2024-09-13T10:19:39.707 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T10:19:39.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T10:19:39.832 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356 branch: wip-aclamk-cbt-combined description: rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-bitmap} rados supported-random-distro$/{centos_latest} thrashers/one workloads/pool-create-delete} email: akupczyk@redhat.com first_in_suite: false job_id: '7903356' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-aclamk-cbt-combined ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos service trim min: 5 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore write v2: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) - slow request - overall HEALTH_ mon_bind_msgr2: false sha1: d58f73069a8157a9ace12a0247ee3e8497707ea9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d58f73069a8157a9ace12a0247ee3e8497707ea9 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-aclamk-cbt-combined sha1: d58f73069a8157a9ace12a0247ee3e8497707ea9 owner: scheduled_akupczyk@teuthology priority: 160 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mon.d - mon.e - osd.0 - osd.1 - osd.2 - - mon.f - mon.g - mon.h - mon.i - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 5394 sha1: d58f73069a8157a9ace12a0247ee3e8497707ea9 sleep_before_teardown: 0 subset: 582/12160 suite: rados suite_branch: wip-aclamk-cbt-combined suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d58f73069a8157a9ace12a0247ee3e8497707ea9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d58f73069a8157a9ace12a0247ee3e8497707ea9 targets: smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI8ndAK7NdG2nwfLHV4oj4McqM56U/KHxWPohiYLp+XbtjjTomUC65ECA5kavgLVzSlhohAIBC+N63PE7XFcbeE= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBeo/s1qt3SuCDc7KptzK6/OHMfLnJKnlnbdX0P5gMVIYYkardtMITCNNpDnGk89yv71fzK2Z2QSl2p6v9eZGD0= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 20 thrash_delay: 1 - exec: client.0: - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_09:37:56 tube: smithi user: akupczyk verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T10:19:39.832 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d58f73069a8157a9ace12a0247ee3e8497707ea9/qa; will attempt to use it 2024-09-13T10:19:39.833 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d58f73069a8157a9ace12a0247ee3e8497707ea9/qa/tasks 2024-09-13T10:19:39.833 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T10:19:39.835 INFO:teuthology.task.internal:Checking packages... 2024-09-13T10:19:39.856 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd58f73069a8157a9ace12a0247ee3e8497707ea9' 2024-09-13T10:19:39.856 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T10:19:39.856 INFO:teuthology.packaging:ref: None 2024-09-13T10:19:39.857 INFO:teuthology.packaging:tag: None 2024-09-13T10:19:39.857 INFO:teuthology.packaging:branch: wip-aclamk-cbt-combined 2024-09-13T10:19:39.857 INFO:teuthology.packaging:sha1: d58f73069a8157a9ace12a0247ee3e8497707ea9 2024-09-13T10:19:39.857 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-aclamk-cbt-combined 2024-09-13T10:19:40.004 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4697.gd58f7306 2024-09-13T10:19:40.006 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T10:19:40.014 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T10:19:40.014 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T10:19:40.030 INFO:teuthology.task.internal:Saving configuration 2024-09-13T10:19:40.047 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T10:19:40.055 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T10:19:40.080 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 10:14:39.997677', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI8ndAK7NdG2nwfLHV4oj4McqM56U/KHxWPohiYLp+XbtjjTomUC65ECA5kavgLVzSlhohAIBC+N63PE7XFcbeE='} 2024-09-13T10:19:40.103 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 10:14:39.998986', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBeo/s1qt3SuCDc7KptzK6/OHMfLnJKnlnbdX0P5gMVIYYkardtMITCNNpDnGk89yv71fzK2Z2QSl2p6v9eZGD0='} 2024-09-13T10:19:40.103 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T10:19:40.111 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'] 2024-09-13T10:19:40.111 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2024-09-13T10:19:40.111 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T10:19:40.174 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f242e637be0>, signals=[15]) 2024-09-13T10:19:40.175 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T10:19:40.184 INFO:teuthology.task.internal:Opening connections... 2024-09-13T10:19:40.184 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T10:19:40.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:19:40.264 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T10:19:40.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:19:40.342 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T10:19:40.350 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-09-13T10:19:40.368 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-09-13T10:19:40.369 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-09-13T10:19:40.435 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-09-13T10:19:40.435 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-09-13T10:19:40.435 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-09-13T10:19:40.435 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-09-13T10:19:40.435 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-09-13T10:19:40.436 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-09-13T10:19:40.436 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T10:19:40.436 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-09-13T10:19:40.436 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-09-13T10:19:40.436 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T10:19:40.436 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-09-13T10:19:40.436 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T10:19:40.436 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T10:19:40.436 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T10:19:40.437 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-09-13T10:19:40.478 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-09-13T10:19:40.512 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-09-13T10:19:40.513 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-09-13T10:19:40.591 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-09-13T10:19:40.591 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-09-13T10:19:40.591 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-09-13T10:19:40.592 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-09-13T10:19:40.592 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-09-13T10:19:40.592 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-09-13T10:19:40.592 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T10:19:40.592 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-09-13T10:19:40.592 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-09-13T10:19:40.592 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T10:19:40.593 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-09-13T10:19:40.593 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T10:19:40.593 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T10:19:40.593 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T10:19:40.593 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-09-13T10:19:40.628 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T10:19:40.964 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T10:19:41.657 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T10:19:41.657 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-09-13T10:19:41.661 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-09-13T10:19:41.680 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T10:19:42.469 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T10:19:42.469 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-09-13T10:19:42.473 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-09-13T10:19:42.565 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T10:19:43.049 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T10:19:43.221 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T10:19:43.221 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.f': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T10:19:43.221 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T10:19:43.222 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T10:19:43.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T10:19:43.239 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-09-13T10:19:43.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T10:19:43.241 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-09-13T10:19:43.298 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-503.el9.x86_64 2024-09-13T10:19:43.298 INFO:teuthology.task.kernel:Running kernel on smithi181: 5.14.0-503.el9.x86_64 2024-09-13T10:19:43.298 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum install -y kernel 2024-09-13T10:19:43.299 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-503.el9.x86_64 2024-09-13T10:19:43.300 INFO:teuthology.task.kernel:Running kernel on smithi195: 5.14.0-503.el9.x86_64 2024-09-13T10:19:43.300 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum install -y kernel 2024-09-13T10:19:45.663 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-13T10:19:45.846 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-13T10:19:47.972 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:00 2024-09-13T10:19:52.264 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-13T10:19:54.557 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-13T10:19:55.386 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-13T10:20:00.883 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T10:20:02.933 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T10:20:02.933 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T10:20:03.018 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:20:03.028 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:20:03.028 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-09-13T10:20:03.028 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:20:03.028 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:20:03.029 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T10:20:03.029 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T10:20:03.029 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T10:20:03.029 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T10:20:03.029 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T10:20:03.029 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:20:03.029 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:20:03.029 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:20:03.029 INFO:teuthology.orchestra.run.smithi195.stdout:Install 4 Packages 2024-09-13T10:20:03.029 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:20:03.030 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 79 M 2024-09-13T10:20:03.030 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 126 M 2024-09-13T10:20:03.031 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:20:03.168 INFO:teuthology.orchestra.run.smithi195.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 246 kB/s | 23 kB 00:00 2024-09-13T10:20:04.179 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-13T10:20:05.885 INFO:teuthology.orchestra.run.smithi195.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.6 MB/s | 16 MB 00:02 2024-09-13T10:20:08.076 INFO:teuthology.orchestra.run.smithi195.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.8 MB/s | 29 MB 00:04 2024-09-13T10:20:08.568 INFO:teuthology.orchestra.run.smithi195.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.3 MB/s | 35 MB 00:05 2024-09-13T10:20:08.568 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:20:08.569 INFO:teuthology.orchestra.run.smithi195.stdout:Total 14 MB/s | 79 MB 00:05 2024-09-13T10:20:09.254 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:20:09.594 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:20:09.594 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:20:10.153 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-13T10:20:10.571 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:20:10.572 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:20:12.371 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-13T10:20:13.004 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:20:13.184 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-13T10:20:13.775 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T10:20:13.852 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T10:20:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T10:20:16.789 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T10:20:18.597 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-09-13T10:20:20.554 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T10:20:20.554 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T10:20:20.640 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:20:20.647 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:20:20.647 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2024-09-13T10:20:20.647 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:20:20.648 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:20:20.648 INFO:teuthology.orchestra.run.smithi181.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T10:20:20.648 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-13T10:20:20.648 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T10:20:20.648 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T10:20:20.648 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T10:20:20.648 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:20:20.648 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:20:20.648 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:20:20.648 INFO:teuthology.orchestra.run.smithi181.stdout:Install 4 Packages 2024-09-13T10:20:20.648 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:20:20.649 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 79 M 2024-09-13T10:20:20.649 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 126 M 2024-09-13T10:20:20.649 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:20:20.790 INFO:teuthology.orchestra.run.smithi181.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 240 kB/s | 23 kB 00:00 2024-09-13T10:20:21.183 INFO:teuthology.orchestra.run.smithi181.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-13T10:20:21.568 INFO:teuthology.orchestra.run.smithi181.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-13T10:20:21.605 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T10:20:21.640 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T10:20:21.875 INFO:teuthology.orchestra.run.smithi181.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-13T10:20:21.875 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:20:21.875 INFO:teuthology.orchestra.run.smithi181.stdout:Total 64 MB/s | 79 MB 00:01 2024-09-13T10:20:22.557 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:20:22.890 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:20:22.890 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:20:23.867 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:20:23.868 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:20:26.308 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:20:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T10:20:26.943 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T10:20:27.058 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T10:20:29.881 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T10:20:30.020 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T10:20:34.876 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T10:20:34.995 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T10:20:39.825 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T10:21:04.798 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T10:21:04.837 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T10:21:05.216 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T10:21:05.217 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T10:21:05.217 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T10:21:05.217 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T10:21:06.067 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T10:21:06.068 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:21:06.068 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:21:06.068 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T10:21:06.068 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T10:21:06.068 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T10:21:06.068 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T10:21:06.068 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:21:06.068 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:21:06.420 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T10:21:06.505 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T10:21:06.505 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T10:21:06.505 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T10:21:06.506 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T10:21:06.506 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T10:21:06.506 INFO:teuthology.task.kernel:Installing distro kernel on mon.f... 2024-09-13T10:21:06.506 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T10:21:06.506 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T10:21:06.564 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T10:21:06.564 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T10:21:06.564 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -qi grub2-tools 2024-09-13T10:21:06.607 INFO:teuthology.orchestra.run.smithi195.stdout:Name : grub2-tools 2024-09-13T10:21:06.607 INFO:teuthology.orchestra.run.smithi195.stdout:Epoch : 1 2024-09-13T10:21:06.607 INFO:teuthology.orchestra.run.smithi195.stdout:Version : 2.06 2024-09-13T10:21:06.607 INFO:teuthology.orchestra.run.smithi195.stdout:Release : 82.el9 2024-09-13T10:21:06.607 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: x86_64 2024-09-13T10:21:06.607 INFO:teuthology.orchestra.run.smithi195.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T10:21:06.607 INFO:teuthology.orchestra.run.smithi195.stdout:Group : Unspecified 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:Size : 8274670 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:License : GPLv3+ 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:Packager : builder@centos.org 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:Vendor : CentOS 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:Summary : Support tools for GRUB. 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:Description : 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T10:21:06.608 INFO:teuthology.orchestra.run.smithi195.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T10:21:06.609 INFO:teuthology.orchestra.run.smithi195.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T10:21:06.609 INFO:teuthology.orchestra.run.smithi195.stdout:hardware devices. 2024-09-13T10:21:06.609 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:21:06.609 INFO:teuthology.orchestra.run.smithi195.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T10:21:06.610 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T10:21:06.610 INFO:teuthology.task.kernel:Updating grub on smithi195 to boot 5.14.0-505.el9.x86_64 2024-09-13T10:21:06.610 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T10:21:07.271 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-09-13T10:21:08.588 INFO:teuthology.orchestra.run.smithi195.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T10:21:08.615 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-09-13T10:21:08.625 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-09-13T10:21:08.641 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.iPzLfTfiHm 2024-09-13T10:21:08.641 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.iPzLfTfiHm 2024-09-13T10:21:08.708 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.iPzLfTfiHm 2024-09-13T10:21:08.866 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.iPzLfTfiHm is 6KB 2024-09-13T10:21:08.915 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.iPzLfTfiHm 2024-09-13T10:21:08.929 DEBUG:teuthology.orchestra.run.smithi195:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T10:21:08.992 INFO:teuthology.orchestra.run.smithi195.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T10:21:08.993 INFO:teuthology.orchestra.run.smithi195.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T10:21:08.993 INFO:teuthology.orchestra.run.smithi195.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T10:21:08.993 INFO:teuthology.orchestra.run.smithi195.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T10:21:08.994 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T10:21:09.140 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2024-09-13T10:21:18.149 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T10:21:18.190 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T10:21:18.520 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T10:21:18.520 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T10:21:18.520 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T10:21:18.520 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T10:21:19.361 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T10:21:19.362 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:21:19.362 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:21:19.362 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T10:21:19.362 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T10:21:19.362 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T10:21:19.362 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T10:21:19.362 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:21:19.362 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:21:19.754 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T10:21:19.840 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T10:21:19.841 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T10:21:19.841 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T10:21:19.841 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T10:21:19.841 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T10:21:19.841 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T10:21:19.841 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T10:21:19.841 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T10:21:19.900 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T10:21:19.900 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T10:21:19.900 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2024-09-13T10:21:19.940 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2024-09-13T10:21:19.940 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2024-09-13T10:21:19.940 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.06 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 82.el9 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:Group : Unspecified 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 8274670 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : builder@centos.org 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T10:21:19.941 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2024-09-13T10:21:19.942 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2024-09-13T10:21:19.942 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:21:19.942 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T10:21:19.942 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T10:21:19.942 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T10:21:19.942 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2024-09-13T10:21:19.942 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:21:19.942 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T10:21:19.943 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T10:21:19.943 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 5.14.0-505.el9.x86_64 2024-09-13T10:21:19.943 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T10:21:20.562 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-09-13T10:21:21.810 INFO:teuthology.orchestra.run.smithi181.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T10:21:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-09-13T10:21:21.848 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-13T10:21:21.863 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.S8fsHCczhI 2024-09-13T10:21:21.864 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.S8fsHCczhI 2024-09-13T10:21:21.930 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.S8fsHCczhI 2024-09-13T10:21:22.065 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.S8fsHCczhI is 6KB 2024-09-13T10:21:22.114 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.S8fsHCczhI 2024-09-13T10:21:22.129 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T10:21:22.192 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T10:21:22.192 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T10:21:22.192 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T10:21:22.192 INFO:teuthology.orchestra.run.smithi181.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T10:21:22.193 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T10:21:22.355 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2024-09-13T10:21:39.157 INFO:teuthology.task.kernel:Checking client mon.f for new kernel version... 2024-09-13T10:21:39.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-09-13T10:21:39.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:21:52.369 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T10:21:52.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-13T10:21:52.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:21:57.693 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-09-13T10:22:06.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-09-13T10:22:06.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:22:09.757 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-09-13T10:22:10.749 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-09-13T10:22:19.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-13T10:22:19.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:22:21.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-09-13T10:22:21.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:22:22.813 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-09-13T10:22:34.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-13T10:22:34.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:22:53.583 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-09-13T10:22:53.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-09-13T10:22:53.954 INFO:teuthology.task.kernel:Checking kernel version of mon.f, want "5.14.0-505.el9.x86_64"... 2024-09-13T10:22:53.955 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-09-13T10:22:53.969 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-505.el9.x86_64 2024-09-13T10:22:53.969 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T10:22:53.969 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T10:22:53.969 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T10:22:54.970 INFO:teuthology.task.kernel:Enabling kdb on mon.f... 2024-09-13T10:22:54.970 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T10:22:55.073 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-09-13T10:22:55.098 DEBUG:teuthology.parallel:result is None 2024-09-13T10:23:06.817 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-13T10:23:07.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-13T10:23:07.234 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T10:23:07.234 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-09-13T10:23:07.250 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-505.el9.x86_64 2024-09-13T10:23:07.250 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T10:23:07.251 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T10:23:07.251 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T10:23:08.251 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T10:23:08.252 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T10:23:08.392 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2024-09-13T10:23:08.412 DEBUG:teuthology.parallel:result is None 2024-09-13T10:23:08.412 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T10:23:08.420 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T10:23:08.420 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T10:23:08.425 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T10:23:08.463 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T10:23:08.469 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T10:23:08.519 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T10:23:08.520 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T10:23:08.523 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T10:23:08.887 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T10:23:08.893 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T10:23:08.893 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T10:23:08.896 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T10:23:08.927 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T10:23:08.927 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T10:23:08.937 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T10:23:08.938 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T10:23:08.940 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T10:23:08.974 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T10:23:08.975 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T10:23:08.981 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T10:23:09.009 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T10:23:09.019 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T10:23:09.019 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T10:23:09.047 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T10:23:09.066 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T10:23:09.147 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T10:23:09.355 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T10:23:09.397 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T10:23:09.440 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:23:09.440 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T10:23:09.505 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T10:23:09.551 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T10:23:09.614 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T10:23:09.658 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T10:23:09.701 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:23:09.701 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T10:23:09.768 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-09-13T10:23:09.770 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-09-13T10:23:09.820 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T10:23:09.859 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T10:23:10.178 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T10:23:10.185 INFO:teuthology.task.internal:Starting timer... 2024-09-13T10:23:10.186 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T10:23:10.240 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T10:23:10.264 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-09-13T10:23:10.328 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-09-13T10:23:10.330 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-09-13T10:23:10.390 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-09-13T10:23:10.392 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T10:23:10.392 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-09-13T10:23:10.432 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-09-13T10:23:10.432 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-09-13T10:23:10.484 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-09-13T10:23:10.484 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi181.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-09-13T10:23:10.484 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T10:23:10.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T10:23:10.510 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T10:23:10.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T10:23:10.537 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T10:23:10.537 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-09-13T10:23:10.581 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-09-13T10:23:10.616 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T10:23:10.628 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T10:23:10.630 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T10:23:10.741 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T10:23:10.751 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T10:23:10.752 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi181.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T10:27:05.534 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi181.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-09-13T10:27:05.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-13T10:27:05.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:27:05.613 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-09-13T10:27:05.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-09-13T10:27:05.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-09-13T10:27:05.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:27:05.767 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-09-13T10:27:05.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-09-13T10:27:05.845 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T10:27:05.855 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T10:27:05.856 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T10:27:05.856 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T10:27:05.858 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T10:27:05.858 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T10:27:05.886 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T10:27:05.901 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T10:27:05.916 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T10:27:05.925 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-09-13T10:27:05.931 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T10:27:05.936 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-09-13T10:27:05.950 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T10:27:05.955 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-09-13T10:27:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T10:27:05.966 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-09-13T10:27:05.981 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T10:27:05.995 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T10:27:06.017 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-13T10:27:06.020 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T10:27:06.020 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-13T10:27:06.020 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T10:27:06.020 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T10:27:06.020 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T10:27:06.021 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T10:27:06.049 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-09-13T10:27:06.052 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T10:27:06.052 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-09-13T10:27:06.052 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T10:27:06.052 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T10:27:06.052 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T10:27:06.052 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T10:27:06.053 INFO:teuthology.run_tasks:Running task install... 2024-09-13T10:27:06.061 DEBUG:teuthology.task.install:project ceph 2024-09-13T10:27:06.061 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9'}} 2024-09-13T10:27:06.061 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9'} 2024-09-13T10:27:06.062 INFO:teuthology.task.install:Using flavor: default 2024-09-13T10:27:06.067 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T10:27:06.067 INFO:teuthology.task.install:extra packages: [] 2024-09-13T10:27:06.067 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9', 'tag': None, 'wait_for_package': False} 2024-09-13T10:27:06.068 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d58f73069a8157a9ace12a0247ee3e8497707ea9 2024-09-13T10:27:06.070 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9', 'tag': None, 'wait_for_package': False} 2024-09-13T10:27:06.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d58f73069a8157a9ace12a0247ee3e8497707ea9 2024-09-13T10:27:06.211 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/centos/9/flavors/default/ 2024-09-13T10:27:06.212 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4697.gd58f7306 2024-09-13T10:27:06.221 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/centos/9/flavors/default/ 2024-09-13T10:27:06.221 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4697.gd58f7306 2024-09-13T10:27:06.323 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T10:27:06.323 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:27:06.323 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T10:27:06.342 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T10:27:06.342 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:27:06.342 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T10:27:06.349 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T10:27:06.349 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d58f73069a8157a9ace12a0247ee3e8497707ea9/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T10:27:06.368 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T10:27:06.369 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d58f73069a8157a9ace12a0247ee3e8497707ea9/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T10:27:06.414 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T10:27:06.434 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T10:27:06.489 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T10:27:06.510 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T10:27:06.553 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-09-13T10:27:06.554 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-09-13T10:27:06.574 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-09-13T10:27:06.576 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-09-13T10:27:06.796 INFO:teuthology.orchestra.run.smithi181.stdout:45 files removed 2024-09-13T10:27:06.823 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw 2024-09-13T10:27:06.865 INFO:teuthology.orchestra.run.smithi195.stdout:45 files removed 2024-09-13T10:27:06.892 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw 2024-09-13T10:27:07.382 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-13T10:27:07.447 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-13T10:27:07.682 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-13T10:27:07.781 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 83 kB/s | 24 kB 00:00 2024-09-13T10:27:07.966 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-13T10:27:08.048 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-13T10:27:08.449 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-13T10:27:09.756 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-13T10:27:10.501 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-13T10:27:13.041 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 20 MB 00:02 2024-09-13T10:27:15.260 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.5 MB 00:00 2024-09-13T10:27:17.552 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-13T10:27:18.066 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.5 MB 00:01 2024-09-13T10:27:18.315 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-13T10:27:19.517 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 19 kB 00:00 2024-09-13T10:27:20.265 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-13T10:27:23.787 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T10:27:25.779 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T10:27:26.122 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:27:26.131 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:27:26.132 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-13T10:27:26.132 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:27:26.132 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:27:26.132 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 11 M 2024-09-13T10:27:26.132 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-09-13T10:27:26.132 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 3.5 M 2024-09-13T10:27:26.132 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 3.2 M 2024-09-13T10:27:26.132 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-13T10:27:26.132 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 5.5 M 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 22 M 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 25 k 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 755 k 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 508 k 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T10:27:26.133 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 5.5 M 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 45 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 143 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 161 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 321 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 305 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 99 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T10:27:26.134 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T10:27:26.135 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-09-13T10:27:26.135 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-13T10:27:26.135 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:27:26.135 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:27:26.135 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:27:26.135 INFO:teuthology.orchestra.run.smithi181.stdout:Install 30 Packages 2024-09-13T10:27:26.135 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 2 Packages 2024-09-13T10:27:26.135 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:27:26.135 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 62 M 2024-09-13T10:27:26.136 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:27:27.088 INFO:teuthology.orchestra.run.smithi181.stdout:(1/32): ceph-base-19.3.0-4697.gd58f7306.el9.x86 10 MB/s | 5.5 MB 00:00 2024-09-13T10:27:27.155 INFO:teuthology.orchestra.run.smithi181.stdout:(2/32): ceph-selinux-19.3.0-4697.gd58f7306.el9. 378 kB/s | 25 kB 00:00 2024-09-13T10:27:27.255 INFO:teuthology.orchestra.run.smithi181.stdout:(3/32): libcephfs2-19.3.0-4697.gd58f7306.el9.x8 7.4 MB/s | 755 kB 00:00 2024-09-13T10:27:27.381 INFO:teuthology.orchestra.run.smithi181.stdout:(4/32): ceph-radosgw-19.3.0-4697.gd58f7306.el9. 13 MB/s | 11 MB 00:00 2024-09-13T10:27:27.414 INFO:teuthology.orchestra.run.smithi181.stdout:(5/32): libradosstriper1-19.3.0-4697.gd58f7306. 3.1 MB/s | 508 kB 00:00 2024-09-13T10:27:27.482 INFO:teuthology.orchestra.run.smithi181.stdout:(6/32): python3-ceph-argparse-19.3.0-4697.gd58f 675 kB/s | 45 kB 00:00 2024-09-13T10:27:27.565 INFO:teuthology.orchestra.run.smithi181.stdout:(7/32): python3-ceph-common-19.3.0-4697.gd58f73 1.7 MB/s | 143 kB 00:00 2024-09-13T10:27:27.640 INFO:teuthology.orchestra.run.smithi181.stdout:(8/32): librgw2-19.3.0-4697.gd58f7306.el9.x86_6 21 MB/s | 5.5 MB 00:00 2024-09-13T10:27:27.674 INFO:teuthology.orchestra.run.smithi181.stdout:(9/32): python3-cephfs-19.3.0-4697.gd58f7306.el 1.4 MB/s | 161 kB 00:00 2024-09-13T10:27:27.699 INFO:teuthology.orchestra.run.smithi181.stdout:(10/32): python3-rados-19.3.0-4697.gd58f7306.el 5.3 MB/s | 321 kB 00:00 2024-09-13T10:27:27.725 INFO:teuthology.orchestra.run.smithi181.stdout:(11/32): python3-rbd-19.3.0-4697.gd58f7306.el9. 6.0 MB/s | 305 kB 00:00 2024-09-13T10:27:27.750 INFO:teuthology.orchestra.run.smithi181.stdout:(12/32): python3-rgw-19.3.0-4697.gd58f7306.el9. 1.9 MB/s | 99 kB 00:00 2024-09-13T10:27:27.975 INFO:teuthology.orchestra.run.smithi181.stdout:(13/32): ceph-common-19.3.0-4697.gd58f7306.el9. 15 MB/s | 22 MB 00:01 2024-09-13T10:27:28.084 INFO:teuthology.orchestra.run.smithi181.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 419 kB/s | 45 kB 00:00 2024-09-13T10:27:28.109 INFO:teuthology.orchestra.run.smithi181.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 278 kB/s | 107 kB 00:00 2024-09-13T10:27:28.134 INFO:teuthology.orchestra.run.smithi181.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 417 kB/s | 160 kB 00:00 2024-09-13T10:27:28.165 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:27:28.185 INFO:teuthology.orchestra.run.smithi181.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-09-13T10:27:28.193 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:27:28.193 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T10:27:28.193 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 11 M 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 3.5 M 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 3.2 M 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 5.5 M 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 22 M 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 25 k 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T10:27:28.194 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 755 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 508 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 5.5 M 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 45 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 143 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 161 k 2024-09-13T10:27:28.195 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T10:27:28.196 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 321 k 2024-09-13T10:27:28.196 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 305 k 2024-09-13T10:27:28.196 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 99 k 2024-09-13T10:27:28.196 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-13T10:27:28.196 INFO:teuthology.orchestra.run.smithi195.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-13T10:27:28.196 INFO:teuthology.orchestra.run.smithi195.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T10:27:28.196 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T10:27:28.196 INFO:teuthology.orchestra.run.smithi195.stdout:Installing weak dependencies: 2024-09-13T10:27:28.196 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-13T10:27:28.196 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:27:28.196 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:27:28.196 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:27:28.197 INFO:teuthology.orchestra.run.smithi195.stdout:Install 30 Packages 2024-09-13T10:27:28.197 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 2 Packages 2024-09-13T10:27:28.197 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:27:28.197 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 62 M 2024-09-13T10:27:28.197 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:27:28.243 INFO:teuthology.orchestra.run.smithi181.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-13T10:27:28.268 INFO:teuthology.orchestra.run.smithi181.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-13T10:27:28.285 INFO:teuthology.orchestra.run.smithi181.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 857 kB/s | 36 kB 00:00 2024-09-13T10:27:28.311 INFO:teuthology.orchestra.run.smithi181.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-13T10:27:28.344 INFO:teuthology.orchestra.run.smithi181.stdout:(22/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 5.1 MB/s | 308 kB 00:00 2024-09-13T10:27:28.361 INFO:teuthology.orchestra.run.smithi181.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.7 MB/s | 26 kB 00:00 2024-09-13T10:27:28.386 INFO:teuthology.orchestra.run.smithi181.stdout:(24/32): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 662 kB 00:00 2024-09-13T10:27:28.403 INFO:teuthology.orchestra.run.smithi181.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-13T10:27:28.462 INFO:teuthology.orchestra.run.smithi181.stdout:(26/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-13T10:27:28.487 INFO:teuthology.orchestra.run.smithi181.stdout:(27/32): libunwind-1.6.2-1.el9.x86_64.rpm 671 kB/s | 67 kB 00:00 2024-09-13T10:27:28.512 INFO:teuthology.orchestra.run.smithi181.stdout:(28/32): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-13T10:27:28.596 INFO:teuthology.orchestra.run.smithi181.stdout:(29/32): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-13T10:27:28.638 INFO:teuthology.orchestra.run.smithi181.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-13T10:27:28.780 INFO:teuthology.orchestra.run.smithi181.stdout:(31/32): librados2-19.3.0-4697.gd58f7306.el9.x8 13 MB/s | 3.5 MB 00:00 2024-09-13T10:27:28.839 INFO:teuthology.orchestra.run.smithi181.stdout:(32/32): librbd1-19.3.0-4697.gd58f7306.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-13T10:27:28.843 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:27:28.843 INFO:teuthology.orchestra.run.smithi181.stdout:Total 23 MB/s | 62 MB 00:02 2024-09-13T10:27:28.942 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:27:28.977 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:27:28.977 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:27:29.606 INFO:teuthology.orchestra.run.smithi195.stdout:(1/32): ceph-base-19.3.0-4697.gd58f7306.el9.x86 5.6 MB/s | 5.5 MB 00:00 2024-09-13T10:27:29.656 INFO:teuthology.orchestra.run.smithi195.stdout:(2/32): ceph-selinux-19.3.0-4697.gd58f7306.el9. 506 kB/s | 25 kB 00:00 2024-09-13T10:27:29.673 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:27:29.673 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:27:29.781 INFO:teuthology.orchestra.run.smithi195.stdout:(3/32): libcephfs2-19.3.0-4697.gd58f7306.el9.x8 5.9 MB/s | 755 kB 00:00 2024-09-13T10:27:29.940 INFO:teuthology.orchestra.run.smithi195.stdout:(4/32): ceph-radosgw-19.3.0-4697.gd58f7306.el9. 8.3 MB/s | 11 MB 00:01 2024-09-13T10:27:29.965 INFO:teuthology.orchestra.run.smithi195.stdout:(5/32): libradosstriper1-19.3.0-4697.gd58f7306. 2.7 MB/s | 508 kB 00:00 2024-09-13T10:27:30.023 INFO:teuthology.orchestra.run.smithi195.stdout:(6/32): python3-ceph-argparse-19.3.0-4697.gd58f 775 kB/s | 45 kB 00:00 2024-09-13T10:27:30.090 INFO:teuthology.orchestra.run.smithi195.stdout:(7/32): python3-ceph-common-19.3.0-4697.gd58f73 2.1 MB/s | 143 kB 00:00 2024-09-13T10:27:30.157 INFO:teuthology.orchestra.run.smithi195.stdout:(8/32): python3-cephfs-19.3.0-4697.gd58f7306.el 2.4 MB/s | 161 kB 00:00 2024-09-13T10:27:30.274 INFO:teuthology.orchestra.run.smithi195.stdout:(9/32): librgw2-19.3.0-4697.gd58f7306.el9.x86_6 16 MB/s | 5.5 MB 00:00 2024-09-13T10:27:30.300 INFO:teuthology.orchestra.run.smithi195.stdout:(10/32): python3-rados-19.3.0-4697.gd58f7306.el 2.2 MB/s | 321 kB 00:00 2024-09-13T10:27:30.508 INFO:teuthology.orchestra.run.smithi195.stdout:(11/32): ceph-common-19.3.0-4697.gd58f7306.el9. 11 MB/s | 22 MB 00:01 2024-09-13T10:27:30.534 INFO:teuthology.orchestra.run.smithi195.stdout:(12/32): python3-rgw-19.3.0-4697.gd58f7306.el9. 425 kB/s | 99 kB 00:00 2024-09-13T10:27:30.559 INFO:teuthology.orchestra.run.smithi195.stdout:(13/32): python3-rbd-19.3.0-4697.gd58f7306.el9. 1.1 MB/s | 305 kB 00:00 2024-09-13T10:27:30.617 INFO:teuthology.orchestra.run.smithi195.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 985 kB/s | 107 kB 00:00 2024-09-13T10:27:30.643 INFO:teuthology.orchestra.run.smithi195.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-09-13T10:27:30.668 INFO:teuthology.orchestra.run.smithi195.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-13T10:27:30.702 INFO:teuthology.orchestra.run.smithi195.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-13T10:27:30.719 INFO:teuthology.orchestra.run.smithi195.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 843 kB/s | 42 kB 00:00 2024-09-13T10:27:30.744 INFO:teuthology.orchestra.run.smithi195.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 5.1 MB/s | 221 kB 00:00 2024-09-13T10:27:30.769 INFO:teuthology.orchestra.run.smithi195.stdout:(20/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-13T10:27:30.795 INFO:teuthology.orchestra.run.smithi195.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 475 kB/s | 36 kB 00:00 2024-09-13T10:27:30.820 INFO:teuthology.orchestra.run.smithi195.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-13T10:27:30.879 INFO:teuthology.orchestra.run.smithi195.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.6 MB/s | 308 kB 00:00 2024-09-13T10:27:30.903 INFO:teuthology.orchestra.run.smithi195.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-09-13T10:27:30.929 INFO:teuthology.orchestra.run.smithi195.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 973 kB/s | 49 kB 00:00 2024-09-13T10:27:30.954 INFO:teuthology.orchestra.run.smithi195.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T10:27:30.988 INFO:teuthology.orchestra.run.smithi195.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T10:27:31.021 INFO:teuthology.orchestra.run.smithi195.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-13T10:27:31.099 INFO:teuthology.orchestra.run.smithi195.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-13T10:27:31.189 INFO:teuthology.orchestra.run.smithi195.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-13T10:27:31.203 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:27:31.289 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-13T10:27:31.319 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-13T10:27:31.344 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-13T10:27:31.347 INFO:teuthology.orchestra.run.smithi195.stdout:(31/32): librbd1-19.3.0-4697.gd58f7306.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-13T10:27:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T10:27:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T10:27:31.431 INFO:teuthology.orchestra.run.smithi195.stdout:(32/32): librados2-19.3.0-4697.gd58f7306.el9.x8 8.5 MB/s | 3.5 MB 00:00 2024-09-13T10:27:31.436 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:27:31.436 INFO:teuthology.orchestra.run.smithi195.stdout:Total 19 MB/s | 62 MB 00:03 2024-09-13T10:27:31.537 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:27:31.561 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T10:27:31.572 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:27:31.572 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:27:31.612 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T10:27:31.999 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-13T10:27:32.054 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.3.0-4697.gd58f7306.el9.x86_64 7/34 2024-09-13T10:27:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.3.0-4697.gd58f7306.el9.x86_64 7/34 2024-09-13T10:27:32.233 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.3.0-4697.gd58f7306.el9.x86_64 8/34 2024-09-13T10:27:32.250 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:27:32.250 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:27:32.263 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.3.0-4697.gd58f7306.el9.x86_64 9/34 2024-09-13T10:27:32.309 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.3.0-4697.gd58f7306.el9.x86_64 9/34 2024-09-13T10:27:32.338 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-13T10:27:32.381 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.3.0-4697.gd58f7306.el9. 11/34 2024-09-13T10:27:32.450 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.3.0-4697.gd58f7306.el9.x86_64 12/34 2024-09-13T10:27:32.483 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.3.0-4697.gd58f7306.el9.x86_6 13/34 2024-09-13T10:27:32.546 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4697.gd58f7306.el9.x86_6 13/34 2024-09-13T10:27:32.581 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-13T10:27:32.687 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-13T10:27:32.715 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-13T10:27:32.756 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-13T10:27:32.797 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-13T10:27:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-13T10:27:32.867 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-13T10:27:33.187 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-13T10:27:33.222 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.3.0-4697.gd58f7306.el9.x86_64 22/34 2024-09-13T10:27:33.297 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.3.0-4697.gd58f7306.el9.x86_64 22/34 2024-09-13T10:27:33.326 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.3.0-4697.gd58f7306.el9.x86_64 23/34 2024-09-13T10:27:33.362 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-13T10:27:33.853 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-13T10:27:33.874 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.3.0-4697.gd58f7306.el9.x86_64 26/34 2024-09-13T10:27:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:27:33.946 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.3.0-4697.gd58f7306.el9.x86_64 26/34 2024-09-13T10:27:33.990 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-13T10:27:34.015 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.3.0-4697.gd58f7306.el9.x86_64 27/34 2024-09-13T10:27:34.019 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-13T10:27:34.043 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.3.0-4697.gd58f7306.el9.x8 28/34 2024-09-13T10:27:34.044 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-13T10:27:34.067 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T10:27:34.093 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T10:27:34.320 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T10:27:34.373 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T10:27:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-13T10:27:34.846 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:19.3.0-4697.gd58f7306.el9.x86_64 7/34 2024-09-13T10:27:34.922 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:19.3.0-4697.gd58f7306.el9.x86_64 7/34 2024-09-13T10:27:35.018 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:19.3.0-4697.gd58f7306.el9.x86_64 8/34 2024-09-13T10:27:35.048 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:19.3.0-4697.gd58f7306.el9.x86_64 9/34 2024-09-13T10:27:35.094 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:19.3.0-4697.gd58f7306.el9.x86_64 9/34 2024-09-13T10:27:35.122 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-13T10:27:35.166 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:19.3.0-4697.gd58f7306.el9. 11/34 2024-09-13T10:27:35.236 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:19.3.0-4697.gd58f7306.el9.x86_64 12/34 2024-09-13T10:27:35.258 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:19.3.0-4697.gd58f7306.el9.x86_6 13/34 2024-09-13T10:27:35.305 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4697.gd58f7306.el9.x86_6 13/34 2024-09-13T10:27:35.340 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-13T10:27:35.448 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-13T10:27:35.483 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-13T10:27:35.524 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-13T10:27:35.564 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-13T10:27:35.593 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-13T10:27:35.633 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-13T10:27:35.954 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-13T10:27:35.997 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:19.3.0-4697.gd58f7306.el9.x86_64 22/34 2024-09-13T10:27:36.080 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:19.3.0-4697.gd58f7306.el9.x86_64 22/34 2024-09-13T10:27:36.111 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:19.3.0-4697.gd58f7306.el9.x86_64 23/34 2024-09-13T10:27:36.155 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-13T10:27:36.522 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.3.0-4697.gd58f7306.el9.x86_64 29/34 2024-09-13T10:27:36.564 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.3.0-4697.gd58f7306.el9.x86_64 29/34 2024-09-13T10:27:36.647 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-13T10:27:36.683 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:19.3.0-4697.gd58f7306.el9.x86_64 26/34 2024-09-13T10:27:36.746 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:19.3.0-4697.gd58f7306.el9.x86_64 26/34 2024-09-13T10:27:36.832 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:19.3.0-4697.gd58f7306.el9.x86_64 27/34 2024-09-13T10:27:36.869 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:19.3.0-4697.gd58f7306.el9.x8 28/34 2024-09-13T10:27:37.145 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.3.0-4697.gd58f7306.el9.x86_64 29/34 2024-09-13T10:27:37.184 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.3.0-4697.gd58f7306.el9.x86_64 30/34 2024-09-13T10:27:37.276 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.3.0-4697.gd58f7306.el9.x86_64 30/34 2024-09-13T10:27:37.276 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T10:27:37.276 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T10:27:37.276 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:27:37.319 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.3.0-4697.gd58f7306.el9.x86_64 31/34 2024-09-13T10:27:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.3.0-4697.gd58f7306.el9.x86_64 29/34 2024-09-13T10:27:39.223 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:19.3.0-4697.gd58f7306.el9.x86_64 29/34 2024-09-13T10:27:39.818 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.3.0-4697.gd58f7306.el9.x86_64 29/34 2024-09-13T10:27:39.860 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:19.3.0-4697.gd58f7306.el9.x86_64 30/34 2024-09-13T10:27:39.947 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:19.3.0-4697.gd58f7306.el9.x86_64 30/34 2024-09-13T10:27:39.947 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T10:27:39.947 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T10:27:39.947 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:27:39.986 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:19.3.0-4697.gd58f7306.el9.x86_64 31/34 2024-09-13T10:27:47.316 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4697.gd58f7306.el9.x86_64 31/34 2024-09-13T10:27:47.316 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-09-13T10:27:47.317 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-09-13T10:27:47.317 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-09-13T10:27:47.317 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-09-13T10:27:47.317 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-09-13T10:27:47.317 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-09-13T10:27:47.317 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-09-13T10:27:47.317 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:27:48.362 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.3.0-4697.gd58f7306.el9.x86_64 32/34 2024-09-13T10:27:48.388 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4697.gd58f7306.el9.x86_64 32/34 2024-09-13T10:27:48.388 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:27:48.389 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T10:27:48.389 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T10:27:48.389 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T10:27:48.389 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:27:48.390 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T10:27:48.480 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T10:27:48.481 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T10:27:49.676 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T10:27:49.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.3.0-4697.gd58f7306.el9.x86_64 1/34 2024-09-13T10:27:49.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.3.0-4697.gd58f7306.el9.x86_64 2/34 2024-09-13T10:27:49.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.3.0-4697.gd58f7306.el9.x86_64 3/34 2024-09-13T10:27:49.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.3.0-4697.gd58f7306.el9.x86_64 4/34 2024-09-13T10:27:49.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.3.0-4697.gd58f7306.el9.x86_64 5/34 2024-09-13T10:27:49.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.3.0-4697.gd58f7306.el9.x86_6 6/34 2024-09-13T10:27:49.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.3.0-4697.gd58f7306.el9.x86_64 7/34 2024-09-13T10:27:49.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4697.gd58f7306.el9. 8/34 2024-09-13T10:27:49.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.3.0-4697.gd58f7306.el9.x8 9/34 2024-09-13T10:27:49.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.3.0-4697.gd58f7306.el9.x86_64 10/34 2024-09-13T10:27:49.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.3.0-4697.gd58f7306.el9.x86_64 11/34 2024-09-13T10:27:49.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.3.0-4697.gd58f7306.el9.x86_64 12/34 2024-09-13T10:27:49.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.3.0-4697.gd58f7306.el9.x86_64 13/34 2024-09-13T10:27:49.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-13T10:27:49.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-13T10:27:49.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-13T10:27:49.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-13T10:27:49.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-13T10:27:49.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-13T10:27:49.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-13T10:27:49.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-13T10:27:49.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-13T10:27:49.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-13T10:27:49.681 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-13T10:27:49.681 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-13T10:27:49.681 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-13T10:27:49.681 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-13T10:27:49.681 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-13T10:27:49.681 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-13T10:27:49.681 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-13T10:27:49.681 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.3.0-4697.gd58f7306.el9.x86_64 31/34 2024-09-13T10:27:49.682 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-13T10:27:49.682 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.3.0-4697.gd58f7306.el9.x86_64 33/34 2024-09-13T10:27:50.203 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4697.gd58f7306.el9.x86_64 31/34 2024-09-13T10:27:50.203 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-09-13T10:27:50.203 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-09-13T10:27:50.203 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-09-13T10:27:50.203 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-09-13T10:27:50.203 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-09-13T10:27:50.203 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /root 2024-09-13T10:27:50.203 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-09-13T10:27:50.204 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:27:50.663 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T10:27:50.663 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:27:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-09-13T10:27:50.663 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.663 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.663 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:27:50.663 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T10:27:50.663 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.663 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.664 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-13T10:27:50.665 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T10:27:50.666 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T10:27:50.666 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:27:50.666 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:27:51.026 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-test 2024-09-13T10:27:51.181 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:19.3.0-4697.gd58f7306.el9.x86_64 32/34 2024-09-13T10:27:51.205 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4697.gd58f7306.el9.x86_64 32/34 2024-09-13T10:27:51.205 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:27:51.205 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T10:27:51.206 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T10:27:51.206 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T10:27:51.206 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:27:51.206 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T10:27:51.305 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T10:27:51.305 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T10:27:51.596 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:00:28 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:27:51.733 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:27:51.734 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:27:51.734 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-13T10:27:51.734 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:27:51.734 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:27:51.734 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 50 M 2024-09-13T10:27:51.734 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-13T10:27:51.734 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 161 k 2024-09-13T10:27:51.734 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T10:27:51.734 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T10:27:51.734 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:27:51.734 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:27:51.735 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:27:51.735 INFO:teuthology.orchestra.run.smithi181.stdout:Install 4 Packages 2024-09-13T10:27:51.735 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:27:51.735 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 51 M 2024-09-13T10:27:51.735 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 216 M 2024-09-13T10:27:51.735 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:27:52.003 INFO:teuthology.orchestra.run.smithi181.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-13T10:27:52.044 INFO:teuthology.orchestra.run.smithi181.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-13T10:27:52.086 INFO:teuthology.orchestra.run.smithi181.stdout:(3/4): libcephsqlite-19.3.0-4697.gd58f7306.el9. 719 kB/s | 161 kB 00:00 2024-09-13T10:27:52.446 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T10:27:52.446 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:19.3.0-4697.gd58f7306.el9.x86_64 1/34 2024-09-13T10:27:52.446 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:19.3.0-4697.gd58f7306.el9.x86_64 2/34 2024-09-13T10:27:52.446 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:19.3.0-4697.gd58f7306.el9.x86_64 3/34 2024-09-13T10:27:52.446 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:19.3.0-4697.gd58f7306.el9.x86_64 4/34 2024-09-13T10:27:52.446 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:19.3.0-4697.gd58f7306.el9.x86_64 5/34 2024-09-13T10:27:52.446 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:19.3.0-4697.gd58f7306.el9.x86_6 6/34 2024-09-13T10:27:52.446 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:19.3.0-4697.gd58f7306.el9.x86_64 7/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4697.gd58f7306.el9. 8/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:19.3.0-4697.gd58f7306.el9.x8 9/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:19.3.0-4697.gd58f7306.el9.x86_64 10/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:19.3.0-4697.gd58f7306.el9.x86_64 11/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:19.3.0-4697.gd58f7306.el9.x86_64 12/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:19.3.0-4697.gd58f7306.el9.x86_64 13/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-13T10:27:52.447 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-13T10:27:52.448 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-13T10:27:52.448 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-13T10:27:52.448 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-13T10:27:52.448 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-13T10:27:52.448 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-13T10:27:52.448 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-13T10:27:52.448 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-13T10:27:52.448 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-13T10:27:52.449 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-13T10:27:52.449 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-13T10:27:52.449 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:19.3.0-4697.gd58f7306.el9.x86_64 31/34 2024-09-13T10:27:52.449 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-13T10:27:52.449 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:19.3.0-4697.gd58f7306.el9.x86_64 33/34 2024-09-13T10:27:53.420 INFO:teuthology.orchestra.run.smithi181.stdout:(4/4): ceph-test-19.3.0-4697.gd58f7306.el9.x86_ 32 MB/s | 50 MB 00:01 2024-09-13T10:27:53.421 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:27:53.422 INFO:teuthology.orchestra.run.smithi181.stdout:Total 30 MB/s | 51 MB 00:01 2024-09-13T10:27:53.450 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:27:53.470 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:27:53.470 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:27:53.568 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T10:27:53.569 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:27:53.569 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-09-13T10:27:53.569 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.569 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.569 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:27:53.569 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T10:27:53.569 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.569 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.569 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.569 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.569 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T10:27:53.570 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:27:53.571 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:27:53.848 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:27:53.849 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:27:53.954 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-test 2024-09-13T10:27:54.385 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:27:54.468 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T10:27:54.512 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T10:27:54.515 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:29 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:27:54.538 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.3.0-4697.gd58f7306.el9.x86_64 3/4 2024-09-13T10:27:54.653 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:27:54.653 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:27:54.653 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T10:27:54.654 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:27:54.654 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:27:54.654 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 50 M 2024-09-13T10:27:54.654 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T10:27:54.654 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 161 k 2024-09-13T10:27:54.654 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T10:27:54.654 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T10:27:54.654 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:27:54.654 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:27:54.654 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:27:54.654 INFO:teuthology.orchestra.run.smithi195.stdout:Install 4 Packages 2024-09-13T10:27:54.654 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:27:54.655 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 51 M 2024-09-13T10:27:54.655 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 216 M 2024-09-13T10:27:54.655 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:27:54.911 INFO:teuthology.orchestra.run.smithi195.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-13T10:27:54.936 INFO:teuthology.orchestra.run.smithi195.stdout:(2/4): libcephsqlite-19.3.0-4697.gd58f7306.el9. 688 kB/s | 161 kB 00:00 2024-09-13T10:27:54.961 INFO:teuthology.orchestra.run.smithi195.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T10:27:56.270 INFO:teuthology.orchestra.run.smithi195.stdout:(4/4): ceph-test-19.3.0-4697.gd58f7306.el9.x86_ 32 MB/s | 50 MB 00:01 2024-09-13T10:27:56.272 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:27:56.272 INFO:teuthology.orchestra.run.smithi195.stdout:Total 31 MB/s | 51 MB 00:01 2024-09-13T10:27:56.301 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:27:56.321 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:27:56.321 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:27:56.700 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:27:56.700 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:27:57.237 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:27:57.317 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T10:27:57.375 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T10:27:57.405 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:19.3.0-4697.gd58f7306.el9.x86_64 3/4 2024-09-13T10:27:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4697.gd58f7306.el9.x86_64 3/4 2024-09-13T10:27:59.353 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.3.0-4697.gd58f7306.el9.x86_64 4/4 2024-09-13T10:28:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-test-2:19.3.0-4697.gd58f7306.el9.x86_64 4/4 2024-09-13T10:28:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.3.0-4697.gd58f7306.el9.x86_64 1/4 2024-09-13T10:28:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.3.0-4697.gd58f7306.el9.x86_64 2/4 2024-09-13T10:28:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T10:28:02.126 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T10:28:02.126 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:02.126 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:28:02.126 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:02.126 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:02.126 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T10:28:02.126 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T10:28:02.126 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:02.126 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:02.162 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4697.gd58f7306.el9.x86_64 3/4 2024-09-13T10:28:02.244 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:19.3.0-4697.gd58f7306.el9.x86_64 4/4 2024-09-13T10:28:02.400 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph 2024-09-13T10:28:02.974 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:00:39 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:28:03.110 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:28:03.113 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:03.113 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-13T10:28:03.113 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:03.113 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:28:03.114 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 6.6 k 2024-09-13T10:28:03.114 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-13T10:28:03.114 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 2.4 M 2024-09-13T10:28:03.114 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 1.5 M 2024-09-13T10:28:03.114 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 291 k 2024-09-13T10:28:03.114 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 4.8 M 2024-09-13T10:28:03.115 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 17 M 2024-09-13T10:28:03.115 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-13T10:28:03.115 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-13T10:28:03.115 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-13T10:28:03.115 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T10:28:03.115 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T10:28:03.116 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T10:28:03.116 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T10:28:03.116 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T10:28:03.116 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T10:28:03.116 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T10:28:03.116 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections 2024-09-13T10:28:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-13T10:28:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T10:28:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T10:28:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T10:28:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T10:28:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T10:28:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T10:28:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T10:28:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T10:28:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T10:28:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T10:28:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T10:28:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T10:28:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T10:28:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T10:28:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T10:28:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T10:28:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T10:28:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T10:28:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T10:28:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T10:28:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:03.120 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:28:03.120 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:03.120 INFO:teuthology.orchestra.run.smithi181.stdout:Install 37 Packages 2024-09-13T10:28:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:03.121 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 31 M 2024-09-13T10:28:03.121 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 109 M 2024-09-13T10:28:03.121 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:28:03.795 INFO:teuthology.orchestra.run.smithi181.stdout:(1/37): ceph-19.3.0-4697.gd58f7306.el9.x86_64.r 53 kB/s | 6.6 kB 00:00 2024-09-13T10:28:03.995 INFO:teuthology.orchestra.run.smithi181.stdout:(2/37): ceph-mgr-19.3.0-4697.gd58f7306.el9.x86_ 4.7 MB/s | 1.5 MB 00:00 2024-09-13T10:28:04.046 INFO:teuthology.orchestra.run.smithi181.stdout:(3/37): ceph-mds-19.3.0-4697.gd58f7306.el9.x86_ 6.3 MB/s | 2.4 MB 00:00 2024-09-13T10:28:04.146 INFO:teuthology.orchestra.run.smithi181.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4697.gd58f 2.8 MB/s | 291 kB 00:00 2024-09-13T10:28:04.263 INFO:teuthology.orchestra.run.smithi181.stdout:(5/37): ceph-mon-19.3.0-4697.gd58f7306.el9.x86_ 10 MB/s | 4.8 MB 00:00 2024-09-13T10:28:04.413 INFO:teuthology.orchestra.run.smithi181.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 949 kB/s | 253 kB 00:00 2024-09-13T10:28:04.580 INFO:teuthology.orchestra.run.smithi181.stdout:(7/37): ceph-osd-19.3.0-4697.gd58f7306.el9.x86_ 29 MB/s | 17 MB 00:00 2024-09-13T10:28:04.605 INFO:teuthology.orchestra.run.smithi181.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 555 kB/s | 106 kB 00:00 2024-09-13T10:28:04.647 INFO:teuthology.orchestra.run.smithi181.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-13T10:28:04.662 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-test-2:19.3.0-4697.gd58f7306.el9.x86_64 4/4 2024-09-13T10:28:04.663 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:19.3.0-4697.gd58f7306.el9.x86_64 1/4 2024-09-13T10:28:04.663 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:19.3.0-4697.gd58f7306.el9.x86_64 2/4 2024-09-13T10:28:04.663 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T10:28:04.706 INFO:teuthology.orchestra.run.smithi181.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.8 MB/s | 1.2 MB 00:00 2024-09-13T10:28:04.731 INFO:teuthology.orchestra.run.smithi181.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-13T10:28:04.807 INFO:teuthology.orchestra.run.smithi181.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 598 kB/s | 135 kB 00:00 2024-09-13T10:28:04.865 INFO:teuthology.orchestra.run.smithi181.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-13T10:28:04.905 INFO:teuthology.orchestra.run.smithi181.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 948 kB/s | 188 kB 00:00 2024-09-13T10:28:04.924 INFO:teuthology.orchestra.run.smithi181.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 297 kB/s | 35 kB 00:00 2024-09-13T10:28:04.949 INFO:teuthology.orchestra.run.smithi181.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 921 kB/s | 77 kB 00:00 2024-09-13T10:28:04.960 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T10:28:04.961 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:04.961 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:28:04.961 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:04.961 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:04.961 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T10:28:04.961 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T10:28:04.961 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:04.961 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:28:04.978 INFO:teuthology.orchestra.run.smithi181.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 703 kB/s | 51 kB 00:00 2024-09-13T10:28:05.011 INFO:teuthology.orchestra.run.smithi181.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 479 kB/s | 42 kB 00:00 2024-09-13T10:28:05.045 INFO:teuthology.orchestra.run.smithi181.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-13T10:28:05.070 INFO:teuthology.orchestra.run.smithi181.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 184 kB/s | 22 kB 00:00 2024-09-13T10:28:05.104 INFO:teuthology.orchestra.run.smithi181.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 480 kB/s | 43 kB 00:00 2024-09-13T10:28:05.129 INFO:teuthology.orchestra.run.smithi181.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 456 kB/s | 11 kB 00:00 2024-09-13T10:28:05.154 INFO:teuthology.orchestra.run.smithi181.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-13T10:28:05.180 INFO:teuthology.orchestra.run.smithi181.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 351 kB/s | 18 kB 00:00 2024-09-13T10:28:05.205 INFO:teuthology.orchestra.run.smithi181.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 464 kB/s | 23 kB 00:00 2024-09-13T10:28:05.232 INFO:teuthology.orchestra.run.smithi181.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-13T10:28:05.249 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph 2024-09-13T10:28:05.255 INFO:teuthology.orchestra.run.smithi181.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-13T10:28:05.281 INFO:teuthology.orchestra.run.smithi181.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 919 kB/s | 46 kB 00:00 2024-09-13T10:28:05.306 INFO:teuthology.orchestra.run.smithi181.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T10:28:05.332 INFO:teuthology.orchestra.run.smithi181.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-13T10:28:05.357 INFO:teuthology.orchestra.run.smithi181.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-13T10:28:05.374 INFO:teuthology.orchestra.run.smithi181.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-13T10:28:05.399 INFO:teuthology.orchestra.run.smithi181.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 855 kB/s | 36 kB 00:00 2024-09-13T10:28:05.424 INFO:teuthology.orchestra.run.smithi181.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-13T10:28:05.450 INFO:teuthology.orchestra.run.smithi181.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 800 kB/s | 20 kB 00:00 2024-09-13T10:28:05.475 INFO:teuthology.orchestra.run.smithi181.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T10:28:05.500 INFO:teuthology.orchestra.run.smithi181.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-13T10:28:05.503 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:05.503 INFO:teuthology.orchestra.run.smithi181.stdout:Total 13 MB/s | 31 MB 00:02 2024-09-13T10:28:05.652 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:28:05.691 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:28:05.691 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:28:05.820 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:40 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:28:05.962 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:28:05.964 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:05.964 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T10:28:05.964 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:05.964 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:28:05.964 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 6.6 k 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 2.4 M 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 1.5 M 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 291 k 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 4.8 M 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 17 M 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T10:28:05.965 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T10:28:05.966 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T10:28:05.966 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T10:28:05.966 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T10:28:05.966 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections 2024-09-13T10:28:05.966 INFO:teuthology.orchestra.run.smithi195.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-13T10:28:05.966 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T10:28:05.966 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T10:28:05.966 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T10:28:05.966 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T10:28:05.966 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T10:28:05.966 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T10:28:05.967 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T10:28:05.968 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T10:28:05.968 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:05.968 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:28:05.968 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:05.968 INFO:teuthology.orchestra.run.smithi195.stdout:Install 37 Packages 2024-09-13T10:28:05.968 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:05.968 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 31 M 2024-09-13T10:28:05.969 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 109 M 2024-09-13T10:28:05.969 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:28:06.186 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:28:06.187 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:28:06.546 INFO:teuthology.orchestra.run.smithi195.stdout:(1/37): ceph-19.3.0-4697.gd58f7306.el9.x86_64.r 55 kB/s | 6.6 kB 00:00 2024-09-13T10:28:06.755 INFO:teuthology.orchestra.run.smithi195.stdout:(2/37): ceph-mds-19.3.0-4697.gd58f7306.el9.x86_ 7.2 MB/s | 2.4 MB 00:00 2024-09-13T10:28:06.797 INFO:teuthology.orchestra.run.smithi195.stdout:(3/37): ceph-mgr-19.3.0-4697.gd58f7306.el9.x86_ 4.1 MB/s | 1.5 MB 00:00 2024-09-13T10:28:06.905 INFO:teuthology.orchestra.run.smithi195.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4697.gd58f 2.6 MB/s | 291 kB 00:00 2024-09-13T10:28:07.039 INFO:teuthology.orchestra.run.smithi195.stdout:(5/37): ceph-mon-19.3.0-4697.gd58f7306.el9.x86_ 9.7 MB/s | 4.8 MB 00:00 2024-09-13T10:28:07.164 INFO:teuthology.orchestra.run.smithi195.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 979 kB/s | 253 kB 00:00 2024-09-13T10:28:07.340 INFO:teuthology.orchestra.run.smithi195.stdout:(7/37): ceph-osd-19.3.0-4697.gd58f7306.el9.x86_ 29 MB/s | 17 MB 00:00 2024-09-13T10:28:07.365 INFO:teuthology.orchestra.run.smithi195.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 532 kB/s | 106 kB 00:00 2024-09-13T10:28:07.440 INFO:teuthology.orchestra.run.smithi195.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.6 MB/s | 125 kB 00:00 2024-09-13T10:28:07.492 INFO:teuthology.orchestra.run.smithi195.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.7 MB/s | 1.2 MB 00:00 2024-09-13T10:28:07.515 INFO:teuthology.orchestra.run.smithi195.stdout:(11/37): python3-pycparser-2.20-6.el9.noarch.rp 770 kB/s | 135 kB 00:00 2024-09-13T10:28:07.541 INFO:teuthology.orchestra.run.smithi195.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.1 MB/s | 215 kB 00:00 2024-09-13T10:28:07.544 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:28:07.608 INFO:teuthology.orchestra.run.smithi195.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 522 kB/s | 35 kB 00:00 2024-09-13T10:28:07.611 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-13T10:28:07.642 INFO:teuthology.orchestra.run.smithi195.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-13T10:28:07.644 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-13T10:28:07.667 INFO:teuthology.orchestra.run.smithi195.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-13T10:28:07.672 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-13T10:28:07.692 INFO:teuthology.orchestra.run.smithi195.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 919 kB/s | 77 kB 00:00 2024-09-13T10:28:07.717 INFO:teuthology.orchestra.run.smithi195.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 674 kB/s | 51 kB 00:00 2024-09-13T10:28:07.743 INFO:teuthology.orchestra.run.smithi195.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-13T10:28:07.743 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-13T10:28:07.779 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-13T10:28:07.785 INFO:teuthology.orchestra.run.smithi195.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-13T10:28:07.810 INFO:teuthology.orchestra.run.smithi195.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-13T10:28:07.811 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-13T10:28:07.843 INFO:teuthology.orchestra.run.smithi195.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-09-13T10:28:07.869 INFO:teuthology.orchestra.run.smithi195.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-13T10:28:07.894 INFO:teuthology.orchestra.run.smithi195.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 220 kB/s | 11 kB 00:00 2024-09-13T10:28:07.904 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-13T10:28:07.919 INFO:teuthology.orchestra.run.smithi195.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-13T10:28:07.945 INFO:teuthology.orchestra.run.smithi195.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-13T10:28:07.970 INFO:teuthology.orchestra.run.smithi195.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-13T10:28:07.995 INFO:teuthology.orchestra.run.smithi195.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-13T10:28:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-13T10:28:08.024 INFO:teuthology.orchestra.run.smithi195.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 866 kB/s | 46 kB 00:00 2024-09-13T10:28:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-13T10:28:08.049 INFO:teuthology.orchestra.run.smithi195.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.4 MB/s | 79 kB 00:00 2024-09-13T10:28:08.075 INFO:teuthology.orchestra.run.smithi195.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-13T10:28:08.075 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-13T10:28:08.091 INFO:teuthology.orchestra.run.smithi195.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 391 kB/s | 16 kB 00:00 2024-09-13T10:28:08.105 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-13T10:28:08.117 INFO:teuthology.orchestra.run.smithi195.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-13T10:28:08.133 INFO:teuthology.orchestra.run.smithi195.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 855 kB/s | 36 kB 00:00 2024-09-13T10:28:08.139 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-13T10:28:08.167 INFO:teuthology.orchestra.run.smithi195.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-13T10:28:08.172 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-13T10:28:08.193 INFO:teuthology.orchestra.run.smithi195.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 801 kB/s | 20 kB 00:00 2024-09-13T10:28:08.213 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-13T10:28:08.218 INFO:teuthology.orchestra.run.smithi195.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-13T10:28:08.251 INFO:teuthology.orchestra.run.smithi195.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-09-13T10:28:08.255 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:08.255 INFO:teuthology.orchestra.run.smithi195.stdout:Total 13 MB/s | 31 MB 00:02 2024-09-13T10:28:08.256 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-13T10:28:08.291 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-13T10:28:08.339 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-13T10:28:08.388 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-13T10:28:08.405 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:28:08.444 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:28:08.445 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:28:08.460 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-13T10:28:08.607 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-13T10:28:08.688 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-13T10:28:08.741 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-13T10:28:08.780 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-13T10:28:08.829 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-13T10:28:08.884 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-13T10:28:08.936 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:28:08.936 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:28:09.078 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-13T10:28:09.126 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-13T10:28:09.203 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-13T10:28:09.292 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-13T10:28:09.333 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-13T10:28:09.461 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-13T10:28:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4697.gd58f7306.el9. 32/37 2024-09-13T10:28:09.652 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.3.0-4697.gd58f7306.el9.x86_64 33/37 2024-09-13T10:28:09.677 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4697.gd58f7306.el9.x86_64 33/37 2024-09-13T10:28:09.678 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:28:09.678 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T10:28:09.678 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T10:28:09.678 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T10:28:09.678 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:10.300 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:28:10.354 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-13T10:28:10.395 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-13T10:28:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-13T10:28:10.502 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-13T10:28:10.564 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-13T10:28:10.597 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-13T10:28:10.688 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-13T10:28:10.775 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-13T10:28:10.816 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-13T10:28:10.851 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-13T10:28:10.881 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-13T10:28:10.916 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-13T10:28:10.949 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-13T10:28:10.990 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-13T10:28:11.025 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-13T10:28:11.059 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-13T10:28:11.108 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-13T10:28:11.140 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-13T10:28:11.153 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.3.0-4697.gd58f7306.el9.x86_64 34/37 2024-09-13T10:28:11.180 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.3.0-4697.gd58f7306.el9.x86_64 34/37 2024-09-13T10:28:11.180 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:28:11.181 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T10:28:11.181 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T10:28:11.183 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T10:28:11.184 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:11.212 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-13T10:28:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-13T10:28:11.431 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-13T10:28:11.485 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-13T10:28:11.533 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-13T10:28:11.582 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-13T10:28:11.620 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.3.0-4697.gd58f7306.el9.x86_64 35/37 2024-09-13T10:28:11.637 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-13T10:28:11.644 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.3.0-4697.gd58f7306.el9.x86_64 35/37 2024-09-13T10:28:11.644 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:28:11.644 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T10:28:11.644 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T10:28:11.644 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T10:28:11.644 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-13T10:28:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-13T10:28:11.976 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-13T10:28:12.063 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.3.0-4697.gd58f7306.el9.x86_64 36/37 2024-09-13T10:28:12.069 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-13T10:28:12.086 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.3.0-4697.gd58f7306.el9.x86_64 36/37 2024-09-13T10:28:12.087 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:28:12.087 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T10:28:12.087 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T10:28:12.087 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T10:28:12.087 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:12.111 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-13T10:28:12.150 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.3.0-4697.gd58f7306.el9.x86_64 37/37 2024-09-13T10:28:12.238 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-13T10:28:12.400 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4697.gd58f7306.el9. 32/37 2024-09-13T10:28:12.430 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:19.3.0-4697.gd58f7306.el9.x86_64 33/37 2024-09-13T10:28:12.455 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4697.gd58f7306.el9.x86_64 33/37 2024-09-13T10:28:12.455 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:28:12.455 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T10:28:12.455 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T10:28:12.455 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T10:28:12.455 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:13.718 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-2:19.3.0-4697.gd58f7306.el9.x86_64 37/37 2024-09-13T10:28:13.718 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.3.0-4697.gd58f7306.el9.x86_64 1/37 2024-09-13T10:28:13.718 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.3.0-4697.gd58f7306.el9.x86_64 2/37 2024-09-13T10:28:13.718 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.3.0-4697.gd58f7306.el9.x86_64 3/37 2024-09-13T10:28:13.718 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.3.0-4697.gd58f7306.el9.x86_64 4/37 2024-09-13T10:28:13.718 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.3.0-4697.gd58f7306.el9.x86_64 5/37 2024-09-13T10:28:13.718 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4697.gd58f7306.el9. 6/37 2024-09-13T10:28:13.718 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-13T10:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-13T10:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-13T10:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-13T10:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-13T10:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-13T10:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-13T10:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-13T10:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-13T10:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-13T10:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-13T10:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-13T10:28:13.719 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-13T10:28:13.720 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-13T10:28:13.720 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-13T10:28:13.720 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-13T10:28:13.720 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-13T10:28:13.720 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-13T10:28:13.720 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-13T10:28:13.720 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-13T10:28:13.720 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-13T10:28:13.720 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-13T10:28:13.720 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-13T10:28:13.720 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-13T10:28:13.720 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-13T10:28:13.721 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-13T10:28:13.721 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-13T10:28:13.721 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-13T10:28:13.721 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-13T10:28:13.722 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-13T10:28:13.956 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:19.3.0-4697.gd58f7306.el9.x86_64 34/37 2024-09-13T10:28:13.985 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:19.3.0-4697.gd58f7306.el9.x86_64 34/37 2024-09-13T10:28:13.985 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:28:13.985 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T10:28:13.985 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T10:28:13.985 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T10:28:13.986 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:14.466 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:19.3.0-4697.gd58f7306.el9.x86_64 35/37 2024-09-13T10:28:14.491 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:19.3.0-4697.gd58f7306.el9.x86_64 35/37 2024-09-13T10:28:14.491 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:28:14.492 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T10:28:14.492 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T10:28:14.492 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T10:28:14.492 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:19.3.0-4697.gd58f7306.el9.x86_64 36/37 2024-09-13T10:28:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:19.3.0-4697.gd58f7306.el9.x86_64 36/37 2024-09-13T10:28:14.751 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:28:14.751 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T10:28:14.751 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T10:28:14.751 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T10:28:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:14.813 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-13T10:28:14.813 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:14.813 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:28:14.813 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:14.813 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:14.813 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:14.813 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:14.813 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T10:28:14.814 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T10:28:14.815 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T10:28:14.816 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T10:28:14.816 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T10:28:14.816 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T10:28:14.816 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T10:28:14.816 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T10:28:14.816 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:14.816 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:14.817 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:19.3.0-4697.gd58f7306.el9.x86_64 37/37 2024-09-13T10:28:15.202 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-base 2024-09-13T10:28:15.771 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:00:52 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:28:15.861 INFO:teuthology.orchestra.run.smithi181.stdout:Package ceph-base-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:28:15.903 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:28:15.904 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-09-13T10:28:15.904 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:15.971 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install cephadm 2024-09-13T10:28:16.532 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:28:16.663 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:28:16.664 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:16.664 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-13T10:28:16.664 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:16.664 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:28:16.664 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 783 k 2024-09-13T10:28:16.664 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:16.665 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:28:16.665 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:16.665 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-09-13T10:28:16.665 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:16.665 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 783 k 2024-09-13T10:28:16.665 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 789 k 2024-09-13T10:28:16.665 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:28:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-2:19.3.0-4697.gd58f7306.el9.x86_64 37/37 2024-09-13T10:28:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:19.3.0-4697.gd58f7306.el9.x86_64 1/37 2024-09-13T10:28:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:19.3.0-4697.gd58f7306.el9.x86_64 2/37 2024-09-13T10:28:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:19.3.0-4697.gd58f7306.el9.x86_64 3/37 2024-09-13T10:28:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:19.3.0-4697.gd58f7306.el9.x86_64 4/37 2024-09-13T10:28:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:19.3.0-4697.gd58f7306.el9.x86_64 5/37 2024-09-13T10:28:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4697.gd58f7306.el9. 6/37 2024-09-13T10:28:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-13T10:28:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-13T10:28:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-13T10:28:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-13T10:28:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-13T10:28:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-13T10:28:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-13T10:28:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-13T10:28:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-13T10:28:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-13T10:28:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-13T10:28:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-13T10:28:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-13T10:28:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-13T10:28:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-13T10:28:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-13T10:28:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-13T10:28:16.921 INFO:teuthology.orchestra.run.smithi181.stdout:cephadm-19.3.0-4697.gd58f7306.el9.noarch.rpm 3.0 MB/s | 783 kB 00:00 2024-09-13T10:28:16.921 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:16.922 INFO:teuthology.orchestra.run.smithi181.stdout:Total 3.0 MB/s | 783 kB 00:00 2024-09-13T10:28:16.922 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:28:16.927 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:28:16.927 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:28:16.933 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:28:16.933 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:28:17.011 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:28:17.474 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:17.578 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-13T10:28:17.578 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout: lua-5.4.4-4.el9.x86_64 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T10:28:17.579 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T10:28:17.580 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T10:28:17.581 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:17.582 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:28:17.593 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:17.961 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-base 2024-09-13T10:28:17.962 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:18.201 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:18.201 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:18.201 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:28:18.201 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:18.201 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:18.202 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:18.431 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T10:28:18.534 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:28:18.624 INFO:teuthology.orchestra.run.smithi195.stdout:Package ceph-base-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:28:18.666 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:28:18.667 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T10:28:18.667 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:28:18.734 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install cephadm 2024-09-13T10:28:19.004 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:00:56 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:28:19.137 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:28:19.138 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:19.138 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2024-09-13T10:28:19.138 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:19.138 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:28:19.139 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 145 k 2024-09-13T10:28:19.139 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:19.139 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:28:19.139 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:19.139 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-09-13T10:28:19.139 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:19.139 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 145 k 2024-09-13T10:28:19.139 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 432 k 2024-09-13T10:28:19.139 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:28:19.295 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:28:19.328 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-immutable-object-cache-19.3.0-4697.gd58f73 770 kB/s | 145 kB 00:00 2024-09-13T10:28:19.329 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:19.329 INFO:teuthology.orchestra.run.smithi181.stdout:Total 763 kB/s | 145 kB 00:00 2024-09-13T10:28:19.329 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:28:19.337 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:28:19.337 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:28:19.393 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:28:19.394 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:28:19.428 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:28:19.429 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:19.429 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T10:28:19.429 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:19.429 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:28:19.429 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 783 k 2024-09-13T10:28:19.429 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:19.430 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:28:19.430 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:19.430 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T10:28:19.430 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:19.430 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 783 k 2024-09-13T10:28:19.430 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 789 k 2024-09-13T10:28:19.430 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:28:19.545 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:28:19.620 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4697.gd58f7306. 1/1 2024-09-13T10:28:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4697.gd58f7306. 1/1 2024-09-13T10:28:19.647 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:28:19.647 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T10:28:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:19.710 INFO:teuthology.orchestra.run.smithi195.stdout:cephadm-19.3.0-4697.gd58f7306.el9.noarch.rpm 2.7 MB/s | 783 kB 00:00 2024-09-13T10:28:19.711 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:19.711 INFO:teuthology.orchestra.run.smithi195.stdout:Total 2.7 MB/s | 783 kB 00:00 2024-09-13T10:28:19.711 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:28:19.717 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:28:19.717 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:28:19.723 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:28:19.723 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:28:19.799 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:28:20.255 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:20.347 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4697.gd58f7306. 1/1 2024-09-13T10:28:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:20.606 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:28:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:20.606 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:20.607 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:20.705 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:20.822 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr 2024-09-13T10:28:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:20.971 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:28:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:20.971 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:28:21.190 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T10:28:21.398 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:00:58 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:28:21.487 INFO:teuthology.orchestra.run.smithi181.stdout:Package ceph-mgr-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:28:21.529 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:28:21.530 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-09-13T10:28:21.530 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:21.595 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T10:28:21.758 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:56 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:28:21.893 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:28:21.894 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:21.894 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-09-13T10:28:21.894 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:21.894 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:28:21.894 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 145 k 2024-09-13T10:28:21.894 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:21.894 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:28:21.894 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:21.894 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T10:28:21.895 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:21.895 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 145 k 2024-09-13T10:28:21.895 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 432 k 2024-09-13T10:28:21.895 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:28:22.102 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-immutable-object-cache-19.3.0-4697.gd58f73 702 kB/s | 145 kB 00:00 2024-09-13T10:28:22.102 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:22.103 INFO:teuthology.orchestra.run.smithi195.stdout:Total 695 kB/s | 145 kB 00:00 2024-09-13T10:28:22.103 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:28:22.110 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:28:22.110 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:28:22.150 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:00:59 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:28:22.169 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:28:22.169 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:28:22.282 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:28:22.283 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:22.283 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-13T10:28:22.283 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:22.283 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:28:22.283 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 14 M 2024-09-13T10:28:22.283 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-13T10:28:22.283 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-13T10:28:22.283 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 34 k 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 16 k 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:22.284 INFO:teuthology.orchestra.run.smithi181.stdout:Install 12 Packages 2024-09-13T10:28:22.285 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:22.285 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 19 M 2024-09-13T10:28:22.285 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 159 M 2024-09-13T10:28:22.285 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:28:22.308 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:28:22.387 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4697.gd58f7306. 1/1 2024-09-13T10:28:22.411 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4697.gd58f7306. 1/1 2024-09-13T10:28:22.411 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:28:22.411 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T10:28:22.411 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:22.556 INFO:teuthology.orchestra.run.smithi181.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4697.gd5 225 kB/s | 34 kB 00:00 2024-09-13T10:28:22.581 INFO:teuthology.orchestra.run.smithi181.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4697.gd58 93 kB/s | 16 kB 00:00 2024-09-13T10:28:22.707 INFO:teuthology.orchestra.run.smithi181.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.1 MB/s | 269 kB 00:00 2024-09-13T10:28:22.790 INFO:teuthology.orchestra.run.smithi181.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-09-13T10:28:22.840 INFO:teuthology.orchestra.run.smithi181.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-13T10:28:22.857 INFO:teuthology.orchestra.run.smithi181.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-13T10:28:22.907 INFO:teuthology.orchestra.run.smithi181.stdout:(7/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.2 MB/s | 863 kB 00:00 2024-09-13T10:28:22.958 INFO:teuthology.orchestra.run.smithi181.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 20 MB/s | 2.0 MB 00:00 2024-09-13T10:28:22.983 INFO:teuthology.orchestra.run.smithi181.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-13T10:28:23.009 INFO:teuthology.orchestra.run.smithi181.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.4 MB/s | 144 kB 00:00 2024-09-13T10:28:23.034 INFO:teuthology.orchestra.run.smithi181.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.6 MB/s | 188 kB 00:00 2024-09-13T10:28:23.176 INFO:teuthology.orchestra.run.smithi181.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4697.gd58f73 18 MB/s | 14 MB 00:00 2024-09-13T10:28:23.180 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:23.180 INFO:teuthology.orchestra.run.smithi181.stdout:Total 22 MB/s | 19 MB 00:00 2024-09-13T10:28:23.226 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:28:23.245 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:28:23.304 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:28:23.327 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4697.gd58f7306. 1/1 2024-09-13T10:28:23.327 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:23.328 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:28:23.328 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:23.328 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:23.328 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:28:23.516 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:28:23.516 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:28:23.571 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr 2024-09-13T10:28:24.121 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:28:24.148 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:59 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:28:24.201 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-13T10:28:24.241 INFO:teuthology.orchestra.run.smithi195.stdout:Package ceph-mgr-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:28:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-13T10:28:24.284 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:28:24.285 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T10:28:24.285 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:28:24.290 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-13T10:28:24.330 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-13T10:28:24.357 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T10:28:24.433 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-13T10:28:24.556 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-13T10:28:24.641 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-13T10:28:24.718 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-13T10:28:24.747 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-13T10:28:24.779 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4697.gd58f7306.el9 10/12 2024-09-13T10:28:24.924 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:59 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:28:25.058 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:28:25.059 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:25.059 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T10:28:25.059 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:25.059 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:28:25.059 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 14 M 2024-09-13T10:28:25.059 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T10:28:25.059 INFO:teuthology.orchestra.run.smithi195.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-13T10:28:25.059 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 34 k 2024-09-13T10:28:25.060 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 16 k 2024-09-13T10:28:25.060 INFO:teuthology.orchestra.run.smithi195.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-13T10:28:25.060 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-13T10:28:25.060 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-13T10:28:25.060 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-13T10:28:25.060 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-13T10:28:25.060 INFO:teuthology.orchestra.run.smithi195.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-13T10:28:25.060 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T10:28:25.060 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T10:28:25.060 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:25.061 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:28:25.061 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:25.061 INFO:teuthology.orchestra.run.smithi195.stdout:Install 12 Packages 2024-09-13T10:28:25.061 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:25.061 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 19 M 2024-09-13T10:28:25.062 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 159 M 2024-09-13T10:28:25.062 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:28:25.439 INFO:teuthology.orchestra.run.smithi195.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4697.gd58 108 kB/s | 16 kB 00:00 2024-09-13T10:28:25.464 INFO:teuthology.orchestra.run.smithi195.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4697.gd5 192 kB/s | 34 kB 00:00 2024-09-13T10:28:25.590 INFO:teuthology.orchestra.run.smithi195.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.1 MB/s | 269 kB 00:00 2024-09-13T10:28:25.640 INFO:teuthology.orchestra.run.smithi195.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-13T10:28:25.699 INFO:teuthology.orchestra.run.smithi195.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-13T10:28:25.716 INFO:teuthology.orchestra.run.smithi195.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-13T10:28:25.774 INFO:teuthology.orchestra.run.smithi195.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 35 MB/s | 2.0 MB 00:00 2024-09-13T10:28:25.799 INFO:teuthology.orchestra.run.smithi195.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-13T10:28:25.825 INFO:teuthology.orchestra.run.smithi195.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-13T10:28:25.850 INFO:teuthology.orchestra.run.smithi195.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-13T10:28:26.009 INFO:teuthology.orchestra.run.smithi195.stdout:(11/12): ceph-mgr-dashboard-19.3.0-4697.gd58f73 20 MB/s | 14 MB 00:00 2024-09-13T10:28:26.051 INFO:teuthology.orchestra.run.smithi195.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.8 MB/s | 863 kB 00:00 2024-09-13T10:28:26.053 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:26.054 INFO:teuthology.orchestra.run.smithi195.stdout:Total 19 MB/s | 19 MB 00:00 2024-09-13T10:28:26.102 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:28:26.120 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:28:26.120 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:28:26.392 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:28:26.392 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:28:26.994 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:28:27.076 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-13T10:28:27.120 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-13T10:28:27.166 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-13T10:28:27.197 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-13T10:28:27.297 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-13T10:28:27.423 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-13T10:28:27.517 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-13T10:28:27.569 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-13T10:28:27.630 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-13T10:28:27.662 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4697.gd58f7306.el9 10/12 2024-09-13T10:28:27.935 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4697.gd58f7306.el 11/12 2024-09-13T10:28:27.992 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4697.gd58f7306.el9.noa 12/12 2024-09-13T10:28:30.016 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4697.gd58f7306.el9.noa 12/12 2024-09-13T10:28:30.016 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4697.gd58f7306.el 1/12 2024-09-13T10:28:30.016 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4697.gd58f7306.el9.noa 2/12 2024-09-13T10:28:30.016 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4697.gd58f7306.el9 3/12 2024-09-13T10:28:30.016 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-13T10:28:30.017 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-13T10:28:30.017 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-13T10:28:30.017 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-13T10:28:30.017 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-13T10:28:30.017 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-13T10:28:30.017 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-13T10:28:30.017 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-13T10:28:30.321 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-13T10:28:30.321 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:30.321 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:28:30.321 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-13T10:28:30.321 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:30.321 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:30.321 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:30.322 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-13T10:28:30.322 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-13T10:28:30.322 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-13T10:28:30.322 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-13T10:28:30.322 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-13T10:28:30.322 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-13T10:28:30.322 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T10:28:30.322 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T10:28:30.322 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:30.322 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:30.577 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T10:28:30.827 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4697.gd58f7306.el 11/12 2024-09-13T10:28:30.892 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4697.gd58f7306.el9.noa 12/12 2024-09-13T10:28:31.139 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:08 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:28:31.271 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:28:31.272 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 7.4 M 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T10:28:31.273 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T10:28:31.274 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T10:28:31.274 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T10:28:31.274 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T10:28:31.274 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:31.274 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:28:31.274 INFO:teuthology.orchestra.run.smithi181.stdout:======================================================================================= 2024-09-13T10:28:31.274 INFO:teuthology.orchestra.run.smithi181.stdout:Install 12 Packages 2024-09-13T10:28:31.274 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:31.275 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 38 M 2024-09-13T10:28:31.275 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 212 M 2024-09-13T10:28:31.275 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:28:31.566 INFO:teuthology.orchestra.run.smithi181.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 767 kB/s | 191 kB 00:00 2024-09-13T10:28:31.633 INFO:teuthology.orchestra.run.smithi181.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-13T10:28:31.683 INFO:teuthology.orchestra.run.smithi181.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 279 kB/s | 33 kB 00:00 2024-09-13T10:28:31.809 INFO:teuthology.orchestra.run.smithi181.stdout:(4/12): ceph-mgr-diskprediction-local-19.3.0-46 15 MB/s | 7.4 MB 00:00 2024-09-13T10:28:31.833 INFO:teuthology.orchestra.run.smithi181.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 121 kB/s | 18 kB 00:00 2024-09-13T10:28:31.942 INFO:teuthology.orchestra.run.smithi181.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 288 kB/s | 38 kB 00:00 2024-09-13T10:28:32.051 INFO:teuthology.orchestra.run.smithi181.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 23 MB/s | 4.9 MB 00:00 2024-09-13T10:28:32.076 INFO:teuthology.orchestra.run.smithi181.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-13T10:28:32.126 INFO:teuthology.orchestra.run.smithi181.stdout:(9/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.1 MB/s | 3.0 MB 00:00 2024-09-13T10:28:32.152 INFO:teuthology.orchestra.run.smithi181.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 3.3 MB/s | 250 kB 00:00 2024-09-13T10:28:32.235 INFO:teuthology.orchestra.run.smithi181.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-13T10:28:32.635 INFO:teuthology.orchestra.run.smithi181.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-13T10:28:32.636 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:32.637 INFO:teuthology.orchestra.run.smithi181.stdout:Total 28 MB/s | 38 MB 00:01 2024-09-13T10:28:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4697.gd58f7306.el9.noa 12/12 2024-09-13T10:28:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4697.gd58f7306.el 1/12 2024-09-13T10:28:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4697.gd58f7306.el9.noa 2/12 2024-09-13T10:28:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4697.gd58f7306.el9 3/12 2024-09-13T10:28:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-13T10:28:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-13T10:28:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-13T10:28:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-13T10:28:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-13T10:28:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-13T10:28:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-13T10:28:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-13T10:28:32.990 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:28:33.017 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:28:33.017 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:28:33.249 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-13T10:28:33.249 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:33.250 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:28:33.443 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:28:33.443 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:28:33.503 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T10:28:34.068 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:09 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:28:34.201 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:28:34.202 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-09-13T10:28:34.202 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T10:28:34.203 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-09-13T10:28:34.203 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:28:34.203 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 7.4 M 2024-09-13T10:28:34.203 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T10:28:34.203 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T10:28:34.203 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T10:28:34.203 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T10:28:34.203 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T10:28:34.203 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T10:28:34.203 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T10:28:34.203 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T10:28:34.204 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T10:28:34.204 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T10:28:34.204 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T10:28:34.204 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T10:28:34.204 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:34.204 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:28:34.204 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-09-13T10:28:34.204 INFO:teuthology.orchestra.run.smithi195.stdout:Install 12 Packages 2024-09-13T10:28:34.204 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:34.205 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 38 M 2024-09-13T10:28:34.205 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 212 M 2024-09-13T10:28:34.205 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:28:34.219 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:28:34.292 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T10:28:34.342 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T10:28:34.441 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T10:28:34.477 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T10:28:34.660 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T10:28:34.691 INFO:teuthology.orchestra.run.smithi195.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-13T10:28:34.692 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T10:28:34.768 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T10:28:34.799 INFO:teuthology.orchestra.run.smithi195.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-13T10:28:34.833 INFO:teuthology.orchestra.run.smithi195.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-13T10:28:34.992 INFO:teuthology.orchestra.run.smithi195.stdout:(4/12): ceph-mgr-diskprediction-local-19.3.0-46 15 MB/s | 7.4 MB 00:00 2024-09-13T10:28:35.017 INFO:teuthology.orchestra.run.smithi195.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 99 kB/s | 18 kB 00:00 2024-09-13T10:28:35.059 INFO:teuthology.orchestra.run.smithi195.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 578 kB/s | 38 kB 00:00 2024-09-13T10:28:35.159 INFO:teuthology.orchestra.run.smithi195.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-13T10:28:35.260 INFO:teuthology.orchestra.run.smithi195.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.5 MB/s | 3.0 MB 00:00 2024-09-13T10:28:35.352 INFO:teuthology.orchestra.run.smithi195.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2024-09-13T10:28:35.377 INFO:teuthology.orchestra.run.smithi195.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-13T10:28:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T10:28:35.452 INFO:teuthology.orchestra.run.smithi195.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-13T10:28:35.548 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T10:28:35.719 INFO:teuthology.orchestra.run.smithi195.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-09-13T10:28:35.720 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:35.720 INFO:teuthology.orchestra.run.smithi195.stdout:Total 25 MB/s | 38 MB 00:01 2024-09-13T10:28:36.077 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:28:36.102 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:28:36.103 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:28:36.530 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:28:36.530 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:28:36.768 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T10:28:37.306 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:28:37.370 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T10:28:37.409 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T10:28:37.507 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T10:28:37.552 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T10:28:37.743 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T10:28:37.776 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T10:28:37.816 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T10:28:37.842 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4697.gd58f7 12/12 2024-09-13T10:28:37.851 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T10:28:38.509 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T10:28:38.640 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T10:28:39.872 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T10:28:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4697.gd58f7 12/12 2024-09-13T10:28:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4697.gd58f7 1/12 2024-09-13T10:28:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T10:28:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T10:28:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T10:28:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T10:28:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T10:28:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T10:28:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T10:28:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T10:28:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T10:28:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T10:28:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T10:28:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:40.848 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:28:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T10:28:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T10:28:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T10:28:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T10:28:40.848 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T10:28:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T10:28:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T10:28:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T10:28:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T10:28:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T10:28:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T10:28:40.849 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:40.849 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:40.897 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T10:28:40.942 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4697.gd58f7 12/12 2024-09-13T10:28:41.221 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr-rook 2024-09-13T10:28:41.800 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:18 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:28:41.937 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:28:41.938 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:41.938 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-13T10:28:41.938 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:41.938 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:28:41.938 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 49 k 2024-09-13T10:28:41.938 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-13T10:28:41.938 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T10:28:41.938 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T10:28:41.938 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T10:28:41.939 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T10:28:41.939 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T10:28:41.939 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T10:28:41.939 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T10:28:41.939 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T10:28:41.939 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T10:28:41.939 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T10:28:41.939 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T10:28:41.939 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T10:28:41.939 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:41.939 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:28:41.939 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:41.940 INFO:teuthology.orchestra.run.smithi181.stdout:Install 13 Packages 2024-09-13T10:28:41.940 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:41.940 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 2.2 M 2024-09-13T10:28:41.940 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 26 M 2024-09-13T10:28:41.940 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:28:42.274 INFO:teuthology.orchestra.run.smithi181.stdout:(1/13): ceph-mgr-rook-19.3.0-4697.gd58f7306.el9 281 kB/s | 49 kB 00:00 2024-09-13T10:28:42.383 INFO:teuthology.orchestra.run.smithi181.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 90 kB/s | 26 kB 00:00 2024-09-13T10:28:42.408 INFO:teuthology.orchestra.run.smithi181.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 62 kB/s | 19 kB 00:00 2024-09-13T10:28:42.792 INFO:teuthology.orchestra.run.smithi181.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 414 kB/s | 159 kB 00:00 2024-09-13T10:28:42.867 INFO:teuthology.orchestra.run.smithi181.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 375 kB/s | 222 kB 00:00 2024-09-13T10:28:42.892 INFO:teuthology.orchestra.run.smithi181.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 576 kB/s | 279 kB 00:00 2024-09-13T10:28:42.918 INFO:teuthology.orchestra.run.smithi181.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 427 kB/s | 54 kB 00:00 2024-09-13T10:28:42.968 INFO:teuthology.orchestra.run.smithi181.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-13T10:28:42.993 INFO:teuthology.orchestra.run.smithi181.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-13T10:28:43.018 INFO:teuthology.orchestra.run.smithi181.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T10:28:43.052 INFO:teuthology.orchestra.run.smithi181.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.8 MB/s | 220 kB 00:00 2024-09-13T10:28:43.077 INFO:teuthology.orchestra.run.smithi181.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-13T10:28:43.110 INFO:teuthology.orchestra.run.smithi181.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.3 MB/s | 1.0 MB 00:00 2024-09-13T10:28:43.113 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:43.114 INFO:teuthology.orchestra.run.smithi181.stdout:Total 1.9 MB/s | 2.2 MB 00:01 2024-09-13T10:28:43.183 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:28:43.199 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:28:43.199 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:28:43.287 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:28:43.288 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:28:43.439 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4697.gd58f7 12/12 2024-09-13T10:28:43.439 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4697.gd58f7 1/12 2024-09-13T10:28:43.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T10:28:43.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T10:28:43.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T10:28:43.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T10:28:43.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T10:28:43.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T10:28:43.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T10:28:43.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T10:28:43.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T10:28:43.440 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T10:28:43.788 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:28:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T10:28:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:43.826 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:28:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T10:28:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T10:28:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T10:28:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T10:28:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T10:28:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T10:28:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T10:28:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T10:28:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T10:28:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T10:28:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T10:28:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:43.827 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:28:43.960 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T10:28:44.028 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T10:28:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T10:28:44.221 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-rook 2024-09-13T10:28:44.229 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T10:28:44.271 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T10:28:44.372 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T10:28:44.475 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T10:28:44.523 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T10:28:44.817 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:19 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:28:44.960 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:28:44.961 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 49 k 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T10:28:44.962 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T10:28:44.963 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T10:28:44.963 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T10:28:44.963 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T10:28:44.963 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T10:28:44.963 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:44.963 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:28:44.963 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:44.963 INFO:teuthology.orchestra.run.smithi195.stdout:Install 13 Packages 2024-09-13T10:28:44.963 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:44.964 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 2.2 M 2024-09-13T10:28:44.964 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 26 M 2024-09-13T10:28:44.964 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:28:45.226 INFO:teuthology.orchestra.run.smithi195.stdout:(1/13): ceph-mgr-rook-19.3.0-4697.gd58f7306.el9 306 kB/s | 49 kB 00:00 2024-09-13T10:28:45.240 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T10:28:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T10:28:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T10:28:45.351 INFO:teuthology.orchestra.run.smithi195.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 90 kB/s | 26 kB 00:00 2024-09-13T10:28:45.368 INFO:teuthology.orchestra.run.smithi195.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 63 kB/s | 19 kB 00:00 2024-09-13T10:28:45.368 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T10:28:45.390 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.3.0-4697.gd58f7306.el9.noarch 13/13 2024-09-13T10:28:45.752 INFO:teuthology.orchestra.run.smithi195.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 414 kB/s | 159 kB 00:00 2024-09-13T10:28:45.777 INFO:teuthology.orchestra.run.smithi195.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 403 kB/s | 222 kB 00:00 2024-09-13T10:28:45.818 INFO:teuthology.orchestra.run.smithi195.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 776 kB/s | 32 kB 00:00 2024-09-13T10:28:45.844 INFO:teuthology.orchestra.run.smithi195.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 585 kB/s | 279 kB 00:00 2024-09-13T10:28:45.869 INFO:teuthology.orchestra.run.smithi195.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 278 kB/s | 14 kB 00:00 2024-09-13T10:28:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:(9/13): python3-requests-oauthlib-1.3.0-12.el9. 354 kB/s | 54 kB 00:00 2024-09-13T10:28:45.945 INFO:teuthology.orchestra.run.smithi195.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.1 MB/s | 220 kB 00:00 2024-09-13T10:28:45.970 INFO:teuthology.orchestra.run.smithi195.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.7 MB/s | 90 kB 00:00 2024-09-13T10:28:45.995 INFO:teuthology.orchestra.run.smithi195.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 655 kB/s | 59 kB 00:00 2024-09-13T10:28:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.3 MB/s | 1.0 MB 00:00 2024-09-13T10:28:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:Total 2.1 MB/s | 2.2 MB 00:01 2024-09-13T10:28:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:28:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:28:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:28:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4697.gd58f7306.el9.noarch 13/13 2024-09-13T10:28:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4697.gd58f7306.el9.noarch 1/13 2024-09-13T10:28:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T10:28:46.138 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T10:28:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T10:28:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T10:28:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T10:28:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T10:28:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T10:28:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T10:28:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T10:28:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T10:28:46.139 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T10:28:46.207 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:28:46.209 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:28:46.460 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T10:28:46.460 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:46.460 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T10:28:46.461 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T10:28:46.462 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:46.462 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:46.693 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T10:28:46.736 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:28:46.911 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T10:28:46.971 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T10:28:47.044 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T10:28:47.089 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T10:28:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T10:28:47.233 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T10:28:47.257 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:28:47.334 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T10:28:47.393 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:28:47.393 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:47.393 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-13T10:28:47.393 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:47.393 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:28:47.393 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 154 k 2024-09-13T10:28:47.393 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout:Install 6 Packages 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 7.0 M 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 33 M 2024-09-13T10:28:47.394 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:28:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T10:28:48.021 INFO:teuthology.orchestra.run.smithi181.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4697.gd58f7306.e 798 kB/s | 154 kB 00:00 2024-09-13T10:28:48.037 INFO:teuthology.orchestra.run.smithi181.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-13T10:28:48.088 INFO:teuthology.orchestra.run.smithi181.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.0 MB/s | 548 kB 00:00 2024-09-13T10:28:48.102 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T10:28:48.113 INFO:teuthology.orchestra.run.smithi181.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 764 kB/s | 58 kB 00:00 2024-09-13T10:28:48.138 INFO:teuthology.orchestra.run.smithi181.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-13T10:28:48.147 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T10:28:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T10:28:48.228 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T10:28:48.250 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:19.3.0-4697.gd58f7306.el9.noarch 13/13 2024-09-13T10:28:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4697.gd58f7306.el9.noarch 13/13 2024-09-13T10:28:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4697.gd58f7306.el9.noarch 1/13 2024-09-13T10:28:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T10:28:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T10:28:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T10:28:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T10:28:49.063 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T10:28:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T10:28:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T10:28:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T10:28:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T10:28:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T10:28:49.064 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T10:28:49.138 INFO:teuthology.orchestra.run.smithi181.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.5 MB/s | 6.0 MB 00:01 2024-09-13T10:28:49.141 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:49.141 INFO:teuthology.orchestra.run.smithi181.stdout:Total 4.0 MB/s | 7.0 MB 00:01 2024-09-13T10:28:49.214 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:28:49.225 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:28:49.226 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:28:49.325 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:28:49.326 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:28:49.405 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T10:28:49.405 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T10:28:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T10:28:49.407 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T10:28:49.407 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:49.407 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:28:49.642 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:28:49.677 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T10:28:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T10:28:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T10:28:50.243 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:25 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:28:50.379 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 154 k 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:50.380 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:28:50.381 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:50.381 INFO:teuthology.orchestra.run.smithi195.stdout:Install 6 Packages 2024-09-13T10:28:50.381 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:50.381 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 7.0 M 2024-09-13T10:28:50.381 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 33 M 2024-09-13T10:28:50.381 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:28:50.403 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T10:28:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T10:28:50.570 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T10:28:50.594 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 6/6 2024-09-13T10:28:50.606 INFO:teuthology.orchestra.run.smithi195.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-13T10:28:50.631 INFO:teuthology.orchestra.run.smithi195.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4697.gd58f7306.e 757 kB/s | 154 kB 00:00 2024-09-13T10:28:50.682 INFO:teuthology.orchestra.run.smithi195.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-13T10:28:50.707 INFO:teuthology.orchestra.run.smithi195.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 766 kB/s | 58 kB 00:00 2024-09-13T10:28:50.732 INFO:teuthology.orchestra.run.smithi195.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-13T10:28:50.841 INFO:teuthology.orchestra.run.smithi195.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-13T10:28:50.843 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:50.843 INFO:teuthology.orchestra.run.smithi195.stdout:Total 15 MB/s | 7.0 MB 00:00 2024-09-13T10:28:50.913 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:28:50.924 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:28:50.925 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:28:51.023 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:28:51.023 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:28:51.331 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:28:51.421 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 6/6 2024-09-13T10:28:51.421 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 1/6 2024-09-13T10:28:51.421 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T10:28:51.421 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T10:28:51.421 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T10:28:51.421 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T10:28:51.508 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T10:28:51.559 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T10:28:51.694 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T10:28:51.694 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:51.694 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:28:51.695 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:51.695 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T10:28:51.695 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T10:28:51.695 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T10:28:51.695 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T10:28:51.695 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T10:28:51.695 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:51.695 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:51.941 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-fuse 2024-09-13T10:28:52.072 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T10:28:52.153 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T10:28:52.231 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T10:28:52.255 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 6/6 2024-09-13T10:28:52.513 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:28:52.648 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:28:52.649 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:52.649 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-13T10:28:52.649 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:52.649 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:28:52.649 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 900 k 2024-09-13T10:28:52.649 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-09-13T10:28:52.649 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T10:28:52.649 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:52.649 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:28:52.649 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:52.649 INFO:teuthology.orchestra.run.smithi181.stdout:Install 2 Packages 2024-09-13T10:28:52.649 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:52.650 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 979 k 2024-09-13T10:28:52.650 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 2.9 M 2024-09-13T10:28:52.650 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:28:53.041 INFO:teuthology.orchestra.run.smithi181.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 723 kB/s | 80 kB 00:00 2024-09-13T10:28:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 6/6 2024-09-13T10:28:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 1/6 2024-09-13T10:28:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T10:28:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T10:28:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T10:28:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T10:28:53.199 INFO:teuthology.orchestra.run.smithi181.stdout:(2/2): ceph-fuse-19.3.0-4697.gd58f7306.el9.x86_ 3.3 MB/s | 900 kB 00:00 2024-09-13T10:28:53.199 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:53.200 INFO:teuthology.orchestra.run.smithi181.stdout:Total 1.7 MB/s | 979 kB 00:00 2024-09-13T10:28:53.212 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:28:53.234 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:28:53.234 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:28:53.315 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:28:53.315 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:28:53.338 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T10:28:53.338 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:53.338 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:28:53.338 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:53.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T10:28:53.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T10:28:53.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T10:28:53.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T10:28:53.338 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T10:28:53.338 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:53.338 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:28:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:28:53.588 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-fuse 2024-09-13T10:28:53.634 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T10:28:53.698 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 2/2 2024-09-13T10:28:54.152 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:28:54.285 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:28:54.286 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:54.286 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T10:28:54.286 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:54.286 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:28:54.286 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 900 k 2024-09-13T10:28:54.286 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-09-13T10:28:54.286 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T10:28:54.286 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:54.286 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:28:54.286 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:54.286 INFO:teuthology.orchestra.run.smithi195.stdout:Install 2 Packages 2024-09-13T10:28:54.286 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:54.287 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 979 k 2024-09-13T10:28:54.287 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 2.9 M 2024-09-13T10:28:54.287 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:28:54.420 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 2/2 2024-09-13T10:28:54.420 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 1/2 2024-09-13T10:28:54.509 INFO:teuthology.orchestra.run.smithi195.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 806 kB/s | 80 kB 00:00 2024-09-13T10:28:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T10:28:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:54.684 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:28:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T10:28:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:54.684 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:54.685 INFO:teuthology.orchestra.run.smithi195.stdout:(2/2): ceph-fuse-19.3.0-4697.gd58f7306.el9.x86_ 3.2 MB/s | 900 kB 00:00 2024-09-13T10:28:54.685 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:54.686 INFO:teuthology.orchestra.run.smithi195.stdout:Total 2.4 MB/s | 979 kB 00:00 2024-09-13T10:28:54.697 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:28:54.719 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:28:54.719 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:28:54.800 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:28:54.800 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:28:54.957 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-volume 2024-09-13T10:28:55.006 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:28:55.154 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T10:28:55.219 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 2/2 2024-09-13T10:28:55.540 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:28:55.679 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:28:55.679 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:55.680 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-09-13T10:28:55.680 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:55.680 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:28:55.680 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 285 k 2024-09-13T10:28:55.680 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:55.680 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:28:55.680 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:55.680 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-09-13T10:28:55.680 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:55.680 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 285 k 2024-09-13T10:28:55.680 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 1.3 M 2024-09-13T10:28:55.680 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:28:55.903 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-volume-19.3.0-4697.gd58f7306.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-13T10:28:55.905 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:55.905 INFO:teuthology.orchestra.run.smithi181.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-13T10:28:55.905 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:28:55.912 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:28:55.913 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:28:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 2/2 2024-09-13T10:28:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 1/2 2024-09-13T10:28:55.942 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:28:55.943 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:28:56.165 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:28:56.194 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T10:28:56.195 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:56.195 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:28:56.195 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T10:28:56.195 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:56.195 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:28:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:56.255 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:28:56.255 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T10:28:56.255 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:56.448 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-volume 2024-09-13T10:28:57.028 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:28:57.165 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:28:57.166 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:57.166 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-09-13T10:28:57.166 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:57.166 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:28:57.166 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume noarch 2:19.3.0-4697.gd58f7306.el9 ceph-noarch 285 k 2024-09-13T10:28:57.167 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:57.167 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:28:57.167 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:57.167 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T10:28:57.167 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:57.167 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 285 k 2024-09-13T10:28:57.167 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 1.3 M 2024-09-13T10:28:57.167 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:28:57.242 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:57.242 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:57.242 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:28:57.242 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:57.242 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:57.242 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:57.398 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-volume-19.3.0-4697.gd58f7306.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-13T10:28:57.399 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:57.399 INFO:teuthology.orchestra.run.smithi195.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-13T10:28:57.399 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:28:57.409 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:28:57.409 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:28:57.438 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:28:57.438 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:28:57.526 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install librados-devel 2024-09-13T10:28:57.660 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:28:57.725 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-volume-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:57.741 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-volume-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:57.742 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:28:57.742 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T10:28:57.742 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:58.106 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:28:58.245 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:28:58.246 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:58.246 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2024-09-13T10:28:58.246 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:58.246 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:28:58.246 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 127 k 2024-09-13T10:28:58.246 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:58.247 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:28:58.247 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:28:58.247 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-09-13T10:28:58.247 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:58.247 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 127 k 2024-09-13T10:28:58.247 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 456 k 2024-09-13T10:28:58.247 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:28:58.500 INFO:teuthology.orchestra.run.smithi181.stdout:librados-devel-19.3.0-4697.gd58f7306.el9.x86_64 501 kB/s | 127 kB 00:00 2024-09-13T10:28:58.501 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:28:58.501 INFO:teuthology.orchestra.run.smithi181.stdout:Total 497 kB/s | 127 kB 00:00 2024-09-13T10:28:58.501 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:28:58.507 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:28:58.507 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:28:58.572 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:28:58.573 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:28:58.725 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:28:58.779 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-volume-2:19.3.0-4697.gd58f7306.el9.noarch 1/1 2024-09-13T10:28:58.780 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:58.780 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:28:58.780 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume-2:19.3.0-4697.gd58f7306.el9.noarch 2024-09-13T10:28:58.780 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:58.780 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:28:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:28:59.068 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librados-devel 2024-09-13T10:28:59.249 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:28:59.525 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:28:59.525 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:59.525 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:28:59.525 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:28:59.525 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:28:59.525 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:28:59.647 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:28:59.790 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:28:59.791 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:59.791 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-09-13T10:28:59.791 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:59.791 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:28:59.791 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 127 k 2024-09-13T10:28:59.791 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:59.791 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:28:59.791 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:28:59.791 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T10:28:59.792 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:28:59.792 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 127 k 2024-09-13T10:28:59.792 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 456 k 2024-09-13T10:28:59.792 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:28:59.794 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install libcephfs2 2024-09-13T10:29:00.004 INFO:teuthology.orchestra.run.smithi195.stdout:librados-devel-19.3.0-4697.gd58f7306.el9.x86_64 597 kB/s | 127 kB 00:00 2024-09-13T10:29:00.005 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:29:00.005 INFO:teuthology.orchestra.run.smithi195.stdout:Total 593 kB/s | 127 kB 00:00 2024-09-13T10:29:00.005 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:29:00.010 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:29:00.010 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:29:00.074 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:29:00.075 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:29:00.223 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:29:00.327 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:00.377 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:29:00.471 INFO:teuthology.orchestra.run.smithi181.stdout:Package libcephfs2-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:00.516 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:29:00.517 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-09-13T10:29:00.517 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:29:00.588 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install libcephfs-devel 2024-09-13T10:29:00.807 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:01.064 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:01.064 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:01.064 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:29:01.064 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:29:01.064 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:01.064 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:29:01.156 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:29:01.291 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:29:01.292 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:29:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2024-09-13T10:29:01.292 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:29:01.292 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:29:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 32 k 2024-09-13T10:29:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:01.292 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:29:01.292 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:29:01.292 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-09-13T10:29:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:01.293 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 32 k 2024-09-13T10:29:01.293 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 142 k 2024-09-13T10:29:01.293 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:29:01.323 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install libcephfs2 2024-09-13T10:29:01.453 INFO:teuthology.orchestra.run.smithi181.stdout:libcephfs-devel-19.3.0-4697.gd58f7306.el9.x86_6 197 kB/s | 32 kB 00:00 2024-09-13T10:29:01.454 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:29:01.454 INFO:teuthology.orchestra.run.smithi181.stdout:Total 196 kB/s | 32 kB 00:00 2024-09-13T10:29:01.454 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:29:01.458 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:29:01.458 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:29:01.478 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:29:01.478 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:29:01.564 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:29:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:01.907 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:29:01.998 INFO:teuthology.orchestra.run.smithi195.stdout:Package libcephfs2-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:02.044 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:29:02.045 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T10:29:02.045 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:29:02.057 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:02.117 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install libcephfs-devel 2024-09-13T10:29:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:02.290 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:29:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:29:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:02.290 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:29:02.467 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install librados2 2024-09-13T10:29:02.688 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:29:02.821 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:29:02.822 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:29:02.822 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-09-13T10:29:02.822 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:29:02.822 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:29:02.822 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 32 k 2024-09-13T10:29:02.822 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:02.822 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:29:02.822 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:29:02.822 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T10:29:02.822 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:02.823 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 32 k 2024-09-13T10:29:02.823 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 142 k 2024-09-13T10:29:02.823 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:29:02.991 INFO:teuthology.orchestra.run.smithi195.stdout:libcephfs-devel-19.3.0-4697.gd58f7306.el9.x86_6 189 kB/s | 32 kB 00:00 2024-09-13T10:29:02.992 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:29:02.992 INFO:teuthology.orchestra.run.smithi195.stdout:Total 187 kB/s | 32 kB 00:00 2024-09-13T10:29:02.992 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:29:02.995 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:29:02.996 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:29:03.020 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:29:03.021 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:29:03.036 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:29:03.113 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:29:03.126 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:03.169 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:29:03.171 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-09-13T10:29:03.171 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:29:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:03.241 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install librbd1 2024-09-13T10:29:03.621 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:03.803 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:29:03.877 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:03.877 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:03.877 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:29:03.877 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:29:03.878 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:03.878 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:29:03.893 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:03.936 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:29:03.937 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-09-13T10:29:03.937 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:29:04.029 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install python3-rados 2024-09-13T10:29:04.063 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librados2 2024-09-13T10:29:04.594 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:29:04.633 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:39 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:29:04.683 INFO:teuthology.orchestra.run.smithi181.stdout:Package python3-rados-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:04.724 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:04.726 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:29:04.727 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-09-13T10:29:04.727 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:29:04.768 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:29:04.768 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T10:29:04.769 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:29:04.795 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install python3-rgw 2024-09-13T10:29:04.845 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install librbd1 2024-09-13T10:29:05.358 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:42 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:29:05.408 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:29:05.448 INFO:teuthology.orchestra.run.smithi181.stdout:Package python3-rgw-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:05.491 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:29:05.493 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-09-13T10:29:05.493 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:29:05.497 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:05.540 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:29:05.541 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T10:29:05.541 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:29:05.560 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install python3-cephfs 2024-09-13T10:29:05.607 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rados 2024-09-13T10:29:06.121 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:29:06.171 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:29:06.211 INFO:teuthology.orchestra.run.smithi181.stdout:Package python3-cephfs-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:06.254 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:29:06.255 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-09-13T10:29:06.255 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:29:06.260 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rados-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:06.304 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:29:06.305 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T10:29:06.305 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:29:06.318 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install python3-rbd 2024-09-13T10:29:06.374 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rgw 2024-09-13T10:29:06.882 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:29:06.944 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:29:06.971 INFO:teuthology.orchestra.run.smithi181.stdout:Package python3-rbd-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:07.014 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:29:07.015 INFO:teuthology.orchestra.run.smithi181.stdout:Nothing to do. 2024-09-13T10:29:07.015 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:29:07.033 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rgw-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:07.076 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:29:07.077 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T10:29:07.078 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:29:07.084 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install rbd-fuse 2024-09-13T10:29:07.151 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-cephfs 2024-09-13T10:29:07.648 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:44 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:29:07.717 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:42 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:29:07.782 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:29:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:29:07.783 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2024-09-13T10:29:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:29:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:29:07.783 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 85 k 2024-09-13T10:29:07.783 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:29:07.783 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:29:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-09-13T10:29:07.784 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 85 k 2024-09-13T10:29:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 231 k 2024-09-13T10:29:07.784 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:29:07.806 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-cephfs-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:07.851 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:29:07.852 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T10:29:07.852 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:29:07.923 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install python3-rbd 2024-09-13T10:29:07.990 INFO:teuthology.orchestra.run.smithi181.stdout:rbd-fuse-19.3.0-4697.gd58f7306.el9.x86_64.rpm 413 kB/s | 85 kB 00:00 2024-09-13T10:29:07.990 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:29:07.991 INFO:teuthology.orchestra.run.smithi181.stdout:Total 411 kB/s | 85 kB 00:00 2024-09-13T10:29:07.991 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:29:07.998 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:29:07.998 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:29:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:29:08.061 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:29:08.202 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:29:08.296 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:08.493 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:29:08.583 INFO:teuthology.orchestra.run.smithi195.stdout:Package python3-rbd-2:19.3.0-4697.gd58f7306.el9.x86_64 is already installed. 2024-09-13T10:29:08.626 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:29:08.627 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-09-13T10:29:08.627 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:29:08.699 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-fuse 2024-09-13T10:29:08.737 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:08.991 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:29:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:29:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:08.992 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:29:09.264 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:44 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:29:09.266 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install rbd-mirror 2024-09-13T10:29:09.397 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:29:09.398 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:29:09.398 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-09-13T10:29:09.398 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:29:09.398 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:29:09.398 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 85 k 2024-09-13T10:29:09.398 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:09.398 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:29:09.398 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:29:09.398 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T10:29:09.398 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:09.398 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 85 k 2024-09-13T10:29:09.398 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 231 k 2024-09-13T10:29:09.399 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:29:09.670 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-fuse-19.3.0-4697.gd58f7306.el9.x86_64.rpm 315 kB/s | 85 kB 00:00 2024-09-13T10:29:09.670 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:29:09.670 INFO:teuthology.orchestra.run.smithi195.stdout:Total 313 kB/s | 85 kB 00:00 2024-09-13T10:29:09.670 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:29:09.677 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:29:09.677 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:29:09.741 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:29:09.741 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:29:09.847 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:46 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:29:09.899 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:29:09.985 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:29:09.985 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:29:09.985 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repo Size 2024-09-13T10:29:09.986 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:29:09.986 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:29:09.986 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 3.2 M 2024-09-13T10:29:09.986 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:09.986 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:29:09.986 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:29:09.986 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-09-13T10:29:09.986 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:09.987 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 3.2 M 2024-09-13T10:29:09.987 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 14 M 2024-09-13T10:29:09.987 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:29:10.009 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:10.385 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:10.643 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:10.644 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:10.644 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:29:10.644 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:29:10.644 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:10.644 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:29:10.710 INFO:teuthology.orchestra.run.smithi181.stdout:rbd-mirror-19.3.0-4697.gd58f7306.el9.x86_64.rpm 4.4 MB/s | 3.2 MB 00:00 2024-09-13T10:29:10.710 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:29:10.711 INFO:teuthology.orchestra.run.smithi181.stdout:Total 4.4 MB/s | 3.2 MB 00:00 2024-09-13T10:29:10.711 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:29:10.720 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:29:10.720 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:29:10.806 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:29:10.807 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:29:10.941 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-mirror 2024-09-13T10:29:11.256 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:29:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:11.352 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:29:11.353 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T10:29:11.353 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T10:29:11.353 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T10:29:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:11.518 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:46 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:29:11.653 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:29:11.654 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:29:11.654 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repo Size 2024-09-13T10:29:11.654 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:29:11.654 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:29:11.655 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 3.2 M 2024-09-13T10:29:11.655 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:11.655 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:29:11.655 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:29:11.655 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T10:29:11.655 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:11.655 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 3.2 M 2024-09-13T10:29:11.655 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 14 M 2024-09-13T10:29:11.655 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:29:12.265 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-mirror-19.3.0-4697.gd58f7306.el9.x86_64.rpm 5.2 MB/s | 3.2 MB 00:00 2024-09-13T10:29:12.266 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:29:12.266 INFO:teuthology.orchestra.run.smithi195.stdout:Total 5.2 MB/s | 3.2 MB 00:00 2024-09-13T10:29:12.266 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:29:12.276 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:29:12.276 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:29:12.363 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:29:12.363 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:29:12.385 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:12.385 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:12.385 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:29:12.385 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:29:12.385 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:12.385 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:29:12.605 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install rbd-nbd 2024-09-13T10:29:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:29:12.874 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:12.898 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:12.899 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T10:29:12.899 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T10:29:12.899 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T10:29:12.899 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T10:29:12.899 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:13.187 INFO:teuthology.orchestra.run.smithi181.stdout:Last metadata expiration check: 0:01:50 ago on Fri 13 Sep 2024 10:27:23 AM UTC. 2024-09-13T10:29:13.321 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-09-13T10:29:13.322 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:29:13.322 INFO:teuthology.orchestra.run.smithi181.stdout: Package Architecture Version Repository Size 2024-09-13T10:29:13.322 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:29:13.322 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-09-13T10:29:13.322 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 170 k 2024-09-13T10:29:13.322 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:13.322 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-09-13T10:29:13.322 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-09-13T10:29:13.323 INFO:teuthology.orchestra.run.smithi181.stdout:Install 1 Package 2024-09-13T10:29:13.323 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:13.323 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 170 k 2024-09-13T10:29:13.323 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 490 k 2024-09-13T10:29:13.323 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-09-13T10:29:13.530 INFO:teuthology.orchestra.run.smithi181.stdout:rbd-nbd-19.3.0-4697.gd58f7306.el9.x86_64.rpm 825 kB/s | 170 kB 00:00 2024-09-13T10:29:13.531 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:29:13.531 INFO:teuthology.orchestra.run.smithi181.stdout:Total 819 kB/s | 170 kB 00:00 2024-09-13T10:29:13.531 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-09-13T10:29:13.538 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-09-13T10:29:13.538 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-09-13T10:29:13.601 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-09-13T10:29:13.601 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-09-13T10:29:13.768 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-09-13T10:29:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:14.052 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:14.052 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:14.053 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:29:14.053 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:29:14.053 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:14.053 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:29:14.287 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:14.305 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install rbd-nbd 2024-09-13T10:29:14.539 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:14.539 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:14.539 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-09-13T10:29:14.539 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:29:14.539 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:14.539 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-09-13T10:29:14.769 DEBUG:teuthology.parallel:result is None 2024-09-13T10:29:14.886 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:49 ago on Fri 13 Sep 2024 10:27:25 AM UTC. 2024-09-13T10:29:15.021 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-09-13T10:29:15.022 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:29:15.023 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-09-13T10:29:15.023 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:29:15.023 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-09-13T10:29:15.023 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:19.3.0-4697.gd58f7306.el9 ceph 170 k 2024-09-13T10:29:15.023 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:15.023 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-09-13T10:29:15.023 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-09-13T10:29:15.023 INFO:teuthology.orchestra.run.smithi195.stdout:Install 1 Package 2024-09-13T10:29:15.023 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:15.023 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 170 k 2024-09-13T10:29:15.023 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 490 k 2024-09-13T10:29:15.023 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-09-13T10:29:15.228 INFO:teuthology.orchestra.run.smithi195.stdout:rbd-nbd-19.3.0-4697.gd58f7306.el9.x86_64.rpm 834 kB/s | 170 kB 00:00 2024-09-13T10:29:15.228 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-09-13T10:29:15.228 INFO:teuthology.orchestra.run.smithi195.stdout:Total 827 kB/s | 170 kB 00:00 2024-09-13T10:29:15.229 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-09-13T10:29:15.236 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-09-13T10:29:15.236 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-09-13T10:29:15.300 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-09-13T10:29:15.300 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-09-13T10:29:15.457 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-09-13T10:29:15.550 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:16.045 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:16.347 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:19.3.0-4697.gd58f7306.el9.x86_64 1/1 2024-09-13T10:29:16.347 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:16.347 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-09-13T10:29:16.347 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:19.3.0-4697.gd58f7306.el9.x86_64 2024-09-13T10:29:16.347 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:16.348 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-09-13T10:29:16.585 DEBUG:teuthology.parallel:result is None 2024-09-13T10:29:16.585 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d58f73069a8157a9ace12a0247ee3e8497707ea9 2024-09-13T10:29:16.730 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T10:29:16.756 INFO:teuthology.orchestra.run.smithi181.stdout:19.3.0-4697.gd58f7306.el9 2024-09-13T10:29:16.757 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4697.gd58f7306.el9 2024-09-13T10:29:16.757 INFO:teuthology.task.install:The correct ceph version 19.3.0-4697.gd58f7306 is installed. 2024-09-13T10:29:16.759 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d58f73069a8157a9ace12a0247ee3e8497707ea9 2024-09-13T10:29:16.901 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T10:29:16.924 INFO:teuthology.orchestra.run.smithi195.stdout:19.3.0-4697.gd58f7306.el9 2024-09-13T10:29:16.924 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4697.gd58f7306.el9 2024-09-13T10:29:16.924 INFO:teuthology.task.install:The correct ceph version 19.3.0-4697.gd58f7306 is installed. 2024-09-13T10:29:16.926 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T10:29:16.926 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:16.926 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T10:29:16.957 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:16.957 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T10:29:16.990 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T10:29:16.990 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:16.990 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T10:29:17.025 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T10:29:17.093 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:17.093 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T10:29:17.118 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T10:29:17.183 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T10:29:17.183 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:17.183 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T10:29:17.210 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T10:29:17.277 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:17.277 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T10:29:17.302 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T10:29:17.367 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T10:29:17.367 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:17.367 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T10:29:17.393 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T10:29:17.461 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:17.461 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T10:29:17.485 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T10:29:17.550 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T10:29:17.637 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T10:29:17.637 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2024-09-13T10:29:17.640 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2024-09-13T10:29:17.666 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T10:29:17.666 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T10:29:17.708 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T10:29:17.732 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T10:29:17.732 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T10:29:17.774 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T10:29:17.809 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T10:29:17.809 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2024-09-13T10:29:17.809 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356', 'branch': 'wip-aclamk-cbt-combined', 'description': 'rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-bitmap} rados supported-random-distro$/{centos_latest} thrashers/one workloads/pool-create-delete}', 'email': 'akupczyk@redhat.com', 'first_in_suite': False, 'job_id': '7903356', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-aclamk-cbt-combined'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'mon_bind_msgr2': False, 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-aclamk-cbt-combined', 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9'}}, 'owner': 'scheduled_akupczyk@teuthology', 'priority': 160, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'], ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 5394, 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9', 'sleep_before_teardown': 0, 'subset': '582/12160', 'suite': 'rados', 'suite_branch': 'wip-aclamk-cbt-combined', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d58f73069a8157a9ace12a0247ee3e8497707ea9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9', 'targets': {'smithi181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI8ndAK7NdG2nwfLHV4oj4McqM56U/KHxWPohiYLp+XbtjjTomUC65ECA5kavgLVzSlhohAIBC+N63PE7XFcbeE=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBeo/s1qt3SuCDc7KptzK6/OHMfLnJKnlnbdX0P5gMVIYYkardtMITCNNpDnGk89yv71fzK2Z2QSl2p6v9eZGD0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 20, 'thrash_delay': 1}}, {'exec': {'client.0': ['ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_09:37:56', 'tube': 'smithi', 'user': 'akupczyk', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T10:29:17.809 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T10:29:17.840 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T10:29:17.855 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T10:29:17.894 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T10:29:17.920 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:17.920 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T10:29:17.974 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T10:29:17.974 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-09-13T10:29:18.030 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T10:29:18.030 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T10:29:18.030 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-13T10:29:18.030 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T10:29:18.030 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T10:29:18.030 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-13 10:29:11.604141040 +0000 2024-09-13T10:29:18.030 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-13 10:26:46.135159325 +0000 2024-09-13T10:29:18.031 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-13 10:26:46.135159325 +0000 2024-09-13T10:29:18.031 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-13 10:26:46.135159325 +0000 2024-09-13T10:29:18.031 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T10:29:18.095 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-13T10:29:18.095 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-13T10:29:18.095 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000234051 s, 2.2 MB/s 2024-09-13T10:29:18.096 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T10:29:18.153 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-09-13T10:29:18.208 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T10:29:18.209 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T10:29:18.209 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-13T10:29:18.209 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T10:29:18.209 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T10:29:18.209 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-13 10:29:11.604141040 +0000 2024-09-13T10:29:18.209 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-13 10:26:46.460159169 +0000 2024-09-13T10:29:18.209 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-13 10:26:46.460159169 +0000 2024-09-13T10:29:18.209 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-13 10:26:46.460159169 +0000 2024-09-13T10:29:18.209 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T10:29:18.272 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-13T10:29:18.272 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-13T10:29:18.272 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000218829 s, 2.3 MB/s 2024-09-13T10:29:18.273 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T10:29:18.329 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-09-13T10:29:18.384 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T10:29:18.385 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T10:29:18.385 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-13T10:29:18.385 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T10:29:18.385 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T10:29:18.385 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-13 10:29:11.604141040 +0000 2024-09-13T10:29:18.385 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-13 10:26:46.778159017 +0000 2024-09-13T10:29:18.385 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-13 10:26:46.778159017 +0000 2024-09-13T10:29:18.385 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-13 10:26:46.778159017 +0000 2024-09-13T10:29:18.385 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T10:29:18.447 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-13T10:29:18.447 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-13T10:29:18.447 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000216547 s, 2.4 MB/s 2024-09-13T10:29:18.448 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T10:29:18.505 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-09-13T10:29:18.560 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T10:29:18.560 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T10:29:18.561 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-13T10:29:18.561 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T10:29:18.561 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T10:29:18.561 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-09-13 10:29:11.604141040 +0000 2024-09-13T10:29:18.561 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-09-13 10:26:47.105158860 +0000 2024-09-13T10:29:18.561 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-09-13 10:26:47.105158860 +0000 2024-09-13T10:29:18.561 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-09-13 10:26:47.105158860 +0000 2024-09-13T10:29:18.561 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T10:29:18.623 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-09-13T10:29:18.623 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-09-13T10:29:18.623 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.00021023 s, 2.4 MB/s 2024-09-13T10:29:18.624 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T10:29:18.680 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-13T10:29:18.681 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:18.681 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T10:29:18.697 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T10:29:18.697 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-09-13T10:29:18.753 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T10:29:18.753 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T10:29:18.754 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-13T10:29:18.754 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T10:29:18.754 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T10:29:18.754 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-09-13 10:29:13.163632147 +0000 2024-09-13T10:29:18.754 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-09-13 10:26:35.828008734 +0000 2024-09-13T10:29:18.754 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-09-13 10:26:35.828008734 +0000 2024-09-13T10:29:18.754 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-09-13 10:26:35.828008734 +0000 2024-09-13T10:29:18.754 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T10:29:18.817 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-09-13T10:29:18.818 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-09-13T10:29:18.818 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000111842 s, 4.6 MB/s 2024-09-13T10:29:18.819 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T10:29:18.881 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-09-13T10:29:18.937 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T10:29:18.937 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T10:29:18.937 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-13T10:29:18.937 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T10:29:18.937 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T10:29:18.937 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-09-13 10:29:13.163632147 +0000 2024-09-13T10:29:18.937 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-09-13 10:26:36.133002524 +0000 2024-09-13T10:29:18.937 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-09-13 10:26:36.133002524 +0000 2024-09-13T10:29:18.938 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-09-13 10:26:36.133002524 +0000 2024-09-13T10:29:18.938 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T10:29:19.001 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-09-13T10:29:19.001 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-09-13T10:29:19.001 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000105668 s, 4.8 MB/s 2024-09-13T10:29:19.002 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T10:29:19.058 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-09-13T10:29:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T10:29:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T10:29:19.114 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-13T10:29:19.114 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T10:29:19.114 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T10:29:19.114 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-09-13 10:29:13.163632147 +0000 2024-09-13T10:29:19.114 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-09-13 10:26:36.454995967 +0000 2024-09-13T10:29:19.114 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-09-13 10:26:36.454995967 +0000 2024-09-13T10:29:19.114 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-09-13 10:26:36.454995967 +0000 2024-09-13T10:29:19.114 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T10:29:19.176 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-09-13T10:29:19.176 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-09-13T10:29:19.177 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 7.8498e-05 s, 6.5 MB/s 2024-09-13T10:29:19.177 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T10:29:19.233 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-09-13T10:29:19.288 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T10:29:19.288 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T10:29:19.289 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-13T10:29:19.289 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T10:29:19.289 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T10:29:19.289 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-09-13 10:29:13.163632147 +0000 2024-09-13T10:29:19.289 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-09-13 10:26:36.753989878 +0000 2024-09-13T10:29:19.289 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-09-13 10:26:36.753989878 +0000 2024-09-13T10:29:19.289 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-09-13 10:26:36.753989878 +0000 2024-09-13T10:29:19.289 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T10:29:19.351 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-09-13T10:29:19.352 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-09-13T10:29:19.352 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000106618 s, 4.8 MB/s 2024-09-13T10:29:19.353 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T10:29:19.410 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-13T10:29:19.410 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-13T10:29:19.410 INFO:tasks.ceph:Generating config... 2024-09-13T10:29:19.411 INFO:tasks.ceph:[client] debug monc = 20 2024-09-13T10:29:19.411 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T10:29:19.411 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-13T10:29:19.411 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-09-13T10:29:19.411 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-09-13T10:29:19.411 INFO:tasks.ceph:[global] ms inject delay max = 1 2024-09-13T10:29:19.412 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2024-09-13T10:29:19.412 INFO:tasks.ceph:[global] ms inject delay type = mon 2024-09-13T10:29:19.412 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2024-09-13T10:29:19.412 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2024-09-13T10:29:19.412 INFO:tasks.ceph:[global] ms type = async 2024-09-13T10:29:19.412 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T10:29:19.412 INFO:tasks.ceph:[mgr] debug monc = 10 2024-09-13T10:29:19.412 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T10:29:19.412 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T10:29:19.412 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T10:29:19.412 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T10:29:19.412 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2024-09-13T10:29:19.412 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-13T10:29:19.413 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-13T10:29:19.413 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-13T10:29:19.413 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2024-09-13T10:29:19.413 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2024-09-13T10:29:19.413 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-13T10:29:19.413 INFO:tasks.ceph:[mon] paxos service trim min = 5 2024-09-13T10:29:19.413 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T10:29:19.413 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T10:29:19.413 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T10:29:19.413 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T10:29:19.413 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T10:29:19.413 INFO:tasks.ceph:[osd] bluestore write v2 = True 2024-09-13T10:29:19.413 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-13T10:29:19.414 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T10:29:19.414 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T10:29:19.414 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T10:29:19.414 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T10:29:19.414 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T10:29:19.414 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T10:29:19.414 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T10:29:19.414 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T10:29:19.414 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-13T10:29:19.414 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-13T10:29:19.415 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T10:29:19.415 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-13T10:29:19.415 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-13T10:29:19.415 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T10:29:19.415 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-13T10:29:19.415 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-13T10:29:19.415 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T10:29:19.415 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T10:29:19.472 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T10:29:19.474 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T10:29:19.521 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T10:29:19.546 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.181:6789]'), ('mon.b', '[v1:172.21.15.181:6790]'), ('mon.c', '[v1:172.21.15.181:6791]'), ('mon.d', '[v1:172.21.15.181:6792]'), ('mon.e', '[v1:172.21.15.181:6793]'), ('mon.f', '[v1:172.21.15.195:6789]'), ('mon.g', '[v1:172.21.15.195:6790]'), ('mon.h', '[v1:172.21.15.195:6791]'), ('mon.i', '[v1:172.21.15.195:6792]')] 2024-09-13T10:29:19.547 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.181:6789],[v1:172.21.15.181:6790],[v1:172.21.15.181:6791],[v1:172.21.15.181:6792],[v1:172.21.15.181:6793],[v1:172.21.15.195:6789],[v1:172.21.15.195:6790],[v1:172.21.15.195:6791],[v1:172.21.15.195:6792]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mon.d': {}, 'mon.e': {}, 'mon.f': {}, 'mon.g': {}, 'mon.h': {}, 'mon.i': {}} 2024-09-13T10:29:19.548 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:19.548 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T10:29:19.604 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.181:6789]' --addv b '[v1:172.21.15.181:6790]' --addv c '[v1:172.21.15.181:6791]' --addv d '[v1:172.21.15.181:6792]' --addv e '[v1:172.21.15.181:6793]' --addv f '[v1:172.21.15.195:6789]' --addv g '[v1:172.21.15.195:6790]' --addv h '[v1:172.21.15.195:6791]' --addv i '[v1:172.21.15.195:6792]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T10:29:19.710 INFO:teuthology.orchestra.run.smithi181.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T10:29:19.710 INFO:teuthology.orchestra.run.smithi181.stdout:monmaptool: generated fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:19.711 INFO:teuthology.orchestra.run.smithi181.stdout:setting min_mon_release = quincy 2024-09-13T10:29:19.711 INFO:teuthology.orchestra.run.smithi181.stdout:epoch 0 2024-09-13T10:29:19.711 INFO:teuthology.orchestra.run.smithi181.stdout:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:19.712 INFO:teuthology.orchestra.run.smithi181.stdout:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:19.712 INFO:teuthology.orchestra.run.smithi181.stdout:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:19.712 INFO:teuthology.orchestra.run.smithi181.stdout:min_mon_release 17 (quincy) 2024-09-13T10:29:19.712 INFO:teuthology.orchestra.run.smithi181.stdout:election_strategy: 3 2024-09-13T10:29:19.712 INFO:teuthology.orchestra.run.smithi181.stdout:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:29:19.712 INFO:teuthology.orchestra.run.smithi181.stdout:1: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:29:19.712 INFO:teuthology.orchestra.run.smithi181.stdout:2: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:29:19.712 INFO:teuthology.orchestra.run.smithi181.stdout:3: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:29:19.712 INFO:teuthology.orchestra.run.smithi181.stdout:4: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:29:19.712 INFO:teuthology.orchestra.run.smithi181.stdout:5: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:29:19.712 INFO:teuthology.orchestra.run.smithi181.stdout:6: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:29:19.713 INFO:teuthology.orchestra.run.smithi181.stdout:7: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:29:19.713 INFO:teuthology.orchestra.run.smithi181.stdout:8: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:29:19.713 INFO:teuthology.orchestra.run.smithi181.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (9 monitors) 2024-09-13T10:29:19.714 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T10:29:19.729 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID de6e6e36-ff0f-4526-9812-870bc0eec0ee... 2024-09-13T10:29:19.730 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T10:29:19.771 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T10:29:19.811 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-09-13T10:29:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-09-13T10:29:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T10:29:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-09-13T10:29:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-09-13T10:29:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T10:29:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T10:29:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-09-13T10:29:19.814 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.814 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T10:29:19.814 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.814 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-09-13T10:29:19.814 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.814 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-09-13T10:29:19.814 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.814 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-09-13T10:29:19.814 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-09-13T10:29:19.814 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "[v1:172.21.15.181:6789],[v1:172.21.15.181:6790],[v1:172.21.15.181:6791],[v1:172.21.15.181:6792],[v1:172.21.15.181:6793],[v1:172.21.15.195:6789],[v1:172.21.15.195:6790],[v1:172.21.15.195:6791],[v1:172.21.15.195:6792]" 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: mon client directed command retry = 5 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: mon election default strategy = 3 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: ms bind msgr2 = False 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject delay max = 1 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject delay probability = 0.005 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject delay type = mon 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject internal delays = 0.002 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: ms inject socket failures = 2500 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: ms type = async 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-09-13T10:29:19.815 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug trim objects = true 2024-09-13T10:29:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-09-13T10:29:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: bdev async discard = True 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: bdev enable discard = True 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore allocator = bitmap 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore write v2 = True 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore zero block detection = True 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 20 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 20 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 10 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T10:29:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify cached snaps = True 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify missing on start = True 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock override recovery settings = True 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: osd op queue = debug_random 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: osd op queue cut off = debug_random 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-09-13T10:29:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout: debug monc = 10 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-09-13T10:29:19.820 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-09-13T10:29:19.821 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-09-13T10:29:19.821 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-09-13T10:29:19.821 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-09-13T10:29:19.821 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.821 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T10:29:19.821 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T10:29:19.821 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T10:29:19.821 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.821 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: mon min osdmap epochs = 25 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: mon osdmap full prune interval = 2 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: mon osdmap full prune min = 15 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: mon osdmap full prune txsize = 2 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: mon scrub inject crc mismatch = 0.01 2024-09-13T10:29:19.822 INFO:teuthology.orchestra.run.smithi181.stdout: mon scrub inject missing keys = 0.05 2024-09-13T10:29:19.823 INFO:teuthology.orchestra.run.smithi181.stdout: mon scrub interval = 300 2024-09-13T10:29:19.823 INFO:teuthology.orchestra.run.smithi181.stdout: paxos service trim min = 5 2024-09-13T10:29:19.823 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:29:19.823 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-09-13T10:29:19.823 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-09-13T10:29:19.823 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2024-09-13T10:29:19.823 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-09-13T10:29:19.823 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T10:29:19.823 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T10:29:19.823 INFO:teuthology.orchestra.run.smithi181.stdout: debug monc = 20 2024-09-13T10:29:19.823 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-09-13T10:29:19.823 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-09-13T10:29:19.824 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-09-13T10:29:19.824 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-09-13T10:29:19.824 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.d] 2024-09-13T10:29:19.824 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.e] 2024-09-13T10:29:19.824 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.f] 2024-09-13T10:29:19.824 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.g] 2024-09-13T10:29:19.825 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.h] 2024-09-13T10:29:19.825 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.i] 2024-09-13T10:29:19.825 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-09-13T10:29:19.825 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-09-13T10:29:19.825 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.826 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-09-13T10:29:19.827 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-09-13T10:29:19.828 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "[v1:172.21.15.181:6789],[v1:172.21.15.181:6790],[v1:172.21.15.181:6791],[v1:172.21.15.181:6792],[v1:172.21.15.181:6793],[v1:172.21.15.195:6789],[v1:172.21.15.195:6790],[v1:172.21.15.195:6791],[v1:172.21.15.195:6792]" 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout: mon client directed command retry = 5 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout: mon election default strategy = 3 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout: ms bind msgr2 = False 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout: ms inject delay max = 1 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout: ms inject delay probability = 0.005 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout: ms inject delay type = mon 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout: ms inject internal delays = 0.002 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout: ms inject socket failures = 2500 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout: ms type = async 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.829 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-09-13T10:29:19.830 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug trim objects = true 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.831 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: bdev async discard = True 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: bdev enable discard = True 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore allocator = bitmap 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore write v2 = True 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore zero block detection = True 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 20 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 20 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-09-13T10:29:19.832 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 10 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify cached snaps = True 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify missing on start = True 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock override recovery settings = True 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: osd op queue = debug_random 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: osd op queue cut off = debug_random 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-09-13T10:29:19.833 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-09-13T10:29:19.834 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-09-13T10:29:19.834 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-09-13T10:29:19.834 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-09-13T10:29:19.834 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-09-13T10:29:19.834 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-09-13T10:29:19.834 INFO:teuthology.orchestra.run.smithi195.stdout: debug monc = 10 2024-09-13T10:29:19.834 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.834 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T10:29:19.835 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: mon min osdmap epochs = 25 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: mon osdmap full prune interval = 2 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: mon osdmap full prune min = 15 2024-09-13T10:29:19.836 INFO:teuthology.orchestra.run.smithi195.stdout: mon osdmap full prune txsize = 2 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout: mon scrub inject crc mismatch = 0.01 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout: mon scrub inject missing keys = 0.05 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout: mon scrub interval = 300 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout: paxos service trim min = 5 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout: debug monc = 20 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-09-13T10:29:19.837 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-09-13T10:29:19.838 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-09-13T10:29:19.838 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-09-13T10:29:19.838 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.d] 2024-09-13T10:29:19.838 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.e] 2024-09-13T10:29:19.838 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.f] 2024-09-13T10:29:19.838 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.g] 2024-09-13T10:29:19.838 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.h] 2024-09-13T10:29:19.838 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.i] 2024-09-13T10:29:19.839 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T10:29:19.840 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T10:29:19.934 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T10:29:19.934 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:19.934 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T10:29:19.949 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:19.949 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T10:29:20.005 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T10:29:20.005 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:20.005 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T10:29:20.005 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T10:29:20.083 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:20.083 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T10:29:20.138 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T10:29:20.139 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:20.139 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T10:29:20.139 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T10:29:20.174 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:20.174 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T10:29:20.229 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T10:29:20.230 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T10:29:20.230 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T10:29:20.329 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T10:29:20.332 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T10:29:20.332 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T10:29:20.332 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T10:29:20.373 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T10:29:20.386 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T10:29:20.386 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-13T10:29:20.386 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T10:29:20.411 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-13T10:29:20.411 INFO:tasks.ceph:role: osd.0 2024-09-13T10:29:20.411 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T10:29:20.411 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T10:29:20.484 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T10:29:20.484 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T10:29:20.484 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T10:29:20.484 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T10:29:20.484 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T10:29:20.485 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-13T10:29:20.485 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T10:29:20.485 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T10:29:20.485 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T10:29:20.485 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T10:29:20.976 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-09-13T10:29:20.978 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-13T10:29:20.978 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T10:29:21.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T10:29:21.154 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T10:29:21.218 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-13T10:29:21.219 INFO:tasks.ceph:role: osd.1 2024-09-13T10:29:21.219 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T10:29:21.219 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T10:29:21.291 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T10:29:21.291 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T10:29:21.291 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T10:29:21.291 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T10:29:21.292 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T10:29:21.292 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-13T10:29:21.292 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T10:29:21.292 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T10:29:21.292 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T10:29:21.292 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T10:29:21.752 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-09-13T10:29:21.753 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-13T10:29:21.753 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T10:29:21.846 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T10:29:21.875 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T10:29:21.941 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-13T10:29:21.941 INFO:tasks.ceph:role: osd.2 2024-09-13T10:29:21.941 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T10:29:21.941 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T10:29:22.013 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T10:29:22.013 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T10:29:22.013 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T10:29:22.013 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T10:29:22.013 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T10:29:22.013 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-09-13T10:29:22.013 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T10:29:22.013 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T10:29:22.013 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T10:29:22.014 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T10:29:22.503 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-09-13T10:29:22.505 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-09-13T10:29:22.505 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T10:29:22.647 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T10:29:22.678 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T10:29:22.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:22.776+0000 7f080040f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T10:29:22.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:22.780+0000 7f080040f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T10:29:22.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:22.780+0000 7f080040f640 -1 bdev(0x559361457800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-13T10:29:22.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:22.780+0000 7f080040f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T10:29:25.699 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T10:29:25.728 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T10:29:25.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:25.818+0000 7f9ae9c17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T10:29:25.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:25.818+0000 7f9ae9c17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T10:29:25.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:25.818+0000 7f9ae9c17640 -1 bdev(0x558a046f1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-13T10:29:25.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:25.818+0000 7f9ae9c17640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T10:29:29.229 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T10:29:29.258 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T10:29:29.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:29.348+0000 7f9fc81bb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T10:29:29.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:29.348+0000 7f9fc81bb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T10:29:29.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:29.348+0000 7f9fc81bb640 -1 bdev(0x56380b0db800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-13T10:29:29.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:29.348+0000 7f9fc81bb640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T10:29:32.519 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T10:29:32.549 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T10:29:32.579 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-13T10:29:32.579 INFO:tasks.ceph:role: osd.3 2024-09-13T10:29:32.579 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T10:29:32.580 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T10:29:32.649 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T10:29:32.649 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T10:29:32.649 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T10:29:32.649 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T10:29:32.649 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T10:29:32.649 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-09-13T10:29:32.649 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T10:29:32.649 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T10:29:32.650 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T10:29:32.650 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T10:29:32.682 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-09-13T10:29:32.684 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-09-13T10:29:32.685 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-13T10:29:32.754 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T10:29:32.825 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T10:29:32.890 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-13T10:29:32.890 INFO:tasks.ceph:role: osd.4 2024-09-13T10:29:32.890 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T10:29:32.890 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T10:29:32.955 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T10:29:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T10:29:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T10:29:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T10:29:32.956 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T10:29:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-09-13T10:29:32.956 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T10:29:32.956 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T10:29:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T10:29:32.956 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T10:29:32.988 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-09-13T10:29:32.993 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-09-13T10:29:32.993 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-13T10:29:33.062 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T10:29:33.130 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T10:29:33.195 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-13T10:29:33.196 INFO:tasks.ceph:role: osd.5 2024-09-13T10:29:33.196 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T10:29:33.196 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T10:29:33.260 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T10:29:33.261 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T10:29:33.261 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T10:29:33.261 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T10:29:33.261 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T10:29:33.261 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-09-13T10:29:33.261 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T10:29:33.261 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T10:29:33.261 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T10:29:33.261 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T10:29:33.292 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-09-13T10:29:33.294 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-09-13T10:29:33.294 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-09-13T10:29:33.361 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T10:29:33.430 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T10:29:33.535 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:33.534+0000 7f3b93812640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T10:29:33.536 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:33.534+0000 7f3b93812640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T10:29:33.536 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:33.534+0000 7f3b93812640 -1 bdev(0x562a451d3800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-13T10:29:33.536 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:33.534+0000 7f3b93812640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T10:29:36.465 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T10:29:36.495 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T10:29:36.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:36.583+0000 7f7848bfd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T10:29:36.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:36.583+0000 7f7848bfd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T10:29:36.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:36.583+0000 7f7848bfd640 -1 bdev(0x55bfe20e3800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-13T10:29:36.585 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:36.584+0000 7f7848bfd640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T10:29:39.752 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T10:29:39.781 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T10:29:39.871 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:39.869+0000 7f0852a12640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T10:29:39.871 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:39.869+0000 7f0852a12640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T10:29:39.871 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:39.869+0000 7f0852a12640 -1 bdev(0x55f77d285800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-13T10:29:39.871 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:39.869+0000 7f0852a12640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T10:29:42.773 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T10:29:42.803 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T10:29:42.803 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:42.803 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T10:29:42.834 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:42.834 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T10:29:42.903 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:42.903 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T10:29:42.970 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:42.970 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T10:29:43.001 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:43.001 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T10:29:43.069 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:43.069 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T10:29:43.136 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:43.136 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T10:29:43.203 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:43.203 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T10:29:43.259 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T10:29:43.260 DEBUG:teuthology.orchestra.run.smithi181:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T10:29:43.262 DEBUG:teuthology.orchestra.run.smithi195:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T10:29:43.302 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.0] 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQACFORm2oZYLhAAQKY7enkNztg90KqCSlqe1Q== 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.1] 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAFFORmQ/rPMBAAmwT5aezTp1MnAY1Wc7SoTA== 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.2] 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAJFORmT37LFBAAYnY+7U9EkiAv7BKnQzosUg== 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.x] 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAAFORmgsyaExAAwjkebiikIITN0358avCxgA== 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.3] 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQANFORm5/7gHxAA5G7HkKD1x7fWOB1x6qch8g== 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.4] 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAQFORmYRjVIhAAPWMIzQXCEp29Wg4OKcbpSw== 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.5] 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQATFORmeU/hMxAAsjEV0DM5D8mbRW/Lh2DcMw== 2024-09-13T10:29:43.303 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-09-13T10:29:43.304 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQAAFORmEbQ4FhAAzoLQZyJcG4gcqJE5kF9R4g== 2024-09-13T10:29:43.323 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.0] 2024-09-13T10:29:43.323 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQACFORm2oZYLhAAQKY7enkNztg90KqCSlqe1Q== 2024-09-13T10:29:43.323 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.1] 2024-09-13T10:29:43.323 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAFFORmQ/rPMBAAmwT5aezTp1MnAY1Wc7SoTA== 2024-09-13T10:29:43.324 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.2] 2024-09-13T10:29:43.324 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAJFORmT37LFBAAYnY+7U9EkiAv7BKnQzosUg== 2024-09-13T10:29:43.324 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.x] 2024-09-13T10:29:43.324 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAAFORmgsyaExAAwjkebiikIITN0358avCxgA== 2024-09-13T10:29:43.324 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.3] 2024-09-13T10:29:43.324 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQANFORm5/7gHxAA5G7HkKD1x7fWOB1x6qch8g== 2024-09-13T10:29:43.324 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.4] 2024-09-13T10:29:43.324 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAQFORmYRjVIhAAPWMIzQXCEp29Wg4OKcbpSw== 2024-09-13T10:29:43.324 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.5] 2024-09-13T10:29:43.324 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQATFORmeU/hMxAAsjEV0DM5D8mbRW/Lh2DcMw== 2024-09-13T10:29:43.324 INFO:teuthology.orchestra.run.smithi195.stdout:[client.0] 2024-09-13T10:29:43.324 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQAAFORmEbQ4FhAAzoLQZyJcG4gcqJE5kF9R4g== 2024-09-13T10:29:43.325 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T10:29:43.348 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T10:29:43.417 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T10:29:43.420 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T10:29:43.471 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T10:29:43.473 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T10:29:43.524 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T10:29:43.526 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T10:29:43.578 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T10:29:43.580 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T10:29:43.631 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T10:29:43.633 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T10:29:43.684 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T10:29:43.686 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T10:29:43.737 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T10:29:43.739 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T10:29:43.793 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T10:29:43.793 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T10:29:43.817 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T10:29:43.914 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T10:29:43.938 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T10:29:44.003 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T10:29:44.099 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T10:29:44.123 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T10:29:44.188 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T10:29:44.284 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T10:29:44.309 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-d 2024-09-13T10:29:44.374 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i d --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T10:29:44.470 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-d 2024-09-13T10:29:44.495 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-e 2024-09-13T10:29:44.560 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i e --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T10:29:44.657 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-e 2024-09-13T10:29:44.682 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-f 2024-09-13T10:29:44.708 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i f --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T10:29:44.804 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-f 2024-09-13T10:29:44.829 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-g 2024-09-13T10:29:44.894 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i g --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T10:29:44.990 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-g 2024-09-13T10:29:45.014 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-h 2024-09-13T10:29:45.079 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i h --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T10:29:45.176 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-h 2024-09-13T10:29:45.201 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-i 2024-09-13T10:29:45.266 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i i --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T10:29:45.363 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-i 2024-09-13T10:29:45.388 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T10:29:45.391 DEBUG:teuthology.orchestra.run.smithi195:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T10:29:45.443 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T10:29:45.444 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T10:29:45.444 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T10:29:45.449 INFO:tasks.ceph.mon.a:Started 2024-09-13T10:29:45.449 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T10:29:45.449 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T10:29:45.452 INFO:tasks.ceph.mon.b:Started 2024-09-13T10:29:45.452 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T10:29:45.452 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T10:29:45.454 INFO:tasks.ceph.mon.c:Started 2024-09-13T10:29:45.454 INFO:tasks.ceph.mon.d:Restarting daemon 2024-09-13T10:29:45.454 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-09-13T10:29:45.456 INFO:tasks.ceph.mon.d:Started 2024-09-13T10:29:45.456 INFO:tasks.ceph.mon.e:Restarting daemon 2024-09-13T10:29:45.456 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-09-13T10:29:45.459 INFO:tasks.ceph.mon.e:Started 2024-09-13T10:29:45.459 INFO:tasks.ceph.mon.f:Restarting daemon 2024-09-13T10:29:45.459 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-09-13T10:29:45.485 INFO:tasks.ceph.mon.f:Started 2024-09-13T10:29:45.486 INFO:tasks.ceph.mon.g:Restarting daemon 2024-09-13T10:29:45.486 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-09-13T10:29:45.488 INFO:tasks.ceph.mon.g:Started 2024-09-13T10:29:45.488 INFO:tasks.ceph.mon.h:Restarting daemon 2024-09-13T10:29:45.488 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-09-13T10:29:45.490 INFO:tasks.ceph.mon.h:Started 2024-09-13T10:29:45.490 INFO:tasks.ceph.mon.i:Restarting daemon 2024-09-13T10:29:45.491 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-09-13T10:29:45.493 INFO:tasks.ceph.mon.i:Started 2024-09-13T10:29:45.493 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T10:29:45.494 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T10:29:45.494 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T10:29:45.496 INFO:tasks.ceph.mgr.x:Started 2024-09-13T10:29:45.496 DEBUG:tasks.ceph:set 0 configs 2024-09-13T10:29:45.497 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T10:29:45.497 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T10:29:45.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.623+0000 7f6082bc3640 10 monclient: get_monmap_and_config 2024-09-13T10:29:45.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.623+0000 7f6082bc3640 10 monclient: build_initial_monmap 2024-09-13T10:29:45.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.623+0000 7f6082bc3640 10 monclient: monmap: 2024-09-13T10:29:45.625 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:29:45.625 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:45.625 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:45.624286+0000 2024-09-13T10:29:45.625 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:45.624286+0000 2024-09-13T10:29:45.625 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:29:45.625 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:29:45.625 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:29:45.626 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:29:45.626 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:29:45.626 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:29:45.626 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:29:45.626 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:29:45.626 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:29:45.626 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:29:45.626 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:29:45.626 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:29:45.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.624+0000 7f6082bc3640 1 Processor -- start 2024-09-13T10:29:45.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.624+0000 7f6082bc3640 1 -- start start 2024-09-13T10:29:45.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.624+0000 7f6082bc3640 10 monclient: init 2024-09-13T10:29:45.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.624+0000 7f6082bc3640 10 monclient: _reopen_session rank -1 2024-09-13T10:29:45.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.625+0000 7f6082bc3640 10 monclient: _add_conns ranks=[8,2,6,1,3,4,0,7,5] 2024-09-13T10:29:45.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.625+0000 7f6082bc3640 10 monclient(hunting): picked mon.noname-e con 0x7f607c0a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:29:45.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.625+0000 7f6082bc3640 10 monclient(hunting): picked mon.noname-b con 0x7f607c0a71c0 addr v1:172.21.15.181:6790/0 2024-09-13T10:29:45.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.625+0000 7f6082bc3640 10 monclient(hunting): picked mon.noname-d con 0x7f607c0a5260 addr v1:172.21.15.181:6792/0 2024-09-13T10:29:45.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.625+0000 7f6082bc3640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607c0a2f10 con 0x7f607c0a71c0 2024-09-13T10:29:45.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.625+0000 7f6082bc3640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607c0a4a60 con 0x7f607c0a5260 2024-09-13T10:29:45.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.625+0000 7f6082bc3640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607c0a3a50 con 0x7f607c0a66d0 2024-09-13T10:29:45.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.625+0000 7f608095f640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f607c0a66d0 0x7f607c0a6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:60120/0 (socket says 172.21.15.181:60120) 2024-09-13T10:29:45.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.625+0000 7f608095f640 1 -- 172.21.15.181:0/3962913388 learned_addr learned my addr 172.21.15.181:0/3962913388 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:29:45.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.625+0000 7f6082bc3640 10 monclient(hunting): _renew_subs 2024-09-13T10:29:45.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.625+0000 7f6082bc3640 10 monclient(hunting): authenticate will time out at 725.130227s 2024-09-13T10:29:45.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.627+0000 7f608095f640 1 -- 172.21.15.181:0/3962913388 >> v1:172.21.15.181:6793/0 conn(0x7f607c0a66d0 legacy=0x7f607c0a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:45.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.627+0000 7f6081160640 1 -- 172.21.15.181:0/3962913388 >> v1:172.21.15.181:6792/0 conn(0x7f607c0a5260 legacy=0x7f607c141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:45.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:45.627+0000 7f607bfff640 1 -- 172.21.15.181:0/3962913388 >> v1:172.21.15.181:6790/0 conn(0x7f607c0a71c0 legacy=0x7f607c13e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:48.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 10 monclient(hunting): tick 2024-09-13T10:29:48.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:29:48.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 1 monclient(hunting): continuing hunt 2024-09-13T10:29:48.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:29:48.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 1 -- 172.21.15.181:0/3962913388 >> v1:172.21.15.181:6793/0 conn(0x7f607c0a66d0 legacy=0x7f607c0a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:48.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 1 -- 172.21.15.181:0/3962913388 >> v1:172.21.15.181:6792/0 conn(0x7f607c0a5260 legacy=0x7f607c141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:48.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 1 -- 172.21.15.181:0/3962913388 >> v1:172.21.15.181:6790/0 conn(0x7f607c0a71c0 legacy=0x7f607c13e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:48.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 10 monclient: _add_conns ranks=[1,0,3,7,5,4] 2024-09-13T10:29:48.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 10 monclient(hunting): picked mon.noname-f con 0x7f6060003960 addr v1:172.21.15.195:6789/0 2024-09-13T10:29:48.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 10 monclient(hunting): picked mon.noname-a con 0x7f60600075f0 addr v1:172.21.15.181:6789/0 2024-09-13T10:29:48.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 10 monclient(hunting): picked mon.noname-g con 0x7f606000b380 addr v1:172.21.15.195:6790/0 2024-09-13T10:29:48.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 1 -- 172.21.15.181:0/3962913388 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607c0a8390 con 0x7f60600075f0 2024-09-13T10:29:48.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 1 -- 172.21.15.181:0/3962913388 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60600101a0 con 0x7f6060003960 2024-09-13T10:29:48.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 1 -- 172.21.15.181:0/3962913388 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6060011420 con 0x7f606000b380 2024-09-13T10:29:48.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.625+0000 7f607a7fc640 10 monclient(hunting): _renew_subs 2024-09-13T10:29:48.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.627+0000 7f607bfff640 1 -- 172.21.15.181:0/3962913388 >> v1:172.21.15.181:6789/0 conn(0x7f60600075f0 legacy=0x7f6060009ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:48.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.627+0000 7f608095f640 1 -- 172.21.15.181:0/3962913388 >> v1:172.21.15.195:6789/0 conn(0x7f6060003960 legacy=0x7f6060005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:48.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:48.627+0000 7f6081160640 1 -- 172.21.15.181:0/3962913388 >> v1:172.21.15.195:6790/0 conn(0x7f606000b380 legacy=0x7f606000d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:51.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.336+0000 7f607b7fe640 1 -- 172.21.15.181:0/3962913388 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731334729 0 0) 0x7f6060011420 con 0x7f606000b380 2024-09-13T10:29:51.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.336+0000 7f607b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:29:51.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.336+0000 7f607b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:29:51.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.336+0000 7f607b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:29:51.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.336+0000 7f607b7fe640 10 monclient(hunting): my global_id is 4107 2024-09-13T10:29:51.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.336+0000 7f607b7fe640 1 -- 172.21.15.181:0/3962913388 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f606c003520 con 0x7f606000b380 2024-09-13T10:29:51.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 1 -- 172.21.15.181:0/3962913388 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 849403063 0 0) 0x7f606c003520 con 0x7f606000b380 2024-09-13T10:29:51.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 1 -- 172.21.15.181:0/3962913388 >> v1:172.21.15.195:6789/0 conn(0x7f6060003960 legacy=0x7f6060005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:51.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 1 -- 172.21.15.181:0/3962913388 >> v1:172.21.15.181:6789/0 conn(0x7f60600075f0 legacy=0x7f6060009ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:51.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:29:51.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 1 monclient: found mon.noname-g 2024-09-13T10:29:51.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:29:51.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:29:51.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 1 -- 172.21.15.181:0/3962913388 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6060012700 con 0x7f606000b380 2024-09-13T10:29:51.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:29:51.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:29:51.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:29:51.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 1 -- 172.21.15.181:0/3962913388 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6074001e70 con 0x7f606000b380 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 10 monclient: dump: 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:29:51.341 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f6081160640 1 -- 172.21.15.181:0/3962913388 reap_dead start 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f6082bc3640 5 monclient: authenticate success, global_id 4107 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f6082bc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 1 -- 172.21.15.181:0/3962913388 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6074003990 con 0x7f606000b380 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 1 -- 172.21.15.181:0/3962913388 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6074003e80 con 0x7f606000b380 2024-09-13T10:29:51.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f607b7fe640 10 monclient: dump: 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:29:51.343 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:29:51.344 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:29:51.344 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:29:51.344 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:29:51.344 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:29:51.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f6082bc3640 10 monclient: get_monmap_and_config success 2024-09-13T10:29:51.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.337+0000 7f6082bc3640 4 set_mon_vals no callback set 2024-09-13T10:29:51.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.338+0000 7f6082bc3640 10 monclient: shutdown 2024-09-13T10:29:51.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.338+0000 7f6082bc3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:29:51.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.338+0000 7f6082bc3640 1 -- 172.21.15.181:0/3962913388 >> v1:172.21.15.195:6790/0 conn(0x7f606000b380 legacy=0x7f606000d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:51.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.338+0000 7f6082bc3640 1 -- 172.21.15.181:0/3962913388 shutdown_connections 2024-09-13T10:29:51.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.338+0000 7f6082bc3640 1 -- 172.21.15.181:0/3962913388 >> 172.21.15.181:0/3962913388 conn(0x7f607c0abcd0 msgr2=0x7f607c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:29:51.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.338+0000 7f6082bc3640 1 -- 172.21.15.181:0/3962913388 shutdown_connections 2024-09-13T10:29:51.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.338+0000 7f6082bc3640 1 -- 172.21.15.181:0/3962913388 wait complete. 2024-09-13T10:29:51.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.339+0000 7f6082bc3640 10 monclient: build_initial_monmap 2024-09-13T10:29:51.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.339+0000 7f6082bc3640 10 monclient: monmap: 2024-09-13T10:29:51.347 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:29:51.347 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:29:51.347 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:29:51.348 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:29:51.348 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:29:51.348 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:29:51.348 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:29:51.348 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:29:51.348 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:29:51.348 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:29:51.348 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:29:51.348 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:29:51.348 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:29:51.348 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:29:51.348 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:29:51.349 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:29:51.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.340+0000 7f6082bc3640 1 Processor -- start 2024-09-13T10:29:51.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.340+0000 7f6082bc3640 1 -- start start 2024-09-13T10:29:51.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.340+0000 7f6082bc3640 10 monclient: init 2024-09-13T10:29:51.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.341+0000 7f6082bc3640 10 monclient: _reopen_session rank -1 2024-09-13T10:29:51.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.341+0000 7f6082bc3640 10 monclient: _add_conns ranks=[0,5,4,7,8,6,3,2,1] 2024-09-13T10:29:51.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.341+0000 7f6082bc3640 10 monclient(hunting): picked mon.noname-a con 0x7f606000b380 addr v1:172.21.15.181:6789/0 2024-09-13T10:29:51.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.341+0000 7f6082bc3640 10 monclient(hunting): picked mon.noname-h con 0x7f607c126f20 addr v1:172.21.15.195:6791/0 2024-09-13T10:29:51.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.341+0000 7f6082bc3640 10 monclient(hunting): picked mon.noname-c con 0x7f607c1d4150 addr v1:172.21.15.181:6791/0 2024-09-13T10:29:51.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.341+0000 7f6082bc3640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607c1278b0 con 0x7f606000b380 2024-09-13T10:29:51.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.341+0000 7f6082bc3640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607c1263c0 con 0x7f607c1d4150 2024-09-13T10:29:51.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.341+0000 7f6082bc3640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607c127e80 con 0x7f607c126f20 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.341+0000 7f6082bc3640 10 monclient(hunting): _renew_subs 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.341+0000 7f6082bc3640 10 monclient(hunting): authenticate will time out at 730.846144s 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.341+0000 7f608095f640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f606000b380 0x7f607c1ce2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:42578/0 (socket says 172.21.15.181:42578) 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.341+0000 7f608095f640 1 -- 172.21.15.181:0/2895515418 learned_addr learned my addr 172.21.15.181:0/2895515418 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.343+0000 7f6081160640 1 -- 172.21.15.181:0/2895515418 >> v1:172.21.15.181:6791/0 conn(0x7f607c1d4150 legacy=0x7f607c1d6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.343+0000 7f608095f640 1 -- 172.21.15.181:0/2895515418 >> v1:172.21.15.181:6789/0 conn(0x7f606000b380 legacy=0x7f607c1ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.343+0000 7f607bfff640 1 -- 172.21.15.181:0/2895515418 >> v1:172.21.15.195:6791/0 conn(0x7f607c126f20 legacy=0x7f607c139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942374845 0 0) 0x7f607c127e80 con 0x7f607c126f20 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 10 monclient(hunting): _negotiate 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 10 monclient(hunting): my global_id is 4109 2024-09-13T10:29:51.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6060010370 con 0x7f607c126f20 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 511403601 0 0) 0x7f6060010370 con 0x7f607c126f20 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f607c127e80 con 0x7f607c126f20 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6068001c70 con 0x7f607c126f20 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 10 monclient(hunting): dump: 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:29:51.351 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:29:51.352 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:29:51.352 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:29:51.352 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:29:51.352 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:29:51.352 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:29:51.352 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:29:51.352 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:29:51.352 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:29:51.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.344+0000 7f60797fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:29:51.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2932320159 0 0) 0x7f607c127e80 con 0x7f607c126f20 2024-09-13T10:29:51.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 >> v1:172.21.15.181:6791/0 conn(0x7f607c1d4150 legacy=0x7f607c1d6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:51.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 >> v1:172.21.15.181:6789/0 conn(0x7f606000b380 legacy=0x7f607c1ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:51.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f60797fa640 10 monclient: _finish_hunting 0 2024-09-13T10:29:51.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f60797fa640 1 monclient: found mon.h 2024-09-13T10:29:51.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f60797fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:29:51.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f60797fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:29:51.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607c13a360 con 0x7f607c126f20 2024-09-13T10:29:51.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f60797fa640 10 monclient: _finish_auth 0 2024-09-13T10:29:51.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f60797fa640 10 monclient: _check_auth_tickets 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f60797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f6082bc3640 5 monclient: authenticate success, global_id 4109 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f6082bc3640 10 monclient: _renew_subs 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f6082bc3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.346+0000 7f6082bc3640 1 -- 172.21.15.181:0/2895515418 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f607c1d7c60 con 0x7f607c126f20 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.347+0000 7f6082bc3640 10 monclient: _renew_subs 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.347+0000 7f6082bc3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.347+0000 7f6082bc3640 1 -- 172.21.15.181:0/2895515418 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f607c1d8010 con 0x7f607c126f20 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.347+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f60680038c0 con 0x7f607c126f20 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.347+0000 7f60797fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.347+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6068003df0 con 0x7f607c126f20 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.347+0000 7f60797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:29:51.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.347+0000 7f60797fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.347+0000 7f60797fa640 10 monclient: dump: 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:29:51.356 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.347+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f60680057c0 con 0x7f607c126f20 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.347+0000 7f607affd640 4 set_mon_vals no callback set 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.347+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 1806153769 0 0) 0x7f6068006cb0 con 0x7f607c126f20 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.348+0000 7f6082bc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.348+0000 7f6082bc3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.348+0000 7f6082bc3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.348+0000 7f6082bc3640 1 -- 172.21.15.181:0/2895515418 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f605c005080 con 0x7f607c126f20 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.351+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 <== mon.5 v1:172.21.15.195:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7f6068006330 con 0x7f607c126f20 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.351+0000 7f60797fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:29:51.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.351+0000 7f60797fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:29:51.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.415+0000 7f6082bc3640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2024-09-13T10:29:51.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.415+0000 7f6082bc3640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-09-13T10:29:51.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.415+0000 7f6082bc3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:29:51.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.415+0000 7f6082bc3640 1 -- 172.21.15.181:0/2895515418 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f605c005370 con 0x7f607c126f20 2024-09-13T10:29:51.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.421+0000 7f60797fa640 1 -- 172.21.15.181:0/2895515418 <== mon.5 v1:172.21.15.195:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7f6068005e10 con 0x7f607c126f20 2024-09-13T10:29:51.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.421+0000 7f60797fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-09-13T10:29:51.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.421+0000 7f60797fa640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2024-09-13T10:29:51.423 INFO:teuthology.orchestra.run.smithi181.stderr:adjusted tunables profile to default 2024-09-13T10:29:51.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.422+0000 7f6082bc3640 10 monclient: shutdown 2024-09-13T10:29:51.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.422+0000 7f6082bc3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:29:51.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.422+0000 7f6082bc3640 1 -- 172.21.15.181:0/2895515418 >> v1:172.21.15.195:6791/0 conn(0x7f607c126f20 legacy=0x7f607c139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:51.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.422+0000 7f6082bc3640 1 -- 172.21.15.181:0/2895515418 shutdown_connections 2024-09-13T10:29:51.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.422+0000 7f6082bc3640 1 -- 172.21.15.181:0/2895515418 >> 172.21.15.181:0/2895515418 conn(0x7f607c0abcd0 msgr2=0x7f607c1bf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:29:51.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.422+0000 7f6082bc3640 1 -- 172.21.15.181:0/2895515418 shutdown_connections 2024-09-13T10:29:51.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:29:51.422+0000 7f6082bc3640 1 -- 172.21.15.181:0/2895515418 wait complete. 2024-09-13T10:29:51.435 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T10:29:51.435 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T10:29:51.435 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:51.435 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T10:29:51.460 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:51.460 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T10:29:51.526 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-09-13T10:29:51.526 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T10:29:51.590 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:51.590 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T10:29:51.616 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:51.616 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T10:29:51.682 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-09-13T10:29:51.682 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T10:29:51.747 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 222eae7d-397c-40de-9975-11705817eae7 0 2024-09-13T10:29:51.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.885+0000 7ffab50f7640 10 monclient: get_monmap_and_config 2024-09-13T10:29:51.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.885+0000 7ffab50f7640 10 monclient: build_initial_monmap 2024-09-13T10:29:51.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.885+0000 7ffab50f7640 10 monclient: monmap: 2024-09-13T10:29:51.888 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 0 2024-09-13T10:29:51.889 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:51.889 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:51.887619+0000 2024-09-13T10:29:51.889 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:51.887619+0000 2024-09-13T10:29:51.889 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 0 (unknown) 2024-09-13T10:29:51.889 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:29:51.889 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:29:51.889 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:29:51.889 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:29:51.889 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:29:51.889 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:29:51.889 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:29:51.890 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:29:51.890 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:29:51.890 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:29:51.890 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:29:51.894 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.886+0000 7ffab50f7640 1 Processor -- start 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.886+0000 7ffab50f7640 1 -- start start 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.886+0000 7ffab50f7640 10 monclient: init 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.886+0000 7ffab50f7640 10 monclient: _reopen_session rank -1 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.886+0000 7ffab50f7640 10 monclient: _add_conns ranks=[7,5,6,2,8,1,4,3,0] 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.886+0000 7ffab50f7640 10 monclient(hunting): picked mon.noname-i con 0x7ffab00a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.886+0000 7ffab50f7640 10 monclient(hunting): picked mon.noname-h con 0x7ffab00a71c0 addr v1:172.21.15.195:6791/0 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.886+0000 7ffab50f7640 10 monclient(hunting): picked mon.noname-d con 0x7ffab00a5260 addr v1:172.21.15.181:6792/0 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.887+0000 7ffab50f7640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab00a2f10 con 0x7ffab00a71c0 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.887+0000 7ffab50f7640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab00a4a60 con 0x7ffab00a5260 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.887+0000 7ffab50f7640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab00a3a50 con 0x7ffab00a66d0 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.887+0000 7ffab50f7640 10 monclient(hunting): _renew_subs 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.887+0000 7ffab50f7640 10 monclient(hunting): authenticate will time out at 742.613051s 2024-09-13T10:29:51.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.887+0000 7ffaaed9d640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7ffab00a66d0 0x7ffab00a6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.195:48018/0 (socket says 172.21.15.195:48018) 2024-09-13T10:29:51.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.887+0000 7ffaae59c640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7ffab00a71c0 0x7ffab013e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.195:59392/0 (socket says 172.21.15.195:59392) 2024-09-13T10:29:51.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.887+0000 7ffaaed9d640 1 -- 172.21.15.195:0/742273349 learned_addr learned my addr 172.21.15.195:0/742273349 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-09-13T10:29:51.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaae59c640 1 -- 172.21.15.195:0/742273349 >> v1:172.21.15.195:6791/0 conn(0x7ffab00a71c0 legacy=0x7ffab013e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:51.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaaed9d640 1 -- 172.21.15.195:0/742273349 >> v1:172.21.15.195:6792/0 conn(0x7ffab00a66d0 legacy=0x7ffab00a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:51.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaaf59e640 1 -- 172.21.15.195:0/742273349 >> v1:172.21.15.181:6792/0 conn(0x7ffab00a5260 legacy=0x7ffab0141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:51.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 1 -- 172.21.15.195:0/742273349 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528917914 0 0) 0x7ffab00a2f10 con 0x7ffab00a71c0 2024-09-13T10:29:51.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient(hunting): _negotiate 2024-09-13T10:29:51.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:29:51.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient(hunting): my global_id is 4118 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 1 -- 172.21.15.195:0/742273349 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa9c003520 con 0x7ffab00a71c0 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 1 -- 172.21.15.195:0/742273349 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605835276 0 0) 0x7ffab00a4a60 con 0x7ffab00a5260 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient(hunting): _negotiate 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient(hunting): my global_id is 4119 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 1 -- 172.21.15.195:0/742273349 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffab00a2f10 con 0x7ffab00a5260 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 1 -- 172.21.15.195:0/742273349 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 314868125 0 0) 0x7ffa9c003520 con 0x7ffab00a71c0 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 1 -- 172.21.15.195:0/742273349 >> v1:172.21.15.195:6792/0 conn(0x7ffab00a66d0 legacy=0x7ffab00a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 1 -- 172.21.15.195:0/742273349 >> v1:172.21.15.181:6792/0 conn(0x7ffab00a5260 legacy=0x7ffab0141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient: _finish_hunting 0 2024-09-13T10:29:51.897 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 1 monclient: found mon.noname-h 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.195:6791/0 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 1 -- 172.21.15.195:0/742273349 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab00a8390 con 0x7ffab00a71c0 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient: _finish_auth 0 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient: _check_auth_tickets 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 1 -- 172.21.15.195:0/742273349 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffa98001ae0 con 0x7ffab00a71c0 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffab50f7640 5 monclient: authenticate success, global_id 4118 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient: dump: 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:29:51.898 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:29:51.899 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffab50f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 1 -- 172.21.15.195:0/742273349 <== mon.5 v1:172.21.15.195:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffa980047e0 con 0x7ffab00a71c0 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffab50f7640 10 monclient: get_monmap_and_config success 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 1 -- 172.21.15.195:0/742273349 <== mon.5 v1:172.21.15.195:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffa98004d50 con 0x7ffab00a71c0 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffab50f7640 4 set_mon_vals no callback set 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.889+0000 7ffaadd9b640 10 monclient: dump: 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.900 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.901 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:29:51.901 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:29:51.901 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:29:51.901 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:29:51.901 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:29:51.901 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:29:51.901 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:29:51.901 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:29:51.901 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:29:51.902 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:29:51.902 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:29:51.902 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:29:51.902 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.890+0000 7ffab50f7640 10 monclient: shutdown 2024-09-13T10:29:51.902 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.890+0000 7ffab50f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:29:51.902 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.890+0000 7ffab50f7640 1 -- 172.21.15.195:0/742273349 >> v1:172.21.15.195:6791/0 conn(0x7ffab00a71c0 legacy=0x7ffab013e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:51.902 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.890+0000 7ffab50f7640 1 -- 172.21.15.195:0/742273349 shutdown_connections 2024-09-13T10:29:51.902 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.890+0000 7ffab50f7640 1 -- 172.21.15.195:0/742273349 >> 172.21.15.195:0/742273349 conn(0x7ffab00abcd0 msgr2=0x7ffab00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:29:51.902 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.890+0000 7ffab50f7640 1 -- 172.21.15.195:0/742273349 shutdown_connections 2024-09-13T10:29:51.902 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.890+0000 7ffab50f7640 1 -- 172.21.15.195:0/742273349 wait complete. 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.891+0000 7ffab50f7640 10 monclient: build_initial_monmap 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.891+0000 7ffab50f7640 10 monclient: monmap: 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 0 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 0.000000 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:created 0.000000 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 0 (unknown) 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 1 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:29:51.903 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:29:51.904 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:29:51.904 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:29:51.904 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.892+0000 7ffab50f7640 1 Processor -- start 2024-09-13T10:29:51.904 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.892+0000 7ffab50f7640 1 -- start start 2024-09-13T10:29:51.904 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.892+0000 7ffab50f7640 10 monclient: init 2024-09-13T10:29:51.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.893+0000 7ffab50f7640 10 monclient: _reopen_session rank -1 2024-09-13T10:29:51.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.893+0000 7ffab50f7640 10 monclient: _add_conns ranks=[1,5,0,3,2,4,7,6,8] 2024-09-13T10:29:51.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.893+0000 7ffab50f7640 10 monclient(hunting): picked mon.noname-f con 0x7ffab00a5260 addr v1:172.21.15.195:6789/0 2024-09-13T10:29:51.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.893+0000 7ffab50f7640 10 monclient(hunting): picked mon.noname-h con 0x7ffab00a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:29:51.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.893+0000 7ffab50f7640 10 monclient(hunting): picked mon.noname-a con 0x7ffab00a71c0 addr v1:172.21.15.181:6789/0 2024-09-13T10:29:51.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.893+0000 7ffab50f7640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab00a9230 con 0x7ffab00a71c0 2024-09-13T10:29:51.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.893+0000 7ffab50f7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab0124d50 con 0x7ffab00a5260 2024-09-13T10:29:51.908 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.893+0000 7ffab50f7640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab01270b0 con 0x7ffab00a66d0 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.893+0000 7ffab50f7640 10 monclient(hunting): _renew_subs 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.893+0000 7ffab50f7640 10 monclient(hunting): authenticate will time out at 742.619218s 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.893+0000 7ffaae59c640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7ffab00a66d0 0x7ffab01d2f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.195:59402/0 (socket says 172.21.15.195:59402) 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.893+0000 7ffaae59c640 1 -- 172.21.15.195:0/1061499917 learned_addr learned my addr 172.21.15.195:0/1061499917 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaae59c640 1 -- 172.21.15.195:0/1061499917 >> v1:172.21.15.195:6791/0 conn(0x7ffab00a66d0 legacy=0x7ffab01d2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaaed9d640 1 -- 172.21.15.195:0/1061499917 >> v1:172.21.15.195:6789/0 conn(0x7ffab00a5260 legacy=0x7ffab01396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaaf59e640 1 -- 172.21.15.195:0/1061499917 >> v1:172.21.15.181:6789/0 conn(0x7ffab00a71c0 legacy=0x7ffab01d6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089942503 0 0) 0x7ffab01270b0 con 0x7ffab00a66d0 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 10 monclient(hunting): my global_id is 4127 2024-09-13T10:29:51.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa90003520 con 0x7ffab00a66d0 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1292514373 0 0) 0x7ffa90003520 con 0x7ffab00a66d0 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffab01270b0 con 0x7ffab00a66d0 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffa98001d30 con 0x7ffab00a66d0 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 10 monclient(hunting): dump: 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:29:51.910 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.895+0000 7ffaa77fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1078427096 0 0) 0x7ffab01270b0 con 0x7ffab00a66d0 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 >> v1:172.21.15.195:6789/0 conn(0x7ffab00a5260 legacy=0x7ffab01396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 >> v1:172.21.15.181:6789/0 conn(0x7ffab00a71c0 legacy=0x7ffab01d6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 10 monclient: _finish_hunting 0 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 1 monclient: found mon.h 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:29:51.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab0139e00 con 0x7ffab00a66d0 2024-09-13T10:29:51.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 10 monclient: _finish_auth 0 2024-09-13T10:29:51.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 10 monclient: _check_auth_tickets 2024-09-13T10:29:51.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:29:51.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffab50f7640 5 monclient: authenticate success, global_id 4127 2024-09-13T10:29:51.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffab50f7640 10 monclient: _renew_subs 2024-09-13T10:29:51.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffab50f7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:29:51.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffab50f7640 1 -- 172.21.15.195:0/1061499917 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffab013a090 con 0x7ffab00a66d0 2024-09-13T10:29:51.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffab50f7640 10 monclient: _renew_subs 2024-09-13T10:29:51.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffab50f7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:29:51.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffab50f7640 1 -- 172.21.15.195:0/1061499917 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7ffab0125a90 con 0x7ffab00a66d0 2024-09-13T10:29:51.912 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffa98004f80 con 0x7ffab00a66d0 2024-09-13T10:29:51.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:29:51.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaad59a640 4 set_mon_vals no callback set 2024-09-13T10:29:51.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffa98005470 con 0x7ffab00a66d0 2024-09-13T10:29:51.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:29:51.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:29:51.913 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 10 monclient: dump: 2024-09-13T10:29:51.913 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:29:51.913 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:29:51.913 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.913 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7ffa98005b10 con 0x7ffab00a66d0 2024-09-13T10:29:51.914 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.896+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (unknown 168034239 0 0) 0x7ffa98007050 con 0x7ffab00a66d0 2024-09-13T10:29:51.915 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.897+0000 7ffab50f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:29:51.915 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.897+0000 7ffab50f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:29:51.915 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.897+0000 7ffab50f7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:29:51.915 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.897+0000 7ffab50f7640 1 -- 172.21.15.195:0/1061499917 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa94005080 con 0x7ffab00a66d0 2024-09-13T10:29:51.915 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.899+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 <== mon.5 v1:172.21.15.195:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7ffa98006080 con 0x7ffab00a66d0 2024-09-13T10:29:51.915 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.899+0000 7ffaa77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:29:51.915 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.899+0000 7ffaa77fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:29:51.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.969+0000 7ffab50f7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "222eae7d-397c-40de-9975-11705817eae7", "id": 0}] 2024-09-13T10:29:51.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.969+0000 7ffab50f7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "222eae7d-397c-40de-9975-11705817eae7", "id": 0}] 2024-09-13T10:29:51.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.969+0000 7ffab50f7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:29:51.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:51.969+0000 7ffab50f7640 1 -- 172.21.15.195:0/1061499917 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "osd new", "uuid": "222eae7d-397c-40de-9975-11705817eae7", "id": 0} v 0) -- 0x7ffa94005370 con 0x7ffab00a66d0 2024-09-13T10:29:54.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:54.893+0000 7ffaa67fc640 10 monclient: tick 2024-09-13T10:29:54.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:54.893+0000 7ffaa67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:29:54.895 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:54.893+0000 7ffaa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:29:54.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:54.893+0000 7ffaa67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:29:55.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:55.894+0000 7ffaa67fc640 10 monclient: tick 2024-09-13T10:29:55.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:55.894+0000 7ffaa67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:29:55.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:55.894+0000 7ffaa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:29:56.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:56.894+0000 7ffaa67fc640 10 monclient: tick 2024-09-13T10:29:56.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:56.894+0000 7ffaa67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:29:56.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:56.894+0000 7ffaa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:29:57.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:57.894+0000 7ffaa67fc640 10 monclient: tick 2024-09-13T10:29:57.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:57.894+0000 7ffaa67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:29:57.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:57.894+0000 7ffaa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:29:58.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:58.894+0000 7ffaa67fc640 10 monclient: tick 2024-09-13T10:29:58.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:58.894+0000 7ffaa67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:29:58.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:58.894+0000 7ffaa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:29:59.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:59.894+0000 7ffaa67fc640 10 monclient: tick 2024-09-13T10:29:59.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:59.894+0000 7ffaa67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:29:59.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:29:59.894+0000 7ffaa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:00.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:00.895+0000 7ffaa67fc640 10 monclient: tick 2024-09-13T10:30:00.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:00.895+0000 7ffaa67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:00.896 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:00.895+0000 7ffaa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:01.846 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.844+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 <== mon.5 v1:172.21.15.195:6791/0 10 ==== mgrmap(e 2) ==== 50130+0+0 (unknown 1494977327 0 0) 0x7ffa98006260 con 0x7ffab00a66d0 2024-09-13T10:30:01.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.849+0000 7ffaa77fe640 1 -- 172.21.15.195:0/1061499917 <== mon.5 v1:172.21.15.195:6791/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "222eae7d-397c-40de-9975-11705817eae7", "id": 0}]=0 v3) ==== 112+0+2 (unknown 908559273 0 732707515) 0x7ffa98018d40 con 0x7ffab00a66d0 2024-09-13T10:30:01.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.849+0000 7ffaa77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "222eae7d-397c-40de-9975-11705817eae7", "id": 0}] 2024-09-13T10:30:01.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.849+0000 7ffaa77fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:01.851 INFO:teuthology.orchestra.run.smithi195.stdout:0 2024-09-13T10:30:01.853 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.851+0000 7ffab50f7640 10 monclient: shutdown 2024-09-13T10:30:01.853 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.851+0000 7ffab50f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:01.853 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.851+0000 7ffab50f7640 1 -- 172.21.15.195:0/1061499917 >> v1:172.21.15.195:6791/0 conn(0x7ffab00a66d0 legacy=0x7ffab01d2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:01.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.851+0000 7ffab50f7640 1 -- 172.21.15.195:0/1061499917 shutdown_connections 2024-09-13T10:30:01.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.851+0000 7ffab50f7640 1 -- 172.21.15.195:0/1061499917 >> 172.21.15.195:0/1061499917 conn(0x7ffab00abcd0 msgr2=0x7ffab01c17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:01.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.851+0000 7ffab50f7640 1 -- 172.21.15.195:0/1061499917 shutdown_connections 2024-09-13T10:30:01.854 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.851+0000 7ffab50f7640 1 -- 172.21.15.195:0/1061499917 wait complete. 2024-09-13T10:30:01.867 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new c241f0df-9ad4-42f4-809b-872d2c14bdc2 1 2024-09-13T10:30:01.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.970+0000 7f7d6155d640 10 monclient: get_monmap_and_config 2024-09-13T10:30:01.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.970+0000 7f7d6155d640 10 monclient: build_initial_monmap 2024-09-13T10:30:01.972 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.970+0000 7f7d6155d640 10 monclient: monmap: 2024-09-13T10:30:01.972 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 0 2024-09-13T10:30:01.973 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:01.973 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:30:01.971650+0000 2024-09-13T10:30:01.973 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:30:01.971650+0000 2024-09-13T10:30:01.973 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:01.973 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:01.973 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:01.973 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:01.973 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:01.973 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:01.973 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:01.973 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:01.973 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:01.974 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:01.974 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:01.974 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:01.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.971+0000 7f7d6155d640 1 Processor -- start 2024-09-13T10:30:01.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.971+0000 7f7d6155d640 1 -- start start 2024-09-13T10:30:01.975 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.971+0000 7f7d6155d640 10 monclient: init 2024-09-13T10:30:01.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d6155d640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:01.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d6155d640 10 monclient: _add_conns ranks=[2,6,4,1,3,8,7,5,0] 2024-09-13T10:30:01.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d6155d640 10 monclient(hunting): picked mon.noname-b con 0x7f7d5c0a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:01.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d6155d640 10 monclient(hunting): picked mon.noname-d con 0x7f7d5c0a71c0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:01.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d6155d640 10 monclient(hunting): picked mon.noname-c con 0x7f7d5c0a5260 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:01.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d6155d640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d5c0a2f10 con 0x7f7d5c0a66d0 2024-09-13T10:30:01.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d6155d640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d5c0a4a60 con 0x7f7d5c0a5260 2024-09-13T10:30:01.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d6155d640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d5c0a3a50 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d6155d640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:01.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d6155d640 10 monclient(hunting): authenticate will time out at 752.697168s 2024-09-13T10:30:01.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d5affd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f7d5c0a66d0 0x7f7d5c0a6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.195:56570/0 (socket says 172.21.15.195:56570) 2024-09-13T10:30:01.976 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d5affd640 1 -- 172.21.15.195:0/1692405430 learned_addr learned my addr 172.21.15.195:0/1692405430 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-09-13T10:30:01.977 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d53fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f7d5c0a71c0 0x7f7d5c13e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.195:43880/0 (socket says 172.21.15.195:43880) 2024-09-13T10:30:01.977 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.972+0000 7f7d5b7fe640 1 --1- 172.21.15.195:0/1692405430 >> v1:172.21.15.181:6791/0 conn(0x7f7d5c0a5260 0x7f7d5c141e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.195:47410/0 (socket says 172.21.15.195:47410) 2024-09-13T10:30:01.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.974+0000 7f7d5b7fe640 1 -- 172.21.15.195:0/1692405430 >> v1:172.21.15.181:6791/0 conn(0x7f7d5c0a5260 legacy=0x7f7d5c141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:01.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.974+0000 7f7d5affd640 1 -- 172.21.15.195:0/1692405430 >> v1:172.21.15.181:6790/0 conn(0x7f7d5c0a66d0 legacy=0x7f7d5c0a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:01.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.974+0000 7f7d53fff640 1 -- 172.21.15.195:0/1692405430 >> v1:172.21.15.181:6792/0 conn(0x7f7d5c0a71c0 legacy=0x7f7d5c13e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:01.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.974+0000 7f7d5a7fc640 1 -- 172.21.15.195:0/1692405430 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138829238 0 0) 0x7f7d5c0a3a50 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:01.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:01.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:01.985 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient(hunting): my global_id is 4128 2024-09-13T10:30:01.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 1 -- 172.21.15.195:0/1692405430 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d48003520 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 1 -- 172.21.15.195:0/1692405430 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256927240 0 0) 0x7f7d5c0a4a60 con 0x7f7d5c0a5260 2024-09-13T10:30:01.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:01.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:01.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:01.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient(hunting): my global_id is 4153 2024-09-13T10:30:01.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 1 -- 172.21.15.195:0/1692405430 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d5c0a3a50 con 0x7f7d5c0a5260 2024-09-13T10:30:01.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 1 -- 172.21.15.195:0/1692405430 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1880064594 0 0) 0x7f7d48003520 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 1 -- 172.21.15.195:0/1692405430 >> v1:172.21.15.181:6791/0 conn(0x7f7d5c0a5260 legacy=0x7f7d5c141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:01.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 1 -- 172.21.15.195:0/1692405430 >> v1:172.21.15.181:6790/0 conn(0x7f7d5c0a66d0 legacy=0x7f7d5c0a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:01.986 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 1 monclient: found mon.noname-d 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 1 -- 172.21.15.195:0/1692405430 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5c0a8390 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 1 -- 172.21.15.195:0/1692405430 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d44001ad0 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient: dump: 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:01.987 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:01.988 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:01.989 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d6155d640 5 monclient: authenticate success, global_id 4128 2024-09-13T10:30:01.989 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d6155d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:01.989 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 1 -- 172.21.15.195:0/1692405430 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d44001cf0 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.989 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:01.989 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d6155d640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:01.989 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 1 -- 172.21.15.195:0/1692405430 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d44004b20 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.989 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d6155d640 4 set_mon_vals no callback set 2024-09-13T10:30:01.989 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:01.989 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d5a7fc640 10 monclient: dump: 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:01.990 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d6155d640 10 monclient: shutdown 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d6155d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.975+0000 7f7d6155d640 1 -- 172.21.15.195:0/1692405430 >> v1:172.21.15.181:6792/0 conn(0x7f7d5c0a71c0 legacy=0x7f7d5c13e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.976+0000 7f7d6155d640 1 -- 172.21.15.195:0/1692405430 shutdown_connections 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.976+0000 7f7d6155d640 1 -- 172.21.15.195:0/1692405430 >> 172.21.15.195:0/1692405430 conn(0x7f7d5c0abcd0 msgr2=0x7f7d5c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.976+0000 7f7d6155d640 1 -- 172.21.15.195:0/1692405430 shutdown_connections 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.976+0000 7f7d6155d640 1 -- 172.21.15.195:0/1692405430 wait complete. 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.976+0000 7f7d6155d640 10 monclient: build_initial_monmap 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.976+0000 7f7d6155d640 10 monclient: monmap: 2024-09-13T10:30:01.991 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 0 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 0.000000 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:created 0.000000 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 1 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:01.992 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:01.993 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:01.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.976+0000 7f7d6155d640 1 Processor -- start 2024-09-13T10:30:01.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.976+0000 7f7d6155d640 1 -- start start 2024-09-13T10:30:01.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.976+0000 7f7d6155d640 10 monclient: init 2024-09-13T10:30:01.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.977+0000 7f7d6155d640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:01.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.977+0000 7f7d6155d640 10 monclient: _add_conns ranks=[6,1,0,4,3,5,8,7,2] 2024-09-13T10:30:01.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.977+0000 7f7d6155d640 10 monclient(hunting): picked mon.noname-d con 0x7f7d5c0a5260 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:01.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.977+0000 7f7d6155d640 10 monclient(hunting): picked mon.noname-f con 0x7f7d5c0a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:01.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.977+0000 7f7d6155d640 10 monclient(hunting): picked mon.noname-a con 0x7f7d5c0a71c0 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:01.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.977+0000 7f7d6155d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d5c0a2100 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.977+0000 7f7d6155d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d5c123e50 con 0x7f7d5c0a66d0 2024-09-13T10:30:01.993 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.977+0000 7f7d6155d640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d5c127190 con 0x7f7d5c0a5260 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.977+0000 7f7d6155d640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.977+0000 7f7d6155d640 10 monclient(hunting): authenticate will time out at 752.702424s 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.977+0000 7f7d53fff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f7d5c0a66d0 0x7f7d5c1d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:42450/0 (socket says 172.21.15.195:42450) 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.977+0000 7f7d53fff640 1 -- 172.21.15.195:0/3144277767 learned_addr learned my addr 172.21.15.195:0/3144277767 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d53fff640 1 -- 172.21.15.195:0/3144277767 >> v1:172.21.15.195:6789/0 conn(0x7f7d5c0a66d0 legacy=0x7f7d5c1d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d5affd640 1 -- 172.21.15.195:0/3144277767 >> v1:172.21.15.181:6792/0 conn(0x7f7d5c0a5260 legacy=0x7f7d5c1397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d5b7fe640 1 -- 172.21.15.195:0/3144277767 >> v1:172.21.15.181:6789/0 conn(0x7f7d5c0a71c0 legacy=0x7f7d5c1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552667492 0 0) 0x7f7d5c123e50 con 0x7f7d5c0a66d0 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 10 monclient(hunting): my global_id is 54118 2024-09-13T10:30:01.994 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d3c003520 con 0x7f7d5c0a66d0 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3746114683 0 0) 0x7f7d5c127190 con 0x7f7d5c0a5260 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 10 monclient(hunting): my global_id is 4137 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d5c123e50 con 0x7f7d5c0a5260 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621571301 0 0) 0x7f7d5c0a2100 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 10 monclient(hunting): my global_id is 54117 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.979+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d5c127190 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.995 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3686950138 0 0) 0x7f7d3c003520 con 0x7f7d5c0a66d0 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d5c0a2100 con 0x7f7d5c0a66d0 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d44001a90 con 0x7f7d5c0a66d0 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient(hunting): dump: 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:01.996 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2558614155 0 0) 0x7f7d5c123e50 con 0x7f7d5c0a5260 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d3c003520 con 0x7f7d5c0a5260 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d4c001c30 con 0x7f7d5c0a5260 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:01.997 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:01.998 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient(hunting): dump: 2024-09-13T10:30:01.998 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:01.998 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:01.998 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:01.998 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:01.998 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:01.998 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:01.998 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:01.998 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:01.998 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:01.998 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 226857534 0 0) 0x7f7d5c127190 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d5c123e50 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d54004ea0 con 0x7f7d5c0a71c0 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient(hunting): dump: 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:01.999 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:02.000 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:02.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1744541165 0 0) 0x7f7d5c0a2100 con 0x7f7d5c0a66d0 2024-09-13T10:30:02.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 >> v1:172.21.15.181:6792/0 conn(0x7f7d5c0a5260 legacy=0x7f7d5c1397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:02.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 >> v1:172.21.15.181:6789/0 conn(0x7f7d5c0a71c0 legacy=0x7f7d5c1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:02.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:02.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 monclient: found mon.f 2024-09-13T10:30:02.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:02.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:02.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5c1268f0 con 0x7f7d5c0a66d0 2024-09-13T10:30:02.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient: _finish_auth 0 2024-09-13T10:30:02.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:02.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:02.001 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d6155d640 5 monclient: authenticate success, global_id 54118 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d6155d640 10 monclient: _renew_subs 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d6155d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d6155d640 1 -- 172.21.15.195:0/3144277767 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7d5c123a90 con 0x7f7d5c0a66d0 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d6155d640 10 monclient: _renew_subs 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d6155d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d6155d640 1 -- 172.21.15.195:0/3144277767 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7d5c13a0c0 con 0x7f7d5c0a66d0 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d44005020 con 0x7f7d5c0a66d0 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d44005510 con 0x7f7d5c0a66d0 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d59ffb640 4 set_mon_vals no callback set 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:02.002 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.980+0000 7f7d537fe640 10 monclient: dump: 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:02.003 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:02.004 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:02.004 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:02.004 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.981+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 2) ==== 50130+0+0 (unknown 1494977327 0 0) 0x7f7d44011a90 con 0x7f7d5c0a66d0 2024-09-13T10:30:02.004 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.981+0000 7f7d6155d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:02.004 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.981+0000 7f7d6155d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:02.004 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.981+0000 7f7d6155d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:02.004 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.981+0000 7f7d6155d640 1 -- 172.21.15.195:0/3144277767 --> v1:172.21.15.195:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d40005080 con 0x7f7d5c0a66d0 2024-09-13T10:30:02.004 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.981+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (unknown 1029354133 0 0) 0x7f7d4404d1d0 con 0x7f7d5c0a66d0 2024-09-13T10:30:02.004 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.983+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.1 v1:172.21.15.195:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7f7d44017670 con 0x7f7d5c0a66d0 2024-09-13T10:30:02.004 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.983+0000 7f7d537fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:02.004 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:01.983+0000 7f7d537fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:02.053 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.051+0000 7f7d6155d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c241f0df-9ad4-42f4-809b-872d2c14bdc2", "id": 1}] 2024-09-13T10:30:02.053 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.051+0000 7f7d6155d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c241f0df-9ad4-42f4-809b-872d2c14bdc2", "id": 1}] 2024-09-13T10:30:02.053 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.051+0000 7f7d6155d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:02.053 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.051+0000 7f7d6155d640 1 -- 172.21.15.195:0/3144277767 --> v1:172.21.15.195:6789/0 -- mon_command({"prefix": "osd new", "uuid": "c241f0df-9ad4-42f4-809b-872d2c14bdc2", "id": 1} v 0) -- 0x7f7d40005370 con 0x7f7d5c0a66d0 2024-09-13T10:30:02.058 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.056+0000 7f7d537fe640 1 -- 172.21.15.195:0/3144277767 <== mon.1 v1:172.21.15.195:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c241f0df-9ad4-42f4-809b-872d2c14bdc2", "id": 1}]=0 v4) ==== 112+0+2 (unknown 4148314600 0 940483276) 0x7f7d44016f70 con 0x7f7d5c0a66d0 2024-09-13T10:30:02.058 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.056+0000 7f7d537fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c241f0df-9ad4-42f4-809b-872d2c14bdc2", "id": 1}] 2024-09-13T10:30:02.058 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.056+0000 7f7d537fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:02.058 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-09-13T10:30:02.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.057+0000 7f7d6155d640 10 monclient: shutdown 2024-09-13T10:30:02.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.057+0000 7f7d6155d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:02.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.057+0000 7f7d6155d640 1 -- 172.21.15.195:0/3144277767 >> v1:172.21.15.195:6789/0 conn(0x7f7d5c0a66d0 legacy=0x7f7d5c1d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:02.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.057+0000 7f7d6155d640 1 -- 172.21.15.195:0/3144277767 shutdown_connections 2024-09-13T10:30:02.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.057+0000 7f7d6155d640 1 -- 172.21.15.195:0/3144277767 >> 172.21.15.195:0/3144277767 conn(0x7f7d5c0abcd0 msgr2=0x7f7d5c1c15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:02.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.057+0000 7f7d6155d640 1 -- 172.21.15.195:0/3144277767 shutdown_connections 2024-09-13T10:30:02.060 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.057+0000 7f7d6155d640 1 -- 172.21.15.195:0/3144277767 wait complete. 2024-09-13T10:30:02.069 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new efbff8a5-b42c-4e47-92e1-faf8ef9bec2b 2 2024-09-13T10:30:02.165 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.164+0000 7f6c37040640 10 monclient: get_monmap_and_config 2024-09-13T10:30:02.165 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.164+0000 7f6c37040640 10 monclient: build_initial_monmap 2024-09-13T10:30:02.165 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.164+0000 7f6c37040640 10 monclient: monmap: 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 0 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:30:02.164869+0000 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:30:02.164869+0000 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:02.166 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:02.167 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:02.167 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:02.167 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:02.168 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.164+0000 7f6c37040640 1 Processor -- start 2024-09-13T10:30:02.168 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.164+0000 7f6c37040640 1 -- start start 2024-09-13T10:30:02.168 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.164+0000 7f6c37040640 10 monclient: init 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c37040640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c37040640 10 monclient: _add_conns ranks=[8,3,5,1,0,4,7,2,6] 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c37040640 10 monclient(hunting): picked mon.noname-e con 0x7f6c300a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c37040640 10 monclient(hunting): picked mon.noname-g con 0x7f6c300a71c0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c37040640 10 monclient(hunting): picked mon.noname-h con 0x7f6c300a5260 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c37040640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c300a2f10 con 0x7f6c300a71c0 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c37040640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c300a4a60 con 0x7f6c300a5260 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c37040640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c300a3a50 con 0x7f6c300a66d0 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c37040640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c37040640 10 monclient(hunting): authenticate will time out at 752.890559s 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c355dd640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f6c300a5260 0x7f6c30141e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.195:55960/0 (socket says 172.21.15.195:55960) 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c355dd640 1 -- 172.21.15.195:0/1932865144 learned_addr learned my addr 172.21.15.195:0/1932865144 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-09-13T10:30:02.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.165+0000 7f6c2ffff640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f6c300a71c0 0x7f6c3013e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.195:60072/0 (socket says 172.21.15.195:60072) 2024-09-13T10:30:02.170 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.167+0000 7f6c2ffff640 1 -- 172.21.15.195:0/1932865144 >> v1:172.21.15.195:6790/0 conn(0x7f6c300a71c0 legacy=0x7f6c3013e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:02.170 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.167+0000 7f6c355dd640 1 -- 172.21.15.195:0/1932865144 >> v1:172.21.15.195:6791/0 conn(0x7f6c300a5260 legacy=0x7f6c30141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:02.170 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.168+0000 7f6c34ddc640 1 -- 172.21.15.195:0/1932865144 >> v1:172.21.15.181:6793/0 conn(0x7f6c300a66d0 legacy=0x7f6c300a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:02.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418448944 0 0) 0x7f6c300a2f10 con 0x7f6c300a71c0 2024-09-13T10:30:02.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:02.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:02.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:02.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient(hunting): my global_id is 4134 2024-09-13T10:30:02.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c18003520 con 0x7f6c300a71c0 2024-09-13T10:30:02.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3794259717 0 0) 0x7f6c300a4a60 con 0x7f6c300a5260 2024-09-13T10:30:02.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:02.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:02.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:02.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient(hunting): my global_id is 4145 2024-09-13T10:30:02.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c300a2f10 con 0x7f6c300a5260 2024-09-13T10:30:02.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586510308 0 0) 0x7f6c300a3a50 con 0x7f6c300a66d0 2024-09-13T10:30:02.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:02.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:02.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:02.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient(hunting): my global_id is 4121 2024-09-13T10:30:02.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c300a4a60 con 0x7f6c300a66d0 2024-09-13T10:30:02.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2571165470 0 0) 0x7f6c18003520 con 0x7f6c300a71c0 2024-09-13T10:30:02.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 >> v1:172.21.15.181:6793/0 conn(0x7f6c300a66d0 legacy=0x7f6c300a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:02.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 >> v1:172.21.15.195:6791/0 conn(0x7f6c300a5260 legacy=0x7f6c30141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:02.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:02.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 monclient: found mon.noname-g 2024-09-13T10:30:02.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:02.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c300a8390 con 0x7f6c300a71c0 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c24001ba0 con 0x7f6c300a71c0 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient: dump: 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:02.817 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c37040640 5 monclient: authenticate success, global_id 4134 2024-09-13T10:30:02.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c37040640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:02.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c240047e0 con 0x7f6c300a71c0 2024-09-13T10:30:02.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:02.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 1 -- 172.21.15.195:0/1932865144 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c24001d40 con 0x7f6c300a71c0 2024-09-13T10:30:02.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:02.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:02.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c2f7fe640 10 monclient: dump: 2024-09-13T10:30:02.819 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:02.819 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:02.819 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:02.819 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:02.819 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:02.819 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:02.820 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:02.820 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:02.820 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:02.820 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:02.820 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:02.820 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:02.820 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:02.820 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:02.820 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:02.820 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:02.820 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c37040640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:02.820 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.812+0000 7f6c37040640 4 set_mon_vals no callback set 2024-09-13T10:30:02.825 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.813+0000 7f6c37040640 10 monclient: shutdown 2024-09-13T10:30:02.825 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.813+0000 7f6c37040640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:02.825 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.813+0000 7f6c37040640 1 -- 172.21.15.195:0/1932865144 >> v1:172.21.15.195:6790/0 conn(0x7f6c300a71c0 legacy=0x7f6c3013e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:02.825 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.813+0000 7f6c37040640 1 -- 172.21.15.195:0/1932865144 shutdown_connections 2024-09-13T10:30:02.825 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.813+0000 7f6c37040640 1 -- 172.21.15.195:0/1932865144 >> 172.21.15.195:0/1932865144 conn(0x7f6c300abcd0 msgr2=0x7f6c300ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:02.825 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.813+0000 7f6c37040640 1 -- 172.21.15.195:0/1932865144 shutdown_connections 2024-09-13T10:30:02.825 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.813+0000 7f6c37040640 1 -- 172.21.15.195:0/1932865144 wait complete. 2024-09-13T10:30:02.825 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.814+0000 7f6c37040640 10 monclient: build_initial_monmap 2024-09-13T10:30:02.825 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.814+0000 7f6c37040640 10 monclient: monmap: 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 0 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 0.000000 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:created 0.000000 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 1 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:02.826 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:02.827 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:02.827 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:02.827 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:02.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.814+0000 7f6c37040640 1 Processor -- start 2024-09-13T10:30:02.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.814+0000 7f6c37040640 1 -- start start 2024-09-13T10:30:02.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.814+0000 7f6c37040640 10 monclient: init 2024-09-13T10:30:02.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.815+0000 7f6c37040640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:02.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.815+0000 7f6c37040640 10 monclient: _add_conns ranks=[6,2,5,4,3,1,7,8,0] 2024-09-13T10:30:02.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.815+0000 7f6c37040640 10 monclient(hunting): picked mon.noname-d con 0x7f6c300a5260 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:02.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.815+0000 7f6c37040640 10 monclient(hunting): picked mon.noname-b con 0x7f6c300a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:02.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.815+0000 7f6c37040640 10 monclient(hunting): picked mon.noname-h con 0x7f6c300a71c0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:02.827 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.815+0000 7f6c37040640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c301264e0 con 0x7f6c300a66d0 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.815+0000 7f6c37040640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c300a9260 con 0x7f6c300a71c0 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.815+0000 7f6c37040640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c30125210 con 0x7f6c300a5260 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.815+0000 7f6c37040640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.815+0000 7f6c37040640 10 monclient(hunting): authenticate will time out at 753.540646s 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.815+0000 7f6c355dd640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f6c300a71c0 0x7f6c301d67a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.195:55968/0 (socket says 172.21.15.195:55968) 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.815+0000 7f6c355dd640 1 -- 172.21.15.195:0/2820064326 learned_addr learned my addr 172.21.15.195:0/2820064326 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.817+0000 7f6c355dd640 1 -- 172.21.15.195:0/2820064326 >> v1:172.21.15.195:6791/0 conn(0x7f6c300a71c0 legacy=0x7f6c301d67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.817+0000 7f6c2ffff640 1 -- 172.21.15.195:0/2820064326 >> v1:172.21.15.181:6790/0 conn(0x7f6c300a66d0 legacy=0x7f6c301d3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.817+0000 7f6c34ddc640 1 -- 172.21.15.195:0/2820064326 >> v1:172.21.15.181:6792/0 conn(0x7f6c300a5260 legacy=0x7f6c30139bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2246668207 0 0) 0x7f6c301264e0 con 0x7f6c300a66d0 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:02.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient(hunting): my global_id is 4133 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c1c003550 con 0x7f6c300a66d0 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1371903240 0 0) 0x7f6c1c003550 con 0x7f6c300a66d0 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c301264e0 con 0x7f6c300a66d0 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c24001b60 con 0x7f6c300a66d0 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient(hunting): dump: 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:02.829 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1880891599 0 0) 0x7f6c301264e0 con 0x7f6c300a66d0 2024-09-13T10:30:02.830 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 >> v1:172.21.15.181:6792/0 conn(0x7f6c300a5260 legacy=0x7f6c30139bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 >> v1:172.21.15.195:6791/0 conn(0x7f6c300a71c0 legacy=0x7f6c301d67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 1 monclient: found mon.b 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c30127570 con 0x7f6c300a66d0 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient: _finish_auth 0 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c37040640 5 monclient: authenticate success, global_id 4133 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c37040640 10 monclient: _renew_subs 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c37040640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:02.831 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c37040640 1 -- 172.21.15.195:0/2820064326 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3013a2c0 con 0x7f6c300a66d0 2024-09-13T10:30:02.832 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c37040640 10 monclient: _renew_subs 2024-09-13T10:30:02.832 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c37040640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:02.832 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c37040640 1 -- 172.21.15.195:0/2820064326 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6c30125f50 con 0x7f6c300a66d0 2024-09-13T10:30:02.832 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c240050b0 con 0x7f6c300a66d0 2024-09-13T10:30:02.832 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:02.832 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c240047e0 con 0x7f6c300a66d0 2024-09-13T10:30:02.832 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:02.832 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:02.832 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2effd640 4 set_mon_vals no callback set 2024-09-13T10:30:02.832 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.818+0000 7f6c2d7fa640 10 monclient: dump: 2024-09-13T10:30:02.832 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:02.832 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:02.833 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:02.834 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:02.834 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.819+0000 7f6c37040640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:02.834 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.819+0000 7f6c37040640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:02.834 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.819+0000 7f6c37040640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:02.834 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.819+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 2) ==== 50130+0+0 (unknown 1494977327 0 0) 0x7f6c24011980 con 0x7f6c300a66d0 2024-09-13T10:30:02.834 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.819+0000 7f6c37040640 1 -- 172.21.15.195:0/2820064326 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c10005080 con 0x7f6c300a66d0 2024-09-13T10:30:02.834 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.819+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (unknown 338027263 0 0) 0x7f6c2404d300 con 0x7f6c300a66d0 2024-09-13T10:30:02.834 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.821+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7f6c24017730 con 0x7f6c300a66d0 2024-09-13T10:30:02.834 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.821+0000 7f6c2d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:02.834 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.821+0000 7f6c2d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:02.878 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.876+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 <== mon.2 v1:172.21.15.181:6790/0 10 ==== mgrmap(e 3) ==== 50222+0+0 (unknown 1096830252 0 0) 0x7f6c2404c390 con 0x7f6c300a66d0 2024-09-13T10:30:02.880 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.879+0000 7f6c34ddc640 10 monclient: get_auth_request con 0x7f6c1c040980 auth_method 0 2024-09-13T10:30:02.893 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-09-13T10:30:02.891+0000 7f3fde516640 -1 mgr.server handle_report got status from non-daemon mon.h 2024-09-13T10:30:02.896 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-09-13T10:30:02.894+0000 7f3fde516640 -1 mgr.server handle_report got status from non-daemon mon.d 2024-09-13T10:30:02.896 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-09-13T10:30:02.894+0000 7f3fde516640 -1 mgr.server handle_report got status from non-daemon mon.f 2024-09-13T10:30:02.896 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-09-13T10:30:02.894+0000 7f3fde516640 -1 mgr.server handle_report got status from non-daemon mon.e 2024-09-13T10:30:02.896 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-09-13T10:30:02.894+0000 7f3fde516640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T10:30:02.896 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-09-13T10:30:02.894+0000 7f3fde516640 -1 mgr.server handle_report got status from non-daemon mon.i 2024-09-13T10:30:02.896 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-09-13T10:30:02.894+0000 7f3fde516640 -1 mgr.server handle_report got status from non-daemon mon.g 2024-09-13T10:30:02.896 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-09-13T10:30:02.894+0000 7f3fde516640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T10:30:02.901 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.899+0000 7f6c37040640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "efbff8a5-b42c-4e47-92e1-faf8ef9bec2b", "id": 2}] 2024-09-13T10:30:02.901 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.899+0000 7f6c37040640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "efbff8a5-b42c-4e47-92e1-faf8ef9bec2b", "id": 2}] 2024-09-13T10:30:02.901 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.899+0000 7f6c37040640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:02.901 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:02.899+0000 7f6c37040640 1 -- 172.21.15.195:0/2820064326 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "osd new", "uuid": "efbff8a5-b42c-4e47-92e1-faf8ef9bec2b", "id": 2} v 0) -- 0x7f6c10005370 con 0x7f6c300a66d0 2024-09-13T10:30:03.240 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.239+0000 7f6c2d7fa640 1 -- 172.21.15.195:0/2820064326 <== mon.2 v1:172.21.15.181:6790/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "efbff8a5-b42c-4e47-92e1-faf8ef9bec2b", "id": 2}]=0 v5) ==== 112+0+2 (unknown 337208298 0 216599125) 0x7f6c24017460 con 0x7f6c300a66d0 2024-09-13T10:30:03.241 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.239+0000 7f6c2d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "efbff8a5-b42c-4e47-92e1-faf8ef9bec2b", "id": 2}] 2024-09-13T10:30:03.241 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.239+0000 7f6c2d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:03.241 INFO:teuthology.orchestra.run.smithi195.stdout:2 2024-09-13T10:30:03.242 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.240+0000 7f6c37040640 1 -- 172.21.15.195:0/2820064326 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6c1c040980 legacy=0x7f6c1c042d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.242 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.240+0000 7f6c37040640 10 monclient: shutdown 2024-09-13T10:30:03.242 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.240+0000 7f6c37040640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:03.242 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.240+0000 7f6c37040640 1 -- 172.21.15.195:0/2820064326 >> v1:172.21.15.181:6790/0 conn(0x7f6c300a66d0 legacy=0x7f6c301d3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.242 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.240+0000 7f6c37040640 1 -- 172.21.15.195:0/2820064326 shutdown_connections 2024-09-13T10:30:03.242 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.240+0000 7f6c37040640 1 -- 172.21.15.195:0/2820064326 >> 172.21.15.195:0/2820064326 conn(0x7f6c300abcd0 msgr2=0x7f6c301c1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:03.242 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.240+0000 7f6c37040640 1 -- 172.21.15.195:0/2820064326 shutdown_connections 2024-09-13T10:30:03.242 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.240+0000 7f6c37040640 1 -- 172.21.15.195:0/2820064326 wait complete. 2024-09-13T10:30:03.252 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 11e6b317-e77c-4469-840a-a1d17e9eee86 3 2024-09-13T10:30:03.349 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.347+0000 7f1acc300640 10 monclient: get_monmap_and_config 2024-09-13T10:30:03.349 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.347+0000 7f1acc300640 10 monclient: build_initial_monmap 2024-09-13T10:30:03.349 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.347+0000 7f1acc300640 10 monclient: monmap: 2024-09-13T10:30:03.349 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 0 2024-09-13T10:30:03.349 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:03.349 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:30:03.348487+0000 2024-09-13T10:30:03.350 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:30:03.348487+0000 2024-09-13T10:30:03.350 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:03.350 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:03.350 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:03.350 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:03.350 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:03.350 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:03.350 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:03.350 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:03.350 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:03.350 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:03.351 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:03.351 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:03.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 1 Processor -- start 2024-09-13T10:30:03.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 1 -- start start 2024-09-13T10:30:03.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 10 monclient: init 2024-09-13T10:30:03.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:03.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 10 monclient: _add_conns ranks=[0,3,4,7,2,6,8,1,5] 2024-09-13T10:30:03.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 10 monclient(hunting): picked mon.noname-a con 0x7f1ac40a6540 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:03.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 10 monclient(hunting): picked mon.noname-g con 0x7f1ac409d360 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:03.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 10 monclient(hunting): picked mon.noname-c con 0x7f1ac409cec0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:03.356 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac40a51e0 con 0x7f1ac40a6540 2024-09-13T10:30:03.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac40a8380 con 0x7f1ac409d360 2024-09-13T10:30:03.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac409e250 con 0x7f1ac409cec0 2024-09-13T10:30:03.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:03.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.348+0000 7f1acc300640 10 monclient(hunting): authenticate will time out at 754.073988s 2024-09-13T10:30:03.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.349+0000 7f1ac989b640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f1ac409d360 0x7f1ac413e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.195:60080/0 (socket says 172.21.15.195:60080) 2024-09-13T10:30:03.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.349+0000 7f1ac989b640 1 -- 172.21.15.195:0/802333356 learned_addr learned my addr 172.21.15.195:0/802333356 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-09-13T10:30:03.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac989b640 1 -- 172.21.15.195:0/802333356 >> v1:172.21.15.195:6790/0 conn(0x7f1ac409d360 legacy=0x7f1ac413e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:03.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 1 -- 172.21.15.195:0/802333356 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398083689 0 0) 0x7f1ac40a8380 con 0x7f1ac409d360 2024-09-13T10:30:03.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient(hunting): _negotiate 2024-09-13T10:30:03.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:03.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:03.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient(hunting): my global_id is 4143 2024-09-13T10:30:03.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 1 -- 172.21.15.195:0/802333356 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ab0003520 con 0x7f1ac409d360 2024-09-13T10:30:03.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1aca89d640 1 -- 172.21.15.195:0/802333356 >> v1:172.21.15.181:6791/0 conn(0x7f1ac409cec0 legacy=0x7f1ac4141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:03.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1aca09c640 1 -- 172.21.15.195:0/802333356 >> v1:172.21.15.181:6789/0 conn(0x7f1ac40a6540 legacy=0x7f1ac40a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:03.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 1 -- 172.21.15.195:0/802333356 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3607872106 0 0) 0x7f1ab0003520 con 0x7f1ac409d360 2024-09-13T10:30:03.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 1 -- 172.21.15.195:0/802333356 >> v1:172.21.15.181:6791/0 conn(0x7f1ac409cec0 legacy=0x7f1ac4141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 1 -- 172.21.15.195:0/802333356 >> v1:172.21.15.181:6789/0 conn(0x7f1ac40a6540 legacy=0x7f1ac40a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient: _finish_hunting 0 2024-09-13T10:30:03.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 1 monclient: found mon.noname-g 2024-09-13T10:30:03.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:03.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:30:03.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 1 -- 172.21.15.195:0/802333356 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac409e530 con 0x7f1ac409d360 2024-09-13T10:30:03.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient: _finish_auth 0 2024-09-13T10:30:03.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient: _check_auth_tickets 2024-09-13T10:30:03.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:03.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1acc300640 5 monclient: authenticate success, global_id 4143 2024-09-13T10:30:03.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 1 -- 172.21.15.195:0/802333356 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1ab4001ba0 con 0x7f1ac409d360 2024-09-13T10:30:03.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1acc300640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:03.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:03.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:30:03.359 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient: dump: 2024-09-13T10:30:03.359 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:03.359 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:03.359 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.360 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.360 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:03.360 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:03.360 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:03.360 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:03.360 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:03.360 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:03.361 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:03.361 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:03.361 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:03.361 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:03.361 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:03.361 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:03.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1acc300640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:03.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 1 -- 172.21.15.195:0/802333356 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ab40048a0 con 0x7f1ac409d360 2024-09-13T10:30:03.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:03.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 1 -- 172.21.15.195:0/802333356 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1ab4004e10 con 0x7f1ac409d360 2024-09-13T10:30:03.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1acc300640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:03.361 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1acc300640 4 set_mon_vals no callback set 2024-09-13T10:30:03.362 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:03.362 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:03.362 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.351+0000 7f1ac909a640 10 monclient: dump: 2024-09-13T10:30:03.362 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:03.362 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:03.362 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.362 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.362 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:03.362 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:03.362 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.352+0000 7f1acc300640 10 monclient: shutdown 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.352+0000 7f1acc300640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.352+0000 7f1acc300640 1 -- 172.21.15.195:0/802333356 >> v1:172.21.15.195:6790/0 conn(0x7f1ac409d360 legacy=0x7f1ac413e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.352+0000 7f1acc300640 1 -- 172.21.15.195:0/802333356 shutdown_connections 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.352+0000 7f1acc300640 1 -- 172.21.15.195:0/802333356 >> 172.21.15.195:0/802333356 conn(0x7f1ac40abc40 msgr2=0x7f1ac40ac050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.352+0000 7f1acc300640 1 -- 172.21.15.195:0/802333356 shutdown_connections 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.352+0000 7f1acc300640 1 -- 172.21.15.195:0/802333356 wait complete. 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.352+0000 7f1acc300640 10 monclient: build_initial_monmap 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.352+0000 7f1acc300640 10 monclient: monmap: 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 0 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 0.000000 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:created 0.000000 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 1 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:03.364 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:03.365 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:03.365 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:03.365 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:03.365 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:03.365 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:03.365 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:03.365 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:03.365 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:03.365 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 1 Processor -- start 2024-09-13T10:30:03.365 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 1 -- start start 2024-09-13T10:30:03.365 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 10 monclient: init 2024-09-13T10:30:03.365 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:03.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 10 monclient: _add_conns ranks=[7,6,0,1,3,2,4,8,5] 2024-09-13T10:30:03.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 10 monclient(hunting): picked mon.noname-i con 0x7f1ac409cec0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:03.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 10 monclient(hunting): picked mon.noname-d con 0x7f1ac409d360 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:03.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 10 monclient(hunting): picked mon.noname-a con 0x7f1ac40a6540 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:03.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac40a9250 con 0x7f1ac40a6540 2024-09-13T10:30:03.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac4124f10 con 0x7f1ac409d360 2024-09-13T10:30:03.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac4127270 con 0x7f1ac409cec0 2024-09-13T10:30:03.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:03.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1acc300640 10 monclient(hunting): authenticate will time out at 754.078879s 2024-09-13T10:30:03.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1aca09c640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f1ac409cec0 0x7f1ac41398b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.195:37790/0 (socket says 172.21.15.195:37790) 2024-09-13T10:30:03.366 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.353+0000 7f1aca09c640 1 -- 172.21.15.195:0/2205438332 learned_addr learned my addr 172.21.15.195:0/2205438332 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-09-13T10:30:03.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1aca09c640 1 -- 172.21.15.195:0/2205438332 >> v1:172.21.15.195:6792/0 conn(0x7f1ac409cec0 legacy=0x7f1ac41398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:03.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 693319323 0 0) 0x7f1ac4127270 con 0x7f1ac409cec0 2024-09-13T10:30:03.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:03.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:03.371 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:03.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): my global_id is 54133 2024-09-13T10:30:03.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1aa8003520 con 0x7f1ac409cec0 2024-09-13T10:30:03.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1aca89d640 1 -- 172.21.15.195:0/2205438332 >> v1:172.21.15.181:6789/0 conn(0x7f1ac40a6540 legacy=0x7f1ac41d6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:03.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1ac989b640 1 -- 172.21.15.195:0/2205438332 >> v1:172.21.15.181:6792/0 conn(0x7f1ac409d360 legacy=0x7f1ac41d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:03.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1666883757 0 0) 0x7f1aa8003520 con 0x7f1ac409cec0 2024-09-13T10:30:03.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ac4127270 con 0x7f1ac409cec0 2024-09-13T10:30:03.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1ac0003610 con 0x7f1ac409cec0 2024-09-13T10:30:03.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:03.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:30:03.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): dump: 2024-09-13T10:30:03.373 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:03.373 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:03.373 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.373 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.374 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:03.374 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:03.374 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:03.374 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:03.374 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:03.374 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:03.374 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:03.374 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:03.374 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:03.374 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:03.375 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:03.375 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:03.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:03.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001634988 0 0) 0x7f1ac4124f10 con 0x7f1ac409d360 2024-09-13T10:30:03.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:03.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:03.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:03.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): my global_id is 4146 2024-09-13T10:30:03.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1aa8003520 con 0x7f1ac409d360 2024-09-13T10:30:03.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469843061 0 0) 0x7f1ac40a9250 con 0x7f1ac40a6540 2024-09-13T10:30:03.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:03.375 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:03.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:03.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient(hunting): my global_id is 54135 2024-09-13T10:30:03.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ac4124f10 con 0x7f1ac40a6540 2024-09-13T10:30:03.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1846813250 0 0) 0x7f1ac4127270 con 0x7f1ac409cec0 2024-09-13T10:30:03.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 >> v1:172.21.15.181:6792/0 conn(0x7f1ac409d360 legacy=0x7f1ac41d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 >> v1:172.21.15.181:6789/0 conn(0x7f1ac40a6540 legacy=0x7f1ac41d6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.376 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:03.377 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 monclient: found mon.i 2024-09-13T10:30:03.377 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:03.377 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:03.377 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac41269d0 con 0x7f1ac409cec0 2024-09-13T10:30:03.377 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient: _finish_auth 0 2024-09-13T10:30:03.377 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:03.377 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:03.377 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1acc300640 5 monclient: authenticate success, global_id 54133 2024-09-13T10:30:03.377 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1acc300640 10 monclient: _renew_subs 2024-09-13T10:30:03.377 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1acc300640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:03.377 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1acc300640 1 -- 172.21.15.195:0/2205438332 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac4125a70 con 0x7f1ac409cec0 2024-09-13T10:30:03.377 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1acc300640 10 monclient: _renew_subs 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1acc300640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1acc300640 1 -- 172.21.15.195:0/2205438332 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f1ac413a1a0 con 0x7f1ac409cec0 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ac0003b60 con 0x7f1ac409cec0 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1ac0004090 con 0x7f1ac409cec0 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1abaffd640 10 monclient: dump: 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.378 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.356+0000 7f1ac8899640 4 set_mon_vals no callback set 2024-09-13T10:30:03.379 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.357+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 3) ==== 50222+0+0 (unknown 1096830252 0 0) 0x7f1ac0004230 con 0x7f1ac409cec0 2024-09-13T10:30:03.380 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.357+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (unknown 4178480710 0 0) 0x7f1ac004d500 con 0x7f1ac409cec0 2024-09-13T10:30:03.380 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.357+0000 7f1acc300640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:03.380 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.357+0000 7f1acc300640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:03.380 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.357+0000 7f1acc300640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:03.380 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.357+0000 7f1acc300640 1 -- 172.21.15.195:0/2205438332 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac409f2e0 con 0x7f1ac409cec0 2024-09-13T10:30:03.380 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.357+0000 7f1ac989b640 10 monclient: get_auth_request con 0x7f1aa803fb90 auth_method 0 2024-09-13T10:30:03.380 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.362+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 <== mon.7 v1:172.21.15.195:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f1ac0017740 con 0x7f1ac409cec0 2024-09-13T10:30:03.380 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.362+0000 7f1abaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:03.380 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.362+0000 7f1abaffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:03.547 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.545+0000 7f1acc300640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "11e6b317-e77c-4469-840a-a1d17e9eee86", "id": 3}] 2024-09-13T10:30:03.547 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.545+0000 7f1acc300640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "11e6b317-e77c-4469-840a-a1d17e9eee86", "id": 3}] 2024-09-13T10:30:03.547 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.545+0000 7f1acc300640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:03.547 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.545+0000 7f1acc300640 1 -- 172.21.15.195:0/2205438332 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "osd new", "uuid": "11e6b317-e77c-4469-840a-a1d17e9eee86", "id": 3} v 0) -- 0x7f1ac40a7030 con 0x7f1ac409cec0 2024-09-13T10:30:03.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.551+0000 7f1abaffd640 1 -- 172.21.15.195:0/2205438332 <== mon.7 v1:172.21.15.195:6792/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "11e6b317-e77c-4469-840a-a1d17e9eee86", "id": 3}]=0 v6) ==== 112+0+2 (unknown 1118734114 0 525046306) 0x7f1ac001b8b0 con 0x7f1ac409cec0 2024-09-13T10:30:03.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.551+0000 7f1abaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "11e6b317-e77c-4469-840a-a1d17e9eee86", "id": 3}] 2024-09-13T10:30:03.553 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.551+0000 7f1abaffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:03.553 INFO:teuthology.orchestra.run.smithi195.stdout:3 2024-09-13T10:30:03.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.554+0000 7f1acc300640 1 -- 172.21.15.195:0/2205438332 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1aa803fb90 legacy=0x7f1aa8042050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.554+0000 7f1acc300640 10 monclient: shutdown 2024-09-13T10:30:03.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.554+0000 7f1acc300640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:03.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.554+0000 7f1acc300640 1 -- 172.21.15.195:0/2205438332 >> v1:172.21.15.195:6792/0 conn(0x7f1ac409cec0 legacy=0x7f1ac41398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.554+0000 7f1acc300640 1 -- 172.21.15.195:0/2205438332 shutdown_connections 2024-09-13T10:30:03.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.554+0000 7f1acc300640 1 -- 172.21.15.195:0/2205438332 >> 172.21.15.195:0/2205438332 conn(0x7f1ac40abc40 msgr2=0x7f1ac40aa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:03.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.554+0000 7f1acc300640 1 -- 172.21.15.195:0/2205438332 shutdown_connections 2024-09-13T10:30:03.556 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.554+0000 7f1acc300640 1 -- 172.21.15.195:0/2205438332 wait complete. 2024-09-13T10:30:03.566 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 78cd8d74-5ffb-4116-aa73-e082ffd9adce 4 2024-09-13T10:30:03.662 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.660+0000 7f74319ec640 10 monclient: get_monmap_and_config 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.660+0000 7f74319ec640 10 monclient: build_initial_monmap 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.660+0000 7f74319ec640 10 monclient: monmap: 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 0 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:30:03.661609+0000 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:30:03.661609+0000 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:03.663 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:03.664 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:03.664 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:03.664 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:03.664 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:03.664 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:03.664 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.661+0000 7f74319ec640 1 Processor -- start 2024-09-13T10:30:03.664 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.661+0000 7f74319ec640 1 -- start start 2024-09-13T10:30:03.664 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.661+0000 7f74319ec640 10 monclient: init 2024-09-13T10:30:03.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.661+0000 7f74319ec640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:03.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.661+0000 7f74319ec640 10 monclient: _add_conns ranks=[0,5,2,8,4,1,7,3,6] 2024-09-13T10:30:03.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.661+0000 7f74319ec640 10 monclient(hunting): picked mon.noname-a con 0x7f742c0a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:03.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.661+0000 7f74319ec640 10 monclient(hunting): picked mon.noname-h con 0x7f742c0a71c0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:03.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.661+0000 7f74319ec640 10 monclient(hunting): picked mon.noname-b con 0x7f742c0a5260 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:03.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.661+0000 7f74319ec640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742c0a2f10 con 0x7f742c0a66d0 2024-09-13T10:30:03.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.662+0000 7f74319ec640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742c0a4a60 con 0x7f742c0a5260 2024-09-13T10:30:03.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.662+0000 7f74319ec640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742c0a3a50 con 0x7f742c0a71c0 2024-09-13T10:30:03.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.662+0000 7f74319ec640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:03.670 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.662+0000 7f74319ec640 10 monclient(hunting): authenticate will time out at 754.387025s 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.662+0000 7f742a7fc640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f742c0a71c0 0x7f742c13e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.195:55980/0 (socket says 172.21.15.195:55980) 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.662+0000 7f742a7fc640 1 -- 172.21.15.195:0/2190114421 learned_addr learned my addr 172.21.15.195:0/2190114421 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f742a7fc640 1 -- 172.21.15.195:0/2190114421 >> v1:172.21.15.195:6791/0 conn(0x7f742c0a71c0 legacy=0x7f742c13e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 1 -- 172.21.15.195:0/2190114421 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3525318344 0 0) 0x7f742c0a3a50 con 0x7f742c0a71c0 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient(hunting): my global_id is 4154 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f742b7fe640 1 -- 172.21.15.195:0/2190114421 >> v1:172.21.15.181:6790/0 conn(0x7f742c0a5260 legacy=0x7f742c141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 1 -- 172.21.15.195:0/2190114421 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7414003520 con 0x7f742c0a71c0 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f742affd640 1 -- 172.21.15.195:0/2190114421 >> v1:172.21.15.181:6789/0 conn(0x7f742c0a66d0 legacy=0x7f742c0a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 1 -- 172.21.15.195:0/2190114421 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2356426367 0 0) 0x7f7414003520 con 0x7f742c0a71c0 2024-09-13T10:30:03.671 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 1 -- 172.21.15.195:0/2190114421 >> v1:172.21.15.181:6790/0 conn(0x7f742c0a5260 legacy=0x7f742c141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 1 -- 172.21.15.195:0/2190114421 >> v1:172.21.15.181:6789/0 conn(0x7f742c0a66d0 legacy=0x7f742c0a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 1 monclient: found mon.noname-h 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.195:6791/0 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 1 -- 172.21.15.195:0/2190114421 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c0a8390 con 0x7f742c0a71c0 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 1 -- 172.21.15.195:0/2190114421 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7420001ae0 con 0x7f742c0a71c0 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f74319ec640 5 monclient: authenticate success, global_id 4154 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f74319ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:03.672 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient: dump: 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:03.673 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f74319ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 1 -- 172.21.15.195:0/2190114421 <== mon.5 v1:172.21.15.195:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74200048a0 con 0x7f742c0a71c0 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 1 -- 172.21.15.195:0/2190114421 <== mon.5 v1:172.21.15.195:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7420004dd0 con 0x7f742c0a71c0 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f74319ec640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f74319ec640 4 set_mon_vals no callback set 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.664+0000 7f7429ffb640 10 monclient: dump: 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:03.674 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:03.675 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.665+0000 7f74319ec640 10 monclient: shutdown 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.665+0000 7f74319ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.665+0000 7f74319ec640 1 -- 172.21.15.195:0/2190114421 >> v1:172.21.15.195:6791/0 conn(0x7f742c0a71c0 legacy=0x7f742c13e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.665+0000 7f74319ec640 1 -- 172.21.15.195:0/2190114421 shutdown_connections 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.665+0000 7f74319ec640 1 -- 172.21.15.195:0/2190114421 >> 172.21.15.195:0/2190114421 conn(0x7f742c0abcd0 msgr2=0x7f742c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.665+0000 7f74319ec640 1 -- 172.21.15.195:0/2190114421 shutdown_connections 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.665+0000 7f74319ec640 1 -- 172.21.15.195:0/2190114421 wait complete. 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.666+0000 7f74319ec640 10 monclient: build_initial_monmap 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.666+0000 7f74319ec640 10 monclient: monmap: 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 0 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:03.676 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 0.000000 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:created 0.000000 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 1 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:03.677 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.666+0000 7f74319ec640 1 Processor -- start 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.666+0000 7f74319ec640 1 -- start start 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.666+0000 7f74319ec640 10 monclient: init 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.666+0000 7f74319ec640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.666+0000 7f74319ec640 10 monclient: _add_conns ranks=[5,2,6,4,1,3,7,0,8] 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.667+0000 7f74319ec640 10 monclient(hunting): picked mon.noname-h con 0x7f742c0a5260 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.667+0000 7f74319ec640 10 monclient(hunting): picked mon.noname-b con 0x7f742c0a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.667+0000 7f74319ec640 10 monclient(hunting): picked mon.noname-d con 0x7f742c0a71c0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.667+0000 7f74319ec640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742c1cc040 con 0x7f742c0a66d0 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.667+0000 7f74319ec640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742c124e10 con 0x7f742c0a5260 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.667+0000 7f74319ec640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742c127170 con 0x7f742c0a71c0 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.667+0000 7f74319ec640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.667+0000 7f74319ec640 10 monclient(hunting): authenticate will time out at 754.392099s 2024-09-13T10:30:03.678 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.667+0000 7f742affd640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f742c0a5260 0x7f742c139790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.195:55996/0 (socket says 172.21.15.195:55996) 2024-09-13T10:30:03.679 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.667+0000 7f742affd640 1 -- 172.21.15.195:0/981137359 learned_addr learned my addr 172.21.15.195:0/981137359 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-09-13T10:30:03.682 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f742affd640 1 -- 172.21.15.195:0/981137359 >> v1:172.21.15.195:6791/0 conn(0x7f742c0a5260 legacy=0x7f742c139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:03.682 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676541111 0 0) 0x7f742c124e10 con 0x7f742c0a5260 2024-09-13T10:30:03.682 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:03.682 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:03.682 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:03.682 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): my global_id is 4163 2024-09-13T10:30:03.682 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7418003550 con 0x7f742c0a5260 2024-09-13T10:30:03.682 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f742a7fc640 1 -- 172.21.15.195:0/981137359 >> v1:172.21.15.181:6790/0 conn(0x7f742c0a66d0 legacy=0x7f742c1d3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:03.682 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f742b7fe640 1 -- 172.21.15.195:0/981137359 >> v1:172.21.15.181:6792/0 conn(0x7f742c0a71c0 legacy=0x7f742c1d6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:03.682 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4203090395 0 0) 0x7f7418003550 con 0x7f742c0a5260 2024-09-13T10:30:03.682 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f742c124e10 con 0x7f742c0a5260 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f741c003610 con 0x7f742c0a5260 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): dump: 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:03.683 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:03.684 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:03.684 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:03.684 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:03.684 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:03.684 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:03.684 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:03.684 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:03.684 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:03.684 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3538846865 0 0) 0x7f742c1cc040 con 0x7f742c0a66d0 2024-09-13T10:30:03.684 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:03.684 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): my global_id is 4151 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7418003550 con 0x7f742c0a66d0 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1812007504 0 0) 0x7f742c127170 con 0x7f742c0a71c0 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient(hunting): my global_id is 4155 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f742c1cc040 con 0x7f742c0a71c0 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3938561836 0 0) 0x7f742c124e10 con 0x7f742c0a5260 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 >> v1:172.21.15.181:6792/0 conn(0x7f742c0a71c0 legacy=0x7f742c1d6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 >> v1:172.21.15.181:6790/0 conn(0x7f742c0a66d0 legacy=0x7f742c1d3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.685 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 monclient: found mon.h 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c1268d0 con 0x7f742c0a5260 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f74319ec640 5 monclient: authenticate success, global_id 4163 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f74319ec640 10 monclient: _renew_subs 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f74319ec640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f74319ec640 1 -- 172.21.15.195:0/981137359 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f742c1cbcd0 con 0x7f742c0a5260 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f74319ec640 10 monclient: _renew_subs 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f74319ec640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:03.686 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f74319ec640 1 -- 172.21.15.195:0/981137359 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f742c13a080 con 0x7f742c0a5260 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f741c003c00 con 0x7f742c0a5260 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f741c004130 con 0x7f742c0a5260 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f74297fa640 4 set_mon_vals no callback set 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.669+0000 7f7413fff640 10 monclient: dump: 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:03.687 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.670+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 3) ==== 50222+0+0 (unknown 1096830252 0 0) 0x7f741c0042d0 con 0x7f742c0a5260 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.670+0000 7f74319ec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.670+0000 7f74319ec640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:03.688 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.670+0000 7f74319ec640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:03.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.670+0000 7f74319ec640 1 -- 172.21.15.195:0/981137359 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f740c005080 con 0x7f742c0a5260 2024-09-13T10:30:03.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.670+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (unknown 1882830299 0 0) 0x7f741c04d620 con 0x7f742c0a5260 2024-09-13T10:30:03.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.671+0000 7f742a7fc640 10 monclient: get_auth_request con 0x7f741803fb90 auth_method 0 2024-09-13T10:30:03.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.675+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 <== mon.5 v1:172.21.15.195:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f741c017840 con 0x7f742c0a5260 2024-09-13T10:30:03.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.675+0000 7f7413fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:03.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.675+0000 7f7413fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:03.866 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.863+0000 7f74319ec640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "78cd8d74-5ffb-4116-aa73-e082ffd9adce", "id": 4}] 2024-09-13T10:30:03.866 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.863+0000 7f74319ec640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "78cd8d74-5ffb-4116-aa73-e082ffd9adce", "id": 4}] 2024-09-13T10:30:03.867 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.863+0000 7f74319ec640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:03.867 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.863+0000 7f74319ec640 1 -- 172.21.15.195:0/981137359 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "osd new", "uuid": "78cd8d74-5ffb-4116-aa73-e082ffd9adce", "id": 4} v 0) -- 0x7f740c005370 con 0x7f742c0a5260 2024-09-13T10:30:03.953 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.952+0000 7f7413fff640 1 -- 172.21.15.195:0/981137359 <== mon.5 v1:172.21.15.195:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "78cd8d74-5ffb-4116-aa73-e082ffd9adce", "id": 4}]=0 v7) ==== 112+0+2 (unknown 2465003953 0 1697012583) 0x7f741c017140 con 0x7f742c0a5260 2024-09-13T10:30:03.954 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.952+0000 7f7413fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "78cd8d74-5ffb-4116-aa73-e082ffd9adce", "id": 4}] 2024-09-13T10:30:03.954 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.952+0000 7f7413fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:03.954 INFO:teuthology.orchestra.run.smithi195.stdout:4 2024-09-13T10:30:03.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.954+0000 7f74319ec640 1 -- 172.21.15.195:0/981137359 >> v1:172.21.15.195:6800/1839191919 conn(0x7f741803fb90 legacy=0x7f7418042050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.954+0000 7f74319ec640 10 monclient: shutdown 2024-09-13T10:30:03.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.954+0000 7f74319ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:03.956 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.954+0000 7f74319ec640 1 -- 172.21.15.195:0/981137359 >> v1:172.21.15.195:6791/0 conn(0x7f742c0a5260 legacy=0x7f742c139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:03.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.954+0000 7f74319ec640 1 -- 172.21.15.195:0/981137359 shutdown_connections 2024-09-13T10:30:03.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.954+0000 7f74319ec640 1 -- 172.21.15.195:0/981137359 >> 172.21.15.195:0/981137359 conn(0x7f742c0abcd0 msgr2=0x7f742c0aa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:03.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.954+0000 7f74319ec640 1 -- 172.21.15.195:0/981137359 shutdown_connections 2024-09-13T10:30:03.957 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:03.955+0000 7f74319ec640 1 -- 172.21.15.195:0/981137359 wait complete. 2024-09-13T10:30:03.967 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new ecb70959-b169-4fd8-958d-ac5b1d0a3c28 5 2024-09-13T10:30:04.063 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.061+0000 7f3461d0e640 10 monclient: get_monmap_and_config 2024-09-13T10:30:04.063 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.061+0000 7f3461d0e640 10 monclient: build_initial_monmap 2024-09-13T10:30:04.063 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.061+0000 7f3461d0e640 10 monclient: monmap: 2024-09-13T10:30:04.063 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 0 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:30:04.062630+0000 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:30:04.062630+0000 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:04.064 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:04.065 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:04.065 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:04.069 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.062+0000 7f3461d0e640 1 Processor -- start 2024-09-13T10:30:04.069 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.062+0000 7f3461d0e640 1 -- start start 2024-09-13T10:30:04.069 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.062+0000 7f3461d0e640 10 monclient: init 2024-09-13T10:30:04.069 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f3461d0e640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:04.069 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f3461d0e640 10 monclient: _add_conns ranks=[1,7,4,3,2,6,0,8,5] 2024-09-13T10:30:04.069 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f3461d0e640 10 monclient(hunting): picked mon.noname-f con 0x7f345c0a6540 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:04.069 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f3461d0e640 10 monclient(hunting): picked mon.noname-i con 0x7f345c09d360 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:04.069 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f3461d0e640 10 monclient(hunting): picked mon.noname-c con 0x7f345c09cec0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:04.069 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f3461d0e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345c0a51e0 con 0x7f345c0a6540 2024-09-13T10:30:04.069 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f3461d0e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345c0a8380 con 0x7f345c09cec0 2024-09-13T10:30:04.069 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f3461d0e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345c09e250 con 0x7f345c09d360 2024-09-13T10:30:04.069 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f3461d0e640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f3461d0e640 10 monclient(hunting): authenticate will time out at 754.788181s 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f345affd640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f345c09d360 0x7f345c13e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.195:37792/0 (socket says 172.21.15.195:37792) 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f345affd640 1 -- 172.21.15.195:0/1384030671 learned_addr learned my addr 172.21.15.195:0/1384030671 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.063+0000 7f345b7fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f345c0a6540 0x7f345c0a6920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:41694/0 (socket says 172.21.15.195:41694) 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345b7fe640 1 -- 172.21.15.195:0/1384030671 >> v1:172.21.15.195:6789/0 conn(0x7f345c0a6540 legacy=0x7f345c0a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345affd640 1 -- 172.21.15.195:0/1384030671 >> v1:172.21.15.195:6792/0 conn(0x7f345c09d360 legacy=0x7f345c13e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 1 -- 172.21.15.195:0/1384030671 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517443252 0 0) 0x7f345c0a51e0 con 0x7f345c0a6540 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient(hunting): my global_id is 54127 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 1 -- 172.21.15.195:0/1384030671 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3444003520 con 0x7f345c0a6540 2024-09-13T10:30:04.070 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 1 -- 172.21.15.195:0/1384030671 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 595449276 0 0) 0x7f345c09e250 con 0x7f345c09d360 2024-09-13T10:30:04.071 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:04.071 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:04.071 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:04.071 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient(hunting): my global_id is 54142 2024-09-13T10:30:04.071 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 1 -- 172.21.15.195:0/1384030671 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f345c0a51e0 con 0x7f345c09d360 2024-09-13T10:30:04.071 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345bfff640 1 -- 172.21.15.195:0/1384030671 >> v1:172.21.15.181:6791/0 conn(0x7f345c09cec0 legacy=0x7f345c141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:04.071 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 1 -- 172.21.15.195:0/1384030671 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3089680530 0 0) 0x7f3444003520 con 0x7f345c0a6540 2024-09-13T10:30:04.071 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 1 -- 172.21.15.195:0/1384030671 >> v1:172.21.15.195:6792/0 conn(0x7f345c09d360 legacy=0x7f345c13e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:04.071 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 1 -- 172.21.15.195:0/1384030671 >> v1:172.21.15.181:6791/0 conn(0x7f345c09cec0 legacy=0x7f345c141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:04.071 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:04.071 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 1 monclient: found mon.noname-f 2024-09-13T10:30:04.071 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 1 -- 172.21.15.195:0/1384030671 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345c09e530 con 0x7f345c0a6540 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 1 -- 172.21.15.195:0/1384030671 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f344c001ae0 con 0x7f345c0a6540 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f3461d0e640 5 monclient: authenticate success, global_id 54127 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f3461d0e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f345a7fc640 10 monclient: dump: 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:04.072 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:04.073 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.073 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.073 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:04.073 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:04.073 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:04.073 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:04.073 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:04.073 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:04.073 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:04.073 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:04.073 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:04.073 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.065+0000 7f3461d0e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f345a7fc640 1 -- 172.21.15.195:0/1384030671 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f344c0047e0 con 0x7f345c0a6540 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f345a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f345a7fc640 1 -- 172.21.15.195:0/1384030671 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f344c004d50 con 0x7f345c0a6540 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f3461d0e640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f3461d0e640 4 set_mon_vals no callback set 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f345a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f345a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f345a7fc640 10 monclient: dump: 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:04.074 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.075 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.075 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:04.075 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:04.075 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:04.075 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:04.075 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:04.075 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:04.076 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f3461d0e640 10 monclient: shutdown 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f3461d0e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f3461d0e640 1 -- 172.21.15.195:0/1384030671 >> v1:172.21.15.195:6789/0 conn(0x7f345c0a6540 legacy=0x7f345c0a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f3461d0e640 1 -- 172.21.15.195:0/1384030671 shutdown_connections 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f3461d0e640 1 -- 172.21.15.195:0/1384030671 >> 172.21.15.195:0/1384030671 conn(0x7f345c0abc40 msgr2=0x7f345c0ac050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f3461d0e640 1 -- 172.21.15.195:0/1384030671 shutdown_connections 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.066+0000 7f3461d0e640 1 -- 172.21.15.195:0/1384030671 wait complete. 2024-09-13T10:30:04.077 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.067+0000 7f3461d0e640 10 monclient: build_initial_monmap 2024-09-13T10:30:04.078 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.067+0000 7f3461d0e640 10 monclient: monmap: 2024-09-13T10:30:04.078 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 0 2024-09-13T10:30:04.078 INFO:teuthology.orchestra.run.smithi195.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:04.078 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 0.000000 2024-09-13T10:30:04.078 INFO:teuthology.orchestra.run.smithi195.stderr:created 0.000000 2024-09-13T10:30:04.078 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:04.078 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 1 2024-09-13T10:30:04.078 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:04.078 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:04.078 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:04.078 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:04.078 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:04.079 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:04.079 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:04.079 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:04.079 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:04.079 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:04.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.067+0000 7f3461d0e640 1 Processor -- start 2024-09-13T10:30:04.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.067+0000 7f3461d0e640 1 -- start start 2024-09-13T10:30:04.079 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.067+0000 7f3461d0e640 10 monclient: init 2024-09-13T10:30:04.083 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.068+0000 7f3461d0e640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:04.083 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.068+0000 7f3461d0e640 10 monclient: _add_conns ranks=[6,4,8,2,1,5,0,7,3] 2024-09-13T10:30:04.083 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.068+0000 7f3461d0e640 10 monclient(hunting): picked mon.noname-d con 0x7f345c09cec0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:04.083 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.068+0000 7f3461d0e640 10 monclient(hunting): picked mon.noname-c con 0x7f345c09d360 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:04.083 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.068+0000 7f3461d0e640 10 monclient(hunting): picked mon.noname-e con 0x7f345c0a6540 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:04.083 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.068+0000 7f3461d0e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345c0a4680 con 0x7f345c09d360 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.068+0000 7f3461d0e640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345c127010 con 0x7f345c09cec0 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.068+0000 7f3461d0e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345c125af0 con 0x7f345c0a6540 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.068+0000 7f3461d0e640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.068+0000 7f3461d0e640 10 monclient(hunting): authenticate will time out at 754.793100s 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.068+0000 7f345affd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f345c09d360 0x7f345c139930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.195:40208/0 (socket says 172.21.15.195:40208) 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.068+0000 7f345affd640 1 -- 172.21.15.195:0/3387767963 learned_addr learned my addr 172.21.15.195:0/3387767963 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f345affd640 1 -- 172.21.15.195:0/3387767963 >> v1:172.21.15.181:6791/0 conn(0x7f345c09d360 legacy=0x7f345c139930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f345b7fe640 1 -- 172.21.15.195:0/3387767963 >> v1:172.21.15.181:6792/0 conn(0x7f345c09cec0 legacy=0x7f345c1cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f345bfff640 1 -- 172.21.15.195:0/3387767963 >> v1:172.21.15.181:6793/0 conn(0x7f345c0a6540 legacy=0x7f345c1d6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213168118 0 0) 0x7f345c0a4680 con 0x7f345c09d360 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:04.084 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 10 monclient(hunting): my global_id is 4180 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3448003520 con 0x7f345c09d360 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1976558603 0 0) 0x7f345c125af0 con 0x7f345c0a6540 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 10 monclient(hunting): my global_id is 4130 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f345c0a4680 con 0x7f345c0a6540 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 545990914 0 0) 0x7f3448003520 con 0x7f345c09d360 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f345c125af0 con 0x7f345c09d360 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f34500047e0 con 0x7f345c09d360 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:04.085 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.070+0000 7f3443fff640 10 monclient(hunting): dump: 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:04.086 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:04.087 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:04.087 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:04.087 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:04.087 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:04.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:04.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2099951554 0 0) 0x7f345c0a4680 con 0x7f345c0a6540 2024-09-13T10:30:04.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3448003520 con 0x7f345c0a6540 2024-09-13T10:30:04.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f34540020a0 con 0x7f345c0a6540 2024-09-13T10:30:04.087 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 10 monclient(hunting): dump: 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:04.088 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 247193000 0 0) 0x7f345c125af0 con 0x7f345c09d360 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 >> v1:172.21.15.181:6793/0 conn(0x7f345c0a6540 legacy=0x7f345c1d6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 >> v1:172.21.15.181:6792/0 conn(0x7f345c09cec0 legacy=0x7f345c1cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 1 monclient: found mon.c 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345c125cc0 con 0x7f345c09d360 2024-09-13T10:30:04.089 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3461d0e640 5 monclient: authenticate success, global_id 4180 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3461d0e640 10 monclient: _renew_subs 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3461d0e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3461d0e640 1 -- 172.21.15.195:0/3387767963 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f345c13a040 con 0x7f345c09d360 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3461d0e640 10 monclient: _renew_subs 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3461d0e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3461d0e640 1 -- 172.21.15.195:0/3387767963 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f345c1d7980 con 0x7f345c09d360 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3450004cb0 con 0x7f345c09d360 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f34500052a0 con 0x7f345c09d360 2024-09-13T10:30:04.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3459ffb640 4 set_mon_vals no callback set 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.071+0000 7f3443fff640 10 monclient: dump: 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:epoch 1 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:election_strategy: 3 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:04.091 INFO:teuthology.orchestra.run.smithi195.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.072+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 3) ==== 50222+0+0 (unknown 1096830252 0 0) 0x7f34500054c0 con 0x7f345c09d360 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.072+0000 7f3461d0e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.072+0000 7f3461d0e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.072+0000 7f3461d0e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.072+0000 7f3461d0e640 1 -- 172.21.15.195:0/3387767963 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343c005080 con 0x7f345c09d360 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.072+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (unknown 3950787201 0 0) 0x7f345004d7a0 con 0x7f345c09d360 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.072+0000 7f345b7fe640 10 monclient: get_auth_request con 0x7f344803ff10 auth_method 0 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.077+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f345c125cc0 con 0x7f345c09d360 2024-09-13T10:30:04.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.077+0000 7f3443fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:04.093 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.077+0000 7f3443fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:04.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.260+0000 7f3461d0e640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "ecb70959-b169-4fd8-958d-ac5b1d0a3c28", "id": 5}] 2024-09-13T10:30:04.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.260+0000 7f3461d0e640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "ecb70959-b169-4fd8-958d-ac5b1d0a3c28", "id": 5}] 2024-09-13T10:30:04.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.260+0000 7f3461d0e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:04.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.260+0000 7f3461d0e640 1 -- 172.21.15.195:0/3387767963 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "osd new", "uuid": "ecb70959-b169-4fd8-958d-ac5b1d0a3c28", "id": 5} v 0) -- 0x7f343c005370 con 0x7f345c09d360 2024-09-13T10:30:04.747 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.745+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mgrmap(e 4) ==== 50328+0+0 (unknown 4138074549 0 0) 0x7f345004c290 con 0x7f345c09d360 2024-09-13T10:30:04.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.813+0000 7f3443fff640 1 -- 172.21.15.195:0/3387767963 <== mon.4 v1:172.21.15.181:6791/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ecb70959-b169-4fd8-958d-ac5b1d0a3c28", "id": 5}]=0 v8) ==== 112+0+2 (unknown 3977116654 0 1988412176) 0x7f345004ba00 con 0x7f345c09d360 2024-09-13T10:30:04.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.813+0000 7f3443fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "ecb70959-b169-4fd8-958d-ac5b1d0a3c28", "id": 5}] 2024-09-13T10:30:04.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.813+0000 7f3443fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:04.815 INFO:teuthology.orchestra.run.smithi195.stdout:5 2024-09-13T10:30:04.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.816+0000 7f3461d0e640 1 -- 172.21.15.195:0/3387767963 >> v1:172.21.15.195:6800/1839191919 conn(0x7f344803ff10 legacy=0x7f34480423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:04.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.816+0000 7f3461d0e640 10 monclient: shutdown 2024-09-13T10:30:04.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.816+0000 7f3461d0e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:04.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.816+0000 7f3461d0e640 1 -- 172.21.15.195:0/3387767963 >> v1:172.21.15.181:6791/0 conn(0x7f345c09d360 legacy=0x7f345c139930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:04.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.816+0000 7f3461d0e640 1 -- 172.21.15.195:0/3387767963 shutdown_connections 2024-09-13T10:30:04.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.816+0000 7f3461d0e640 1 -- 172.21.15.195:0/3387767963 >> 172.21.15.195:0/3387767963 conn(0x7f345c0abc40 msgr2=0x7f345c0aa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:04.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.816+0000 7f3461d0e640 1 -- 172.21.15.195:0/3387767963 shutdown_connections 2024-09-13T10:30:04.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-09-13T10:30:04.816+0000 7f3461d0e640 1 -- 172.21.15.195:0/3387767963 wait complete. 2024-09-13T10:30:04.829 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T10:30:04.829 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T10:30:04.832 INFO:tasks.ceph.osd.0:Started 2024-09-13T10:30:04.832 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T10:30:04.832 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T10:30:04.834 INFO:tasks.ceph.osd.1:Started 2024-09-13T10:30:04.834 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T10:30:04.834 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T10:30:04.836 INFO:tasks.ceph.osd.2:Started 2024-09-13T10:30:04.836 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T10:30:04.836 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T10:30:04.839 INFO:tasks.ceph.osd.3:Started 2024-09-13T10:30:04.839 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T10:30:04.839 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T10:30:04.841 INFO:tasks.ceph.osd.4:Started 2024-09-13T10:30:04.841 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T10:30:04.842 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T10:30:04.844 INFO:tasks.ceph.osd.5:Started 2024-09-13T10:30:04.844 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T10:30:04.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.950+0000 7fc337dec640 10 monclient: get_monmap_and_config 2024-09-13T10:30:04.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.950+0000 7fc337dec640 10 monclient: build_initial_monmap 2024-09-13T10:30:04.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.950+0000 7fc337dec640 10 monclient: monmap: 2024-09-13T10:30:04.953 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:04.953 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:04.953 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:04.951454+0000 2024-09-13T10:30:04.953 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:04.951454+0000 2024-09-13T10:30:04.953 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:04.953 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:04.953 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:04.953 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:04.953 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:04.954 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:04.954 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:04.954 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:04.954 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:04.954 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:04.954 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:04.954 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:04.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.951+0000 7fc337dec640 1 Processor -- start 2024-09-13T10:30:04.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.951+0000 7fc337dec640 1 -- start start 2024-09-13T10:30:04.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.951+0000 7fc337dec640 10 monclient: init 2024-09-13T10:30:04.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.952+0000 7fc337dec640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:04.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.952+0000 7fc337dec640 10 monclient: _add_conns ranks=[6,1,5,8,4,0,3,7,2] 2024-09-13T10:30:04.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.952+0000 7fc337dec640 10 monclient(hunting): picked mon.noname-d con 0x7fc3300a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:04.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.952+0000 7fc337dec640 10 monclient(hunting): picked mon.noname-f con 0x7fc3300a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:04.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.952+0000 7fc337dec640 10 monclient(hunting): picked mon.noname-h con 0x7fc33013f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:04.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.952+0000 7fc337dec640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3300a5fe0 con 0x7fc3300a6ab0 2024-09-13T10:30:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.952+0000 7fc337dec640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3300a8080 con 0x7fc33013f9a0 2024-09-13T10:30:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.952+0000 7fc337dec640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3300a42c0 con 0x7fc3300a66d0 2024-09-13T10:30:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.952+0000 7fc335b88640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fc3300a66d0 0x7fc3300a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:43662/0 (socket says 172.21.15.181:43662) 2024-09-13T10:30:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.952+0000 7fc335b88640 1 -- 172.21.15.181:0/4134332239 learned_addr learned my addr 172.21.15.181:0/4134332239 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.952+0000 7fc337dec640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.952+0000 7fc337dec640 10 monclient(hunting): authenticate will time out at 744.457418s 2024-09-13T10:30:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc335b88640 1 -- 172.21.15.181:0/4134332239 >> v1:172.21.15.181:6792/0 conn(0x7fc3300a66d0 legacy=0x7fc3300a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc336389640 1 -- 172.21.15.181:0/4134332239 >> v1:172.21.15.195:6791/0 conn(0x7fc33013f9a0 legacy=0x7fc330141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc335387640 1 -- 172.21.15.181:0/4134332239 >> v1:172.21.15.195:6789/0 conn(0x7fc3300a6ab0 legacy=0x7fc3300a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3522574029 0 0) 0x7fc3300a42c0 con 0x7fc3300a66d0 2024-09-13T10:30:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient(hunting): _negotiate 2024-09-13T10:30:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient(hunting): my global_id is 4182 2024-09-13T10:30:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc31c003520 con 0x7fc3300a66d0 2024-09-13T10:30:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188158412 0 0) 0x7fc3300a8080 con 0x7fc33013f9a0 2024-09-13T10:30:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient(hunting): _negotiate 2024-09-13T10:30:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient(hunting): my global_id is 4190 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3300a42c0 con 0x7fc33013f9a0 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 850953804 0 0) 0x7fc3300a5fe0 con 0x7fc3300a6ab0 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient(hunting): _negotiate 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient(hunting): my global_id is 54154 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3300a8080 con 0x7fc3300a6ab0 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3269346130 0 0) 0x7fc31c003520 con 0x7fc3300a66d0 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 >> v1:172.21.15.195:6791/0 conn(0x7fc33013f9a0 legacy=0x7fc330141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 >> v1:172.21.15.195:6789/0 conn(0x7fc3300a6ab0 legacy=0x7fc3300a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 10 monclient: _finish_hunting 0 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 1 monclient: found mon.noname-d 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.954+0000 7fc334b86640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3301464e0 con 0x7fc3300a66d0 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 10 monclient: _finish_auth 0 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 10 monclient: _check_auth_tickets 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc320001ad0 con 0x7fc3300a66d0 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc337dec640 5 monclient: authenticate success, global_id 4182 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc337dec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:04.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 10 monclient: dump: 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:04.966 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc337dec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3200048a0 con 0x7fc3300a66d0 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc335b88640 1 --1- 172.21.15.181:0/4134332239 >> v1:172.21.15.181:6792/0 conn(0x7fc3300a66d0 0x7fc3300a53b0 :-1 s=OPENED pgs=50 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fc320004e50 mon_map magic: 0 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc337dec640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc337dec640 4 set_mon_vals no callback set 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc337dec640 10 monclient: shutdown 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc337dec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc337dec640 1 -- 172.21.15.181:0/4134332239 >> v1:172.21.15.181:6792/0 conn(0x7fc3300a66d0 legacy=0x7fc3300a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 1 -- 172.21.15.181:0/4134332239 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc320004e50 con 0x7fc3300a66d0 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc334b86640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:30:04.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc337dec640 1 -- 172.21.15.181:0/4134332239 shutdown_connections 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc337dec640 1 -- 172.21.15.181:0/4134332239 >> 172.21.15.181:0/4134332239 conn(0x7fc3300abcd0 msgr2=0x7fc3300ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc337dec640 1 -- 172.21.15.181:0/4134332239 shutdown_connections 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.955+0000 7fc337dec640 1 -- 172.21.15.181:0/4134332239 wait complete. 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.956+0000 7fc337dec640 10 monclient: build_initial_monmap 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.956+0000 7fc337dec640 10 monclient: monmap: 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.956+0000 7fc337dec640 1 Processor -- start 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.956+0000 7fc337dec640 1 -- start start 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.956+0000 7fc337dec640 10 monclient: init 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.957+0000 7fc337dec640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.957+0000 7fc337dec640 10 monclient: _add_conns ranks=[1,2,5,0,8,3,4,6,7] 2024-09-13T10:30:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.957+0000 7fc337dec640 10 monclient(hunting): picked mon.noname-f con 0x7fc3300a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.957+0000 7fc337dec640 10 monclient(hunting): picked mon.noname-b con 0x7fc3300a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.957+0000 7fc337dec640 10 monclient(hunting): picked mon.noname-h con 0x7fc33013f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.957+0000 7fc337dec640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33009d830 con 0x7fc3300a66d0 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.957+0000 7fc337dec640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3300a2ac0 con 0x7fc3300a6ab0 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.957+0000 7fc337dec640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33013e2e0 con 0x7fc33013f9a0 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.957+0000 7fc337dec640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.957+0000 7fc337dec640 10 monclient(hunting): authenticate will time out at 744.462156s 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.957+0000 7fc335387640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fc3300a6ab0 0x7fc3301d3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:35372/0 (socket says 172.21.15.181:35372) 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.957+0000 7fc335387640 1 -- 172.21.15.181:0/3196501133 learned_addr learned my addr 172.21.15.181:0/3196501133 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc335387640 1 -- 172.21.15.181:0/3196501133 >> v1:172.21.15.181:6790/0 conn(0x7fc3300a6ab0 legacy=0x7fc3301d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2562067836 0 0) 0x7fc3300a2ac0 con 0x7fc3300a6ab0 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): my global_id is 4178 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc314003520 con 0x7fc3300a6ab0 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc335b88640 1 -- 172.21.15.181:0/3196501133 >> v1:172.21.15.195:6789/0 conn(0x7fc3300a66d0 legacy=0x7fc3301376e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc336389640 1 -- 172.21.15.181:0/3196501133 >> v1:172.21.15.195:6791/0 conn(0x7fc33013f9a0 legacy=0x7fc3301d7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2762467130 0 0) 0x7fc314003520 con 0x7fc3300a6ab0 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3300a2ac0 con 0x7fc3300a6ab0 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc32c003950 con 0x7fc3300a6ab0 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): dump: 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:04.972 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209752774 0 0) 0x7fc33009d830 con 0x7fc3300a66d0 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): my global_id is 54163 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc314003520 con 0x7fc3300a66d0 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276343104 0 0) 0x7fc33013e2e0 con 0x7fc33013f9a0 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient(hunting): my global_id is 4199 2024-09-13T10:30:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc33009d830 con 0x7fc33013f9a0 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2158222703 0 0) 0x7fc3300a2ac0 con 0x7fc3300a6ab0 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 >> v1:172.21.15.195:6791/0 conn(0x7fc33013f9a0 legacy=0x7fc3301d7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 >> v1:172.21.15.195:6789/0 conn(0x7fc3300a66d0 legacy=0x7fc3301376e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 monclient: found mon.b 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33009cf90 con 0x7fc3300a6ab0 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc337dec640 5 monclient: authenticate success, global_id 4178 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc337dec640 10 monclient: _renew_subs 2024-09-13T10:30:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc337dec640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc337dec640 1 -- 172.21.15.181:0/3196501133 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc33013ee40 con 0x7fc3300a6ab0 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc337dec640 10 monclient: _renew_subs 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc337dec640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc337dec640 1 -- 172.21.15.181:0/3196501133 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc33013d830 con 0x7fc3300a6ab0 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc32c001d10 con 0x7fc3300a6ab0 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.959+0000 7fc3267fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.960+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc32c004160 con 0x7fc3300a6ab0 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.960+0000 7fc3267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.960+0000 7fc3267fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.960+0000 7fc327fff640 4 set_mon_vals no callback set 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.960+0000 7fc3267fc640 10 monclient: dump: 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:04.976 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:04.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.960+0000 7fc337dec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:04.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.960+0000 7fc337dec640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:04.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.961+0000 7fc337dec640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:04.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.961+0000 7fc337dec640 1 -- 172.21.15.181:0/3196501133 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3300a3240 con 0x7fc3300a6ab0 2024-09-13T10:30:04.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.961+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 4) ==== 50328+0+0 (unknown 4138074549 0 0) 0x7fc32c011c60 con 0x7fc3300a6ab0 2024-09-13T10:30:04.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.961+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 3105561109 0 0) 0x7fc32c04da30 con 0x7fc3300a6ab0 2024-09-13T10:30:04.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.961+0000 7fc335b88640 10 monclient: get_auth_request con 0x7fc31403fb80 auth_method 0 2024-09-13T10:30:04.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.965+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fc32c0178f0 con 0x7fc3300a6ab0 2024-09-13T10:30:04.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.965+0000 7fc3267fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:04.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:04.965+0000 7fc3267fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.140+0000 7fc337dec640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.140+0000 7fc337dec640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.140+0000 7fc337dec640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.140+0000 7fc337dec640 1 -- 172.21.15.181:0/3196501133 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc33013db70 con 0x7fc3300a6ab0 2024-09-13T10:30:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.140+0000 7fc3267fc640 1 -- 172.21.15.181:0/3196501133 <== mon.2 v1:172.21.15.181:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (unknown 150273500 0 3807066675) 0x7fc32c0171f0 con 0x7fc3300a6ab0 2024-09-13T10:30:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.140+0000 7fc3267fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.140+0000 7fc3267fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:30:05.143 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":8,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","created":"2024-09-13T10:29:50.823515+0000","modified":"2024-09-13T10:30:04.743077+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T10:30:04.743077+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"222eae7d-397c-40de-9975-11705817eae7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c241f0df-9ad4-42f4-809b-872d2c14bdc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"efbff8a5-b42c-4e47-92e1-faf8ef9bec2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"11e6b317-e77c-4469-840a-a1d17e9eee86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"78cd8d74-5ffb-4116-aa73-e082ffd9adce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ecb70959-b169-4fd8-958d-ac5b1d0a3c28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T10:30:05.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.142+0000 7fc337dec640 1 -- 172.21.15.181:0/3196501133 >> v1:172.21.15.195:6800/1839191919 conn(0x7fc31403fb80 legacy=0x7fc314042040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:05.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.142+0000 7fc337dec640 10 monclient: shutdown 2024-09-13T10:30:05.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.142+0000 7fc337dec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:05.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.142+0000 7fc337dec640 1 -- 172.21.15.181:0/3196501133 >> v1:172.21.15.181:6790/0 conn(0x7fc3300a6ab0 legacy=0x7fc3301d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:05.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.142+0000 7fc337dec640 1 -- 172.21.15.181:0/3196501133 shutdown_connections 2024-09-13T10:30:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.142+0000 7fc337dec640 1 -- 172.21.15.181:0/3196501133 >> 172.21.15.181:0/3196501133 conn(0x7fc3300abcd0 msgr2=0x7fc330143c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.142+0000 7fc337dec640 1 -- 172.21.15.181:0/3196501133 shutdown_connections 2024-09-13T10:30:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:05.142+0000 7fc337dec640 1 -- 172.21.15.181:0/3196501133 wait complete. 2024-09-13T10:30:05.154 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T10:30:05.155 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T10:30:05.760 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T10:30:05.762 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-09-13T10:30:05.760+0000 7fd866a18640 -1 Falling back to public interface 2024-09-13T10:30:05.851 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.850+0000 7f0bccc57640 10 monclient: get_monmap_and_config 2024-09-13T10:30:05.852 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.850+0000 7f0bccc57640 10 monclient: build_initial_monmap 2024-09-13T10:30:05.852 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.850+0000 7f0bccc57640 10 monclient: monmap: 2024-09-13T10:30:05.852 INFO:teuthology.misc.health.smithi181.stderr:epoch 0 2024-09-13T10:30:05.852 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:05.852 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:30:05.850655+0000 2024-09-13T10:30:05.852 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:30:05.850655+0000 2024-09-13T10:30:05.852 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:05.852 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:05.852 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:05.852 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:05.852 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:05.853 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:05.853 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:05.853 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:05.853 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:05.853 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:05.853 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:05.853 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:05.853 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.850+0000 7f0bccc57640 1 Processor -- start 2024-09-13T10:30:05.853 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.850+0000 7f0bccc57640 1 -- start start 2024-09-13T10:30:05.853 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.850+0000 7f0bccc57640 10 monclient: init 2024-09-13T10:30:05.854 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.851+0000 7f0bccc57640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:05.854 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.851+0000 7f0bccc57640 10 monclient: _add_conns ranks=[3,6,8,7,4,2,0,1,5] 2024-09-13T10:30:05.854 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.851+0000 7f0bccc57640 10 monclient(hunting): picked mon.noname-g con 0x7f0bc809cbd0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:05.854 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.851+0000 7f0bccc57640 10 monclient(hunting): picked mon.noname-d con 0x7f0bc80a5890 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:05.854 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.851+0000 7f0bccc57640 10 monclient(hunting): picked mon.noname-e con 0x7f0bc80a5c70 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:05.855 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.851+0000 7f0bccc57640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc809da60 con 0x7f0bc809cbd0 2024-09-13T10:30:05.855 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.851+0000 7f0bccc57640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc809e020 con 0x7f0bc80a5890 2024-09-13T10:30:05.855 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.851+0000 7f0bccc57640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc809e300 con 0x7f0bc80a5c70 2024-09-13T10:30:05.855 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.851+0000 7f0bccc57640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:05.855 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.851+0000 7f0bccc57640 10 monclient(hunting): authenticate will time out at 745.356342s 2024-09-13T10:30:05.855 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.851+0000 7f0bc5d9b640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f0bc80a5890 0x7f0bc813e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:43668/0 (socket says 172.21.15.181:43668) 2024-09-13T10:30:05.855 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.851+0000 7f0bc5d9b640 1 -- 172.21.15.181:0/2885131255 learned_addr learned my addr 172.21.15.181:0/2885131255 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:05.859 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.853+0000 7f0bc6d9d640 1 -- 172.21.15.181:0/2885131255 >> v1:172.21.15.181:6793/0 conn(0x7f0bc80a5c70 legacy=0x7f0bc81419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:05.859 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.853+0000 7f0bc5d9b640 1 -- 172.21.15.181:0/2885131255 >> v1:172.21.15.181:6792/0 conn(0x7f0bc80a5890 legacy=0x7f0bc813e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:05.859 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.853+0000 7f0bc659c640 1 -- 172.21.15.181:0/2885131255 >> v1:172.21.15.195:6790/0 conn(0x7f0bc809cbd0 legacy=0x7f0bc8135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:05.859 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.853+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738698158 0 0) 0x7f0bc809e020 con 0x7f0bc80a5890 2024-09-13T10:30:05.859 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient(hunting): _negotiate 2024-09-13T10:30:05.859 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:05.859 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:05.859 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient(hunting): my global_id is 4191 2024-09-13T10:30:05.859 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bb0003520 con 0x7f0bc80a5890 2024-09-13T10:30:05.859 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1828357067 0 0) 0x7f0bc809e300 con 0x7f0bc80a5c70 2024-09-13T10:30:05.859 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient(hunting): _negotiate 2024-09-13T10:30:05.860 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:05.860 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:05.860 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient(hunting): my global_id is 4157 2024-09-13T10:30:05.860 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bc809e020 con 0x7f0bc80a5c70 2024-09-13T10:30:05.860 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214182875 0 0) 0x7f0bc809da60 con 0x7f0bc809cbd0 2024-09-13T10:30:05.860 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient(hunting): _negotiate 2024-09-13T10:30:05.860 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:05.860 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:05.860 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient(hunting): my global_id is 4170 2024-09-13T10:30:05.860 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bc809e300 con 0x7f0bc809cbd0 2024-09-13T10:30:05.860 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1493908387 0 0) 0x7f0bc809e020 con 0x7f0bc80a5c70 2024-09-13T10:30:05.860 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 >> v1:172.21.15.181:6792/0 conn(0x7f0bc80a5890 legacy=0x7f0bc813e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 >> v1:172.21.15.195:6790/0 conn(0x7f0bc809cbd0 legacy=0x7f0bc8135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient: _finish_hunting 0 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 monclient: found mon.noname-e 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc8146110 con 0x7f0bc80a5c70 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient: _finish_auth 0 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient: _check_auth_tickets 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0bc0001a90 con 0x7f0bc80a5c70 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bccc57640 5 monclient: authenticate success, global_id 4157 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:05.861 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient: dump: 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:05.862 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bccc57640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0bc0003610 con 0x7f0bc80a5c70 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 1 -- 172.21.15.181:0/2885131255 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0bc0003b80 con 0x7f0bc80a5c70 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bccc57640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bccc57640 4 set_mon_vals no callback set 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bc559a640 10 monclient: dump: 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:05.863 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:05.864 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bccc57640 10 monclient: shutdown 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bccc57640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bccc57640 1 -- 172.21.15.181:0/2885131255 >> v1:172.21.15.181:6793/0 conn(0x7f0bc80a5c70 legacy=0x7f0bc81419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bccc57640 1 -- 172.21.15.181:0/2885131255 shutdown_connections 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bccc57640 1 -- 172.21.15.181:0/2885131255 >> 172.21.15.181:0/2885131255 conn(0x7f0bc80abb70 msgr2=0x7f0bc80abf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bccc57640 1 -- 172.21.15.181:0/2885131255 shutdown_connections 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.854+0000 7f0bccc57640 1 -- 172.21.15.181:0/2885131255 wait complete. 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.855+0000 7f0bccc57640 10 monclient: build_initial_monmap 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.855+0000 7f0bccc57640 10 monclient: monmap: 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:epoch 0 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:created 0.000000 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:05.865 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.855+0000 7f0bccc57640 1 Processor -- start 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bccc57640 1 -- start start 2024-09-13T10:30:05.866 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bccc57640 10 monclient: init 2024-09-13T10:30:05.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bccc57640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:05.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bccc57640 10 monclient: _add_conns ranks=[4,5,7,2,6,8,0,3,1] 2024-09-13T10:30:05.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bccc57640 10 monclient(hunting): picked mon.noname-c con 0x7f0bc809cbd0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:05.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bccc57640 10 monclient(hunting): picked mon.noname-h con 0x7f0bc80a5890 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:05.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bccc57640 10 monclient(hunting): picked mon.noname-i con 0x7f0bc80a5c70 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:05.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bccc57640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc80a38c0 con 0x7f0bc809cbd0 2024-09-13T10:30:05.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bccc57640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc80a5640 con 0x7f0bc80a5890 2024-09-13T10:30:05.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bccc57640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc81cee40 con 0x7f0bc80a5c70 2024-09-13T10:30:05.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bccc57640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:05.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bccc57640 10 monclient(hunting): authenticate will time out at 745.361436s 2024-09-13T10:30:05.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bc659c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f0bc809cbd0 0x7f0bc81ce020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47374/0 (socket says 172.21.15.181:47374) 2024-09-13T10:30:05.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.856+0000 7f0bc659c640 1 -- 172.21.15.181:0/376144093 learned_addr learned my addr 172.21.15.181:0/376144093 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:05.870 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bc659c640 1 -- 172.21.15.181:0/376144093 >> v1:172.21.15.181:6791/0 conn(0x7f0bc809cbd0 legacy=0x7f0bc81ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bc5d9b640 1 -- 172.21.15.181:0/376144093 >> v1:172.21.15.195:6791/0 conn(0x7f0bc80a5890 legacy=0x7f0bc81ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bc6d9d640 1 -- 172.21.15.181:0/376144093 >> v1:172.21.15.195:6792/0 conn(0x7f0bc80a5c70 legacy=0x7f0bc81d6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3714619960 0 0) 0x7f0bc809e300 con 0x7f0bc809cbd0 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bb6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bb6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bb6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bb6ffd640 10 monclient(hunting): my global_id is 4207 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ba8003520 con 0x7f0bc809cbd0 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2432400688 0 0) 0x7f0ba8003520 con 0x7f0bc809cbd0 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0bc809e300 con 0x7f0bc809cbd0 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0bb8003990 con 0x7f0bc809cbd0 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.858+0000 7f0bb6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:05.871 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient(hunting): dump: 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:05.872 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2844980154 0 0) 0x7f0bc80a5640 con 0x7f0bc80a5890 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient(hunting): my global_id is 4208 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ba8003520 con 0x7f0bc80a5890 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178011457 0 0) 0x7f0bc81cee40 con 0x7f0bc80a5c70 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:05.873 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient(hunting): my global_id is 54151 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bc80a5640 con 0x7f0bc80a5c70 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3550824891 0 0) 0x7f0bc809e300 con 0x7f0bc809cbd0 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 >> v1:172.21.15.195:6792/0 conn(0x7f0bc80a5c70 legacy=0x7f0bc81d6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 >> v1:172.21.15.195:6791/0 conn(0x7f0bc80a5890 legacy=0x7f0bc81ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 1 monclient: found mon.c 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc8145d10 con 0x7f0bc809cbd0 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:05.874 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:05.875 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bccc57640 5 monclient: authenticate success, global_id 4207 2024-09-13T10:30:05.875 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bccc57640 10 monclient: _renew_subs 2024-09-13T10:30:05.875 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bccc57640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:05.875 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bccc57640 1 -- 172.21.15.181:0/376144093 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc80a1e00 con 0x7f0bc809cbd0 2024-09-13T10:30:05.875 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bccc57640 10 monclient: _renew_subs 2024-09-13T10:30:05.875 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bccc57640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:05.875 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bccc57640 1 -- 172.21.15.181:0/376144093 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f0bc80a2960 con 0x7f0bc809cbd0 2024-09-13T10:30:05.875 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0bb8003fa0 con 0x7f0bc809cbd0 2024-09-13T10:30:05.875 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:05.875 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0bb8004490 con 0x7f0bc809cbd0 2024-09-13T10:30:05.875 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:05.875 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bc4d99640 4 set_mon_vals no callback set 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.859+0000 7f0bb6ffd640 10 monclient: dump: 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:05.876 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:05.877 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:05.877 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:05.877 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:05.877 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:05.877 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:05.877 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.860+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 4) ==== 50328+0+0 (unknown 4138074549 0 0) 0x7f0bb8011fe0 con 0x7f0bc809cbd0 2024-09-13T10:30:05.877 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.860+0000 7f0bccc57640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:05.877 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.860+0000 7f0bccc57640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:05.877 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.860+0000 7f0bccc57640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:05.877 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.860+0000 7f0bccc57640 1 -- 172.21.15.181:0/376144093 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bac005080 con 0x7f0bc809cbd0 2024-09-13T10:30:05.877 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.860+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 3105561109 0 0) 0x7f0bb804dde0 con 0x7f0bc809cbd0 2024-09-13T10:30:05.877 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.860+0000 7f0bc5d9b640 10 monclient: get_auth_request con 0x7f0ba803fba0 auth_method 0 2024-09-13T10:30:05.878 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.864+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f0bc80a38c0 con 0x7f0bc809cbd0 2024-09-13T10:30:05.878 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.864+0000 7f0bb6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:05.878 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:05.864+0000 7f0bb6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:06.044 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.042+0000 7f0bccc57640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:06.044 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.042+0000 7f0bccc57640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:06.044 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.042+0000 7f0bccc57640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:06.044 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.042+0000 7f0bccc57640 1 -- 172.21.15.181:0/376144093 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0bac005370 con 0x7f0bc809cbd0 2024-09-13T10:30:06.044 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.043+0000 7f0bb6ffd640 1 -- 172.21.15.181:0/376144093 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (unknown 150273500 0 3807066675) 0x7f0bb8017d00 con 0x7f0bc809cbd0 2024-09-13T10:30:06.045 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.043+0000 7f0bb6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:06.045 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.043+0000 7f0bb6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:06.045 INFO:teuthology.misc.health.smithi181.stdout: 2024-09-13T10:30:06.045 INFO:teuthology.misc.health.smithi181.stdout:{"epoch":8,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","created":"2024-09-13T10:29:50.823515+0000","modified":"2024-09-13T10:30:04.743077+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T10:30:04.743077+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"222eae7d-397c-40de-9975-11705817eae7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c241f0df-9ad4-42f4-809b-872d2c14bdc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"efbff8a5-b42c-4e47-92e1-faf8ef9bec2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"11e6b317-e77c-4469-840a-a1d17e9eee86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"78cd8d74-5ffb-4116-aa73-e082ffd9adce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ecb70959-b169-4fd8-958d-ac5b1d0a3c28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T10:30:06.046 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.045+0000 7f0bccc57640 1 -- 172.21.15.181:0/376144093 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0ba803fba0 legacy=0x7f0ba8042060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:06.046 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.045+0000 7f0bccc57640 10 monclient: shutdown 2024-09-13T10:30:06.046 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.045+0000 7f0bccc57640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:06.047 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.045+0000 7f0bccc57640 1 -- 172.21.15.181:0/376144093 >> v1:172.21.15.181:6791/0 conn(0x7f0bc809cbd0 legacy=0x7f0bc81ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:06.047 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.045+0000 7f0bccc57640 1 -- 172.21.15.181:0/376144093 shutdown_connections 2024-09-13T10:30:06.047 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.045+0000 7f0bccc57640 1 -- 172.21.15.181:0/376144093 >> 172.21.15.181:0/376144093 conn(0x7f0bc80abb70 msgr2=0x7f0bc81443f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:06.047 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.045+0000 7f0bccc57640 1 -- 172.21.15.181:0/376144093 shutdown_connections 2024-09-13T10:30:06.047 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:06.045+0000 7f0bccc57640 1 -- 172.21.15.181:0/376144093 wait complete. 2024-09-13T10:30:06.056 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-13T10:30:06.056 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-09-13T10:30:06.054+0000 7f8207420640 -1 Falling back to public interface 2024-09-13T10:30:06.262 INFO:tasks.ceph.osd.1.smithi181.stderr:2024-09-13T10:30:06.260+0000 7f1c15c11640 -1 Falling back to public interface 2024-09-13T10:30:06.284 INFO:tasks.ceph.osd.0.smithi181.stderr:2024-09-13T10:30:06.282+0000 7f5ac6e16640 -1 Falling back to public interface 2024-09-13T10:30:06.294 INFO:tasks.ceph.osd.2.smithi181.stderr:2024-09-13T10:30:06.293+0000 7f4248f58640 -1 Falling back to public interface 2024-09-13T10:30:06.518 INFO:tasks.ceph.osd.3.smithi195.stderr:2024-09-13T10:30:06.516+0000 7fc9fdba8640 -1 Falling back to public interface 2024-09-13T10:30:09.568 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-09-13T10:30:09.566+0000 7f8207420640 -1 osd.4 0 log_to_monitors true 2024-09-13T10:30:09.827 INFO:tasks.ceph.osd.0.smithi181.stderr:2024-09-13T10:30:09.825+0000 7f5ac6e16640 -1 osd.0 0 log_to_monitors true 2024-09-13T10:30:10.013 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-09-13T10:30:10.012+0000 7fd866a18640 -1 osd.5 0 log_to_monitors true 2024-09-13T10:30:10.275 INFO:tasks.ceph.osd.1.smithi181.stderr:2024-09-13T10:30:10.274+0000 7f1c15c11640 -1 osd.1 0 log_to_monitors true 2024-09-13T10:30:10.353 INFO:tasks.ceph.osd.2.smithi181.stderr:2024-09-13T10:30:10.352+0000 7f4248f58640 -1 osd.2 0 log_to_monitors true 2024-09-13T10:30:10.787 INFO:tasks.ceph.osd.3.smithi195.stderr:2024-09-13T10:30:10.786+0000 7fc9fdba8640 -1 osd.3 0 log_to_monitors true 2024-09-13T10:30:11.083 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-09-13T10:30:11.081+0000 7f8202d11640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T10:30:11.085 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-09-13T10:30:11.084+0000 7f81fab30640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T10:30:11.635 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-09-13T10:30:11.634+0000 7fd8623e1640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T10:30:11.638 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-09-13T10:30:11.637+0000 7fd85e208640 -1 osd.5 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T10:30:11.640 INFO:tasks.ceph.osd.0.smithi181.stderr:2024-09-13T10:30:11.639+0000 7f5ac27e1640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T10:30:11.787 INFO:tasks.ceph.osd.0.smithi181.stderr:2024-09-13T10:30:11.785+0000 7f5abe608640 -1 osd.0 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T10:30:12.661 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T10:30:12.704 INFO:tasks.ceph.osd.2.smithi181.stderr:2024-09-13T10:30:12.702+0000 7f4244ee7640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T10:30:12.707 INFO:tasks.ceph.osd.2.smithi181.stderr:2024-09-13T10:30:12.705+0000 7f423cd06640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T10:30:12.757 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.755+0000 7fb4d34e4640 10 monclient: get_monmap_and_config 2024-09-13T10:30:12.757 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.755+0000 7fb4d34e4640 10 monclient: build_initial_monmap 2024-09-13T10:30:12.757 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.755+0000 7fb4d34e4640 10 monclient: monmap: 2024-09-13T10:30:12.757 INFO:teuthology.misc.health.smithi181.stderr:epoch 0 2024-09-13T10:30:12.757 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:12.757 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:30:12.756298+0000 2024-09-13T10:30:12.757 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:30:12.756298+0000 2024-09-13T10:30:12.757 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:12.757 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:12.757 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:12.758 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:12.758 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:12.758 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:12.758 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:12.758 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:12.758 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:12.758 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:12.758 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:12.758 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:12.759 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.756+0000 7fb4d34e4640 1 Processor -- start 2024-09-13T10:30:12.759 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.756+0000 7fb4d34e4640 1 -- start start 2024-09-13T10:30:12.759 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.756+0000 7fb4d34e4640 10 monclient: init 2024-09-13T10:30:12.759 INFO:tasks.ceph.osd.1.smithi181.stderr:2024-09-13T10:30:12.756+0000 7f1c11592640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T10:30:12.761 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.757+0000 7fb4d34e4640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.757+0000 7fb4d34e4640 10 monclient: _add_conns ranks=[2,3,1,7,4,5,6,8,0] 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.757+0000 7fb4d34e4640 10 monclient(hunting): picked mon.noname-b con 0x7fb4cc09cbd0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.757+0000 7fb4d34e4640 10 monclient(hunting): picked mon.noname-g con 0x7fb4cc0a5890 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.757+0000 7fb4d34e4640 10 monclient(hunting): picked mon.noname-f con 0x7fb4cc0a5c70 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.757+0000 7fb4d34e4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4cc09da60 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.757+0000 7fb4d34e4640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4cc09e020 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.757+0000 7fb4d34e4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4cc09e300 con 0x7fb4cc0a5890 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.757+0000 7fb4d34e4640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.757+0000 7fb4d34e4640 10 monclient(hunting): authenticate will time out at 752.262215s 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.757+0000 7fb4d1280640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fb4cc09cbd0 0x7fb4cc135e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:35404/0 (socket says 172.21.15.181:35404) 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.757+0000 7fb4d1280640 1 -- 172.21.15.181:0/2933546811 learned_addr learned my addr 172.21.15.181:0/2933546811 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.759+0000 7fb4d1280640 1 -- 172.21.15.181:0/2933546811 >> v1:172.21.15.181:6790/0 conn(0x7fb4cc09cbd0 legacy=0x7fb4cc135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:12.762 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.759+0000 7fb4d0a7f640 1 -- 172.21.15.181:0/2933546811 >> v1:172.21.15.195:6790/0 conn(0x7fb4cc0a5890 legacy=0x7fb4cc13e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:12.763 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.759+0000 7fb4d1a81640 1 -- 172.21.15.181:0/2933546811 >> v1:172.21.15.195:6789/0 conn(0x7fb4cc0a5c70 legacy=0x7fb4cc1419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:12.763 INFO:tasks.ceph.osd.1.smithi181.stderr:2024-09-13T10:30:12.759+0000 7f1c093b1640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T10:30:12.766 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 1 -- 172.21.15.181:0/2933546811 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1385439110 0 0) 0x7fb4cc09da60 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.766 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:12.766 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:12.766 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:12.766 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient(hunting): my global_id is 54199 2024-09-13T10:30:12.766 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 1 -- 172.21.15.181:0/2933546811 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4b8003520 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 1 -- 172.21.15.181:0/2933546811 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1600703996 0 0) 0x7fb4cc09e300 con 0x7fb4cc0a5890 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient(hunting): my global_id is 4188 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 1 -- 172.21.15.181:0/2933546811 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4cc09da60 con 0x7fb4cc0a5890 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 1 -- 172.21.15.181:0/2933546811 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3982959905 0 0) 0x7fb4b8003520 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 1 -- 172.21.15.181:0/2933546811 >> v1:172.21.15.195:6790/0 conn(0x7fb4cc0a5890 legacy=0x7fb4cc13e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 1 -- 172.21.15.181:0/2933546811 >> v1:172.21.15.181:6790/0 conn(0x7fb4cc09cbd0 legacy=0x7fb4cc135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 1 monclient: found mon.noname-f 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:30:12.767 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 1 -- 172.21.15.181:0/2933546811 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc146110 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 1 -- 172.21.15.181:0/2933546811 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb4c4001de0 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient: dump: 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:12.768 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4d34e4640 5 monclient: authenticate success, global_id 54199 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4d34e4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 1 -- 172.21.15.181:0/2933546811 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb4bc001b50 con 0x7fb4cc0a5890 2024-09-13T10:30:12.769 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.763+0000 7fb4c3fff640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4c3fff640 1 -- 172.21.15.181:0/2933546811 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4c40020b0 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4c3fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4c3fff640 1 -- 172.21.15.181:0/2933546811 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb4c4003cd0 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4d34e4640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4d34e4640 4 set_mon_vals no callback set 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4c3fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4c3fff640 10 monclient: dump: 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:12.770 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4d34e4640 10 monclient: shutdown 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4d34e4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:12.771 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2933546811 >> v1:172.21.15.195:6789/0 conn(0x7fb4cc0a5c70 legacy=0x7fb4cc1419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:12.772 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2933546811 shutdown_connections 2024-09-13T10:30:12.772 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2933546811 >> 172.21.15.181:0/2933546811 conn(0x7fb4cc0abb70 msgr2=0x7fb4cc0abf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:12.772 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2933546811 shutdown_connections 2024-09-13T10:30:12.772 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.764+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2933546811 wait complete. 2024-09-13T10:30:12.777 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.765+0000 7fb4d34e4640 10 monclient: build_initial_monmap 2024-09-13T10:30:12.777 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.765+0000 7fb4d34e4640 10 monclient: monmap: 2024-09-13T10:30:12.777 INFO:teuthology.misc.health.smithi181.stderr:epoch 0 2024-09-13T10:30:12.777 INFO:teuthology.misc.health.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:12.777 INFO:teuthology.misc.health.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr:created 0.000000 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:12.778 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.766+0000 7fb4d34e4640 1 Processor -- start 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.766+0000 7fb4d34e4640 1 -- start start 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.766+0000 7fb4d34e4640 10 monclient: init 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.766+0000 7fb4d34e4640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.766+0000 7fb4d34e4640 10 monclient: _add_conns ranks=[0,3,4,5,7,1,8,2,6] 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.766+0000 7fb4d34e4640 10 monclient(hunting): picked mon.noname-a con 0x7fb4cc09cbd0 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.766+0000 7fb4d34e4640 10 monclient(hunting): picked mon.noname-g con 0x7fb4cc0a5890 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.766+0000 7fb4d34e4640 10 monclient(hunting): picked mon.noname-c con 0x7fb4cc0a5c70 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.767+0000 7fb4d34e4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4cc145d10 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.767+0000 7fb4d34e4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4cc0a3ce0 con 0x7fb4cc0a5890 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.767+0000 7fb4d34e4640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4cc0a3fc0 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.767+0000 7fb4d34e4640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:12.779 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.767+0000 7fb4d34e4640 10 monclient(hunting): authenticate will time out at 752.272050s 2024-09-13T10:30:12.780 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.767+0000 7fb4d1280640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb4cc09cbd0 0x7fb4cc0a0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54928/0 (socket says 172.21.15.181:54928) 2024-09-13T10:30:12.780 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.767+0000 7fb4d1280640 1 -- 172.21.15.181:0/2122162029 learned_addr learned my addr 172.21.15.181:0/2122162029 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:12.780 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4d1280640 1 -- 172.21.15.181:0/2122162029 >> v1:172.21.15.181:6789/0 conn(0x7fb4cc09cbd0 legacy=0x7fb4cc0a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:12.780 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4d1a81640 1 -- 172.21.15.181:0/2122162029 >> v1:172.21.15.181:6791/0 conn(0x7fb4cc0a5c70 legacy=0x7fb4cc1d6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:12.780 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4d0a7f640 1 -- 172.21.15.181:0/2122162029 >> v1:172.21.15.195:6790/0 conn(0x7fb4cc0a5890 legacy=0x7fb4cc0a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:12.780 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921916774 0 0) 0x7fb4cc09e020 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.780 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:12.780 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:12.780 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:12.780 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): my global_id is 54189 2024-09-13T10:30:12.780 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4b0003520 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.780 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009023447 0 0) 0x7fb4cc0a3fc0 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): my global_id is 4225 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4cc09e020 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367000979 0 0) 0x7fb4cc0a3ce0 con 0x7fb4cc0a5890 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): my global_id is 4197 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4cc0a3fc0 con 0x7fb4cc0a5890 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1372504380 0 0) 0x7fb4b0003520 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.781 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4cc0a3ce0 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb4c80047e0 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:12.782 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 863488608 0 0) 0x7fb4cc0a3fc0 con 0x7fb4cc0a5890 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4b0003520 con 0x7fb4cc0a5890 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2098179610 0 0) 0x7fb4cc09e020 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4cc0a3fc0 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb4bc003950 con 0x7fb4cc0a5890 2024-09-13T10:30:12.783 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:12.784 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb4c4003cd0 con 0x7fb4cc0a5c70 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:12.785 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2196691014 0 0) 0x7fb4cc0a3ce0 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 >> v1:172.21.15.181:6791/0 conn(0x7fb4cc0a5c70 legacy=0x7fb4cc1d6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:12.786 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 >> v1:172.21.15.195:6790/0 conn(0x7fb4cc0a5890 legacy=0x7fb4cc0a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 monclient: found mon.a 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.769+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc0a54a0 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4c1ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4c1ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4d34e4640 5 monclient: authenticate success, global_id 54189 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4d34e4640 10 monclient: _renew_subs 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4d34e4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2122162029 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc0a1c60 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.787 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4c8004cb0 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.788 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4c1ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:12.788 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb4c80051e0 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.788 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:12.788 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4c1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:12.788 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4c1ffb640 10 monclient: dump: 2024-09-13T10:30:12.788 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:12.788 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:12.788 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:12.788 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:12.788 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:12.788 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:12.788 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:12.789 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:12.789 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:12.789 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:12.789 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:12.789 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:12.789 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:12.789 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:12.789 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:12.789 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:12.789 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4c37fe640 4 set_mon_vals no callback set 2024-09-13T10:30:12.789 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4d34e4640 10 monclient: _renew_subs 2024-09-13T10:30:12.789 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4d34e4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:12.790 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.770+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2122162029 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb4cc0a27c0 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.790 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.771+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 4) ==== 50328+0+0 (unknown 4138074549 0 0) 0x7fb4c8005380 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.790 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.771+0000 7fb4d34e4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:12.790 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.771+0000 7fb4d34e4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:12.790 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.771+0000 7fb4d34e4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:12.790 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.771+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2122162029 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4cc0a3720 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.790 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.771+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(12..12 src has 1..12) ==== 2347+0+0 (unknown 4200878275 0 0) 0x7fb4c804dcf0 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.790 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.771+0000 7fb4d0a7f640 10 monclient: get_auth_request con 0x7fb4b0040470 auth_method 0 2024-09-13T10:30:12.790 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.775+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fb4cc145d10 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.790 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.776+0000 7fb4c1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:12.790 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.776+0000 7fb4c1ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:12.956 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.954+0000 7fb4d34e4640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:12.956 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.954+0000 7fb4d34e4640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:12.957 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.954+0000 7fb4d34e4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:12.957 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.954+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2122162029 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4cc1381f0 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.957 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.955+0000 7fb4c1ffb640 1 -- 172.21.15.181:0/2122162029 <== mon.0 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+6378 (unknown 4250787923 0 1457309485) 0x7fb4c80178d0 con 0x7fb4cc09cbd0 2024-09-13T10:30:12.957 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.955+0000 7fb4c1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:12.957 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.955+0000 7fb4c1ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:12.957 INFO:teuthology.misc.health.smithi181.stdout: 2024-09-13T10:30:12.957 INFO:teuthology.misc.health.smithi181.stdout:{"epoch":12,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","created":"2024-09-13T10:29:50.823515+0000","modified":"2024-09-13T10:30:12.627060+0000","last_up_change":"2024-09-13T10:30:12.627060+0000","last_in_change":"2024-09-13T10:30:04.743077+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"222eae7d-397c-40de-9975-11705817eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6804","nonce":3159017208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6805","nonce":3159017208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6807","nonce":3159017208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6806","nonce":3159017208}]},"public_addr":"172.21.15.181:6804/3159017208","cluster_addr":"172.21.15.181:6805/3159017208","heartbeat_back_addr":"172.21.15.181:6807/3159017208","heartbeat_front_addr":"172.21.15.181:6806/3159017208","state":["exists","up"]},{"osd":1,"uuid":"c241f0df-9ad4-42f4-809b-872d2c14bdc2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"efbff8a5-b42c-4e47-92e1-faf8ef9bec2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"11e6b317-e77c-4469-840a-a1d17e9eee86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"78cd8d74-5ffb-4116-aa73-e082ffd9adce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6805","nonce":1430589228}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6806","nonce":1430589228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6808","nonce":1430589228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6807","nonce":1430589228}]},"public_addr":"172.21.15.195:6805/1430589228","cluster_addr":"172.21.15.195:6806/1430589228","heartbeat_back_addr":"172.21.15.195:6808/1430589228","heartbeat_front_addr":"172.21.15.195:6807/1430589228","state":["exists","up"]},{"osd":5,"uuid":"ecb70959-b169-4fd8-958d-ac5b1d0a3c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6801","nonce":2714505324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6802","nonce":2714505324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6804","nonce":2714505324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6803","nonce":2714505324}]},"public_addr":"172.21.15.195:6801/2714505324","cluster_addr":"172.21.15.195:6802/2714505324","heartbeat_back_addr":"172.21.15.195:6804/2714505324","heartbeat_front_addr":"172.21.15.195:6803/2714505324","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.551366+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T10:30:12.958 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.957+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2122162029 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb4b0040470 legacy=0x7fb4b0042930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:12.958 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.957+0000 7fb4d34e4640 10 monclient: shutdown 2024-09-13T10:30:12.959 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.957+0000 7fb4d34e4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:12.959 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.957+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2122162029 >> v1:172.21.15.181:6789/0 conn(0x7fb4cc09cbd0 legacy=0x7fb4cc0a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:12.959 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.957+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2122162029 shutdown_connections 2024-09-13T10:30:12.959 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.957+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2122162029 >> 172.21.15.181:0/2122162029 conn(0x7fb4cc0abb70 msgr2=0x7fb4cc1444f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:12.959 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.957+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2122162029 shutdown_connections 2024-09-13T10:30:12.959 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:12.957+0000 7fb4d34e4640 1 -- 172.21.15.181:0/2122162029 wait complete. 2024-09-13T10:30:12.967 DEBUG:teuthology.misc:3 of 6 OSDs are up 2024-09-13T10:30:13.119 INFO:tasks.ceph.osd.3.smithi195.stderr:2024-09-13T10:30:13.118+0000 7fc9fa34b640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T10:30:13.122 INFO:tasks.ceph.osd.3.smithi195.stderr:2024-09-13T10:30:13.120+0000 7fc9f1956640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T10:30:13.278 INFO:tasks.ceph.osd.1.smithi181.stderr:2024-09-13T10:30:13.277+0000 7f1c04fa4640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T10:30:13.279 INFO:tasks.ceph.osd.1.smithi181.stderr:2024-09-13T10:30:13.277+0000 7f1c04fa4640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T10:30:13.279 INFO:tasks.ceph.osd.1.smithi181.stderr:2024-09-13T10:30:13.278+0000 7f1c04fa4640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T10:30:19.573 DEBUG:teuthology.orchestra.run.smithi181:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T10:30:19.673 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.671+0000 7fb2314d4640 10 monclient: get_monmap_and_config 2024-09-13T10:30:19.673 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.671+0000 7fb2314d4640 10 monclient: build_initial_monmap 2024-09-13T10:30:19.673 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.671+0000 7fb2314d4640 10 monclient: monmap: 2024-09-13T10:30:19.673 INFO:teuthology.misc.health.smithi181.stderr:epoch 0 2024-09-13T10:30:19.673 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:19.673 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:30:19.672395+0000 2024-09-13T10:30:19.674 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:30:19.672395+0000 2024-09-13T10:30:19.674 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:19.674 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:19.674 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:19.674 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:19.674 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:19.674 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:19.674 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:19.674 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:19.674 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:19.674 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:19.675 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:19.675 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:19.679 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 1 Processor -- start 2024-09-13T10:30:19.680 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 1 -- start start 2024-09-13T10:30:19.680 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 10 monclient: init 2024-09-13T10:30:19.680 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:19.680 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 10 monclient: _add_conns ranks=[7,4,1,0,2,6,3,8,5] 2024-09-13T10:30:19.680 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 10 monclient(hunting): picked mon.noname-i con 0x7fb22c09cbd0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:19.680 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 10 monclient(hunting): picked mon.noname-c con 0x7fb22c0a5890 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:19.680 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 10 monclient(hunting): picked mon.noname-f con 0x7fb22c0a5c70 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:19.680 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c09da60 con 0x7fb22c0a5c70 2024-09-13T10:30:19.680 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c09e020 con 0x7fb22c0a5890 2024-09-13T10:30:19.680 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c09e300 con 0x7fb22c09cbd0 2024-09-13T10:30:19.681 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:19.681 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.672+0000 7fb2314d4640 10 monclient(hunting): authenticate will time out at 759.177962s 2024-09-13T10:30:19.681 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.673+0000 7fb22a7fc640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fb22c0a5890 0x7fb22c13e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:52924/0 (socket says 172.21.15.181:52924) 2024-09-13T10:30:19.681 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.673+0000 7fb22a7fc640 1 -- 172.21.15.181:0/2571154984 learned_addr learned my addr 172.21.15.181:0/2571154984 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:19.681 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb22a7fc640 1 -- 172.21.15.181:0/2571154984 >> v1:172.21.15.181:6791/0 conn(0x7fb22c0a5890 legacy=0x7fb22c13e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:19.681 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 1 -- 172.21.15.181:0/2571154984 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 642585530 0 0) 0x7fb22c09e020 con 0x7fb22c0a5890 2024-09-13T10:30:19.681 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:19.681 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:19.681 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:19.681 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient(hunting): my global_id is 4243 2024-09-13T10:30:19.681 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 1 -- 172.21.15.181:0/2571154984 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb214003520 con 0x7fb22c0a5890 2024-09-13T10:30:19.682 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb22affd640 1 -- 172.21.15.181:0/2571154984 >> v1:172.21.15.195:6792/0 conn(0x7fb22c09cbd0 legacy=0x7fb22c135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:19.682 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb22b7fe640 1 -- 172.21.15.181:0/2571154984 >> v1:172.21.15.195:6789/0 conn(0x7fb22c0a5c70 legacy=0x7fb22c1419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:19.682 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 1 -- 172.21.15.181:0/2571154984 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2639054385 0 0) 0x7fb214003520 con 0x7fb22c0a5890 2024-09-13T10:30:19.682 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 1 -- 172.21.15.181:0/2571154984 >> v1:172.21.15.195:6792/0 conn(0x7fb22c09cbd0 legacy=0x7fb22c135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:19.682 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 1 -- 172.21.15.181:0/2571154984 >> v1:172.21.15.195:6789/0 conn(0x7fb22c0a5c70 legacy=0x7fb22c1419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:19.682 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:19.682 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 1 monclient: found mon.noname-c 2024-09-13T10:30:19.682 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:19.682 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:30:19.682 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 1 -- 172.21.15.181:0/2571154984 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c146110 con 0x7fb22c0a5890 2024-09-13T10:30:19.682 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:19.683 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:19.683 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:19.683 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 1 -- 172.21.15.181:0/2571154984 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb21c001ae0 con 0x7fb22c0a5890 2024-09-13T10:30:19.683 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:19.683 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:19.683 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient: dump: 2024-09-13T10:30:19.683 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:19.683 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:19.683 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.683 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.683 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:19.684 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:19.684 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:19.684 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:19.684 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:19.684 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:19.684 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:19.684 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:19.684 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:19.684 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:19.684 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:19.685 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:19.685 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb2314d4640 5 monclient: authenticate success, global_id 4243 2024-09-13T10:30:19.685 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb2314d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:19.685 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 1 -- 172.21.15.181:0/2571154984 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb21c0048a0 con 0x7fb22c0a5890 2024-09-13T10:30:19.685 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:19.685 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 1 -- 172.21.15.181:0/2571154984 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb21c004dd0 con 0x7fb22c0a5890 2024-09-13T10:30:19.685 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:19.685 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:19.685 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb229ffb640 10 monclient: dump: 2024-09-13T10:30:19.685 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:19.685 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:19.685 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.686 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.686 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:19.686 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:19.686 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:19.686 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:19.686 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:19.686 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:19.686 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:19.686 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:19.686 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:19.686 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:19.687 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:19.687 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:19.687 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb2314d4640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:19.687 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.675+0000 7fb2314d4640 4 set_mon_vals no callback set 2024-09-13T10:30:19.687 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.676+0000 7fb2314d4640 10 monclient: shutdown 2024-09-13T10:30:19.687 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.676+0000 7fb2314d4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:19.687 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.676+0000 7fb2314d4640 1 -- 172.21.15.181:0/2571154984 >> v1:172.21.15.181:6791/0 conn(0x7fb22c0a5890 legacy=0x7fb22c13e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:19.687 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.676+0000 7fb2314d4640 1 -- 172.21.15.181:0/2571154984 shutdown_connections 2024-09-13T10:30:19.687 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.676+0000 7fb2314d4640 1 -- 172.21.15.181:0/2571154984 >> 172.21.15.181:0/2571154984 conn(0x7fb22c0abb70 msgr2=0x7fb22c0abf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:19.687 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.676+0000 7fb2314d4640 1 -- 172.21.15.181:0/2571154984 shutdown_connections 2024-09-13T10:30:19.687 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.676+0000 7fb2314d4640 1 -- 172.21.15.181:0/2571154984 wait complete. 2024-09-13T10:30:19.687 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.677+0000 7fb2314d4640 10 monclient: build_initial_monmap 2024-09-13T10:30:19.688 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.677+0000 7fb2314d4640 10 monclient: monmap: 2024-09-13T10:30:19.688 INFO:teuthology.misc.health.smithi181.stderr:epoch 0 2024-09-13T10:30:19.688 INFO:teuthology.misc.health.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:19.688 INFO:teuthology.misc.health.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:19.688 INFO:teuthology.misc.health.smithi181.stderr:created 0.000000 2024-09-13T10:30:19.688 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:19.688 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:19.688 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:19.688 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:19.688 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:19.688 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:19.688 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:19.689 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:19.689 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:19.689 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:19.689 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:19.689 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:19.689 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.677+0000 7fb2314d4640 1 Processor -- start 2024-09-13T10:30:19.689 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.677+0000 7fb2314d4640 1 -- start start 2024-09-13T10:30:19.689 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.677+0000 7fb2314d4640 10 monclient: init 2024-09-13T10:30:19.689 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.678+0000 7fb2314d4640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:19.689 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.678+0000 7fb2314d4640 10 monclient: _add_conns ranks=[4,6,1,3,0,7,5,2,8] 2024-09-13T10:30:19.689 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.678+0000 7fb2314d4640 10 monclient(hunting): picked mon.noname-c con 0x7fb22c09cbd0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:19.690 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.678+0000 7fb2314d4640 10 monclient(hunting): picked mon.noname-d con 0x7fb22c0a5890 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:19.690 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.678+0000 7fb2314d4640 10 monclient(hunting): picked mon.noname-f con 0x7fb22c0a5c70 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:19.690 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.678+0000 7fb2314d4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c1cee40 con 0x7fb22c0a5c70 2024-09-13T10:30:19.690 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.678+0000 7fb2314d4640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c145d10 con 0x7fb22c09cbd0 2024-09-13T10:30:19.690 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.678+0000 7fb2314d4640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c0a54f0 con 0x7fb22c0a5890 2024-09-13T10:30:19.690 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.678+0000 7fb2314d4640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:19.690 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.678+0000 7fb2314d4640 10 monclient(hunting): authenticate will time out at 759.183165s 2024-09-13T10:30:19.690 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.678+0000 7fb22affd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fb22c09cbd0 0x7fb22c1ce020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:52940/0 (socket says 172.21.15.181:52940) 2024-09-13T10:30:19.690 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.678+0000 7fb22affd640 1 -- 172.21.15.181:0/3360926953 learned_addr learned my addr 172.21.15.181:0/3360926953 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:19.694 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb22affd640 1 -- 172.21.15.181:0/3360926953 >> v1:172.21.15.181:6791/0 conn(0x7fb22c09cbd0 legacy=0x7fb22c1ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:19.694 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb22a7fc640 1 -- 172.21.15.181:0/3360926953 >> v1:172.21.15.181:6792/0 conn(0x7fb22c0a5890 legacy=0x7fb22c1ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:19.694 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566943634 0 0) 0x7fb22c145d10 con 0x7fb22c09cbd0 2024-09-13T10:30:19.695 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:19.695 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:19.695 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:19.695 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): my global_id is 4252 2024-09-13T10:30:19.695 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb22b7fe640 1 -- 172.21.15.181:0/3360926953 >> v1:172.21.15.195:6789/0 conn(0x7fb22c0a5c70 legacy=0x7fb22c1d6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:19.695 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb218003520 con 0x7fb22c09cbd0 2024-09-13T10:30:19.695 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159161573 0 0) 0x7fb22c0a54f0 con 0x7fb22c0a5890 2024-09-13T10:30:19.695 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:19.695 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:19.695 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:19.695 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): my global_id is 4218 2024-09-13T10:30:19.695 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb22c145d10 con 0x7fb22c0a5890 2024-09-13T10:30:19.696 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561468977 0 0) 0x7fb22c1cee40 con 0x7fb22c0a5c70 2024-09-13T10:30:19.696 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:19.696 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:19.696 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:19.696 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): my global_id is 54226 2024-09-13T10:30:19.696 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb22c0a54f0 con 0x7fb22c0a5c70 2024-09-13T10:30:19.696 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4111846426 0 0) 0x7fb218003520 con 0x7fb22c09cbd0 2024-09-13T10:30:19.696 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb22c1cee40 con 0x7fb22c09cbd0 2024-09-13T10:30:19.696 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb220003990 con 0x7fb22c09cbd0 2024-09-13T10:30:19.696 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:19.697 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:19.697 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): dump: 2024-09-13T10:30:19.697 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:19.697 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:19.697 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.697 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.697 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:19.697 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:19.697 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:19.697 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:19.697 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:19.698 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:19.698 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:19.698 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:19.698 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:19.698 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:19.698 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:19.698 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:19.698 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:19.698 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2609615259 0 0) 0x7fb22c145d10 con 0x7fb22c0a5890 2024-09-13T10:30:19.698 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb218003520 con 0x7fb22c0a5890 2024-09-13T10:30:19.698 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb21c004d90 con 0x7fb22c0a5890 2024-09-13T10:30:19.698 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:19.699 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:19.699 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 10 monclient(hunting): dump: 2024-09-13T10:30:19.699 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:19.699 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:19.699 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.699 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.699 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:19.699 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:19.699 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:19.699 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:19.699 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:19.699 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:19.700 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:19.700 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:19.700 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:19.700 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:19.700 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:19.700 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:19.700 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4195730256 0 0) 0x7fb22c1cee40 con 0x7fb22c09cbd0 2024-09-13T10:30:19.700 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.680+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 >> v1:172.21.15.181:6792/0 conn(0x7fb22c0a5890 legacy=0x7fb22c1ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:19.700 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 >> v1:172.21.15.195:6789/0 conn(0x7fb22c0a5c70 legacy=0x7fb22c1d6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:19.700 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:19.700 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 1 monclient: found mon.c 2024-09-13T10:30:19.700 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:19.701 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:19.701 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c0a3470 con 0x7fb22c09cbd0 2024-09-13T10:30:19.701 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 10 monclient: _finish_auth 0 2024-09-13T10:30:19.701 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:19.701 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:19.701 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2314d4640 5 monclient: authenticate success, global_id 4252 2024-09-13T10:30:19.701 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2314d4640 10 monclient: _renew_subs 2024-09-13T10:30:19.701 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2314d4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:19.701 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2314d4640 1 -- 172.21.15.181:0/3360926953 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb22c0a3770 con 0x7fb22c09cbd0 2024-09-13T10:30:19.701 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2314d4640 10 monclient: _renew_subs 2024-09-13T10:30:19.701 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2314d4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:19.701 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2314d4640 1 -- 172.21.15.181:0/3360926953 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fb22c0a1cf0 con 0x7fb22c09cbd0 2024-09-13T10:30:19.702 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb220003f10 con 0x7fb22c09cbd0 2024-09-13T10:30:19.702 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:19.702 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb220004440 con 0x7fb22c09cbd0 2024-09-13T10:30:19.702 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:19.702 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:19.702 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 10 monclient: dump: 2024-09-13T10:30:19.702 INFO:teuthology.misc.health.smithi181.stderr:epoch 1 2024-09-13T10:30:19.702 INFO:teuthology.misc.health.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:19.702 INFO:teuthology.misc.health.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.702 INFO:teuthology.misc.health.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.703 INFO:teuthology.misc.health.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:19.703 INFO:teuthology.misc.health.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:19.703 INFO:teuthology.misc.health.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:19.703 INFO:teuthology.misc.health.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:19.703 INFO:teuthology.misc.health.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:19.703 INFO:teuthology.misc.health.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:19.703 INFO:teuthology.misc.health.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:19.703 INFO:teuthology.misc.health.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:19.703 INFO:teuthology.misc.health.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:19.703 INFO:teuthology.misc.health.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:19.703 INFO:teuthology.misc.health.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:19.703 INFO:teuthology.misc.health.smithi181.stderr: 2024-09-13T10:30:19.704 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2297fa640 4 set_mon_vals no callback set 2024-09-13T10:30:19.704 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.681+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb2200045e0 con 0x7fb22c09cbd0 2024-09-13T10:30:19.704 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.682+0000 7fb2314d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:19.704 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.682+0000 7fb2314d4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:19.704 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.682+0000 7fb2314d4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:19.704 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.682+0000 7fb2314d4640 1 -- 172.21.15.181:0/3360926953 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22c0008d0 con 0x7fb22c09cbd0 2024-09-13T10:30:19.704 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.682+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(16..16 src has 1..16) ==== 3153+0+0 (unknown 3045190530 0 0) 0x7fb22004e380 con 0x7fb22c09cbd0 2024-09-13T10:30:19.704 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.682+0000 7fb22a7fc640 10 monclient: get_auth_request con 0x7fb218040110 auth_method 0 2024-09-13T10:30:19.704 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.686+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fb220017b50 con 0x7fb22c09cbd0 2024-09-13T10:30:19.704 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.686+0000 7fb2137fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:19.704 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.686+0000 7fb2137fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:19.866 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.864+0000 7fb2314d4640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:19.866 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.864+0000 7fb2314d4640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:19.866 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.864+0000 7fb2314d4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:19.866 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.864+0000 7fb2314d4640 1 -- 172.21.15.181:0/3360926953 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb22c0a2810 con 0x7fb22c09cbd0 2024-09-13T10:30:19.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.865+0000 7fb2137fe640 1 -- 172.21.15.181:0/3360926953 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9081 (unknown 1054498076 0 621844909) 0x7fb220017450 con 0x7fb22c09cbd0 2024-09-13T10:30:19.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.865+0000 7fb2137fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:19.867 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.865+0000 7fb2137fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:19.867 INFO:teuthology.misc.health.smithi181.stdout: 2024-09-13T10:30:19.867 INFO:teuthology.misc.health.smithi181.stdout:{"epoch":16,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","created":"2024-09-13T10:29:50.823515+0000","modified":"2024-09-13T10:30:16.718749+0000","last_up_change":"2024-09-13T10:30:13.707133+0000","last_in_change":"2024-09-13T10:30:04.743077+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T10:30:13.877061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"222eae7d-397c-40de-9975-11705817eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6804","nonce":3159017208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6805","nonce":3159017208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6807","nonce":3159017208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6806","nonce":3159017208}]},"public_addr":"172.21.15.181:6804/3159017208","cluster_addr":"172.21.15.181:6805/3159017208","heartbeat_back_addr":"172.21.15.181:6807/3159017208","heartbeat_front_addr":"172.21.15.181:6806/3159017208","state":["exists","up"]},{"osd":1,"uuid":"c241f0df-9ad4-42f4-809b-872d2c14bdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6800","nonce":3226877824}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6801","nonce":3226877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6803","nonce":3226877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6802","nonce":3226877824}]},"public_addr":"172.21.15.181:6800/3226877824","cluster_addr":"172.21.15.181:6801/3226877824","heartbeat_back_addr":"172.21.15.181:6803/3226877824","heartbeat_front_addr":"172.21.15.181:6802/3226877824","state":["exists","up"]},{"osd":2,"uuid":"efbff8a5-b42c-4e47-92e1-faf8ef9bec2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6808","nonce":3162343005}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6809","nonce":3162343005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6811","nonce":3162343005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6810","nonce":3162343005}]},"public_addr":"172.21.15.181:6808/3162343005","cluster_addr":"172.21.15.181:6809/3162343005","heartbeat_back_addr":"172.21.15.181:6811/3162343005","heartbeat_front_addr":"172.21.15.181:6810/3162343005","state":["exists","up"]},{"osd":3,"uuid":"11e6b317-e77c-4469-840a-a1d17e9eee86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6809","nonce":2152618500}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6810","nonce":2152618500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6812","nonce":2152618500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6811","nonce":2152618500}]},"public_addr":"172.21.15.195:6809/2152618500","cluster_addr":"172.21.15.195:6810/2152618500","heartbeat_back_addr":"172.21.15.195:6812/2152618500","heartbeat_front_addr":"172.21.15.195:6811/2152618500","state":["exists","up"]},{"osd":4,"uuid":"78cd8d74-5ffb-4116-aa73-e082ffd9adce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6805","nonce":1430589228}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6806","nonce":1430589228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6808","nonce":1430589228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6807","nonce":1430589228}]},"public_addr":"172.21.15.195:6805/1430589228","cluster_addr":"172.21.15.195:6806/1430589228","heartbeat_back_addr":"172.21.15.195:6808/1430589228","heartbeat_front_addr":"172.21.15.195:6807/1430589228","state":["exists","up"]},{"osd":5,"uuid":"ecb70959-b169-4fd8-958d-ac5b1d0a3c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6801","nonce":2714505324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6802","nonce":2714505324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6804","nonce":2714505324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6803","nonce":2714505324}]},"public_addr":"172.21.15.195:6801/2714505324","cluster_addr":"172.21.15.195:6802/2714505324","heartbeat_back_addr":"172.21.15.195:6804/2714505324","heartbeat_front_addr":"172.21.15.195:6803/2714505324","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.841016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.270575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.374446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.763765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.551366+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.985540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T10:30:19.869 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.867+0000 7fb2314d4640 1 -- 172.21.15.181:0/3360926953 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb218040110 legacy=0x7fb2180425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:19.869 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.867+0000 7fb2314d4640 10 monclient: shutdown 2024-09-13T10:30:19.869 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.867+0000 7fb2314d4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:19.869 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.867+0000 7fb2314d4640 1 -- 172.21.15.181:0/3360926953 >> v1:172.21.15.181:6791/0 conn(0x7fb22c09cbd0 legacy=0x7fb22c1ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:19.869 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.867+0000 7fb2314d4640 1 -- 172.21.15.181:0/3360926953 shutdown_connections 2024-09-13T10:30:19.869 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.867+0000 7fb2314d4640 1 -- 172.21.15.181:0/3360926953 >> 172.21.15.181:0/3360926953 conn(0x7fb22c0abb70 msgr2=0x7fb22c0a8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:19.869 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.867+0000 7fb2314d4640 1 -- 172.21.15.181:0/3360926953 shutdown_connections 2024-09-13T10:30:19.869 INFO:teuthology.misc.health.smithi181.stderr:2024-09-13T10:30:19.867+0000 7fb2314d4640 1 -- 172.21.15.181:0/3360926953 wait complete. 2024-09-13T10:30:19.879 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-09-13T10:30:19.879 INFO:tasks.ceph:Creating RBD pool 2024-09-13T10:30:19.879 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T10:30:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.974+0000 7f55dd153640 10 monclient: get_monmap_and_config 2024-09-13T10:30:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.974+0000 7f55dd153640 10 monclient: build_initial_monmap 2024-09-13T10:30:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.974+0000 7f55dd153640 10 monclient: monmap: 2024-09-13T10:30:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:19.974832+0000 2024-09-13T10:30:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:19.974832+0000 2024-09-13T10:30:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:19.979 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.974+0000 7f55dd153640 1 Processor -- start 2024-09-13T10:30:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.974+0000 7f55dd153640 1 -- start start 2024-09-13T10:30:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.974+0000 7f55dd153640 10 monclient: init 2024-09-13T10:30:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.975+0000 7f55dd153640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.975+0000 7f55dd153640 10 monclient: _add_conns ranks=[2,1,5,4,6,0,8,3,7] 2024-09-13T10:30:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.975+0000 7f55dd153640 10 monclient(hunting): picked mon.noname-b con 0x7f55d80a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.975+0000 7f55dd153640 10 monclient(hunting): picked mon.noname-f con 0x7f55d80a8220 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.975+0000 7f55dd153640 10 monclient(hunting): picked mon.noname-h con 0x7f55d80a71c0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.975+0000 7f55dd153640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d80a4ad0 con 0x7f55d80a8220 2024-09-13T10:30:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.975+0000 7f55dd153640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d806a130 con 0x7f55d80a66d0 2024-09-13T10:30:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.975+0000 7f55dd153640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d80a47f0 con 0x7f55d80a71c0 2024-09-13T10:30:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.975+0000 7f55dd153640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.975+0000 7f55dd153640 10 monclient(hunting): authenticate will time out at 759.480398s 2024-09-13T10:30:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.975+0000 7f55d6d9d640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f55d80a66d0 0x7f55d80a6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:35872/0 (socket says 172.21.15.181:35872) 2024-09-13T10:30:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.975+0000 7f55d6d9d640 1 -- 172.21.15.181:0/439948088 learned_addr learned my addr 172.21.15.181:0/439948088 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.977+0000 7f55d6d9d640 1 -- 172.21.15.181:0/439948088 >> v1:172.21.15.181:6790/0 conn(0x7f55d80a66d0 legacy=0x7f55d80a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.977+0000 7f55ce59c640 1 -- 172.21.15.181:0/439948088 >> v1:172.21.15.195:6789/0 conn(0x7f55d80a8220 legacy=0x7f55d813e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.977+0000 7f55d759e640 1 -- 172.21.15.181:0/439948088 >> v1:172.21.15.195:6791/0 conn(0x7f55d80a71c0 legacy=0x7f55d8141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.977+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 316075996 0 0) 0x7f55d806a130 con 0x7f55d80a66d0 2024-09-13T10:30:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.977+0000 7f55d659c640 10 monclient(hunting): _negotiate 2024-09-13T10:30:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.977+0000 7f55d659c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.977+0000 7f55d659c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.977+0000 7f55d659c640 10 monclient(hunting): my global_id is 4223 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.977+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55c4003520 con 0x7f55d80a66d0 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647670102 0 0) 0x7f55d80a4ad0 con 0x7f55d80a8220 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient(hunting): _negotiate 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient(hunting): my global_id is 54235 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55d806a130 con 0x7f55d80a8220 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048323874 0 0) 0x7f55d80a47f0 con 0x7f55d80a71c0 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient(hunting): _negotiate 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient(hunting): my global_id is 4253 2024-09-13T10:30:19.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55d80a4ad0 con 0x7f55d80a71c0 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1036496312 0 0) 0x7f55c4003520 con 0x7f55d80a66d0 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 >> v1:172.21.15.195:6791/0 conn(0x7f55d80a71c0 legacy=0x7f55d8141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 >> v1:172.21.15.195:6789/0 conn(0x7f55d80a8220 legacy=0x7f55d813e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient: _finish_hunting 0 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 1 monclient: found mon.noname-b 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d80a52f0 con 0x7f55d80a66d0 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient: _finish_auth 0 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient: _check_auth_tickets 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f55c8001ba0 con 0x7f55d80a66d0 2024-09-13T10:30:19.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient: dump: 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:19.989 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:19.990 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:19.990 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:19.990 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:19.990 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:19.990 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:19.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55dd153640 5 monclient: authenticate success, global_id 4223 2024-09-13T10:30:19.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55dd153640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:19.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55c80048a0 con 0x7f55d80a66d0 2024-09-13T10:30:19.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:19.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 1 -- 172.21.15.181:0/439948088 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f55c8004dd0 con 0x7f55d80a66d0 2024-09-13T10:30:19.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55dd153640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:19.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55dd153640 4 set_mon_vals no callback set 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55d659c640 10 monclient: dump: 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:19.991 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55dd153640 10 monclient: shutdown 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55dd153640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55dd153640 1 -- 172.21.15.181:0/439948088 >> v1:172.21.15.181:6790/0 conn(0x7f55d80a66d0 legacy=0x7f55d80a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55dd153640 1 -- 172.21.15.181:0/439948088 shutdown_connections 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55dd153640 1 -- 172.21.15.181:0/439948088 >> 172.21.15.181:0/439948088 conn(0x7f55d80abcd0 msgr2=0x7f55d80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55dd153640 1 -- 172.21.15.181:0/439948088 shutdown_connections 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.978+0000 7f55dd153640 1 -- 172.21.15.181:0/439948088 wait complete. 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.979+0000 7f55dd153640 10 monclient: build_initial_monmap 2024-09-13T10:30:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.979+0000 7f55dd153640 10 monclient: monmap: 2024-09-13T10:30:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:19.994 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.979+0000 7f55dd153640 1 Processor -- start 2024-09-13T10:30:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55dd153640 1 -- start start 2024-09-13T10:30:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55dd153640 10 monclient: init 2024-09-13T10:30:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55dd153640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55dd153640 10 monclient: _add_conns ranks=[2,3,4,6,8,1,0,7,5] 2024-09-13T10:30:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55dd153640 10 monclient(hunting): picked mon.noname-b con 0x7f55d80a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55dd153640 10 monclient(hunting): picked mon.noname-g con 0x7f55d80a71c0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55dd153640 10 monclient(hunting): picked mon.noname-c con 0x7f55d80a8220 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55dd153640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d8136cf0 con 0x7f55d80a66d0 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55dd153640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d81349b0 con 0x7f55d80a71c0 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55dd153640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d81357d0 con 0x7f55d80a8220 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55dd153640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55dd153640 10 monclient(hunting): authenticate will time out at 759.485554s 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55d6d9d640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f55d80a66d0 0x7f55d8133b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:35878/0 (socket says 172.21.15.181:35878) 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.980+0000 7f55d6d9d640 1 -- 172.21.15.181:0/437773822 learned_addr learned my addr 172.21.15.181:0/437773822 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55d6d9d640 1 -- 172.21.15.181:0/437773822 >> v1:172.21.15.181:6790/0 conn(0x7f55d80a66d0 legacy=0x7f55d8133b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55d759e640 1 -- 172.21.15.181:0/437773822 >> v1:172.21.15.181:6791/0 conn(0x7f55d80a8220 legacy=0x7f55d81d6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 343346465 0 0) 0x7f55d8136cf0 con 0x7f55d80a66d0 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55cffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55cffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55cffff640 10 monclient(hunting): my global_id is 4232 2024-09-13T10:30:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55b8003520 con 0x7f55d80a66d0 2024-09-13T10:30:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 725314080 0 0) 0x7f55d81357d0 con 0x7f55d80a8220 2024-09-13T10:30:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55cffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55cffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55cffff640 10 monclient(hunting): my global_id is 4261 2024-09-13T10:30:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.982+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55d8136cf0 con 0x7f55d80a8220 2024-09-13T10:30:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 685577985 0 0) 0x7f55d8136cf0 con 0x7f55d80a8220 2024-09-13T10:30:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55ce59c640 1 -- 172.21.15.181:0/437773822 >> v1:172.21.15.195:6790/0 conn(0x7f55d80a71c0 legacy=0x7f55d81342a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55d81357d0 con 0x7f55d80a8220 2024-09-13T10:30:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f55d0003990 con 0x7f55d80a8220 2024-09-13T10:30:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient(hunting): dump: 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:19.998 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 659472419 0 0) 0x7f55b8003520 con 0x7f55d80a66d0 2024-09-13T10:30:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55d8136cf0 con 0x7f55d80a66d0 2024-09-13T10:30:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f55c8001b60 con 0x7f55d80a66d0 2024-09-13T10:30:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient(hunting): dump: 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 817340267 0 0) 0x7f55d81357d0 con 0x7f55d80a8220 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 >> v1:172.21.15.195:6790/0 conn(0x7f55d80a71c0 legacy=0x7f55d81342a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 >> v1:172.21.15.181:6790/0 conn(0x7f55d80a66d0 legacy=0x7f55d8133b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 monclient: found mon.c 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d8137a00 con 0x7f55d80a8220 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient: _finish_auth 0 2024-09-13T10:30:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55dd153640 5 monclient: authenticate success, global_id 4261 2024-09-13T10:30:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55dd153640 10 monclient: _renew_subs 2024-09-13T10:30:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55dd153640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55dd153640 1 -- 172.21.15.181:0/437773822 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f55d8134c70 con 0x7f55d80a8220 2024-09-13T10:30:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55dd153640 10 monclient: _renew_subs 2024-09-13T10:30:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55dd153640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55dd153640 1 -- 172.21.15.181:0/437773822 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f55d80a1c10 con 0x7f55d80a8220 2024-09-13T10:30:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55d0003e90 con 0x7f55d80a8220 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f55d00043c0 con 0x7f55d80a8220 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55d5d9b640 4 set_mon_vals no callback set 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.983+0000 7f55cffff640 10 monclient: dump: 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.984+0000 7f55dd153640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.984+0000 7f55dd153640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.984+0000 7f55dd153640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.984+0000 7f55dd153640 1 -- 172.21.15.181:0/437773822 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55bc005080 con 0x7f55d80a8220 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.984+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f55d0004660 con 0x7f55d80a8220 2024-09-13T10:30:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.984+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(16..16 src has 1..16) ==== 3153+0+0 (unknown 3045190530 0 0) 0x7f55d004e260 con 0x7f55d80a8220 2024-09-13T10:30:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.984+0000 7f55d6d9d640 10 monclient: get_auth_request con 0x7f55b8040160 auth_method 0 2024-09-13T10:30:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.989+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f55d0017380 con 0x7f55d80a8220 2024-09-13T10:30:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.989+0000 7f55cffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:19.989+0000 7f55cffff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:20.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:20.164+0000 7f55dd153640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-09-13T10:30:20.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:20.164+0000 7f55dd153640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-09-13T10:30:20.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:20.164+0000 7f55dd153640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:20.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:20.164+0000 7f55dd153640 1 -- 172.21.15.181:0/437773822 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f55bc005c40 con 0x7f55d80a8220 2024-09-13T10:30:21.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.724+0000 7f55cffff640 1 -- 172.21.15.181:0/437773822 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) ==== 109+0+0 (unknown 1910661782 0 0) 0x7f55d0020530 con 0x7f55d80a8220 2024-09-13T10:30:21.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.724+0000 7f55cffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-09-13T10:30:21.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.724+0000 7f55cffff640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2024-09-13T10:30:21.727 INFO:teuthology.orchestra.run.smithi181.stderr:pool 'rbd' created 2024-09-13T10:30:21.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.728+0000 7f55dd153640 1 -- 172.21.15.181:0/437773822 >> v1:172.21.15.195:6800/1839191919 conn(0x7f55b8040160 legacy=0x7f55b8042620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:21.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.728+0000 7f55dd153640 10 monclient: shutdown 2024-09-13T10:30:21.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.728+0000 7f55dd153640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:21.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.728+0000 7f55dd153640 1 -- 172.21.15.181:0/437773822 >> v1:172.21.15.181:6791/0 conn(0x7f55d80a8220 legacy=0x7f55d81d6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:21.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.728+0000 7f55dd153640 1 -- 172.21.15.181:0/437773822 shutdown_connections 2024-09-13T10:30:21.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.728+0000 7f55dd153640 1 -- 172.21.15.181:0/437773822 >> 172.21.15.181:0/437773822 conn(0x7f55d80abcd0 msgr2=0x7f55d80a9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:21.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.728+0000 7f55dd153640 1 -- 172.21.15.181:0/437773822 shutdown_connections 2024-09-13T10:30:21.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.728+0000 7f55dd153640 1 -- 172.21.15.181:0/437773822 wait complete. 2024-09-13T10:30:21.742 DEBUG:teuthology.orchestra.run.smithi181:> rbd --cluster ceph pool init rbd 2024-09-13T10:30:21.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.830+0000 7fbf9e851f00 10 monclient: get_monmap_and_config 2024-09-13T10:30:21.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.830+0000 7fbf9e851f00 10 monclient: build_initial_monmap 2024-09-13T10:30:21.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.830+0000 7fbf9e851f00 10 monclient: monmap: 2024-09-13T10:30:21.831 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:21.830695+0000 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:21.830695+0000 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:21.832 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:21.833 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:21.833 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:21.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.830+0000 7fbf9e851f00 1 Processor -- start 2024-09-13T10:30:21.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.830+0000 7fbf9e851f00 1 -- start start 2024-09-13T10:30:21.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.830+0000 7fbf9e851f00 10 monclient: init 2024-09-13T10:30:21.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.831+0000 7fbf9e851f00 10 monclient: _reopen_session rank -1 2024-09-13T10:30:21.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.831+0000 7fbf9e851f00 10 monclient: _add_conns ranks=[7,5,2,8,6,3,4,1,0] 2024-09-13T10:30:21.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.831+0000 7fbf9e851f00 10 monclient(hunting): picked mon.noname-i con 0x55ea746b5c70 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:21.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.831+0000 7fbf9e851f00 10 monclient(hunting): picked mon.noname-h con 0x55ea746b6760 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:21.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.831+0000 7fbf9e851f00 10 monclient(hunting): picked mon.noname-b con 0x55ea746b88c0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:21.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.831+0000 7fbf9e851f00 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55ea74515fe0 con 0x55ea746b88c0 2024-09-13T10:30:21.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.831+0000 7fbf9e851f00 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55ea7451ef30 con 0x55ea746b6760 2024-09-13T10:30:21.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.831+0000 7fbf9e851f00 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55ea745040c0 con 0x55ea746b5c70 2024-09-13T10:30:21.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.831+0000 7fbf9e851f00 10 monclient(hunting): _renew_subs 2024-09-13T10:30:21.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.831+0000 7fbf9e851f00 10 monclient(hunting): authenticate will time out at 761.336375s 2024-09-13T10:30:21.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.831+0000 7fbf9e5a1640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x55ea746b88c0 0x55ea74754b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:35892/0 (socket says 172.21.15.181:35892) 2024-09-13T10:30:21.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.831+0000 7fbf9e5a1640 1 -- 172.21.15.181:0/67496589 learned_addr learned my addr 172.21.15.181:0/67496589 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf9e5a1640 1 -- 172.21.15.181:0/67496589 >> v1:172.21.15.181:6790/0 conn(0x55ea746b88c0 legacy=0x55ea74754b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf9cb3e640 1 -- 172.21.15.181:0/67496589 >> v1:172.21.15.195:6791/0 conn(0x55ea746b6760 legacy=0x55ea747513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716870542 0 0) 0x55ea74515fe0 con 0x55ea746b88c0 2024-09-13T10:30:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf8ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf8ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf8ffff640 10 monclient(hunting): my global_id is 4241 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf9d33f640 1 -- 172.21.15.181:0/67496589 >> v1:172.21.15.195:6792/0 conn(0x55ea746b5c70 legacy=0x55ea746b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf84001e10 con 0x55ea746b88c0 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3441862092 0 0) 0x55ea7451ef30 con 0x55ea746b6760 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf8ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf8ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.833+0000 7fbf8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient(hunting): my global_id is 4262 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55ea74515fe0 con 0x55ea746b6760 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946628494 0 0) 0x55ea745040c0 con 0x55ea746b5c70 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient(hunting): my global_id is 54214 2024-09-13T10:30:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55ea7451ef30 con 0x55ea746b5c70 2024-09-13T10:30:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2147999081 0 0) 0x7fbf84001e10 con 0x55ea746b88c0 2024-09-13T10:30:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 >> v1:172.21.15.195:6792/0 conn(0x55ea746b5c70 legacy=0x55ea746b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 >> v1:172.21.15.195:6791/0 conn(0x55ea746b6760 legacy=0x55ea747513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 1 monclient: found mon.noname-b 2024-09-13T10:30:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea746b7b90 con 0x55ea746b88c0 2024-09-13T10:30:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient: _finish_auth 0 2024-09-13T10:30:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf90001e60 con 0x55ea746b88c0 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf9e851f00 5 monclient: authenticate success, global_id 4241 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf9e851f00 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient: dump: 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf9e851f00 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbf90003510 con 0x55ea746b88c0 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 1 -- 172.21.15.181:0/67496589 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf90003a80 con 0x55ea746b88c0 2024-09-13T10:30:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf9e851f00 10 monclient: get_monmap_and_config success 2024-09-13T10:30:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf9e851f00 4 set_mon_vals no callback set 2024-09-13T10:30:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf8ffff640 10 monclient: dump: 2024-09-13T10:30:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf9e851f00 10 monclient: shutdown 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf9e851f00 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf9e851f00 1 -- 172.21.15.181:0/67496589 >> v1:172.21.15.181:6790/0 conn(0x55ea746b88c0 legacy=0x55ea74754b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf9e851f00 1 -- 172.21.15.181:0/67496589 shutdown_connections 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf9e851f00 1 -- 172.21.15.181:0/67496589 >> 172.21.15.181:0/67496589 conn(0x55ea746bb270 msgr2=0x55ea746bb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf9e851f00 1 -- 172.21.15.181:0/67496589 shutdown_connections 2024-09-13T10:30:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.834+0000 7fbf9e851f00 1 -- 172.21.15.181:0/67496589 wait complete. 2024-09-13T10:30:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.835+0000 7fbf9e851f00 10 monclient: build_initial_monmap 2024-09-13T10:30:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.835+0000 7fbf9e851f00 10 monclient: monmap: 2024-09-13T10:30:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:21.852 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:21.852 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:21.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.835+0000 7fbf9e851f00 1 Processor -- start 2024-09-13T10:30:21.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.835+0000 7fbf9e851f00 1 -- start start 2024-09-13T10:30:21.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.835+0000 7fbf9e851f00 10 monclient: init 2024-09-13T10:30:21.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9e851f00 10 monclient: _reopen_session rank -1 2024-09-13T10:30:21.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9e851f00 10 monclient: _add_conns ranks=[6,0,4,2,3,7,5,8,1] 2024-09-13T10:30:21.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9e851f00 10 monclient(hunting): picked mon.noname-d con 0x55ea746b5c70 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:21.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9e851f00 10 monclient(hunting): picked mon.noname-a con 0x55ea746b6760 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:21.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9e851f00 10 monclient(hunting): picked mon.noname-c con 0x55ea746b88c0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:21.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9e851f00 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55ea7469cab0 con 0x55ea746b6760 2024-09-13T10:30:21.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9e851f00 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55ea7473e250 con 0x55ea746b88c0 2024-09-13T10:30:21.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9e851f00 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55ea7473e530 con 0x55ea746b5c70 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9e851f00 10 monclient(hunting): _renew_subs 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9e851f00 10 monclient(hunting): authenticate will time out at 761.341143s 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9d33f640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x55ea746b5c70 0x55ea7473a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:40514/0 (socket says 172.21.15.181:40514) 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9cb3e640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x55ea746b6760 0x55ea7473adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:45206/0 (socket says 172.21.15.181:45206) 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.836+0000 7fbf9d33f640 1 -- 172.21.15.181:0/692257502 learned_addr learned my addr 172.21.15.181:0/692257502 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf9d33f640 1 -- 172.21.15.181:0/692257502 >> v1:172.21.15.181:6792/0 conn(0x55ea746b5c70 legacy=0x55ea7473a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf9cb3e640 1 -- 172.21.15.181:0/692257502 >> v1:172.21.15.181:6789/0 conn(0x55ea746b6760 legacy=0x55ea7473adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf9e5a1640 1 -- 172.21.15.181:0/692257502 >> v1:172.21.15.181:6791/0 conn(0x55ea746b88c0 legacy=0x55ea74765310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 33781954 0 0) 0x55ea7473e250 con 0x55ea746b88c0 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): my global_id is 4270 2024-09-13T10:30:21.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf7c001e10 con 0x55ea746b88c0 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3825367670 0 0) 0x55ea74515fe0 con 0x55ea746b6760 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): my global_id is 54207 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55ea7473e250 con 0x55ea746b6760 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2947072170 0 0) 0x7fbf7c001e10 con 0x55ea746b88c0 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55ea74515fe0 con 0x55ea746b88c0 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf900020b0 con 0x55ea746b88c0 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): dump: 2024-09-13T10:30:21.855 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:21.857 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1126184487 0 0) 0x55ea7473e250 con 0x55ea746b6760 2024-09-13T10:30:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf7c001e10 con 0x55ea746b6760 2024-09-13T10:30:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf88001f00 con 0x55ea746b6760 2024-09-13T10:30:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.838+0000 7fbf8d7fa640 10 monclient(hunting): dump: 2024-09-13T10:30:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2198284574 0 0) 0x55ea74515fe0 con 0x55ea746b88c0 2024-09-13T10:30:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 >> v1:172.21.15.181:6792/0 conn(0x55ea746b5c70 legacy=0x55ea7473a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 >> v1:172.21.15.181:6789/0 conn(0x55ea746b6760 legacy=0x55ea7473adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:30:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 1 monclient: found mon.c 2024-09-13T10:30:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea7473d4b0 con 0x55ea746b88c0 2024-09-13T10:30:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 10 monclient: _finish_auth 0 2024-09-13T10:30:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:30:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf9e851f00 5 monclient: authenticate success, global_id 4270 2024-09-13T10:30:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf9e851f00 10 monclient: _renew_subs 2024-09-13T10:30:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf9e851f00 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x55ea7473c1d0 con 0x55ea746b88c0 2024-09-13T10:30:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf9e851f00 10 monclient: _renew_subs 2024-09-13T10:30:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf9e851f00 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x55ea7473cfd0 con 0x55ea746b88c0 2024-09-13T10:30:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbf90001ea0 con 0x55ea746b88c0 2024-09-13T10:30:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf90003ff0 con 0x55ea746b88c0 2024-09-13T10:30:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8d7fa640 10 monclient: dump: 2024-09-13T10:30:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:21.864 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.839+0000 7fbf8f7fe640 4 set_mon_vals no callback set 2024-09-13T10:30:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.840+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fbf90010670 con 0x55ea746b88c0 2024-09-13T10:30:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.840+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(17..17 src has 1..17) ==== 3495+0+0 (unknown 2592264291 0 0) 0x7fbf9004ce80 con 0x55ea746b88c0 2024-09-13T10:30:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.840+0000 7fbf9e851f00 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-09-13T10:30:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.840+0000 7fbf9e851f00 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-09-13T10:30:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.840+0000 7fbf9e851f00 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.840+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55ea74766a30 con 0x55ea746b88c0 2024-09-13T10:30:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:21.840+0000 7fbf9d33f640 10 monclient: get_auth_request con 0x7fbf7c03ea70 auth_method 0 2024-09-13T10:30:22.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.816+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v18) ==== 141+0+0 (unknown 660702925 0 0) 0x55ea746b7b90 con 0x55ea746b88c0 2024-09-13T10:30:22.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.816+0000 7fbf8d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-09-13T10:30:22.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.816+0000 7fbf8d7fa640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2024-09-13T10:30:22.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.818+0000 7fbf9e851f00 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:22.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.818+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fbf90003510 con 0x55ea746b88c0 2024-09-13T10:30:22.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.820+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7fbf90015c50 con 0x55ea746b88c0 2024-09-13T10:30:22.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.821+0000 7fbf8d7fa640 10 monclient: handle_get_version_reply finishing 1 version 18 2024-09-13T10:30:22.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.821+0000 7fbf8f7fe640 10 monclient: _renew_subs 2024-09-13T10:30:22.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.821+0000 7fbf8f7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:22.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.821+0000 7fbf8f7fe640 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=18}) -- 0x7fbf74002bc0 con 0x55ea746b88c0 2024-09-13T10:30:22.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.821+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 11 ==== osd_map(18..18 src has 1..18) ==== 674+0+0 (unknown 3497570909 0 0) 0x7fbf900160e0 con 0x55ea746b88c0 2024-09-13T10:30:22.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.821+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6800/3226877824 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x55ea7476b240 con 0x55ea74767730 2024-09-13T10:30:22.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.821+0000 7fbf9cb3e640 10 monclient: get_auth_request con 0x55ea74767730 auth_method 0 2024-09-13T10:30:22.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.830+0000 7fbf9cb3e640 1 -- 172.21.15.181:0/692257502 <== osd.1 v1:172.21.15.181:6800/3226877824 1 ==== osd_op_reply(1 rbd_trash [create] v18'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 785457554 0 0) 0x7fbf880023d0 con 0x55ea74767730 2024-09-13T10:30:22.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.833+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6804/3159017208 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x55ea747c19b0 con 0x55ea747bddb0 2024-09-13T10:30:22.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.833+0000 7fbf9d33f640 10 monclient: get_auth_request con 0x55ea747bddb0 auth_method 0 2024-09-13T10:30:22.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.838+0000 7fbf9d33f640 1 -- 172.21.15.181:0/692257502 <== osd.0 v1:172.21.15.181:6804/3159017208 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1898125418 0 0) 0x7fbf940060d0 con 0x55ea747bddb0 2024-09-13T10:30:22.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.838+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6804/3159017208 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x55ea747bc840 con 0x55ea747bddb0 2024-09-13T10:30:22.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.838+0000 7fbf9d33f640 1 -- 172.21.15.181:0/692257502 <== osd.0 v1:172.21.15.181:6804/3159017208 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1886642790 0 0) 0x7fbf940060d0 con 0x55ea747bddb0 2024-09-13T10:30:22.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.838+0000 7fbf8f7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:22.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:22.838+0000 7fbf8f7fe640 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6791/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fbf740040e0 con 0x55ea746b88c0 2024-09-13T10:30:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:23.826+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 12 ==== pool_op_reply(tid 4 (0) Success v19) ==== 55+0+0 (unknown 1200620522 0 0) 0x7fbf90016580 con 0x55ea746b88c0 2024-09-13T10:30:23.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:23.826+0000 7fbf8d7fa640 10 monclient: _renew_subs 2024-09-13T10:30:23.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:23.826+0000 7fbf8d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:23.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:23.826+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=19}) -- 0x55ea74515fe0 con 0x55ea746b88c0 2024-09-13T10:30:23.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:23.827+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 13 ==== osd_map(19..19 src has 1..19) ==== 626+0+0 (unknown 2402762099 0 0) 0x7fbf90013e30 con 0x55ea746b88c0 2024-09-13T10:30:23.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:23.827+0000 7fbf8effd640 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6804/3159017208 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7fbf78003770 con 0x55ea747bddb0 2024-09-13T10:30:23.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:23.832+0000 7fbf9d33f640 1 -- 172.21.15.181:0/692257502 <== osd.0 v1:172.21.15.181:6804/3159017208 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v19'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 1570664900 0 0) 0x7fbf940060d0 con 0x55ea747bddb0 2024-09-13T10:30:23.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:23.833+0000 7fbf8f7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:23.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:23.833+0000 7fbf8f7fe640 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6791/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v19) -- 0x7fbf740042d0 con 0x55ea746b88c0 2024-09-13T10:30:24.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.838+0000 7fbf83fff640 10 monclient: tick 2024-09-13T10:30:24.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.838+0000 7fbf83fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:24.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.838+0000 7fbf83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:24.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.838+0000 7fbf83fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:24.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.839+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 14 ==== pool_op_reply(tid 6 (0) Success v20) ==== 43+0+0 (unknown 1237163072 0 0) 0x7fbf90015e80 con 0x55ea746b88c0 2024-09-13T10:30:24.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.839+0000 7fbf8d7fa640 10 monclient: _renew_subs 2024-09-13T10:30:24.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.839+0000 7fbf8d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:24.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.839+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=20}) -- 0x55ea7473e250 con 0x55ea746b88c0 2024-09-13T10:30:24.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.839+0000 7fbf8d7fa640 1 -- 172.21.15.181:0/692257502 <== mon.4 v1:172.21.15.181:6791/0 15 ==== osd_map(20..20 src has 1..20) ==== 654+0+0 (unknown 4084741890 0 0) 0x7fbf90014030 con 0x55ea746b88c0 2024-09-13T10:30:24.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.839+0000 7fbf8effd640 1 -- 172.21.15.181:0/692257502 --> v1:172.21.15.181:6804/3159017208 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20) -- 0x7fbf78004d60 con 0x55ea747bddb0 2024-09-13T10:30:24.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.845+0000 7fbf9d33f640 1 -- 172.21.15.181:0/692257502 <== osd.0 v1:172.21.15.181:6804/3159017208 4 ==== osd_op_reply(7 rbd_info [write 0~19] v20'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 1721084249 0 0) 0x7fbf940060d0 con 0x55ea747bddb0 2024-09-13T10:30:24.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.845+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 >> v1:172.21.15.181:6804/3159017208 conn(0x55ea747bddb0 legacy=0x55ea747c0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:24.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.845+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 >> v1:172.21.15.181:6800/3226877824 conn(0x55ea74767730 legacy=0x55ea74769b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:24.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.846+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 >> v1:172.21.15.195:6800/1839191919 conn(0x7fbf7c03ea70 legacy=0x7fbf7c040f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:24.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.846+0000 7fbf9e851f00 10 monclient: shutdown 2024-09-13T10:30:24.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.846+0000 7fbf9e851f00 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:24.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.846+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 >> v1:172.21.15.181:6791/0 conn(0x55ea746b88c0 legacy=0x55ea74765310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:24.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.846+0000 7fbf9e5a1640 1 -- 172.21.15.181:0/692257502 reap_dead start 2024-09-13T10:30:24.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.846+0000 7fbf9e5a1640 1 -- 172.21.15.181:0/692257502 reap_dead start 2024-09-13T10:30:24.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.846+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 shutdown_connections 2024-09-13T10:30:24.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.846+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 >> 172.21.15.181:0/692257502 conn(0x55ea746bb270 msgr2=0x55ea746bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:24.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.846+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 shutdown_connections 2024-09-13T10:30:24.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.846+0000 7fbf9e851f00 1 -- 172.21.15.181:0/692257502 wait complete. 2024-09-13T10:30:24.851 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T10:30:24.852 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-13T10:30:24.852 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T10:30:24.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.954+0000 7f9a17423640 10 monclient: get_monmap_and_config 2024-09-13T10:30:24.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.954+0000 7f9a17423640 10 monclient: build_initial_monmap 2024-09-13T10:30:24.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.954+0000 7f9a17423640 10 monclient: monmap: 2024-09-13T10:30:24.956 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:24.956 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:24.956 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:24.955408+0000 2024-09-13T10:30:24.956 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:24.955408+0000 2024-09-13T10:30:24.956 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:24.957 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:24.957 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:24.957 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:24.957 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:24.957 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:24.957 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:24.957 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:24.957 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:24.957 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:24.957 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:24.957 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:24.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.955+0000 7f9a17423640 1 Processor -- start 2024-09-13T10:30:24.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.955+0000 7f9a17423640 1 -- start start 2024-09-13T10:30:24.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.955+0000 7f9a17423640 10 monclient: init 2024-09-13T10:30:24.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a17423640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:24.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a17423640 10 monclient: _add_conns ranks=[4,8,1,0,5,7,2,6,3] 2024-09-13T10:30:24.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a17423640 10 monclient(hunting): picked mon.noname-c con 0x7f9a100a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:24.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a17423640 10 monclient(hunting): picked mon.noname-e con 0x7f9a100a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:24.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a17423640 10 monclient(hunting): picked mon.noname-f con 0x7f9a1013f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:24.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a17423640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a100a4bc0 con 0x7f9a1013f750 2024-09-13T10:30:24.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a17423640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1013a320 con 0x7f9a100a6640 2024-09-13T10:30:24.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a17423640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a100a8100 con 0x7f9a100a8340 2024-09-13T10:30:24.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a17423640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:24.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a17423640 10 monclient(hunting): authenticate will time out at 764.461206s 2024-09-13T10:30:24.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a151bf640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f9a100a6640 0x7f9a10139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38330/0 (socket says 172.21.15.181:38330) 2024-09-13T10:30:24.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a151bf640 1 -- 172.21.15.181:0/2450762695 learned_addr learned my addr 172.21.15.181:0/2450762695 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:24.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.956+0000 7f9a149be640 1 --1- 172.21.15.181:0/2450762695 >> v1:172.21.15.181:6793/0 conn(0x7f9a100a8340 0x7f9a10139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39716/0 (socket says 172.21.15.181:39716) 2024-09-13T10:30:24.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a149be640 1 -- 172.21.15.181:0/2450762695 >> v1:172.21.15.181:6793/0 conn(0x7f9a100a8340 legacy=0x7f9a10139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:24.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a151bf640 1 -- 172.21.15.181:0/2450762695 >> v1:172.21.15.181:6791/0 conn(0x7f9a100a6640 legacy=0x7f9a10139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:24.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a159c0640 1 -- 172.21.15.181:0/2450762695 >> v1:172.21.15.195:6789/0 conn(0x7f9a1013f750 legacy=0x7f9a10141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:24.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 85777144 0 0) 0x7f9a100a8100 con 0x7f9a100a8340 2024-09-13T10:30:24.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:24.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:24.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 10 monclient(hunting): my global_id is 4202 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99fc003520 con 0x7f9a100a8340 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 730533524 0 0) 0x7f9a100a4bc0 con 0x7f9a1013f750 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 10 monclient(hunting): my global_id is 54244 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a100a8100 con 0x7f9a1013f750 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576802664 0 0) 0x7f9a1013a320 con 0x7f9a100a6640 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:24.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 10 monclient(hunting): my global_id is 4279 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.958+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a100a4bc0 con 0x7f9a100a6640 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1662510954 0 0) 0x7f99fc003520 con 0x7f9a100a8340 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 >> v1:172.21.15.181:6791/0 conn(0x7f9a100a6640 legacy=0x7f9a10139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 >> v1:172.21.15.195:6789/0 conn(0x7f9a1013f750 legacy=0x7f9a10141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 1 monclient: found mon.noname-e 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a100a48e0 con 0x7f9a100a8340 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:24.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9a00001ae0 con 0x7f9a100a8340 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a17423640 5 monclient: authenticate success, global_id 4202 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a17423640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 10 monclient: dump: 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:24.967 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a17423640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a000047e0 con 0x7f9a100a8340 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a17423640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 1 -- 172.21.15.181:0/2450762695 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9a00004d50 con 0x7f9a100a8340 2024-09-13T10:30:24.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a17423640 4 set_mon_vals no callback set 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a07fff640 10 monclient: dump: 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:24.969 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a17423640 10 monclient: shutdown 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a17423640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a17423640 1 -- 172.21.15.181:0/2450762695 >> v1:172.21.15.181:6793/0 conn(0x7f9a100a8340 legacy=0x7f9a10139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a17423640 1 -- 172.21.15.181:0/2450762695 shutdown_connections 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a17423640 1 -- 172.21.15.181:0/2450762695 >> 172.21.15.181:0/2450762695 conn(0x7f9a10077170 msgr2=0x7f9a100abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a17423640 1 -- 172.21.15.181:0/2450762695 shutdown_connections 2024-09-13T10:30:24.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.959+0000 7f9a17423640 1 -- 172.21.15.181:0/2450762695 wait complete. 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.960+0000 7f9a17423640 10 monclient: build_initial_monmap 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.960+0000 7f9a17423640 10 monclient: monmap: 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:24.971 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.960+0000 7f9a17423640 1 Processor -- start 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.960+0000 7f9a17423640 1 -- start start 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.960+0000 7f9a17423640 10 monclient: init 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.961+0000 7f9a17423640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.961+0000 7f9a17423640 10 monclient: _add_conns ranks=[3,4,5,2,1,6,8,7,0] 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.961+0000 7f9a17423640 10 monclient(hunting): picked mon.noname-g con 0x7f9a100a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.961+0000 7f9a17423640 10 monclient(hunting): picked mon.noname-c con 0x7f9a1013f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:24.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.961+0000 7f9a17423640 10 monclient(hunting): picked mon.noname-h con 0x7f9a101d4730 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:24.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.961+0000 7f9a17423640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a100a1260 con 0x7f9a100a8340 2024-09-13T10:30:24.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.961+0000 7f9a17423640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a100a1540 con 0x7f9a1013f750 2024-09-13T10:30:24.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.961+0000 7f9a17423640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a10139310 con 0x7f9a101d4730 2024-09-13T10:30:24.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.961+0000 7f9a17423640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:24.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.961+0000 7f9a17423640 10 monclient(hunting): authenticate will time out at 764.466283s 2024-09-13T10:30:24.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.961+0000 7f9a149be640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f9a1013f750 0x7f9a10138c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38342/0 (socket says 172.21.15.181:38342) 2024-09-13T10:30:24.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.961+0000 7f9a149be640 1 -- 172.21.15.181:0/3247482718 learned_addr learned my addr 172.21.15.181:0/3247482718 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:24.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a149be640 1 -- 172.21.15.181:0/3247482718 >> v1:172.21.15.181:6791/0 conn(0x7f9a1013f750 legacy=0x7f9a10138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:24.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a159c0640 1 -- 172.21.15.181:0/3247482718 >> v1:172.21.15.195:6791/0 conn(0x7f9a101d4730 legacy=0x7f9a101d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:24.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a151bf640 1 -- 172.21.15.181:0/3247482718 >> v1:172.21.15.195:6790/0 conn(0x7f9a100a8340 legacy=0x7f9a101384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:24.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1991077367 0 0) 0x7f9a100a1540 con 0x7f9a1013f750 2024-09-13T10:30:24.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:24.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:24.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:24.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): my global_id is 4288 2024-09-13T10:30:24.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99f4003550 con 0x7f9a1013f750 2024-09-13T10:30:24.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041651412 0 0) 0x7f9a10139310 con 0x7f9a101d4730 2024-09-13T10:30:24.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:24.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:24.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:24.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): my global_id is 4271 2024-09-13T10:30:24.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a100a1540 con 0x7f9a101d4730 2024-09-13T10:30:24.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4032383337 0 0) 0x7f9a100a1260 con 0x7f9a100a8340 2024-09-13T10:30:24.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:24.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:24.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:24.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): my global_id is 4233 2024-09-13T10:30:24.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a10139310 con 0x7f9a100a8340 2024-09-13T10:30:24.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1470123547 0 0) 0x7f99f4003550 con 0x7f9a1013f750 2024-09-13T10:30:24.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a100a1260 con 0x7f9a1013f750 2024-09-13T10:30:24.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9a00004cd0 con 0x7f9a1013f750 2024-09-13T10:30:24.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:24.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:24.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:24.978 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:24.979 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:24.980 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:24.980 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:24.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:24.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.963+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 779348398 0 0) 0x7f9a100a1260 con 0x7f9a1013f750 2024-09-13T10:30:24.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 >> v1:172.21.15.195:6791/0 conn(0x7f9a101d4730 legacy=0x7f9a101d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:24.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 >> v1:172.21.15.195:6790/0 conn(0x7f9a100a8340 legacy=0x7f9a101384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:24.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:24.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 1 monclient: found mon.c 2024-09-13T10:30:24.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:24.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:24.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a100a2a20 con 0x7f9a1013f750 2024-09-13T10:30:24.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:24.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:24.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:24.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a17423640 5 monclient: authenticate success, global_id 4288 2024-09-13T10:30:24.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a17423640 10 monclient: _renew_subs 2024-09-13T10:30:24.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a17423640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:24.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a17423640 1 -- 172.21.15.181:0/3247482718 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1009fd40 con 0x7f9a1013f750 2024-09-13T10:30:24.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a00001a80 con 0x7f9a1013f750 2024-09-13T10:30:24.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:24.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9a00005680 con 0x7f9a1013f750 2024-09-13T10:30:24.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:24.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:24.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 10 monclient: dump: 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:24.982 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:24.983 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:24.983 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:24.983 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:24.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a077fe640 4 set_mon_vals no callback set 2024-09-13T10:30:24.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a17423640 10 monclient: _renew_subs 2024-09-13T10:30:24.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a17423640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:24.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a17423640 1 -- 172.21.15.181:0/3247482718 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a1009f1e0 con 0x7f9a1013f750 2024-09-13T10:30:24.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.964+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9a00011d00 con 0x7f9a1013f750 2024-09-13T10:30:24.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.965+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f9a0004e1a0 con 0x7f9a1013f750 2024-09-13T10:30:24.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.965+0000 7f9a17423640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:24.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.965+0000 7f9a17423640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:24.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.965+0000 7f9a17423640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:24.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.965+0000 7f9a17423640 1 -- 172.21.15.181:0/3247482718 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a100aa190 con 0x7f9a1013f750 2024-09-13T10:30:24.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.965+0000 7f9a151bf640 10 monclient: get_auth_request con 0x7f99f403fd80 auth_method 0 2024-09-13T10:30:24.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.969+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f9a100aa190 con 0x7f9a1013f750 2024-09-13T10:30:24.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.969+0000 7f9a05ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:24.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:24.969+0000 7f9a05ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:25.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.149+0000 7f9a17423640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2024-09-13T10:30:25.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.149+0000 7f9a17423640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2024-09-13T10:30:25.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.149+0000 7f9a17423640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:25.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.149+0000 7f9a17423640 1 -- 172.21.15.181:0/3247482718 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f9a100a1cd0 con 0x7f9a1013f750 2024-09-13T10:30:25.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.149+0000 7f9a05ffb640 1 -- 172.21.15.181:0/3247482718 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+160 (unknown 882900978 0 1146284992) 0x7f9a00017780 con 0x7f9a1013f750 2024-09-13T10:30:25.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.149+0000 7f9a05ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2024-09-13T10:30:25.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.149+0000 7f9a05ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:25.151 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:30:25.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.152+0000 7f9a17423640 1 -- 172.21.15.181:0/3247482718 >> v1:172.21.15.195:6800/1839191919 conn(0x7f99f403fd80 legacy=0x7f99f4042240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.152+0000 7f9a17423640 10 monclient: shutdown 2024-09-13T10:30:25.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.152+0000 7f9a17423640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:25.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.152+0000 7f9a17423640 1 -- 172.21.15.181:0/3247482718 >> v1:172.21.15.181:6791/0 conn(0x7f9a1013f750 legacy=0x7f9a10138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.152+0000 7f9a17423640 1 -- 172.21.15.181:0/3247482718 shutdown_connections 2024-09-13T10:30:25.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.152+0000 7f9a17423640 1 -- 172.21.15.181:0/3247482718 >> 172.21.15.181:0/3247482718 conn(0x7f9a100a6640 msgr2=0x7f9a100aa390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:25.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.152+0000 7f9a17423640 1 -- 172.21.15.181:0/3247482718 shutdown_connections 2024-09-13T10:30:25.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.152+0000 7f9a17423640 1 -- 172.21.15.181:0/3247482718 wait complete. 2024-09-13T10:30:25.163 INFO:teuthology.orchestra.run.smithi181.stdout:[{"version":5,"timestamp":"2024-09-13T10:30:13.123443+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"13897.783792"}]}] 2024-09-13T10:30:25.164 INFO:tasks.ceph_manager:config epoch is 5 2024-09-13T10:30:25.164 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T10:30:25.164 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T10:30:25.164 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T10:30:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.259+0000 7f09ed91e640 10 monclient: get_monmap_and_config 2024-09-13T10:30:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.259+0000 7f09ed91e640 10 monclient: build_initial_monmap 2024-09-13T10:30:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.259+0000 7f09ed91e640 10 monclient: monmap: 2024-09-13T10:30:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:25.260251+0000 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:25.260251+0000 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 1 Processor -- start 2024-09-13T10:30:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 1 -- start start 2024-09-13T10:30:25.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 10 monclient: init 2024-09-13T10:30:25.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 10 monclient: _add_conns ranks=[4,1,7,3,5,6,0,2,8] 2024-09-13T10:30:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 10 monclient(hunting): picked mon.noname-c con 0x7f09e80a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 10 monclient(hunting): picked mon.noname-f con 0x7f09e80a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 10 monclient(hunting): picked mon.noname-i con 0x7f09e813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e80a5fe0 con 0x7f09e80a6ab0 2024-09-13T10:30:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e80a8080 con 0x7f09e80a66d0 2024-09-13T10:30:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e80a42c0 con 0x7f09e813f9a0 2024-09-13T10:30:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09ed91e640 10 monclient(hunting): authenticate will time out at 764.765769s 2024-09-13T10:30:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09e6ffd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f09e80a66d0 0x7f09e80a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38346/0 (socket says 172.21.15.181:38346) 2024-09-13T10:30:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.260+0000 7f09e6ffd640 1 -- 172.21.15.181:0/1631382730 learned_addr learned my addr 172.21.15.181:0/1631382730 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:25.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e6ffd640 1 -- 172.21.15.181:0/1631382730 >> v1:172.21.15.181:6791/0 conn(0x7f09e80a66d0 legacy=0x7f09e80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 1 -- 172.21.15.181:0/1631382730 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108557394 0 0) 0x7f09e80a8080 con 0x7f09e80a66d0 2024-09-13T10:30:25.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient(hunting): my global_id is 4297 2024-09-13T10:30:25.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 1 -- 172.21.15.181:0/1631382730 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09d4003520 con 0x7f09e80a66d0 2024-09-13T10:30:25.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e77fe640 1 -- 172.21.15.181:0/1631382730 >> v1:172.21.15.195:6792/0 conn(0x7f09e813f9a0 legacy=0x7f09e8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09de7fc640 1 -- 172.21.15.181:0/1631382730 >> v1:172.21.15.195:6789/0 conn(0x7f09e80a6ab0 legacy=0x7f09e80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 1 -- 172.21.15.181:0/1631382730 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1357974462 0 0) 0x7f09d4003520 con 0x7f09e80a66d0 2024-09-13T10:30:25.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 1 -- 172.21.15.181:0/1631382730 >> v1:172.21.15.195:6792/0 conn(0x7f09e813f9a0 legacy=0x7f09e8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 1 -- 172.21.15.181:0/1631382730 >> v1:172.21.15.195:6789/0 conn(0x7f09e80a6ab0 legacy=0x7f09e80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:25.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 1 monclient: found mon.noname-c 2024-09-13T10:30:25.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:25.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:30:25.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 1 -- 172.21.15.181:0/1631382730 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e81464e0 con 0x7f09e80a66d0 2024-09-13T10:30:25.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:25.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:25.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:25.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 1 -- 172.21.15.181:0/1631382730 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f09d8001ae0 con 0x7f09e80a66d0 2024-09-13T10:30:25.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09ed91e640 5 monclient: authenticate success, global_id 4297 2024-09-13T10:30:25.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09ed91e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:25.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:25.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient: dump: 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.271 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09ed91e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 1 -- 172.21.15.181:0/1631382730 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09d80048a0 con 0x7f09e80a66d0 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 1 -- 172.21.15.181:0/1631382730 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f09d8004e10 con 0x7f09e80a66d0 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09ed91e640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09ed91e640 4 set_mon_vals no callback set 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.263+0000 7f09e67fc640 10 monclient: dump: 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.272 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.273 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.274 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.264+0000 7f09ed91e640 10 monclient: shutdown 2024-09-13T10:30:25.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.264+0000 7f09ed91e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:25.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.264+0000 7f09ed91e640 1 -- 172.21.15.181:0/1631382730 >> v1:172.21.15.181:6791/0 conn(0x7f09e80a66d0 legacy=0x7f09e80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.264+0000 7f09ed91e640 1 -- 172.21.15.181:0/1631382730 shutdown_connections 2024-09-13T10:30:25.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.264+0000 7f09ed91e640 1 -- 172.21.15.181:0/1631382730 >> 172.21.15.181:0/1631382730 conn(0x7f09e80abcd0 msgr2=0x7f09e80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:25.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.264+0000 7f09ed91e640 1 -- 172.21.15.181:0/1631382730 shutdown_connections 2024-09-13T10:30:25.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.264+0000 7f09ed91e640 1 -- 172.21.15.181:0/1631382730 wait complete. 2024-09-13T10:30:25.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.264+0000 7f09ed91e640 10 monclient: build_initial_monmap 2024-09-13T10:30:25.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.264+0000 7f09ed91e640 10 monclient: monmap: 2024-09-13T10:30:25.275 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:25.275 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:25.275 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:25.275 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:25.275 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:25.275 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:25.275 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:25.275 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:25.275 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.264+0000 7f09ed91e640 1 Processor -- start 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09ed91e640 1 -- start start 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09ed91e640 10 monclient: init 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09ed91e640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09ed91e640 10 monclient: _add_conns ranks=[8,7,1,5,0,6,4,2,3] 2024-09-13T10:30:25.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09ed91e640 10 monclient(hunting): picked mon.noname-e con 0x7f09e80a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:25.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09ed91e640 10 monclient(hunting): picked mon.noname-i con 0x7f09e80a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:25.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09ed91e640 10 monclient(hunting): picked mon.noname-f con 0x7f09e813f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:25.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09ed91e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e80689c0 con 0x7f09e813f9a0 2024-09-13T10:30:25.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09ed91e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e813eaa0 con 0x7f09e80a6ab0 2024-09-13T10:30:25.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09ed91e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e813d480 con 0x7f09e80a66d0 2024-09-13T10:30:25.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09ed91e640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:25.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09ed91e640 10 monclient(hunting): authenticate will time out at 764.770649s 2024-09-13T10:30:25.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09e6ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f09e80a66d0 0x7f09e81ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39732/0 (socket says 172.21.15.181:39732) 2024-09-13T10:30:25.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.265+0000 7f09e6ffd640 1 -- 172.21.15.181:0/3322235137 learned_addr learned my addr 172.21.15.181:0/3322235137 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:25.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.267+0000 7f09e6ffd640 1 -- 172.21.15.181:0/3322235137 >> v1:172.21.15.181:6793/0 conn(0x7f09e80a66d0 legacy=0x7f09e81ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.267+0000 7f09e77fe640 1 -- 172.21.15.181:0/3322235137 >> v1:172.21.15.195:6789/0 conn(0x7f09e813f9a0 legacy=0x7f09e81d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.267+0000 7f09de7fc640 1 -- 172.21.15.181:0/3322235137 >> v1:172.21.15.195:6792/0 conn(0x7f09e80a6ab0 legacy=0x7f09e81d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.267+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3971721002 0 0) 0x7f09e813d480 con 0x7f09e80a66d0 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): my global_id is 4211 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09c8003520 con 0x7f09e80a66d0 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 283089722 0 0) 0x7f09e0001820 con 0x7f09e813f9a0 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): my global_id is 54262 2024-09-13T10:30:25.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09e813d480 con 0x7f09e813f9a0 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3000012718 0 0) 0x7f09e813eaa0 con 0x7f09e80a6ab0 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): my global_id is 54232 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09e0001820 con 0x7f09e80a6ab0 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2571981449 0 0) 0x7f09c8003520 con 0x7f09e80a66d0 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09e813eaa0 con 0x7f09e80a66d0 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f09d8004d90 con 0x7f09e80a66d0 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): dump: 2024-09-13T10:30:25.283 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.284 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1327664870 0 0) 0x7f09e813eaa0 con 0x7f09e80a66d0 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 >> v1:172.21.15.195:6792/0 conn(0x7f09e80a6ab0 legacy=0x7f09e81d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 >> v1:172.21.15.195:6789/0 conn(0x7f09e813f9a0 legacy=0x7f09e81d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 monclient: found mon.e 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e8068d10 con 0x7f09e80a66d0 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient: _finish_auth 0 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:30:25.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09ed91e640 5 monclient: authenticate success, global_id 4211 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09ed91e640 10 monclient: _renew_subs 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09ed91e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09ed91e640 1 -- 172.21.15.181:0/3322235137 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f09e813f060 con 0x7f09e80a66d0 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09ed91e640 10 monclient: _renew_subs 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09ed91e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09ed91e640 1 -- 172.21.15.181:0/3322235137 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f09e813c500 con 0x7f09e80a66d0 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09d80048a0 con 0x7f09e80a66d0 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f09d8001a80 con 0x7f09e80a66d0 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e5ffb640 4 set_mon_vals no callback set 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.268+0000 7f09e4ff9640 10 monclient: dump: 2024-09-13T10:30:25.286 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.287 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.288 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.269+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f09d8011c20 con 0x7f09e80a66d0 2024-09-13T10:30:25.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.269+0000 7f09ed91e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:25.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.269+0000 7f09ed91e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:25.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.269+0000 7f09ed91e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:25.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.269+0000 7f09ed91e640 1 -- 172.21.15.181:0/3322235137 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09cc005080 con 0x7f09e80a66d0 2024-09-13T10:30:25.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.269+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f09d804e2f0 con 0x7f09e80a66d0 2024-09-13T10:30:25.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.269+0000 7f09de7fc640 10 monclient: get_auth_request con 0x7f09c803fdc0 auth_method 0 2024-09-13T10:30:25.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.274+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f09d8017990 con 0x7f09e80a66d0 2024-09-13T10:30:25.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.274+0000 7f09e4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:25.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.274+0000 7f09e4ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:25.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.496+0000 7f09ed91e640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2024-09-13T10:30:25.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.496+0000 7f09ed91e640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2024-09-13T10:30:25.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.496+0000 7f09ed91e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:25.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.496+0000 7f09ed91e640 1 -- 172.21.15.181:0/3322235137 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f09cc005370 con 0x7f09e80a66d0 2024-09-13T10:30:25.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.498+0000 7f09e4ff9640 1 -- 172.21.15.181:0/3322235137 <== mon.8 v1:172.21.15.181:6793/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+96984 (unknown 481731318 0 3642661297) 0x7f09d8017290 con 0x7f09e80a66d0 2024-09-13T10:30:25.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.498+0000 7f09e4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2024-09-13T10:30:25.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.498+0000 7f09e4ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:25.501 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:30:25.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.500+0000 7f09ed91e640 1 -- 172.21.15.181:0/3322235137 >> v1:172.21.15.195:6800/1839191919 conn(0x7f09c803fdc0 legacy=0x7f09c8042280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.500+0000 7f09ed91e640 10 monclient: shutdown 2024-09-13T10:30:25.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.500+0000 7f09ed91e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:25.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.500+0000 7f09ed91e640 1 -- 172.21.15.181:0/3322235137 >> v1:172.21.15.181:6793/0 conn(0x7f09e80a66d0 legacy=0x7f09e81ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.501+0000 7f09ed91e640 1 -- 172.21.15.181:0/3322235137 shutdown_connections 2024-09-13T10:30:25.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.501+0000 7f09ed91e640 1 -- 172.21.15.181:0/3322235137 >> 172.21.15.181:0/3322235137 conn(0x7f09e80abcd0 msgr2=0x7f09e80a3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:25.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.501+0000 7f09ed91e640 1 -- 172.21.15.181:0/3322235137 shutdown_connections 2024-09-13T10:30:25.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.501+0000 7f09ed91e640 1 -- 172.21.15.181:0/3322235137 wait complete. 2024-09-13T10:30:25.512 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6800","nonce":1839191919}]},"active_addr":"172.21.15.195:6800/1839191919","active_change":"2024-09-13T10:30:01.831818+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":2828611313}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":3538023727}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":139257048}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":3983803816}]}]} 2024-09-13T10:30:25.515 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T10:30:25.515 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T10:30:25.515 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T10:30:25.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.610+0000 7f1d9fef7640 10 monclient: get_monmap_and_config 2024-09-13T10:30:25.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.610+0000 7f1d9fef7640 10 monclient: build_initial_monmap 2024-09-13T10:30:25.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.610+0000 7f1d9fef7640 10 monclient: monmap: 2024-09-13T10:30:25.612 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:25.612 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.612 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:25.611563+0000 2024-09-13T10:30:25.612 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:25.611563+0000 2024-09-13T10:30:25.613 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:25.613 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.613 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:25.613 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:25.613 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:25.613 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:25.613 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:25.613 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:25.613 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:25.613 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:25.613 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:25.613 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.611+0000 7f1d9fef7640 1 Processor -- start 2024-09-13T10:30:25.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.611+0000 7f1d9fef7640 1 -- start start 2024-09-13T10:30:25.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.611+0000 7f1d9fef7640 10 monclient: init 2024-09-13T10:30:25.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.612+0000 7f1d9fef7640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:25.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.612+0000 7f1d9fef7640 10 monclient: _add_conns ranks=[8,6,0,1,5,7,3,2,4] 2024-09-13T10:30:25.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.612+0000 7f1d9fef7640 10 monclient(hunting): picked mon.noname-e con 0x7f1d980a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:25.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.612+0000 7f1d9fef7640 10 monclient(hunting): picked mon.noname-d con 0x7f1d980a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:25.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.612+0000 7f1d9fef7640 10 monclient(hunting): picked mon.noname-a con 0x7f1d9813f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:25.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.612+0000 7f1d9fef7640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d980a4bc0 con 0x7f1d9813f750 2024-09-13T10:30:25.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.612+0000 7f1d9fef7640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d9813a320 con 0x7f1d980a8340 2024-09-13T10:30:25.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.612+0000 7f1d9fef7640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d980a8100 con 0x7f1d980a6640 2024-09-13T10:30:25.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.612+0000 7f1d9fef7640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:25.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.612+0000 7f1d9fef7640 10 monclient(hunting): authenticate will time out at 765.117337s 2024-09-13T10:30:25.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.612+0000 7f1d9dc93640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f1d980a6640 0x7f1d98139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39738/0 (socket says 172.21.15.181:39738) 2024-09-13T10:30:25.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.612+0000 7f1d9dc93640 1 -- 172.21.15.181:0/603152710 learned_addr learned my addr 172.21.15.181:0/603152710 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:25.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9e494640 1 -- 172.21.15.181:0/603152710 >> v1:172.21.15.181:6789/0 conn(0x7f1d9813f750 legacy=0x7f1d98141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9dc93640 1 -- 172.21.15.181:0/603152710 >> v1:172.21.15.181:6793/0 conn(0x7f1d980a6640 legacy=0x7f1d98139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9d492640 1 -- 172.21.15.181:0/603152710 >> v1:172.21.15.181:6792/0 conn(0x7f1d980a8340 legacy=0x7f1d98139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857218301 0 0) 0x7f1d980a4bc0 con 0x7f1d9813f750 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 10 monclient(hunting): my global_id is 54216 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d84003520 con 0x7f1d9813f750 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322442389 0 0) 0x7f1d980a8100 con 0x7f1d980a6640 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 10 monclient(hunting): my global_id is 4220 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d980a4bc0 con 0x7f1d980a6640 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715341640 0 0) 0x7f1d9813a320 con 0x7f1d980a8340 2024-09-13T10:30:25.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 10 monclient(hunting): my global_id is 4227 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.614+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d980a8100 con 0x7f1d980a8340 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1251394271 0 0) 0x7f1d84003520 con 0x7f1d9813f750 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 >> v1:172.21.15.181:6793/0 conn(0x7f1d980a6640 legacy=0x7f1d98139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 >> v1:172.21.15.181:6792/0 conn(0x7f1d980a8340 legacy=0x7f1d98139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 10 monclient: _finish_hunting 0 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 1 monclient: found mon.noname-a 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d980a48e0 con 0x7f1d9813f750 2024-09-13T10:30:25.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 10 monclient: _finish_auth 0 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 10 monclient: _check_auth_tickets 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1d90001eb0 con 0x7f1d9813f750 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9fef7640 5 monclient: authenticate success, global_id 54216 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9fef7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 10 monclient: dump: 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.622 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9fef7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d90003990 con 0x7f1d9813f750 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:25.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9fef7640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 1 -- 172.21.15.181:0/603152710 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1d90003f00 con 0x7f1d9813f750 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9fef7640 4 set_mon_vals no callback set 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9cc91640 10 monclient: dump: 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.624 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9fef7640 10 monclient: shutdown 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9fef7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9fef7640 1 -- 172.21.15.181:0/603152710 >> v1:172.21.15.181:6789/0 conn(0x7f1d9813f750 legacy=0x7f1d98141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9fef7640 1 -- 172.21.15.181:0/603152710 shutdown_connections 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9fef7640 1 -- 172.21.15.181:0/603152710 >> 172.21.15.181:0/603152710 conn(0x7f1d98077170 msgr2=0x7f1d980abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:25.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9fef7640 1 -- 172.21.15.181:0/603152710 shutdown_connections 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.615+0000 7f1d9fef7640 1 -- 172.21.15.181:0/603152710 wait complete. 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.616+0000 7f1d9fef7640 10 monclient: build_initial_monmap 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.616+0000 7f1d9fef7640 10 monclient: monmap: 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:25.626 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.616+0000 7f1d9fef7640 1 Processor -- start 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.616+0000 7f1d9fef7640 1 -- start start 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.616+0000 7f1d9fef7640 10 monclient: init 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9fef7640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9fef7640 10 monclient: _add_conns ranks=[7,1,5,6,0,8,2,4,3] 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9fef7640 10 monclient(hunting): picked mon.noname-i con 0x7f1d980a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9fef7640 10 monclient(hunting): picked mon.noname-f con 0x7f1d9813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:25.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9fef7640 10 monclient(hunting): picked mon.noname-h con 0x7f1d981d4520 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:25.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9fef7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d980a1090 con 0x7f1d9813f750 2024-09-13T10:30:25.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9fef7640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d9809e370 con 0x7f1d981d4520 2024-09-13T10:30:25.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9fef7640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d980a1370 con 0x7f1d980a8340 2024-09-13T10:30:25.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9fef7640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:25.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9fef7640 10 monclient(hunting): authenticate will time out at 765.122297s 2024-09-13T10:30:25.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9e494640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f1d981d4520 0x7f1d981d6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:54704/0 (socket says 172.21.15.181:54704) 2024-09-13T10:30:25.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9e494640 1 -- 172.21.15.181:0/3686565594 learned_addr learned my addr 172.21.15.181:0/3686565594 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:25.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9dc93640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f1d980a8340 0x7f1d9809d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:50078/0 (socket says 172.21.15.181:50078) 2024-09-13T10:30:25.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.617+0000 7f1d9d492640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f1d9813f750 0x7f1d9809dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:35306/0 (socket says 172.21.15.181:35306) 2024-09-13T10:30:25.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.619+0000 7f1d9e494640 1 -- 172.21.15.181:0/3686565594 >> v1:172.21.15.195:6791/0 conn(0x7f1d981d4520 legacy=0x7f1d981d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.619+0000 7f1d9dc93640 1 -- 172.21.15.181:0/3686565594 >> v1:172.21.15.195:6792/0 conn(0x7f1d980a8340 legacy=0x7f1d9809d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.619+0000 7f1d9d492640 1 -- 172.21.15.181:0/3686565594 >> v1:172.21.15.195:6789/0 conn(0x7f1d9813f750 legacy=0x7f1d9809dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.619+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2067279383 0 0) 0x7f1d9809e370 con 0x7f1d981d4520 2024-09-13T10:30:25.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): my global_id is 4280 2024-09-13T10:30:25.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d7c003550 con 0x7f1d981d4520 2024-09-13T10:30:25.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231569374 0 0) 0x7f1d980a1370 con 0x7f1d980a8340 2024-09-13T10:30:25.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): my global_id is 54241 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d9809e370 con 0x7f1d980a8340 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345332516 0 0) 0x7f1d980a1090 con 0x7f1d9813f750 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): my global_id is 54271 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d980a1370 con 0x7f1d9813f750 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 311105976 0 0) 0x7f1d9809e370 con 0x7f1d980a8340 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d980a1090 con 0x7f1d980a8340 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2343484767 0 0) 0x7f1d980a1370 con 0x7f1d9813f750 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d9809e370 con 0x7f1d9813f750 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 569779806 0 0) 0x7f1d7c003550 con 0x7f1d981d4520 2024-09-13T10:30:25.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d980a1370 con 0x7f1d981d4520 2024-09-13T10:30:25.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1d940047e0 con 0x7f1d980a8340 2024-09-13T10:30:25.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:25.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:30:25.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): dump: 2024-09-13T10:30:25.634 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.634 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.634 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.634 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.634 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.634 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.634 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.634 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.635 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.635 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.635 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.635 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.635 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.635 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.635 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.635 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:25.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1d88003950 con 0x7f1d9813f750 2024-09-13T10:30:25.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:25.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:25.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): dump: 2024-09-13T10:30:25.636 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.636 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.636 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.636 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.636 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.636 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.636 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.636 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.636 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.636 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1d90003e80 con 0x7f1d981d4520 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient(hunting): dump: 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.637 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3833293590 0 0) 0x7f1d980a1090 con 0x7f1d980a8340 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 >> v1:172.21.15.195:6791/0 conn(0x7f1d981d4520 legacy=0x7f1d981d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 >> v1:172.21.15.195:6789/0 conn(0x7f1d9813f750 legacy=0x7f1d9809dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 monclient: found mon.i 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d980a0500 con 0x7f1d980a8340 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d9fef7640 5 monclient: authenticate success, global_id 54241 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d9fef7640 10 monclient: _renew_subs 2024-09-13T10:30:25.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d9fef7640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d9fef7640 1 -- 172.21.15.181:0/3686565594 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1d980a0db0 con 0x7f1d980a8340 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d9fef7640 10 monclient: _renew_subs 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d9fef7640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d9fef7640 1 -- 172.21.15.181:0/3686565594 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f1d981d8030 con 0x7f1d980a8340 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d94004c30 con 0x7f1d980a8340 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1d94005120 con 0x7f1d980a8340 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8ffff640 4 set_mon_vals no callback set 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.620+0000 7f1d8e7fc640 10 monclient: dump: 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.640 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.641 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.621+0000 7f1d9fef7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:25.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.621+0000 7f1d9fef7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:25.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.621+0000 7f1d9fef7640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:25.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.621+0000 7f1d9fef7640 1 -- 172.21.15.181:0/3686565594 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d80005080 con 0x7f1d980a8340 2024-09-13T10:30:25.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.621+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1d940117a0 con 0x7f1d980a8340 2024-09-13T10:30:25.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.621+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f1d9404e220 con 0x7f1d980a8340 2024-09-13T10:30:25.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.622+0000 7f1d9d492640 10 monclient: get_auth_request con 0x7f1d7c040640 auth_method 0 2024-09-13T10:30:25.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.626+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.7 v1:172.21.15.195:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f1d94017800 con 0x7f1d980a8340 2024-09-13T10:30:25.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.626+0000 7f1d8e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:25.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.626+0000 7f1d8e7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:25.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.801+0000 7f1d9fef7640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:25.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.801+0000 7f1d9fef7640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:25.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.801+0000 7f1d9fef7640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:25.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.801+0000 7f1d9fef7640 1 -- 172.21.15.181:0/3686565594 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d80005370 con 0x7f1d980a8340 2024-09-13T10:30:25.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.803+0000 7f1d8e7fc640 1 -- 172.21.15.181:0/3686565594 <== mon.7 v1:172.21.15.195:6792/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+10987 (unknown 3413328019 0 1153584008) 0x7f1d94017100 con 0x7f1d980a8340 2024-09-13T10:30:25.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.803+0000 7f1d8e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:25.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.803+0000 7f1d8e7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:25.804 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:30:25.804 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":20,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","created":"2024-09-13T10:29:50.823515+0000","modified":"2024-09-13T10:30:24.822046+0000","last_up_change":"2024-09-13T10:30:13.707133+0000","last_in_change":"2024-09-13T10:30:04.743077+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T10:30:13.877061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T10:30:20.723608+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"222eae7d-397c-40de-9975-11705817eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6804","nonce":3159017208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6805","nonce":3159017208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6807","nonce":3159017208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6806","nonce":3159017208}]},"public_addr":"172.21.15.181:6804/3159017208","cluster_addr":"172.21.15.181:6805/3159017208","heartbeat_back_addr":"172.21.15.181:6807/3159017208","heartbeat_front_addr":"172.21.15.181:6806/3159017208","state":["exists","up"]},{"osd":1,"uuid":"c241f0df-9ad4-42f4-809b-872d2c14bdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6800","nonce":3226877824}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6801","nonce":3226877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6803","nonce":3226877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6802","nonce":3226877824}]},"public_addr":"172.21.15.181:6800/3226877824","cluster_addr":"172.21.15.181:6801/3226877824","heartbeat_back_addr":"172.21.15.181:6803/3226877824","heartbeat_front_addr":"172.21.15.181:6802/3226877824","state":["exists","up"]},{"osd":2,"uuid":"efbff8a5-b42c-4e47-92e1-faf8ef9bec2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6808","nonce":3162343005}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6809","nonce":3162343005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6811","nonce":3162343005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6810","nonce":3162343005}]},"public_addr":"172.21.15.181:6808/3162343005","cluster_addr":"172.21.15.181:6809/3162343005","heartbeat_back_addr":"172.21.15.181:6811/3162343005","heartbeat_front_addr":"172.21.15.181:6810/3162343005","state":["exists","up"]},{"osd":3,"uuid":"11e6b317-e77c-4469-840a-a1d17e9eee86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6809","nonce":2152618500}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6810","nonce":2152618500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6812","nonce":2152618500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6811","nonce":2152618500}]},"public_addr":"172.21.15.195:6809/2152618500","cluster_addr":"172.21.15.195:6810/2152618500","heartbeat_back_addr":"172.21.15.195:6812/2152618500","heartbeat_front_addr":"172.21.15.195:6811/2152618500","state":["exists","up"]},{"osd":4,"uuid":"78cd8d74-5ffb-4116-aa73-e082ffd9adce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6805","nonce":1430589228}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6806","nonce":1430589228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6808","nonce":1430589228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6807","nonce":1430589228}]},"public_addr":"172.21.15.195:6805/1430589228","cluster_addr":"172.21.15.195:6806/1430589228","heartbeat_back_addr":"172.21.15.195:6808/1430589228","heartbeat_front_addr":"172.21.15.195:6807/1430589228","state":["exists","up"]},{"osd":5,"uuid":"ecb70959-b169-4fd8-958d-ac5b1d0a3c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6801","nonce":2714505324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6802","nonce":2714505324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6804","nonce":2714505324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6803","nonce":2714505324}]},"public_addr":"172.21.15.195:6801/2714505324","cluster_addr":"172.21.15.195:6802/2714505324","heartbeat_back_addr":"172.21.15.195:6804/2714505324","heartbeat_front_addr":"172.21.15.195:6803/2714505324","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.841016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.270575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.374446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.763765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.551366+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.985540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T10:30:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.804+0000 7f1d9fef7640 1 -- 172.21.15.181:0/3686565594 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1d7c040640 legacy=0x7f1d7c042b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.804+0000 7f1d9fef7640 10 monclient: shutdown 2024-09-13T10:30:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.804+0000 7f1d9fef7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.804+0000 7f1d9fef7640 1 -- 172.21.15.181:0/3686565594 >> v1:172.21.15.195:6792/0 conn(0x7f1d980a8340 legacy=0x7f1d9809d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.805+0000 7f1d9fef7640 1 -- 172.21.15.181:0/3686565594 shutdown_connections 2024-09-13T10:30:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.805+0000 7f1d9fef7640 1 -- 172.21.15.181:0/3686565594 >> 172.21.15.181:0/3686565594 conn(0x7f1d980a6640 msgr2=0x7f1d98141df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.805+0000 7f1d9fef7640 1 -- 172.21.15.181:0/3686565594 shutdown_connections 2024-09-13T10:30:25.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.805+0000 7f1d9fef7640 1 -- 172.21.15.181:0/3686565594 wait complete. 2024-09-13T10:30:25.817 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T10:30:25.817 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T10:30:25.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.912+0000 7f6427d24640 10 monclient: get_monmap_and_config 2024-09-13T10:30:25.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.912+0000 7f6427d24640 10 monclient: build_initial_monmap 2024-09-13T10:30:25.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.912+0000 7f6427d24640 10 monclient: monmap: 2024-09-13T10:30:25.914 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:25.914 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.914 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:25.913336+0000 2024-09-13T10:30:25.914 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:25.913336+0000 2024-09-13T10:30:25.914 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:25.914 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.915 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:25.915 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:25.915 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:25.915 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:25.915 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:25.915 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:25.915 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:25.915 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:25.915 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:25.915 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.913+0000 7f6427d24640 1 Processor -- start 2024-09-13T10:30:25.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.913+0000 7f6427d24640 1 -- start start 2024-09-13T10:30:25.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.913+0000 7f6427d24640 10 monclient: init 2024-09-13T10:30:25.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.913+0000 7f6427d24640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:25.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.913+0000 7f6427d24640 10 monclient: _add_conns ranks=[5,7,1,4,2,0,8,6,3] 2024-09-13T10:30:25.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.913+0000 7f6427d24640 10 monclient(hunting): picked mon.noname-h con 0x7f64200a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:25.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.913+0000 7f6427d24640 10 monclient(hunting): picked mon.noname-i con 0x7f64200a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:25.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.913+0000 7f6427d24640 10 monclient(hunting): picked mon.noname-f con 0x7f642013f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:25.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.913+0000 7f6427d24640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64200a4bc0 con 0x7f642013f750 2024-09-13T10:30:25.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.913+0000 7f6427d24640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642013a320 con 0x7f64200a6640 2024-09-13T10:30:25.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.914+0000 7f6427d24640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64200a8100 con 0x7f64200a8340 2024-09-13T10:30:25.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.914+0000 7f6427d24640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:25.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.914+0000 7f6427d24640 10 monclient(hunting): authenticate will time out at 765.419019s 2024-09-13T10:30:25.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.914+0000 7f64262c1640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f642013f750 0x7f6420141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:35320/0 (socket says 172.21.15.181:35320) 2024-09-13T10:30:25.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.914+0000 7f64262c1640 1 -- 172.21.15.181:0/1566878648 learned_addr learned my addr 172.21.15.181:0/1566878648 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:25.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6425ac0640 1 -- 172.21.15.181:0/1566878648 >> v1:172.21.15.195:6791/0 conn(0x7f64200a6640 legacy=0x7f6420139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f64262c1640 1 -- 172.21.15.181:0/1566878648 >> v1:172.21.15.195:6789/0 conn(0x7f642013f750 legacy=0x7f6420141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f64252bf640 1 -- 172.21.15.181:0/1566878648 >> v1:172.21.15.195:6792/0 conn(0x7f64200a8340 legacy=0x7f6420139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1510150081 0 0) 0x7f642013a320 con 0x7f64200a6640 2024-09-13T10:30:25.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 10 monclient(hunting): my global_id is 4289 2024-09-13T10:30:25.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f640c003520 con 0x7f64200a6640 2024-09-13T10:30:25.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722558341 0 0) 0x7f64200a4bc0 con 0x7f642013f750 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 10 monclient(hunting): my global_id is 54280 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f642013a320 con 0x7f642013f750 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1805536440 0 0) 0x7f64200a8100 con 0x7f64200a8340 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 10 monclient(hunting): my global_id is 54250 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.916+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64200a4bc0 con 0x7f64200a8340 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2029739585 0 0) 0x7f64200a4bc0 con 0x7f64200a8340 2024-09-13T10:30:25.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 >> v1:172.21.15.195:6791/0 conn(0x7f64200a6640 legacy=0x7f6420139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 >> v1:172.21.15.195:6789/0 conn(0x7f642013f750 legacy=0x7f6420141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 1 monclient: found mon.noname-i 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64200a48e0 con 0x7f64200a8340 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 10 monclient: _finish_auth 0 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6410001980 con 0x7f64200a8340 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 10 monclient: dump: 2024-09-13T10:30:25.923 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.924 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.924 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.924 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.924 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.924 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.924 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.924 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.924 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.924 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6427d24640 5 monclient: authenticate success, global_id 54250 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6427d24640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6410001bd0 con 0x7f64200a8340 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 1 -- 172.21.15.181:0/1566878648 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6410003950 con 0x7f64200a8340 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6427d24640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:25.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6427d24640 4 set_mon_vals no callback set 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6424abe640 10 monclient: dump: 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.926 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6427d24640 10 monclient: shutdown 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6427d24640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6427d24640 1 -- 172.21.15.181:0/1566878648 >> v1:172.21.15.195:6792/0 conn(0x7f64200a8340 legacy=0x7f6420139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6427d24640 1 -- 172.21.15.181:0/1566878648 shutdown_connections 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6427d24640 1 -- 172.21.15.181:0/1566878648 >> 172.21.15.181:0/1566878648 conn(0x7f6420077170 msgr2=0x7f64200abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6427d24640 1 -- 172.21.15.181:0/1566878648 shutdown_connections 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.917+0000 7f6427d24640 1 -- 172.21.15.181:0/1566878648 wait complete. 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.918+0000 7f6427d24640 10 monclient: build_initial_monmap 2024-09-13T10:30:25.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.918+0000 7f6427d24640 10 monclient: monmap: 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:25.928 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.918+0000 7f6427d24640 1 Processor -- start 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.918+0000 7f6427d24640 1 -- start start 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.918+0000 7f6427d24640 10 monclient: init 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f6427d24640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f6427d24640 10 monclient: _add_conns ranks=[4,6,1,7,8,2,5,0,3] 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f6427d24640 10 monclient(hunting): picked mon.noname-c con 0x7f64200a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f6427d24640 10 monclient(hunting): picked mon.noname-d con 0x7f642013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f6427d24640 10 monclient(hunting): picked mon.noname-f con 0x7f64201d4520 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f6427d24640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64200a9f80 con 0x7f64201d4520 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f6427d24640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64201cf0f0 con 0x7f64200a8340 2024-09-13T10:30:25.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f6427d24640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64200a12b0 con 0x7f642013f750 2024-09-13T10:30:25.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f6427d24640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:25.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f6427d24640 10 monclient(hunting): authenticate will time out at 765.424263s 2024-09-13T10:30:25.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f6425ac0640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f64200a8340 0x7f64201ce2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38350/0 (socket says 172.21.15.181:38350) 2024-09-13T10:30:25.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f64252bf640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f642013f750 0x7f64201ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45550/0 (socket says 172.21.15.181:45550) 2024-09-13T10:30:25.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f6425ac0640 1 -- 172.21.15.181:0/3853949569 learned_addr learned my addr 172.21.15.181:0/3853949569 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:25.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f64252bf640 1 -- 172.21.15.181:0/3853949569 >> v1:172.21.15.181:6792/0 conn(0x7f642013f750 legacy=0x7f64201ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send send error: (32) Broken pipe 2024-09-13T10:30:25.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f64252bf640 1 --1- 172.21.15.181:0/3853949569 >> v1:172.21.15.181:6792/0 conn(0x7f642013f750 0x7f64201ce9e0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2024-09-13T10:30:25.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.919+0000 7f64167fc640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.181:6792/0 2024-09-13T10:30:25.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f6425ac0640 1 -- 172.21.15.181:0/3853949569 >> v1:172.21.15.181:6791/0 conn(0x7f64200a8340 legacy=0x7f64201ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64262c1640 1 -- 172.21.15.181:0/3853949569 >> v1:172.21.15.195:6789/0 conn(0x7f64201d4520 legacy=0x7f64201d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:25.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191254318 0 0) 0x7f64201cf0f0 con 0x7f64200a8340 2024-09-13T10:30:25.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 10 monclient(hunting): my global_id is 4306 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6404003550 con 0x7f64200a8340 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2179614034 0 0) 0x7f6418001fc0 con 0x7f64201d4520 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 10 monclient(hunting): my global_id is 54289 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64201cf0f0 con 0x7f64201d4520 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1986437517 0 0) 0x7f6404003550 con 0x7f64200a8340 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6418001fc0 con 0x7f64200a8340 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f641c003950 con 0x7f64200a8340 2024-09-13T10:30:25.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:25.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:25.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 10 monclient(hunting): dump: 2024-09-13T10:30:25.935 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.935 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.935 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.935 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.935 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.935 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.935 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.935 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.935 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.935 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.936 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.936 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.936 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.936 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.936 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.936 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.921+0000 7f64167fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:25.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3020761472 0 0) 0x7f64201cf0f0 con 0x7f64201d4520 2024-09-13T10:30:25.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6404003550 con 0x7f64201d4520 2024-09-13T10:30:25.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6418004b60 con 0x7f64201d4520 2024-09-13T10:30:25.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:25.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:25.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 10 monclient(hunting): dump: 2024-09-13T10:30:25.937 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.937 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.937 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.937 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.937 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.937 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.937 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.938 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.938 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.938 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.938 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.938 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.938 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.938 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.938 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.938 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3946983467 0 0) 0x7f6418001fc0 con 0x7f64200a8340 2024-09-13T10:30:25.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 >> v1:172.21.15.181:6792/0 conn(0x7f642013f750 legacy=0x7f64201ce9e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:25.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 >> v1:172.21.15.195:6789/0 conn(0x7f64201d4520 legacy=0x7f64201d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 1 monclient: found mon.c 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6420143020 con 0x7f64200a8340 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f6427d24640 5 monclient: authenticate success, global_id 4306 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f6427d24640 10 monclient: _renew_subs 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f6427d24640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f6427d24640 1 -- 172.21.15.181:0/3853949569 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f64200a0440 con 0x7f64200a8340 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f6427d24640 10 monclient: _renew_subs 2024-09-13T10:30:25.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f6427d24640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f6427d24640 1 -- 172.21.15.181:0/3853949569 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f64200a0fd0 con 0x7f64200a8340 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f641c001b90 con 0x7f64200a8340 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f641c004160 con 0x7f64200a8340 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f6417fff640 4 set_mon_vals no callback set 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.922+0000 7f64167fc640 10 monclient: dump: 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:25.940 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.923+0000 7f6427d24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.923+0000 7f6427d24640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.923+0000 7f6427d24640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:25.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.923+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f641c011ca0 con 0x7f64200a8340 2024-09-13T10:30:25.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.923+0000 7f6427d24640 1 -- 172.21.15.181:0/3853949569 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6408005080 con 0x7f64200a8340 2024-09-13T10:30:25.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.923+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f641c04e2f0 con 0x7f64200a8340 2024-09-13T10:30:25.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.923+0000 7f64252bf640 10 monclient: get_auth_request con 0x7f64040400d0 auth_method 0 2024-09-13T10:30:25.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.927+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f641c017930 con 0x7f64200a8340 2024-09-13T10:30:25.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.927+0000 7f64167fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:25.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:25.927+0000 7f64167fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:26.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.105+0000 7f6427d24640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:26.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.105+0000 7f6427d24640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:26.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.105+0000 7f6427d24640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:26.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.105+0000 7f6427d24640 1 -- 172.21.15.181:0/3853949569 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6408005370 con 0x7f64200a8340 2024-09-13T10:30:26.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.106+0000 7f64167fc640 1 -- 172.21.15.181:0/3853949569 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+10987 (unknown 3413328019 0 1153584008) 0x7f641c017230 con 0x7f64200a8340 2024-09-13T10:30:26.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.106+0000 7f64167fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:26.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.106+0000 7f64167fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:26.108 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:30:26.108 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":20,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","created":"2024-09-13T10:29:50.823515+0000","modified":"2024-09-13T10:30:24.822046+0000","last_up_change":"2024-09-13T10:30:13.707133+0000","last_in_change":"2024-09-13T10:30:04.743077+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T10:30:13.877061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T10:30:20.723608+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"222eae7d-397c-40de-9975-11705817eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6804","nonce":3159017208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6805","nonce":3159017208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6807","nonce":3159017208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6806","nonce":3159017208}]},"public_addr":"172.21.15.181:6804/3159017208","cluster_addr":"172.21.15.181:6805/3159017208","heartbeat_back_addr":"172.21.15.181:6807/3159017208","heartbeat_front_addr":"172.21.15.181:6806/3159017208","state":["exists","up"]},{"osd":1,"uuid":"c241f0df-9ad4-42f4-809b-872d2c14bdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6800","nonce":3226877824}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6801","nonce":3226877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6803","nonce":3226877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6802","nonce":3226877824}]},"public_addr":"172.21.15.181:6800/3226877824","cluster_addr":"172.21.15.181:6801/3226877824","heartbeat_back_addr":"172.21.15.181:6803/3226877824","heartbeat_front_addr":"172.21.15.181:6802/3226877824","state":["exists","up"]},{"osd":2,"uuid":"efbff8a5-b42c-4e47-92e1-faf8ef9bec2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6808","nonce":3162343005}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6809","nonce":3162343005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6811","nonce":3162343005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6810","nonce":3162343005}]},"public_addr":"172.21.15.181:6808/3162343005","cluster_addr":"172.21.15.181:6809/3162343005","heartbeat_back_addr":"172.21.15.181:6811/3162343005","heartbeat_front_addr":"172.21.15.181:6810/3162343005","state":["exists","up"]},{"osd":3,"uuid":"11e6b317-e77c-4469-840a-a1d17e9eee86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6809","nonce":2152618500}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6810","nonce":2152618500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6812","nonce":2152618500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6811","nonce":2152618500}]},"public_addr":"172.21.15.195:6809/2152618500","cluster_addr":"172.21.15.195:6810/2152618500","heartbeat_back_addr":"172.21.15.195:6812/2152618500","heartbeat_front_addr":"172.21.15.195:6811/2152618500","state":["exists","up"]},{"osd":4,"uuid":"78cd8d74-5ffb-4116-aa73-e082ffd9adce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6805","nonce":1430589228}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6806","nonce":1430589228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6808","nonce":1430589228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6807","nonce":1430589228}]},"public_addr":"172.21.15.195:6805/1430589228","cluster_addr":"172.21.15.195:6806/1430589228","heartbeat_back_addr":"172.21.15.195:6808/1430589228","heartbeat_front_addr":"172.21.15.195:6807/1430589228","state":["exists","up"]},{"osd":5,"uuid":"ecb70959-b169-4fd8-958d-ac5b1d0a3c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6801","nonce":2714505324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6802","nonce":2714505324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6804","nonce":2714505324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6803","nonce":2714505324}]},"public_addr":"172.21.15.195:6801/2714505324","cluster_addr":"172.21.15.195:6802/2714505324","heartbeat_back_addr":"172.21.15.195:6804/2714505324","heartbeat_front_addr":"172.21.15.195:6803/2714505324","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.841016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.270575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.374446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.763765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.551366+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.985540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T10:30:26.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.108+0000 7f6427d24640 1 -- 172.21.15.181:0/3853949569 >> v1:172.21.15.195:6800/1839191919 conn(0x7f64040400d0 legacy=0x7f6404042590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.108+0000 7f6427d24640 10 monclient: shutdown 2024-09-13T10:30:26.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.108+0000 7f6427d24640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.108+0000 7f6427d24640 1 -- 172.21.15.181:0/3853949569 >> v1:172.21.15.181:6791/0 conn(0x7f64200a8340 legacy=0x7f64201ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.108+0000 7f6427d24640 1 -- 172.21.15.181:0/3853949569 shutdown_connections 2024-09-13T10:30:26.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.108+0000 7f6427d24640 1 -- 172.21.15.181:0/3853949569 >> 172.21.15.181:0/3853949569 conn(0x7f64200a6640 msgr2=0x7f6420141cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.108+0000 7f6427d24640 1 -- 172.21.15.181:0/3853949569 shutdown_connections 2024-09-13T10:30:26.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.108+0000 7f6427d24640 1 -- 172.21.15.181:0/3853949569 wait complete. 2024-09-13T10:30:26.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T10:30:26.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T10:30:26.121 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T10:30:26.122 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T10:30:26.122 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T10:30:26.123 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T10:30:26.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.233+0000 7f34686f7640 10 monclient: get_monmap_and_config 2024-09-13T10:30:26.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.233+0000 7f3e8a07f640 10 monclient: get_monmap_and_config 2024-09-13T10:30:26.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.233+0000 7f3e8a07f640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.233+0000 7f3e8a07f640 10 monclient: monmap: 2024-09-13T10:30:26.236 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.236 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.236 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:26.234545+0000 2024-09-13T10:30:26.236 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:26.234545+0000 2024-09-13T10:30:26.236 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.236 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.236 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.236 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.236 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.237 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.237 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.237 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.237 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.237 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.237 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.237 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.233+0000 7f34686f7640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.233+0000 7f34686f7640 10 monclient: monmap: 2024-09-13T10:30:26.238 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.238 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.238 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:26.234543+0000 2024-09-13T10:30:26.238 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:26.234543+0000 2024-09-13T10:30:26.238 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.238 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.238 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.238 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.238 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.239 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.239 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.239 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.239 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.239 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.239 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.239 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.234+0000 7f34686f7640 1 Processor -- start 2024-09-13T10:30:26.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.234+0000 7f34686f7640 1 -- start start 2024-09-13T10:30:26.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.234+0000 7f34686f7640 10 monclient: init 2024-09-13T10:30:26.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.234+0000 7f3e8a07f640 1 Processor -- start 2024-09-13T10:30:26.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.234+0000 7f3e8a07f640 1 -- start start 2024-09-13T10:30:26.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.234+0000 7f3e8a07f640 10 monclient: init 2024-09-13T10:30:26.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3e8a07f640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3e8a07f640 10 monclient: _add_conns ranks=[2,5,8,6,3,4,1,7,0] 2024-09-13T10:30:26.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f34686f7640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3e8a07f640 10 monclient(hunting): picked mon.noname-b con 0x7f3e840a5630 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:26.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3e8a07f640 10 monclient(hunting): picked mon.noname-h con 0x7f3e840a5a10 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:26.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3e8a07f640 10 monclient(hunting): picked mon.noname-e con 0x7f3e8413f7a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:26.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3e8a07f640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e8406f650 con 0x7f3e840a5630 2024-09-13T10:30:26.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3e8a07f640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e8406ea60 con 0x7f3e840a5a10 2024-09-13T10:30:26.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3e8a07f640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e8406eec0 con 0x7f3e8413f7a0 2024-09-13T10:30:26.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3e8a07f640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3e8a07f640 10 monclient(hunting): authenticate will time out at 765.740507s 2024-09-13T10:30:26.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3e837fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f3e840a5630 0x7f3e840721a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48428/0 (socket says 172.21.15.181:48428) 2024-09-13T10:30:26.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3e837fe640 1 -- 172.21.15.181:0/3509908332 learned_addr learned my addr 172.21.15.181:0/3509908332 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f34686f7640 10 monclient: _add_conns ranks=[5,7,3,4,0,2,8,1,6] 2024-09-13T10:30:26.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f34686f7640 10 monclient(hunting): picked mon.noname-h con 0x7f34600a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:26.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f34686f7640 10 monclient(hunting): picked mon.noname-i con 0x7f34600a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:26.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f34686f7640 10 monclient(hunting): picked mon.noname-g con 0x7f346013f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:26.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f34686f7640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34600a5fe0 con 0x7f346013f9a0 2024-09-13T10:30:26.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f34686f7640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34600a8080 con 0x7f34600a66d0 2024-09-13T10:30:26.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f34686f7640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34600a42c0 con 0x7f34600a6ab0 2024-09-13T10:30:26.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f34686f7640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f34686f7640 10 monclient(hunting): authenticate will time out at 765.740823s 2024-09-13T10:30:26.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3465c92640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f34600a6ab0 0x7f34600a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:50092/0 (socket says 172.21.15.181:50092) 2024-09-13T10:30:26.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3465c92640 1 -- 172.21.15.181:0/1351709164 learned_addr learned my addr 172.21.15.181:0/1351709164 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.235+0000 7f3466493640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f34600a66d0 0x7f34600a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:54734/0 (socket says 172.21.15.181:54734) 2024-09-13T10:30:26.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.237+0000 7f3e837fe640 1 -- 172.21.15.181:0/3509908332 >> v1:172.21.15.181:6790/0 conn(0x7f3e840a5630 legacy=0x7f3e840721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.237+0000 7f3e83fff640 1 -- 172.21.15.181:0/3509908332 >> v1:172.21.15.181:6793/0 conn(0x7f3e8413f7a0 legacy=0x7f3e84141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3466493640 1 -- 172.21.15.181:0/1351709164 >> v1:172.21.15.195:6791/0 conn(0x7f34600a66d0 legacy=0x7f34600a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 1 -- 172.21.15.181:0/3509908332 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 253560985 0 0) 0x7f3e8406f650 con 0x7f3e840a5630 2024-09-13T10:30:26.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient(hunting): my global_id is 4250 2024-09-13T10:30:26.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 1 -- 172.21.15.181:0/3509908332 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e6c003520 con 0x7f3e840a5630 2024-09-13T10:30:26.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 1 -- 172.21.15.181:0/3509908332 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518851469 0 0) 0x7f3e8406eec0 con 0x7f3e8413f7a0 2024-09-13T10:30:26.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient(hunting): my global_id is 4229 2024-09-13T10:30:26.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 1 -- 172.21.15.181:0/3509908332 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e8406f650 con 0x7f3e8413f7a0 2024-09-13T10:30:26.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465c92640 1 -- 172.21.15.181:0/1351709164 >> v1:172.21.15.195:6792/0 conn(0x7f34600a6ab0 legacy=0x7f34600a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3466c94640 1 -- 172.21.15.181:0/1351709164 >> v1:172.21.15.195:6790/0 conn(0x7f346013f9a0 legacy=0x7f3460141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 1 -- 172.21.15.181:0/3509908332 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 958350305 0 0) 0x7f3e6c003520 con 0x7f3e840a5630 2024-09-13T10:30:26.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 1 -- 172.21.15.181:0/1351709164 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3130080349 0 0) 0x7f34600a42c0 con 0x7f34600a6ab0 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient(hunting): my global_id is 54259 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 1 -- 172.21.15.181:0/1351709164 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f344c003520 con 0x7f34600a6ab0 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 1 -- 172.21.15.181:0/1351709164 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838376385 0 0) 0x7f34600a5fe0 con 0x7f346013f9a0 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient(hunting): my global_id is 4242 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 1 -- 172.21.15.181:0/1351709164 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34600a42c0 con 0x7f346013f9a0 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 1 -- 172.21.15.181:0/1351709164 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1025535902 0 0) 0x7f344c003520 con 0x7f34600a6ab0 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 1 -- 172.21.15.181:0/1351709164 >> v1:172.21.15.195:6791/0 conn(0x7f34600a66d0 legacy=0x7f34600a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 1 -- 172.21.15.181:0/1351709164 >> v1:172.21.15.195:6790/0 conn(0x7f346013f9a0 legacy=0x7f3460141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 1 monclient: found mon.noname-i 2024-09-13T10:30:26.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 1 -- 172.21.15.181:0/1351709164 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34601464e0 con 0x7f34600a6ab0 2024-09-13T10:30:26.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 1 -- 172.21.15.181:0/1351709164 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3450001a00 con 0x7f34600a6ab0 2024-09-13T10:30:26.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:30:26.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 1 -- 172.21.15.181:0/3509908332 >> v1:172.21.15.181:6793/0 conn(0x7f3e8413f7a0 legacy=0x7f3e84141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient: dump: 2024-09-13T10:30:26.249 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.249 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.249 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.249 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.249 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.249 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.249 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.250 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.250 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.250 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.250 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.250 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.250 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.250 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.250 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.250 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f34686f7640 5 monclient: authenticate success, global_id 54259 2024-09-13T10:30:26.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f34686f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 1 -- 172.21.15.181:0/3509908332 >> v1:172.21.15.195:6791/0 conn(0x7f3e840a5a10 legacy=0x7f3e840a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T10:30:26.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 1 monclient: found mon.noname-b 2024-09-13T10:30:26.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 1 -- 172.21.15.181:0/3509908332 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e840a71b0 con 0x7f3e840a5630 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 1 -- 172.21.15.181:0/3509908332 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e74001ae0 con 0x7f3e840a5630 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient: dump: 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.252 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e8a07f640 5 monclient: authenticate success, global_id 4250 2024-09-13T10:30:26.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e8a07f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 1 -- 172.21.15.181:0/1351709164 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3450001cd0 con 0x7f34600a6ab0 2024-09-13T10:30:26.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 1 -- 172.21.15.181:0/1351709164 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3450004be0 con 0x7f34600a6ab0 2024-09-13T10:30:26.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f34686f7640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:26.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f34686f7640 4 set_mon_vals no callback set 2024-09-13T10:30:26.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3465491640 10 monclient: dump: 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.255 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.256 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.256 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.256 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 1 -- 172.21.15.181:0/3509908332 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e740048a0 con 0x7f3e840a5630 2024-09-13T10:30:26.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 1 -- 172.21.15.181:0/3509908332 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e74004d90 con 0x7f3e840a5630 2024-09-13T10:30:26.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e8a07f640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e8a07f640 4 set_mon_vals no callback set 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.238+0000 7f3e827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f3e827fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f3e827fc640 10 monclient: dump: 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.257 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.258 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.258 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.258 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.258 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.258 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.258 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.258 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f34686f7640 10 monclient: shutdown 2024-09-13T10:30:26.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f34686f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f34686f7640 1 -- 172.21.15.181:0/1351709164 >> v1:172.21.15.195:6792/0 conn(0x7f34600a6ab0 legacy=0x7f34600a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f3e8a07f640 10 monclient: shutdown 2024-09-13T10:30:26.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f3e8a07f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f3e8a07f640 1 -- 172.21.15.181:0/3509908332 >> v1:172.21.15.181:6790/0 conn(0x7f3e840a5630 legacy=0x7f3e840721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f34686f7640 1 -- 172.21.15.181:0/1351709164 shutdown_connections 2024-09-13T10:30:26.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f3e8a07f640 1 -- 172.21.15.181:0/3509908332 shutdown_connections 2024-09-13T10:30:26.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f3e8a07f640 1 -- 172.21.15.181:0/3509908332 >> 172.21.15.181:0/3509908332 conn(0x7f3e840aa310 msgr2=0x7f3e840a6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f34686f7640 1 -- 172.21.15.181:0/1351709164 >> 172.21.15.181:0/1351709164 conn(0x7f34600abcd0 msgr2=0x7f34600ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f3e8a07f640 1 -- 172.21.15.181:0/3509908332 shutdown_connections 2024-09-13T10:30:26.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f34686f7640 1 -- 172.21.15.181:0/1351709164 shutdown_connections 2024-09-13T10:30:26.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f3e8a07f640 1 -- 172.21.15.181:0/3509908332 wait complete. 2024-09-13T10:30:26.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.239+0000 7f34686f7640 1 -- 172.21.15.181:0/1351709164 wait complete. 2024-09-13T10:30:26.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.240+0000 7f34686f7640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.240+0000 7f3e8a07f640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.240+0000 7f3e8a07f640 10 monclient: monmap: 2024-09-13T10:30:26.262 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.262 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:26.262 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:26.262 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:26.262 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.262 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:26.262 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.262 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.262 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.262 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.262 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.263 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.263 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.263 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.263 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.263 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.240+0000 7f34686f7640 10 monclient: monmap: 2024-09-13T10:30:26.263 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.263 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:26.263 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:26.263 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:26.264 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.264 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:26.264 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.264 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.264 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.264 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.264 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.264 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.264 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.264 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.264 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.264 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.241+0000 7f3e8a07f640 1 Processor -- start 2024-09-13T10:30:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.241+0000 7f34686f7640 1 Processor -- start 2024-09-13T10:30:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.241+0000 7f34686f7640 1 -- start start 2024-09-13T10:30:26.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.241+0000 7f34686f7640 10 monclient: init 2024-09-13T10:30:26.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.241+0000 7f3e8a07f640 1 -- start start 2024-09-13T10:30:26.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.241+0000 7f3e8a07f640 10 monclient: init 2024-09-13T10:30:26.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f34686f7640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f34686f7640 10 monclient: _add_conns ranks=[2,3,7,0,4,5,6,8,1] 2024-09-13T10:30:26.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f34686f7640 10 monclient(hunting): picked mon.noname-b con 0x7f34600a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:26.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f34686f7640 10 monclient(hunting): picked mon.noname-g con 0x7f34600a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:26.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e8a07f640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e8a07f640 10 monclient: _add_conns ranks=[3,8,2,5,7,0,4,6,1] 2024-09-13T10:30:26.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f34686f7640 10 monclient(hunting): picked mon.noname-i con 0x7f346013f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:26.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f34686f7640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f346013d1e0 con 0x7f34600a66d0 2024-09-13T10:30:26.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f34686f7640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3460068a90 con 0x7f34600a6ab0 2024-09-13T10:30:26.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f34686f7640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34601cb9e0 con 0x7f346013f9a0 2024-09-13T10:30:26.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e8a07f640 10 monclient(hunting): picked mon.noname-g con 0x7f3e840a5630 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:26.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e8a07f640 10 monclient(hunting): picked mon.noname-e con 0x7f3e840a5a10 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:26.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e8a07f640 10 monclient(hunting): picked mon.noname-b con 0x7f3e8413f7a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:26.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f34686f7640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f34686f7640 10 monclient(hunting): authenticate will time out at 765.747137s 2024-09-13T10:30:26.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e8a07f640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e84120550 con 0x7f3e8413f7a0 2024-09-13T10:30:26.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e8a07f640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e84120830 con 0x7f3e840a5630 2024-09-13T10:30:26.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e8a07f640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e840a5020 con 0x7f3e840a5a10 2024-09-13T10:30:26.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3466493640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f34600a66d0 0x7f34600a1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48432/0 (socket says 172.21.15.181:48432) 2024-09-13T10:30:26.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3466493640 1 -- 172.21.15.181:0/142894560 learned_addr learned my addr 172.21.15.181:0/142894560 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e8a07f640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e8a07f640 10 monclient(hunting): authenticate will time out at 765.747404s 2024-09-13T10:30:26.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e83fff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f3e8413f7a0 0x7f3e841d6580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48434/0 (socket says 172.21.15.181:48434) 2024-09-13T10:30:26.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e83fff640 1 -- 172.21.15.181:0/1608798672 learned_addr learned my addr 172.21.15.181:0/1608798672 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.242+0000 7f3e82ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f3e840a5a10 0x7f3e8413bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39754/0 (socket says 172.21.15.181:39754) 2024-09-13T10:30:26.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3465c92640 1 -- 172.21.15.181:0/142894560 >> v1:172.21.15.195:6790/0 conn(0x7f34600a6ab0 legacy=0x7f34601d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3466493640 1 -- 172.21.15.181:0/142894560 >> v1:172.21.15.181:6790/0 conn(0x7f34600a66d0 legacy=0x7f34600a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e83fff640 1 -- 172.21.15.181:0/1608798672 >> v1:172.21.15.181:6790/0 conn(0x7f3e8413f7a0 legacy=0x7f3e841d6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3466c94640 1 -- 172.21.15.181:0/142894560 >> v1:172.21.15.195:6792/0 conn(0x7f346013f9a0 legacy=0x7f34601d6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e82ffd640 1 -- 172.21.15.181:0/1608798672 >> v1:172.21.15.181:6793/0 conn(0x7f3e840a5a10 legacy=0x7f3e8413bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e837fe640 1 -- 172.21.15.181:0/1608798672 >> v1:172.21.15.195:6790/0 conn(0x7f3e840a5630 legacy=0x7f3e8413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279364753 0 0) 0x7f3460068a90 con 0x7f34600a6ab0 2024-09-13T10:30:26.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3456ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2455519038 0 0) 0x7f3e840a5020 con 0x7f3e840a5a10 2024-09-13T10:30:26.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e6bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e6bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e6bfff640 10 monclient(hunting): my global_id is 4238 2024-09-13T10:30:26.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e70003520 con 0x7f3e840a5a10 2024-09-13T10:30:26.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992430310 0 0) 0x7f3e84120830 con 0x7f3e840a5630 2024-09-13T10:30:26.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e6bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e6bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e6bfff640 10 monclient(hunting): my global_id is 4260 2024-09-13T10:30:26.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e840a5020 con 0x7f3e840a5630 2024-09-13T10:30:26.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3456ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3456ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3456ffd640 10 monclient(hunting): my global_id is 4251 2024-09-13T10:30:26.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2894924827 0 0) 0x7f3e84120550 con 0x7f3e8413f7a0 2024-09-13T10:30:26.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient(hunting): my global_id is 4259 2024-09-13T10:30:26.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e84120830 con 0x7f3e8413f7a0 2024-09-13T10:30:26.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3444003520 con 0x7f34600a6ab0 2024-09-13T10:30:26.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121870689 0 0) 0x7f34601cb9e0 con 0x7f346013f9a0 2024-09-13T10:30:26.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3456ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3456ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3456ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3456ffd640 10 monclient(hunting): my global_id is 54268 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.244+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3460068a90 con 0x7f346013f9a0 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 238210211 0 0) 0x7f3460068a90 con 0x7f346013f9a0 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34601cb9e0 con 0x7f346013f9a0 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3458002000 con 0x7f346013f9a0 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient(hunting): dump: 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.275 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.276 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.276 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.276 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.276 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.276 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.276 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.276 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.276 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.276 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.276 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.276 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 121163476 0 0) 0x7f3e840a5020 con 0x7f3e840a5630 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e84120550 con 0x7f3e840a5630 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e74001a60 con 0x7f3e840a5630 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient(hunting): dump: 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.277 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3994608832 0 0) 0x7f3e70003520 con 0x7f3e840a5a10 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e840a5020 con 0x7f3e840a5a10 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e78004340 con 0x7f3e840a5a10 2024-09-13T10:30:26.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient(hunting): dump: 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.279 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.280 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.280 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.280 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.280 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1896174663 0 0) 0x7f3444003520 con 0x7f34600a6ab0 2024-09-13T10:30:26.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3460068a90 con 0x7f34600a6ab0 2024-09-13T10:30:26.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3450004b20 con 0x7f34600a6ab0 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient(hunting): dump: 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.281 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 261320277 0 0) 0x7f346013d1e0 con 0x7f34600a66d0 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient(hunting): my global_id is 4268 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3444003520 con 0x7f34600a66d0 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2876571311 0 0) 0x7f3460068a90 con 0x7f34600a6ab0 2024-09-13T10:30:26.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 >> v1:172.21.15.195:6792/0 conn(0x7f346013f9a0 legacy=0x7f34601d6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 309203272 0 0) 0x7f3e840a5020 con 0x7f3e840a5a10 2024-09-13T10:30:26.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 >> v1:172.21.15.195:6790/0 conn(0x7f3e840a5630 legacy=0x7f3e8413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 >> v1:172.21.15.181:6790/0 conn(0x7f3e8413f7a0 legacy=0x7f3e841d6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 monclient: found mon.e 2024-09-13T10:30:26.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e84142fe0 con 0x7f3e840a5a10 2024-09-13T10:30:26.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e6bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 >> v1:172.21.15.181:6790/0 conn(0x7f34600a66d0 legacy=0x7f34600a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 monclient: found mon.g 2024-09-13T10:30:26.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:30:26.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346013f540 con 0x7f34600a6ab0 2024-09-13T10:30:26.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3450004cc0 con 0x7f34600a6ab0 2024-09-13T10:30:26.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3450005550 con 0x7f34600a6ab0 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3456ffd640 10 monclient: dump: 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.286 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.287 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.287 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.287 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.287 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.287 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3464c90640 4 set_mon_vals no callback set 2024-09-13T10:30:26.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.246+0000 7f34686f7640 5 monclient: authenticate success, global_id 4251 2024-09-13T10:30:26.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.246+0000 7f34686f7640 10 monclient: _renew_subs 2024-09-13T10:30:26.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e8a07f640 5 monclient: authenticate success, global_id 4238 2024-09-13T10:30:26.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e8a07f640 10 monclient: _renew_subs 2024-09-13T10:30:26.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e8a07f640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e8a07f640 1 -- 172.21.15.181:0/1608798672 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3e84142bb0 con 0x7f3e840a5a10 2024-09-13T10:30:26.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e8a07f640 10 monclient: _renew_subs 2024-09-13T10:30:26.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e8a07f640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.245+0000 7f3e8a07f640 1 -- 172.21.15.181:0/1608798672 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f3e8413c230 con 0x7f3e840a5a10 2024-09-13T10:30:26.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.246+0000 7f34686f7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:30:26.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.246+0000 7f34686f7640 1 -- 172.21.15.181:0/142894560 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f346013dd40 con 0x7f34600a6ab0 2024-09-13T10:30:26.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.246+0000 7f34686f7640 10 monclient: _renew_subs 2024-09-13T10:30:26.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.246+0000 7f34686f7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:30:26.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.246+0000 7f34686f7640 1 -- 172.21.15.181:0/142894560 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f34600a2680 con 0x7f34600a6ab0 2024-09-13T10:30:26.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.247+0000 7f34686f7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:30:26.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.247+0000 7f34686f7640 1 -- 172.21.15.181:0/142894560 --> v1:172.21.15.195:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f34601430b0 con 0x7f34600a6ab0 2024-09-13T10:30:26.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.247+0000 7f3e8a07f640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.247+0000 7f3e8a07f640 1 -- 172.21.15.181:0/1608798672 --> v1:172.21.15.181:6793/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3e8406e6e0 con 0x7f3e840a5a10 2024-09-13T10:30:26.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.247+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e78001180 con 0x7f3e840a5a10 2024-09-13T10:30:26.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.247+0000 7f3e6bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.247+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e780016f0 con 0x7f3e840a5a10 2024-09-13T10:30:26.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.247+0000 7f3e6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.247+0000 7f3e81ffb640 4 set_mon_vals no callback set 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.247+0000 7f3e6bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.247+0000 7f3e6bfff640 10 monclient: dump: 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.291 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.292 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.292 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.292 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.292 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.292 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.247+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3e78001910 con 0x7f3e840a5a10 2024-09-13T10:30:26.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f3e7804d330 con 0x7f3e840a5a10 2024-09-13T10:30:26.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 --> v1:172.21.15.181:6808/3162343005 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e7004aa90 con 0x7f3e70046e00 2024-09-13T10:30:26.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f3e7804d5b0 con 0x7f3e840a5a10 2024-09-13T10:30:26.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3e6bfff640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-13T10:30:26.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3e837fe640 10 monclient: get_auth_request con 0x7f3e70040130 auth_method 0 2024-09-13T10:30:26.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3e83fff640 10 monclient: get_auth_request con 0x7f3e70046e00 auth_method 0 2024-09-13T10:30:26.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3450011bd0 con 0x7f34600a6ab0 2024-09-13T10:30:26.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f345004dfe0 con 0x7f34600a6ab0 2024-09-13T10:30:26.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 --> v1:172.21.15.195:6805/1430589228 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f344404aad0 con 0x7f3444046e20 2024-09-13T10:30:26.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== mon.3 v1:172.21.15.195:6790/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f345004e320 con 0x7f34600a6ab0 2024-09-13T10:30:26.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3456ffd640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-13T10:30:26.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3466493640 10 monclient: get_auth_request con 0x7f3444040200 auth_method 0 2024-09-13T10:30:26.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.248+0000 7f3466c94640 10 monclient: get_auth_request con 0x7f3444046e20 auth_method 0 2024-09-13T10:30:26.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.253+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== osd.2 v1:172.21.15.181:6808/3162343005 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f3e7004aa90 con 0x7f3e70046e00 2024-09-13T10:30:26.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.254+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== osd.4 v1:172.21.15.195:6805/1430589228 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f344404aad0 con 0x7f3444046e20 2024-09-13T10:30:26.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.280+0000 7f3e8a07f640 1 -- 172.21.15.181:0/1608798672 --> v1:172.21.15.181:6808/3162343005 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e8413c500 con 0x7f3e70046e00 2024-09-13T10:30:26.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.280+0000 7ff814552640 10 monclient: get_monmap_and_config 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.280+0000 7ff814552640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.280+0000 7ff814552640 10 monclient: monmap: 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:26.281495+0000 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:26.281495+0000 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.295 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.296 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.296 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.296 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.296 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7f3e6bfff640 1 -- 172.21.15.181:0/1608798672 <== osd.2 v1:172.21.15.181:6808/3162343005 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3685469309) 0x7f3e8413c500 con 0x7f3e70046e00 2024-09-13T10:30:26.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7ff814552640 1 Processor -- start 2024-09-13T10:30:26.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7ff814552640 1 -- start start 2024-09-13T10:30:26.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7ff814552640 10 monclient: init 2024-09-13T10:30:26.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7f3e8a07f640 1 -- 172.21.15.181:0/1608798672 >> v1:172.21.15.181:6808/3162343005 conn(0x7f3e70046e00 legacy=0x7f3e70049220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7fa43691e640 10 monclient: get_monmap_and_config 2024-09-13T10:30:26.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7fa43691e640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7fa43691e640 10 monclient: monmap: 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:26.282427+0000 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:26.282427+0000 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.298 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.299 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.299 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.299 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7f3e8a07f640 1 -- 172.21.15.181:0/1608798672 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3e70040130 legacy=0x7f3e700425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7f3e8a07f640 10 monclient: shutdown 2024-09-13T10:30:26.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7f3e8a07f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7f3e8a07f640 1 -- 172.21.15.181:0/1608798672 >> v1:172.21.15.181:6793/0 conn(0x7f3e840a5a10 legacy=0x7f3e8413bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7f3e83fff640 1 -- 172.21.15.181:0/1608798672 reap_dead start 2024-09-13T10:30:26.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7fe8c1124640 10 monclient: get_monmap_and_config 2024-09-13T10:30:26.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7fe8c1124640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.281+0000 7fe8c1124640 10 monclient: monmap: 2024-09-13T10:30:26.300 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.300 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.300 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:26.282517+0000 2024-09-13T10:30:26.300 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:26.282517+0000 2024-09-13T10:30:26.300 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.301 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.301 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.301 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.301 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.301 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.301 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.301 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.301 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.301 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.301 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.301 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7f3e8a07f640 1 -- 172.21.15.181:0/1608798672 shutdown_connections 2024-09-13T10:30:26.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7f3e8a07f640 1 -- 172.21.15.181:0/1608798672 >> 172.21.15.181:0/1608798672 conn(0x7f3e840aa310 msgr2=0x7f3e84072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7f3e8a07f640 1 -- 172.21.15.181:0/1608798672 shutdown_connections 2024-09-13T10:30:26.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7f3e8a07f640 1 -- 172.21.15.181:0/1608798672 wait complete. 2024-09-13T10:30:26.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7ff814552640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7ff814552640 10 monclient: _add_conns ranks=[5,6,4,2,8,3,1,7,0] 2024-09-13T10:30:26.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7ff814552640 10 monclient(hunting): picked mon.noname-h con 0x7ff80c0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:26.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7fe8c1124640 1 Processor -- start 2024-09-13T10:30:26.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7ff814552640 10 monclient(hunting): picked mon.noname-d con 0x7ff80c0a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:26.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7fa43691e640 1 Processor -- start 2024-09-13T10:30:26.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fe8c1124640 1 -- start start 2024-09-13T10:30:26.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fe8c1124640 10 monclient: init 2024-09-13T10:30:26.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7ff811aed640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7ff80c0a6ab0 0x7ff80c0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45554/0 (socket says 172.21.15.181:45554) 2024-09-13T10:30:26.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7fa43691e640 1 -- start start 2024-09-13T10:30:26.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.282+0000 7fa43691e640 10 monclient: init 2024-09-13T10:30:26.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7ff812aef640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ff80c13f9a0 0x7ff80c141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38362/0 (socket says 172.21.15.181:38362) 2024-09-13T10:30:26.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7ff8122ee640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7ff80c0a66d0 0x7ff80c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:54750/0 (socket says 172.21.15.181:54750) 2024-09-13T10:30:26.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7ff8122ee640 1 -- 172.21.15.181:0/2455182650 learned_addr learned my addr 172.21.15.181:0/2455182650 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7ff814552640 10 monclient(hunting): picked mon.noname-c con 0x7ff80c13f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:26.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7ff814552640 1 -- 172.21.15.181:0/2455182650 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff80c0a5fe0 con 0x7ff80c13f9a0 2024-09-13T10:30:26.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7ff814552640 1 -- 172.21.15.181:0/2455182650 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff80c0a8080 con 0x7ff80c0a66d0 2024-09-13T10:30:26.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7ff814552640 1 -- 172.21.15.181:0/2455182650 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff80c0a42c0 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7ff814552640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7ff814552640 10 monclient(hunting): authenticate will time out at 765.788318s 2024-09-13T10:30:26.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7f1fae126640 10 monclient: get_monmap_and_config 2024-09-13T10:30:26.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7f1fae126640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7f1fae126640 10 monclient: monmap: 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:26.283976+0000 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:26.283976+0000 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.307 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.308 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.308 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fa43691e640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fa43691e640 10 monclient: _add_conns ranks=[6,0,5,8,2,7,1,3,4] 2024-09-13T10:30:26.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fa43691e640 10 monclient(hunting): picked mon.noname-d con 0x7fa4300a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:26.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fe8c1124640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fe8c1124640 10 monclient: _add_conns ranks=[1,4,0,5,7,6,2,8,3] 2024-09-13T10:30:26.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fa43691e640 10 monclient(hunting): picked mon.noname-a con 0x7fa4300a71c0 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:26.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fa43691e640 10 monclient(hunting): picked mon.noname-h con 0x7fa4301445c0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:26.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fa43691e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4300a8120 con 0x7fa4300a71c0 2024-09-13T10:30:26.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fa43691e640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4300a4910 con 0x7fa4301445c0 2024-09-13T10:30:26.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fa43691e640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4300a5790 con 0x7fa4300a66d0 2024-09-13T10:30:26.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fa43691e640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fa43691e640 10 monclient(hunting): authenticate will time out at 765.788764s 2024-09-13T10:30:26.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fe8c1124640 10 monclient(hunting): picked mon.noname-f con 0x7fe8bc073180 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:26.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fe8c1124640 10 monclient(hunting): picked mon.noname-c con 0x7fe8bc072950 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:26.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7fe8c1124640 10 monclient(hunting): picked mon.noname-a con 0x7fe8bc13bbd0 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:26.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7fe8bad9d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe8bc073180 0x7fe8bc073560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:35340/0 (socket says 172.21.15.181:35340) 2024-09-13T10:30:26.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7fe8bad9d640 1 -- 172.21.15.181:0/4259649597 learned_addr learned my addr 172.21.15.181:0/4259649597 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fa42ffff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fa4300a66d0 0x7fa4300a6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45556/0 (socket says 172.21.15.181:45556) 2024-09-13T10:30:26.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.283+0000 7fa42ffff640 1 -- 172.21.15.181:0/2180702330 learned_addr learned my addr 172.21.15.181:0/2180702330 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7fe8c1124640 1 -- 172.21.15.181:0/4259649597 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8bc06dc20 con 0x7fe8bc13bbd0 2024-09-13T10:30:26.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7fe8c1124640 1 -- 172.21.15.181:0/4259649597 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8bc072d50 con 0x7fe8bc073180 2024-09-13T10:30:26.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7fe8c1124640 1 -- 172.21.15.181:0/4259649597 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8bc073c70 con 0x7fe8bc072950 2024-09-13T10:30:26.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7fe8c1124640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7fe8c1124640 10 monclient(hunting): authenticate will time out at 765.789245s 2024-09-13T10:30:26.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7f1fae126640 1 Processor -- start 2024-09-13T10:30:26.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7f1fae126640 1 -- start start 2024-09-13T10:30:26.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7f1fae126640 10 monclient: init 2024-09-13T10:30:26.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7f34686f7640 1 -- 172.21.15.181:0/142894560 --> v1:172.21.15.195:6805/1430589228 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f34601430b0 con 0x7f3444046e20 2024-09-13T10:30:26.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7f1fae126640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7f1fae126640 10 monclient: _add_conns ranks=[6,5,7,0,1,2,8,3,4] 2024-09-13T10:30:26.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7f1fae126640 10 monclient(hunting): picked mon.noname-d con 0x7f1fa80a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:26.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.284+0000 7f1fae126640 10 monclient(hunting): picked mon.noname-h con 0x7f1fa80a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:26.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f1fae126640 10 monclient(hunting): picked mon.noname-i con 0x7f1fa813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:26.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f1fae126640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa80a5fe0 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f1fae126640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa80a8080 con 0x7f1fa80a66d0 2024-09-13T10:30:26.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f1fae126640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa80a42c0 con 0x7f1fa813f9a0 2024-09-13T10:30:26.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f3456ffd640 1 -- 172.21.15.181:0/142894560 <== osd.4 v1:172.21.15.195:6805/1430589228 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3580782990) 0x7f34601430b0 con 0x7f3444046e20 2024-09-13T10:30:26.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f1fae126640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f1fae126640 10 monclient(hunting): authenticate will time out at 765.790180s 2024-09-13T10:30:26.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f1fa6ffd640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f1fa80a6ab0 0x7f1fa80a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:54770/0 (socket says 172.21.15.181:54770) 2024-09-13T10:30:26.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f1fa6ffd640 1 -- 172.21.15.181:0/1043823121 learned_addr learned my addr 172.21.15.181:0/1043823121 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff812aef640 1 -- 172.21.15.181:0/2455182650 >> v1:172.21.15.181:6791/0 conn(0x7ff80c13f9a0 legacy=0x7ff80c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff811aed640 1 -- 172.21.15.181:0/2455182650 >> v1:172.21.15.181:6792/0 conn(0x7ff80c0a6ab0 legacy=0x7ff80c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8122ee640 1 -- 172.21.15.181:0/2455182650 >> v1:172.21.15.195:6791/0 conn(0x7ff80c0a66d0 legacy=0x7ff80c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 1 -- 172.21.15.181:0/2455182650 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 892534579 0 0) 0x7ff80c0a42c0 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 10 monclient(hunting): my global_id is 4236 2024-09-13T10:30:26.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 1 -- 172.21.15.181:0/2455182650 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7f8003520 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 1 -- 172.21.15.181:0/2455182650 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1532250478 0 0) 0x7ff80c0a5fe0 con 0x7ff80c13f9a0 2024-09-13T10:30:26.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f34686f7640 1 -- 172.21.15.181:0/142894560 >> v1:172.21.15.195:6805/1430589228 conn(0x7f3444046e20 legacy=0x7f3444049260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f34686f7640 1 -- 172.21.15.181:0/142894560 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3444040200 legacy=0x7f34440426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 10 monclient(hunting): my global_id is 4315 2024-09-13T10:30:26.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f34686f7640 10 monclient: shutdown 2024-09-13T10:30:26.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f34686f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f34686f7640 1 -- 172.21.15.181:0/142894560 >> v1:172.21.15.195:6790/0 conn(0x7f34600a6ab0 legacy=0x7f34601d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f3466c94640 1 -- 172.21.15.181:0/142894560 reap_dead start 2024-09-13T10:30:26.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 1 -- 172.21.15.181:0/2455182650 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff80c0a42c0 con 0x7ff80c13f9a0 2024-09-13T10:30:26.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f34686f7640 1 -- 172.21.15.181:0/142894560 shutdown_connections 2024-09-13T10:30:26.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7f34686f7640 1 -- 172.21.15.181:0/142894560 >> 172.21.15.181:0/142894560 conn(0x7f34600abcd0 msgr2=0x7f34600a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 1 -- 172.21.15.181:0/2455182650 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3307913496 0 0) 0x7ff7f8003520 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 1 -- 172.21.15.181:0/2455182650 >> v1:172.21.15.195:6791/0 conn(0x7ff80c0a66d0 legacy=0x7ff80c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 1 -- 172.21.15.181:0/2455182650 >> v1:172.21.15.181:6791/0 conn(0x7ff80c13f9a0 legacy=0x7ff80c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 1 monclient: found mon.noname-d 2024-09-13T10:30:26.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:30:26.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 1 -- 172.21.15.181:0/2455182650 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80c1464e0 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.285+0000 7ff8112ec640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff814552640 5 monclient: authenticate success, global_id 4236 2024-09-13T10:30:26.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff814552640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42ffff640 1 -- 172.21.15.181:0/2180702330 >> v1:172.21.15.181:6792/0 conn(0x7fa4300a66d0 legacy=0x7fa4300a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa4277fe640 1 -- 172.21.15.181:0/2180702330 >> v1:172.21.15.181:6789/0 conn(0x7fa4300a71c0 legacy=0x7fa430142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff8112ec640 1 -- 172.21.15.181:0/2455182650 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff7fc001ad0 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff8112ec640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff8112ec640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:26.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7f34686f7640 1 -- 172.21.15.181:0/142894560 shutdown_connections 2024-09-13T10:30:26.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7f34686f7640 1 -- 172.21.15.181:0/142894560 wait complete. 2024-09-13T10:30:26.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8bad9d640 1 -- 172.21.15.181:0/4259649597 >> v1:172.21.15.195:6789/0 conn(0x7fe8bc073180 legacy=0x7fe8bc073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8bb59e640 1 -- 172.21.15.181:0/4259649597 >> v1:172.21.15.181:6789/0 conn(0x7fe8bc13bbd0 legacy=0x7fe8bc13dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8ba59c640 1 -- 172.21.15.181:0/4259649597 >> v1:172.21.15.181:6791/0 conn(0x7fe8bc072950 legacy=0x7fe8bc13a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff8112ec640 10 monclient: dump: 2024-09-13T10:30:26.322 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.322 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.322 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.322 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.322 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.322 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.322 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.322 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.322 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.322 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.323 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.323 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.323 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.323 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.323 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.323 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff814552640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584508522 0 0) 0x7fe8bc072d50 con 0x7fe8bc073180 2024-09-13T10:30:26.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff8112ec640 1 -- 172.21.15.181:0/2455182650 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff7fc0047e0 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff8112ec640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff8112ec640 1 -- 172.21.15.181:0/2455182650 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff7fc004d50 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff8112ec640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff8112ec640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:26.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff8112ec640 10 monclient: dump: 2024-09-13T10:30:26.324 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.324 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.324 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.324 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff814552640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:26.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7ff814552640 4 set_mon_vals no callback set 2024-09-13T10:30:26.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 1 -- 172.21.15.181:0/2180702330 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163993635 0 0) 0x7fa4300a5790 con 0x7fa4300a66d0 2024-09-13T10:30:26.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 10 monclient(hunting): my global_id is 4245 2024-09-13T10:30:26.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 1 -- 172.21.15.181:0/2180702330 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa410003520 con 0x7fa4300a66d0 2024-09-13T10:30:26.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient(hunting): my global_id is 54298 2024-09-13T10:30:26.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8a4003520 con 0x7fe8bc073180 2024-09-13T10:30:26.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2783918773 0 0) 0x7fe8bc06dc20 con 0x7fe8bc13bbd0 2024-09-13T10:30:26.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 1 -- 172.21.15.181:0/2180702330 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004814933 0 0) 0x7fa4300a8120 con 0x7fa4300a71c0 2024-09-13T10:30:26.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 10 monclient(hunting): my global_id is 54225 2024-09-13T10:30:26.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 1 -- 172.21.15.181:0/2180702330 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4300a5790 con 0x7fa4300a71c0 2024-09-13T10:30:26.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient(hunting): my global_id is 54234 2024-09-13T10:30:26.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8bc072d50 con 0x7fe8bc13bbd0 2024-09-13T10:30:26.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828384152 0 0) 0x7fe8bc073c70 con 0x7fe8bc072950 2024-09-13T10:30:26.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient(hunting): my global_id is 4324 2024-09-13T10:30:26.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8bc06dc20 con 0x7fe8bc072950 2024-09-13T10:30:26.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3873872867 0 0) 0x7fe8a4003520 con 0x7fe8bc073180 2024-09-13T10:30:26.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 >> v1:172.21.15.181:6791/0 conn(0x7fe8bc072950 legacy=0x7fe8bc13a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 1 -- 172.21.15.181:0/2180702330 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4141545534 0 0) 0x7fa410003520 con 0x7fa4300a66d0 2024-09-13T10:30:26.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 1 -- 172.21.15.181:0/2180702330 >> v1:172.21.15.195:6791/0 conn(0x7fa4301445c0 legacy=0x7fa4301469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T10:30:26.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 >> v1:172.21.15.181:6789/0 conn(0x7fe8bc13bbd0 legacy=0x7fe8bc13dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 1 -- 172.21.15.181:0/2180702330 >> v1:172.21.15.181:6789/0 conn(0x7fa4300a71c0 legacy=0x7fa430142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 1 monclient: found mon.noname-d 2024-09-13T10:30:26.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:30:26.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 1 -- 172.21.15.181:0/2180702330 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4300a4350 con 0x7fa4300a66d0 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fa42f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa43691e640 5 monclient: authenticate success, global_id 4245 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa43691e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa42f7fe640 1 -- 172.21.15.181:0/2180702330 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa420001ba0 con 0x7fa4300a66d0 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa42f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa42f7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa42f7fe640 10 monclient: dump: 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.331 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.332 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.332 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.332 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.332 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.332 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.332 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.332 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.332 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.332 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.332 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.332 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa43691e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 monclient: found mon.noname-f 2024-09-13T10:30:26.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:30:26.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8bc0716b0 con 0x7fe8bc073180 2024-09-13T10:30:26.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe8ac001ae0 con 0x7fe8bc073180 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient: dump: 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.334 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8c1124640 5 monclient: authenticate success, global_id 54298 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8c1124640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8ac0048a0 con 0x7fe8bc073180 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8c1124640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 1 -- 172.21.15.181:0/4259649597 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe8ac004d90 con 0x7fe8bc073180 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8c1124640 4 set_mon_vals no callback set 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.286+0000 7fe8b9d9b640 10 monclient: dump: 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.337 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.337 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.337 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.337 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa42f7fe640 1 -- 172.21.15.181:0/2180702330 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4200048a0 con 0x7fa4300a66d0 2024-09-13T10:30:26.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa42f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa42f7fe640 1 -- 172.21.15.181:0/2180702330 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa420004d90 con 0x7fa4300a66d0 2024-09-13T10:30:26.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa42f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa42f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa42f7fe640 10 monclient: dump: 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.338 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.339 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa43691e640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fa43691e640 4 set_mon_vals no callback set 2024-09-13T10:30:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7ff814552640 10 monclient: shutdown 2024-09-13T10:30:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7ff814552640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7ff814552640 1 -- 172.21.15.181:0/2455182650 >> v1:172.21.15.181:6792/0 conn(0x7ff80c0a6ab0 legacy=0x7ff80c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa7fff640 1 -- 172.21.15.181:0/1043823121 >> v1:172.21.15.195:6792/0 conn(0x7f1fa813f9a0 legacy=0x7f1fa8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa6ffd640 1 -- 172.21.15.181:0/1043823121 >> v1:172.21.15.195:6791/0 conn(0x7f1fa80a6ab0 legacy=0x7f1fa80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7ff814552640 1 -- 172.21.15.181:0/2455182650 shutdown_connections 2024-09-13T10:30:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7ff814552640 1 -- 172.21.15.181:0/2455182650 >> 172.21.15.181:0/2455182650 conn(0x7ff80c0abcd0 msgr2=0x7ff80c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa67fc640 1 -- 172.21.15.181:0/1043823121 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233320253 0 0) 0x7f1fa80a42c0 con 0x7f1fa813f9a0 2024-09-13T10:30:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa67fc640 10 monclient(hunting): my global_id is 54277 2024-09-13T10:30:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa67fc640 1 -- 172.21.15.181:0/1043823121 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f90003520 con 0x7f1fa813f9a0 2024-09-13T10:30:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fe8c1124640 10 monclient: shutdown 2024-09-13T10:30:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fe8c1124640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fe8c1124640 1 -- 172.21.15.181:0/4259649597 >> v1:172.21.15.195:6789/0 conn(0x7fe8bc073180 legacy=0x7fe8bc073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7ff814552640 1 -- 172.21.15.181:0/2455182650 shutdown_connections 2024-09-13T10:30:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa67fc640 1 -- 172.21.15.181:0/1043823121 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2560704346 0 0) 0x7f1fa80a5fe0 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa67fc640 10 monclient(hunting): my global_id is 4298 2024-09-13T10:30:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7f1fa67fc640 1 -- 172.21.15.181:0/1043823121 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f90003880 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7ff814552640 1 -- 172.21.15.181:0/2455182650 wait complete. 2024-09-13T10:30:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fe8c1124640 1 -- 172.21.15.181:0/4259649597 shutdown_connections 2024-09-13T10:30:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fe8c1124640 1 -- 172.21.15.181:0/4259649597 >> 172.21.15.181:0/4259649597 conn(0x7fe8bc0a45b0 msgr2=0x7fe8bc0a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fe8c1124640 1 -- 172.21.15.181:0/4259649597 shutdown_connections 2024-09-13T10:30:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.287+0000 7fe8c1124640 1 -- 172.21.15.181:0/4259649597 wait complete. 2024-09-13T10:30:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 1 -- 172.21.15.181:0/1043823121 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1125830910 0 0) 0x7f1f90003880 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 1 -- 172.21.15.181:0/1043823121 >> v1:172.21.15.195:6792/0 conn(0x7f1fa813f9a0 legacy=0x7f1fa8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 1 -- 172.21.15.181:0/1043823121 >> v1:172.21.15.181:6792/0 conn(0x7f1fa80a66d0 legacy=0x7f1fa80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T10:30:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 1 monclient: found mon.noname-h 2024-09-13T10:30:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.195:6791/0 2024-09-13T10:30:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 1 -- 172.21.15.181:0/1043823121 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa81464e0 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 1 -- 172.21.15.181:0/1043823121 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f9c001a50 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 10 monclient: dump: 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.345 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7fa43691e640 10 monclient: shutdown 2024-09-13T10:30:26.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7fa43691e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7fa43691e640 1 -- 172.21.15.181:0/2180702330 >> v1:172.21.15.181:6792/0 conn(0x7fa4300a66d0 legacy=0x7fa4300a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fae126640 5 monclient: authenticate success, global_id 4298 2024-09-13T10:30:26.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fae126640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 1 -- 172.21.15.181:0/1043823121 <== mon.5 v1:172.21.15.195:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f9c0048a0 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fa67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fae126640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:26.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7f1fae126640 4 set_mon_vals no callback set 2024-09-13T10:30:26.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7fa43691e640 1 -- 172.21.15.181:0/2180702330 shutdown_connections 2024-09-13T10:30:26.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7fa43691e640 1 -- 172.21.15.181:0/2180702330 >> 172.21.15.181:0/2180702330 conn(0x7fa4300abcd0 msgr2=0x7fa4300ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7fa43691e640 1 -- 172.21.15.181:0/2180702330 shutdown_connections 2024-09-13T10:30:26.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7fa43691e640 1 -- 172.21.15.181:0/2180702330 wait complete. 2024-09-13T10:30:26.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7ff814552640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7ff814552640 10 monclient: monmap: 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.348 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.349 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.349 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7f1fa67fc640 1 -- 172.21.15.181:0/1043823121 <== mon.5 v1:172.21.15.195:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f9c001a50 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7f1fa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7f1fa67fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:26.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7f1fa67fc640 10 monclient: dump: 2024-09-13T10:30:26.349 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.349 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.349 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.349 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.350 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.350 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.350 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.350 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.350 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.350 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.350 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.350 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.350 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.350 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.350 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.350 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7fe8c1124640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.288+0000 7fe8c1124640 10 monclient: monmap: 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.352 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7ff814552640 1 Processor -- start 2024-09-13T10:30:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7fe8c1124640 1 Processor -- start 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7fa43691e640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7fa43691e640 10 monclient: monmap: 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.354 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7fe8c1124640 1 -- start start 2024-09-13T10:30:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7fe8c1124640 10 monclient: init 2024-09-13T10:30:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7f1fae126640 10 monclient: shutdown 2024-09-13T10:30:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7ff814552640 1 -- start start 2024-09-13T10:30:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7f1fae126640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7f1fae126640 1 -- 172.21.15.181:0/1043823121 >> v1:172.21.15.195:6791/0 conn(0x7f1fa80a6ab0 legacy=0x7f1fa80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7ff814552640 10 monclient: init 2024-09-13T10:30:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7fa43691e640 1 Processor -- start 2024-09-13T10:30:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7f1fae126640 1 -- 172.21.15.181:0/1043823121 shutdown_connections 2024-09-13T10:30:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7f1fae126640 1 -- 172.21.15.181:0/1043823121 >> 172.21.15.181:0/1043823121 conn(0x7f1fa80abcd0 msgr2=0x7f1fa80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7fa43691e640 1 -- start start 2024-09-13T10:30:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.289+0000 7fa43691e640 10 monclient: init 2024-09-13T10:30:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7f1fae126640 1 -- 172.21.15.181:0/1043823121 shutdown_connections 2024-09-13T10:30:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7f1fae126640 1 -- 172.21.15.181:0/1043823121 wait complete. 2024-09-13T10:30:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fe8c1124640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fe8c1124640 10 monclient: _add_conns ranks=[5,8,1,6,7,0,4,3,2] 2024-09-13T10:30:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fe8c1124640 10 monclient(hunting): picked mon.noname-h con 0x7fe8bc072950 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fe8c1124640 10 monclient(hunting): picked mon.noname-e con 0x7fe8bc073180 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fe8c1124640 10 monclient(hunting): picked mon.noname-f con 0x7fe8bc13bbd0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fe8c1124640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8bc12c290 con 0x7fe8bc13bbd0 2024-09-13T10:30:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fe8bad9d640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7fe8bc072950 0x7fe8bc13ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:54778/0 (socket says 172.21.15.181:54778) 2024-09-13T10:30:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fe8bad9d640 1 -- 172.21.15.181:0/1862877433 learned_addr learned my addr 172.21.15.181:0/1862877433 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7ff814552640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8bc12e5f0 con 0x7fe8bc072950 2024-09-13T10:30:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8bc12dd50 con 0x7fe8bc073180 2024-09-13T10:30:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fe8c1124640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fe8c1124640 10 monclient(hunting): authenticate will time out at 765.795547s 2024-09-13T10:30:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7ff814552640 10 monclient: _add_conns ranks=[5,7,8,1,0,2,3,6,4] 2024-09-13T10:30:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7ff814552640 10 monclient(hunting): picked mon.noname-h con 0x7ff80c0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fa43691e640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fa43691e640 10 monclient: _add_conns ranks=[7,8,2,0,3,5,6,1,4] 2024-09-13T10:30:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fa43691e640 10 monclient(hunting): picked mon.noname-i con 0x7fa4300a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fa43691e640 10 monclient(hunting): picked mon.noname-e con 0x7fa4300a71c0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fa43691e640 10 monclient(hunting): picked mon.noname-b con 0x7fa4301445c0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fa43691e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa43013c7c0 con 0x7fa4301445c0 2024-09-13T10:30:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fa43691e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4300ac420 con 0x7fa4300a66d0 2024-09-13T10:30:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fa43691e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4300ac0b0 con 0x7fa4300a71c0 2024-09-13T10:30:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fa43691e640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fa43691e640 10 monclient(hunting): authenticate will time out at 765.795886s 2024-09-13T10:30:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7ff814552640 10 monclient(hunting): picked mon.noname-i con 0x7ff80c0a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fa4277fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fa4300a71c0 0x7fa43009f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39776/0 (socket says 172.21.15.181:39776) 2024-09-13T10:30:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.290+0000 7fa4277fe640 1 -- 172.21.15.181:0/3015697776 learned_addr learned my addr 172.21.15.181:0/3015697776 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7f1fae126640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7ff811aed640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7ff80c0a6ab0 0x7ff80c1d36e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:50124/0 (socket says 172.21.15.181:50124) 2024-09-13T10:30:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7f1fae126640 10 monclient: monmap: 2024-09-13T10:30:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.363 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7ff814552640 10 monclient(hunting): picked mon.noname-e con 0x7ff80c13f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7ff811aed640 1 -- 172.21.15.181:0/1695856789 learned_addr learned my addr 172.21.15.181:0/1695856789 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff80c13d1e0 con 0x7ff80c0a66d0 2024-09-13T10:30:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff80c068a90 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff80c1cb9e0 con 0x7ff80c13f9a0 2024-09-13T10:30:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7ff814552640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7ff814552640 10 monclient(hunting): authenticate will time out at 765.796405s 2024-09-13T10:30:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7f1fae126640 1 Processor -- start 2024-09-13T10:30:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7f1fae126640 1 -- start start 2024-09-13T10:30:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.291+0000 7f1fae126640 10 monclient: init 2024-09-13T10:30:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7f1fae126640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7f1fae126640 10 monclient: _add_conns ranks=[6,1,7,3,5,0,4,2,8] 2024-09-13T10:30:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7f1fae126640 10 monclient(hunting): picked mon.noname-d con 0x7f1fa80a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7f1fae126640 10 monclient(hunting): picked mon.noname-f con 0x7f1fa80a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7f1fae126640 10 monclient(hunting): picked mon.noname-i con 0x7f1fa813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7f1fae126640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa813ebb0 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7fe8bad9d640 1 -- 172.21.15.181:0/1862877433 >> v1:172.21.15.195:6791/0 conn(0x7fe8bc072950 legacy=0x7fe8bc13ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7f1fa77fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f1fa80a66d0 0x7f1fa81ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45560/0 (socket says 172.21.15.181:45560) 2024-09-13T10:30:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7f1fa77fe640 1 -- 172.21.15.181:0/743397885 learned_addr learned my addr 172.21.15.181:0/743397885 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa8137800 con 0x7f1fa80a66d0 2024-09-13T10:30:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7fe8ba59c640 1 -- 172.21.15.181:0/1862877433 >> v1:172.21.15.181:6793/0 conn(0x7fe8bc073180 legacy=0x7fe8bc1d7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7fe8bb59e640 1 -- 172.21.15.181:0/1862877433 >> v1:172.21.15.195:6789/0 conn(0x7fe8bc13bbd0 legacy=0x7fe8bc1da960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa81431e0 con 0x7f1fa813f9a0 2024-09-13T10:30:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7f1fae126640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7f1fae126640 10 monclient(hunting): authenticate will time out at 765.797870s 2024-09-13T10:30:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.292+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3845002669 0 0) 0x7fe8bc12dd50 con 0x7fe8bc073180 2024-09-13T10:30:26.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): my global_id is 4247 2024-09-13T10:30:26.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8a8003550 con 0x7fe8bc073180 2024-09-13T10:30:26.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3278296692 0 0) 0x7fe8bc12c290 con 0x7fe8bc13bbd0 2024-09-13T10:30:26.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): my global_id is 54307 2024-09-13T10:30:26.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8bc12dd50 con 0x7fe8bc13bbd0 2024-09-13T10:30:26.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa4277fe640 1 -- 172.21.15.181:0/3015697776 >> v1:172.21.15.181:6793/0 conn(0x7fa4300a71c0 legacy=0x7fa43009f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42ffff640 1 -- 172.21.15.181:0/3015697776 >> v1:172.21.15.195:6792/0 conn(0x7fa4300a66d0 legacy=0x7fa43009f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa434ebb640 1 -- 172.21.15.181:0/3015697776 >> v1:172.21.15.181:6790/0 conn(0x7fa4301445c0 legacy=0x7fa4301da790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1418296562 0 0) 0x7fe8bc12dd50 con 0x7fe8bc13bbd0 2024-09-13T10:30:26.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8bc12c290 con 0x7fe8bc13bbd0 2024-09-13T10:30:26.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe8b40019a0 con 0x7fe8bc13bbd0 2024-09-13T10:30:26.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:30:26.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7ff811aed640 1 -- 172.21.15.181:0/1695856789 >> v1:172.21.15.195:6792/0 conn(0x7ff80c0a6ab0 legacy=0x7ff80c1d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3682169685 0 0) 0x7fa4300a4350 con 0x7fa4300a66d0 2024-09-13T10:30:26.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): dump: 2024-09-13T10:30:26.371 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.372 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.373 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:26.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1443142352 0 0) 0x7fe8a8003550 con 0x7fe8bc073180 2024-09-13T10:30:26.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8bc12dd50 con 0x7fe8bc073180 2024-09-13T10:30:26.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe8b0001c10 con 0x7fe8bc073180 2024-09-13T10:30:26.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): my global_id is 54286 2024-09-13T10:30:26.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa414003520 con 0x7fa4300a66d0 2024-09-13T10:30:26.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3097158421 0 0) 0x7fa4300ac0b0 con 0x7fa4300a71c0 2024-09-13T10:30:26.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): my global_id is 4256 2024-09-13T10:30:26.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4300a4350 con 0x7fa4300a71c0 2024-09-13T10:30:26.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:26.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386294831 0 0) 0x7fa4280016e0 con 0x7fa4301445c0 2024-09-13T10:30:26.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): my global_id is 4277 2024-09-13T10:30:26.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4300ac0b0 con 0x7fa4301445c0 2024-09-13T10:30:26.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient(hunting): dump: 2024-09-13T10:30:26.375 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.375 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.375 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.376 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780302851 0 0) 0x7ff80c068a90 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2363783931 0 0) 0x7fe8bc12dd50 con 0x7fe8bc073180 2024-09-13T10:30:26.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7ff802ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7ff802ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7ff802ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7ff802ffd640 10 monclient(hunting): my global_id is 54295 2024-09-13T10:30:26.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7f0003520 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 >> v1:172.21.15.195:6791/0 conn(0x7fe8bc072950 legacy=0x7fe8bc13ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1219879437 0 0) 0x7fa414003520 con 0x7fa4300a66d0 2024-09-13T10:30:26.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4280016e0 con 0x7fa4300a66d0 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa420001ae0 con 0x7fa4300a66d0 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): dump: 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.381 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.382 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.382 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.382 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.382 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.382 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.382 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:26.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 >> v1:172.21.15.195:6789/0 conn(0x7fe8bc13bbd0 legacy=0x7fe8bc1da960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 monclient: found mon.e 2024-09-13T10:30:26.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8bc12cdf0 con 0x7fe8bc073180 2024-09-13T10:30:26.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8c1124640 5 monclient: authenticate success, global_id 4247 2024-09-13T10:30:26.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2450056654 0 0) 0x7fa4300ac0b0 con 0x7fa4301445c0 2024-09-13T10:30:26.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa414003520 con 0x7fa4301445c0 2024-09-13T10:30:26.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa428002010 con 0x7fa4301445c0 2024-09-13T10:30:26.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8c1124640 10 monclient: _renew_subs 2024-09-13T10:30:26.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8c1124640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe8bc1d03c0 con 0x7fe8bc073180 2024-09-13T10:30:26.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8c1124640 10 monclient: _renew_subs 2024-09-13T10:30:26.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8c1124640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.293+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fe8bc12b970 con 0x7fe8bc073180 2024-09-13T10:30:26.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:26.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 10 monclient(hunting): dump: 2024-09-13T10:30:26.385 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.385 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.385 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.385 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.385 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.385 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1096747674 0 0) 0x7fa4280016e0 con 0x7fa4300a66d0 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 >> v1:172.21.15.181:6793/0 conn(0x7fa4300a71c0 legacy=0x7fa43009f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 >> v1:172.21.15.181:6790/0 conn(0x7fa4301445c0 legacy=0x7fa4301da790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 1 monclient: found mon.i 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4300a1f10 con 0x7fa4300a66d0 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa43691e640 5 monclient: authenticate success, global_id 54286 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa43691e640 10 monclient: _renew_subs 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa43691e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa43691e640 1 -- 172.21.15.181:0/3015697776 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa43009ffa0 con 0x7fa4300a66d0 2024-09-13T10:30:26.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa43691e640 10 monclient: _renew_subs 2024-09-13T10:30:26.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa43691e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8b00038c0 con 0x7fe8bc073180 2024-09-13T10:30:26.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fe8a37fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa43691e640 1 -- 172.21.15.181:0/3015697776 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4300a17f0 con 0x7fa4300a66d0 2024-09-13T10:30:26.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa420001320 con 0x7fa4300a66d0 2024-09-13T10:30:26.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa420001c80 con 0x7fa4300a66d0 2024-09-13T10:30:26.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2803672141 0 0) 0x7ff7f0003520 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff80c068a90 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff7fc004cd0 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7ff802ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7ff802ffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:30:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7ff802ffd640 10 monclient(hunting): dump: 2024-09-13T10:30:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.391 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.391 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.391 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.391 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.391 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.391 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.391 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.391 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.391 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7ff802ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fa42d7fa640 10 monclient: dump: 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.392 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.393 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.393 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.393 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.393 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.393 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7fa42effd640 4 set_mon_vals no callback set 2024-09-13T10:30:26.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7fe8b959a640 4 set_mon_vals no callback set 2024-09-13T10:30:26.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe8b0003e30 con 0x7fe8bc073180 2024-09-13T10:30:26.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7fe8a37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7fe8a37fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:26.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7fe8a37fe640 10 monclient: dump: 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.394 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.395 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.395 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe8b00040d0 con 0x7fe8bc073180 2024-09-13T10:30:26.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7fe8c1124640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 --> v1:172.21.15.181:6793/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe89c000f80 con 0x7fe8bc073180 2024-09-13T10:30:26.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7ff8122ee640 1 -- 172.21.15.181:0/1695856789 >> v1:172.21.15.195:6791/0 conn(0x7ff80c0a66d0 legacy=0x7ff80c0a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.294+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 938108027 0 0) 0x7ff80c068a90 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 >> v1:172.21.15.181:6793/0 conn(0x7ff80c13f9a0 legacy=0x7ff80c1d6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 >> v1:172.21.15.195:6791/0 conn(0x7ff80c0a66d0 legacy=0x7ff80c0a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 1 monclient: found mon.i 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80c13f540 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff814552640 5 monclient: authenticate success, global_id 54295 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff814552640 10 monclient: _renew_subs 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff814552640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff80c13dd40 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff7fc005340 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff7fc004cd0 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff810aeb640 4 set_mon_vals no callback set 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff802ffd640 10 monclient: dump: 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.397 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.398 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.398 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.398 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.398 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.398 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.398 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.398 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff814552640 10 monclient: _renew_subs 2024-09-13T10:30:26.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff814552640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7ff80c0a2680 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7f1fa7fff640 1 -- 172.21.15.181:0/743397885 >> v1:172.21.15.195:6792/0 conn(0x7f1fa813f9a0 legacy=0x7f1fa81d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7f1fa77fe640 1 -- 172.21.15.181:0/743397885 >> v1:172.21.15.181:6792/0 conn(0x7f1fa80a66d0 legacy=0x7f1fa81ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2407057178 0 0) 0x7f1fa81431e0 con 0x7f1fa813f9a0 2024-09-13T10:30:26.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7f1f8ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7f1f8ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7f1f8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7f1f8ffff640 10 monclient(hunting): my global_id is 54304 2024-09-13T10:30:26.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f94003520 con 0x7f1fa813f9a0 2024-09-13T10:30:26.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.295+0000 7f1fa6ffd640 1 -- 172.21.15.181:0/743397885 >> v1:172.21.15.195:6789/0 conn(0x7f1fa80a6ab0 legacy=0x7f1fa81d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7fe8b004e0b0 con 0x7fe8bc073180 2024-09-13T10:30:26.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa420011bd0 con 0x7fa4300a66d0 2024-09-13T10:30:26.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 --> v1:172.21.15.195:6809/2152618500 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8b00038c0 con 0x7fe8a8046e30 2024-09-13T10:30:26.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7fe8b004e4f0 con 0x7fe8bc073180 2024-09-13T10:30:26.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7fe8a37fe640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-13T10:30:26.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7fe8bad9d640 10 monclient: get_auth_request con 0x7fe8a8040260 auth_method 0 2024-09-13T10:30:26.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034548870 0 0) 0x7f1fa8137800 con 0x7f1fa80a66d0 2024-09-13T10:30:26.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): my global_id is 4254 2024-09-13T10:30:26.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fa81431e0 con 0x7f1fa80a66d0 2024-09-13T10:30:26.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682375630 0 0) 0x7f1fa813ebb0 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7fa43691e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7fa43691e640 1 -- 172.21.15.181:0/3015697776 --> v1:172.21.15.195:6792/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa408000f80 con 0x7fa4300a66d0 2024-09-13T10:30:26.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): my global_id is 54316 2024-09-13T10:30:26.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fa8137800 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 454106248 0 0) 0x7f1f94003520 con 0x7f1fa813f9a0 2024-09-13T10:30:26.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1fa813ebb0 con 0x7f1fa813f9a0 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1fa0002000 con 0x7f1fa813f9a0 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): dump: 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3060404074 0 0) 0x7f1fa8137800 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f94003520 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f9c001d20 con 0x7f1fa80a6ab0 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:26.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient(hunting): dump: 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.406 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.406 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.406 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1437848519 0 0) 0x7f1fa813ebb0 con 0x7f1fa813f9a0 2024-09-13T10:30:26.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 >> v1:172.21.15.181:6792/0 conn(0x7f1fa80a66d0 legacy=0x7f1fa81ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 >> v1:172.21.15.195:6789/0 conn(0x7f1fa80a6ab0 legacy=0x7f1fa81d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff7fc0119d0 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7ff814552640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 --> v1:172.21.15.195:6792/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff80c1430b0 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 monclient: found mon.i 2024-09-13T10:30:26.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa813d0f0 con 0x7f1fa813f9a0 2024-09-13T10:30:26.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1fae126640 5 monclient: authenticate success, global_id 54304 2024-09-13T10:30:26.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1fa0003c40 con 0x7f1fa813f9a0 2024-09-13T10:30:26.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1fae126640 10 monclient: _renew_subs 2024-09-13T10:30:26.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1fae126640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa80a2b70 con 0x7f1fa813f9a0 2024-09-13T10:30:26.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7fe8bb59e640 10 monclient: get_auth_request con 0x7fe8a8046e30 auth_method 0 2024-09-13T10:30:26.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1fa0004230 con 0x7f1fa813f9a0 2024-09-13T10:30:26.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7f1f8ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7f1f8ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7f1f8ffff640 10 monclient: dump: 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.409 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.410 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.410 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.410 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7f1fae126640 10 monclient: _renew_subs 2024-09-13T10:30:26.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7f1fae126640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.296+0000 7f1fa5ffb640 4 set_mon_vals no callback set 2024-09-13T10:30:26.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f1fa813d8d0 con 0x7f1fa813f9a0 2024-09-13T10:30:26.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7fa42004e150 con 0x7fa4300a66d0 2024-09-13T10:30:26.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 --> v1:172.21.15.181:6800/3226877824 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4200048a0 con 0x7fa414047000 2024-09-13T10:30:26.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7fa4277fe640 10 monclient: get_auth_request con 0x7fa4140403c0 auth_method 0 2024-09-13T10:30:26.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== mon.7 v1:172.21.15.195:6792/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7fa4200137d0 con 0x7fa4300a66d0 2024-09-13T10:30:26.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7fa42d7fa640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-13T10:30:26.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7fa434ebb640 10 monclient: get_auth_request con 0x7fa414047000 auth_method 0 2024-09-13T10:30:26.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7ff7fc04de10 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.297+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 --> v1:172.21.15.195:6801/2714505324 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7f004af50 con 0x7ff7f0047240 2024-09-13T10:30:26.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.298+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 <== mon.7 v1:172.21.15.195:6792/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7ff7fc013670 con 0x7ff80c0a6ab0 2024-09-13T10:30:26.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.298+0000 7ff802ffd640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-13T10:30:26.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.298+0000 7ff812aef640 10 monclient: get_auth_request con 0x7ff7f0047240 auth_method 0 2024-09-13T10:30:26.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.298+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1fa00043d0 con 0x7f1fa813f9a0 2024-09-13T10:30:26.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.298+0000 7f1fae126640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:26.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.298+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.195:6792/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f1fa80a3240 con 0x7f1fa813f9a0 2024-09-13T10:30:26.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.298+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f1fa004e740 con 0x7f1fa813f9a0 2024-09-13T10:30:26.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.298+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.181:6804/3159017208 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f9404aab0 con 0x7f1f94046e00 2024-09-13T10:30:26.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.298+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== mon.7 v1:172.21.15.195:6792/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f1fa004e9c0 con 0x7f1fa813f9a0 2024-09-13T10:30:26.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.298+0000 7f1f8ffff640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-13T10:30:26.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.298+0000 7f1fa6ffd640 10 monclient: get_auth_request con 0x7f1f94046e00 auth_method 0 2024-09-13T10:30:26.414 INFO:teuthology.orchestra.run.smithi181.stdout:55834574853 2024-09-13T10:30:26.414 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T10:30:26.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.299+0000 7f1fa77fe640 10 monclient: get_auth_request con 0x7f1f94040200 auth_method 0 2024-09-13T10:30:26.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.299+0000 7ff8122ee640 10 monclient: get_auth_request con 0x7ff7f003fd20 auth_method 0 2024-09-13T10:30:26.415 INFO:teuthology.orchestra.run.smithi181.stdout:47244640261 2024-09-13T10:30:26.416 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T10:30:26.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.302+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== osd.3 v1:172.21.15.195:6809/2152618500 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fe8b00038c0 con 0x7fe8a8046e30 2024-09-13T10:30:26.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.302+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== osd.1 v1:172.21.15.181:6800/3226877824 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fa4200048a0 con 0x7fa414047000 2024-09-13T10:30:26.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.303+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 <== osd.5 v1:172.21.15.195:6801/2714505324 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7ff7f004af50 con 0x7ff7f0047240 2024-09-13T10:30:26.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.304+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== osd.0 v1:172.21.15.181:6804/3159017208 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f1f9404aab0 con 0x7f1f94046e00 2024-09-13T10:30:26.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.316+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 --> v1:172.21.15.195:6809/2152618500 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe89c002c70 con 0x7fe8a8046e30 2024-09-13T10:30:26.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.316+0000 7fe8a37fe640 1 -- 172.21.15.181:0/1862877433 <== osd.3 v1:172.21.15.195:6809/2152618500 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3685469309) 0x7fe89c002c70 con 0x7fe8a8046e30 2024-09-13T10:30:26.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.316+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 >> v1:172.21.15.195:6809/2152618500 conn(0x7fe8a8046e30 legacy=0x7fe8a8049270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.316+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 >> v1:172.21.15.195:6800/1839191919 conn(0x7fe8a8040260 legacy=0x7fe8a8042720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.316+0000 7fe8c1124640 10 monclient: shutdown 2024-09-13T10:30:26.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7fe8c1124640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.316+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 --> v1:172.21.15.195:6801/2714505324 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff80c050d00 con 0x7ff7f0047240 2024-09-13T10:30:26.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 >> v1:172.21.15.181:6793/0 conn(0x7fe8bc073180 legacy=0x7fe8bc1d7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7fe8bb59e640 1 -- 172.21.15.181:0/1862877433 reap_dead start 2024-09-13T10:30:26.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 shutdown_connections 2024-09-13T10:30:26.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 >> 172.21.15.181:0/1862877433 conn(0x7fe8bc0a45b0 msgr2=0x7fe8bc06fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 shutdown_connections 2024-09-13T10:30:26.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7fe8c1124640 1 -- 172.21.15.181:0/1862877433 wait complete. 2024-09-13T10:30:26.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7ff802ffd640 1 -- 172.21.15.181:0/1695856789 <== osd.5 v1:172.21.15.195:6801/2714505324 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2368054369) 0x7ff80c050d00 con 0x7ff7f0047240 2024-09-13T10:30:26.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 >> v1:172.21.15.195:6801/2714505324 conn(0x7ff7f0047240 legacy=0x7ff7f00496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff7f003fd20 legacy=0x7ff7f00421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7ff814552640 10 monclient: shutdown 2024-09-13T10:30:26.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7ff814552640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 >> v1:172.21.15.195:6792/0 conn(0x7ff80c0a6ab0 legacy=0x7ff80c1d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7ff812aef640 1 -- 172.21.15.181:0/1695856789 reap_dead start 2024-09-13T10:30:26.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 shutdown_connections 2024-09-13T10:30:26.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 >> 172.21.15.181:0/1695856789 conn(0x7ff80c0abcd0 msgr2=0x7ff80c0a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 shutdown_connections 2024-09-13T10:30:26.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.317+0000 7ff814552640 1 -- 172.21.15.181:0/1695856789 wait complete. 2024-09-13T10:30:26.422 INFO:teuthology.orchestra.run.smithi181.stdout:55834574853 2024-09-13T10:30:26.422 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T10:30:26.423 INFO:teuthology.orchestra.run.smithi181.stdout:51539607558 2024-09-13T10:30:26.423 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T10:30:26.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.332+0000 7fa43691e640 1 -- 172.21.15.181:0/3015697776 --> v1:172.21.15.181:6800/3226877824 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa408002c70 con 0x7fa414047000 2024-09-13T10:30:26.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.332+0000 7fa42d7fa640 1 -- 172.21.15.181:0/3015697776 <== osd.1 v1:172.21.15.181:6800/3226877824 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 258058390) 0x7fa408002c70 con 0x7fa414047000 2024-09-13T10:30:26.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.333+0000 7fa43691e640 1 -- 172.21.15.181:0/3015697776 >> v1:172.21.15.181:6800/3226877824 conn(0x7fa414047000 legacy=0x7fa414049440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.333+0000 7fa43691e640 1 -- 172.21.15.181:0/3015697776 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa4140403c0 legacy=0x7fa414042880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.333+0000 7fa43691e640 10 monclient: shutdown 2024-09-13T10:30:26.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.333+0000 7fa43691e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.333+0000 7fa43691e640 1 -- 172.21.15.181:0/3015697776 >> v1:172.21.15.195:6792/0 conn(0x7fa4300a66d0 legacy=0x7fa43009f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.333+0000 7fa434ebb640 1 -- 172.21.15.181:0/3015697776 reap_dead start 2024-09-13T10:30:26.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.333+0000 7fa43691e640 1 -- 172.21.15.181:0/3015697776 shutdown_connections 2024-09-13T10:30:26.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.333+0000 7fa43691e640 1 -- 172.21.15.181:0/3015697776 >> 172.21.15.181:0/3015697776 conn(0x7fa4300abcd0 msgr2=0x7fa430070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.333+0000 7fa43691e640 1 -- 172.21.15.181:0/3015697776 shutdown_connections 2024-09-13T10:30:26.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.333+0000 7fa43691e640 1 -- 172.21.15.181:0/3015697776 wait complete. 2024-09-13T10:30:26.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.334+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 --> v1:172.21.15.181:6804/3159017208 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1fa813c610 con 0x7f1f94046e00 2024-09-13T10:30:26.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.334+0000 7f1f8ffff640 1 -- 172.21.15.181:0/743397885 <== osd.0 v1:172.21.15.181:6804/3159017208 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 559749958) 0x7f1fa813c610 con 0x7f1f94046e00 2024-09-13T10:30:26.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.335+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 >> v1:172.21.15.181:6804/3159017208 conn(0x7f1f94046e00 legacy=0x7f1f94049240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.335+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1f94040200 legacy=0x7f1f940426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.335+0000 7f1fae126640 10 monclient: shutdown 2024-09-13T10:30:26.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.335+0000 7f1fae126640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.335+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 >> v1:172.21.15.195:6792/0 conn(0x7f1fa813f9a0 legacy=0x7f1fa81d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.335+0000 7f1fa7fff640 1 -- 172.21.15.181:0/743397885 reap_dead start 2024-09-13T10:30:26.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.335+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 shutdown_connections 2024-09-13T10:30:26.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.335+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 >> 172.21.15.181:0/743397885 conn(0x7f1fa80abcd0 msgr2=0x7f1fa80a8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.335+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 shutdown_connections 2024-09-13T10:30:26.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.335+0000 7f1fae126640 1 -- 172.21.15.181:0/743397885 wait complete. 2024-09-13T10:30:26.428 INFO:teuthology.orchestra.run.smithi181.stdout:55834574854 2024-09-13T10:30:26.429 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T10:30:26.429 INFO:teuthology.orchestra.run.smithi181.stdout:51539607556 2024-09-13T10:30:26.430 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T10:30:26.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.567+0000 7ff8edbec640 10 monclient: get_monmap_and_config 2024-09-13T10:30:26.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.567+0000 7ff8edbec640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.567+0000 7f12a6e60640 10 monclient: get_monmap_and_config 2024-09-13T10:30:26.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.567+0000 7ff8edbec640 10 monclient: monmap: 2024-09-13T10:30:26.569 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.569 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:26.568025+0000 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:26.568025+0000 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.570 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.567+0000 7f12a6e60640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.567+0000 7f12a6e60640 10 monclient: monmap: 2024-09-13T10:30:26.571 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.571 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.571 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:26.568026+0000 2024-09-13T10:30:26.571 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:26.568026+0000 2024-09-13T10:30:26.571 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.571 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.571 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.572 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.572 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.572 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.572 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.572 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.572 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.572 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.572 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.572 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.568+0000 7ff8edbec640 1 Processor -- start 2024-09-13T10:30:26.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.568+0000 7f12a6e60640 1 Processor -- start 2024-09-13T10:30:26.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.568+0000 7ff8edbec640 1 -- start start 2024-09-13T10:30:26.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.568+0000 7ff8edbec640 10 monclient: init 2024-09-13T10:30:26.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.568+0000 7f12a6e60640 1 -- start start 2024-09-13T10:30:26.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.568+0000 7f12a6e60640 10 monclient: init 2024-09-13T10:30:26.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.568+0000 7ff8edbec640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.568+0000 7ff8edbec640 10 monclient: _add_conns ranks=[2,5,4,8,3,6,1,0,7] 2024-09-13T10:30:26.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.568+0000 7ff8edbec640 10 monclient(hunting): picked mon.noname-b con 0x7ff8e80a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:26.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f12a6e60640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f12a6e60640 10 monclient: _add_conns ranks=[0,5,7,4,1,3,2,6,8] 2024-09-13T10:30:26.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f12a6e60640 10 monclient(hunting): picked mon.noname-a con 0x7f12a00a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:26.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7ff8edbec640 10 monclient(hunting): picked mon.noname-h con 0x7ff8e80a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:26.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7ff8edbec640 10 monclient(hunting): picked mon.noname-c con 0x7ff8e813f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:26.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f12a6e60640 10 monclient(hunting): picked mon.noname-h con 0x7f12a00a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:26.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7ff8edbec640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e80a5fe0 con 0x7ff8e80a66d0 2024-09-13T10:30:26.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7ff8edbec640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e80a8080 con 0x7ff8e813f9a0 2024-09-13T10:30:26.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f12a6e60640 10 monclient(hunting): picked mon.noname-i con 0x7f12a013f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:26.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f12a6e60640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a00a4bc0 con 0x7f12a00a6640 2024-09-13T10:30:26.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f129ffff640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f12a00a8340 0x7f12a0139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:54792/0 (socket says 172.21.15.181:54792) 2024-09-13T10:30:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7ff8edbec640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e80a42c0 con 0x7ff8e80a6ab0 2024-09-13T10:30:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7ff8edbec640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7ff8edbec640 10 monclient(hunting): authenticate will time out at 766.074096s 2024-09-13T10:30:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7ff8e77fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7ff8e80a66d0 0x7ff8e80a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48442/0 (socket says 172.21.15.181:48442) 2024-09-13T10:30:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7ff8e77fe640 1 -- 172.21.15.181:0/59837424 learned_addr learned my addr 172.21.15.181:0/59837424 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f129ffff640 1 -- 172.21.15.181:0/2167442101 learned_addr learned my addr 172.21.15.181:0/2167442101 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f12a4bfc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f12a00a6640 0x7f12a0139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50784/0 (socket says 172.21.15.181:50784) 2024-09-13T10:30:26.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f12a6e60640 1 -- 172.21.15.181:0/2167442101 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a013a320 con 0x7f12a00a8340 2024-09-13T10:30:26.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f12a6e60640 1 -- 172.21.15.181:0/2167442101 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a00a8100 con 0x7f12a013f750 2024-09-13T10:30:26.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f12a6e60640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.569+0000 7f12a6e60640 10 monclient(hunting): authenticate will time out at 766.074557s 2024-09-13T10:30:26.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e77fe640 1 -- 172.21.15.181:0/59837424 >> v1:172.21.15.181:6790/0 conn(0x7ff8e80a66d0 legacy=0x7ff8e80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e7fff640 1 -- 172.21.15.181:0/59837424 >> v1:172.21.15.181:6791/0 conn(0x7ff8e813f9a0 legacy=0x7ff8e8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e6ffd640 1 -- 172.21.15.181:0/59837424 >> v1:172.21.15.195:6791/0 conn(0x7ff8e80a6ab0 legacy=0x7ff8e80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7f12a4bfc640 1 -- 172.21.15.181:0/2167442101 >> v1:172.21.15.181:6789/0 conn(0x7f12a00a6640 legacy=0x7f12a0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e67fc640 1 -- 172.21.15.181:0/59837424 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201777417 0 0) 0x7ff8e80a5fe0 con 0x7ff8e80a66d0 2024-09-13T10:30:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e67fc640 10 monclient(hunting): my global_id is 4286 2024-09-13T10:30:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e67fc640 1 -- 172.21.15.181:0/59837424 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8d0003520 con 0x7ff8e80a66d0 2024-09-13T10:30:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e67fc640 1 -- 172.21.15.181:0/59837424 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128268970 0 0) 0x7ff8e80a8080 con 0x7ff8e813f9a0 2024-09-13T10:30:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e67fc640 10 monclient(hunting): my global_id is 4333 2024-09-13T10:30:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7ff8e67fc640 1 -- 172.21.15.181:0/59837424 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e80a5fe0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.571+0000 7f12a53fd640 1 -- 172.21.15.181:0/2167442101 >> v1:172.21.15.195:6792/0 conn(0x7f12a013f750 legacy=0x7f12a0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 1 -- 172.21.15.181:0/2167442101 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2069498671 0 0) 0x7f12a00a8100 con 0x7f12a013f750 2024-09-13T10:30:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 1 -- 172.21.15.181:0/59837424 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1800681789 0 0) 0x7ff8d0003520 con 0x7ff8e80a66d0 2024-09-13T10:30:26.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 1 -- 172.21.15.181:0/59837424 >> v1:172.21.15.195:6791/0 conn(0x7ff8e80a6ab0 legacy=0x7ff8e80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 1 -- 172.21.15.181:0/59837424 >> v1:172.21.15.181:6791/0 conn(0x7ff8e813f9a0 legacy=0x7ff8e8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient(hunting): my global_id is 54313 2024-09-13T10:30:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 1 -- 172.21.15.181:0/2167442101 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1290003520 con 0x7f12a013f750 2024-09-13T10:30:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 1 monclient: found mon.noname-b 2024-09-13T10:30:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 1 -- 172.21.15.181:0/2167442101 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654655121 0 0) 0x7f12a00a4bc0 con 0x7f12a00a6640 2024-09-13T10:30:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 1 -- 172.21.15.181:0/59837424 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e81464e0 con 0x7ff8e80a66d0 2024-09-13T10:30:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient(hunting): my global_id is 54243 2024-09-13T10:30:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 1 -- 172.21.15.181:0/2167442101 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12a00a8100 con 0x7f12a00a6640 2024-09-13T10:30:26.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 1 -- 172.21.15.181:0/59837424 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff8d8001ad0 con 0x7ff8e80a66d0 2024-09-13T10:30:26.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8edbec640 5 monclient: authenticate success, global_id 4286 2024-09-13T10:30:26.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8edbec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 10 monclient: dump: 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.591 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.592 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.592 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.592 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8edbec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 1 -- 172.21.15.181:0/59837424 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8d80048a0 con 0x7ff8e80a66d0 2024-09-13T10:30:26.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8e67fc640 1 -- 172.21.15.181:0/59837424 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff8d8004d90 con 0x7ff8e80a66d0 2024-09-13T10:30:26.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8edbec640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:26.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7ff8edbec640 4 set_mon_vals no callback set 2024-09-13T10:30:26.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 1 -- 172.21.15.181:0/2167442101 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3340810962 0 0) 0x7f12a00a8100 con 0x7f12a00a6640 2024-09-13T10:30:26.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 1 -- 172.21.15.181:0/2167442101 >> v1:172.21.15.195:6792/0 conn(0x7f12a013f750 legacy=0x7f12a0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 1 -- 172.21.15.181:0/2167442101 >> v1:172.21.15.195:6791/0 conn(0x7f12a00a8340 legacy=0x7f12a0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T10:30:26.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 1 monclient: found mon.noname-a 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 1 -- 172.21.15.181:0/2167442101 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a00a48e0 con 0x7f12a00a6640 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 1 -- 172.21.15.181:0/2167442101 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1294001a40 con 0x7f12a00a6640 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.572+0000 7f129f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f129f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f129f7fe640 10 monclient: dump: 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.595 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f129f7fe640 1 -- 172.21.15.181:0/2167442101 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f12940047e0 con 0x7f12a00a6640 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f12a6e60640 5 monclient: authenticate success, global_id 54243 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f12a6e60640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f129f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f12a6e60640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f12a6e60640 4 set_mon_vals no callback set 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f129f7fe640 1 -- 172.21.15.181:0/2167442101 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1294004d50 con 0x7f12a00a6640 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f129f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f129f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f129f7fe640 10 monclient: dump: 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.597 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.598 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.598 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.598 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.598 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.598 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.598 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.598 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.598 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.598 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.598 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.598 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7ff8e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7ff8e67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:26.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7ff8e67fc640 10 monclient: dump: 2024-09-13T10:30:26.599 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.599 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.600 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7ff8edbec640 10 monclient: shutdown 2024-09-13T10:30:26.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7ff8edbec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7ff8edbec640 1 -- 172.21.15.181:0/59837424 >> v1:172.21.15.181:6790/0 conn(0x7ff8e80a66d0 legacy=0x7ff8e80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7ff8edbec640 1 -- 172.21.15.181:0/59837424 shutdown_connections 2024-09-13T10:30:26.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7ff8edbec640 1 -- 172.21.15.181:0/59837424 >> 172.21.15.181:0/59837424 conn(0x7ff8e80abcd0 msgr2=0x7ff8e80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7ff8edbec640 1 -- 172.21.15.181:0/59837424 shutdown_connections 2024-09-13T10:30:26.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7ff8edbec640 1 -- 172.21.15.181:0/59837424 wait complete. 2024-09-13T10:30:26.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f12a6e60640 10 monclient: shutdown 2024-09-13T10:30:26.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f12a6e60640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.573+0000 7f12a6e60640 1 -- 172.21.15.181:0/2167442101 >> v1:172.21.15.181:6789/0 conn(0x7f12a00a6640 legacy=0x7f12a0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.574+0000 7f12a6e60640 1 -- 172.21.15.181:0/2167442101 shutdown_connections 2024-09-13T10:30:26.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.574+0000 7f12a6e60640 1 -- 172.21.15.181:0/2167442101 >> 172.21.15.181:0/2167442101 conn(0x7f12a0077170 msgr2=0x7f12a00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.574+0000 7f12a6e60640 1 -- 172.21.15.181:0/2167442101 shutdown_connections 2024-09-13T10:30:26.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.574+0000 7f12a6e60640 1 -- 172.21.15.181:0/2167442101 wait complete. 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.574+0000 7ff8edbec640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.574+0000 7ff8edbec640 10 monclient: monmap: 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.603 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.604 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.604 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.604 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.604 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.604 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.574+0000 7ff8edbec640 1 Processor -- start 2024-09-13T10:30:26.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.575+0000 7f12a6e60640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.575+0000 7ff8edbec640 1 -- start start 2024-09-13T10:30:26.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.575+0000 7f12a6e60640 10 monclient: monmap: 2024-09-13T10:30:26.605 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.605 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:26.605 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:26.605 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:26.605 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.605 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:26.605 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.605 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.605 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.605 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.605 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.606 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.606 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.606 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.606 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.606 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.575+0000 7ff8edbec640 10 monclient: init 2024-09-13T10:30:26.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.575+0000 7ff8edbec640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.575+0000 7f12a6e60640 1 Processor -- start 2024-09-13T10:30:26.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.575+0000 7ff8edbec640 10 monclient: _add_conns ranks=[3,1,8,4,5,0,7,2,6] 2024-09-13T10:30:26.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.575+0000 7ff8edbec640 10 monclient(hunting): picked mon.noname-g con 0x7ff8e80a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:26.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.575+0000 7f12a6e60640 1 -- start start 2024-09-13T10:30:26.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.575+0000 7f12a6e60640 10 monclient: init 2024-09-13T10:30:26.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.575+0000 7ff8edbec640 10 monclient(hunting): picked mon.noname-f con 0x7ff8e80a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:26.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.576+0000 7ff8edbec640 10 monclient(hunting): picked mon.noname-e con 0x7ff8e813f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:26.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.576+0000 7ff8e7fff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7ff8e813f9a0 0x7ff8e81db490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39790/0 (socket says 172.21.15.181:39790) 2024-09-13T10:30:26.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.576+0000 7ff8e7fff640 1 -- 172.21.15.181:0/468090514 learned_addr learned my addr 172.21.15.181:0/468090514 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.576+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e80734f0 con 0x7ff8e80a6ab0 2024-09-13T10:30:26.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.576+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e8139090 con 0x7ff8e80a66d0 2024-09-13T10:30:26.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.576+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e8142db0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.576+0000 7ff8edbec640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.576+0000 7ff8edbec640 10 monclient(hunting): authenticate will time out at 766.081371s 2024-09-13T10:30:26.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.576+0000 7f12a6e60640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.576+0000 7f12a6e60640 10 monclient: _add_conns ranks=[8,0,4,1,3,2,5,7,6] 2024-09-13T10:30:26.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.576+0000 7f12a6e60640 10 monclient(hunting): picked mon.noname-e con 0x7f12a00a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:26.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.577+0000 7f12a6e60640 10 monclient(hunting): picked mon.noname-a con 0x7f12a013f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:26.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.577+0000 7f12a6e60640 10 monclient(hunting): picked mon.noname-c con 0x7f12a01d4310 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:26.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.577+0000 7f12a6e60640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a00a0350 con 0x7f12a013f750 2024-09-13T10:30:26.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.577+0000 7f12a6e60640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a00a0920 con 0x7f12a01d4310 2024-09-13T10:30:26.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.577+0000 7f12a6e60640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a0142b90 con 0x7f12a00a8340 2024-09-13T10:30:26.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.577+0000 7f129ffff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f12a013f750 0x7f12a009da80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50800/0 (socket says 172.21.15.181:50800) 2024-09-13T10:30:26.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.577+0000 7f129ffff640 1 -- 172.21.15.181:0/1045202290 learned_addr learned my addr 172.21.15.181:0/1045202290 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.577+0000 7f12a6e60640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.577+0000 7f12a6e60640 10 monclient(hunting): authenticate will time out at 766.082202s 2024-09-13T10:30:26.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8e7fff640 1 -- 172.21.15.181:0/468090514 >> v1:172.21.15.181:6793/0 conn(0x7ff8e813f9a0 legacy=0x7ff8e81db490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8e6ffd640 1 -- 172.21.15.181:0/468090514 >> v1:172.21.15.195:6789/0 conn(0x7ff8e80a6ab0 legacy=0x7ff8e8071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8e77fe640 1 -- 172.21.15.181:0/468090514 >> v1:172.21.15.195:6790/0 conn(0x7ff8e80a66d0 legacy=0x7ff8e80713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822358069 0 0) 0x7ff8e8142db0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): my global_id is 4265 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8d4003520 con 0x7ff8e813f9a0 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3187610616 0 0) 0x7ff8e81464e0 con 0x7ff8e80a66d0 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): my global_id is 4269 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e8142db0 con 0x7ff8e80a66d0 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1366338342 0 0) 0x7ff8e80734f0 con 0x7ff8e80a6ab0 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): my global_id is 54325 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e81464e0 con 0x7ff8e80a6ab0 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3595879291 0 0) 0x7ff8d4003520 con 0x7ff8e813f9a0 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8e80734f0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff8e0003990 con 0x7ff8e813f9a0 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): dump: 2024-09-13T10:30:26.614 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.615 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.578+0000 7ff8cffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1616180549 0 0) 0x7ff8e8142db0 con 0x7ff8e80a66d0 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8d4003520 con 0x7ff8e80a66d0 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff8d8004d90 con 0x7ff8e80a66d0 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 10 monclient(hunting): dump: 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.616 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3852728130 0 0) 0x7ff8e80734f0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 >> v1:172.21.15.195:6790/0 conn(0x7ff8e80a66d0 legacy=0x7ff8e80713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 >> v1:172.21.15.195:6789/0 conn(0x7ff8e80a6ab0 legacy=0x7ff8e8071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 1 monclient: found mon.e 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e813efb0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8edbec640 5 monclient: authenticate success, global_id 4265 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8edbec640 10 monclient: _renew_subs 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8edbec640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e80721d0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8edbec640 10 monclient: _renew_subs 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8edbec640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7ff8e813a9b0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8e0003e50 con 0x7ff8e813f9a0 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff8e0004340 con 0x7ff8e813f9a0 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8cffff640 10 monclient: dump: 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.619 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.620 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.620 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.620 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.620 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.620 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.620 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.620 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7ff8e5ffb640 4 set_mon_vals no callback set 2024-09-13T10:30:26.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7f12a53fd640 1 -- 172.21.15.181:0/1045202290 >> v1:172.21.15.181:6791/0 conn(0x7f12a01d4310 legacy=0x7f12a01d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7f12a4bfc640 1 -- 172.21.15.181:0/1045202290 >> v1:172.21.15.181:6793/0 conn(0x7f12a00a8340 legacy=0x7f12a009d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7f129ffff640 1 -- 172.21.15.181:0/1045202290 >> v1:172.21.15.181:6789/0 conn(0x7f12a013f750 legacy=0x7f12a009da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3214720429 0 0) 0x7f1290003520 con 0x7f12a01d4310 2024-09-13T10:30:26.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7f129d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7f129d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7f129d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7f129d7fa640 10 monclient(hunting): my global_id is 4342 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1284003550 con 0x7f12a01d4310 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.579+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578792944 0 0) 0x7f12a00a0350 con 0x7f12a013f750 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7f129d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7f129d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7f129d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7f129d7fa640 10 monclient(hunting): my global_id is 54252 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1290003520 con 0x7f12a013f750 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3517218049 0 0) 0x7f1284003550 con 0x7f12a01d4310 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12a00a0350 con 0x7f12a01d4310 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1298002070 con 0x7f12a01d4310 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7f129d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7f129d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7f129d7fa640 10 monclient(hunting): dump: 2024-09-13T10:30:26.622 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.623 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.624 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7f129d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:26.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff8e00044e0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521060209 0 0) 0x7f12a0142b90 con 0x7f12a00a8340 2024-09-13T10:30:26.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 10 monclient(hunting): my global_id is 4274 2024-09-13T10:30:26.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1284003550 con 0x7f12a00a8340 2024-09-13T10:30:26.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 730952496 0 0) 0x7f12a00a0350 con 0x7f12a01d4310 2024-09-13T10:30:26.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.580+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7ff8e004e4f0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7ff8edbec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7ff8edbec640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 >> v1:172.21.15.181:6793/0 conn(0x7f12a00a8340 legacy=0x7f12a009d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7ff8edbec640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e806cab0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 >> v1:172.21.15.181:6789/0 conn(0x7f12a013f750 legacy=0x7f12a009da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 1 monclient: found mon.c 2024-09-13T10:30:26.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:26.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a00a9c40 con 0x7f12a01d4310 2024-09-13T10:30:26.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f129d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f12a6e60640 5 monclient: authenticate success, global_id 4342 2024-09-13T10:30:26.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f12a6e60640 10 monclient: _renew_subs 2024-09-13T10:30:26.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f12a6e60640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:26.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f12a6e60640 1 -- 172.21.15.181:0/1045202290 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f12a009ee60 con 0x7f12a01d4310 2024-09-13T10:30:26.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f12a6e60640 10 monclient: _renew_subs 2024-09-13T10:30:26.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f12a6e60640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:26.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7f12a6e60640 1 -- 172.21.15.181:0/1045202290 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f12a00a11c0 con 0x7f12a01d4310 2024-09-13T10:30:26.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.581+0000 7ff8e77fe640 10 monclient: get_auth_request con 0x7ff8d403ffe0 auth_method 0 2024-09-13T10:30:26.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.582+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1298003c40 con 0x7f12a01d4310 2024-09-13T10:30:26.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.582+0000 7f129d7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.582+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1298004170 con 0x7f12a01d4310 2024-09-13T10:30:26.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.582+0000 7f129d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.582+0000 7f129d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:26.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.582+0000 7f129d7fa640 10 monclient: dump: 2024-09-13T10:30:26.630 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.630 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.630 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.630 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.582+0000 7f129e7fc640 4 set_mon_vals no callback set 2024-09-13T10:30:26.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.582+0000 7f12a6e60640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.582+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1298004390 con 0x7f12a01d4310 2024-09-13T10:30:26.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.583+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f129804e460 con 0x7f12a01d4310 2024-09-13T10:30:26.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.583+0000 7f12a6e60640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.583+0000 7f12a6e60640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:26.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.583+0000 7f12a6e60640 1 -- 172.21.15.181:0/1045202290 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1280005080 con 0x7f12a01d4310 2024-09-13T10:30:26.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.583+0000 7f12a4bfc640 10 monclient: get_auth_request con 0x7f128403fac0 auth_method 0 2024-09-13T10:30:26.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.586+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7ff8e806cab0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.587+0000 7ff8cffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.587+0000 7ff8cffff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:26.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.588+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f12a00a0920 con 0x7f12a01d4310 2024-09-13T10:30:26.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.588+0000 7f129d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.588+0000 7f129d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:26.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.606+0000 7f7f979d1640 10 monclient: get_monmap_and_config 2024-09-13T10:30:26.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.606+0000 7f7f979d1640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.606+0000 7f7f979d1640 10 monclient: monmap: 2024-09-13T10:30:26.634 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.634 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.634 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:26.606783+0000 2024-09-13T10:30:26.634 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:26.606783+0000 2024-09-13T10:30:26.634 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.634 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.634 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.634 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.634 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.606+0000 7f7f979d1640 1 Processor -- start 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.607+0000 7f7f979d1640 1 -- start start 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.607+0000 7f7f979d1640 10 monclient: init 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.607+0000 7f7f979d1640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.607+0000 7f7f979d1640 10 monclient: _add_conns ranks=[2,4,6,8,1,3,0,5,7] 2024-09-13T10:30:26.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.607+0000 7f7f979d1640 10 monclient(hunting): picked mon.noname-b con 0x7f7f900a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:26.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.607+0000 7fbc337c3640 10 monclient: get_monmap_and_config 2024-09-13T10:30:26.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.607+0000 7fbc337c3640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.607+0000 7f7f979d1640 10 monclient(hunting): picked mon.noname-c con 0x7f7f900a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:26.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.607+0000 7fbc337c3640 10 monclient: monmap: 2024-09-13T10:30:26.636 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.637 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.637 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:26.608484+0000 2024-09-13T10:30:26.637 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:26.608484+0000 2024-09-13T10:30:26.637 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.637 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.637 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.637 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.637 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.637 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.637 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.637 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.637 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.638 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.638 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.638 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7f7f94f6c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f7f900a6ab0 0x7f7f900a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38398/0 (socket says 172.21.15.181:38398) 2024-09-13T10:30:26.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7f7f9576d640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f7f900a66d0 0x7f7f900a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48450/0 (socket says 172.21.15.181:48450) 2024-09-13T10:30:26.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7f7f94f6c640 1 -- 172.21.15.181:0/1029945417 learned_addr learned my addr 172.21.15.181:0/1029945417 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7f7f979d1640 10 monclient(hunting): picked mon.noname-d con 0x7f7f9013f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:26.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7f7f979d1640 1 -- 172.21.15.181:0/1029945417 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f900a5fe0 con 0x7f7f900a66d0 2024-09-13T10:30:26.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7fb89c0ef640 10 monclient: get_monmap_and_config 2024-09-13T10:30:26.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7fb89c0ef640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7fb89c0ef640 10 monclient: monmap: 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:26.608945+0000 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:26.608945+0000 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.640 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.641 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.641 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7f7f979d1640 1 -- 172.21.15.181:0/1029945417 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f900a8080 con 0x7f7f900a6ab0 2024-09-13T10:30:26.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7f7f979d1640 1 -- 172.21.15.181:0/1029945417 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f900a42c0 con 0x7f7f9013f9a0 2024-09-13T10:30:26.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7fbc337c3640 1 Processor -- start 2024-09-13T10:30:26.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7f7f979d1640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7f7f979d1640 10 monclient(hunting): authenticate will time out at 766.113704s 2024-09-13T10:30:26.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7fbc337c3640 1 -- start start 2024-09-13T10:30:26.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.608+0000 7fbc337c3640 10 monclient: init 2024-09-13T10:30:26.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fb89c0ef640 1 Processor -- start 2024-09-13T10:30:26.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fb89c0ef640 1 -- start start 2024-09-13T10:30:26.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fb89c0ef640 10 monclient: init 2024-09-13T10:30:26.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fbc337c3640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fbc337c3640 10 monclient: _add_conns ranks=[6,4,8,1,2,0,7,3,5] 2024-09-13T10:30:26.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fbc337c3640 10 monclient(hunting): picked mon.noname-d con 0x7fbc2c0a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:26.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fbc337c3640 10 monclient(hunting): picked mon.noname-c con 0x7fbc2c0a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:26.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fbc337c3640 10 monclient(hunting): picked mon.noname-e con 0x7fbc2c13f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:26.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fbc337c3640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2c0a5fe0 con 0x7fbc2c0a6ab0 2024-09-13T10:30:26.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fbc337c3640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2c0a8080 con 0x7fbc2c0a66d0 2024-09-13T10:30:26.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fbc3155f640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fbc2c0a66d0 0x7fbc2c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45574/0 (socket says 172.21.15.181:45574) 2024-09-13T10:30:26.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fbc3155f640 1 -- 172.21.15.181:0/2227830803 learned_addr learned my addr 172.21.15.181:0/2227830803 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fbc337c3640 1 -- 172.21.15.181:0/2227830803 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2c0a42c0 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fbc337c3640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fbc337c3640 10 monclient(hunting): authenticate will time out at 766.114790s 2024-09-13T10:30:26.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fb89c0ef640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.609+0000 7fb89c0ef640 10 monclient: _add_conns ranks=[6,3,2,0,5,8,1,4,7] 2024-09-13T10:30:26.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7fb89c0ef640 10 monclient(hunting): picked mon.noname-d con 0x7fb89412d4d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:26.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7fb89c0ef640 10 monclient(hunting): picked mon.noname-g con 0x7fb894074150 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:26.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7fb89c0ef640 10 monclient(hunting): picked mon.noname-b con 0x7fb89413d800 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:26.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7fb89a68c640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fb89413d800 0x7fb89413fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48456/0 (socket says 172.21.15.181:48456) 2024-09-13T10:30:26.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7fb89a68c640 1 -- 172.21.15.181:0/4045832688 learned_addr learned my addr 172.21.15.181:0/4045832688 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f94f6c640 1 -- 172.21.15.181:0/1029945417 >> v1:172.21.15.181:6791/0 conn(0x7f7f900a6ab0 legacy=0x7f7f900a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7fb89c0ef640 1 -- 172.21.15.181:0/4045832688 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb89412dfc0 con 0x7fb89413d800 2024-09-13T10:30:26.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7fb89c0ef640 1 -- 172.21.15.181:0/4045832688 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb894072e40 con 0x7fb894074150 2024-09-13T10:30:26.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f9576d640 1 -- 172.21.15.181:0/1029945417 >> v1:172.21.15.181:6790/0 conn(0x7f7f900a66d0 legacy=0x7f7f900a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7fb89c0ef640 1 -- 172.21.15.181:0/4045832688 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb894073490 con 0x7fb89412d4d0 2024-09-13T10:30:26.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7fb89c0ef640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7fb89c0ef640 10 monclient(hunting): authenticate will time out at 766.115404s 2024-09-13T10:30:26.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 1 -- 172.21.15.181:0/1029945417 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991299340 0 0) 0x7f7f900a8080 con 0x7f7f900a6ab0 2024-09-13T10:30:26.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 10 monclient(hunting): my global_id is 4351 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 1 -- 172.21.15.181:0/1029945417 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f7c003520 con 0x7f7f900a6ab0 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 1 -- 172.21.15.181:0/1029945417 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881528813 0 0) 0x7f7f900a5fe0 con 0x7f7f900a66d0 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 10 monclient(hunting): my global_id is 4295 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 1 -- 172.21.15.181:0/1029945417 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f900a8080 con 0x7f7f900a66d0 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f95f6e640 1 -- 172.21.15.181:0/1029945417 >> v1:172.21.15.181:6792/0 conn(0x7f7f9013f9a0 legacy=0x7f7f90141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 1 -- 172.21.15.181:0/1029945417 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4262092002 0 0) 0x7f7f7c003520 con 0x7f7f900a6ab0 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 1 -- 172.21.15.181:0/1029945417 >> v1:172.21.15.181:6792/0 conn(0x7f7f9013f9a0 legacy=0x7f7f90141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 1 -- 172.21.15.181:0/1029945417 >> v1:172.21.15.181:6790/0 conn(0x7f7f900a66d0 legacy=0x7f7f900a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 1 monclient: found mon.noname-c 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.610+0000 7f7f87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 1 -- 172.21.15.181:0/1029945417 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f901464e0 con 0x7f7f900a6ab0 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 1 -- 172.21.15.181:0/1029945417 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f80001ae0 con 0x7f7f900a6ab0 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 10 monclient: dump: 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.650 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f979d1640 5 monclient: authenticate success, global_id 4351 2024-09-13T10:30:26.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f979d1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 1 -- 172.21.15.181:0/1029945417 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f800048a0 con 0x7f7f900a6ab0 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f979d1640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 1 -- 172.21.15.181:0/1029945417 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f80004e50 con 0x7f7f900a6ab0 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f979d1640 4 set_mon_vals no callback set 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f87fff640 10 monclient: dump: 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.653 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7fbc3155f640 1 -- 172.21.15.181:0/2227830803 >> v1:172.21.15.181:6792/0 conn(0x7fbc2c0a66d0 legacy=0x7fbc2c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc31d60640 1 -- 172.21.15.181:0/2227830803 >> v1:172.21.15.181:6793/0 conn(0x7fbc2c13f9a0 legacy=0x7fbc2c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f979d1640 10 monclient: shutdown 2024-09-13T10:30:26.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f979d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.611+0000 7f7f979d1640 1 -- 172.21.15.181:0/1029945417 >> v1:172.21.15.181:6791/0 conn(0x7f7f900a6ab0 legacy=0x7f7f900a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7f7f979d1640 1 -- 172.21.15.181:0/1029945417 shutdown_connections 2024-09-13T10:30:26.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7f7f979d1640 1 -- 172.21.15.181:0/1029945417 >> 172.21.15.181:0/1029945417 conn(0x7f7f900abcd0 msgr2=0x7f7f900ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 1 -- 172.21.15.181:0/2227830803 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985652246 0 0) 0x7fbc2c0a8080 con 0x7fbc2c0a66d0 2024-09-13T10:30:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient(hunting): my global_id is 4272 2024-09-13T10:30:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 1 -- 172.21.15.181:0/2227830803 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc18003520 con 0x7fbc2c0a66d0 2024-09-13T10:30:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 1 -- 172.21.15.181:0/2227830803 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 867854758 0 0) 0x7fbc2c0a42c0 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient(hunting): my global_id is 4283 2024-09-13T10:30:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 1 -- 172.21.15.181:0/2227830803 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc2c0a8080 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb89a68c640 1 -- 172.21.15.181:0/4045832688 >> v1:172.21.15.181:6790/0 conn(0x7fb89413d800 legacy=0x7fb89413fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 1 -- 172.21.15.181:0/2227830803 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2456754648 0 0) 0x7fbc2c0a8080 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 1 -- 172.21.15.181:0/2227830803 >> v1:172.21.15.181:6792/0 conn(0x7fbc2c0a66d0 legacy=0x7fbc2c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 1 -- 172.21.15.181:0/2227830803 >> v1:172.21.15.181:6791/0 conn(0x7fbc2c0a6ab0 legacy=0x7fbc2c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc30d5e640 1 -- 172.21.15.181:0/2227830803 >> v1:172.21.15.181:6791/0 conn(0x7fbc2c0a6ab0 legacy=0x7fbc2c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 1 monclient: found mon.noname-e 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 1 -- 172.21.15.181:0/2227830803 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2c1464e0 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 1 -- 172.21.15.181:0/2227830803 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbc24001e60 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:26.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb89968a640 1 -- 172.21.15.181:0/4045832688 >> v1:172.21.15.195:6790/0 conn(0x7fb894074150 legacy=0x7fb89413c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient: dump: 2024-09-13T10:30:26.658 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.658 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.658 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.658 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.658 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.658 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.659 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.659 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.659 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.659 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.659 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.659 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.659 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.659 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.659 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.659 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc337c3640 5 monclient: authenticate success, global_id 4283 2024-09-13T10:30:26.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc337c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 1 -- 172.21.15.181:0/4045832688 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3355745896 0 0) 0x7fb89412dfc0 con 0x7fb89413d800 2024-09-13T10:30:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 1 -- 172.21.15.181:0/2227830803 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbc24003990 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc337c3640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc337c3640 4 set_mon_vals no callback set 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 1 -- 172.21.15.181:0/2227830803 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbc24003e80 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fbc23fff640 10 monclient: dump: 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.662 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 10 monclient(hunting): my global_id is 4304 2024-09-13T10:30:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 1 -- 172.21.15.181:0/4045832688 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb880003520 con 0x7fb89413d800 2024-09-13T10:30:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7f7f979d1640 1 -- 172.21.15.181:0/1029945417 shutdown_connections 2024-09-13T10:30:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 1 -- 172.21.15.181:0/4045832688 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3493320257 0 0) 0x7fb894072e40 con 0x7fb894074150 2024-09-13T10:30:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 10 monclient(hunting): my global_id is 4278 2024-09-13T10:30:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 1 -- 172.21.15.181:0/4045832688 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb89412dfc0 con 0x7fb894074150 2024-09-13T10:30:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7f7f979d1640 1 -- 172.21.15.181:0/1029945417 wait complete. 2024-09-13T10:30:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.612+0000 7fb898e89640 1 -- 172.21.15.181:0/4045832688 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1536677693 0 0) 0x7fb880003520 con 0x7fb89413d800 2024-09-13T10:30:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 1 -- 172.21.15.181:0/4045832688 >> v1:172.21.15.181:6792/0 conn(0x7fb89412d4d0 legacy=0x7fb89412d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T10:30:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 1 -- 172.21.15.181:0/4045832688 >> v1:172.21.15.195:6790/0 conn(0x7fb894074150 legacy=0x7fb89413c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 1 monclient: found mon.noname-b 2024-09-13T10:30:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 1 -- 172.21.15.181:0/4045832688 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb894073770 con 0x7fb89413d800 2024-09-13T10:30:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 1 -- 172.21.15.181:0/4045832688 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb88c001e60 con 0x7fb89413d800 2024-09-13T10:30:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fbc337c3640 10 monclient: shutdown 2024-09-13T10:30:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fbc337c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fbc337c3640 1 -- 172.21.15.181:0/2227830803 >> v1:172.21.15.181:6793/0 conn(0x7fbc2c13f9a0 legacy=0x7fbc2c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 10 monclient: dump: 2024-09-13T10:30:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.668 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7f1257a48640 10 monclient: get_monmap_and_config 2024-09-13T10:30:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7f1257a48640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7f1257a48640 10 monclient: monmap: 2024-09-13T10:30:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:26.614346+0000 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:26.614346+0000 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.669 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fbc337c3640 1 -- 172.21.15.181:0/2227830803 shutdown_connections 2024-09-13T10:30:26.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fbc337c3640 1 -- 172.21.15.181:0/2227830803 >> 172.21.15.181:0/2227830803 conn(0x7fbc2c0abcd0 msgr2=0x7fbc2c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7f7f979d1640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb89c0ef640 5 monclient: authenticate success, global_id 4304 2024-09-13T10:30:26.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7f7f979d1640 10 monclient: monmap: 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.671 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.672 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.672 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.672 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fbc337c3640 1 -- 172.21.15.181:0/2227830803 shutdown_connections 2024-09-13T10:30:26.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb89c0ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 1 -- 172.21.15.181:0/4045832688 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb88c004c20 con 0x7fb89413d800 2024-09-13T10:30:26.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7fbc337c3640 1 -- 172.21.15.181:0/2227830803 wait complete. 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 1 -- 172.21.15.181:0/4045832688 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb88c005110 con 0x7fb89413d800 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb89c0ef640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb89c0ef640 4 set_mon_vals no callback set 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.613+0000 7fb898e89640 10 monclient: dump: 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.675 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7f1257a48640 1 Processor -- start 2024-09-13T10:30:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7f7f979d1640 1 Processor -- start 2024-09-13T10:30:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7f7f979d1640 1 -- start start 2024-09-13T10:30:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7f7f979d1640 10 monclient: init 2024-09-13T10:30:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7f1257a48640 1 -- start start 2024-09-13T10:30:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7f1257a48640 10 monclient: init 2024-09-13T10:30:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7fb89c0ef640 10 monclient: shutdown 2024-09-13T10:30:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7fb89c0ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7fb89c0ef640 1 -- 172.21.15.181:0/4045832688 >> v1:172.21.15.181:6790/0 conn(0x7fb89413d800 legacy=0x7fb89413fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7f7f979d1640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7f7f979d1640 10 monclient: _add_conns ranks=[6,5,4,8,7,0,2,3,1] 2024-09-13T10:30:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.614+0000 7f7f979d1640 10 monclient(hunting): picked mon.noname-d con 0x7f7f900a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f7f979d1640 10 monclient(hunting): picked mon.noname-h con 0x7f7f900a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f7f979d1640 10 monclient(hunting): picked mon.noname-c con 0x7f7f9013f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f7f979d1640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f9013cfa0 con 0x7f7f9013f9a0 2024-09-13T10:30:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f7f979d1640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f9013ea60 con 0x7f7f900a6ab0 2024-09-13T10:30:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f7f979d1640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f9013ed40 con 0x7f7f900a66d0 2024-09-13T10:30:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f7f979d1640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f7f979d1640 10 monclient(hunting): authenticate will time out at 766.120071s 2024-09-13T10:30:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7fbc337c3640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7fbc337c3640 10 monclient: monmap: 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.680 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f7f95f6e640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f7f9013f9a0 0x7f7f901d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38426/0 (socket says 172.21.15.181:38426) 2024-09-13T10:30:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7fb89c0ef640 1 -- 172.21.15.181:0/4045832688 shutdown_connections 2024-09-13T10:30:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7fb89c0ef640 1 -- 172.21.15.181:0/4045832688 >> 172.21.15.181:0/4045832688 conn(0x7fb89406e6e0 msgr2=0x7fb89406eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f7f95f6e640 1 -- 172.21.15.181:0/2799913251 learned_addr learned my addr 172.21.15.181:0/2799913251 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f1257a48640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7fb89c0ef640 1 -- 172.21.15.181:0/4045832688 shutdown_connections 2024-09-13T10:30:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f1257a48640 10 monclient: _add_conns ranks=[7,2,1,0,6,5,4,3,8] 2024-09-13T10:30:26.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f1257a48640 10 monclient(hunting): picked mon.noname-i con 0x7f12501398c0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:26.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f1257a48640 10 monclient(hunting): picked mon.noname-b con 0x7f125006e720 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:26.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f1257a48640 10 monclient(hunting): picked mon.noname-f con 0x7f1250073880 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:26.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f1257a48640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12500a5e10 con 0x7f1250073880 2024-09-13T10:30:26.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f1257a48640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1250070640 con 0x7f125006e720 2024-09-13T10:30:26.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f1257a48640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12500a6090 con 0x7f12501398c0 2024-09-13T10:30:26.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f1257a48640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7fb89c0ef640 1 -- 172.21.15.181:0/4045832688 wait complete. 2024-09-13T10:30:26.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f1257a48640 10 monclient(hunting): authenticate will time out at 766.120539s 2024-09-13T10:30:26.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f1254fe3640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f125006e720 0x7f1250073170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48472/0 (socket says 172.21.15.181:48472) 2024-09-13T10:30:26.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7f1254fe3640 1 -- 172.21.15.181:0/3887294633 learned_addr learned my addr 172.21.15.181:0/3887294633 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7fbc337c3640 1 Processor -- start 2024-09-13T10:30:26.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7fbc337c3640 1 -- start start 2024-09-13T10:30:26.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.615+0000 7fbc337c3640 10 monclient: init 2024-09-13T10:30:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.616+0000 7fb89c0ef640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.616+0000 7fb89c0ef640 10 monclient: monmap: 2024-09-13T10:30:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.685 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.616+0000 7fbc337c3640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.616+0000 7fbc337c3640 10 monclient: _add_conns ranks=[4,1,2,3,5,6,0,7,8] 2024-09-13T10:30:26.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.616+0000 7fbc337c3640 10 monclient(hunting): picked mon.noname-c con 0x7fbc2c0a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:26.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.616+0000 7fbc337c3640 10 monclient(hunting): picked mon.noname-f con 0x7fbc2c0a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.616+0000 7fbc337c3640 10 monclient(hunting): picked mon.noname-b con 0x7fbc2c13f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.616+0000 7fbc337c3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2c139260 con 0x7fbc2c0a6ab0 2024-09-13T10:30:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.616+0000 7fbc337c3640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2c09cbb0 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7fbc31d60640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fbc2c13f9a0 0x7fbc2c1d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48474/0 (socket says 172.21.15.181:48474) 2024-09-13T10:30:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7fbc31d60640 1 -- 172.21.15.181:0/2401660000 learned_addr learned my addr 172.21.15.181:0/2401660000 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7fbc337c3640 1 -- 172.21.15.181:0/2401660000 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2c142dd0 con 0x7fbc2c0a66d0 2024-09-13T10:30:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7fbc337c3640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7fbc337c3640 10 monclient(hunting): authenticate will time out at 766.122120s 2024-09-13T10:30:26.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7fb89c0ef640 1 Processor -- start 2024-09-13T10:30:26.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7fb89c0ef640 1 -- start start 2024-09-13T10:30:26.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7fb89c0ef640 10 monclient: init 2024-09-13T10:30:26.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f9576d640 1 -- 172.21.15.181:0/2799913251 >> v1:172.21.15.181:6792/0 conn(0x7f7f900a66d0 legacy=0x7f7f901ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f95f6e640 1 -- 172.21.15.181:0/2799913251 >> v1:172.21.15.181:6791/0 conn(0x7f7f9013f9a0 legacy=0x7f7f901d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f94f6c640 1 -- 172.21.15.181:0/2799913251 >> v1:172.21.15.195:6791/0 conn(0x7f7f900a6ab0 legacy=0x7f7f901d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915975460 0 0) 0x7f7f9013ed40 con 0x7f7f900a66d0 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f85ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f85ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f85ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f85ffb640 10 monclient(hunting): my global_id is 4281 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f74003520 con 0x7f7f900a66d0 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1771417673 0 0) 0x7f7f9013cfa0 con 0x7f7f9013f9a0 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f85ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f85ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f85ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f85ffb640 10 monclient(hunting): my global_id is 4360 2024-09-13T10:30:26.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f740048e0 con 0x7f7f9013f9a0 2024-09-13T10:30:26.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f1254fe3640 1 -- 172.21.15.181:0/3887294633 >> v1:172.21.15.181:6790/0 conn(0x7f125006e720 legacy=0x7f1250073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f12557e4640 1 -- 172.21.15.181:0/3887294633 >> v1:172.21.15.195:6792/0 conn(0x7f12501398c0 legacy=0x7f1250072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7fb89c0ef640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f1247fff640 1 -- 172.21.15.181:0/3887294633 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 653585362 0 0) 0x7f1250070640 con 0x7f125006e720 2024-09-13T10:30:26.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f1247fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f1247fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f1247fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.617+0000 7f1247fff640 10 monclient(hunting): my global_id is 4313 2024-09-13T10:30:26.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 1 -- 172.21.15.181:0/3887294633 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f123c003520 con 0x7f125006e720 2024-09-13T10:30:26.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7fb89c0ef640 10 monclient: _add_conns ranks=[1,5,8,6,2,7,0,4,3] 2024-09-13T10:30:26.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7fb89c0ef640 10 monclient(hunting): picked mon.noname-f con 0x7fb894074150 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3191436367 0 0) 0x7f7f9013ea60 con 0x7f7f900a6ab0 2024-09-13T10:30:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): my global_id is 4325 2024-09-13T10:30:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f9013cfa0 con 0x7f7f900a6ab0 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 1 -- 172.21.15.181:0/3887294633 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4098220804 0 0) 0x7f12500a6090 con 0x7f12501398c0 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient(hunting): my global_id is 54322 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1255fe5640 1 -- 172.21.15.181:0/3887294633 >> v1:172.21.15.195:6789/0 conn(0x7f1250073880 legacy=0x7f1250142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 1 -- 172.21.15.181:0/3887294633 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1250070640 con 0x7f12501398c0 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 1 -- 172.21.15.181:0/3887294633 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1931563407 0 0) 0x7f123c003520 con 0x7f125006e720 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 1 -- 172.21.15.181:0/3887294633 >> v1:172.21.15.195:6792/0 conn(0x7f12501398c0 legacy=0x7f1250072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 1 -- 172.21.15.181:0/3887294633 >> v1:172.21.15.195:6789/0 conn(0x7f1250073880 legacy=0x7f1250142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 1 monclient: found mon.noname-b 2024-09-13T10:30:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 1 -- 172.21.15.181:0/3887294633 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1250072610 con 0x7f125006e720 2024-09-13T10:30:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7fb89c0ef640 10 monclient(hunting): picked mon.noname-h con 0x7fb89412d4d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 1 -- 172.21.15.181:0/3887294633 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1240001ba0 con 0x7f125006e720 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient: dump: 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.696 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7fb899e8b640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb894074150 0x7fb8941c9960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:35386/0 (socket says 172.21.15.181:35386) 2024-09-13T10:30:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7fb899e8b640 1 -- 172.21.15.181:0/3477439710 learned_addr learned my addr 172.21.15.181:0/3477439710 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1257a48640 5 monclient: authenticate success, global_id 4313 2024-09-13T10:30:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1257a48640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 1 -- 172.21.15.181:0/3887294633 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f12400048a0 con 0x7f125006e720 2024-09-13T10:30:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7fb89c0ef640 10 monclient(hunting): picked mon.noname-e con 0x7fb89413d800 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8941ca780 con 0x7fb894074150 2024-09-13T10:30:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 1 -- 172.21.15.181:0/3887294633 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1240004dd0 con 0x7f125006e720 2024-09-13T10:30:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb89409ee30 con 0x7fb89412d4d0 2024-09-13T10:30:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb89409f110 con 0x7fb89413d800 2024-09-13T10:30:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7fb89c0ef640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7fb89c0ef640 10 monclient(hunting): authenticate will time out at 766.123798s 2024-09-13T10:30:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2242692653 0 0) 0x7f7f740048e0 con 0x7f7f9013f9a0 2024-09-13T10:30:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:26.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f9013ea60 con 0x7f7f9013f9a0 2024-09-13T10:30:26.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f88002070 con 0x7f7f9013f9a0 2024-09-13T10:30:26.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:26.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:26.700 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.700 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.700 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:26.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 366750740 0 0) 0x7f7f74003520 con 0x7f7f900a66d0 2024-09-13T10:30:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f740048e0 con 0x7f7f900a66d0 2024-09-13T10:30:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2815207884 0 0) 0x7f7f9013cfa0 con 0x7f7f900a6ab0 2024-09-13T10:30:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1247fff640 10 monclient: dump: 2024-09-13T10:30:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.702 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.703 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.703 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.703 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.703 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.703 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.703 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.703 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.703 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f74003520 con 0x7f7f900a6ab0 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f8c0047e0 con 0x7f7f900a66d0 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.704 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f80004d90 con 0x7f7f900a6ab0 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.705 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3774992711 0 0) 0x7f7f740048e0 con 0x7f7f900a66d0 2024-09-13T10:30:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 >> v1:172.21.15.195:6791/0 conn(0x7f7f900a6ab0 legacy=0x7f7f901d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 >> v1:172.21.15.181:6791/0 conn(0x7f7f9013f9a0 legacy=0x7f7f901d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1257a48640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.618+0000 7f1257a48640 4 set_mon_vals no callback set 2024-09-13T10:30:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc31d60640 1 -- 172.21.15.181:0/2401660000 >> v1:172.21.15.181:6790/0 conn(0x7fbc2c13f9a0 legacy=0x7fbc2c1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 1 monclient: found mon.d 2024-09-13T10:30:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3749881724 0 0) 0x7fbc2c09cbb0 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 10 monclient(hunting): my global_id is 4322 2024-09-13T10:30:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc10003520 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f900a2950 con 0x7f7f900a66d0 2024-09-13T10:30:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f1257a48640 10 monclient: shutdown 2024-09-13T10:30:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f1257a48640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f1257a48640 1 -- 172.21.15.181:0/3887294633 >> v1:172.21.15.181:6790/0 conn(0x7f125006e720 legacy=0x7f1250073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1068843349 0 0) 0x7fbc10003520 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbc2c09cbb0 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbc24001e60 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f1257a48640 1 -- 172.21.15.181:0/3887294633 shutdown_connections 2024-09-13T10:30:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.712 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f1257a48640 1 -- 172.21.15.181:0/3887294633 >> 172.21.15.181:0/3887294633 conn(0x7f12500a65d0 msgr2=0x7f12500a69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f1257a48640 1 -- 172.21.15.181:0/3887294633 shutdown_connections 2024-09-13T10:30:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 712758916 0 0) 0x7fbc2c09cbb0 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 >> v1:172.21.15.181:6791/0 conn(0x7fbc2c0a66d0 legacy=0x7fbc2c13aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7f1257a48640 1 -- 172.21.15.181:0/3887294633 wait complete. 2024-09-13T10:30:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc30d5e640 1 -- 172.21.15.181:0/2401660000 >> v1:172.21.15.195:6789/0 conn(0x7fbc2c0a6ab0 legacy=0x7fbc2c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f979d1640 5 monclient: authenticate success, global_id 4281 2024-09-13T10:30:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f979d1640 10 monclient: _renew_subs 2024-09-13T10:30:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f979d1640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f979d1640 1 -- 172.21.15.181:0/2799913251 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7f901374e0 con 0x7f7f900a66d0 2024-09-13T10:30:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f979d1640 10 monclient: _renew_subs 2024-09-13T10:30:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f979d1640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc3155f640 1 -- 172.21.15.181:0/2401660000 >> v1:172.21.15.181:6791/0 conn(0x7fbc2c0a66d0 legacy=0x7fbc2c13aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f979d1640 1 -- 172.21.15.181:0/2799913251 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f7f9013c540 con 0x7f7f900a66d0 2024-09-13T10:30:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f8c004c30 con 0x7f7f900a66d0 2024-09-13T10:30:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f8c005160 con 0x7f7f900a66d0 2024-09-13T10:30:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fb899e8b640 1 -- 172.21.15.181:0/3477439710 >> v1:172.21.15.195:6789/0 conn(0x7fb894074150 legacy=0x7fb8941c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 >> v1:172.21.15.195:6789/0 conn(0x7fbc2c0a6ab0 legacy=0x7fbc2c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc21ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc21ffb640 1 monclient: found mon.b 2024-09-13T10:30:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc21ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc21ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2c13e430 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc21ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc21ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc21ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc337c3640 5 monclient: authenticate success, global_id 4322 2024-09-13T10:30:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc337c3640 10 monclient: _renew_subs 2024-09-13T10:30:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc337c3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7f1257a48640 10 monclient: build_initial_monmap 2024-09-13T10:30:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fbc337c3640 1 -- 172.21.15.181:0/2401660000 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2c13d280 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7f1257a48640 10 monclient: monmap: 2024-09-13T10:30:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:26.719 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fb89968a640 1 -- 172.21.15.181:0/3477439710 >> v1:172.21.15.195:6791/0 conn(0x7fb89412d4d0 legacy=0x7fb8941ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2050876080 0 0) 0x7fb8941ca780 con 0x7fb894074150 2024-09-13T10:30:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fb88a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fb88a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f85ffb640 10 monclient: dump: 2024-09-13T10:30:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.722 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.619+0000 7f7f86ffd640 4 set_mon_vals no callback set 2024-09-13T10:30:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7f7f7b7fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7f7f7b7fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7f7f7b7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7f7f7b7fe640 1 -- 172.21.15.181:0/2799913251 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f900a3240 con 0x7f7f900a66d0 2024-09-13T10:30:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbc24004350 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fbc21ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbc24005b40 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fb88a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fb88a7fc640 10 monclient(hunting): my global_id is 54352 2024-09-13T10:30:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.620+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb878003520 con 0x7fb894074150 2024-09-13T10:30:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335092138 0 0) 0x7fb89409ee30 con 0x7fb89412d4d0 2024-09-13T10:30:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7f1257a48640 1 Processor -- start 2024-09-13T10:30:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): my global_id is 4334 2024-09-13T10:30:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7f1257a48640 1 -- start start 2024-09-13T10:30:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8941ca780 con 0x7fb89412d4d0 2024-09-13T10:30:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb89a68c640 1 -- 172.21.15.181:0/3477439710 >> v1:172.21.15.181:6793/0 conn(0x7fb89413d800 legacy=0x7fb8941d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7f1257a48640 10 monclient: init 2024-09-13T10:30:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1328094626 0 0) 0x7fb89409f110 con 0x7fb89413d800 2024-09-13T10:30:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): my global_id is 4292 2024-09-13T10:30:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb89409ee30 con 0x7fb89413d800 2024-09-13T10:30:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4252990650 0 0) 0x7fb878003520 con 0x7fb894074150 2024-09-13T10:30:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb89409f110 con 0x7fb894074150 2024-09-13T10:30:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb890000ed0 con 0x7fb894074150 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): dump: 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.727 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2151501866 0 0) 0x7fb8941ca780 con 0x7fb89412d4d0 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb878003520 con 0x7fb89412d4d0 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb884003610 con 0x7fb89412d4d0 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 10 monclient(hunting): dump: 2024-09-13T10:30:26.728 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.729 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.730 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7f8c0117e0 con 0x7f7f900a66d0 2024-09-13T10:30:26.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f7f8c04e100 con 0x7f7f900a66d0 2024-09-13T10:30:26.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1040874013 0 0) 0x7fb89409f110 con 0x7fb894074150 2024-09-13T10:30:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 >> v1:172.21.15.181:6793/0 conn(0x7fb89413d800 legacy=0x7fb8941d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 >> v1:172.21.15.195:6791/0 conn(0x7fb89412d4d0 legacy=0x7fb8941ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 1 monclient: found mon.f 2024-09-13T10:30:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89409f3f0 con 0x7fb894074150 2024-09-13T10:30:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb89c0ef640 5 monclient: authenticate success, global_id 54352 2024-09-13T10:30:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fbc21ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fbc21ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fbc21ffb640 10 monclient: dump: 2024-09-13T10:30:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.732 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.733 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.733 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.733 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.733 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.733 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.733 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.733 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb89c0ef640 10 monclient: _renew_subs 2024-09-13T10:30:26.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb89c0ef640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:26.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb89413bd10 con 0x7fb894074150 2024-09-13T10:30:26.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb890001450 con 0x7fb894074150 2024-09-13T10:30:26.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.621+0000 7fbc237fe640 4 set_mon_vals no callback set 2024-09-13T10:30:26.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f7f94f6c640 10 monclient: get_auth_request con 0x7f7f74040760 auth_method 0 2024-09-13T10:30:26.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f1257a48640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:26.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fbc337c3640 10 monclient: _renew_subs 2024-09-13T10:30:26.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fbc337c3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:26.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fbc337c3640 1 -- 172.21.15.181:0/2401660000 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbc2c13bcf0 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f1257a48640 10 monclient: _add_conns ranks=[7,3,4,8,2,0,6,1,5] 2024-09-13T10:30:26.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f1257a48640 10 monclient(hunting): picked mon.noname-i con 0x7f125006e720 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:26.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f1257a48640 10 monclient(hunting): picked mon.noname-g con 0x7f1250073880 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:26.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f1257a48640 10 monclient(hunting): picked mon.noname-c con 0x7f12501398c0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:26.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f1257a48640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1250126c80 con 0x7f1250073880 2024-09-13T10:30:26.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f1257a48640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1250127690 con 0x7f12501398c0 2024-09-13T10:30:26.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f1257a48640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1250124920 con 0x7f125006e720 2024-09-13T10:30:26.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f1257a48640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:26.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f1257a48640 10 monclient(hunting): authenticate will time out at 766.127856s 2024-09-13T10:30:26.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f1255fe5640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f12501398c0 0x7f12501d6ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38446/0 (socket says 172.21.15.181:38446) 2024-09-13T10:30:26.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7f1255fe5640 1 -- 172.21.15.181:0/3519840945 learned_addr learned my addr 172.21.15.181:0/3519840945 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:26.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb890001980 con 0x7fb894074150 2024-09-13T10:30:26.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:26.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88a7fc640 10 monclient: dump: 2024-09-13T10:30:26.737 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.737 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.737 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.737 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.737 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.737 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.737 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.737 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.738 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.738 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.738 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.738 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.738 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.738 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.738 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.738 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.622+0000 7fb88bfff640 4 set_mon_vals no callback set 2024-09-13T10:30:26.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.623+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fbc240121c0 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.623+0000 7fbc337c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.623+0000 7fbc337c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.623+0000 7fbc337c3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:26.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.623+0000 7fb89c0ef640 10 monclient: _renew_subs 2024-09-13T10:30:26.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.623+0000 7fb89c0ef640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:26.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.623+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb89413c650 con 0x7fb894074150 2024-09-13T10:30:26.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.624+0000 7fbc337c3640 1 -- 172.21.15.181:0/2401660000 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc2c0a3240 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.624+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7fbc2404eb50 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.624+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb890001b20 con 0x7fb894074150 2024-09-13T10:30:26.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.624+0000 7fbc3155f640 10 monclient: get_auth_request con 0x7fbc1003fb50 auth_method 0 2024-09-13T10:30:26.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.624+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7fb89004d160 con 0x7fb894074150 2024-09-13T10:30:26.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.624+0000 7fb89968a640 10 monclient: get_auth_request con 0x7fb8780401d0 auth_method 0 2024-09-13T10:30:26.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1255fe5640 1 -- 172.21.15.181:0/3519840945 >> v1:172.21.15.181:6791/0 conn(0x7f12501398c0 legacy=0x7f12501d6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:26.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7fb89c0ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7fb89c0ef640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7fb89c0ef640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2126706499 0 0) 0x7f1250127690 con 0x7f12501398c0 2024-09-13T10:30:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 10 monclient(hunting): my global_id is 4378 2024-09-13T10:30:26.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.195:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb89409ebc0 con 0x7fb894074150 2024-09-13T10:30:26.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1234003550 con 0x7f12501398c0 2024-09-13T10:30:26.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 205034949 0 0) 0x7f1234003550 con 0x7f12501398c0 2024-09-13T10:30:26.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1250127690 con 0x7f12501398c0 2024-09-13T10:30:26.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1248003990 con 0x7f12501398c0 2024-09-13T10:30:26.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:26.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:26.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:26.745 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.745 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.745 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1019500584 0 0) 0x7f1250127690 con 0x7f12501398c0 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 >> v1:172.21.15.195:6792/0 conn(0x7f125006e720 legacy=0x7f12501ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 >> v1:172.21.15.195:6790/0 conn(0x7f1250073880 legacy=0x7f12501d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.625+0000 7f1245ffb640 1 monclient: found mon.c 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1245ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1245ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1250136260 con 0x7f12501398c0 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1245ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1245ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1245ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1257a48640 5 monclient: authenticate success, global_id 4378 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1257a48640 10 monclient: _renew_subs 2024-09-13T10:30:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1257a48640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1257a48640 1 -- 172.21.15.181:0/3519840945 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f12501263e0 con 0x7f12501398c0 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1257a48640 10 monclient: _renew_subs 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1257a48640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.626+0000 7f1257a48640 1 -- 172.21.15.181:0/3519840945 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f1250125660 con 0x7f12501398c0 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.627+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1248003f10 con 0x7f12501398c0 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.627+0000 7f1245ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.627+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1248004440 con 0x7f12501398c0 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.627+0000 7f1245ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.627+0000 7f1245ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.627+0000 7f1245ffb640 10 monclient: dump: 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.627+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1248004660 con 0x7f12501398c0 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.627+0000 7f1246ffd640 4 set_mon_vals no callback set 2024-09-13T10:30:26.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.627+0000 7f1257a48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.628+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f124804e750 con 0x7f12501398c0 2024-09-13T10:30:26.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.628+0000 7f1257a48640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.628+0000 7f1257a48640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:26.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.628+0000 7f1257a48640 1 -- 172.21.15.181:0/3519840945 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f125006fbf0 con 0x7f12501398c0 2024-09-13T10:30:26.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.628+0000 7f12557e4640 10 monclient: get_auth_request con 0x7f123403faf0 auth_method 0 2024-09-13T10:30:26.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.628+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f7f8c0176e0 con 0x7f7f900a66d0 2024-09-13T10:30:26.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.628+0000 7f7f85ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.628+0000 7f7f85ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:26.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.630+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.1 v1:172.21.15.195:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fb890017800 con 0x7fb894074150 2024-09-13T10:30:26.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.630+0000 7fb88a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.630+0000 7fb88a7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:26.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.634+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fbc24017ef0 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.634+0000 7fbc21ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.634+0000 7fbc21ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:26.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.635+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f125006fbf0 con 0x7f12501398c0 2024-09-13T10:30:26.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.635+0000 7f1245ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:26.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.635+0000 7f1245ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.810+0000 7ff8edbec640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-13T10:30:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.810+0000 7ff8edbec640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-13T10:30:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.810+0000 7ff8edbec640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.810+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff8e80a3240 con 0x7ff8e813f9a0 2024-09-13T10:30:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.811+0000 7ff8cffff640 1 -- 172.21.15.181:0/468090514 <== mon.8 v1:172.21.15.181:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 2777258794) 0x7ff8e0017ad0 con 0x7ff8e813f9a0 2024-09-13T10:30:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.811+0000 7ff8cffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-13T10:30:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.811+0000 7ff8cffff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:26.813 INFO:teuthology.orchestra.run.smithi181.stdout:55834574853 2024-09-13T10:30:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.812+0000 7f12a6e60640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-13T10:30:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.812+0000 7f12a6e60640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-13T10:30:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.812+0000 7f12a6e60640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.812+0000 7f12a6e60640 1 -- 172.21.15.181:0/1045202290 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1280005370 con 0x7f12a01d4310 2024-09-13T10:30:26.815 INFO:teuthology.orchestra.run.smithi181.stdout:47244640260 2024-09-13T10:30:26.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.813+0000 7f129d7fa640 1 -- 172.21.15.181:0/1045202290 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 1444633209) 0x7f1298017be0 con 0x7f12a01d4310 2024-09-13T10:30:26.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.813+0000 7f129d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-13T10:30:26.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.813+0000 7f129d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.815+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff8d403ffe0 legacy=0x7ff8d40424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.815+0000 7ff8edbec640 10 monclient: shutdown 2024-09-13T10:30:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.815+0000 7ff8edbec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.815+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 >> v1:172.21.15.181:6793/0 conn(0x7ff8e813f9a0 legacy=0x7ff8e81db490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.815+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 shutdown_connections 2024-09-13T10:30:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.815+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 >> 172.21.15.181:0/468090514 conn(0x7ff8e80abcd0 msgr2=0x7ff8e8145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.815+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 shutdown_connections 2024-09-13T10:30:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.815+0000 7ff8edbec640 1 -- 172.21.15.181:0/468090514 wait complete. 2024-09-13T10:30:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.816+0000 7f12a6e60640 1 -- 172.21.15.181:0/1045202290 >> v1:172.21.15.195:6800/1839191919 conn(0x7f128403fac0 legacy=0x7f1284041f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.816+0000 7f12a6e60640 10 monclient: shutdown 2024-09-13T10:30:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.816+0000 7f12a6e60640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.816+0000 7f12a6e60640 1 -- 172.21.15.181:0/1045202290 >> v1:172.21.15.181:6791/0 conn(0x7f12a01d4310 legacy=0x7f12a01d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.817+0000 7f12a6e60640 1 -- 172.21.15.181:0/1045202290 shutdown_connections 2024-09-13T10:30:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.817+0000 7f12a6e60640 1 -- 172.21.15.181:0/1045202290 >> 172.21.15.181:0/1045202290 conn(0x7f12a00a6640 msgr2=0x7f12a0141c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.817+0000 7f12a6e60640 1 -- 172.21.15.181:0/1045202290 shutdown_connections 2024-09-13T10:30:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.817+0000 7f12a6e60640 1 -- 172.21.15.181:0/1045202290 wait complete. 2024-09-13T10:30:26.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-09-13T10:30:26.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.4 2024-09-13T10:30:26.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.933+0000 7f7f7b7fe640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-13T10:30:26.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.933+0000 7f7f7b7fe640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-13T10:30:26.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.933+0000 7f7f7b7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:26.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.933+0000 7f7f7b7fe640 1 -- 172.21.15.181:0/2799913251 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7f9013c880 con 0x7f7f900a66d0 2024-09-13T10:30:26.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.933+0000 7f7f85ffb640 1 -- 172.21.15.181:0/2799913251 <== mon.6 v1:172.21.15.181:6792/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 3056272221) 0x7f7f8c016fe0 con 0x7f7f900a66d0 2024-09-13T10:30:26.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.933+0000 7f7f85ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-13T10:30:26.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.933+0000 7f7f85ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:26.935 INFO:teuthology.orchestra.run.smithi181.stdout:55834574852 2024-09-13T10:30:26.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.935+0000 7f7f7b7fe640 1 -- 172.21.15.181:0/2799913251 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7f74040760 legacy=0x7f7f74042c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.935+0000 7f7f7b7fe640 10 monclient: shutdown 2024-09-13T10:30:26.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.935+0000 7f7f7b7fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.935+0000 7f7f7b7fe640 1 -- 172.21.15.181:0/2799913251 >> v1:172.21.15.181:6792/0 conn(0x7f7f900a66d0 legacy=0x7f7f901ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.935+0000 7f7f7b7fe640 1 -- 172.21.15.181:0/2799913251 shutdown_connections 2024-09-13T10:30:26.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.935+0000 7f7f7b7fe640 1 -- 172.21.15.181:0/2799913251 >> 172.21.15.181:0/2799913251 conn(0x7f7f900abcd0 msgr2=0x7f7f900a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.936+0000 7f7f7b7fe640 1 -- 172.21.15.181:0/2799913251 shutdown_connections 2024-09-13T10:30:26.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.936+0000 7f7f7b7fe640 1 -- 172.21.15.181:0/2799913251 wait complete. 2024-09-13T10:30:26.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.939+0000 7fbc337c3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-13T10:30:26.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.940+0000 7fbc337c3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-13T10:30:26.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.940+0000 7fbc337c3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:26.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.940+0000 7fbc337c3640 1 -- 172.21.15.181:0/2401660000 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbc2c0ab9a0 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.940+0000 7fbc21ffb640 1 -- 172.21.15.181:0/2401660000 <== mon.2 v1:172.21.15.181:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 956180462) 0x7fbc240203d0 con 0x7fbc2c13f9a0 2024-09-13T10:30:26.942 INFO:teuthology.orchestra.run.smithi181.stdout:51539607555 2024-09-13T10:30:26.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.940+0000 7fbc21ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-13T10:30:26.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.940+0000 7fbc21ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:26.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.942+0000 7fbc337c3640 1 -- 172.21.15.181:0/2401660000 >> v1:172.21.15.195:6800/1839191919 conn(0x7fbc1003fb50 legacy=0x7fbc10042010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.942+0000 7fbc337c3640 10 monclient: shutdown 2024-09-13T10:30:26.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.942+0000 7fbc337c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.942+0000 7fbc337c3640 1 -- 172.21.15.181:0/2401660000 >> v1:172.21.15.181:6790/0 conn(0x7fbc2c13f9a0 legacy=0x7fbc2c1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.942+0000 7fbc337c3640 1 -- 172.21.15.181:0/2401660000 shutdown_connections 2024-09-13T10:30:26.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.942+0000 7fbc337c3640 1 -- 172.21.15.181:0/2401660000 >> 172.21.15.181:0/2401660000 conn(0x7fbc2c0abcd0 msgr2=0x7fbc2c13ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.942+0000 7fbc337c3640 1 -- 172.21.15.181:0/2401660000 shutdown_connections 2024-09-13T10:30:26.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.942+0000 7fbc337c3640 1 -- 172.21.15.181:0/2401660000 wait complete. 2024-09-13T10:30:26.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-09-13T10:30:26.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607555 for osd.0 2024-09-13T10:30:26.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.966+0000 7fb89c0ef640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-13T10:30:26.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.966+0000 7fb89c0ef640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-13T10:30:26.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.966+0000 7fb89c0ef640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:26.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.966+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 --> v1:172.21.15.195:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb89406d3d0 con 0x7fb894074150 2024-09-13T10:30:26.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.966+0000 7fb88a7fc640 1 -- 172.21.15.181:0/3477439710 <== mon.1 v1:172.21.15.195:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 3056272221) 0x7fb89001b970 con 0x7fb894074150 2024-09-13T10:30:26.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.966+0000 7fb88a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-13T10:30:26.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.966+0000 7fb88a7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:26.968 INFO:teuthology.orchestra.run.smithi181.stdout:55834574852 2024-09-13T10:30:26.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.968+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb8780401d0 legacy=0x7fb878042690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.968+0000 7fb89c0ef640 10 monclient: shutdown 2024-09-13T10:30:26.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.968+0000 7fb89c0ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.968+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 >> v1:172.21.15.195:6789/0 conn(0x7fb894074150 legacy=0x7fb8941c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.968+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 shutdown_connections 2024-09-13T10:30:26.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.968+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 >> 172.21.15.181:0/3477439710 conn(0x7fb89406e6e0 msgr2=0x7fb8940a4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.969+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 shutdown_connections 2024-09-13T10:30:26.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.969+0000 7fb89c0ef640 1 -- 172.21.15.181:0/3477439710 wait complete. 2024-09-13T10:30:26.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.972+0000 7f1257a48640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-13T10:30:26.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.972+0000 7f1257a48640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-13T10:30:26.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.972+0000 7f1257a48640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:26.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.972+0000 7f1257a48640 1 -- 172.21.15.181:0/3519840945 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f12500a6340 con 0x7f12501398c0 2024-09-13T10:30:26.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.973+0000 7f1245ffb640 1 -- 172.21.15.181:0/3519840945 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 532354816) 0x7f1248017cd0 con 0x7f12501398c0 2024-09-13T10:30:26.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.973+0000 7f1245ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-13T10:30:26.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.973+0000 7f1245ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:26.975 INFO:teuthology.orchestra.run.smithi181.stdout:51539607557 2024-09-13T10:30:26.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.975+0000 7f1257a48640 1 -- 172.21.15.181:0/3519840945 >> v1:172.21.15.195:6800/1839191919 conn(0x7f123403faf0 legacy=0x7f1234041fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.975+0000 7f1257a48640 10 monclient: shutdown 2024-09-13T10:30:26.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.975+0000 7f1257a48640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:26.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.975+0000 7f1257a48640 1 -- 172.21.15.181:0/3519840945 >> v1:172.21.15.181:6791/0 conn(0x7f12501398c0 legacy=0x7f12501d6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:26.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.975+0000 7f1257a48640 1 -- 172.21.15.181:0/3519840945 shutdown_connections 2024-09-13T10:30:26.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.975+0000 7f1257a48640 1 -- 172.21.15.181:0/3519840945 >> 172.21.15.181:0/3519840945 conn(0x7f12500a65d0 msgr2=0x7f1250136d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:26.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.975+0000 7f1257a48640 1 -- 172.21.15.181:0/3519840945 shutdown_connections 2024-09-13T10:30:26.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:26.975+0000 7f1257a48640 1 -- 172.21.15.181:0/3519840945 wait complete. 2024-09-13T10:30:26.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-09-13T10:30:26.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607558 got 51539607557 for osd.5 2024-09-13T10:30:27.835 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T10:30:27.836 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T10:30:27.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.945+0000 7f557b809640 10 monclient: get_monmap_and_config 2024-09-13T10:30:27.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.945+0000 7f557b809640 10 monclient: build_initial_monmap 2024-09-13T10:30:27.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.945+0000 7f557b809640 10 monclient: monmap: 2024-09-13T10:30:27.947 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:27.947 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:27.948 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:27.946512+0000 2024-09-13T10:30:27.948 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:27.946512+0000 2024-09-13T10:30:27.948 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:27.948 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:27.948 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:27.948 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:27.948 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:27.948 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:27.948 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:27.948 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:27.949 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:27.949 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:27.949 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:27.949 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:27.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.945+0000 7fb319cd6640 10 monclient: get_monmap_and_config 2024-09-13T10:30:27.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.945+0000 7fb319cd6640 10 monclient: build_initial_monmap 2024-09-13T10:30:27.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.946+0000 7fb319cd6640 10 monclient: monmap: 2024-09-13T10:30:27.949 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:27.946612+0000 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:27.946612+0000 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:27.950 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:27.951 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:27.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.946+0000 7f557b809640 1 Processor -- start 2024-09-13T10:30:27.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.946+0000 7f557b809640 1 -- start start 2024-09-13T10:30:27.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.946+0000 7f557b809640 10 monclient: init 2024-09-13T10:30:27.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.946+0000 7fb319cd6640 1 Processor -- start 2024-09-13T10:30:27.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.946+0000 7fb319cd6640 1 -- start start 2024-09-13T10:30:27.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.946+0000 7fb319cd6640 10 monclient: init 2024-09-13T10:30:27.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7f557b809640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:27.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7f557b809640 10 monclient: _add_conns ranks=[5,2,0,1,3,8,7,6,4] 2024-09-13T10:30:27.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7f557b809640 10 monclient(hunting): picked mon.noname-h con 0x7f55740a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:27.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7f557b809640 10 monclient(hunting): picked mon.noname-b con 0x7f55740a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:27.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7f557b809640 10 monclient(hunting): picked mon.noname-a con 0x7f557413f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:27.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7f557b809640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55740a5fe0 con 0x7f557413f9a0 2024-09-13T10:30:27.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7f557b809640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55740a8080 con 0x7f55740a6ab0 2024-09-13T10:30:27.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7f557b809640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55740a42c0 con 0x7f55740a66d0 2024-09-13T10:30:27.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7f557b809640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:27.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7f557b809640 10 monclient(hunting): authenticate will time out at 767.452217s 2024-09-13T10:30:27.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7f5578da4640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f55740a6ab0 0x7f55740a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48486/0 (socket says 172.21.15.181:48486) 2024-09-13T10:30:27.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7f5578da4640 1 -- 172.21.15.181:0/2025556611 learned_addr learned my addr 172.21.15.181:0/2025556611 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:27.956 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T10:30:27.957 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T10:30:27.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7fb319cd6640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:27.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7fb319cd6640 10 monclient: _add_conns ranks=[2,7,5,0,8,4,3,6,1] 2024-09-13T10:30:27.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7fb319cd6640 10 monclient(hunting): picked mon.noname-b con 0x7fb31412d4d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:27.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7fb319cd6640 10 monclient(hunting): picked mon.noname-i con 0x7fb314074150 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:27.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7fb319cd6640 10 monclient(hunting): picked mon.noname-h con 0x7fb31413d800 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:27.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7fb319cd6640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb31412dfc0 con 0x7fb31412d4d0 2024-09-13T10:30:27.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7fb319cd6640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb314072e40 con 0x7fb31413d800 2024-09-13T10:30:27.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7fb319cd6640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb314073490 con 0x7fb314074150 2024-09-13T10:30:27.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7fb319cd6640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:27.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7fb319cd6640 10 monclient(hunting): authenticate will time out at 767.452662s 2024-09-13T10:30:27.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7fb3137fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fb31412d4d0 0x7fb31412d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48496/0 (socket says 172.21.15.181:48496) 2024-09-13T10:30:27.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.947+0000 7fb3137fe640 1 -- 172.21.15.181:0/3529386378 learned_addr learned my addr 172.21.15.181:0/3529386378 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:27.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f5578da4640 1 -- 172.21.15.181:0/2025556611 >> v1:172.21.15.181:6790/0 conn(0x7f55740a6ab0 legacy=0x7f55740a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:27.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f5579da6640 1 -- 172.21.15.181:0/2025556611 >> v1:172.21.15.181:6789/0 conn(0x7f557413f9a0 legacy=0x7f5574141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:27.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f55795a5640 1 -- 172.21.15.181:0/2025556611 >> v1:172.21.15.195:6791/0 conn(0x7f55740a66d0 legacy=0x7f55740a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:27.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 1 -- 172.21.15.181:0/2025556611 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763005247 0 0) 0x7f55740a8080 con 0x7f55740a6ab0 2024-09-13T10:30:27.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:27.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:27.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:27.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 10 monclient(hunting): my global_id is 4331 2024-09-13T10:30:27.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 1 -- 172.21.15.181:0/2025556611 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5560003520 con 0x7f55740a6ab0 2024-09-13T10:30:27.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 1 -- 172.21.15.181:0/2025556611 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1305814781 0 0) 0x7f55740a5fe0 con 0x7f557413f9a0 2024-09-13T10:30:27.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:27.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:27.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:27.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 10 monclient(hunting): my global_id is 54261 2024-09-13T10:30:27.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 1 -- 172.21.15.181:0/2025556611 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55740a8080 con 0x7f557413f9a0 2024-09-13T10:30:27.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7fb3137fe640 1 -- 172.21.15.181:0/3529386378 >> v1:172.21.15.181:6790/0 conn(0x7fb31412d4d0 legacy=0x7fb31412d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:27.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 1 -- 172.21.15.181:0/2025556611 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1395296885 0 0) 0x7f5560003520 con 0x7f55740a6ab0 2024-09-13T10:30:27.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 1 -- 172.21.15.181:0/2025556611 >> v1:172.21.15.195:6791/0 conn(0x7f55740a66d0 legacy=0x7f55740a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:27.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 1 -- 172.21.15.181:0/2025556611 >> v1:172.21.15.181:6789/0 conn(0x7f557413f9a0 legacy=0x7f5574141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:27.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:27.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 1 monclient: found mon.noname-b 2024-09-13T10:30:27.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:27.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:27.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 1 -- 172.21.15.181:0/2025556611 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55741464e0 con 0x7f55740a6ab0 2024-09-13T10:30:27.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 10 monclient: _finish_auth 0 2024-09-13T10:30:27.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:27.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:27.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f556bfff640 1 -- 172.21.15.181:0/2025556611 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5564001ae0 con 0x7f55740a6ab0 2024-09-13T10:30:27.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.949+0000 7f557b809640 5 monclient: authenticate success, global_id 4331 2024-09-13T10:30:27.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f556bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:27.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f556bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:27.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb312ffd640 1 -- 172.21.15.181:0/3529386378 >> v1:172.21.15.195:6792/0 conn(0x7fb314074150 legacy=0x7fb31413c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:27.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f556bfff640 10 monclient: dump: 2024-09-13T10:30:27.966 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:27.966 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:27.966 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:27.966 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:27.966 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:27.967 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:27.967 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:27.967 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:27.967 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:27.967 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:27.967 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:27.968 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:27.968 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:27.968 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:27.968 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:27.968 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:27.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f557b809640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:27.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 1 -- 172.21.15.181:0/3529386378 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015682878 0 0) 0x7fb31412dfc0 con 0x7fb31412d4d0 2024-09-13T10:30:27.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:27.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f5578da4640 1 --1- 172.21.15.181:0/2025556611 >> v1:172.21.15.181:6790/0 conn(0x7f55740a6ab0 0x7f55740a6ec0 :-1 s=OPENED pgs=78 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f5564004e10 mon_map magic: 0 2024-09-13T10:30:27.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:27.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:27.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient(hunting): my global_id is 4340 2024-09-13T10:30:27.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 1 -- 172.21.15.181:0/3529386378 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2fc003520 con 0x7fb31412d4d0 2024-09-13T10:30:27.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f556bfff640 1 -- 172.21.15.181:0/2025556611 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55640048a0 con 0x7f55740a6ab0 2024-09-13T10:30:27.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f556bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:27.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f557b809640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:27.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f557b809640 4 set_mon_vals no callback set 2024-09-13T10:30:27.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 1 -- 172.21.15.181:0/3529386378 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1308120340 0 0) 0x7fb314073490 con 0x7fb314074150 2024-09-13T10:30:27.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:27.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:27.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:27.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient(hunting): my global_id is 54331 2024-09-13T10:30:27.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 1 -- 172.21.15.181:0/3529386378 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb31412dfc0 con 0x7fb314074150 2024-09-13T10:30:27.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 1 -- 172.21.15.181:0/3529386378 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4246166659 0 0) 0x7fb2fc003520 con 0x7fb31412d4d0 2024-09-13T10:30:27.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 1 -- 172.21.15.181:0/3529386378 >> v1:172.21.15.195:6792/0 conn(0x7fb314074150 legacy=0x7fb31413c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:27.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 1 -- 172.21.15.181:0/3529386378 >> v1:172.21.15.195:6791/0 conn(0x7fb31413d800 legacy=0x7fb31413fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T10:30:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 1 monclient: found mon.noname-b 2024-09-13T10:30:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 1 -- 172.21.15.181:0/3529386378 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb314073770 con 0x7fb31412d4d0 2024-09-13T10:30:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:27.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:27.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:27.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb319cd6640 5 monclient: authenticate success, global_id 4340 2024-09-13T10:30:27.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 1 -- 172.21.15.181:0/3529386378 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb304001ae0 con 0x7fb31412d4d0 2024-09-13T10:30:27.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb319cd6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient: dump: 2024-09-13T10:30:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:27.980 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:27.980 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:27.980 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:27.980 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:27.980 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:27.980 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:27.981 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:27.981 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:27.981 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:27.981 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:27.981 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:27.981 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:27.981 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:27.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb319cd6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:27.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 1 -- 172.21.15.181:0/3529386378 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3040048a0 con 0x7fb31412d4d0 2024-09-13T10:30:27.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:27.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb319cd6640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:27.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 1 -- 172.21.15.181:0/3529386378 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb304004e10 con 0x7fb31412d4d0 2024-09-13T10:30:27.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:27.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb319cd6640 4 set_mon_vals no callback set 2024-09-13T10:30:27.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7fb3127fc640 10 monclient: dump: 2024-09-13T10:30:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:27.984 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:27.984 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T10:30:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f557b809640 10 monclient: shutdown 2024-09-13T10:30:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f557b809640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f557b809640 1 -- 172.21.15.181:0/2025556611 >> v1:172.21.15.181:6790/0 conn(0x7f55740a6ab0 legacy=0x7f55740a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f556bfff640 1 -- 172.21.15.181:0/2025556611 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5564004e10 con 0x7f55740a6ab0 2024-09-13T10:30:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f556bfff640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:30:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f557b809640 1 -- 172.21.15.181:0/2025556611 shutdown_connections 2024-09-13T10:30:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.950+0000 7f557b809640 1 -- 172.21.15.181:0/2025556611 >> 172.21.15.181:0/2025556611 conn(0x7f55740abcd0 msgr2=0x7f55740ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7f557b809640 1 -- 172.21.15.181:0/2025556611 shutdown_connections 2024-09-13T10:30:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7f557b809640 1 -- 172.21.15.181:0/2025556611 wait complete. 2024-09-13T10:30:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7fb319cd6640 10 monclient: shutdown 2024-09-13T10:30:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7fb319cd6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7fb319cd6640 1 -- 172.21.15.181:0/3529386378 >> v1:172.21.15.181:6790/0 conn(0x7fb31412d4d0 legacy=0x7fb31412d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7fb319cd6640 1 -- 172.21.15.181:0/3529386378 shutdown_connections 2024-09-13T10:30:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7fb319cd6640 1 -- 172.21.15.181:0/3529386378 >> 172.21.15.181:0/3529386378 conn(0x7fb31406e6e0 msgr2=0x7fb31406eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7fb319cd6640 1 -- 172.21.15.181:0/3529386378 shutdown_connections 2024-09-13T10:30:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7fb319cd6640 1 -- 172.21.15.181:0/3529386378 wait complete. 2024-09-13T10:30:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7f557b809640 10 monclient: build_initial_monmap 2024-09-13T10:30:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7f557b809640 10 monclient: monmap: 2024-09-13T10:30:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:27.989 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7fb319cd6640 10 monclient: build_initial_monmap 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7fb319cd6640 10 monclient: monmap: 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:27.991 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:27.991 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:27.991 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:27.991 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:27.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.951+0000 7f557b809640 1 Processor -- start 2024-09-13T10:30:27.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f557b809640 1 -- start start 2024-09-13T10:30:27.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f557b809640 10 monclient: init 2024-09-13T10:30:27.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7fb319cd6640 1 Processor -- start 2024-09-13T10:30:27.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7fb319cd6640 1 -- start start 2024-09-13T10:30:27.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7fb319cd6640 10 monclient: init 2024-09-13T10:30:27.993 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T10:30:27.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f557b809640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:27.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f557b809640 10 monclient: _add_conns ranks=[6,8,2,5,4,7,3,0,1] 2024-09-13T10:30:27.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f557b809640 10 monclient(hunting): picked mon.noname-d con 0x7f55740a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:27.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f557b809640 10 monclient(hunting): picked mon.noname-e con 0x7f55740a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:27.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f557b809640 10 monclient(hunting): picked mon.noname-b con 0x7f557413f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:27.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f557b809640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557413f0a0 con 0x7f557413f9a0 2024-09-13T10:30:27.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f557b809640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557413f380 con 0x7f55740a66d0 2024-09-13T10:30:27.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f557b809640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5574143090 con 0x7f55740a6ab0 2024-09-13T10:30:27.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f557b809640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:27.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f557b809640 10 monclient(hunting): authenticate will time out at 767.457610s 2024-09-13T10:30:27.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f55795a5640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f55740a66d0 0x7f55741ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45600/0 (socket says 172.21.15.181:45600) 2024-09-13T10:30:27.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f5578da4640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f55740a6ab0 0x7f55741d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39812/0 (socket says 172.21.15.181:39812) 2024-09-13T10:30:27.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f5579da6640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f557413f9a0 0x7f55741d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48500/0 (socket says 172.21.15.181:48500) 2024-09-13T10:30:27.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7f55795a5640 1 -- 172.21.15.181:0/2888053595 learned_addr learned my addr 172.21.15.181:0/2888053595 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:27.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7fb319cd6640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:27.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7fb319cd6640 10 monclient: _add_conns ranks=[1,8,3,5,2,4,7,0,6] 2024-09-13T10:30:27.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7fb319cd6640 10 monclient(hunting): picked mon.noname-f con 0x7fb314074150 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:27.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7fb319cd6640 10 monclient(hunting): picked mon.noname-e con 0x7fb31412d4d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:27.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7fb319cd6640 10 monclient(hunting): picked mon.noname-g con 0x7fb31413d800 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:27.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.952+0000 7fb319cd6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3140a4cf0 con 0x7fb314074150 2024-09-13T10:30:27.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.953+0000 7fb319cd6640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb31409d380 con 0x7fb31413d800 2024-09-13T10:30:27.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.953+0000 7fb319cd6640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb31409d660 con 0x7fb31412d4d0 2024-09-13T10:30:27.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.953+0000 7fb319cd6640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:27.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.953+0000 7fb319cd6640 10 monclient(hunting): authenticate will time out at 767.458036s 2024-09-13T10:30:27.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.953+0000 7fb312ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fb31412d4d0 0x7fb31412c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39820/0 (socket says 172.21.15.181:39820) 2024-09-13T10:30:27.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.953+0000 7fb312ffd640 1 -- 172.21.15.181:0/1950904489 learned_addr learned my addr 172.21.15.181:0/1950904489 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:27.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f55795a5640 1 -- 172.21.15.181:0/2888053595 >> v1:172.21.15.181:6792/0 conn(0x7f55740a66d0 legacy=0x7f55741ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:27.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5579da6640 1 -- 172.21.15.181:0/2888053595 >> v1:172.21.15.181:6790/0 conn(0x7f557413f9a0 legacy=0x7f55741d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:27.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5578da4640 1 -- 172.21.15.181:0/2888053595 >> v1:172.21.15.181:6793/0 conn(0x7f55740a6ab0 legacy=0x7f55741d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:27.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281679167 0 0) 0x7f557413f0a0 con 0x7f557413f9a0 2024-09-13T10:30:27.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5569ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:27.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5569ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:27.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5569ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:27.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5569ffb640 10 monclient(hunting): my global_id is 4349 2024-09-13T10:30:27.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5558003520 con 0x7f557413f9a0 2024-09-13T10:30:27.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1100401695 0 0) 0x7f5574143090 con 0x7f55740a6ab0 2024-09-13T10:30:27.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5569ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:27.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5569ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5569ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.954+0000 7f5569ffb640 10 monclient(hunting): my global_id is 4301 2024-09-13T10:30:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f557413f0a0 con 0x7f55740a6ab0 2024-09-13T10:30:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2247901838 0 0) 0x7f557413f380 con 0x7f55740a66d0 2024-09-13T10:30:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): my global_id is 4290 2024-09-13T10:30:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5574143090 con 0x7f55740a66d0 2024-09-13T10:30:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb312ffd640 1 -- 172.21.15.181:0/1950904489 >> v1:172.21.15.181:6793/0 conn(0x7fb31412d4d0 legacy=0x7fb31412c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 217313949 0 0) 0x7f5558003520 con 0x7f557413f9a0 2024-09-13T10:30:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f557413f380 con 0x7f557413f9a0 2024-09-13T10:30:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1803428426 0 0) 0x7f5574143090 con 0x7f55740a66d0 2024-09-13T10:30:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5558003520 con 0x7f55740a66d0 2024-09-13T10:30:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 406420558 0 0) 0x7f557413f0a0 con 0x7f55740a6ab0 2024-09-13T10:30:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5574143090 con 0x7f55740a6ab0 2024-09-13T10:30:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f556c002070 con 0x7f557413f9a0 2024-09-13T10:30:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2209181406 0 0) 0x7fb31409d660 con 0x7fb31412d4d0 2024-09-13T10:30:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): my global_id is 4310 2024-09-13T10:30:28.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb300003520 con 0x7fb31412d4d0 2024-09-13T10:30:28.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:28.002 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.002 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.002 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.002 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.002 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.002 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.002 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5570003610 con 0x7f55740a66d0 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.004 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5564004d90 con 0x7f55740a6ab0 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.006 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb3137fe640 1 -- 172.21.15.181:0/1950904489 >> v1:172.21.15.195:6789/0 conn(0x7fb314074150 legacy=0x7fb31412c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb313fff640 1 -- 172.21.15.181:0/1950904489 >> v1:172.21.15.195:6790/0 conn(0x7fb31413d800 legacy=0x7fb3141d61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 45672725 0 0) 0x7f5558003520 con 0x7f55740a66d0 2024-09-13T10:30:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 >> v1:172.21.15.181:6793/0 conn(0x7f55740a6ab0 legacy=0x7f55741d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 >> v1:172.21.15.181:6790/0 conn(0x7f557413f9a0 legacy=0x7f55741d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 monclient: found mon.d 2024-09-13T10:30:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5574068a10 con 0x7f55740a66d0 2024-09-13T10:30:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f5569ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f557b809640 5 monclient: authenticate success, global_id 4290 2024-09-13T10:30:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f557b809640 10 monclient: _renew_subs 2024-09-13T10:30:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f557b809640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f557b809640 1 -- 172.21.15.181:0/2888053595 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f557413edc0 con 0x7f55740a66d0 2024-09-13T10:30:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 461151927 0 0) 0x7fb314073770 con 0x7fb314074150 2024-09-13T10:30:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): my global_id is 54361 2024-09-13T10:30:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb31409d660 con 0x7fb314074150 2024-09-13T10:30:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1685783351 0 0) 0x7fb31409d380 con 0x7fb31413d800 2024-09-13T10:30:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): my global_id is 4287 2024-09-13T10:30:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb314073770 con 0x7fb31413d800 2024-09-13T10:30:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1357351695 0 0) 0x7fb300003520 con 0x7fb31412d4d0 2024-09-13T10:30:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb31409d380 con 0x7fb31412d4d0 2024-09-13T10:30:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb308003610 con 0x7fb31412d4d0 2024-09-13T10:30:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): dump: 2024-09-13T10:30:28.016 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.016 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.016 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.016 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.016 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.016 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.016 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.016 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.016 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.017 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.017 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.017 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.017 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.017 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.017 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.017 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:28.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f557b809640 10 monclient: _renew_subs 2024-09-13T10:30:28.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f557b809640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:28.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7f557b809640 1 -- 172.21.15.181:0/2888053595 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f557413c630 con 0x7f55740a66d0 2024-09-13T10:30:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.955+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3426240148 0 0) 0x7fb31409d380 con 0x7fb31412d4d0 2024-09-13T10:30:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 >> v1:172.21.15.195:6790/0 conn(0x7fb31413d800 legacy=0x7fb3141d61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 >> v1:172.21.15.195:6789/0 conn(0x7fb314074150 legacy=0x7fb31412c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 1 monclient: found mon.e 2024-09-13T10:30:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5570003b90 con 0x7f55740a66d0 2024-09-13T10:30:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7f5569ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31412cf90 con 0x7fb31412d4d0 2024-09-13T10:30:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5570004100 con 0x7f55740a66d0 2024-09-13T10:30:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7f5569ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7f5569ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7f556b7fe640 4 set_mon_vals no callback set 2024-09-13T10:30:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb319cd6640 5 monclient: authenticate success, global_id 4310 2024-09-13T10:30:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7f5569ffb640 10 monclient: dump: 2024-09-13T10:30:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.025 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb319cd6640 10 monclient: _renew_subs 2024-09-13T10:30:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb319cd6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb319cd6640 1 -- 172.21.15.181:0/1950904489 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb314071cd0 con 0x7fb31412d4d0 2024-09-13T10:30:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb308003bb0 con 0x7fb31412d4d0 2024-09-13T10:30:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb319cd6640 10 monclient: _renew_subs 2024-09-13T10:30:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb319cd6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb319cd6640 1 -- 172.21.15.181:0/1950904489 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fb3140723b0 con 0x7fb31412d4d0 2024-09-13T10:30:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb3080040e0 con 0x7fb31412d4d0 2024-09-13T10:30:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb2fbfff640 10 monclient: dump: 2024-09-13T10:30:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.029 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.956+0000 7fb311ffb640 4 set_mon_vals no callback set 2024-09-13T10:30:28.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7f557b809640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7f557b809640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7f557b809640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:28.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f55700042a0 con 0x7f55740a66d0 2024-09-13T10:30:28.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7f557b809640 1 -- 172.21.15.181:0/2888053595 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5554005080 con 0x7f55740a66d0 2024-09-13T10:30:28.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7fb319cd6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7fb319cd6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7fb319cd6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7fb319cd6640 1 -- 172.21.15.181:0/1950904489 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3140008d0 con 0x7fb31412d4d0 2024-09-13T10:30:28.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb308004280 con 0x7fb31412d4d0 2024-09-13T10:30:28.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f557004e0e0 con 0x7f55740a66d0 2024-09-13T10:30:28.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7f5578da4640 10 monclient: get_auth_request con 0x7f5558040670 auth_method 0 2024-09-13T10:30:28.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7fb30804e270 con 0x7fb31412d4d0 2024-09-13T10:30:28.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.957+0000 7fb3137fe640 10 monclient: get_auth_request con 0x7fb30003fc90 auth_method 0 2024-09-13T10:30:28.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.961+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f55700176c0 con 0x7f55740a66d0 2024-09-13T10:30:28.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.961+0000 7f5569ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.961+0000 7f5569ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:28.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.962+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fb308017930 con 0x7fb31412d4d0 2024-09-13T10:30:28.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.962+0000 7fb2fbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:27.962+0000 7fb2fbfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:28.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.143+0000 7f71d9a40640 10 monclient: get_monmap_and_config 2024-09-13T10:30:28.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.143+0000 7f71d9a40640 10 monclient: build_initial_monmap 2024-09-13T10:30:28.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.143+0000 7f71d9a40640 10 monclient: monmap: 2024-09-13T10:30:28.145 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:28.145 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.145 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:28.143926+0000 2024-09-13T10:30:28.145 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:28.143926+0000 2024-09-13T10:30:28.145 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:28.145 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.145 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:28.145 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:28.145 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:28.145 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:28.146 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:28.146 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:28.146 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:28.146 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:28.146 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:28.146 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.143+0000 7f71d9a40640 1 Processor -- start 2024-09-13T10:30:28.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.144+0000 7f71d9a40640 1 -- start start 2024-09-13T10:30:28.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.144+0000 7f71d9a40640 10 monclient: init 2024-09-13T10:30:28.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.144+0000 7f71d9a40640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:28.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.144+0000 7f71d9a40640 10 monclient: _add_conns ranks=[2,4,1,3,6,5,0,7,8] 2024-09-13T10:30:28.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.144+0000 7f71d9a40640 10 monclient(hunting): picked mon.noname-b con 0x7f71d40a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:28.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.144+0000 7f71d9a40640 10 monclient(hunting): picked mon.noname-c con 0x7f71d40a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:28.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.144+0000 7f71d9a40640 10 monclient(hunting): picked mon.noname-f con 0x7f71d413f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:28.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.144+0000 7f71d27fc640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f71d40a6ab0 0x7f71d40a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38452/0 (socket says 172.21.15.181:38452) 2024-09-13T10:30:28.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.144+0000 7f71d27fc640 1 -- 172.21.15.181:0/3232309858 learned_addr learned my addr 172.21.15.181:0/3232309858 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:28.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.145+0000 7f71d9a40640 1 -- 172.21.15.181:0/3232309858 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d40a5fe0 con 0x7f71d413f9a0 2024-09-13T10:30:28.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.145+0000 7f71d9a40640 1 -- 172.21.15.181:0/3232309858 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d40a8080 con 0x7f71d40a66d0 2024-09-13T10:30:28.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.145+0000 7f71d9a40640 1 -- 172.21.15.181:0/3232309858 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d40a42c0 con 0x7f71d40a6ab0 2024-09-13T10:30:28.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.145+0000 7f71d9a40640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:28.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.145+0000 7f71d9a40640 10 monclient(hunting): authenticate will time out at 767.650213s 2024-09-13T10:30:28.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d27fc640 1 -- 172.21.15.181:0/3232309858 >> v1:172.21.15.181:6791/0 conn(0x7f71d40a6ab0 legacy=0x7f71d40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d2ffd640 1 -- 172.21.15.181:0/3232309858 >> v1:172.21.15.181:6790/0 conn(0x7f71d40a66d0 legacy=0x7f71d40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3453170602 0 0) 0x7f71d40a8080 con 0x7f71d40a66d0 2024-09-13T10:30:28.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d37fe640 1 -- 172.21.15.181:0/3232309858 >> v1:172.21.15.195:6789/0 conn(0x7f71d413f9a0 legacy=0x7f71d4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 10 monclient(hunting): my global_id is 4358 2024-09-13T10:30:28.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71bc003520 con 0x7f71d40a66d0 2024-09-13T10:30:28.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3533189773 0 0) 0x7f71d40a42c0 con 0x7f71d40a6ab0 2024-09-13T10:30:28.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 10 monclient(hunting): my global_id is 4387 2024-09-13T10:30:28.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d40a8080 con 0x7f71d40a6ab0 2024-09-13T10:30:28.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 819587543 0 0) 0x7f71d40a5fe0 con 0x7f71d413f9a0 2024-09-13T10:30:28.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 10 monclient(hunting): my global_id is 54370 2024-09-13T10:30:28.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.147+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d40a42c0 con 0x7f71d413f9a0 2024-09-13T10:30:28.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2180519586 0 0) 0x7f71bc003520 con 0x7f71d40a66d0 2024-09-13T10:30:28.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d27fc640 1 --1- 172.21.15.181:0/3232309858 >> v1:172.21.15.181:6791/0 conn(0x7f71d40a6ab0 0x7f71d40a6ec0 :-1 s=OPENED pgs=87 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f71c8001a50 mon_map magic: 0 2024-09-13T10:30:28.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 >> v1:172.21.15.181:6791/0 conn(0x7f71d40a6ab0 legacy=0x7f71d40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 >> v1:172.21.15.195:6789/0 conn(0x7f71d413f9a0 legacy=0x7f71d4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 1 monclient: found mon.noname-b 2024-09-13T10:30:28.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:28.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d41464e0 con 0x7f71d40a66d0 2024-09-13T10:30:28.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71c4001b30 con 0x7f71d40a66d0 2024-09-13T10:30:28.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:28.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 10 monclient: dump: 2024-09-13T10:30:28.158 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.158 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.158 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.159 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.159 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.159 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.159 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.159 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.159 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.159 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.159 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.159 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.159 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.159 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.159 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.160 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71c8001a50 con 0x7f71d40a6ab0 2024-09-13T10:30:28.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:30:28.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d9a40640 5 monclient: authenticate success, global_id 4358 2024-09-13T10:30:28.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d9a40640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:28.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71c4003610 con 0x7f71d40a66d0 2024-09-13T10:30:28.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 1 -- 172.21.15.181:0/3232309858 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71c4003bc0 con 0x7f71d40a66d0 2024-09-13T10:30:28.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:28.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d1ffb640 10 monclient: dump: 2024-09-13T10:30:28.161 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.161 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.161 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.161 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.161 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.161 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.161 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.161 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.161 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.161 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.161 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.161 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.162 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.162 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.162 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.162 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d9a40640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:28.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.148+0000 7f71d9a40640 4 set_mon_vals no callback set 2024-09-13T10:30:28.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.149+0000 7f71d9a40640 10 monclient: shutdown 2024-09-13T10:30:28.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.149+0000 7f71d9a40640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.149+0000 7f71d9a40640 1 -- 172.21.15.181:0/3232309858 >> v1:172.21.15.181:6790/0 conn(0x7f71d40a66d0 legacy=0x7f71d40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.149+0000 7f71d9a40640 1 -- 172.21.15.181:0/3232309858 shutdown_connections 2024-09-13T10:30:28.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.149+0000 7f71d9a40640 1 -- 172.21.15.181:0/3232309858 >> 172.21.15.181:0/3232309858 conn(0x7f71d40abcd0 msgr2=0x7f71d40ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.149+0000 7f71d9a40640 1 -- 172.21.15.181:0/3232309858 shutdown_connections 2024-09-13T10:30:28.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.149+0000 7f71d9a40640 1 -- 172.21.15.181:0/3232309858 wait complete. 2024-09-13T10:30:28.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.150+0000 7f71d9a40640 10 monclient: build_initial_monmap 2024-09-13T10:30:28.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.150+0000 7f71d9a40640 10 monclient: monmap: 2024-09-13T10:30:28.163 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:28.163 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:28.163 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:28.163 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:28.163 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:28.163 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:28.163 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:28.163 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:28.163 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:28.164 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:28.164 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:28.164 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:28.164 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:28.164 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:28.164 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:28.164 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.150+0000 7f71d9a40640 1 Processor -- start 2024-09-13T10:30:28.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d9a40640 1 -- start start 2024-09-13T10:30:28.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d9a40640 10 monclient: init 2024-09-13T10:30:28.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d9a40640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:28.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d9a40640 10 monclient: _add_conns ranks=[6,3,5,4,2,7,8,0,1] 2024-09-13T10:30:28.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d9a40640 10 monclient(hunting): picked mon.noname-d con 0x7f71d40a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:28.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d9a40640 10 monclient(hunting): picked mon.noname-g con 0x7f71d40a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:28.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d9a40640 10 monclient(hunting): picked mon.noname-h con 0x7f71d413f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:28.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d9a40640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d40a2280 con 0x7f71d40a6ab0 2024-09-13T10:30:28.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d9a40640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d413ed80 con 0x7f71d413f9a0 2024-09-13T10:30:28.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d9a40640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d413d480 con 0x7f71d40a66d0 2024-09-13T10:30:28.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d9a40640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:28.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d9a40640 10 monclient(hunting): authenticate will time out at 767.656697s 2024-09-13T10:30:28.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d2ffd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f71d40a66d0 0x7f71d41366d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45616/0 (socket says 172.21.15.181:45616) 2024-09-13T10:30:28.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.151+0000 7f71d2ffd640 1 -- 172.21.15.181:0/4098428036 learned_addr learned my addr 172.21.15.181:0/4098428036 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:28.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.154+0000 7f71d2ffd640 1 -- 172.21.15.181:0/4098428036 >> v1:172.21.15.181:6792/0 conn(0x7f71d40a66d0 legacy=0x7f71d41366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.154+0000 7f71d27fc640 1 -- 172.21.15.181:0/4098428036 >> v1:172.21.15.195:6790/0 conn(0x7f71d40a6ab0 legacy=0x7f71d41d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.154+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:30:28.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.154+0000 7f71d37fe640 1 -- 172.21.15.181:0/4098428036 >> v1:172.21.15.195:6791/0 conn(0x7f71d413f9a0 legacy=0x7f71d41d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720770899 0 0) 0x7f71d413d480 con 0x7f71d40a66d0 2024-09-13T10:30:28.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): my global_id is 4299 2024-09-13T10:30:28.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71c0003520 con 0x7f71d40a66d0 2024-09-13T10:30:28.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194152811 0 0) 0x7f71d40a2280 con 0x7f71d40a6ab0 2024-09-13T10:30:28.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): my global_id is 4296 2024-09-13T10:30:28.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d413d480 con 0x7f71d40a6ab0 2024-09-13T10:30:28.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4173432758 0 0) 0x7f71d413ed80 con 0x7f71d413f9a0 2024-09-13T10:30:28.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): my global_id is 4352 2024-09-13T10:30:28.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d40a2280 con 0x7f71d413f9a0 2024-09-13T10:30:28.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 67123496 0 0) 0x7f71d40a2280 con 0x7f71d413f9a0 2024-09-13T10:30:28.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71d413ed80 con 0x7f71d413f9a0 2024-09-13T10:30:28.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71cc002040 con 0x7f71d413f9a0 2024-09-13T10:30:28.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:30:28.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): dump: 2024-09-13T10:30:28.174 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.174 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.174 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.174 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.175 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.175 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.175 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.175 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.175 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.175 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.175 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.175 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.175 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.175 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.175 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.176 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:28.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 442981115 0 0) 0x7f71d413d480 con 0x7f71d40a6ab0 2024-09-13T10:30:28.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71d40a2280 con 0x7f71d40a6ab0 2024-09-13T10:30:28.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2596961961 0 0) 0x7f71c0003520 con 0x7f71d40a66d0 2024-09-13T10:30:28.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71d413d480 con 0x7f71d40a66d0 2024-09-13T10:30:28.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71c8001930 con 0x7f71d40a6ab0 2024-09-13T10:30:28.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:28.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): dump: 2024-09-13T10:30:28.176 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.177 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.177 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.177 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.177 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.177 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.177 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.177 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.177 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.177 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.177 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.177 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.178 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71c4003b00 con 0x7f71d40a66d0 2024-09-13T10:30:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.156+0000 7f71bbfff640 10 monclient(hunting): dump: 2024-09-13T10:30:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.178 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.179 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.179 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.179 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.179 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.179 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.179 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.179 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.179 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.179 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.179 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.179 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.180 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 36388107 0 0) 0x7f71d40a2280 con 0x7f71d40a6ab0 2024-09-13T10:30:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 >> v1:172.21.15.181:6792/0 conn(0x7f71d40a66d0 legacy=0x7f71d41366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 >> v1:172.21.15.195:6791/0 conn(0x7f71d413f9a0 legacy=0x7f71d41d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 1 monclient: found mon.g 2024-09-13T10:30:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:30:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d413f060 con 0x7f71d40a6ab0 2024-09-13T10:30:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71d9a40640 5 monclient: authenticate success, global_id 4296 2024-09-13T10:30:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71d9a40640 10 monclient: _renew_subs 2024-09-13T10:30:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71d9a40640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:30:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71d9a40640 1 -- 172.21.15.181:0/4098428036 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f71d4142db0 con 0x7f71d40a6ab0 2024-09-13T10:30:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71d9a40640 10 monclient: _renew_subs 2024-09-13T10:30:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71d9a40640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:30:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71d9a40640 1 -- 172.21.15.181:0/4098428036 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f71d413eaa0 con 0x7f71d40a6ab0 2024-09-13T10:30:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71c8004dd0 con 0x7f71d40a6ab0 2024-09-13T10:30:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71c80052c0 con 0x7f71d40a6ab0 2024-09-13T10:30:28.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:28.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71bbfff640 10 monclient: dump: 2024-09-13T10:30:28.182 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.182 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.182 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.182 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.182 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.182 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.182 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.182 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.182 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.182 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.157+0000 7f71d17fa640 4 set_mon_vals no callback set 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.159+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f71c8011940 con 0x7f71d40a6ab0 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.159+0000 7f71d9a40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.159+0000 7f71d9a40640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.159+0000 7f71d9a40640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.159+0000 7f71d9a40640 1 -- 172.21.15.181:0/4098428036 --> v1:172.21.15.195:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d406ccd0 con 0x7f71d40a6ab0 2024-09-13T10:30:28.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.159+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f71c804e050 con 0x7f71d40a6ab0 2024-09-13T10:30:28.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.159+0000 7f71d2ffd640 10 monclient: get_auth_request con 0x7f71c00404b0 auth_method 0 2024-09-13T10:30:28.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.164+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.3 v1:172.21.15.195:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f71c80176f0 con 0x7f71d40a6ab0 2024-09-13T10:30:28.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.164+0000 7f71bbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.164+0000 7f71bbfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:28.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.168+0000 7f557b809640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-13T10:30:28.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.168+0000 7f557b809640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-13T10:30:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.168+0000 7f557b809640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.168+0000 7f557b809640 1 -- 172.21.15.181:0/2888053595 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5554005370 con 0x7f55740a66d0 2024-09-13T10:30:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.171+0000 7f5569ffb640 1 -- 172.21.15.181:0/2888053595 <== mon.6 v1:172.21.15.181:6792/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 3756282479) 0x7f5570016fc0 con 0x7f55740a66d0 2024-09-13T10:30:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.171+0000 7f5569ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-13T10:30:28.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.171+0000 7f5569ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:28.185 INFO:teuthology.orchestra.run.smithi181.stdout:55834574854 2024-09-13T10:30:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.175+0000 7f557b809640 1 -- 172.21.15.181:0/2888053595 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5558040670 legacy=0x7f5558042b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.175+0000 7f557b809640 10 monclient: shutdown 2024-09-13T10:30:28.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.175+0000 7f557b809640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.175+0000 7f557b809640 1 -- 172.21.15.181:0/2888053595 >> v1:172.21.15.181:6792/0 conn(0x7f55740a66d0 legacy=0x7f55741ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.175+0000 7f557b809640 1 -- 172.21.15.181:0/2888053595 shutdown_connections 2024-09-13T10:30:28.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.175+0000 7f557b809640 1 -- 172.21.15.181:0/2888053595 >> 172.21.15.181:0/2888053595 conn(0x7f55740abcd0 msgr2=0x7f5574137cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.175+0000 7f557b809640 1 -- 172.21.15.181:0/2888053595 shutdown_connections 2024-09-13T10:30:28.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.175+0000 7f557b809640 1 -- 172.21.15.181:0/2888053595 wait complete. 2024-09-13T10:30:28.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.181+0000 7f75af144640 10 monclient: get_monmap_and_config 2024-09-13T10:30:28.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.181+0000 7f75af144640 10 monclient: build_initial_monmap 2024-09-13T10:30:28.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.181+0000 7f75af144640 10 monclient: monmap: 2024-09-13T10:30:28.189 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:28.190 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.190 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:28.181772+0000 2024-09-13T10:30:28.190 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:28.181772+0000 2024-09-13T10:30:28.190 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:28.190 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.190 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:28.190 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:28.190 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:28.190 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:28.190 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:28.191 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:28.191 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:28.191 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:28.191 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:28.191 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.182+0000 7f75af144640 1 Processor -- start 2024-09-13T10:30:28.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.182+0000 7f75af144640 1 -- start start 2024-09-13T10:30:28.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.182+0000 7f75af144640 10 monclient: init 2024-09-13T10:30:28.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f75af144640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:28.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f75af144640 10 monclient: _add_conns ranks=[5,6,7,2,4,3,0,1,8] 2024-09-13T10:30:28.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f75af144640 10 monclient(hunting): picked mon.noname-h con 0x7f75a80a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:28.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f75af144640 10 monclient(hunting): picked mon.noname-d con 0x7f75a80a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:28.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f75af144640 10 monclient(hunting): picked mon.noname-i con 0x7f75a813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:28.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f75af144640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a80a5fe0 con 0x7f75a80a66d0 2024-09-13T10:30:28.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f75af144640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a80a8080 con 0x7f75a80a6ab0 2024-09-13T10:30:28.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f75a7fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f75a80a6ab0 0x7f75a80a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45630/0 (socket says 172.21.15.181:45630) 2024-09-13T10:30:28.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f75a7fff640 1 -- 172.21.15.181:0/1640715382 learned_addr learned my addr 172.21.15.181:0/1640715382 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:28.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f75af144640 1 -- 172.21.15.181:0/1640715382 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a80a42c0 con 0x7f75a813f9a0 2024-09-13T10:30:28.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f75af144640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:28.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f75af144640 10 monclient(hunting): authenticate will time out at 767.688825s 2024-09-13T10:30:28.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f892b849640 10 monclient: get_monmap_and_config 2024-09-13T10:30:28.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f892b849640 10 monclient: build_initial_monmap 2024-09-13T10:30:28.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.183+0000 7f892b849640 10 monclient: monmap: 2024-09-13T10:30:28.193 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:28.193 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.193 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:28.184554+0000 2024-09-13T10:30:28.193 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:28.184554+0000 2024-09-13T10:30:28.193 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:28.193 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.193 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:28.194 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:28.194 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:28.194 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:28.194 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:28.194 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:28.194 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:28.194 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:28.194 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:28.194 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.184+0000 7fba3d4d6640 10 monclient: get_monmap_and_config 2024-09-13T10:30:28.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.184+0000 7fba3d4d6640 10 monclient: build_initial_monmap 2024-09-13T10:30:28.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.184+0000 7fba3d4d6640 10 monclient: monmap: 2024-09-13T10:30:28.195 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:28.195 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.195 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:28.184807+0000 2024-09-13T10:30:28.195 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:28.184807+0000 2024-09-13T10:30:28.195 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:28.195 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.195 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:28.196 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:28.196 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:28.196 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:28.196 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:28.196 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:28.196 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:28.196 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:28.196 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:28.196 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.184+0000 7fba3d4d6640 1 Processor -- start 2024-09-13T10:30:28.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.184+0000 7f892b849640 1 Processor -- start 2024-09-13T10:30:28.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.184+0000 7fba3d4d6640 1 -- start start 2024-09-13T10:30:28.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.184+0000 7fba3d4d6640 10 monclient: init 2024-09-13T10:30:28.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7f892b849640 1 -- start start 2024-09-13T10:30:28.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7f892b849640 10 monclient: init 2024-09-13T10:30:28.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7fba3d4d6640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:28.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7fba3d4d6640 10 monclient: _add_conns ranks=[7,5,4,2,6,8,0,3,1] 2024-09-13T10:30:28.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7fba3d4d6640 10 monclient(hunting): picked mon.noname-i con 0x7fba3809ca60 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:28.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7fba3d4d6640 10 monclient(hunting): picked mon.noname-h con 0x7fba3809ce40 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:28.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7fba3d4d6640 10 monclient(hunting): picked mon.noname-c con 0x7fba3813bb30 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:28.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7f75a7fff640 1 -- 172.21.15.181:0/1640715382 >> v1:172.21.15.181:6792/0 conn(0x7f75a80a6ab0 legacy=0x7f75a80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7fba3d4d6640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3809ee00 con 0x7fba3813bb30 2024-09-13T10:30:28.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7fba3d4d6640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba380a4170 con 0x7fba3809ce40 2024-09-13T10:30:28.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7fba3d4d6640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3809e560 con 0x7fba3809ca60 2024-09-13T10:30:28.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7fba3d4d6640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:28.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7fba3d4d6640 10 monclient(hunting): authenticate will time out at 767.690863s 2024-09-13T10:30:28.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7f892b849640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:28.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7fba377fe640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fba3813bb30 0x7fba3813df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38468/0 (socket says 172.21.15.181:38468) 2024-09-13T10:30:28.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7fba377fe640 1 -- 172.21.15.181:0/3146497814 learned_addr learned my addr 172.21.15.181:0/3146497814 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:28.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.185+0000 7f892b849640 10 monclient: _add_conns ranks=[8,2,1,6,7,4,0,5,3] 2024-09-13T10:30:28.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f892b849640 10 monclient(hunting): picked mon.noname-e con 0x7f8924132b40 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:28.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f892b849640 10 monclient(hunting): picked mon.noname-b con 0x7f892409ca60 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:28.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75acee0640 1 -- 172.21.15.181:0/1640715382 >> v1:172.21.15.195:6791/0 conn(0x7f75a80a66d0 legacy=0x7f75a80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75ad6e1640 1 -- 172.21.15.181:0/1640715382 >> v1:172.21.15.195:6792/0 conn(0x7f75a813f9a0 legacy=0x7f75a8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571768605 0 0) 0x7f75a80a8080 con 0x7f75a80a6ab0 2024-09-13T10:30:28.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient(hunting): my global_id is 4308 2024-09-13T10:30:28.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7598003520 con 0x7f75a80a6ab0 2024-09-13T10:30:28.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339600154 0 0) 0x7f75a80a5fe0 con 0x7f75a80a66d0 2024-09-13T10:30:28.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient(hunting): my global_id is 4361 2024-09-13T10:30:28.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75a80a8080 con 0x7f75a80a66d0 2024-09-13T10:30:28.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738109008 0 0) 0x7f75a80a42c0 con 0x7f75a813f9a0 2024-09-13T10:30:28.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient(hunting): my global_id is 54340 2024-09-13T10:30:28.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75a80a5fe0 con 0x7f75a813f9a0 2024-09-13T10:30:28.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f892b849640 10 monclient(hunting): picked mon.noname-f con 0x7f892409ead0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:28.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f892b849640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f892409d850 con 0x7f892409ead0 2024-09-13T10:30:28.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4187218673 0 0) 0x7f7598003520 con 0x7f75a80a6ab0 2024-09-13T10:30:28.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 >> v1:172.21.15.195:6792/0 conn(0x7f75a813f9a0 legacy=0x7f75a8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 >> v1:172.21.15.195:6791/0 conn(0x7f75a80a66d0 legacy=0x7f75a80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 monclient: found mon.noname-d 2024-09-13T10:30:28.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:30:28.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a81464e0 con 0x7f75a80a6ab0 2024-09-13T10:30:28.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7594001ae0 con 0x7f75a80a6ab0 2024-09-13T10:30:28.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f892b849640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f892409db30 con 0x7f892409ca60 2024-09-13T10:30:28.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:28.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient: dump: 2024-09-13T10:30:28.206 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.207 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.207 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.207 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.207 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.207 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.207 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.207 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.207 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.207 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.207 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.207 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.208 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.208 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.208 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.208 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75af144640 5 monclient: authenticate success, global_id 4308 2024-09-13T10:30:28.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75af144640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:28.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f89295e5640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f8924132b40 0x7f8924132f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39830/0 (socket says 172.21.15.181:39830) 2024-09-13T10:30:28.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f89295e5640 1 -- 172.21.15.181:0/2218533821 learned_addr learned my addr 172.21.15.181:0/2218533821 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:28.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f75940048a0 con 0x7f75a80a6ab0 2024-09-13T10:30:28.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 1 -- 172.21.15.181:0/1640715382 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7594004e10 con 0x7f75a80a6ab0 2024-09-13T10:30:28.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:28.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75a77fe640 10 monclient: dump: 2024-09-13T10:30:28.209 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.210 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.210 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.210 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.210 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.210 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.210 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.210 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.210 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.210 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.210 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.211 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.211 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.211 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.211 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.211 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75af144640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:28.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f75af144640 4 set_mon_vals no callback set 2024-09-13T10:30:28.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f892b849640 1 -- 172.21.15.181:0/2218533821 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f892409de10 con 0x7f8924132b40 2024-09-13T10:30:28.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f892b849640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:28.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.186+0000 7f892b849640 10 monclient(hunting): authenticate will time out at 767.691826s 2024-09-13T10:30:28.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.187+0000 7f75af144640 10 monclient: shutdown 2024-09-13T10:30:28.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.187+0000 7f75af144640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.187+0000 7f75af144640 1 -- 172.21.15.181:0/1640715382 >> v1:172.21.15.181:6792/0 conn(0x7f75a80a6ab0 legacy=0x7f75a80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.187+0000 7f75af144640 1 -- 172.21.15.181:0/1640715382 shutdown_connections 2024-09-13T10:30:28.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.187+0000 7f75af144640 1 -- 172.21.15.181:0/1640715382 >> 172.21.15.181:0/1640715382 conn(0x7f75a80abcd0 msgr2=0x7f75a80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.187+0000 7f75af144640 1 -- 172.21.15.181:0/1640715382 shutdown_connections 2024-09-13T10:30:28.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.187+0000 7f75af144640 1 -- 172.21.15.181:0/1640715382 wait complete. 2024-09-13T10:30:28.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7fba377fe640 1 -- 172.21.15.181:0/3146497814 >> v1:172.21.15.181:6791/0 conn(0x7fba3813bb30 legacy=0x7fba3813df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7fba36ffd640 1 -- 172.21.15.181:0/3146497814 >> v1:172.21.15.195:6792/0 conn(0x7fba3809ca60 legacy=0x7fba3809f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f75af144640 10 monclient: build_initial_monmap 2024-09-13T10:30:28.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f75af144640 10 monclient: monmap: 2024-09-13T10:30:28.216 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:28.216 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:28.216 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:28.216 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:28.216 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:28.216 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:28.216 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:28.216 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:28.216 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:28.216 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:28.217 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:28.217 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:28.217 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:28.217 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:28.217 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:28.217 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7fba35ffb640 1 -- 172.21.15.181:0/3146497814 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497872204 0 0) 0x7fba3809ee00 con 0x7fba3813bb30 2024-09-13T10:30:28.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7fba35ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7fba35ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7fba35ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f89295e5640 1 -- 172.21.15.181:0/2218533821 >> v1:172.21.15.181:6793/0 conn(0x7f8924132b40 legacy=0x7f8924132f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7fba35ffb640 10 monclient(hunting): my global_id is 4396 2024-09-13T10:30:28.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7fba35ffb640 1 -- 172.21.15.181:0/3146497814 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba20003520 con 0x7fba3813bb30 2024-09-13T10:30:28.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7fba367fc640 1 -- 172.21.15.181:0/3146497814 >> v1:172.21.15.195:6791/0 conn(0x7fba3809ce40 legacy=0x7fba3809d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f75af144640 1 Processor -- start 2024-09-13T10:30:28.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7fba35ffb640 1 -- 172.21.15.181:0/3146497814 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235989277 0 0) 0x7fba380a4170 con 0x7fba3809ce40 2024-09-13T10:30:28.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient(hunting): my global_id is 4370 2024-09-13T10:30:28.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 1 -- 172.21.15.181:0/3146497814 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba3809ee00 con 0x7fba3809ce40 2024-09-13T10:30:28.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f891bfff640 1 -- 172.21.15.181:0/2218533821 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1867072988 0 0) 0x7f892409de10 con 0x7f8924132b40 2024-09-13T10:30:28.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f891bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f891bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f891bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f891bfff640 10 monclient(hunting): my global_id is 4319 2024-09-13T10:30:28.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f891bfff640 1 -- 172.21.15.181:0/2218533821 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8910003520 con 0x7f8924132b40 2024-09-13T10:30:28.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f8929de6640 1 -- 172.21.15.181:0/2218533821 >> v1:172.21.15.195:6789/0 conn(0x7f892409ead0 legacy=0x7f8924141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 1 -- 172.21.15.181:0/2218533821 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1935543966 0 0) 0x7f8910003520 con 0x7f8924132b40 2024-09-13T10:30:28.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 1 -- 172.21.15.181:0/2218533821 >> v1:172.21.15.181:6790/0 conn(0x7f892409ca60 legacy=0x7f892413e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f8928de4640 1 -- 172.21.15.181:0/2218533821 >> v1:172.21.15.181:6790/0 conn(0x7f892409ca60 legacy=0x7f892413e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 1 -- 172.21.15.181:0/2218533821 >> v1:172.21.15.195:6789/0 conn(0x7f892409ead0 legacy=0x7f8924141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 1 monclient: found mon.noname-e 2024-09-13T10:30:28.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 1 -- 172.21.15.181:0/2218533821 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892409e0f0 con 0x7f8924132b40 2024-09-13T10:30:28.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 1 -- 172.21.15.181:0/2218533821 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8920001ac0 con 0x7f8924132b40 2024-09-13T10:30:28.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:28.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 1 -- 172.21.15.181:0/3146497814 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 901701647 0 0) 0x7fba20003520 con 0x7fba3813bb30 2024-09-13T10:30:28.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 1 -- 172.21.15.181:0/3146497814 >> v1:172.21.15.195:6792/0 conn(0x7fba3809ca60 legacy=0x7fba3809f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 1 -- 172.21.15.181:0/3146497814 >> v1:172.21.15.195:6791/0 conn(0x7fba3809ce40 legacy=0x7fba3809d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 1 monclient: found mon.noname-c 2024-09-13T10:30:28.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:30:28.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 1 -- 172.21.15.181:0/3146497814 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3809e840 con 0x7fba3813bb30 2024-09-13T10:30:28.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 1 -- 172.21.15.181:0/3146497814 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba30001e60 con 0x7fba3813bb30 2024-09-13T10:30:28.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:28.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient: dump: 2024-09-13T10:30:28.224 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.224 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.224 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.224 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.224 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.224 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.224 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.224 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.224 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.224 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.225 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.225 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.225 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.225 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.225 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.225 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba3d4d6640 5 monclient: authenticate success, global_id 4396 2024-09-13T10:30:28.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba3d4d6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:28.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f75af144640 1 -- start start 2024-09-13T10:30:28.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.188+0000 7f75af144640 10 monclient: init 2024-09-13T10:30:28.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 10 monclient: dump: 2024-09-13T10:30:28.226 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.226 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.226 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.226 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.226 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.227 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.227 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.227 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.227 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.227 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.227 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.227 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.227 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.227 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.227 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.227 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f892b849640 5 monclient: authenticate success, global_id 4319 2024-09-13T10:30:28.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f892b849640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:28.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 1 -- 172.21.15.181:0/2218533821 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89200048a0 con 0x7f8924132b40 2024-09-13T10:30:28.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f892b849640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:28.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f892b849640 4 set_mon_vals no callback set 2024-09-13T10:30:28.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 1 -- 172.21.15.181:0/2218533821 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8920004e10 con 0x7f8924132b40 2024-09-13T10:30:28.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:28.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f891bfff640 10 monclient: dump: 2024-09-13T10:30:28.228 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.228 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.229 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.229 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.229 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.229 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.229 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.229 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.229 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.229 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.230 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.230 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.230 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.230 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.230 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.230 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 1 -- 172.21.15.181:0/3146497814 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba30004c20 con 0x7fba3813bb30 2024-09-13T10:30:28.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 1 -- 172.21.15.181:0/3146497814 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba30005110 con 0x7fba3813bb30 2024-09-13T10:30:28.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:28.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba35ffb640 10 monclient: dump: 2024-09-13T10:30:28.231 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.231 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.231 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.231 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.231 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.231 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.231 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.232 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.232 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.232 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.232 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.232 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.232 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.232 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.232 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.232 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba3d4d6640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:28.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7fba3d4d6640 4 set_mon_vals no callback set 2024-09-13T10:30:28.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f75af144640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:28.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f75af144640 10 monclient: _add_conns ranks=[8,7,6,4,3,5,2,1,0] 2024-09-13T10:30:28.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f75af144640 10 monclient(hunting): picked mon.noname-e con 0x7f75a80a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:28.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f75af144640 10 monclient(hunting): picked mon.noname-i con 0x7f75a80a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:28.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f75af144640 10 monclient(hunting): picked mon.noname-d con 0x7f75a813f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:28.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f75af144640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a8072820 con 0x7f75a813f9a0 2024-09-13T10:30:28.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f75af144640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a8074120 con 0x7f75a80a6ab0 2024-09-13T10:30:28.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.189+0000 7f75af144640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a8074400 con 0x7f75a80a66d0 2024-09-13T10:30:28.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7f75af144640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:28.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7f75af144640 10 monclient(hunting): authenticate will time out at 767.695051s 2024-09-13T10:30:28.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7f75ad6e1640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f75a813f9a0 0x7f75a81dab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45636/0 (socket says 172.21.15.181:45636) 2024-09-13T10:30:28.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7f75acee0640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f75a80a66d0 0x7f75a813e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39840/0 (socket says 172.21.15.181:39840) 2024-09-13T10:30:28.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7f75ad6e1640 1 -- 172.21.15.181:0/719936115 learned_addr learned my addr 172.21.15.181:0/719936115 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:28.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7f892b849640 10 monclient: shutdown 2024-09-13T10:30:28.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7f892b849640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7f892b849640 1 -- 172.21.15.181:0/2218533821 >> v1:172.21.15.181:6793/0 conn(0x7f8924132b40 legacy=0x7f8924132f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7f892b849640 1 -- 172.21.15.181:0/2218533821 shutdown_connections 2024-09-13T10:30:28.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7f892b849640 1 -- 172.21.15.181:0/2218533821 >> 172.21.15.181:0/2218533821 conn(0x7f89240a8750 msgr2=0x7f89240a4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7fba3d4d6640 10 monclient: shutdown 2024-09-13T10:30:28.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-09-13T10:30:28.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7fba3d4d6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7fba3d4d6640 1 -- 172.21.15.181:0/3146497814 >> v1:172.21.15.181:6791/0 conn(0x7fba3813bb30 legacy=0x7fba3813df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.238 DEBUG:teuthology.parallel:result is None 2024-09-13T10:30:28.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7f892b849640 1 -- 172.21.15.181:0/2218533821 shutdown_connections 2024-09-13T10:30:28.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7f892b849640 1 -- 172.21.15.181:0/2218533821 wait complete. 2024-09-13T10:30:28.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7fba3d4d6640 1 -- 172.21.15.181:0/3146497814 shutdown_connections 2024-09-13T10:30:28.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.190+0000 7fba3d4d6640 1 -- 172.21.15.181:0/3146497814 >> 172.21.15.181:0/3146497814 conn(0x7fba380a8540 msgr2=0x7fba380a4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.191+0000 7fba3d4d6640 1 -- 172.21.15.181:0/3146497814 shutdown_connections 2024-09-13T10:30:28.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.191+0000 7fba3d4d6640 1 -- 172.21.15.181:0/3146497814 wait complete. 2024-09-13T10:30:28.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.191+0000 7f892b849640 10 monclient: build_initial_monmap 2024-09-13T10:30:28.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.191+0000 7f892b849640 10 monclient: monmap: 2024-09-13T10:30:28.239 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:28.240 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:28.240 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:28.240 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:28.240 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:28.240 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:28.240 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:28.240 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:28.240 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:28.240 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:28.240 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:28.240 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:28.241 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:28.241 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:28.241 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:28.241 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7fba3d4d6640 10 monclient: build_initial_monmap 2024-09-13T10:30:28.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7fba3d4d6640 10 monclient: monmap: 2024-09-13T10:30:28.241 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:28.241 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:28.242 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:28.242 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:28.242 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:28.242 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:28.242 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:28.242 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:28.242 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:28.242 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:28.242 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:28.242 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:28.242 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:28.242 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:28.243 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:28.243 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f892b849640 1 Processor -- start 2024-09-13T10:30:28.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f892b849640 1 -- start start 2024-09-13T10:30:28.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f892b849640 10 monclient: init 2024-09-13T10:30:28.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75ad6e1640 1 -- 172.21.15.181:0/719936115 >> v1:172.21.15.181:6792/0 conn(0x7f75a813f9a0 legacy=0x7f75a81dab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75acee0640 1 -- 172.21.15.181:0/719936115 >> v1:172.21.15.181:6793/0 conn(0x7f75a80a66d0 legacy=0x7f75a813e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a7fff640 1 -- 172.21.15.181:0/719936115 >> v1:172.21.15.195:6792/0 conn(0x7f75a80a6ab0 legacy=0x7f75a81d7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1951732251 0 0) 0x7f75a8072820 con 0x7f75a813f9a0 2024-09-13T10:30:28.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): my global_id is 4317 2024-09-13T10:30:28.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f758c003520 con 0x7f75a813f9a0 2024-09-13T10:30:28.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858110363 0 0) 0x7f75a8074400 con 0x7f75a80a66d0 2024-09-13T10:30:28.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): my global_id is 4328 2024-09-13T10:30:28.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75a8072820 con 0x7f75a80a66d0 2024-09-13T10:30:28.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 462477937 0 0) 0x7f758c003520 con 0x7f75a813f9a0 2024-09-13T10:30:28.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75a8074400 con 0x7f75a813f9a0 2024-09-13T10:30:28.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f75a0002060 con 0x7f75a813f9a0 2024-09-13T10:30:28.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f892b849640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:28.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f892b849640 10 monclient: _add_conns ranks=[5,3,7,4,1,8,6,0,2] 2024-09-13T10:30:28.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7fba3d4d6640 1 Processor -- start 2024-09-13T10:30:28.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:28.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7fba3d4d6640 1 -- start start 2024-09-13T10:30:28.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f892b849640 10 monclient(hunting): picked mon.noname-h con 0x7f892409ca60 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:28.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f892b849640 10 monclient(hunting): picked mon.noname-g con 0x7f892409ead0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:28.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f892b849640 10 monclient(hunting): picked mon.noname-i con 0x7f8924131550 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:28.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): dump: 2024-09-13T10:30:28.248 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.249 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.249 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.249 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.249 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.249 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.249 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.249 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.249 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.249 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.249 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.250 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.250 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.250 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.250 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.250 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:28.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2324467893 0 0) 0x7f75a8074120 con 0x7f75a80a6ab0 2024-09-13T10:30:28.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 10 monclient(hunting): my global_id is 54358 2024-09-13T10:30:28.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.192+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f758c003520 con 0x7f75a80a6ab0 2024-09-13T10:30:28.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4169794018 0 0) 0x7f75a8072820 con 0x7f75a80a66d0 2024-09-13T10:30:28.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f892b849640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89240a3fa0 con 0x7f892409ead0 2024-09-13T10:30:28.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f892b849640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8924136d50 con 0x7f892409ca60 2024-09-13T10:30:28.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75a8074120 con 0x7f75a80a66d0 2024-09-13T10:30:28.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f759c001d20 con 0x7f75a80a66d0 2024-09-13T10:30:28.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:28.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 10 monclient(hunting): dump: 2024-09-13T10:30:28.252 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.252 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.252 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.252 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.252 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.252 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.253 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.253 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.253 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.253 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.253 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.253 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.253 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.253 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.253 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.253 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3335640033 0 0) 0x7f75a8074120 con 0x7f75a80a66d0 2024-09-13T10:30:28.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 >> v1:172.21.15.195:6792/0 conn(0x7f75a80a6ab0 legacy=0x7f75a81d7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 >> v1:172.21.15.181:6792/0 conn(0x7f75a813f9a0 legacy=0x7f75a81dab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 1 monclient: found mon.e 2024-09-13T10:30:28.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f89295e5640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f892409ca60 0x7f892412eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:54862/0 (socket says 172.21.15.181:54862) 2024-09-13T10:30:28.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f89295e5640 1 -- 172.21.15.181:0/3328641116 learned_addr learned my addr 172.21.15.181:0/3328641116 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:28.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a8072ee0 con 0x7f75a80a66d0 2024-09-13T10:30:28.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f892b849640 1 -- 172.21.15.181:0/3328641116 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8924137030 con 0x7f8924131550 2024-09-13T10:30:28.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f892b849640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:28.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f892b849640 10 monclient(hunting): authenticate will time out at 767.698416s 2024-09-13T10:30:28.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7fba3d4d6640 10 monclient: init 2024-09-13T10:30:28.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75af144640 5 monclient: authenticate success, global_id 4328 2024-09-13T10:30:28.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75af144640 10 monclient: _renew_subs 2024-09-13T10:30:28.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75af144640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75af144640 1 -- 172.21.15.181:0/719936115 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f75a8142db0 con 0x7f75a80a66d0 2024-09-13T10:30:28.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f759c003a70 con 0x7f75a80a66d0 2024-09-13T10:30:28.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f759c003f60 con 0x7f75a80a66d0 2024-09-13T10:30:28.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:28.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a57fa640 10 monclient: dump: 2024-09-13T10:30:28.258 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.258 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.258 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.258 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.258 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.258 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.258 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.258 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.258 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.258 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.258 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.259 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.259 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.259 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.259 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.259 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75a6ffd640 4 set_mon_vals no callback set 2024-09-13T10:30:28.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75af144640 10 monclient: _renew_subs 2024-09-13T10:30:28.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75af144640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.193+0000 7f75af144640 1 -- 172.21.15.181:0/719936115 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f75a813eea0 con 0x7f75a80a66d0 2024-09-13T10:30:28.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.194+0000 7fba3d4d6640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:28.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.194+0000 7fba3d4d6640 10 monclient: _add_conns ranks=[7,0,8,6,3,4,2,5,1] 2024-09-13T10:30:28.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.194+0000 7fba3d4d6640 10 monclient(hunting): picked mon.noname-i con 0x7fba3809ca60 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:28.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.194+0000 7fba3d4d6640 10 monclient(hunting): picked mon.noname-a con 0x7fba3809ce40 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:28.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.194+0000 7fba367fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fba3809ce40 0x7fba38138e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50814/0 (socket says 172.21.15.181:50814) 2024-09-13T10:30:28.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.194+0000 7fba36ffd640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7fba3809ca60 0x7fba38138770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:50224/0 (socket says 172.21.15.181:50224) 2024-09-13T10:30:28.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.194+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f759c004200 con 0x7f75a80a66d0 2024-09-13T10:30:28.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.194+0000 7fba377fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fba3813bb30 0x7fba381d4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39856/0 (socket says 172.21.15.181:39856) 2024-09-13T10:30:28.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.194+0000 7fba3d4d6640 10 monclient(hunting): picked mon.noname-e con 0x7fba3813bb30 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:28.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.194+0000 7fba367fc640 1 -- 172.21.15.181:0/4073134195 learned_addr learned my addr 172.21.15.181:0/4073134195 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:28.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.194+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3813fcd0 con 0x7fba3809ce40 2024-09-13T10:30:28.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.194+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba380a7510 con 0x7fba3809ca60 2024-09-13T10:30:28.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba38139590 con 0x7fba3813bb30 2024-09-13T10:30:28.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f759c04e0e0 con 0x7f75a80a66d0 2024-09-13T10:30:28.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7fba3d4d6640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:28.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7fba3d4d6640 10 monclient(hunting): authenticate will time out at 767.700100s 2024-09-13T10:30:28.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f75af144640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f75af144640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f75af144640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f75af144640 1 -- 172.21.15.181:0/719936115 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a80a3240 con 0x7f75a80a66d0 2024-09-13T10:30:28.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f75a7fff640 10 monclient: get_auth_request con 0x7f758c040040 auth_method 0 2024-09-13T10:30:28.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f89295e5640 1 -- 172.21.15.181:0/3328641116 >> v1:172.21.15.195:6791/0 conn(0x7f892409ca60 legacy=0x7f892412eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3323084506 0 0) 0x7f8924136d50 con 0x7f892409ca60 2024-09-13T10:30:28.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8919ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8919ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8919ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8919ffb640 10 monclient(hunting): my global_id is 4379 2024-09-13T10:30:28.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8928de4640 1 -- 172.21.15.181:0/3328641116 >> v1:172.21.15.195:6790/0 conn(0x7f892409ead0 legacy=0x7f892412f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8908003520 con 0x7f892409ca60 2024-09-13T10:30:28.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8929de6640 1 -- 172.21.15.181:0/3328641116 >> v1:172.21.15.195:6792/0 conn(0x7f8924131550 legacy=0x7f89241d6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679641927 0 0) 0x7f8914001480 con 0x7f892409ead0 2024-09-13T10:30:28.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8919ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8919ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8919ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8919ffb640 10 monclient(hunting): my global_id is 4305 2024-09-13T10:30:28.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8924136d50 con 0x7f892409ead0 2024-09-13T10:30:28.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.195+0000 7f8929de6640 1 --1- 172.21.15.181:0/3328641116 >> v1:172.21.15.195:6792/0 conn(0x7f8924131550 0x7f89241d6410 :-1 s=OPENED pgs=71 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f8924137030 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:30:28.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 716157991 0 0) 0x7f8908003520 con 0x7f892409ca60 2024-09-13T10:30:28.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8914001480 con 0x7f892409ca60 2024-09-13T10:30:28.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8920001a40 con 0x7f892409ca60 2024-09-13T10:30:28.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:30:28.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:28.268 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.268 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.268 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.268 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.268 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.268 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.268 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.268 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.268 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.268 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.268 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.269 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.269 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.269 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.269 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.269 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:28.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3968207989 0 0) 0x7f8924136d50 con 0x7f892409ead0 2024-09-13T10:30:28.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8908003520 con 0x7f892409ead0 2024-09-13T10:30:28.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8914003610 con 0x7f892409ead0 2024-09-13T10:30:28.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:28.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:28.270 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.270 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.270 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.270 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.270 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.270 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.270 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.270 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.270 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.270 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.270 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.271 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.271 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.271 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.271 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.271 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4212571698 0 0) 0x7f8914001480 con 0x7f892409ca60 2024-09-13T10:30:28.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 >> v1:172.21.15.195:6792/0 conn(0x7f8924131550 legacy=0x7f89241d6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 >> v1:172.21.15.195:6790/0 conn(0x7f892409ead0 legacy=0x7f892412f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 1 monclient: found mon.h 2024-09-13T10:30:28.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892412fe10 con 0x7f892409ca60 2024-09-13T10:30:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f8919ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f892b849640 5 monclient: authenticate success, global_id 4379 2024-09-13T10:30:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f892b849640 10 monclient: _renew_subs 2024-09-13T10:30:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f892b849640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f892b849640 1 -- 172.21.15.181:0/3328641116 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8924142930 con 0x7f892409ca60 2024-09-13T10:30:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f892b849640 10 monclient: _renew_subs 2024-09-13T10:30:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f892b849640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.196+0000 7f892b849640 1 -- 172.21.15.181:0/3328641116 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f8924131ee0 con 0x7f892409ca60 2024-09-13T10:30:28.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba36ffd640 1 -- 172.21.15.181:0/4073134195 >> v1:172.21.15.195:6792/0 conn(0x7fba3809ca60 legacy=0x7fba38138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba377fe640 1 -- 172.21.15.181:0/4073134195 >> v1:172.21.15.181:6793/0 conn(0x7fba3813bb30 legacy=0x7fba381d4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba367fc640 1 -- 172.21.15.181:0/4073134195 >> v1:172.21.15.181:6789/0 conn(0x7fba3809ce40 legacy=0x7fba38138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2927297471 0 0) 0x7fba3809e560 con 0x7fba3809ca60 2024-09-13T10:30:28.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 10 monclient(hunting): my global_id is 54376 2024-09-13T10:30:28.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba24003520 con 0x7fba3809ca60 2024-09-13T10:30:28.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377808245 0 0) 0x7fba3813fcd0 con 0x7fba3809ce40 2024-09-13T10:30:28.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 10 monclient(hunting): my global_id is 54270 2024-09-13T10:30:28.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f890f7fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f890f7fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f890f7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:28.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f890f7fe640 1 -- 172.21.15.181:0/3328641116 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89240008d0 con 0x7f892409ca60 2024-09-13T10:30:28.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba3809e560 con 0x7fba3809ce40 2024-09-13T10:30:28.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3635214725 0 0) 0x7fba24003520 con 0x7fba3809ca60 2024-09-13T10:30:28.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba3813fcd0 con 0x7fba3809ca60 2024-09-13T10:30:28.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 367552802 0 0) 0x7fba3809e560 con 0x7fba3809ce40 2024-09-13T10:30:28.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba24003520 con 0x7fba3809ce40 2024-09-13T10:30:28.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1683148380 0 0) 0x7f8924137030 con 0x7f8924131550 2024-09-13T10:30:28.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f8919ffb640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:30:28.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8920004db0 con 0x7f892409ca60 2024-09-13T10:30:28.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f8919ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89200056c0 con 0x7f892409ca60 2024-09-13T10:30:28.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f8919ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f8919ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:28.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f891b7fe640 4 set_mon_vals no callback set 2024-09-13T10:30:28.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.197+0000 7f8919ffb640 10 monclient: dump: 2024-09-13T10:30:28.278 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.278 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.278 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.278 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.278 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.278 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.279 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f8920011d40 con 0x7f892409ca60 2024-09-13T10:30:28.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba28003610 con 0x7fba3809ca60 2024-09-13T10:30:28.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:30:28.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f892004e400 con 0x7f892409ca60 2024-09-13T10:30:28.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7f8928de4640 10 monclient: get_auth_request con 0x7f8908040090 auth_method 0 2024-09-13T10:30:28.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient(hunting): dump: 2024-09-13T10:30:28.284 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.284 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.285 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.285 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.285 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.285 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.285 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.285 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.285 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.285 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.285 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.285 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.285 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.286 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.286 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.286 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:28.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba2c003610 con 0x7fba3809ce40 2024-09-13T10:30:28.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:28.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient(hunting): dump: 2024-09-13T10:30:28.286 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.286 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.286 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.286 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.287 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.287 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.287 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.287 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.287 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.287 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.287 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.287 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.287 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.287 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.287 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.287 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1058039403 0 0) 0x7fba3813fcd0 con 0x7fba3809ca60 2024-09-13T10:30:28.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 >> v1:172.21.15.181:6793/0 conn(0x7fba3813bb30 legacy=0x7fba381d4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 >> v1:172.21.15.181:6789/0 conn(0x7fba3809ce40 legacy=0x7fba38138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 1 monclient: found mon.i 2024-09-13T10:30:28.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:28.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba381434d0 con 0x7fba3809ca60 2024-09-13T10:30:28.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba3d4d6640 5 monclient: authenticate success, global_id 54376 2024-09-13T10:30:28.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba3d4d6640 10 monclient: _renew_subs 2024-09-13T10:30:28.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba3d4d6640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:28.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fba38142030 con 0x7fba3809ca60 2024-09-13T10:30:28.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba3d4d6640 10 monclient: _renew_subs 2024-09-13T10:30:28.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba3d4d6640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:28.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fba381409c0 con 0x7fba3809ca60 2024-09-13T10:30:28.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba28003c10 con 0x7fba3809ca60 2024-09-13T10:30:28.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba280041c0 con 0x7fba3809ca60 2024-09-13T10:30:28.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba357fa640 4 set_mon_vals no callback set 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.198+0000 7fba1f7fe640 10 monclient: dump: 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.290 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.291 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.291 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.291 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.291 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.291 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.200+0000 7fba3d4d6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.200+0000 7fba3d4d6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.200+0000 7fba3d4d6640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:28.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.200+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba18005080 con 0x7fba3809ca60 2024-09-13T10:30:28.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.200+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fba28011ca0 con 0x7fba3809ca60 2024-09-13T10:30:28.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.200+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7fba2804e110 con 0x7fba3809ca60 2024-09-13T10:30:28.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.200+0000 7fba367fc640 10 monclient: get_auth_request con 0x7fba24040400 auth_method 0 2024-09-13T10:30:28.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.201+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f759c017720 con 0x7f75a80a66d0 2024-09-13T10:30:28.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.201+0000 7f75a57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.201+0000 7f75a57fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:28.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.206+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.5 v1:172.21.15.195:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f892001bd70 con 0x7f892409ca60 2024-09-13T10:30:28.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.206+0000 7f8919ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.206+0000 7f8919ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:28.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.207+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.7 v1:172.21.15.195:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fba380a7510 con 0x7fba3809ca60 2024-09-13T10:30:28.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.207+0000 7fba1f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.207+0000 7fba1f7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:28.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.232+0000 7fb319cd6640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-13T10:30:28.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.232+0000 7fb319cd6640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-13T10:30:28.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.232+0000 7fb319cd6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.232+0000 7fb319cd6640 1 -- 172.21.15.181:0/1950904489 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb31406f6b0 con 0x7fb31412d4d0 2024-09-13T10:30:28.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.232+0000 7fb2fbfff640 1 -- 172.21.15.181:0/1950904489 <== mon.8 v1:172.21.15.181:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 1169801742) 0x7fb308017230 con 0x7fb31412d4d0 2024-09-13T10:30:28.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.233+0000 7fb2fbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-13T10:30:28.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.233+0000 7fb2fbfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:28.295 INFO:teuthology.orchestra.run.smithi181.stdout:47244640261 2024-09-13T10:30:28.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.236+0000 7fb319cd6640 1 -- 172.21.15.181:0/1950904489 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb30003fc90 legacy=0x7fb300042150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.236+0000 7fb319cd6640 10 monclient: shutdown 2024-09-13T10:30:28.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.236+0000 7fb319cd6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.236+0000 7fb319cd6640 1 -- 172.21.15.181:0/1950904489 >> v1:172.21.15.181:6793/0 conn(0x7fb31412d4d0 legacy=0x7fb31412c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.236+0000 7fb319cd6640 1 -- 172.21.15.181:0/1950904489 shutdown_connections 2024-09-13T10:30:28.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.236+0000 7fb319cd6640 1 -- 172.21.15.181:0/1950904489 >> 172.21.15.181:0/1950904489 conn(0x7fb31406e6e0 msgr2=0x7fb314136940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.236+0000 7fb319cd6640 1 -- 172.21.15.181:0/1950904489 shutdown_connections 2024-09-13T10:30:28.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.236+0000 7fb319cd6640 1 -- 172.21.15.181:0/1950904489 wait complete. 2024-09-13T10:30:28.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.4 2024-09-13T10:30:28.297 DEBUG:teuthology.parallel:result is None 2024-09-13T10:30:28.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.372+0000 7f71d9a40640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-13T10:30:28.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.372+0000 7f71d9a40640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-13T10:30:28.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.372+0000 7f71d9a40640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:30:28.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.372+0000 7f71d9a40640 1 -- 172.21.15.181:0/4098428036 --> v1:172.21.15.195:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f71d40a4bd0 con 0x7f71d40a6ab0 2024-09-13T10:30:28.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.373+0000 7f71bbfff640 1 -- 172.21.15.181:0/4098428036 <== mon.3 v1:172.21.15.195:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 4173471229) 0x7f71c8016ff0 con 0x7f71d40a6ab0 2024-09-13T10:30:28.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.373+0000 7f71bbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-13T10:30:28.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.373+0000 7f71bbfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:28.375 INFO:teuthology.orchestra.run.smithi181.stdout:51539607558 2024-09-13T10:30:28.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.375+0000 7f71d9a40640 1 -- 172.21.15.181:0/4098428036 >> v1:172.21.15.195:6800/1839191919 conn(0x7f71c00404b0 legacy=0x7f71c0042970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.375+0000 7f71d9a40640 10 monclient: shutdown 2024-09-13T10:30:28.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.375+0000 7f71d9a40640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.375+0000 7f71d9a40640 1 -- 172.21.15.181:0/4098428036 >> v1:172.21.15.195:6790/0 conn(0x7f71d40a6ab0 legacy=0x7f71d41d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.375+0000 7f71d9a40640 1 -- 172.21.15.181:0/4098428036 shutdown_connections 2024-09-13T10:30:28.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.375+0000 7f71d9a40640 1 -- 172.21.15.181:0/4098428036 >> 172.21.15.181:0/4098428036 conn(0x7f71d40abcd0 msgr2=0x7f71d40a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.375+0000 7f71d9a40640 1 -- 172.21.15.181:0/4098428036 shutdown_connections 2024-09-13T10:30:28.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.375+0000 7f71d9a40640 1 -- 172.21.15.181:0/4098428036 wait complete. 2024-09-13T10:30:28.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607558 got 51539607558 for osd.5 2024-09-13T10:30:28.388 DEBUG:teuthology.parallel:result is None 2024-09-13T10:30:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.390+0000 7f890f7fe640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-13T10:30:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.390+0000 7f890f7fe640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-13T10:30:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.390+0000 7f890f7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.390+0000 7f890f7fe640 1 -- 172.21.15.181:0/3328641116 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f89241431d0 con 0x7f892409ca60 2024-09-13T10:30:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.390+0000 7f8919ffb640 1 -- 172.21.15.181:0/3328641116 <== mon.5 v1:172.21.15.195:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 532354816) 0x7f8920020140 con 0x7f892409ca60 2024-09-13T10:30:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.390+0000 7f8919ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-13T10:30:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.390+0000 7f8919ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:28.392 INFO:teuthology.orchestra.run.smithi181.stdout:51539607557 2024-09-13T10:30:28.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.392+0000 7fba3d4d6640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-13T10:30:28.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.392+0000 7fba3d4d6640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-13T10:30:28.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.392+0000 7fba3d4d6640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:30:28.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.392+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fba18005370 con 0x7fba3809ca60 2024-09-13T10:30:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.393+0000 7f890f7fe640 1 -- 172.21.15.181:0/3328641116 >> v1:172.21.15.195:6800/1839191919 conn(0x7f8908040090 legacy=0x7f8908042550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.393+0000 7f890f7fe640 10 monclient: shutdown 2024-09-13T10:30:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.393+0000 7f890f7fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.393+0000 7f890f7fe640 1 -- 172.21.15.181:0/3328641116 >> v1:172.21.15.195:6791/0 conn(0x7f892409ca60 legacy=0x7f892412eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.393+0000 7f890f7fe640 1 -- 172.21.15.181:0/3328641116 shutdown_connections 2024-09-13T10:30:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.393+0000 7f890f7fe640 1 -- 172.21.15.181:0/3328641116 >> 172.21.15.181:0/3328641116 conn(0x7f89240a8750 msgr2=0x7f8924136380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.393+0000 7f890f7fe640 1 -- 172.21.15.181:0/3328641116 shutdown_connections 2024-09-13T10:30:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.393+0000 7f890f7fe640 1 -- 172.21.15.181:0/3328641116 wait complete. 2024-09-13T10:30:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.393+0000 7fba1f7fe640 1 -- 172.21.15.181:0/4073134195 <== mon.7 v1:172.21.15.195:6792/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 2777258794) 0x7fba28017770 con 0x7fba3809ca60 2024-09-13T10:30:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.393+0000 7fba1f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-13T10:30:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.393+0000 7fba1f7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:28.397 INFO:teuthology.orchestra.run.smithi181.stdout:55834574853 2024-09-13T10:30:28.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.395+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 >> v1:172.21.15.195:6800/1839191919 conn(0x7fba24040400 legacy=0x7fba240428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.395+0000 7fba3d4d6640 10 monclient: shutdown 2024-09-13T10:30:28.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.395+0000 7fba3d4d6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.395+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 >> v1:172.21.15.195:6792/0 conn(0x7fba3809ca60 legacy=0x7fba38138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.395+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 shutdown_connections 2024-09-13T10:30:28.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.395+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 >> 172.21.15.181:0/4073134195 conn(0x7fba380a8540 msgr2=0x7fba380a6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.395+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 shutdown_connections 2024-09-13T10:30:28.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.395+0000 7fba3d4d6640 1 -- 172.21.15.181:0/4073134195 wait complete. 2024-09-13T10:30:28.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.403+0000 7f75af144640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-13T10:30:28.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.403+0000 7f75af144640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-13T10:30:28.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.403+0000 7f75af144640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.403+0000 7f75af144640 1 -- 172.21.15.181:0/719936115 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f75a8069af0 con 0x7f75a80a66d0 2024-09-13T10:30:28.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.403+0000 7f75a57fa640 1 -- 172.21.15.181:0/719936115 <== mon.8 v1:172.21.15.181:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 2777258794) 0x7f759c017020 con 0x7f75a80a66d0 2024-09-13T10:30:28.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.403+0000 7f75a57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-13T10:30:28.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.403+0000 7f75a57fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:28.405 INFO:teuthology.orchestra.run.smithi181.stdout:55834574853 2024-09-13T10:30:28.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607557 for osd.0 2024-09-13T10:30:28.406 DEBUG:teuthology.parallel:result is None 2024-09-13T10:30:28.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.406+0000 7f75af144640 1 -- 172.21.15.181:0/719936115 >> v1:172.21.15.195:6800/1839191919 conn(0x7f758c040040 legacy=0x7f758c042500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.406+0000 7f75af144640 10 monclient: shutdown 2024-09-13T10:30:28.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.406+0000 7f75af144640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.406+0000 7f75af144640 1 -- 172.21.15.181:0/719936115 >> v1:172.21.15.181:6793/0 conn(0x7f75a80a66d0 legacy=0x7f75a813e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.406+0000 7f75af144640 1 -- 172.21.15.181:0/719936115 shutdown_connections 2024-09-13T10:30:28.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.406+0000 7f75af144640 1 -- 172.21.15.181:0/719936115 >> 172.21.15.181:0/719936115 conn(0x7f75a80abcd0 msgr2=0x7f75a8138d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.406+0000 7f75af144640 1 -- 172.21.15.181:0/719936115 shutdown_connections 2024-09-13T10:30:28.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.406+0000 7f75af144640 1 -- 172.21.15.181:0/719936115 wait complete. 2024-09-13T10:30:28.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-09-13T10:30:28.410 DEBUG:teuthology.parallel:result is None 2024-09-13T10:30:28.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-09-13T10:30:28.421 DEBUG:teuthology.parallel:result is None 2024-09-13T10:30:28.421 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T10:30:28.421 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T10:30:28.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.557+0000 7f6fdb0d4640 10 monclient: get_monmap_and_config 2024-09-13T10:30:28.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.557+0000 7f6fdb0d4640 10 monclient: build_initial_monmap 2024-09-13T10:30:28.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.557+0000 7f6fdb0d4640 10 monclient: monmap: 2024-09-13T10:30:28.559 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:28.559 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.559 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:28.557905+0000 2024-09-13T10:30:28.559 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:28.557905+0000 2024-09-13T10:30:28.559 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:28.559 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.559 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:28.559 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:28.560 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:28.560 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:28.560 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:28.560 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:28.560 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:28.560 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:28.560 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:28.560 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 1 Processor -- start 2024-09-13T10:30:28.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 1 -- start start 2024-09-13T10:30:28.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 10 monclient: init 2024-09-13T10:30:28.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:28.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 10 monclient: _add_conns ranks=[2,8,6,0,7,5,1,4,3] 2024-09-13T10:30:28.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 10 monclient(hunting): picked mon.noname-b con 0x7f6fd4133d50 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:28.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 10 monclient(hunting): picked mon.noname-e con 0x7f6fd4133890 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:28.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 10 monclient(hunting): picked mon.noname-d con 0x7f6fd413d870 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:28.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd40737d0 con 0x7f6fd4133d50 2024-09-13T10:30:28.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd4073ab0 con 0x7f6fd413d870 2024-09-13T10:30:28.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd4073d90 con 0x7f6fd4133890 2024-09-13T10:30:28.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:28.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fdb0d4640 10 monclient(hunting): authenticate will time out at 768.063616s 2024-09-13T10:30:28.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fd9671640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f6fd413d870 0x7f6fd413fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45638/0 (socket says 172.21.15.181:45638) 2024-09-13T10:30:28.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fd8e70640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f6fd4133d50 0x7f6fd4134130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48520/0 (socket says 172.21.15.181:48520) 2024-09-13T10:30:28.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.558+0000 7f6fd9671640 1 -- 172.21.15.181:0/2115295189 learned_addr learned my addr 172.21.15.181:0/2115295189 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:28.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.560+0000 7f6fd9671640 1 -- 172.21.15.181:0/2115295189 >> v1:172.21.15.181:6792/0 conn(0x7f6fd413d870 legacy=0x7f6fd413fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.560+0000 7f6fd3fff640 1 -- 172.21.15.181:0/2115295189 >> v1:172.21.15.181:6793/0 conn(0x7f6fd4133890 legacy=0x7f6fd413c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.560+0000 7f6fd8e70640 1 -- 172.21.15.181:0/2115295189 >> v1:172.21.15.181:6790/0 conn(0x7f6fd4133d50 legacy=0x7f6fd4134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195258426 0 0) 0x7f6fd4073d90 con 0x7f6fd4133890 2024-09-13T10:30:28.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient(hunting): my global_id is 4337 2024-09-13T10:30:28.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fc0003520 con 0x7f6fd4133890 2024-09-13T10:30:28.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228466325 0 0) 0x7f6fd40737d0 con 0x7f6fd4133d50 2024-09-13T10:30:28.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient(hunting): my global_id is 4367 2024-09-13T10:30:28.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd4073d90 con 0x7f6fd4133d50 2024-09-13T10:30:28.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4049145471 0 0) 0x7f6fd4073ab0 con 0x7f6fd413d870 2024-09-13T10:30:28.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient(hunting): my global_id is 4326 2024-09-13T10:30:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd40737d0 con 0x7f6fd413d870 2024-09-13T10:30:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd8e70640 1 --1- 172.21.15.181:0/2115295189 >> v1:172.21.15.181:6790/0 conn(0x7f6fd4133d50 0x7f6fd4134130 :-1 s=OPENED pgs=83 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f6fcc001ac0 mon_map magic: 0 2024-09-13T10:30:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 836798167 0 0) 0x7f6fc0003520 con 0x7f6fd4133890 2024-09-13T10:30:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 >> v1:172.21.15.181:6792/0 conn(0x7f6fd413d870 legacy=0x7f6fd413fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 >> v1:172.21.15.181:6790/0 conn(0x7f6fd4133d50 legacy=0x7f6fd4134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 monclient: found mon.noname-e 2024-09-13T10:30:28.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd4074070 con 0x7f6fd4133890 2024-09-13T10:30:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fc4001eb0 con 0x7f6fd4133890 2024-09-13T10:30:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient: dump: 2024-09-13T10:30:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.570 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.571 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.572 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fcc001ac0 con 0x7f6fd4133d50 2024-09-13T10:30:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fdb0d4640 5 monclient: authenticate success, global_id 4337 2024-09-13T10:30:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fdb0d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:30:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fc4003990 con 0x7f6fd4133890 2024-09-13T10:30:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 1 -- 172.21.15.181:0/2115295189 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fc4003f00 con 0x7f6fd4133890 2024-09-13T10:30:28.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fdb0d4640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fdb0d4640 4 set_mon_vals no callback set 2024-09-13T10:30:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.561+0000 7f6fd37fe640 10 monclient: dump: 2024-09-13T10:30:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.573 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.574 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.574 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.574 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.574 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.574 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.574 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.574 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.574 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.562+0000 7f6fdb0d4640 10 monclient: shutdown 2024-09-13T10:30:28.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.562+0000 7f6fdb0d4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.562+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/2115295189 >> v1:172.21.15.181:6793/0 conn(0x7f6fd4133890 legacy=0x7f6fd413c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.562+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/2115295189 shutdown_connections 2024-09-13T10:30:28.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.562+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/2115295189 >> 172.21.15.181:0/2115295189 conn(0x7f6fd40aa1c0 msgr2=0x7f6fd40a65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.562+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/2115295189 shutdown_connections 2024-09-13T10:30:28.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.562+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/2115295189 wait complete. 2024-09-13T10:30:28.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.562+0000 7f6fdb0d4640 10 monclient: build_initial_monmap 2024-09-13T10:30:28.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.562+0000 7f6fdb0d4640 10 monclient: monmap: 2024-09-13T10:30:28.575 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:28.575 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:28.575 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:28.575 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:28.575 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:28.576 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 1 Processor -- start 2024-09-13T10:30:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 1 -- start start 2024-09-13T10:30:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 10 monclient: init 2024-09-13T10:30:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 10 monclient: _add_conns ranks=[3,6,4,0,8,5,2,1,7] 2024-09-13T10:30:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 10 monclient(hunting): picked mon.noname-g con 0x7f6fd4133890 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 10 monclient(hunting): picked mon.noname-d con 0x7f6fd4133d50 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 10 monclient(hunting): picked mon.noname-c con 0x7f6fd413d870 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd4139090 con 0x7f6fd4133890 2024-09-13T10:30:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd413fb60 con 0x7f6fd413d870 2024-09-13T10:30:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd413f000 con 0x7f6fd4133d50 2024-09-13T10:30:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:28.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fdb0d4640 10 monclient(hunting): authenticate will time out at 768.068807s 2024-09-13T10:30:28.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fd3fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f6fd4133d50 0x7f6fd413e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45642/0 (socket says 172.21.15.181:45642) 2024-09-13T10:30:28.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.563+0000 7f6fd3fff640 1 -- 172.21.15.181:0/913564672 learned_addr learned my addr 172.21.15.181:0/913564672 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:28.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.565+0000 7f6fd3fff640 1 -- 172.21.15.181:0/913564672 >> v1:172.21.15.181:6792/0 conn(0x7f6fd4133d50 legacy=0x7f6fd413e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.565+0000 7f6fd9671640 1 -- 172.21.15.181:0/913564672 >> v1:172.21.15.181:6791/0 conn(0x7f6fd413d870 legacy=0x7f6fd41d42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285653483 0 0) 0x7f6fd413f000 con 0x7f6fd4133d50 2024-09-13T10:30:28.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): my global_id is 4335 2024-09-13T10:30:28.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fb4003520 con 0x7f6fd4133d50 2024-09-13T10:30:28.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3875887803 0 0) 0x7f6fd413fb60 con 0x7f6fd413d870 2024-09-13T10:30:28.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): my global_id is 4405 2024-09-13T10:30:28.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd413f000 con 0x7f6fd413d870 2024-09-13T10:30:28.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd8e70640 1 -- 172.21.15.181:0/913564672 >> v1:172.21.15.195:6790/0 conn(0x7f6fd4133890 legacy=0x7f6fd413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 802880953 0 0) 0x7f6fb4003520 con 0x7f6fd4133d50 2024-09-13T10:30:28.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fd413fb60 con 0x7f6fd4133d50 2024-09-13T10:30:28.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fc4003e80 con 0x7f6fd4133d50 2024-09-13T10:30:28.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:28.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): dump: 2024-09-13T10:30:28.583 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.583 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.583 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.583 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.583 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.583 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.583 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.583 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.583 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.583 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.583 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.584 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.584 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.584 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.584 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.584 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:28.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2083794502 0 0) 0x7f6fd413f000 con 0x7f6fd413d870 2024-09-13T10:30:28.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fb4003520 con 0x7f6fd413d870 2024-09-13T10:30:28.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fbc001c60 con 0x7f6fd413d870 2024-09-13T10:30:28.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:28.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient(hunting): dump: 2024-09-13T10:30:28.585 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.585 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.585 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.585 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.585 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.585 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.585 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.585 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.585 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.585 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.586 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.586 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.586 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.586 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.586 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.586 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2435430732 0 0) 0x7f6fd413fb60 con 0x7f6fd4133d50 2024-09-13T10:30:28.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 >> v1:172.21.15.181:6791/0 conn(0x7f6fd413d870 legacy=0x7f6fd41d42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 >> v1:172.21.15.195:6790/0 conn(0x7f6fd4133890 legacy=0x7f6fd413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 monclient: found mon.d 2024-09-13T10:30:28.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:28.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd41387f0 con 0x7f6fd4133d50 2024-09-13T10:30:28.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fdb0d4640 5 monclient: authenticate success, global_id 4335 2024-09-13T10:30:28.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fdb0d4640 10 monclient: _renew_subs 2024-09-13T10:30:28.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fdb0d4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:28.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/913564672 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd4138ad0 con 0x7f6fd4133d50 2024-09-13T10:30:28.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fdb0d4640 10 monclient: _renew_subs 2024-09-13T10:30:28.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fdb0d4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:28.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/913564672 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f6fd41406c0 con 0x7f6fd4133d50 2024-09-13T10:30:28.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fc4001ed0 con 0x7f6fd4133d50 2024-09-13T10:30:28.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fc4003990 con 0x7f6fd4133d50 2024-09-13T10:30:28.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:28.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd2ffd640 4 set_mon_vals no callback set 2024-09-13T10:30:28.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.566+0000 7f6fd17fa640 10 monclient: dump: 2024-09-13T10:30:28.588 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.588 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.589 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.589 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.589 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.589 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.589 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.589 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.589 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.589 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.589 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.589 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.589 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.590 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.590 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.590 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.567+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6fc4012020 con 0x7f6fd4133d50 2024-09-13T10:30:28.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.567+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f6fc404e640 con 0x7f6fd4133d50 2024-09-13T10:30:28.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.567+0000 7f6fdb0d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.567+0000 7f6fdb0d4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.567+0000 7f6fdb0d4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:28.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.567+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/913564672 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb8005080 con 0x7f6fd4133d50 2024-09-13T10:30:28.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.567+0000 7f6fd8e70640 10 monclient: get_auth_request con 0x7f6fb4040330 auth_method 0 2024-09-13T10:30:28.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.572+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f6fc4017bc0 con 0x7f6fd4133d50 2024-09-13T10:30:28.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.572+0000 7f6fd17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.572+0000 7f6fd17fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:28.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.743+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/913564672 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6fb8000b90 con 0x7f6fb4040330 2024-09-13T10:30:28.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.744+0000 7f6fd17fa640 1 -- 172.21.15.181:0/913564672 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34100 (unknown 2965378022 0 3670267676) 0x7f6fb8000b90 con 0x7f6fb4040330 2024-09-13T10:30:28.746 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:30:28.746 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-13T10:30:28.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.746+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/913564672 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6fb4040330 legacy=0x7f6fb40427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.746+0000 7f6fdb0d4640 10 monclient: shutdown 2024-09-13T10:30:28.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.746+0000 7f6fdb0d4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.746+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/913564672 >> v1:172.21.15.181:6792/0 conn(0x7f6fd4133d50 legacy=0x7f6fd413e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.746+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/913564672 shutdown_connections 2024-09-13T10:30:28.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.746+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/913564672 >> 172.21.15.181:0/913564672 conn(0x7f6fd40aa1c0 msgr2=0x7f6fd40a7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.746+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/913564672 shutdown_connections 2024-09-13T10:30:28.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.746+0000 7f6fdb0d4640 1 -- 172.21.15.181:0/913564672 wait complete. 2024-09-13T10:30:28.758 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-13T10:30:27.852006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":172640,"kb_used_data":2176,"kb_used_omap":9,"kb_used_meta":170358,"kb_avail":566058400,"statfs":{"total":579820584960,"available":579643801600,"internally_reserved":0,"allocated":2228224,"data_stored":1511608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":174447264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001352"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.839306+0000","last_change":"2024-09-13T10:30:24.839549+0000","last_active":"2024-09-13T10:30:24.839306+0000","last_peered":"2024-09-13T10:30:24.839306+0000","last_clean":"2024-09-13T10:30:24.839306+0000","last_became_active":"2024-09-13T10:30:22.828862+0000","last_became_peered":"2024-09-13T10:30:22.828862+0000","last_unstale":"2024-09-13T10:30:24.839306+0000","last_undegraded":"2024-09-13T10:30:24.839306+0000","last_fullsized":"2024-09-13T10:30:24.839306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:07.535710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013355629999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.833762+0000","last_change":"2024-09-13T10:30:24.834024+0000","last_active":"2024-09-13T10:30:24.833762+0000","last_peered":"2024-09-13T10:30:24.833762+0000","last_clean":"2024-09-13T10:30:24.833762+0000","last_became_active":"2024-09-13T10:30:22.822788+0000","last_became_peered":"2024-09-13T10:30:22.822788+0000","last_unstale":"2024-09-13T10:30:24.833762+0000","last_undegraded":"2024-09-13T10:30:24.833762+0000","last_fullsized":"2024-09-13T10:30:24.833762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:02.717016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050450899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.839057+0000","last_change":"2024-09-13T10:30:24.839303+0000","last_active":"2024-09-13T10:30:24.839057+0000","last_peered":"2024-09-13T10:30:24.839057+0000","last_clean":"2024-09-13T10:30:24.839057+0000","last_became_active":"2024-09-13T10:30:22.818560+0000","last_became_peered":"2024-09-13T10:30:22.818560+0000","last_unstale":"2024-09-13T10:30:24.839057+0000","last_undegraded":"2024-09-13T10:30:24.839057+0000","last_fullsized":"2024-09-13T10:30:24.839057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:20.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012649200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.833596+0000","last_change":"2024-09-13T10:30:24.833843+0000","last_active":"2024-09-13T10:30:24.833596+0000","last_peered":"2024-09-13T10:30:24.833596+0000","last_clean":"2024-09-13T10:30:24.833596+0000","last_became_active":"2024-09-13T10:30:22.816554+0000","last_became_peered":"2024-09-13T10:30:22.816554+0000","last_unstale":"2024-09-13T10:30:24.833596+0000","last_undegraded":"2024-09-13T10:30:24.833596+0000","last_fullsized":"2024-09-13T10:30:24.833596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:55.701606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066494999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.845556+0000","last_change":"2024-09-13T10:30:24.845556+0000","last_active":"2024-09-13T10:30:24.845556+0000","last_peered":"2024-09-13T10:30:24.845556+0000","last_clean":"2024-09-13T10:30:24.845556+0000","last_became_active":"2024-09-13T10:30:22.821223+0000","last_became_peered":"2024-09-13T10:30:22.821223+0000","last_unstale":"2024-09-13T10:30:24.845556+0000","last_undegraded":"2024-09-13T10:30:24.845556+0000","last_fullsized":"2024-09-13T10:30:24.845556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:43.560455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036258549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.833593+0000","last_change":"2024-09-13T10:30:24.833851+0000","last_active":"2024-09-13T10:30:24.833593+0000","last_peered":"2024-09-13T10:30:24.833593+0000","last_clean":"2024-09-13T10:30:24.833593+0000","last_became_active":"2024-09-13T10:30:22.816447+0000","last_became_peered":"2024-09-13T10:30:22.816447+0000","last_unstale":"2024-09-13T10:30:24.833593+0000","last_undegraded":"2024-09-13T10:30:24.833593+0000","last_fullsized":"2024-09-13T10:30:24.833593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:43.342134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084575600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.838233+0000","last_change":"2024-09-13T10:30:24.838514+0000","last_active":"2024-09-13T10:30:24.838233+0000","last_peered":"2024-09-13T10:30:24.838233+0000","last_clean":"2024-09-13T10:30:24.838233+0000","last_became_active":"2024-09-13T10:30:22.822750+0000","last_became_peered":"2024-09-13T10:30:22.822750+0000","last_unstale":"2024-09-13T10:30:24.838233+0000","last_undegraded":"2024-09-13T10:30:24.838233+0000","last_fullsized":"2024-09-13T10:30:24.838233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:13.913264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062120600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.838999+0000","last_change":"2024-09-13T10:30:24.839249+0000","last_active":"2024-09-13T10:30:24.838999+0000","last_peered":"2024-09-13T10:30:24.838999+0000","last_clean":"2024-09-13T10:30:24.838999+0000","last_became_active":"2024-09-13T10:30:22.820901+0000","last_became_peered":"2024-09-13T10:30:22.820901+0000","last_unstale":"2024-09-13T10:30:24.838999+0000","last_undegraded":"2024-09-13T10:30:24.838999+0000","last_fullsized":"2024-09-13T10:30:24.838999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:36.190102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001249939,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.838372+0000","last_change":"2024-09-13T10:30:15.731747+0000","last_active":"2024-09-13T10:30:24.838372+0000","last_peered":"2024-09-13T10:30:24.838372+0000","last_clean":"2024-09-13T10:30:24.838372+0000","last_became_active":"2024-09-13T10:30:15.730748+0000","last_became_peered":"2024-09-13T10:30:15.730748+0000","last_unstale":"2024-09-13T10:30:24.838372+0000","last_undegraded":"2024-09-13T10:30:24.838372+0000","last_fullsized":"2024-09-13T10:30:24.838372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_clean_scrub_stamp":"2024-09-13T10:30:14.708874+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:14.488037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":172032,"data_stored":55139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":55139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":645507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607558,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":645507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":176128,"data_stored":55158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607557,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":55158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T10:30:28.759 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T10:30:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.857+0000 7f1f6f75d640 10 monclient: get_monmap_and_config 2024-09-13T10:30:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.857+0000 7f1f6f75d640 10 monclient: build_initial_monmap 2024-09-13T10:30:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.857+0000 7f1f6f75d640 10 monclient: monmap: 2024-09-13T10:30:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:28.858244+0000 2024-09-13T10:30:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:28.858244+0000 2024-09-13T10:30:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:28.863 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 1 Processor -- start 2024-09-13T10:30:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 1 -- start start 2024-09-13T10:30:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 10 monclient: init 2024-09-13T10:30:28.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 10 monclient: _add_conns ranks=[8,7,3,4,2,1,0,5,6] 2024-09-13T10:30:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 10 monclient(hunting): picked mon.noname-e con 0x7f1f680a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 10 monclient(hunting): picked mon.noname-i con 0x7f1f680a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 10 monclient(hunting): picked mon.noname-g con 0x7f1f6813f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:28.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f680a4bc0 con 0x7f1f6813f750 2024-09-13T10:30:28.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6813a320 con 0x7f1f680a8340 2024-09-13T10:30:28.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f680a8100 con 0x7f1f680a6640 2024-09-13T10:30:28.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:28.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.858+0000 7f1f6f75d640 10 monclient(hunting): authenticate will time out at 768.363920s 2024-09-13T10:30:28.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.859+0000 7f1f6d4f9640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f1f680a6640 0x7f1f68139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39878/0 (socket says 172.21.15.181:39878) 2024-09-13T10:30:28.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.859+0000 7f1f6d4f9640 1 -- 172.21.15.181:0/2824906592 learned_addr learned my addr 172.21.15.181:0/2824906592 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:28.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f6d4f9640 1 -- 172.21.15.181:0/2824906592 >> v1:172.21.15.181:6793/0 conn(0x7f1f680a6640 legacy=0x7f1f68139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 1 -- 172.21.15.181:0/2824906592 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2677146933 0 0) 0x7f1f680a8100 con 0x7f1f680a6640 2024-09-13T10:30:28.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient(hunting): my global_id is 4346 2024-09-13T10:30:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 1 -- 172.21.15.181:0/2824906592 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f54003520 con 0x7f1f680a6640 2024-09-13T10:30:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f6dcfa640 1 -- 172.21.15.181:0/2824906592 >> v1:172.21.15.195:6790/0 conn(0x7f1f6813f750 legacy=0x7f1f68141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f6ccf8640 1 -- 172.21.15.181:0/2824906592 >> v1:172.21.15.195:6792/0 conn(0x7f1f680a8340 legacy=0x7f1f68139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 1 -- 172.21.15.181:0/2824906592 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332711877 0 0) 0x7f1f680a4bc0 con 0x7f1f6813f750 2024-09-13T10:30:28.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient(hunting): my global_id is 4323 2024-09-13T10:30:28.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 1 -- 172.21.15.181:0/2824906592 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f680a8100 con 0x7f1f6813f750 2024-09-13T10:30:28.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 1 -- 172.21.15.181:0/2824906592 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3759728925 0 0) 0x7f1f54003520 con 0x7f1f680a6640 2024-09-13T10:30:28.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 1 -- 172.21.15.181:0/2824906592 >> v1:172.21.15.195:6792/0 conn(0x7f1f680a8340 legacy=0x7f1f68139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 1 -- 172.21.15.181:0/2824906592 >> v1:172.21.15.195:6790/0 conn(0x7f1f6813f750 legacy=0x7f1f68141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 1 monclient: found mon.noname-e 2024-09-13T10:30:28.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:30:28.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 1 -- 172.21.15.181:0/2824906592 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f680a48e0 con 0x7f1f680a6640 2024-09-13T10:30:28.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 1 -- 172.21.15.181:0/2824906592 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f64001ae0 con 0x7f1f680a6640 2024-09-13T10:30:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f6f75d640 5 monclient: authenticate success, global_id 4346 2024-09-13T10:30:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f6f75d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:28.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient: dump: 2024-09-13T10:30:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.886 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.887 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.887 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.887 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.887 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.887 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.887 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.887 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.888 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f6f75d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:28.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 1 -- 172.21.15.181:0/2824906592 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f640048a0 con 0x7f1f680a6640 2024-09-13T10:30:28.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f6f75d640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:28.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 1 -- 172.21.15.181:0/2824906592 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f64004e10 con 0x7f1f680a6640 2024-09-13T10:30:28.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f6f75d640 4 set_mon_vals no callback set 2024-09-13T10:30:28.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:28.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.861+0000 7f1f5ffff640 10 monclient: dump: 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.889 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.890 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.890 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.862+0000 7f1f6f75d640 10 monclient: shutdown 2024-09-13T10:30:28.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.862+0000 7f1f6f75d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:28.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.862+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2824906592 >> v1:172.21.15.181:6793/0 conn(0x7f1f680a6640 legacy=0x7f1f68139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.862+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2824906592 shutdown_connections 2024-09-13T10:30:28.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.862+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2824906592 >> 172.21.15.181:0/2824906592 conn(0x7f1f68077170 msgr2=0x7f1f680abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:28.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.862+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2824906592 shutdown_connections 2024-09-13T10:30:28.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.862+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2824906592 wait complete. 2024-09-13T10:30:28.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.862+0000 7f1f6f75d640 10 monclient: build_initial_monmap 2024-09-13T10:30:28.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.862+0000 7f1f6f75d640 10 monclient: monmap: 2024-09-13T10:30:28.890 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:28.891 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:28.892 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 1 Processor -- start 2024-09-13T10:30:28.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 1 -- start start 2024-09-13T10:30:28.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 10 monclient: init 2024-09-13T10:30:28.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:28.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 10 monclient: _add_conns ranks=[2,4,8,0,1,3,7,5,6] 2024-09-13T10:30:28.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 10 monclient(hunting): picked mon.noname-b con 0x7f1f680a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:28.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 10 monclient(hunting): picked mon.noname-c con 0x7f1f6813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:28.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 10 monclient(hunting): picked mon.noname-e con 0x7f1f681d4520 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:28.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f680a0fb0 con 0x7f1f680a8340 2024-09-13T10:30:28.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f681cf0f0 con 0x7f1f6813f750 2024-09-13T10:30:28.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f680a1290 con 0x7f1f681d4520 2024-09-13T10:30:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6f75d640 10 monclient(hunting): authenticate will time out at 768.368725s 2024-09-13T10:30:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6dcfa640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f1f681d4520 0x7f1f681d6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39880/0 (socket says 172.21.15.181:39880) 2024-09-13T10:30:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6ccf8640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f1f6813f750 0x7f1f681ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38476/0 (socket says 172.21.15.181:38476) 2024-09-13T10:30:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6d4f9640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f1f680a8340 0x7f1f681ce2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48524/0 (socket says 172.21.15.181:48524) 2024-09-13T10:30:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.863+0000 7f1f6dcfa640 1 -- 172.21.15.181:0/2759416502 learned_addr learned my addr 172.21.15.181:0/2759416502 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.865+0000 7f1f6d4f9640 1 -- 172.21.15.181:0/2759416502 >> v1:172.21.15.181:6790/0 conn(0x7f1f680a8340 legacy=0x7f1f681ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.865+0000 7f1f6ccf8640 1 -- 172.21.15.181:0/2759416502 >> v1:172.21.15.181:6791/0 conn(0x7f1f6813f750 legacy=0x7f1f681ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.865+0000 7f1f6dcfa640 1 -- 172.21.15.181:0/2759416502 >> v1:172.21.15.181:6793/0 conn(0x7f1f681d4520 legacy=0x7f1f681d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:28.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071599385 0 0) 0x7f1f680a0fb0 con 0x7f1f680a8340 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): my global_id is 4376 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f4c003550 con 0x7f1f680a8340 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283557039 0 0) 0x7f1f681cf0f0 con 0x7f1f6813f750 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): my global_id is 4414 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f680a0fb0 con 0x7f1f6813f750 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352370579 0 0) 0x7f1f680a1290 con 0x7f1f681d4520 2024-09-13T10:30:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): my global_id is 4355 2024-09-13T10:30:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f681cf0f0 con 0x7f1f681d4520 2024-09-13T10:30:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 720956770 0 0) 0x7f1f4c003550 con 0x7f1f680a8340 2024-09-13T10:30:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f680a1290 con 0x7f1f680a8340 2024-09-13T10:30:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f64004d90 con 0x7f1f680a8340 2024-09-13T10:30:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): dump: 2024-09-13T10:30:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.896 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.897 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.897 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.897 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.897 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.897 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.897 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.898 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.898 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.898 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.898 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.898 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.898 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.899 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 535282808 0 0) 0x7f1f681cf0f0 con 0x7f1f681d4520 2024-09-13T10:30:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f4c003550 con 0x7f1f681d4520 2024-09-13T10:30:28.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3563115030 0 0) 0x7f1f680a0fb0 con 0x7f1f6813f750 2024-09-13T10:30:28.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f681cf0f0 con 0x7f1f6813f750 2024-09-13T10:30:28.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f60002030 con 0x7f1f681d4520 2024-09-13T10:30:28.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:28.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): dump: 2024-09-13T10:30:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.901 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.902 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.902 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.902 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.902 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.902 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.903 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.903 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.903 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.903 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.903 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f58001c40 con 0x7f1f6813f750 2024-09-13T10:30:28.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:28.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:28.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient(hunting): dump: 2024-09-13T10:30:28.904 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.904 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.904 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.905 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.905 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.905 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.905 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.905 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.905 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.906 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.906 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.906 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.906 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.906 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.906 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.907 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2309612207 0 0) 0x7f1f680a1290 con 0x7f1f680a8340 2024-09-13T10:30:28.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 >> v1:172.21.15.181:6793/0 conn(0x7f1f681d4520 legacy=0x7f1f681d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 >> v1:172.21.15.181:6791/0 conn(0x7f1f6813f750 legacy=0x7f1f681ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:28.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:28.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 monclient: found mon.b 2024-09-13T10:30:28.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:28.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:28.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f680aa2e0 con 0x7f1f680a8340 2024-09-13T10:30:28.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:28.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:28.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:28.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f6f75d640 5 monclient: authenticate success, global_id 4376 2024-09-13T10:30:28.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f6f75d640 10 monclient: _renew_subs 2024-09-13T10:30:28.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f6f75d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:28.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2759416502 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1f680a0cd0 con 0x7f1f680a8340 2024-09-13T10:30:28.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f64001d30 con 0x7f1f680a8340 2024-09-13T10:30:28.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:28.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f64001a80 con 0x7f1f680a8340 2024-09-13T10:30:28.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:28.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:28.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5dffb640 10 monclient: dump: 2024-09-13T10:30:28.910 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:28.911 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:28.911 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.911 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:28.911 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:28.911 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:28.912 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:28.912 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:28.912 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:28.912 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:28.912 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:28.912 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:28.913 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:28.913 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:28.913 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:28.913 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:28.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f5f7fe640 4 set_mon_vals no callback set 2024-09-13T10:30:28.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f6f75d640 10 monclient: _renew_subs 2024-09-13T10:30:28.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f6f75d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:28.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.866+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2759416502 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1f6809fd30 con 0x7f1f680a8340 2024-09-13T10:30:28.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.867+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1f64011c20 con 0x7f1f680a8340 2024-09-13T10:30:28.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.867+0000 7f1f6f75d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.867+0000 7f1f6f75d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.867+0000 7f1f6f75d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:28.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.867+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2759416502 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f68142450 con 0x7f1f680a8340 2024-09-13T10:30:28.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.868+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f1f6404e250 con 0x7f1f680a8340 2024-09-13T10:30:28.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.868+0000 7f1f6ccf8640 10 monclient: get_auth_request con 0x7f1f4c040650 auth_method 0 2024-09-13T10:30:28.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.872+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f1f68142450 con 0x7f1f680a8340 2024-09-13T10:30:28.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.872+0000 7f1f5dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:28.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:28.872+0000 7f1f5dffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:29.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.042+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2759416502 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1f68142e60 con 0x7f1f4c040650 2024-09-13T10:30:29.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.043+0000 7f1f5dffb640 1 -- 172.21.15.181:0/2759416502 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34100 (unknown 2965378022 0 3670267676) 0x7f1f68142e60 con 0x7f1f4c040650 2024-09-13T10:30:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:30:29.045 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-13T10:30:29.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.045+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2759416502 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1f4c040650 legacy=0x7f1f4c042b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.045+0000 7f1f6f75d640 10 monclient: shutdown 2024-09-13T10:30:29.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.045+0000 7f1f6f75d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:29.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.045+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2759416502 >> v1:172.21.15.181:6790/0 conn(0x7f1f680a8340 legacy=0x7f1f681ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.045+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2759416502 shutdown_connections 2024-09-13T10:30:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.045+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2759416502 >> 172.21.15.181:0/2759416502 conn(0x7f1f680a6640 msgr2=0x7f1f68141d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.045+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2759416502 shutdown_connections 2024-09-13T10:30:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.046+0000 7f1f6f75d640 1 -- 172.21.15.181:0/2759416502 wait complete. 2024-09-13T10:30:29.057 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-13T10:30:27.852006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":172640,"kb_used_data":2176,"kb_used_omap":9,"kb_used_meta":170358,"kb_avail":566058400,"statfs":{"total":579820584960,"available":579643801600,"internally_reserved":0,"allocated":2228224,"data_stored":1511608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":174447264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001352"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.839306+0000","last_change":"2024-09-13T10:30:24.839549+0000","last_active":"2024-09-13T10:30:24.839306+0000","last_peered":"2024-09-13T10:30:24.839306+0000","last_clean":"2024-09-13T10:30:24.839306+0000","last_became_active":"2024-09-13T10:30:22.828862+0000","last_became_peered":"2024-09-13T10:30:22.828862+0000","last_unstale":"2024-09-13T10:30:24.839306+0000","last_undegraded":"2024-09-13T10:30:24.839306+0000","last_fullsized":"2024-09-13T10:30:24.839306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:07.535710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013355629999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.833762+0000","last_change":"2024-09-13T10:30:24.834024+0000","last_active":"2024-09-13T10:30:24.833762+0000","last_peered":"2024-09-13T10:30:24.833762+0000","last_clean":"2024-09-13T10:30:24.833762+0000","last_became_active":"2024-09-13T10:30:22.822788+0000","last_became_peered":"2024-09-13T10:30:22.822788+0000","last_unstale":"2024-09-13T10:30:24.833762+0000","last_undegraded":"2024-09-13T10:30:24.833762+0000","last_fullsized":"2024-09-13T10:30:24.833762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:02.717016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050450899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.839057+0000","last_change":"2024-09-13T10:30:24.839303+0000","last_active":"2024-09-13T10:30:24.839057+0000","last_peered":"2024-09-13T10:30:24.839057+0000","last_clean":"2024-09-13T10:30:24.839057+0000","last_became_active":"2024-09-13T10:30:22.818560+0000","last_became_peered":"2024-09-13T10:30:22.818560+0000","last_unstale":"2024-09-13T10:30:24.839057+0000","last_undegraded":"2024-09-13T10:30:24.839057+0000","last_fullsized":"2024-09-13T10:30:24.839057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:20.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012649200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.833596+0000","last_change":"2024-09-13T10:30:24.833843+0000","last_active":"2024-09-13T10:30:24.833596+0000","last_peered":"2024-09-13T10:30:24.833596+0000","last_clean":"2024-09-13T10:30:24.833596+0000","last_became_active":"2024-09-13T10:30:22.816554+0000","last_became_peered":"2024-09-13T10:30:22.816554+0000","last_unstale":"2024-09-13T10:30:24.833596+0000","last_undegraded":"2024-09-13T10:30:24.833596+0000","last_fullsized":"2024-09-13T10:30:24.833596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:55.701606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066494999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.845556+0000","last_change":"2024-09-13T10:30:24.845556+0000","last_active":"2024-09-13T10:30:24.845556+0000","last_peered":"2024-09-13T10:30:24.845556+0000","last_clean":"2024-09-13T10:30:24.845556+0000","last_became_active":"2024-09-13T10:30:22.821223+0000","last_became_peered":"2024-09-13T10:30:22.821223+0000","last_unstale":"2024-09-13T10:30:24.845556+0000","last_undegraded":"2024-09-13T10:30:24.845556+0000","last_fullsized":"2024-09-13T10:30:24.845556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:43.560455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036258549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.833593+0000","last_change":"2024-09-13T10:30:24.833851+0000","last_active":"2024-09-13T10:30:24.833593+0000","last_peered":"2024-09-13T10:30:24.833593+0000","last_clean":"2024-09-13T10:30:24.833593+0000","last_became_active":"2024-09-13T10:30:22.816447+0000","last_became_peered":"2024-09-13T10:30:22.816447+0000","last_unstale":"2024-09-13T10:30:24.833593+0000","last_undegraded":"2024-09-13T10:30:24.833593+0000","last_fullsized":"2024-09-13T10:30:24.833593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:43.342134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084575600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.838233+0000","last_change":"2024-09-13T10:30:24.838514+0000","last_active":"2024-09-13T10:30:24.838233+0000","last_peered":"2024-09-13T10:30:24.838233+0000","last_clean":"2024-09-13T10:30:24.838233+0000","last_became_active":"2024-09-13T10:30:22.822750+0000","last_became_peered":"2024-09-13T10:30:22.822750+0000","last_unstale":"2024-09-13T10:30:24.838233+0000","last_undegraded":"2024-09-13T10:30:24.838233+0000","last_fullsized":"2024-09-13T10:30:24.838233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:13.913264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062120600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.838999+0000","last_change":"2024-09-13T10:30:24.839249+0000","last_active":"2024-09-13T10:30:24.838999+0000","last_peered":"2024-09-13T10:30:24.838999+0000","last_clean":"2024-09-13T10:30:24.838999+0000","last_became_active":"2024-09-13T10:30:22.820901+0000","last_became_peered":"2024-09-13T10:30:22.820901+0000","last_unstale":"2024-09-13T10:30:24.838999+0000","last_undegraded":"2024-09-13T10:30:24.838999+0000","last_fullsized":"2024-09-13T10:30:24.838999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:36.190102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001249939,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.838372+0000","last_change":"2024-09-13T10:30:15.731747+0000","last_active":"2024-09-13T10:30:24.838372+0000","last_peered":"2024-09-13T10:30:24.838372+0000","last_clean":"2024-09-13T10:30:24.838372+0000","last_became_active":"2024-09-13T10:30:15.730748+0000","last_became_peered":"2024-09-13T10:30:15.730748+0000","last_unstale":"2024-09-13T10:30:24.838372+0000","last_undegraded":"2024-09-13T10:30:24.838372+0000","last_fullsized":"2024-09-13T10:30:24.838372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_clean_scrub_stamp":"2024-09-13T10:30:14.708874+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:14.488037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":172032,"data_stored":55139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":55139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":645507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607558,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":645507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":176128,"data_stored":55158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607557,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":55158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T10:30:29.058 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T10:30:29.058 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T10:30:29.059 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T10:30:29.059 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T10:30:29.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.155+0000 7f240dfab640 10 monclient: get_monmap_and_config 2024-09-13T10:30:29.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.155+0000 7f240dfab640 10 monclient: build_initial_monmap 2024-09-13T10:30:29.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.155+0000 7f240dfab640 10 monclient: monmap: 2024-09-13T10:30:29.156 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:29.156 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.156 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:29.155658+0000 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:29.155658+0000 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:29.157 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.155+0000 7f240dfab640 1 Processor -- start 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f240dfab640 1 -- start start 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f240dfab640 10 monclient: init 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f240dfab640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f240dfab640 10 monclient: _add_conns ranks=[6,8,1,7,3,2,5,0,4] 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f240dfab640 10 monclient(hunting): picked mon.noname-d con 0x7f24080a58b0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f240dfab640 10 monclient(hunting): picked mon.noname-e con 0x7f240809cdb0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f240dfab640 10 monclient(hunting): picked mon.noname-f con 0x7f2408136280 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f240dfab640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240809d8c0 con 0x7f2408136280 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f240dfab640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2408139b80 con 0x7f24080a58b0 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f240dfab640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24080a7b50 con 0x7f240809cdb0 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f240dfab640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:29.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f240dfab640 10 monclient(hunting): authenticate will time out at 768.661516s 2024-09-13T10:30:29.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f23fffff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f240809cdb0 0x7f2408139470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39886/0 (socket says 172.21.15.181:39886) 2024-09-13T10:30:29.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f23fffff640 1 -- 172.21.15.181:0/2700748039 learned_addr learned my addr 172.21.15.181:0/2700748039 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:29.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.156+0000 7f24077fe640 1 --1- 172.21.15.181:0/2700748039 >> v1:172.21.15.181:6792/0 conn(0x7f24080a58b0 0x7f2408138d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45656/0 (socket says 172.21.15.181:45656) 2024-09-13T10:30:29.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f24077fe640 1 -- 172.21.15.181:0/2700748039 >> v1:172.21.15.181:6792/0 conn(0x7f24080a58b0 legacy=0x7f2408138d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f23fffff640 1 -- 172.21.15.181:0/2700748039 >> v1:172.21.15.181:6793/0 conn(0x7f240809cdb0 legacy=0x7f2408139470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f2406ffd640 1 -- 172.21.15.181:0/2700748039 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1944119958 0 0) 0x7f2408139b80 con 0x7f24080a58b0 2024-09-13T10:30:29.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f2406ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f2406ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f2406ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f2406ffd640 10 monclient(hunting): my global_id is 4344 2024-09-13T10:30:29.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f2406ffd640 1 -- 172.21.15.181:0/2700748039 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23f4003520 con 0x7f24080a58b0 2024-09-13T10:30:29.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f2406ffd640 1 -- 172.21.15.181:0/2700748039 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2633828439 0 0) 0x7f24080a7b50 con 0x7f240809cdb0 2024-09-13T10:30:29.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f2406ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f2406ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f2406ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.158+0000 7f2406ffd640 10 monclient(hunting): my global_id is 4364 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 1 -- 172.21.15.181:0/2700748039 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2408139b80 con 0x7f240809cdb0 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2407fff640 1 -- 172.21.15.181:0/2700748039 >> v1:172.21.15.195:6789/0 conn(0x7f2408136280 legacy=0x7f2408142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 1 -- 172.21.15.181:0/2700748039 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1672346717 0 0) 0x7f23f4003520 con 0x7f24080a58b0 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 1 -- 172.21.15.181:0/2700748039 >> v1:172.21.15.181:6793/0 conn(0x7f240809cdb0 legacy=0x7f2408139470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 1 -- 172.21.15.181:0/2700748039 >> v1:172.21.15.195:6789/0 conn(0x7f2408136280 legacy=0x7f2408142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 1 monclient: found mon.noname-d 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 1 -- 172.21.15.181:0/2700748039 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240809db30 con 0x7f24080a58b0 2024-09-13T10:30:29.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 10 monclient: _finish_auth 0 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f240dfab640 5 monclient: authenticate success, global_id 4344 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 1 -- 172.21.15.181:0/2700748039 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f23f8001ae0 con 0x7f24080a58b0 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f240dfab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 10 monclient: dump: 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.166 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f240dfab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 1 -- 172.21.15.181:0/2700748039 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4136286310 0 0) 0x7f2408139b80 con 0x7f240809cdb0 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:30:29.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 1 -- 172.21.15.181:0/2700748039 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23f80047e0 con 0x7f24080a58b0 2024-09-13T10:30:29.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:29.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 1 -- 172.21.15.181:0/2700748039 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f23f8004d50 con 0x7f24080a58b0 2024-09-13T10:30:29.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f240dfab640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:29.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f240dfab640 4 set_mon_vals no callback set 2024-09-13T10:30:29.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:29.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:29.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f2406ffd640 10 monclient: dump: 2024-09-13T10:30:29.168 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.168 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.168 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.168 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.168 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f240dfab640 10 monclient: shutdown 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f240dfab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:29.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f240dfab640 1 -- 172.21.15.181:0/2700748039 >> v1:172.21.15.181:6792/0 conn(0x7f24080a58b0 legacy=0x7f2408138d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f240dfab640 1 -- 172.21.15.181:0/2700748039 shutdown_connections 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f240dfab640 1 -- 172.21.15.181:0/2700748039 >> 172.21.15.181:0/2700748039 conn(0x7f2408077170 msgr2=0x7f24080abb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f240dfab640 1 -- 172.21.15.181:0/2700748039 shutdown_connections 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.159+0000 7f240dfab640 1 -- 172.21.15.181:0/2700748039 wait complete. 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.160+0000 7f240dfab640 10 monclient: build_initial_monmap 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.160+0000 7f240dfab640 10 monclient: monmap: 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:29.170 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.160+0000 7f240dfab640 1 Processor -- start 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.160+0000 7f240dfab640 1 -- start start 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.160+0000 7f240dfab640 10 monclient: init 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.161+0000 7f240dfab640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.161+0000 7f240dfab640 10 monclient: _add_conns ranks=[8,2,0,4,6,1,3,5,7] 2024-09-13T10:30:29.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.161+0000 7f240dfab640 10 monclient(hunting): picked mon.noname-e con 0x7f24080a58b0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:29.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.161+0000 7f240dfab640 10 monclient(hunting): picked mon.noname-b con 0x7f2408136280 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:29.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.161+0000 7f240dfab640 10 monclient(hunting): picked mon.noname-a con 0x7f2408132b30 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:29.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.161+0000 7f240dfab640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24080aaff0 con 0x7f2408132b30 2024-09-13T10:30:29.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.161+0000 7f240dfab640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2408126b70 con 0x7f2408136280 2024-09-13T10:30:29.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.161+0000 7f240dfab640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2408126e50 con 0x7f24080a58b0 2024-09-13T10:30:29.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.161+0000 7f240dfab640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:29.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.161+0000 7f240dfab640 10 monclient(hunting): authenticate will time out at 768.666342s 2024-09-13T10:30:29.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.161+0000 7f24077fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f24080a58b0 0x7f24081cdae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39898/0 (socket says 172.21.15.181:39898) 2024-09-13T10:30:29.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.161+0000 7f24077fe640 1 -- 172.21.15.181:0/3479236919 learned_addr learned my addr 172.21.15.181:0/3479236919 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:29.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f24077fe640 1 -- 172.21.15.181:0/3479236919 >> v1:172.21.15.181:6793/0 conn(0x7f24080a58b0 legacy=0x7f24081cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f23fffff640 1 -- 172.21.15.181:0/3479236919 >> v1:172.21.15.181:6790/0 conn(0x7f2408136280 legacy=0x7f2408132420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2407fff640 1 -- 172.21.15.181:0/3479236919 >> v1:172.21.15.181:6789/0 conn(0x7f2408132b30 legacy=0x7f24081d5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900886559 0 0) 0x7f2408126e50 con 0x7f24080a58b0 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): my global_id is 4373 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23e8003520 con 0x7f24080a58b0 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767686320 0 0) 0x7f2408126b70 con 0x7f2408136280 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): my global_id is 4385 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2408126e50 con 0x7f2408136280 2024-09-13T10:30:29.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4066571829 0 0) 0x7f240809d8c0 con 0x7f2408132b30 2024-09-13T10:30:29.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): my global_id is 54279 2024-09-13T10:30:29.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2408126b70 con 0x7f2408132b30 2024-09-13T10:30:29.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1665884248 0 0) 0x7f2408126e50 con 0x7f2408136280 2024-09-13T10:30:29.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f240809d8c0 con 0x7f2408136280 2024-09-13T10:30:29.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2353716716 0 0) 0x7f23e8003520 con 0x7f24080a58b0 2024-09-13T10:30:29.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2408126e50 con 0x7f24080a58b0 2024-09-13T10:30:29.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f23f8004cd0 con 0x7f24080a58b0 2024-09-13T10:30:29.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.163+0000 7f2404ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:29.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient(hunting): dump: 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.178 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f23f0001ce0 con 0x7f2408136280 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient(hunting): dump: 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.179 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4178336779 0 0) 0x7f2408126b70 con 0x7f2408132b30 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23e8003520 con 0x7f2408132b30 2024-09-13T10:30:29.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2400002050 con 0x7f2408132b30 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient(hunting): dump: 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 639742735 0 0) 0x7f240809d8c0 con 0x7f2408136280 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 >> v1:172.21.15.181:6793/0 conn(0x7f24080a58b0 legacy=0x7f24081cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 >> v1:172.21.15.181:6789/0 conn(0x7f2408132b30 legacy=0x7f24081d5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 1 monclient: found mon.b 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2408125a00 con 0x7f2408136280 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient: _finish_auth 0 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f240dfab640 5 monclient: authenticate success, global_id 4385 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f240dfab640 10 monclient: _renew_subs 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f240dfab640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f240dfab640 1 -- 172.21.15.181:0/3479236919 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2408124af0 con 0x7f2408136280 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f240dfab640 10 monclient: _renew_subs 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f240dfab640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f240dfab640 1 -- 172.21.15.181:0/3479236919 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f24081d7720 con 0x7f2408136280 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23f0004b00 con 0x7f2408136280 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:29.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f23f0005030 con 0x7f2408136280 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f24067fc640 4 set_mon_vals no callback set 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.164+0000 7f2404ff9640 10 monclient: dump: 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.184 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.165+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f23f0005300 con 0x7f2408136280 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.165+0000 7f240dfab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.165+0000 7f240dfab640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.165+0000 7f240dfab640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.165+0000 7f240dfab640 1 -- 172.21.15.181:0/3479236919 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ec005080 con 0x7f2408136280 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.165+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f23f004e070 con 0x7f2408136280 2024-09-13T10:30:29.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.165+0000 7f24077fe640 10 monclient: get_auth_request con 0x7f23e80404c0 auth_method 0 2024-09-13T10:30:29.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.169+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f23f00176b0 con 0x7f2408136280 2024-09-13T10:30:29.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.169+0000 7f2404ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:29.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.169+0000 7f2404ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:29.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.381+0000 7f240dfab640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2024-09-13T10:30:29.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.381+0000 7f240dfab640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2024-09-13T10:30:29.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.381+0000 7f240dfab640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:29.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.381+0000 7f240dfab640 1 -- 172.21.15.181:0/3479236919 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f23ec005370 con 0x7f2408136280 2024-09-13T10:30:29.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.381+0000 7f2404ff9640 1 -- 172.21.15.181:0/3479236919 <== mon.2 v1:172.21.15.181:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f23f0016fb0 con 0x7f2408136280 2024-09-13T10:30:29.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.381+0000 7f2404ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2024-09-13T10:30:29.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.381+0000 7f2404ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:29.384 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:30:29.384 INFO:teuthology.orchestra.run.smithi181.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T10:30:29.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.383+0000 7f240dfab640 1 -- 172.21.15.181:0/3479236919 >> v1:172.21.15.195:6800/1839191919 conn(0x7f23e80404c0 legacy=0x7f23e8042980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.383+0000 7f240dfab640 10 monclient: shutdown 2024-09-13T10:30:29.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.383+0000 7f240dfab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:29.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.383+0000 7f240dfab640 1 -- 172.21.15.181:0/3479236919 >> v1:172.21.15.181:6790/0 conn(0x7f2408136280 legacy=0x7f2408132420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.383+0000 7f240dfab640 1 -- 172.21.15.181:0/3479236919 shutdown_connections 2024-09-13T10:30:29.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.383+0000 7f240dfab640 1 -- 172.21.15.181:0/3479236919 >> 172.21.15.181:0/3479236919 conn(0x7f240809cdb0 msgr2=0x7f24080a9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:29.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.383+0000 7f240dfab640 1 -- 172.21.15.181:0/3479236919 shutdown_connections 2024-09-13T10:30:29.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.383+0000 7f240dfab640 1 -- 172.21.15.181:0/3479236919 wait complete. 2024-09-13T10:30:29.396 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T10:30:29.396 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-09-13T10:30:29.429 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-09-13T10:30:29.430 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T10:30:29.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.526+0000 7f30f7f44640 10 monclient: get_monmap_and_config 2024-09-13T10:30:29.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.526+0000 7f30f7f44640 10 monclient: build_initial_monmap 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.526+0000 7f30f7f44640 10 monclient: monmap: 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:29.526890+0000 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:29.526890+0000 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:29.528 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:29.529 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:29.529 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:29.529 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:29.529 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.526+0000 7f30f7f44640 1 Processor -- start 2024-09-13T10:30:29.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f7f44640 1 -- start start 2024-09-13T10:30:29.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f7f44640 10 monclient: init 2024-09-13T10:30:29.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f7f44640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:29.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f7f44640 10 monclient: _add_conns ranks=[8,2,5,1,0,4,6,7,3] 2024-09-13T10:30:29.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f7f44640 10 monclient(hunting): picked mon.noname-e con 0x7f30f00a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:29.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f7f44640 10 monclient(hunting): picked mon.noname-b con 0x7f30f00a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:29.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f7f44640 10 monclient(hunting): picked mon.noname-h con 0x7f30f013f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:29.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f7f44640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f00a5fe0 con 0x7f30f00a6ab0 2024-09-13T10:30:29.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f7f44640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f00a8080 con 0x7f30f013f9a0 2024-09-13T10:30:29.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f7f44640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f00a42c0 con 0x7f30f00a66d0 2024-09-13T10:30:29.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f7f44640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:29.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f7f44640 10 monclient(hunting): authenticate will time out at 769.032591s 2024-09-13T10:30:29.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f5ce0640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f30f00a66d0 0x7f30f00a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39902/0 (socket says 172.21.15.181:39902) 2024-09-13T10:30:29.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f54df640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f30f00a6ab0 0x7f30f00a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48534/0 (socket says 172.21.15.181:48534) 2024-09-13T10:30:29.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.527+0000 7f30f5ce0640 1 -- 172.21.15.181:0/340030306 learned_addr learned my addr 172.21.15.181:0/340030306 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:29.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.529+0000 7f30f5ce0640 1 -- 172.21.15.181:0/340030306 >> v1:172.21.15.181:6793/0 conn(0x7f30f00a66d0 legacy=0x7f30f00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.529+0000 7f30f54df640 1 -- 172.21.15.181:0/340030306 >> v1:172.21.15.181:6790/0 conn(0x7f30f00a6ab0 legacy=0x7f30f00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 1 -- 172.21.15.181:0/340030306 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507547008 0 0) 0x7f30f00a42c0 con 0x7f30f00a66d0 2024-09-13T10:30:29.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient(hunting): my global_id is 4382 2024-09-13T10:30:29.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 1 -- 172.21.15.181:0/340030306 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30dc003520 con 0x7f30f00a66d0 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 1 -- 172.21.15.181:0/340030306 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090838224 0 0) 0x7f30f00a5fe0 con 0x7f30f00a6ab0 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient(hunting): my global_id is 4394 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 1 -- 172.21.15.181:0/340030306 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30f00a42c0 con 0x7f30f00a6ab0 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f64e1640 1 -- 172.21.15.181:0/340030306 >> v1:172.21.15.195:6791/0 conn(0x7f30f013f9a0 legacy=0x7f30f0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 1 -- 172.21.15.181:0/340030306 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3484804988 0 0) 0x7f30dc003520 con 0x7f30f00a66d0 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 1 -- 172.21.15.181:0/340030306 >> v1:172.21.15.195:6791/0 conn(0x7f30f013f9a0 legacy=0x7f30f0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 1 -- 172.21.15.181:0/340030306 >> v1:172.21.15.181:6790/0 conn(0x7f30f00a6ab0 legacy=0x7f30f00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient: _finish_hunting 0 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 1 monclient: found mon.noname-e 2024-09-13T10:30:29.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 1 -- 172.21.15.181:0/340030306 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f01464e0 con 0x7f30f00a66d0 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient: _finish_auth 0 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient: _check_auth_tickets 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 1 -- 172.21.15.181:0/340030306 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f30e4001ad0 con 0x7f30f00a66d0 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f7f44640 5 monclient: authenticate success, global_id 4382 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f7f44640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient: dump: 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.536 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f7f44640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 1 -- 172.21.15.181:0/340030306 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f30e40048a0 con 0x7f30f00a66d0 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 1 -- 172.21.15.181:0/340030306 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f30e4004e10 con 0x7f30f00a66d0 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f7f44640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f7f44640 4 set_mon_vals no callback set 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f4cde640 10 monclient: dump: 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.538 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f7f44640 10 monclient: shutdown 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f7f44640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:29.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.530+0000 7f30f7f44640 1 -- 172.21.15.181:0/340030306 >> v1:172.21.15.181:6793/0 conn(0x7f30f00a66d0 legacy=0x7f30f00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.531+0000 7f30f7f44640 1 -- 172.21.15.181:0/340030306 shutdown_connections 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.531+0000 7f30f7f44640 1 -- 172.21.15.181:0/340030306 >> 172.21.15.181:0/340030306 conn(0x7f30f00abcd0 msgr2=0x7f30f00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.531+0000 7f30f7f44640 1 -- 172.21.15.181:0/340030306 shutdown_connections 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.531+0000 7f30f7f44640 1 -- 172.21.15.181:0/340030306 wait complete. 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.531+0000 7f30f7f44640 10 monclient: build_initial_monmap 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.531+0000 7f30f7f44640 10 monclient: monmap: 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:29.540 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:29.541 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:29.541 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:29.541 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:29.541 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:29.541 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:29.541 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:29.541 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:29.541 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.531+0000 7f30f7f44640 1 Processor -- start 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.531+0000 7f30f7f44640 1 -- start start 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.531+0000 7f30f7f44640 10 monclient: init 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.532+0000 7f30f7f44640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.532+0000 7f30f7f44640 10 monclient: _add_conns ranks=[8,2,5,0,7,6,3,1,4] 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.532+0000 7f30f7f44640 10 monclient(hunting): picked mon.noname-e con 0x7f30f00a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.532+0000 7f30f7f44640 10 monclient(hunting): picked mon.noname-b con 0x7f30f00a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.532+0000 7f30f7f44640 10 monclient(hunting): picked mon.noname-h con 0x7f30f013f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.532+0000 7f30f7f44640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f013cd40 con 0x7f30f00a6ab0 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.532+0000 7f30f7f44640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f0068680 con 0x7f30f013f9a0 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.532+0000 7f30f7f44640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f013dce0 con 0x7f30f00a66d0 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.532+0000 7f30f7f44640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.532+0000 7f30f7f44640 10 monclient(hunting): authenticate will time out at 769.037429s 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.532+0000 7f30f5ce0640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f30f00a66d0 0x7f30f01ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39908/0 (socket says 172.21.15.181:39908) 2024-09-13T10:30:29.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.532+0000 7f30f5ce0640 1 -- 172.21.15.181:0/832308425 learned_addr learned my addr 172.21.15.181:0/832308425 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:29.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.534+0000 7f30f54df640 1 -- 172.21.15.181:0/832308425 >> v1:172.21.15.181:6790/0 conn(0x7f30f00a6ab0 legacy=0x7f30f01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.534+0000 7f30f5ce0640 1 -- 172.21.15.181:0/832308425 >> v1:172.21.15.181:6793/0 conn(0x7f30f00a66d0 legacy=0x7f30f01ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.534+0000 7f30f54df640 1 --1- 172.21.15.181:0/832308425 >> v1:172.21.15.181:6790/0 conn(0x7f30f00a6ab0 0x7f30f01d3630 :-1 s=OPENED pgs=87 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f30f013cd40 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:30:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.534+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530063875 0 0) 0x7f30f013dce0 con 0x7f30f00a66d0 2024-09-13T10:30:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.534+0000 7f30e27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.534+0000 7f30e27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.534+0000 7f30e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.534+0000 7f30e27fc640 10 monclient(hunting): my global_id is 4391 2024-09-13T10:30:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.534+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30d4003520 con 0x7f30f00a66d0 2024-09-13T10:30:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.534+0000 7f30f64e1640 1 -- 172.21.15.181:0/832308425 >> v1:172.21.15.195:6791/0 conn(0x7f30f013f9a0 legacy=0x7f30f01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.534+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 794186002 0 0) 0x7f30d4003520 con 0x7f30f00a66d0 2024-09-13T10:30:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.534+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f30f013dce0 con 0x7f30f00a66d0 2024-09-13T10:30:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f30e4004d90 con 0x7f30f00a66d0 2024-09-13T10:30:29.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient(hunting): dump: 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.547 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1126111539 0 0) 0x7f30f00a8080 con 0x7f30f013f9a0 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient(hunting): my global_id is 4397 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30d4003520 con 0x7f30f013f9a0 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1168882127 0 0) 0x7f30f013dce0 con 0x7f30f00a66d0 2024-09-13T10:30:29.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 >> v1:172.21.15.195:6791/0 conn(0x7f30f013f9a0 legacy=0x7f30f01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 >> v1:172.21.15.181:6790/0 conn(0x7f30f00a6ab0 legacy=0x7f30f01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 1 monclient: found mon.e 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f013e800 con 0x7f30f00a66d0 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1856955365 0 0) 0x7f30f013cd40 con 0x7f30f00a6ab0 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30f7f44640 5 monclient: authenticate success, global_id 4391 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30f7f44640 10 monclient: _renew_subs 2024-09-13T10:30:29.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30f7f44640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30f7f44640 1 -- 172.21.15.181:0/832308425 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f30f01374e0 con 0x7f30f00a66d0 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30f7f44640 10 monclient: _renew_subs 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30f7f44640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30f7f44640 1 -- 172.21.15.181:0/832308425 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f30f013c2a0 con 0x7f30f00a66d0 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f30e4001d20 con 0x7f30f00a66d0 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f30e4005740 con 0x7f30f00a66d0 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e3fff640 4 set_mon_vals no callback set 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 10 monclient: dump: 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.550 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.535+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f30e4011dc0 con 0x7f30f00a66d0 2024-09-13T10:30:29.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.536+0000 7f30f7f44640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:29.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.536+0000 7f30f7f44640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:29.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.536+0000 7f30f7f44640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:29.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.536+0000 7f30f7f44640 1 -- 172.21.15.181:0/832308425 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d8005080 con 0x7f30f00a66d0 2024-09-13T10:30:29.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.536+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f30e404e2a0 con 0x7f30f00a66d0 2024-09-13T10:30:29.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.536+0000 7f30f54df640 10 monclient: get_auth_request con 0x7f30d403faf0 auth_method 0 2024-09-13T10:30:29.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.540+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f30e40178e0 con 0x7f30f00a66d0 2024-09-13T10:30:29.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.540+0000 7f30e27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:29.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.540+0000 7f30e27fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:29.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.716+0000 7f30f7f44640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:29.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.716+0000 7f30f7f44640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:29.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.716+0000 7f30f7f44640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:29.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.716+0000 7f30f7f44640 1 -- 172.21.15.181:0/832308425 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30d8005370 con 0x7f30f00a66d0 2024-09-13T10:30:29.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.717+0000 7f30e27fc640 1 -- 172.21.15.181:0/832308425 <== mon.8 v1:172.21.15.181:6793/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+10987 (unknown 3413328019 0 1153584008) 0x7f30e40171e0 con 0x7f30f00a66d0 2024-09-13T10:30:29.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.717+0000 7f30e27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:30:29.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.717+0000 7f30e27fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:29.719 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:30:29.720 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":20,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","created":"2024-09-13T10:29:50.823515+0000","modified":"2024-09-13T10:30:24.822046+0000","last_up_change":"2024-09-13T10:30:13.707133+0000","last_in_change":"2024-09-13T10:30:04.743077+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T10:30:13.877061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T10:30:20.723608+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"222eae7d-397c-40de-9975-11705817eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6804","nonce":3159017208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6805","nonce":3159017208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6807","nonce":3159017208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6806","nonce":3159017208}]},"public_addr":"172.21.15.181:6804/3159017208","cluster_addr":"172.21.15.181:6805/3159017208","heartbeat_back_addr":"172.21.15.181:6807/3159017208","heartbeat_front_addr":"172.21.15.181:6806/3159017208","state":["exists","up"]},{"osd":1,"uuid":"c241f0df-9ad4-42f4-809b-872d2c14bdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6800","nonce":3226877824}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6801","nonce":3226877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6803","nonce":3226877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6802","nonce":3226877824}]},"public_addr":"172.21.15.181:6800/3226877824","cluster_addr":"172.21.15.181:6801/3226877824","heartbeat_back_addr":"172.21.15.181:6803/3226877824","heartbeat_front_addr":"172.21.15.181:6802/3226877824","state":["exists","up"]},{"osd":2,"uuid":"efbff8a5-b42c-4e47-92e1-faf8ef9bec2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6808","nonce":3162343005}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6809","nonce":3162343005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6811","nonce":3162343005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6810","nonce":3162343005}]},"public_addr":"172.21.15.181:6808/3162343005","cluster_addr":"172.21.15.181:6809/3162343005","heartbeat_back_addr":"172.21.15.181:6811/3162343005","heartbeat_front_addr":"172.21.15.181:6810/3162343005","state":["exists","up"]},{"osd":3,"uuid":"11e6b317-e77c-4469-840a-a1d17e9eee86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6809","nonce":2152618500}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6810","nonce":2152618500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6812","nonce":2152618500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6811","nonce":2152618500}]},"public_addr":"172.21.15.195:6809/2152618500","cluster_addr":"172.21.15.195:6810/2152618500","heartbeat_back_addr":"172.21.15.195:6812/2152618500","heartbeat_front_addr":"172.21.15.195:6811/2152618500","state":["exists","up"]},{"osd":4,"uuid":"78cd8d74-5ffb-4116-aa73-e082ffd9adce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6805","nonce":1430589228}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6806","nonce":1430589228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6808","nonce":1430589228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6807","nonce":1430589228}]},"public_addr":"172.21.15.195:6805/1430589228","cluster_addr":"172.21.15.195:6806/1430589228","heartbeat_back_addr":"172.21.15.195:6808/1430589228","heartbeat_front_addr":"172.21.15.195:6807/1430589228","state":["exists","up"]},{"osd":5,"uuid":"ecb70959-b169-4fd8-958d-ac5b1d0a3c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6801","nonce":2714505324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6802","nonce":2714505324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6804","nonce":2714505324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6803","nonce":2714505324}]},"public_addr":"172.21.15.195:6801/2714505324","cluster_addr":"172.21.15.195:6802/2714505324","heartbeat_back_addr":"172.21.15.195:6804/2714505324","heartbeat_front_addr":"172.21.15.195:6803/2714505324","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.841016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.270575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.374446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.763765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.551366+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.985540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T10:30:29.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.719+0000 7f30f7f44640 1 -- 172.21.15.181:0/832308425 >> v1:172.21.15.195:6800/1839191919 conn(0x7f30d403faf0 legacy=0x7f30d4041fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.719+0000 7f30f7f44640 10 monclient: shutdown 2024-09-13T10:30:29.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.719+0000 7f30f7f44640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:29.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.719+0000 7f30f7f44640 1 -- 172.21.15.181:0/832308425 >> v1:172.21.15.181:6793/0 conn(0x7f30f00a66d0 legacy=0x7f30f01ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.719+0000 7f30f7f44640 1 -- 172.21.15.181:0/832308425 shutdown_connections 2024-09-13T10:30:29.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.719+0000 7f30f7f44640 1 -- 172.21.15.181:0/832308425 >> 172.21.15.181:0/832308425 conn(0x7f30f00abcd0 msgr2=0x7f30f00ab410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:29.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.719+0000 7f30f7f44640 1 -- 172.21.15.181:0/832308425 shutdown_connections 2024-09-13T10:30:29.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.719+0000 7f30f7f44640 1 -- 172.21.15.181:0/832308425 wait complete. 2024-09-13T10:30:29.731 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T10:30:13.877061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T10:30:20.723608+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T10:30:29.731 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T10:30:29.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.831+0000 7f6bb43f5640 10 monclient: get_monmap_and_config 2024-09-13T10:30:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.831+0000 7f6bb43f5640 10 monclient: build_initial_monmap 2024-09-13T10:30:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.831+0000 7f6bb43f5640 10 monclient: monmap: 2024-09-13T10:30:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:29.831944+0000 2024-09-13T10:30:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:29.831944+0000 2024-09-13T10:30:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:29.833 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:29.834 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:29.834 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:29.834 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:29.834 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:29.834 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:29.834 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:29.834 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:29.834 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.831+0000 7f6bb43f5640 1 Processor -- start 2024-09-13T10:30:29.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb43f5640 1 -- start start 2024-09-13T10:30:29.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb43f5640 10 monclient: init 2024-09-13T10:30:29.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb43f5640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:29.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb43f5640 10 monclient: _add_conns ranks=[6,2,7,3,0,8,1,5,4] 2024-09-13T10:30:29.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb43f5640 10 monclient(hunting): picked mon.noname-d con 0x7f6bac0a6540 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:29.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb43f5640 10 monclient(hunting): picked mon.noname-b con 0x7f6bac09d360 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:29.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb43f5640 10 monclient(hunting): picked mon.noname-i con 0x7f6bac09cec0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:29.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb43f5640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bac0a51e0 con 0x7f6bac09d360 2024-09-13T10:30:29.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb43f5640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bac0a8380 con 0x7f6bac0a6540 2024-09-13T10:30:29.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb43f5640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bac09e250 con 0x7f6bac09cec0 2024-09-13T10:30:29.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb43f5640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:29.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb43f5640 10 monclient(hunting): authenticate will time out at 769.337736s 2024-09-13T10:30:29.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb2191640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f6bac0a6540 0x7f6bac0a6920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45668/0 (socket says 172.21.15.181:45668) 2024-09-13T10:30:29.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.832+0000 7f6bb2191640 1 -- 172.21.15.181:0/1579885875 learned_addr learned my addr 172.21.15.181:0/1579885875 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:29.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.834+0000 7f6bb1990640 1 -- 172.21.15.181:0/1579885875 >> v1:172.21.15.181:6790/0 conn(0x7f6bac09d360 legacy=0x7f6bac13e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.834+0000 7f6bb2191640 1 -- 172.21.15.181:0/1579885875 >> v1:172.21.15.181:6792/0 conn(0x7f6bac0a6540 legacy=0x7f6bac0a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 1 -- 172.21.15.181:0/1579885875 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550965148 0 0) 0x7f6bac0a8380 con 0x7f6bac0a6540 2024-09-13T10:30:29.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient(hunting): my global_id is 4353 2024-09-13T10:30:29.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 1 -- 172.21.15.181:0/1579885875 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b98003520 con 0x7f6bac0a6540 2024-09-13T10:30:29.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 1 -- 172.21.15.181:0/1579885875 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1919224634 0 0) 0x7f6bac0a51e0 con 0x7f6bac09d360 2024-09-13T10:30:29.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient(hunting): my global_id is 4412 2024-09-13T10:30:29.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 1 -- 172.21.15.181:0/1579885875 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bac0a8380 con 0x7f6bac09d360 2024-09-13T10:30:29.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb2992640 1 -- 172.21.15.181:0/1579885875 >> v1:172.21.15.195:6792/0 conn(0x7f6bac09cec0 legacy=0x7f6bac141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 1 -- 172.21.15.181:0/1579885875 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3524675791 0 0) 0x7f6b98003520 con 0x7f6bac0a6540 2024-09-13T10:30:29.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 1 -- 172.21.15.181:0/1579885875 >> v1:172.21.15.195:6792/0 conn(0x7f6bac09cec0 legacy=0x7f6bac141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 1 -- 172.21.15.181:0/1579885875 >> v1:172.21.15.181:6790/0 conn(0x7f6bac09d360 legacy=0x7f6bac13e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient: _finish_hunting 0 2024-09-13T10:30:29.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 1 monclient: found mon.noname-d 2024-09-13T10:30:29.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:29.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:30:29.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 1 -- 172.21.15.181:0/1579885875 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bac09e530 con 0x7f6bac0a6540 2024-09-13T10:30:29.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient: _finish_auth 0 2024-09-13T10:30:29.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient: _check_auth_tickets 2024-09-13T10:30:29.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:29.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 1 -- 172.21.15.181:0/1579885875 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6ba8001a10 con 0x7f6bac0a6540 2024-09-13T10:30:29.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb43f5640 5 monclient: authenticate success, global_id 4353 2024-09-13T10:30:29.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb43f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:29.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:29.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:29.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient: dump: 2024-09-13T10:30:29.848 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.848 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.848 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.848 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.848 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.849 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.849 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.849 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.849 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.849 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.849 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.849 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.849 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.849 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.849 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.849 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb43f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:29.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 1 -- 172.21.15.181:0/1579885875 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ba8001ce0 con 0x7f6bac0a6540 2024-09-13T10:30:29.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:29.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 1 -- 172.21.15.181:0/1579885875 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6ba8004be0 con 0x7f6bac0a6540 2024-09-13T10:30:29.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb43f5640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:29.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb43f5640 4 set_mon_vals no callback set 2024-09-13T10:30:29.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:29.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:29.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb118f640 10 monclient: dump: 2024-09-13T10:30:29.850 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.850 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.850 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.851 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.851 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.851 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.851 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.851 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.851 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.851 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.851 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.851 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.851 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.851 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.852 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.852 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.835+0000 7f6bb43f5640 10 monclient: shutdown 2024-09-13T10:30:29.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.836+0000 7f6bb43f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:29.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.836+0000 7f6bb43f5640 1 -- 172.21.15.181:0/1579885875 >> v1:172.21.15.181:6792/0 conn(0x7f6bac0a6540 legacy=0x7f6bac0a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.836+0000 7f6bb43f5640 1 -- 172.21.15.181:0/1579885875 shutdown_connections 2024-09-13T10:30:29.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.836+0000 7f6bb43f5640 1 -- 172.21.15.181:0/1579885875 >> 172.21.15.181:0/1579885875 conn(0x7f6bac0abc40 msgr2=0x7f6bac0ac050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:29.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.836+0000 7f6bb43f5640 1 -- 172.21.15.181:0/1579885875 shutdown_connections 2024-09-13T10:30:29.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.836+0000 7f6bb43f5640 1 -- 172.21.15.181:0/1579885875 wait complete. 2024-09-13T10:30:29.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.836+0000 7f6bb43f5640 10 monclient: build_initial_monmap 2024-09-13T10:30:29.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.836+0000 7f6bb43f5640 10 monclient: monmap: 2024-09-13T10:30:29.853 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:29.853 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:29.853 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:29.853 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:29.853 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:29.853 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:29.853 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:29.853 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:29.853 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:29.853 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:29.853 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:29.853 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:29.854 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:29.854 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:29.854 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:29.857 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.836+0000 7f6bb43f5640 1 Processor -- start 2024-09-13T10:30:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb43f5640 1 -- start start 2024-09-13T10:30:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb43f5640 10 monclient: init 2024-09-13T10:30:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb43f5640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb43f5640 10 monclient: _add_conns ranks=[3,4,8,1,2,0,7,5,6] 2024-09-13T10:30:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb43f5640 10 monclient(hunting): picked mon.noname-g con 0x7f6bac09cec0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb43f5640 10 monclient(hunting): picked mon.noname-c con 0x7f6bac09d360 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:29.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb43f5640 10 monclient(hunting): picked mon.noname-e con 0x7f6bac0a6540 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:29.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb43f5640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bac0a91c0 con 0x7f6bac09cec0 2024-09-13T10:30:29.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb43f5640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bac127200 con 0x7f6bac09d360 2024-09-13T10:30:29.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb43f5640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bac125fc0 con 0x7f6bac0a6540 2024-09-13T10:30:29.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb43f5640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:29.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb43f5640 10 monclient(hunting): authenticate will time out at 769.342576s 2024-09-13T10:30:29.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb1990640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f6bac09d360 0x7f6bac1d2ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38492/0 (socket says 172.21.15.181:38492) 2024-09-13T10:30:29.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.837+0000 7f6bb1990640 1 -- 172.21.15.181:0/69326103 learned_addr learned my addr 172.21.15.181:0/69326103 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:29.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6bb1990640 1 -- 172.21.15.181:0/69326103 >> v1:172.21.15.181:6791/0 conn(0x7f6bac09d360 legacy=0x7f6bac1d2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6bb2992640 1 -- 172.21.15.181:0/69326103 >> v1:172.21.15.181:6793/0 conn(0x7f6bac0a6540 legacy=0x7f6bac1d6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6bb2191640 1 -- 172.21.15.181:0/69326103 >> v1:172.21.15.195:6790/0 conn(0x7f6bac09cec0 legacy=0x7f6bac139840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:29.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526963204 0 0) 0x7f6bac127200 con 0x7f6bac09d360 2024-09-13T10:30:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6b9effd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6b9effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6b9effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6b9effd640 10 monclient(hunting): my global_id is 4423 2024-09-13T10:30:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b90003520 con 0x7f6bac09d360 2024-09-13T10:30:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627484825 0 0) 0x7f6bac125fc0 con 0x7f6bac0a6540 2024-09-13T10:30:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6b9effd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6b9effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6b9effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6b9effd640 10 monclient(hunting): my global_id is 4400 2024-09-13T10:30:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.839+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bac127200 con 0x7f6bac0a6540 2024-09-13T10:30:29.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4138614015 0 0) 0x7f6b90003520 con 0x7f6bac09d360 2024-09-13T10:30:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6bac125fc0 con 0x7f6bac09d360 2024-09-13T10:30:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224782362 0 0) 0x7f6bac09e530 con 0x7f6bac09cec0 2024-09-13T10:30:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient(hunting): my global_id is 4332 2024-09-13T10:30:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b90003520 con 0x7f6bac09cec0 2024-09-13T10:30:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6ba0003610 con 0x7f6bac09d360 2024-09-13T10:30:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:29.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient(hunting): dump: 2024-09-13T10:30:29.861 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.861 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.861 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.861 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.861 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.861 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.861 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.861 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.861 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.861 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.862 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.862 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.862 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.862 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.862 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.862 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:29.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2769739729 0 0) 0x7f6bac127200 con 0x7f6bac0a6540 2024-09-13T10:30:29.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6bac09e530 con 0x7f6bac0a6540 2024-09-13T10:30:29.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6ba4002020 con 0x7f6bac0a6540 2024-09-13T10:30:29.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:29.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:29.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient(hunting): dump: 2024-09-13T10:30:29.863 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.863 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.863 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.863 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.863 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.863 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.863 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.863 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.863 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.863 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.863 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.864 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1835732394 0 0) 0x7f6bac125fc0 con 0x7f6bac09d360 2024-09-13T10:30:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 >> v1:172.21.15.181:6793/0 conn(0x7f6bac0a6540 legacy=0x7f6bac1d6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 >> v1:172.21.15.195:6790/0 conn(0x7f6bac09cec0 legacy=0x7f6bac139840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 monclient: found mon.c 2024-09-13T10:30:29.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bac124ea0 con 0x7f6bac09d360 2024-09-13T10:30:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient: _finish_auth 0 2024-09-13T10:30:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6bb43f5640 5 monclient: authenticate success, global_id 4423 2024-09-13T10:30:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6bb43f5640 10 monclient: _renew_subs 2024-09-13T10:30:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6bb43f5640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6bb43f5640 1 -- 172.21.15.181:0/69326103 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6bac126f20 con 0x7f6bac09d360 2024-09-13T10:30:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6bb43f5640 10 monclient: _renew_subs 2024-09-13T10:30:29.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6bb43f5640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6bb43f5640 1 -- 172.21.15.181:0/69326103 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f6bac1cde20 con 0x7f6bac09d360 2024-09-13T10:30:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ba0003c70 con 0x7f6bac09d360 2024-09-13T10:30:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6ba00041e0 con 0x7f6bac09d360 2024-09-13T10:30:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6bb098e640 4 set_mon_vals no callback set 2024-09-13T10:30:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.840+0000 7f6b9effd640 10 monclient: dump: 2024-09-13T10:30:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:29.866 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:29.867 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:29.868 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.841+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6ba0011ca0 con 0x7f6bac09d360 2024-09-13T10:30:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.841+0000 7f6bb43f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.841+0000 7f6bb43f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.841+0000 7f6bb43f5640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.841+0000 7f6bb43f5640 1 -- 172.21.15.181:0/69326103 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b94005080 con 0x7f6bac09d360 2024-09-13T10:30:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.841+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7f6ba004e360 con 0x7f6bac09d360 2024-09-13T10:30:29.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.841+0000 7f6bb2191640 10 monclient: get_auth_request con 0x7f6b90040350 auth_method 0 2024-09-13T10:30:29.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.845+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f6ba00178e0 con 0x7f6bac09d360 2024-09-13T10:30:29.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.845+0000 7f6b9effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:29.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:29.845+0000 7f6b9effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:30.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.022+0000 7f6bb43f5640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-09-13T10:30:30.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.022+0000 7f6bb43f5640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-09-13T10:30:30.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.022+0000 7f6bb43f5640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:30.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.022+0000 7f6bb43f5640 1 -- 172.21.15.181:0/69326103 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6b94005c40 con 0x7f6bac09d360 2024-09-13T10:30:30.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.022+0000 7f6b9effd640 1 -- 172.21.15.181:0/69326103 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (unknown 3471955896 0 2170607528) 0x7f6ba00171e0 con 0x7f6bac09d360 2024-09-13T10:30:30.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.022+0000 7f6b9effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-09-13T10:30:30.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.022+0000 7f6b9effd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:30.024 INFO:teuthology.orchestra.run.smithi181.stdout:pg_num: 1 2024-09-13T10:30:30.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.025+0000 7f6bb43f5640 1 -- 172.21.15.181:0/69326103 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6b90040350 legacy=0x7f6b90042810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.025+0000 7f6bb43f5640 10 monclient: shutdown 2024-09-13T10:30:30.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.025+0000 7f6bb43f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:30.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.025+0000 7f6bb43f5640 1 -- 172.21.15.181:0/69326103 >> v1:172.21.15.181:6791/0 conn(0x7f6bac09d360 legacy=0x7f6bac1d2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.025+0000 7f6bb43f5640 1 -- 172.21.15.181:0/69326103 shutdown_connections 2024-09-13T10:30:30.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.025+0000 7f6bb43f5640 1 -- 172.21.15.181:0/69326103 >> 172.21.15.181:0/69326103 conn(0x7f6bac0abc40 msgr2=0x7f6bac1c1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:30.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.025+0000 7f6bb43f5640 1 -- 172.21.15.181:0/69326103 shutdown_connections 2024-09-13T10:30:30.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.025+0000 7f6bb43f5640 1 -- 172.21.15.181:0/69326103 wait complete. 2024-09-13T10:30:30.036 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-13T10:30:30.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.139+0000 7fa2cad5d640 10 monclient: get_monmap_and_config 2024-09-13T10:30:30.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.139+0000 7fa2cad5d640 10 monclient: build_initial_monmap 2024-09-13T10:30:30.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.139+0000 7fa2cad5d640 10 monclient: monmap: 2024-09-13T10:30:30.141 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:30.141 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.141 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:30.140262+0000 2024-09-13T10:30:30.141 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:30.140262+0000 2024-09-13T10:30:30.141 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:30.141 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.142 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:30.142 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:30.142 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:30.142 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:30.142 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:30.142 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:30.142 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:30.142 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:30.142 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:30.142 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.140+0000 7fa2cad5d640 1 Processor -- start 2024-09-13T10:30:30.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.140+0000 7fa2cad5d640 1 -- start start 2024-09-13T10:30:30.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.140+0000 7fa2cad5d640 10 monclient: init 2024-09-13T10:30:30.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.140+0000 7fa2cad5d640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:30.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.140+0000 7fa2cad5d640 10 monclient: _add_conns ranks=[2,8,0,7,3,6,1,4,5] 2024-09-13T10:30:30.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.140+0000 7fa2cad5d640 10 monclient(hunting): picked mon.noname-b con 0x7fa2c40a6540 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:30.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.140+0000 7fa2cad5d640 10 monclient(hunting): picked mon.noname-e con 0x7fa2c409d360 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:30.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.140+0000 7fa2cad5d640 10 monclient(hunting): picked mon.noname-a con 0x7fa2c409cec0 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:30.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.140+0000 7fa2cad5d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c40a51e0 con 0x7fa2c409cec0 2024-09-13T10:30:30.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.141+0000 7fa2cad5d640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c40a8380 con 0x7fa2c40a6540 2024-09-13T10:30:30.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.141+0000 7fa2cad5d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c409e250 con 0x7fa2c409d360 2024-09-13T10:30:30.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.141+0000 7fa2cad5d640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:30.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.141+0000 7fa2cad5d640 10 monclient(hunting): authenticate will time out at 769.646033s 2024-09-13T10:30:30.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.141+0000 7fa2c8af9640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fa2c40a6540 0x7fa2c40a6920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48562/0 (socket says 172.21.15.181:48562) 2024-09-13T10:30:30.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.141+0000 7fa2c3fff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fa2c409d360 0x7fa2c413e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39928/0 (socket says 172.21.15.181:39928) 2024-09-13T10:30:30.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.141+0000 7fa2c8af9640 1 -- 172.21.15.181:0/745480885 learned_addr learned my addr 172.21.15.181:0/745480885 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:30.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c8af9640 1 -- 172.21.15.181:0/745480885 >> v1:172.21.15.181:6790/0 conn(0x7fa2c40a6540 legacy=0x7fa2c40a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c92fa640 1 -- 172.21.15.181:0/745480885 >> v1:172.21.15.181:6789/0 conn(0x7fa2c409cec0 legacy=0x7fa2c4141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c3fff640 1 -- 172.21.15.181:0/745480885 >> v1:172.21.15.181:6793/0 conn(0x7fa2c409d360 legacy=0x7fa2c413e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548517352 0 0) 0x7fa2c40a8380 con 0x7fa2c40a6540 2024-09-13T10:30:30.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): my global_id is 4421 2024-09-13T10:30:30.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2b4003520 con 0x7fa2c40a6540 2024-09-13T10:30:30.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2648681265 0 0) 0x7fa2c40a51e0 con 0x7fa2c409cec0 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): my global_id is 54288 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2c40a8380 con 0x7fa2c409cec0 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889504137 0 0) 0x7fa2c409e250 con 0x7fa2c409d360 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): my global_id is 4409 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2c40a51e0 con 0x7fa2c409d360 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c92fa640 1 -- 172.21.15.181:0/745480885 >> v1:172.21.15.181:6789/0 conn(0x7fa2c409cec0 legacy=0x7fa2c4141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-09-13T10:30:30.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c92fa640 1 -- 172.21.15.181:0/745480885 >> v1:172.21.15.181:6789/0 conn(0x7fa2c409cec0 legacy=0x7fa2c4141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:30:30.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c92fa640 1 --1- 172.21.15.181:0/745480885 >> v1:172.21.15.181:6789/0 conn(0x7fa2c409cec0 0x7fa2c4141f80 :-1 s=OPENED pgs=93 cs=1 l=1).handle_message read tag failed 2024-09-13T10:30:30.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c92fa640 1 --1- 172.21.15.181:0/745480885 >> v1:172.21.15.181:6789/0 conn(0x7fa2c409cec0 0x7fa2c4141f80 :-1 s=OPENED pgs=93 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:30:30.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.181:6789/0 2024-09-13T10:30:30.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1760642161 0 0) 0x7fa2b4003520 con 0x7fa2c40a6540 2024-09-13T10:30:30.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 >> v1:172.21.15.181:6793/0 conn(0x7fa2c409d360 legacy=0x7fa2c413e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 >> v1:172.21.15.181:6789/0 conn(0x7fa2c409cec0 legacy=0x7fa2c4141f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:30.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:30.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 monclient: found mon.noname-b 2024-09-13T10:30:30.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:30.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:30.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c409e530 con 0x7fa2c40a6540 2024-09-13T10:30:30.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient: _finish_auth 0 2024-09-13T10:30:30.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:30.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:30.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa2b8001ae0 con 0x7fa2c40a6540 2024-09-13T10:30:30.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2cad5d640 5 monclient: authenticate success, global_id 4421 2024-09-13T10:30:30.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:30.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:30.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient: dump: 2024-09-13T10:30:30.158 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.158 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.158 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.158 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2cad5d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:30.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2b80048a0 con 0x7fa2c40a6540 2024-09-13T10:30:30.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:30.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 1 -- 172.21.15.181:0/745480885 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa2b8004e10 con 0x7fa2c40a6540 2024-09-13T10:30:30.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2cad5d640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:30.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2cad5d640 4 set_mon_vals no callback set 2024-09-13T10:30:30.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:30.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:30.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.143+0000 7fa2c37fe640 10 monclient: dump: 2024-09-13T10:30:30.160 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.160 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.160 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.160 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.144+0000 7fa2cad5d640 10 monclient: shutdown 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.144+0000 7fa2cad5d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.144+0000 7fa2cad5d640 1 -- 172.21.15.181:0/745480885 >> v1:172.21.15.181:6790/0 conn(0x7fa2c40a6540 legacy=0x7fa2c40a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.144+0000 7fa2cad5d640 1 -- 172.21.15.181:0/745480885 shutdown_connections 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.144+0000 7fa2cad5d640 1 -- 172.21.15.181:0/745480885 >> 172.21.15.181:0/745480885 conn(0x7fa2c40abc40 msgr2=0x7fa2c40ac050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.144+0000 7fa2cad5d640 1 -- 172.21.15.181:0/745480885 shutdown_connections 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.144+0000 7fa2cad5d640 1 -- 172.21.15.181:0/745480885 wait complete. 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.144+0000 7fa2cad5d640 10 monclient: build_initial_monmap 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.144+0000 7fa2cad5d640 10 monclient: monmap: 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:30.162 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.145+0000 7fa2cad5d640 1 Processor -- start 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.145+0000 7fa2cad5d640 1 -- start start 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.145+0000 7fa2cad5d640 10 monclient: init 2024-09-13T10:30:30.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.145+0000 7fa2cad5d640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:30.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.145+0000 7fa2cad5d640 10 monclient: _add_conns ranks=[8,1,6,3,2,4,5,0,7] 2024-09-13T10:30:30.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.145+0000 7fa2cad5d640 10 monclient(hunting): picked mon.noname-e con 0x7fa2c409cec0 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:30.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.145+0000 7fa2cad5d640 10 monclient(hunting): picked mon.noname-f con 0x7fa2c409d360 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:30.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.145+0000 7fa2cad5d640 10 monclient(hunting): picked mon.noname-d con 0x7fa2c40a6540 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:30.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.145+0000 7fa2cad5d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c4125fa0 con 0x7fa2c409d360 2024-09-13T10:30:30.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.146+0000 7fa2cad5d640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c41cc180 con 0x7fa2c40a6540 2024-09-13T10:30:30.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.146+0000 7fa2cad5d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c4124e80 con 0x7fa2c409cec0 2024-09-13T10:30:30.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.146+0000 7fa2cad5d640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:30.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.146+0000 7fa2cad5d640 10 monclient(hunting): authenticate will time out at 769.651039s 2024-09-13T10:30:30.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.146+0000 7fa2c8af9640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fa2c409cec0 0x7fa2c4139800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39930/0 (socket says 172.21.15.181:39930) 2024-09-13T10:30:30.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.146+0000 7fa2c8af9640 1 -- 172.21.15.181:0/1012400758 learned_addr learned my addr 172.21.15.181:0/1012400758 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:30.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c8af9640 1 -- 172.21.15.181:0/1012400758 >> v1:172.21.15.181:6793/0 conn(0x7fa2c409cec0 legacy=0x7fa2c4139800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c92fa640 1 -- 172.21.15.181:0/1012400758 >> v1:172.21.15.181:6792/0 conn(0x7fa2c40a6540 legacy=0x7fa2c41d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413058216 0 0) 0x7fa2c4124e80 con 0x7fa2c409cec0 2024-09-13T10:30:30.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): my global_id is 4418 2024-09-13T10:30:30.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2a8003520 con 0x7fa2c409cec0 2024-09-13T10:30:30.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 578999819 0 0) 0x7fa2c40a8380 con 0x7fa2c40a6540 2024-09-13T10:30:30.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): my global_id is 4362 2024-09-13T10:30:30.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2c4124e80 con 0x7fa2c40a6540 2024-09-13T10:30:30.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c3fff640 1 -- 172.21.15.181:0/1012400758 >> v1:172.21.15.195:6789/0 conn(0x7fa2c409d360 legacy=0x7fa2c41d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3073135371 0 0) 0x7fa2a8003520 con 0x7fa2c409cec0 2024-09-13T10:30:30.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2c40a8380 con 0x7fa2c409cec0 2024-09-13T10:30:30.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa2b8001d30 con 0x7fa2c409cec0 2024-09-13T10:30:30.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:30.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:30.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): dump: 2024-09-13T10:30:30.167 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.167 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.167 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.167 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.168 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.168 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.168 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.168 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.168 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.168 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.169 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.169 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.169 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.169 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.169 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.169 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:30.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2009222750 0 0) 0x7fa2c4124e80 con 0x7fa2c40a6540 2024-09-13T10:30:30.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2a8003520 con 0x7fa2c40a6540 2024-09-13T10:30:30.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa2bc003990 con 0x7fa2c40a6540 2024-09-13T10:30:30.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:30.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): dump: 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.170 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.171 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.171 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.171 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.171 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168858190 0 0) 0x7fa2c4125fa0 con 0x7fa2c409d360 2024-09-13T10:30:30.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient(hunting): my global_id is 54397 2024-09-13T10:30:30.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2c4124e80 con 0x7fa2c409d360 2024-09-13T10:30:30.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3495873902 0 0) 0x7fa2c40a8380 con 0x7fa2c409cec0 2024-09-13T10:30:30.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 >> v1:172.21.15.181:6792/0 conn(0x7fa2c40a6540 legacy=0x7fa2c41d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 >> v1:172.21.15.195:6789/0 conn(0x7fa2c409d360 legacy=0x7fa2c41d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient: _finish_hunting 0 2024-09-13T10:30:30.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 monclient: found mon.e 2024-09-13T10:30:30.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:30.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:30.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c41271e0 con 0x7fa2c409cec0 2024-09-13T10:30:30.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient: _finish_auth 0 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient: _check_auth_tickets 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2cad5d640 5 monclient: authenticate success, global_id 4418 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2cad5d640 10 monclient: _renew_subs 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2cad5d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2cad5d640 1 -- 172.21.15.181:0/1012400758 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c41259e0 con 0x7fa2c409cec0 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2cad5d640 10 monclient: _renew_subs 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2cad5d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2cad5d640 1 -- 172.21.15.181:0/1012400758 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2c413a0f0 con 0x7fa2c409cec0 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2b8005040 con 0x7fa2c409cec0 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa2b80048a0 con 0x7fa2c409cec0 2024-09-13T10:30:30.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.148+0000 7fa2c2ffd640 4 set_mon_vals no callback set 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.149+0000 7fa2c17fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.149+0000 7fa2c17fa640 10 monclient: dump: 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.174 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.175 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.175 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.175 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.175 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.149+0000 7fa2cad5d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:30.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.149+0000 7fa2cad5d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:30.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.149+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa2b8011a10 con 0x7fa2c409cec0 2024-09-13T10:30:30.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.149+0000 7fa2cad5d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:30.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.149+0000 7fa2cad5d640 1 -- 172.21.15.181:0/1012400758 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a4005080 con 0x7fa2c409cec0 2024-09-13T10:30:30.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.150+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7fa2b804e0b0 con 0x7fa2c409cec0 2024-09-13T10:30:30.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.150+0000 7fa2c3fff640 10 monclient: get_auth_request con 0x7fa2a80404d0 auth_method 0 2024-09-13T10:30:30.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.154+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fa2b8017750 con 0x7fa2c409cec0 2024-09-13T10:30:30.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.154+0000 7fa2c17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:30.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.154+0000 7fa2c17fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:30.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.327+0000 7fa2cad5d640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-09-13T10:30:30.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.327+0000 7fa2cad5d640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-09-13T10:30:30.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.327+0000 7fa2cad5d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:30.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.327+0000 7fa2cad5d640 1 -- 172.21.15.181:0/1012400758 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7fa2a4005c40 con 0x7fa2c409cec0 2024-09-13T10:30:30.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.328+0000 7fa2c17fa640 1 -- 172.21.15.181:0/1012400758 <== mon.8 v1:172.21.15.181:6793/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) ==== 92+0+10 (unknown 3412311620 0 265718887) 0x7fa2b804bf70 con 0x7fa2c409cec0 2024-09-13T10:30:30.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.328+0000 7fa2c17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-09-13T10:30:30.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.328+0000 7fa2c17fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:30.330 INFO:teuthology.orchestra.run.smithi181.stdout:pg_num: 8 2024-09-13T10:30:30.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.330+0000 7fa2cad5d640 1 -- 172.21.15.181:0/1012400758 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa2a80404d0 legacy=0x7fa2a8042990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.330+0000 7fa2cad5d640 10 monclient: shutdown 2024-09-13T10:30:30.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.330+0000 7fa2cad5d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:30.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.330+0000 7fa2cad5d640 1 -- 172.21.15.181:0/1012400758 >> v1:172.21.15.181:6793/0 conn(0x7fa2c409cec0 legacy=0x7fa2c4139800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.330+0000 7fa2cad5d640 1 -- 172.21.15.181:0/1012400758 shutdown_connections 2024-09-13T10:30:30.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.330+0000 7fa2cad5d640 1 -- 172.21.15.181:0/1012400758 >> 172.21.15.181:0/1012400758 conn(0x7fa2c40abc40 msgr2=0x7fa2c41c15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:30.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.330+0000 7fa2cad5d640 1 -- 172.21.15.181:0/1012400758 shutdown_connections 2024-09-13T10:30:30.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.330+0000 7fa2cad5d640 1 -- 172.21.15.181:0/1012400758 wait complete. 2024-09-13T10:30:30.342 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-09-13T10:30:30.342 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T10:30:30.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.437+0000 7ff370317640 10 monclient: get_monmap_and_config 2024-09-13T10:30:30.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.437+0000 7ff370317640 10 monclient: build_initial_monmap 2024-09-13T10:30:30.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.437+0000 7ff370317640 10 monclient: monmap: 2024-09-13T10:30:30.439 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:30.439 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.439 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:30.438466+0000 2024-09-13T10:30:30.439 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:30.438466+0000 2024-09-13T10:30:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:30.440 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:30.440 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.438+0000 7ff370317640 1 Processor -- start 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.438+0000 7ff370317640 1 -- start start 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.438+0000 7ff370317640 10 monclient: init 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.439+0000 7ff370317640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.439+0000 7ff370317640 10 monclient: _add_conns ranks=[3,5,2,0,7,6,4,8,1] 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.439+0000 7ff370317640 10 monclient(hunting): picked mon.noname-g con 0x7ff3680a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.439+0000 7ff370317640 10 monclient(hunting): picked mon.noname-h con 0x7ff3680a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.439+0000 7ff370317640 10 monclient(hunting): picked mon.noname-b con 0x7ff36813f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.439+0000 7ff370317640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3680a4bc0 con 0x7ff36813f750 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.439+0000 7ff370317640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36813a320 con 0x7ff3680a6640 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.439+0000 7ff370317640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3680a8100 con 0x7ff3680a8340 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.439+0000 7ff370317640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:30.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.439+0000 7ff370317640 10 monclient(hunting): authenticate will time out at 769.944332s 2024-09-13T10:30:30.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.439+0000 7ff36e8b4640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7ff36813f750 0x7ff368141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48574/0 (socket says 172.21.15.181:48574) 2024-09-13T10:30:30.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.439+0000 7ff36e8b4640 1 -- 172.21.15.181:0/4062412939 learned_addr learned my addr 172.21.15.181:0/4062412939 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:30.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36e8b4640 1 -- 172.21.15.181:0/4062412939 >> v1:172.21.15.181:6790/0 conn(0x7ff36813f750 legacy=0x7ff368141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 1 -- 172.21.15.181:0/4062412939 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3049918198 0 0) 0x7ff3680a4bc0 con 0x7ff36813f750 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 10 monclient(hunting): my global_id is 4430 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 1 -- 172.21.15.181:0/4062412939 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff354003520 con 0x7ff36813f750 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d8b2640 1 -- 172.21.15.181:0/4062412939 >> v1:172.21.15.195:6791/0 conn(0x7ff3680a8340 legacy=0x7ff368139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36e0b3640 1 -- 172.21.15.181:0/4062412939 >> v1:172.21.15.195:6790/0 conn(0x7ff3680a6640 legacy=0x7ff368139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 1 -- 172.21.15.181:0/4062412939 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3803651733 0 0) 0x7ff354003520 con 0x7ff36813f750 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 1 -- 172.21.15.181:0/4062412939 >> v1:172.21.15.195:6791/0 conn(0x7ff3680a8340 legacy=0x7ff368139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 1 -- 172.21.15.181:0/4062412939 >> v1:172.21.15.195:6790/0 conn(0x7ff3680a6640 legacy=0x7ff368139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 10 monclient: _finish_hunting 0 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 1 monclient: found mon.noname-b 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:30.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.441+0000 7ff36d0b1640 1 -- 172.21.15.181:0/4062412939 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3680a48e0 con 0x7ff36813f750 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 10 monclient: _finish_auth 0 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 10 monclient: _check_auth_tickets 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff370317640 5 monclient: authenticate success, global_id 4430 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 1 -- 172.21.15.181:0/4062412939 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff360001e60 con 0x7ff36813f750 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 10 monclient: dump: 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.448 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff370317640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:30.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 1 -- 172.21.15.181:0/4062412939 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff360004c20 con 0x7ff36813f750 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 1 -- 172.21.15.181:0/4062412939 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff360005150 con 0x7ff36813f750 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff370317640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff370317640 4 set_mon_vals no callback set 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff36d0b1640 10 monclient: dump: 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.450 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff370317640 10 monclient: shutdown 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff370317640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff370317640 1 -- 172.21.15.181:0/4062412939 >> v1:172.21.15.181:6790/0 conn(0x7ff36813f750 legacy=0x7ff368141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff370317640 1 -- 172.21.15.181:0/4062412939 shutdown_connections 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff370317640 1 -- 172.21.15.181:0/4062412939 >> 172.21.15.181:0/4062412939 conn(0x7ff368077170 msgr2=0x7ff3680abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:30.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff370317640 1 -- 172.21.15.181:0/4062412939 shutdown_connections 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.442+0000 7ff370317640 1 -- 172.21.15.181:0/4062412939 wait complete. 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.443+0000 7ff370317640 10 monclient: build_initial_monmap 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.443+0000 7ff370317640 10 monclient: monmap: 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:30.452 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.443+0000 7ff370317640 1 Processor -- start 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.443+0000 7ff370317640 1 -- start start 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.443+0000 7ff370317640 10 monclient: init 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff370317640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff370317640 10 monclient: _add_conns ranks=[5,7,3,6,1,4,8,0,2] 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff370317640 10 monclient(hunting): picked mon.noname-h con 0x7ff3680a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff370317640 10 monclient(hunting): picked mon.noname-i con 0x7ff36813f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff370317640 10 monclient(hunting): picked mon.noname-g con 0x7ff36813ba90 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff370317640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3680aa0c0 con 0x7ff36813ba90 2024-09-13T10:30:30.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff370317640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36813e4f0 con 0x7ff3680a8340 2024-09-13T10:30:30.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff370317640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff368133e30 con 0x7ff36813f750 2024-09-13T10:30:30.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff370317640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:30.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff370317640 10 monclient(hunting): authenticate will time out at 769.949108s 2024-09-13T10:30:30.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff36e8b4640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7ff36813ba90 0x7ff3681d6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:37100/0 (socket says 172.21.15.181:37100) 2024-09-13T10:30:30.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff36e0b3640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7ff3680a8340 0x7ff36812e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:54890/0 (socket says 172.21.15.181:54890) 2024-09-13T10:30:30.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.444+0000 7ff36e8b4640 1 -- 172.21.15.181:0/1374272658 learned_addr learned my addr 172.21.15.181:0/1374272658 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:30.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff36e8b4640 1 -- 172.21.15.181:0/1374272658 >> v1:172.21.15.195:6790/0 conn(0x7ff36813ba90 legacy=0x7ff3681d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff36e0b3640 1 -- 172.21.15.181:0/1374272658 >> v1:172.21.15.195:6791/0 conn(0x7ff3680a8340 legacy=0x7ff36812e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff36d8b2640 1 -- 172.21.15.181:0/1374272658 >> v1:172.21.15.195:6792/0 conn(0x7ff36813f750 legacy=0x7ff3681d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279183579 0 0) 0x7ff3680a48e0 con 0x7ff36813ba90 2024-09-13T10:30:30.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): my global_id is 4350 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff34c003550 con 0x7ff36813ba90 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753115469 0 0) 0x7ff36813e4f0 con 0x7ff3680a8340 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): my global_id is 4415 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3680a48e0 con 0x7ff3680a8340 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 849574435 0 0) 0x7ff368133e30 con 0x7ff36813f750 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): my global_id is 54403 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff36813e4f0 con 0x7ff36813f750 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3882183496 0 0) 0x7ff3680a48e0 con 0x7ff3680a8340 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff368133e30 con 0x7ff3680a8340 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3980317897 0 0) 0x7ff34c003550 con 0x7ff36813ba90 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff3680a48e0 con 0x7ff36813ba90 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff364003610 con 0x7ff3680a8340 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.446+0000 7ff35effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient(hunting): dump: 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.459 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff3600020b0 con 0x7ff36813ba90 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient(hunting): dump: 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.461 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 661529077 0 0) 0x7ff36813e4f0 con 0x7ff36813f750 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff34c003550 con 0x7ff36813f750 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff358001cd0 con 0x7ff36813f750 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient(hunting): dump: 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.462 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 560114498 0 0) 0x7ff368133e30 con 0x7ff3680a8340 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 >> v1:172.21.15.195:6792/0 conn(0x7ff36813f750 legacy=0x7ff3681d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 >> v1:172.21.15.195:6790/0 conn(0x7ff36813ba90 legacy=0x7ff3681d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 1 monclient: found mon.h 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36813cfd0 con 0x7ff3680a8340 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient: _finish_auth 0 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff370317640 5 monclient: authenticate success, global_id 4415 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff370317640 10 monclient: _renew_subs 2024-09-13T10:30:30.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff370317640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff370317640 1 -- 172.21.15.181:0/1374272658 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff36813dc00 con 0x7ff3680a8340 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff370317640 10 monclient: _renew_subs 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff370317640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff370317640 1 -- 172.21.15.181:0/1374272658 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7ff36812efb0 con 0x7ff3680a8340 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff364003a80 con 0x7ff3680a8340 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff364003fb0 con 0x7ff3680a8340 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff36c8b0640 4 set_mon_vals no callback set 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.447+0000 7ff35effd640 10 monclient: dump: 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.465 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.466 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.448+0000 7ff370317640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:30.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.448+0000 7ff370317640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:30.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.448+0000 7ff370317640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:30.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.448+0000 7ff370317640 1 -- 172.21.15.181:0/1374272658 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff350005080 con 0x7ff3680a8340 2024-09-13T10:30:30.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.448+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff364004250 con 0x7ff3680a8340 2024-09-13T10:30:30.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.448+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1943809936 0 0) 0x7ff36404e110 con 0x7ff3680a8340 2024-09-13T10:30:30.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.448+0000 7ff36d8b2640 10 monclient: get_auth_request con 0x7ff34c040750 auth_method 0 2024-09-13T10:30:30.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.453+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mon.5 v1:172.21.15.195:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7ff364017750 con 0x7ff3680a8340 2024-09-13T10:30:30.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.453+0000 7ff35effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:30.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.453+0000 7ff35effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:30.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.627+0000 7ff370317640 1 -- 172.21.15.181:0/1374272658 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff350000b90 con 0x7ff34c040750 2024-09-13T10:30:30.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.629+0000 7ff35effd640 1 -- 172.21.15.181:0/1374272658 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34100 (unknown 2965378022 0 3969577617) 0x7ff350000b90 con 0x7ff34c040750 2024-09-13T10:30:30.631 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:30:30.631 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-13T10:30:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.631+0000 7ff370317640 1 -- 172.21.15.181:0/1374272658 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff34c040750 legacy=0x7ff34c042c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.631+0000 7ff370317640 10 monclient: shutdown 2024-09-13T10:30:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.631+0000 7ff370317640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.631+0000 7ff370317640 1 -- 172.21.15.181:0/1374272658 >> v1:172.21.15.195:6791/0 conn(0x7ff3680a8340 legacy=0x7ff36812e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.631+0000 7ff370317640 1 -- 172.21.15.181:0/1374272658 shutdown_connections 2024-09-13T10:30:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.631+0000 7ff370317640 1 -- 172.21.15.181:0/1374272658 >> 172.21.15.181:0/1374272658 conn(0x7ff3680a6640 msgr2=0x7ff3680a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.631+0000 7ff370317640 1 -- 172.21.15.181:0/1374272658 shutdown_connections 2024-09-13T10:30:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.631+0000 7ff370317640 1 -- 172.21.15.181:0/1374272658 wait complete. 2024-09-13T10:30:30.643 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-13T10:30:30.576632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":172640,"kb_used_data":2176,"kb_used_omap":9,"kb_used_meta":170358,"kb_avail":566058400,"statfs":{"total":579820584960,"available":579643801600,"internally_reserved":0,"allocated":2228224,"data_stored":1511608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":174447264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.751239"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.839306+0000","last_change":"2024-09-13T10:30:24.839549+0000","last_active":"2024-09-13T10:30:24.839306+0000","last_peered":"2024-09-13T10:30:24.839306+0000","last_clean":"2024-09-13T10:30:24.839306+0000","last_became_active":"2024-09-13T10:30:22.828862+0000","last_became_peered":"2024-09-13T10:30:22.828862+0000","last_unstale":"2024-09-13T10:30:24.839306+0000","last_undegraded":"2024-09-13T10:30:24.839306+0000","last_fullsized":"2024-09-13T10:30:24.839306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:07.535710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013355629999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.833762+0000","last_change":"2024-09-13T10:30:24.834024+0000","last_active":"2024-09-13T10:30:24.833762+0000","last_peered":"2024-09-13T10:30:24.833762+0000","last_clean":"2024-09-13T10:30:24.833762+0000","last_became_active":"2024-09-13T10:30:22.822788+0000","last_became_peered":"2024-09-13T10:30:22.822788+0000","last_unstale":"2024-09-13T10:30:24.833762+0000","last_undegraded":"2024-09-13T10:30:24.833762+0000","last_fullsized":"2024-09-13T10:30:24.833762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:02.717016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050450899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.839057+0000","last_change":"2024-09-13T10:30:24.839303+0000","last_active":"2024-09-13T10:30:24.839057+0000","last_peered":"2024-09-13T10:30:24.839057+0000","last_clean":"2024-09-13T10:30:24.839057+0000","last_became_active":"2024-09-13T10:30:22.818560+0000","last_became_peered":"2024-09-13T10:30:22.818560+0000","last_unstale":"2024-09-13T10:30:24.839057+0000","last_undegraded":"2024-09-13T10:30:24.839057+0000","last_fullsized":"2024-09-13T10:30:24.839057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:20.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012649200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.833596+0000","last_change":"2024-09-13T10:30:24.833843+0000","last_active":"2024-09-13T10:30:24.833596+0000","last_peered":"2024-09-13T10:30:24.833596+0000","last_clean":"2024-09-13T10:30:24.833596+0000","last_became_active":"2024-09-13T10:30:22.816554+0000","last_became_peered":"2024-09-13T10:30:22.816554+0000","last_unstale":"2024-09-13T10:30:24.833596+0000","last_undegraded":"2024-09-13T10:30:24.833596+0000","last_fullsized":"2024-09-13T10:30:24.833596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:55.701606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066494999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.845556+0000","last_change":"2024-09-13T10:30:24.845556+0000","last_active":"2024-09-13T10:30:24.845556+0000","last_peered":"2024-09-13T10:30:24.845556+0000","last_clean":"2024-09-13T10:30:24.845556+0000","last_became_active":"2024-09-13T10:30:22.821223+0000","last_became_peered":"2024-09-13T10:30:22.821223+0000","last_unstale":"2024-09-13T10:30:24.845556+0000","last_undegraded":"2024-09-13T10:30:24.845556+0000","last_fullsized":"2024-09-13T10:30:24.845556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:43.560455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036258549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.833593+0000","last_change":"2024-09-13T10:30:24.833851+0000","last_active":"2024-09-13T10:30:24.833593+0000","last_peered":"2024-09-13T10:30:24.833593+0000","last_clean":"2024-09-13T10:30:24.833593+0000","last_became_active":"2024-09-13T10:30:22.816447+0000","last_became_peered":"2024-09-13T10:30:22.816447+0000","last_unstale":"2024-09-13T10:30:24.833593+0000","last_undegraded":"2024-09-13T10:30:24.833593+0000","last_fullsized":"2024-09-13T10:30:24.833593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:43.342134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084575600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.838233+0000","last_change":"2024-09-13T10:30:24.838514+0000","last_active":"2024-09-13T10:30:24.838233+0000","last_peered":"2024-09-13T10:30:24.838233+0000","last_clean":"2024-09-13T10:30:24.838233+0000","last_became_active":"2024-09-13T10:30:22.822750+0000","last_became_peered":"2024-09-13T10:30:22.822750+0000","last_unstale":"2024-09-13T10:30:24.838233+0000","last_undegraded":"2024-09-13T10:30:24.838233+0000","last_fullsized":"2024-09-13T10:30:24.838233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:13.913264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062120600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.838999+0000","last_change":"2024-09-13T10:30:24.839249+0000","last_active":"2024-09-13T10:30:24.838999+0000","last_peered":"2024-09-13T10:30:24.838999+0000","last_clean":"2024-09-13T10:30:24.838999+0000","last_became_active":"2024-09-13T10:30:22.820901+0000","last_became_peered":"2024-09-13T10:30:22.820901+0000","last_unstale":"2024-09-13T10:30:24.838999+0000","last_undegraded":"2024-09-13T10:30:24.838999+0000","last_fullsized":"2024-09-13T10:30:24.838999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:36.190102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001249939,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.838372+0000","last_change":"2024-09-13T10:30:15.731747+0000","last_active":"2024-09-13T10:30:24.838372+0000","last_peered":"2024-09-13T10:30:24.838372+0000","last_clean":"2024-09-13T10:30:24.838372+0000","last_became_active":"2024-09-13T10:30:15.730748+0000","last_became_peered":"2024-09-13T10:30:15.730748+0000","last_unstale":"2024-09-13T10:30:24.838372+0000","last_undegraded":"2024-09-13T10:30:24.838372+0000","last_fullsized":"2024-09-13T10:30:24.838372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_clean_scrub_stamp":"2024-09-13T10:30:14.708874+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:14.488037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":172032,"data_stored":55139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":55139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":645507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607559,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":645507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640262,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":176128,"data_stored":55158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607557,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":55158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T10:30:30.644 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T10:30:30.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.739+0000 7f1dc2775640 10 monclient: get_monmap_and_config 2024-09-13T10:30:30.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.739+0000 7f1dc2775640 10 monclient: build_initial_monmap 2024-09-13T10:30:30.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.739+0000 7f1dc2775640 10 monclient: monmap: 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:30.739828+0000 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:30.739828+0000 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:30.741 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:30.742 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:30.742 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.739+0000 7f1dc2775640 1 Processor -- start 2024-09-13T10:30:30.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dc2775640 1 -- start start 2024-09-13T10:30:30.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dc2775640 10 monclient: init 2024-09-13T10:30:30.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dc2775640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:30.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dc2775640 10 monclient: _add_conns ranks=[4,2,3,0,1,6,8,7,5] 2024-09-13T10:30:30.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dc2775640 10 monclient(hunting): picked mon.noname-c con 0x7f1dbc0a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:30.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dc2775640 10 monclient(hunting): picked mon.noname-b con 0x7f1dbc0a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:30.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dc2775640 10 monclient(hunting): picked mon.noname-g con 0x7f1dbc13f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:30.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dc2775640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dbc0a4bc0 con 0x7f1dbc0a8340 2024-09-13T10:30:30.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dc2775640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dbc13a320 con 0x7f1dbc13f750 2024-09-13T10:30:30.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dc2775640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dbc0a8100 con 0x7f1dbc0a6640 2024-09-13T10:30:30.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dc2775640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:30.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dc2775640 10 monclient(hunting): authenticate will time out at 770.245497s 2024-09-13T10:30:30.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dbbfff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f1dbc0a6640 0x7f1dbc139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38496/0 (socket says 172.21.15.181:38496) 2024-09-13T10:30:30.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.740+0000 7f1dbbfff640 1 -- 172.21.15.181:0/860114416 learned_addr learned my addr 172.21.15.181:0/860114416 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:30.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.742+0000 7f1dbbfff640 1 -- 172.21.15.181:0/860114416 >> v1:172.21.15.181:6791/0 conn(0x7f1dbc0a6640 legacy=0x7f1dbc139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.742+0000 7f1dbb7fe640 1 -- 172.21.15.181:0/860114416 >> v1:172.21.15.181:6790/0 conn(0x7f1dbc0a8340 legacy=0x7f1dbc139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.743+0000 7f1dc0d12640 1 -- 172.21.15.181:0/860114416 >> v1:172.21.15.195:6790/0 conn(0x7f1dbc13f750 legacy=0x7f1dbc141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.823+0000 7f1dbaffd640 1 -- 172.21.15.181:0/860114416 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674200547 0 0) 0x7f1dbc0a4bc0 con 0x7f1dbc0a8340 2024-09-13T10:30:30.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.823+0000 7f1dbaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.823+0000 7f1dbaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.823+0000 7f1dbaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.823+0000 7f1dbaffd640 10 monclient(hunting): my global_id is 4439 2024-09-13T10:30:30.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.823+0000 7f1dbaffd640 1 -- 172.21.15.181:0/860114416 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1da8003520 con 0x7f1dbc0a8340 2024-09-13T10:30:30.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 1 -- 172.21.15.181:0/860114416 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 836238910 0 0) 0x7f1da8003520 con 0x7f1dbc0a8340 2024-09-13T10:30:30.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 1 -- 172.21.15.181:0/860114416 >> v1:172.21.15.181:6791/0 conn(0x7f1dbc0a6640 legacy=0x7f1dbc139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 1 -- 172.21.15.181:0/860114416 >> v1:172.21.15.195:6790/0 conn(0x7f1dbc13f750 legacy=0x7f1dbc141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 1 monclient: found mon.noname-b 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 1 -- 172.21.15.181:0/860114416 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dbc0a48e0 con 0x7f1dbc0a8340 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 10 monclient: _finish_auth 0 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 1 -- 172.21.15.181:0/860114416 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1da4001b30 con 0x7f1dbc0a8340 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 10 monclient: dump: 2024-09-13T10:30:30.827 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.828 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 1 -- 172.21.15.181:0/860114416 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1da4003610 con 0x7f1dbc0a8340 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 1 -- 172.21.15.181:0/860114416 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1da4001b30 con 0x7f1dbc0a8340 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dbaffd640 10 monclient: dump: 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.829 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dc2775640 5 monclient: authenticate success, global_id 4439 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dc2775640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:30.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.824+0000 7f1dc2775640 4 set_mon_vals no callback set 2024-09-13T10:30:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.825+0000 7f1dc2775640 10 monclient: shutdown 2024-09-13T10:30:30.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.825+0000 7f1dc2775640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.825+0000 7f1dc2775640 1 -- 172.21.15.181:0/860114416 >> v1:172.21.15.181:6790/0 conn(0x7f1dbc0a8340 legacy=0x7f1dbc139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.826+0000 7f1dc2775640 1 -- 172.21.15.181:0/860114416 shutdown_connections 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.826+0000 7f1dc2775640 1 -- 172.21.15.181:0/860114416 >> 172.21.15.181:0/860114416 conn(0x7f1dbc077170 msgr2=0x7f1dbc0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.826+0000 7f1dc2775640 1 -- 172.21.15.181:0/860114416 shutdown_connections 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.826+0000 7f1dc2775640 1 -- 172.21.15.181:0/860114416 wait complete. 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.827+0000 7f1dc2775640 10 monclient: build_initial_monmap 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.827+0000 7f1dc2775640 10 monclient: monmap: 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:30.837 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.827+0000 7f1dc2775640 1 Processor -- start 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.827+0000 7f1dc2775640 1 -- start start 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.827+0000 7f1dc2775640 10 monclient: init 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dc2775640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:30.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dc2775640 10 monclient: _add_conns ranks=[0,6,7,4,2,1,8,3,5] 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dc2775640 10 monclient(hunting): picked mon.noname-a con 0x7f1dbc0a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dc2775640 10 monclient(hunting): picked mon.noname-d con 0x7f1dbc13f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dc2775640 10 monclient(hunting): picked mon.noname-i con 0x7f1dbc139dd0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dc2775640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dbc13eb20 con 0x7f1dbc0a8340 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dc2775640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dbc0a1500 con 0x7f1dbc13f750 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dc2775640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dbc13e720 con 0x7f1dbc139dd0 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dc2775640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dc2775640 10 monclient(hunting): authenticate will time out at 770.333413s 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dbb7fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f1dbc13f750 0x7f1dbc09e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45692/0 (socket says 172.21.15.181:45692) 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dbb7fe640 1 -- 172.21.15.181:0/1343948833 learned_addr learned my addr 172.21.15.181:0/1343948833 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.828+0000 7f1dbbfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1dbc0a8340 0x7f1dbc09de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50844/0 (socket says 172.21.15.181:50844) 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1dbbfff640 1 -- 172.21.15.181:0/1343948833 >> v1:172.21.15.181:6789/0 conn(0x7f1dbc0a8340 legacy=0x7f1dbc09de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1dbb7fe640 1 -- 172.21.15.181:0/1343948833 >> v1:172.21.15.181:6792/0 conn(0x7f1dbc13f750 legacy=0x7f1dbc09e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1dc0d12640 1 -- 172.21.15.181:0/1343948833 >> v1:172.21.15.195:6792/0 conn(0x7f1dbc139dd0 legacy=0x7f1dbc1d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1541024045 0 0) 0x7f1dbc0a8100 con 0x7f1dbc0a8340 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1db8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1db8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1db8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1db8ff9640 10 monclient(hunting): my global_id is 54297 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d9c003520 con 0x7f1dbc0a8340 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1308304123 0 0) 0x7f1dbc0a1500 con 0x7f1dbc13f750 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1db8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1db8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1db8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1db8ff9640 10 monclient(hunting): my global_id is 4371 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.830+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dbc0a8100 con 0x7f1dbc13f750 2024-09-13T10:30:30.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076428207 0 0) 0x7f1dbc13e720 con 0x7f1dbc139dd0 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient(hunting): my global_id is 54412 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dbc0a1500 con 0x7f1dbc139dd0 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1449411595 0 0) 0x7f1dbc0a8100 con 0x7f1dbc13f750 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1dbc13e720 con 0x7f1dbc13f750 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2712990251 0 0) 0x7f1d9c003520 con 0x7f1dbc0a8340 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1dbc0a8100 con 0x7f1dbc0a8340 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1da4003ca0 con 0x7f1dbc13f750 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient(hunting): dump: 2024-09-13T10:30:30.841 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.842 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1dac001c40 con 0x7f1dbc0a8340 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient(hunting): dump: 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.843 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2279375464 0 0) 0x7f1dbc13e720 con 0x7f1dbc13f750 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 >> v1:172.21.15.195:6792/0 conn(0x7f1dbc139dd0 legacy=0x7f1dbc1d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 >> v1:172.21.15.181:6789/0 conn(0x7f1dbc0a8340 legacy=0x7f1dbc09de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 monclient: found mon.d 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:30.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dbc09f740 con 0x7f1dbc13f750 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient: _finish_auth 0 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1dc2775640 5 monclient: authenticate success, global_id 4371 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1dc2775640 10 monclient: _renew_subs 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1dc2775640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1dc2775640 1 -- 172.21.15.181:0/1343948833 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1dbc09ec80 con 0x7f1dbc13f750 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1dc2775640 10 monclient: _renew_subs 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1dc2775640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1dc2775640 1 -- 172.21.15.181:0/1343948833 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f1dbc0a25b0 con 0x7f1dbc13f750 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1da4001350 con 0x7f1dbc13f750 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:30.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1da4003610 con 0x7f1dbc13f750 2024-09-13T10:30:30.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:30.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1dba7fc640 4 set_mon_vals no callback set 2024-09-13T10:30:30.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:30.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.831+0000 7f1db8ff9640 10 monclient: dump: 2024-09-13T10:30:30.846 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:30.846 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:30.846 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.846 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:30.846 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:30.846 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:30.846 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:30.846 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.832+0000 7f1dc2775640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.832+0000 7f1dc2775640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.832+0000 7f1dc2775640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.832+0000 7f1dc2775640 1 -- 172.21.15.181:0/1343948833 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da0005080 con 0x7f1dbc13f750 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.832+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1da4011ca0 con 0x7f1dbc13f750 2024-09-13T10:30:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.833+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 1150789242 0 0) 0x7f1da404e260 con 0x7f1dbc13f750 2024-09-13T10:30:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.833+0000 7f1dbbfff640 10 monclient: get_auth_request con 0x7f1d9c040040 auth_method 0 2024-09-13T10:30:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.838+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f1da4017860 con 0x7f1dbc13f750 2024-09-13T10:30:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.838+0000 7f1db8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:30.838+0000 7f1db8ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:31.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.009+0000 7f1dc2775640 1 -- 172.21.15.181:0/1343948833 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1da0000b90 con 0x7f1d9c040040 2024-09-13T10:30:31.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.011+0000 7f1db8ff9640 1 -- 172.21.15.181:0/1343948833 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34100 (unknown 2965378022 0 3969577617) 0x7f1da0000b90 con 0x7f1d9c040040 2024-09-13T10:30:31.013 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:30:31.013 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-13T10:30:31.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.013+0000 7f1dc2775640 1 -- 172.21.15.181:0/1343948833 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1d9c040040 legacy=0x7f1d9c042500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.013+0000 7f1dc2775640 10 monclient: shutdown 2024-09-13T10:30:31.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.013+0000 7f1dc2775640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:31.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.013+0000 7f1dc2775640 1 -- 172.21.15.181:0/1343948833 >> v1:172.21.15.181:6792/0 conn(0x7f1dbc13f750 legacy=0x7f1dbc09e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.013+0000 7f1dc2775640 1 -- 172.21.15.181:0/1343948833 shutdown_connections 2024-09-13T10:30:31.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.013+0000 7f1dc2775640 1 -- 172.21.15.181:0/1343948833 >> 172.21.15.181:0/1343948833 conn(0x7f1dbc0a6640 msgr2=0x7f1dbc073670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:31.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.013+0000 7f1dc2775640 1 -- 172.21.15.181:0/1343948833 shutdown_connections 2024-09-13T10:30:31.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.013+0000 7f1dc2775640 1 -- 172.21.15.181:0/1343948833 wait complete. 2024-09-13T10:30:31.025 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-13T10:30:30.576632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":172640,"kb_used_data":2176,"kb_used_omap":9,"kb_used_meta":170358,"kb_avail":566058400,"statfs":{"total":579820584960,"available":579643801600,"internally_reserved":0,"allocated":2228224,"data_stored":1511608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":174447264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.751239"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.839306+0000","last_change":"2024-09-13T10:30:24.839549+0000","last_active":"2024-09-13T10:30:24.839306+0000","last_peered":"2024-09-13T10:30:24.839306+0000","last_clean":"2024-09-13T10:30:24.839306+0000","last_became_active":"2024-09-13T10:30:22.828862+0000","last_became_peered":"2024-09-13T10:30:22.828862+0000","last_unstale":"2024-09-13T10:30:24.839306+0000","last_undegraded":"2024-09-13T10:30:24.839306+0000","last_fullsized":"2024-09-13T10:30:24.839306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:07.535710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013355629999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.833762+0000","last_change":"2024-09-13T10:30:24.834024+0000","last_active":"2024-09-13T10:30:24.833762+0000","last_peered":"2024-09-13T10:30:24.833762+0000","last_clean":"2024-09-13T10:30:24.833762+0000","last_became_active":"2024-09-13T10:30:22.822788+0000","last_became_peered":"2024-09-13T10:30:22.822788+0000","last_unstale":"2024-09-13T10:30:24.833762+0000","last_undegraded":"2024-09-13T10:30:24.833762+0000","last_fullsized":"2024-09-13T10:30:24.833762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:02.717016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050450899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.839057+0000","last_change":"2024-09-13T10:30:24.839303+0000","last_active":"2024-09-13T10:30:24.839057+0000","last_peered":"2024-09-13T10:30:24.839057+0000","last_clean":"2024-09-13T10:30:24.839057+0000","last_became_active":"2024-09-13T10:30:22.818560+0000","last_became_peered":"2024-09-13T10:30:22.818560+0000","last_unstale":"2024-09-13T10:30:24.839057+0000","last_undegraded":"2024-09-13T10:30:24.839057+0000","last_fullsized":"2024-09-13T10:30:24.839057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:20.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012649200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.833596+0000","last_change":"2024-09-13T10:30:24.833843+0000","last_active":"2024-09-13T10:30:24.833596+0000","last_peered":"2024-09-13T10:30:24.833596+0000","last_clean":"2024-09-13T10:30:24.833596+0000","last_became_active":"2024-09-13T10:30:22.816554+0000","last_became_peered":"2024-09-13T10:30:22.816554+0000","last_unstale":"2024-09-13T10:30:24.833596+0000","last_undegraded":"2024-09-13T10:30:24.833596+0000","last_fullsized":"2024-09-13T10:30:24.833596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:55.701606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066494999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.845556+0000","last_change":"2024-09-13T10:30:24.845556+0000","last_active":"2024-09-13T10:30:24.845556+0000","last_peered":"2024-09-13T10:30:24.845556+0000","last_clean":"2024-09-13T10:30:24.845556+0000","last_became_active":"2024-09-13T10:30:22.821223+0000","last_became_peered":"2024-09-13T10:30:22.821223+0000","last_unstale":"2024-09-13T10:30:24.845556+0000","last_undegraded":"2024-09-13T10:30:24.845556+0000","last_fullsized":"2024-09-13T10:30:24.845556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:43.560455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036258549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.833593+0000","last_change":"2024-09-13T10:30:24.833851+0000","last_active":"2024-09-13T10:30:24.833593+0000","last_peered":"2024-09-13T10:30:24.833593+0000","last_clean":"2024-09-13T10:30:24.833593+0000","last_became_active":"2024-09-13T10:30:22.816447+0000","last_became_peered":"2024-09-13T10:30:22.816447+0000","last_unstale":"2024-09-13T10:30:24.833593+0000","last_undegraded":"2024-09-13T10:30:24.833593+0000","last_fullsized":"2024-09-13T10:30:24.833593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:43.342134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084575600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.838233+0000","last_change":"2024-09-13T10:30:24.838514+0000","last_active":"2024-09-13T10:30:24.838233+0000","last_peered":"2024-09-13T10:30:24.838233+0000","last_clean":"2024-09-13T10:30:24.838233+0000","last_became_active":"2024-09-13T10:30:22.822750+0000","last_became_peered":"2024-09-13T10:30:22.822750+0000","last_unstale":"2024-09-13T10:30:24.838233+0000","last_undegraded":"2024-09-13T10:30:24.838233+0000","last_fullsized":"2024-09-13T10:30:24.838233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:13.913264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062120600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.838999+0000","last_change":"2024-09-13T10:30:24.839249+0000","last_active":"2024-09-13T10:30:24.838999+0000","last_peered":"2024-09-13T10:30:24.838999+0000","last_clean":"2024-09-13T10:30:24.838999+0000","last_became_active":"2024-09-13T10:30:22.820901+0000","last_became_peered":"2024-09-13T10:30:22.820901+0000","last_unstale":"2024-09-13T10:30:24.838999+0000","last_undegraded":"2024-09-13T10:30:24.838999+0000","last_fullsized":"2024-09-13T10:30:24.838999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:36.190102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001249939,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T10:30:24.838372+0000","last_change":"2024-09-13T10:30:15.731747+0000","last_active":"2024-09-13T10:30:24.838372+0000","last_peered":"2024-09-13T10:30:24.838372+0000","last_clean":"2024-09-13T10:30:24.838372+0000","last_became_active":"2024-09-13T10:30:15.730748+0000","last_became_peered":"2024-09-13T10:30:15.730748+0000","last_unstale":"2024-09-13T10:30:24.838372+0000","last_undegraded":"2024-09-13T10:30:24.838372+0000","last_fullsized":"2024-09-13T10:30:24.838372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_clean_scrub_stamp":"2024-09-13T10:30:14.708874+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:14.488037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":172032,"data_stored":55139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":55139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":645507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607559,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":765952,"data_stored":645507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640262,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":176128,"data_stored":55158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607557,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":176128,"data_stored":55158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T10:30:31.026 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-09-13T10:30:31.026 DEBUG:tasks.mon_thrash:Yielding 2024-09-13T10:30:31.026 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T10:30:31.042 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T10:30:31.042 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T10:30:31.042 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:30:31.042 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-09-13T10:30:31.043 INFO:tasks.mon_thrash.mon_thrasher:seed: 1726223431, revive delay: 20.0, thrash delay: 1.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-09-13T10:30:31.043 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:30:31.043 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:30:31.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.138+0000 7f820ef2c640 10 monclient: get_monmap_and_config 2024-09-13T10:30:31.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.138+0000 7f820ef2c640 10 monclient: build_initial_monmap 2024-09-13T10:30:31.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.138+0000 7f820ef2c640 10 monclient: monmap: 2024-09-13T10:30:31.140 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:31.140 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.140 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:31.139229+0000 2024-09-13T10:30:31.140 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:31.139229+0000 2024-09-13T10:30:31.140 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:31.140 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.141 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:31.141 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:31.141 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:31.141 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:31.141 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:31.141 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:31.141 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:31.141 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:31.141 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:31.141 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 1 Processor -- start 2024-09-13T10:30:31.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 1 -- start start 2024-09-13T10:30:31.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 10 monclient: init 2024-09-13T10:30:31.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:31.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 10 monclient: _add_conns ranks=[8,5,6,2,0,1,7,3,4] 2024-09-13T10:30:31.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 10 monclient(hunting): picked mon.noname-e con 0x7f82080a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:31.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 10 monclient(hunting): picked mon.noname-h con 0x7f82080a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:31.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 10 monclient(hunting): picked mon.noname-d con 0x7f820813f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:31.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82080a4bc0 con 0x7f82080a8340 2024-09-13T10:30:31.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f820813a320 con 0x7f820813f750 2024-09-13T10:30:31.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82080a8100 con 0x7f82080a6640 2024-09-13T10:30:31.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:31.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ef2c640 10 monclient(hunting): authenticate will time out at 770.644871s 2024-09-13T10:30:31.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ccc8640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f82080a6640 0x7f8208139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39944/0 (socket says 172.21.15.181:39944) 2024-09-13T10:30:31.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.139+0000 7f820ccc8640 1 -- 172.21.15.181:0/1277670498 learned_addr learned my addr 172.21.15.181:0/1277670498 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:31.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.142+0000 7f820ccc8640 1 -- 172.21.15.181:0/1277670498 >> v1:172.21.15.181:6793/0 conn(0x7f82080a6640 legacy=0x7f8208139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.142+0000 7f820d4c9640 1 -- 172.21.15.181:0/1277670498 >> v1:172.21.15.181:6792/0 conn(0x7f820813f750 legacy=0x7f8208141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.142+0000 7f8207fff640 1 -- 172.21.15.181:0/1277670498 >> v1:172.21.15.195:6791/0 conn(0x7f82080a8340 legacy=0x7f8208139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029730406 0 0) 0x7f82080a8100 con 0x7f82080a6640 2024-09-13T10:30:31.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 10 monclient(hunting): my global_id is 4445 2024-09-13T10:30:31.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81f8003520 con 0x7f82080a6640 2024-09-13T10:30:31.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326158375 0 0) 0x7f820813a320 con 0x7f820813f750 2024-09-13T10:30:31.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 10 monclient(hunting): my global_id is 4389 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82080a8100 con 0x7f820813f750 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1761203554 0 0) 0x7f82080a4bc0 con 0x7f82080a8340 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 10 monclient(hunting): my global_id is 4433 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.399+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f820813a320 con 0x7f82080a8340 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3458290738 0 0) 0x7f82080a8100 con 0x7f820813f750 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 >> v1:172.21.15.181:6793/0 conn(0x7f82080a6640 legacy=0x7f8208139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 >> v1:172.21.15.195:6791/0 conn(0x7f82080a8340 legacy=0x7f8208139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 1 monclient: found mon.noname-d 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82080a48e0 con 0x7f820813f750 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 10 monclient: _finish_auth 0 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8200001e90 con 0x7f820813f750 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 10 monclient: dump: 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.405 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.406 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f820ef2c640 5 monclient: authenticate success, global_id 4389 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f820ef2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8200003990 con 0x7f820813f750 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 1 -- 172.21.15.181:0/1277670498 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8200003f00 con 0x7f820813f750 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f820ef2c640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f820ef2c640 4 set_mon_vals no callback set 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.400+0000 7f82077fe640 10 monclient: dump: 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.407 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.401+0000 7f820ef2c640 10 monclient: shutdown 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.401+0000 7f820ef2c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.401+0000 7f820ef2c640 1 -- 172.21.15.181:0/1277670498 >> v1:172.21.15.181:6792/0 conn(0x7f820813f750 legacy=0x7f8208141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.401+0000 7f820ef2c640 1 -- 172.21.15.181:0/1277670498 shutdown_connections 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.401+0000 7f820ef2c640 1 -- 172.21.15.181:0/1277670498 >> 172.21.15.181:0/1277670498 conn(0x7f8208077170 msgr2=0x7f82080abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.401+0000 7f820ef2c640 1 -- 172.21.15.181:0/1277670498 shutdown_connections 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.401+0000 7f820ef2c640 1 -- 172.21.15.181:0/1277670498 wait complete. 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.402+0000 7f820ef2c640 10 monclient: build_initial_monmap 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.402+0000 7f820ef2c640 10 monclient: monmap: 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:31.409 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:31.410 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:31.410 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:31.410 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:31.410 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:31.410 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:31.410 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:31.410 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:31.410 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:31.410 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:31.410 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:31.410 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.402+0000 7f820ef2c640 1 Processor -- start 2024-09-13T10:30:31.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.402+0000 7f820ef2c640 1 -- start start 2024-09-13T10:30:31.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.402+0000 7f820ef2c640 10 monclient: init 2024-09-13T10:30:31.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f820ef2c640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:31.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f820ef2c640 10 monclient: _add_conns ranks=[5,7,1,4,2,3,8,0,6] 2024-09-13T10:30:31.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f820ef2c640 10 monclient(hunting): picked mon.noname-h con 0x7f82080a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:31.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f820ef2c640 10 monclient(hunting): picked mon.noname-i con 0x7f820813f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:31.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f820ef2c640 10 monclient(hunting): picked mon.noname-f con 0x7f82080a18d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:31.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f820ef2c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8208142e40 con 0x7f82080a18d0 2024-09-13T10:30:31.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f820ef2c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82080a11d0 con 0x7f82080a8340 2024-09-13T10:30:31.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f820ef2c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82080a14b0 con 0x7f820813f750 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f820ef2c640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f820ef2c640 10 monclient(hunting): authenticate will time out at 770.908153s 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f8207fff640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f820813f750 0x7f8208138c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:50280/0 (socket says 172.21.15.181:50280) 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f820d4c9640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f82080a18d0 0x7f82081d6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:35440/0 (socket says 172.21.15.181:35440) 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.403+0000 7f8207fff640 1 -- 172.21.15.181:0/3842208836 learned_addr learned my addr 172.21.15.181:0/3842208836 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f8207fff640 1 -- 172.21.15.181:0/3842208836 >> v1:172.21.15.195:6792/0 conn(0x7f820813f750 legacy=0x7f8208138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f820d4c9640 1 -- 172.21.15.181:0/3842208836 >> v1:172.21.15.195:6789/0 conn(0x7f82080a18d0 legacy=0x7f82081d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f820ccc8640 1 -- 172.21.15.181:0/3842208836 >> v1:172.21.15.195:6791/0 conn(0x7f82080a8340 legacy=0x7f82081384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3414145198 0 0) 0x7f82080a14b0 con 0x7f820813f750 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): my global_id is 54439 2024-09-13T10:30:31.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81ec003550 con 0x7f820813f750 2024-09-13T10:30:31.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043031770 0 0) 0x7f82080a48e0 con 0x7f82080a18d0 2024-09-13T10:30:31.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): my global_id is 54424 2024-09-13T10:30:31.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82080a14b0 con 0x7f82080a18d0 2024-09-13T10:30:31.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415279439 0 0) 0x7f82080a11d0 con 0x7f82080a8340 2024-09-13T10:30:31.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): my global_id is 4442 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82080a48e0 con 0x7f82080a8340 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2673525730 0 0) 0x7f82080a14b0 con 0x7f82080a18d0 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82080a11d0 con 0x7f82080a18d0 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3413216753 0 0) 0x7f82080a48e0 con 0x7f82080a8340 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82080a14b0 con 0x7f82080a8340 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 636848821 0 0) 0x7f81ec003550 con 0x7f820813f750 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82080a48e0 con 0x7f820813f750 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8200003e80 con 0x7f82080a18d0 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.405+0000 7f82057fa640 10 monclient(hunting): dump: 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.418 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f81fc0047e0 con 0x7f82080a8340 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient(hunting): dump: 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.420 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f81f4003610 con 0x7f820813f750 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient(hunting): dump: 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.421 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1052529286 0 0) 0x7f82080a14b0 con 0x7f82080a8340 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 >> v1:172.21.15.195:6792/0 conn(0x7f820813f750 legacy=0x7f8208138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 >> v1:172.21.15.195:6789/0 conn(0x7f82080a18d0 legacy=0x7f82081d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient: _finish_hunting 0 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 1 monclient: found mon.h 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8208139310 con 0x7f82080a8340 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient: _finish_auth 0 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient: _check_auth_tickets 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f820ef2c640 5 monclient: authenticate success, global_id 4442 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f820ef2c640 10 monclient: _renew_subs 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f820ef2c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:31.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f820ef2c640 1 -- 172.21.15.181:0/3842208836 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f82080a1d80 con 0x7f82080a8340 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f820ef2c640 10 monclient: _renew_subs 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f820ef2c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f820ef2c640 1 -- 172.21.15.181:0/3842208836 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f820809f150 con 0x7f82080a8340 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f81fc004c30 con 0x7f82080a8340 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f81fc005120 con 0x7f82080a8340 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f82057fa640 10 monclient: dump: 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.424 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.406+0000 7f8206ffd640 4 set_mon_vals no callback set 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.407+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f81fc0117a0 con 0x7f82080a8340 2024-09-13T10:30:31.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.407+0000 7f820ef2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:31.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.407+0000 7f820ef2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:31.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.407+0000 7f820ef2c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:31.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.407+0000 7f820ef2c640 1 -- 172.21.15.181:0/3842208836 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e8005080 con 0x7f82080a8340 2024-09-13T10:30:31.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.407+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 1150789242 0 0) 0x7f81fc04e020 con 0x7f82080a8340 2024-09-13T10:30:31.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.407+0000 7f8207fff640 10 monclient: get_auth_request con 0x7f81ec040610 auth_method 0 2024-09-13T10:30:31.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.411+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.5 v1:172.21.15.195:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f81fc017620 con 0x7f82080a8340 2024-09-13T10:30:31.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.411+0000 7f82057fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:31.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.411+0000 7f82057fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:31.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.654+0000 7f820ef2c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:30:31.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.654+0000 7f820ef2c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:30:31.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.654+0000 7f820ef2c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:30:31.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.654+0000 7f820ef2c640 1 -- 172.21.15.181:0/3842208836 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f81e8005370 con 0x7f82080a8340 2024-09-13T10:30:31.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.655+0000 7f82057fa640 1 -- 172.21.15.181:0/3842208836 <== mon.5 v1:172.21.15.195:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 2797251855) 0x7f81fc016f20 con 0x7f82080a8340 2024-09-13T10:30:31.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.655+0000 7f82057fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:30:31.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.655+0000 7f82057fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:31.657 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":22,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":29,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:30:31.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.658+0000 7f820ef2c640 1 -- 172.21.15.181:0/3842208836 >> v1:172.21.15.195:6800/1839191919 conn(0x7f81ec040610 legacy=0x7f81ec042ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.658+0000 7f820ef2c640 10 monclient: shutdown 2024-09-13T10:30:31.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.658+0000 7f820ef2c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:31.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.658+0000 7f820ef2c640 1 -- 172.21.15.181:0/3842208836 >> v1:172.21.15.195:6791/0 conn(0x7f82080a8340 legacy=0x7f82081384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.658+0000 7f820ef2c640 1 -- 172.21.15.181:0/3842208836 shutdown_connections 2024-09-13T10:30:31.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.658+0000 7f820ef2c640 1 -- 172.21.15.181:0/3842208836 >> 172.21.15.181:0/3842208836 conn(0x7f82080a6640 msgr2=0x7f8208141ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:31.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.658+0000 7f820ef2c640 1 -- 172.21.15.181:0/3842208836 shutdown_connections 2024-09-13T10:30:31.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.658+0000 7f820ef2c640 1 -- 172.21.15.181:0/3842208836 wait complete. 2024-09-13T10:30:31.670 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:30:31.671 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T10:30:31.671 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:30:31.671 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:30:31.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.767+0000 7fb5e7b6c640 10 monclient: get_monmap_and_config 2024-09-13T10:30:31.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.767+0000 7fb5e7b6c640 10 monclient: build_initial_monmap 2024-09-13T10:30:31.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.767+0000 7fb5e7b6c640 10 monclient: monmap: 2024-09-13T10:30:31.769 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:31.769 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.770 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:31.768500+0000 2024-09-13T10:30:31.770 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:31.768500+0000 2024-09-13T10:30:31.770 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:31.770 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.770 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:31.770 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:31.770 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:31.770 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:31.770 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:31.770 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:31.770 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:31.771 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:31.771 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:31.771 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.768+0000 7fb5e7b6c640 1 Processor -- start 2024-09-13T10:30:31.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.768+0000 7fb5e7b6c640 1 -- start start 2024-09-13T10:30:31.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.768+0000 7fb5e7b6c640 10 monclient: init 2024-09-13T10:30:31.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.769+0000 7fb5e7b6c640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:31.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.769+0000 7fb5e7b6c640 10 monclient: _add_conns ranks=[8,5,1,4,7,6,2,0,3] 2024-09-13T10:30:31.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.769+0000 7fb5e7b6c640 10 monclient(hunting): picked mon.noname-e con 0x7fb5e00a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:31.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.769+0000 7fb5e7b6c640 10 monclient(hunting): picked mon.noname-h con 0x7fb5e00a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:31.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.769+0000 7fb5e7b6c640 10 monclient(hunting): picked mon.noname-f con 0x7fb5e013f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:31.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.769+0000 7fb5e7b6c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e00a4bc0 con 0x7fb5e013f750 2024-09-13T10:30:31.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.769+0000 7fb5e7b6c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e013a320 con 0x7fb5e00a8340 2024-09-13T10:30:31.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.769+0000 7fb5e7b6c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e00a8100 con 0x7fb5e00a6640 2024-09-13T10:30:31.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.769+0000 7fb5e7b6c640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:31.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.769+0000 7fb5e7b6c640 10 monclient(hunting): authenticate will time out at 771.274265s 2024-09-13T10:30:31.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.769+0000 7fb5e5908640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fb5e00a6640 0x7fb5e0139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39948/0 (socket says 172.21.15.181:39948) 2024-09-13T10:30:31.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.769+0000 7fb5e5908640 1 -- 172.21.15.181:0/2479792823 learned_addr learned my addr 172.21.15.181:0/2479792823 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:31.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.771+0000 7fb5e5908640 1 -- 172.21.15.181:0/2479792823 >> v1:172.21.15.181:6793/0 conn(0x7fb5e00a6640 legacy=0x7fb5e0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.771+0000 7fb5e6109640 1 -- 172.21.15.181:0/2479792823 >> v1:172.21.15.195:6789/0 conn(0x7fb5e013f750 legacy=0x7fb5e0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.771+0000 7fb5e5107640 1 -- 172.21.15.181:0/2479792823 >> v1:172.21.15.195:6791/0 conn(0x7fb5e00a8340 legacy=0x7fb5e0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.771+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608922369 0 0) 0x7fb5e00a8100 con 0x7fb5e00a6640 2024-09-13T10:30:31.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient(hunting): my global_id is 4454 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5cc003520 con 0x7fb5e00a6640 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321805538 0 0) 0x7fb5e00a4bc0 con 0x7fb5e013f750 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient(hunting): my global_id is 54433 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e00a8100 con 0x7fb5e013f750 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454498434 0 0) 0x7fb5e013a320 con 0x7fb5e00a8340 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient(hunting): my global_id is 4451 2024-09-13T10:30:31.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e00a4bc0 con 0x7fb5e00a8340 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3100317368 0 0) 0x7fb5cc003520 con 0x7fb5e00a6640 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 >> v1:172.21.15.195:6791/0 conn(0x7fb5e00a8340 legacy=0x7fb5e0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 >> v1:172.21.15.195:6789/0 conn(0x7fb5e013f750 legacy=0x7fb5e0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient: _finish_hunting 0 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 monclient: found mon.noname-e 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e00a48e0 con 0x7fb5e00a6640 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient: _finish_auth 0 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient: _check_auth_tickets 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e7b6c640 5 monclient: authenticate success, global_id 4454 2024-09-13T10:30:31.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb5dc001ae0 con 0x7fb5e00a6640 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e7b6c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient: dump: 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.785 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e7b6c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5dc0048a0 con 0x7fb5e00a6640 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e7b6c640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 1 -- 172.21.15.181:0/2479792823 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb5dc004e10 con 0x7fb5e00a6640 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e7b6c640 4 set_mon_vals no callback set 2024-09-13T10:30:31.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:31.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e4906640 10 monclient: dump: 2024-09-13T10:30:31.787 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.787 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.787 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.788 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.788 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.788 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.788 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.788 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.788 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.788 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.788 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.788 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.789 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.789 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.789 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.789 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e7b6c640 10 monclient: shutdown 2024-09-13T10:30:31.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e7b6c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:31.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/2479792823 >> v1:172.21.15.181:6793/0 conn(0x7fb5e00a6640 legacy=0x7fb5e0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/2479792823 shutdown_connections 2024-09-13T10:30:31.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.772+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/2479792823 >> 172.21.15.181:0/2479792823 conn(0x7fb5e0077170 msgr2=0x7fb5e00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:31.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.773+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/2479792823 shutdown_connections 2024-09-13T10:30:31.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.773+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/2479792823 wait complete. 2024-09-13T10:30:31.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.773+0000 7fb5e7b6c640 10 monclient: build_initial_monmap 2024-09-13T10:30:31.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.773+0000 7fb5e7b6c640 10 monclient: monmap: 2024-09-13T10:30:31.790 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:31.790 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:31.790 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:31.790 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:31.790 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:31.790 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:31.791 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:31.791 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:31.791 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:31.791 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:31.791 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:31.791 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:31.791 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:31.791 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:31.792 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:31.792 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.773+0000 7fb5e7b6c640 1 Processor -- start 2024-09-13T10:30:31.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.773+0000 7fb5e7b6c640 1 -- start start 2024-09-13T10:30:31.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.773+0000 7fb5e7b6c640 10 monclient: init 2024-09-13T10:30:31.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.774+0000 7fb5e7b6c640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.774+0000 7fb5e7b6c640 10 monclient: _add_conns ranks=[8,6,1,0,2,5,3,4,7] 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.774+0000 7fb5e7b6c640 10 monclient(hunting): picked mon.noname-e con 0x7fb5e00a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.774+0000 7fb5e7b6c640 10 monclient(hunting): picked mon.noname-d con 0x7fb5e013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.774+0000 7fb5e7b6c640 10 monclient(hunting): picked mon.noname-f con 0x7fb5e01422f0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.774+0000 7fb5e7b6c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e00a9c40 con 0x7fb5e01422f0 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.774+0000 7fb5e7b6c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e013bc90 con 0x7fb5e013f750 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.774+0000 7fb5e7b6c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e013c7f0 con 0x7fb5e00a8340 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.774+0000 7fb5e7b6c640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.774+0000 7fb5e7b6c640 10 monclient(hunting): authenticate will time out at 771.279422s 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.774+0000 7fb5e5908640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fb5e00a8340 0x7fb5e012c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39956/0 (socket says 172.21.15.181:39956) 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.774+0000 7fb5e5908640 1 -- 172.21.15.181:0/3577205617 learned_addr learned my addr 172.21.15.181:0/3577205617 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5e5908640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.181:6793/0 conn(0x7fb5e00a8340 legacy=0x7fb5e012c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5e5107640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.181:6792/0 conn(0x7fb5e013f750 legacy=0x7fb5e01d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3253636512 0 0) 0x7fb5e013c7f0 con 0x7fb5e00a8340 2024-09-13T10:30:31.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 10 monclient(hunting): my global_id is 4463 2024-09-13T10:30:31.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5c4003550 con 0x7fb5e00a8340 2024-09-13T10:30:31.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3740435564 0 0) 0x7fb5e013bc90 con 0x7fb5e013f750 2024-09-13T10:30:31.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 10 monclient(hunting): my global_id is 4398 2024-09-13T10:30:31.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5e6109640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.195:6789/0 conn(0x7fb5e01422f0 legacy=0x7fb5e01d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e013c7f0 con 0x7fb5e013f750 2024-09-13T10:30:31.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1845265626 0 0) 0x7fb5c4003550 con 0x7fb5e00a8340 2024-09-13T10:30:31.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5e013bc90 con 0x7fb5e00a8340 2024-09-13T10:30:31.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb5dc004d90 con 0x7fb5e00a8340 2024-09-13T10:30:31.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.776+0000 7fb5d67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:31.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:31.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient(hunting): dump: 2024-09-13T10:30:31.795 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.795 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.795 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.795 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.795 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.796 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.796 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.796 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.796 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.796 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.796 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.796 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.796 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.796 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.796 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.796 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3066517546 0 0) 0x7fb5e013c7f0 con 0x7fb5e013f750 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5c4003550 con 0x7fb5e013f750 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb5d0001c80 con 0x7fb5e013f750 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient(hunting): dump: 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.797 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065721710 0 0) 0x7fb5e00a9c40 con 0x7fb5e01422f0 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient(hunting): my global_id is 54442 2024-09-13T10:30:31.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e013c7f0 con 0x7fb5e01422f0 2024-09-13T10:30:31.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3660916634 0 0) 0x7fb5e013bc90 con 0x7fb5e00a8340 2024-09-13T10:30:31.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.181:6792/0 conn(0x7fb5e013f750 legacy=0x7fb5e01d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.195:6789/0 conn(0x7fb5e01422f0 legacy=0x7fb5e01d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:31.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 1 monclient: found mon.e 2024-09-13T10:30:31.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:31.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:31.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e00aa0a0 con 0x7fb5e00a8340 2024-09-13T10:30:31.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:31.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:31.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:31.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5e7b6c640 5 monclient: authenticate success, global_id 4463 2024-09-13T10:30:31.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5e7b6c640 10 monclient: _renew_subs 2024-09-13T10:30:31.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5e7b6c640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:31.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e013a4a0 con 0x7fb5e00a8340 2024-09-13T10:30:31.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5e7b6c640 10 monclient: _renew_subs 2024-09-13T10:30:31.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5e7b6c640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:31.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fb5e012cfc0 con 0x7fb5e00a8340 2024-09-13T10:30:31.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5dc001d30 con 0x7fb5e00a8340 2024-09-13T10:30:31.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:31.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb5dc001a80 con 0x7fb5e00a8340 2024-09-13T10:30:31.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d7fff640 4 set_mon_vals no callback set 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.777+0000 7fb5d67fc640 10 monclient: dump: 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.801 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.778+0000 7fb5e7b6c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.778+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb5c80065c0 con 0x7fb5c8002860 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.778+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb5dc011c20 con 0x7fb5e00a8340 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.778+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 1150789242 0 0) 0x7fb5dc04e150 con 0x7fb5e00a8340 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.778+0000 7fb5e6109640 10 monclient: get_auth_request con 0x7fb5c40402d0 auth_method 0 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5e5107640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.181:6789/0 conn(0x7fb5c8002860 legacy=0x7fb5c8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107596976 0 0) 0x7fb5c80065c0 con 0x7fb5c8002860 2024-09-13T10:30:31.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 10 monclient(hunting): my global_id is 54306 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e013bc90 con 0x7fb5c8002860 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3390946857 0 0) 0x7fb5e013bc90 con 0x7fb5c8002860 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5c80065c0 con 0x7fb5c8002860 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb5d0003b40 con 0x7fb5c8002860 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 10 monclient: dump: 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.803 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.804 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.804 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.804 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.804 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.804 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.804 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.804 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.804 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.804 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.804 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.805 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.805 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1032869693 0 0) 0x7fb5c80065c0 con 0x7fb5c8002860 2024-09-13T10:30:31.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.780+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5c800a160 con 0x7fb5c8002860 2024-09-13T10:30:31.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.781+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb5d0003eb0 con 0x7fb5c8002860 2024-09-13T10:30:31.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.781+0000 7fb5d67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:31.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.781+0000 7fb5d67fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:31.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.781+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.181:6789/0 conn(0x7fb5c8002860 legacy=0x7fb5c8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.781+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.181:6789/0 conn(0x7fb5c8002860 legacy=0x7fb5c8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:31.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.787+0000 7fb5e7b6c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:31.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.787+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb5c8009e50 con 0x7fb5c8009110 2024-09-13T10:30:31.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5e5107640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.181:6789/0 conn(0x7fb5c8009110 legacy=0x7fb5c80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7823597 0 0) 0x7fb5c8009e50 con 0x7fb5c8009110 2024-09-13T10:30:31.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5d67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5d67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5d67fc640 10 monclient(hunting): my global_id is 54315 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5c80065c0 con 0x7fb5c8009110 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3585932860 0 0) 0x7fb5c80065c0 con 0x7fb5c8009110 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5c8009e50 con 0x7fb5c8009110 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb5d0004420 con 0x7fb5c8009110 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5d67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.789+0000 7fb5d67fc640 10 monclient: dump: 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.808 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 725796784 0 0) 0x7fb5c8009e50 con 0x7fb5c8009110 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb5c800c3a0 con 0x7fb5c8009110 2024-09-13T10:30:31.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7728 (unknown 0 0 3380314489) 0x7fb5d0005b00 con 0x7fb5c8009110 2024-09-13T10:30:31.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5d67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:31.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5d67fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:31.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.181:6789/0 conn(0x7fb5c8009110 legacy=0x7fb5c80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5d67fc640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.181:6789/0 conn(0x7fb5c8009110 legacy=0x7fb5c80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:31.810 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:30:31.810 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 22, 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 46222, 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:31.811 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 29, 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:31.812 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:31.813 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:31.814 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:31.815 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:31.816 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.818 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:31.821 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.822 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:31.825 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.826 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.828 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:31.829 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:31.830 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:31.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb5c40402d0 legacy=0x7fb5c4042790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5e7b6c640 10 monclient: shutdown 2024-09-13T10:30:31.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5e7b6c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:31.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/3577205617 >> v1:172.21.15.181:6793/0 conn(0x7fb5e00a8340 legacy=0x7fb5e012c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5e6109640 1 -- 172.21.15.181:0/3577205617 reap_dead start 2024-09-13T10:30:31.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5e6109640 1 -- 172.21.15.181:0/3577205617 reap_dead start 2024-09-13T10:30:31.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/3577205617 shutdown_connections 2024-09-13T10:30:31.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/3577205617 >> 172.21.15.181:0/3577205617 conn(0x7fb5e00a6640 msgr2=0x7fb5e00a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:31.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/3577205617 shutdown_connections 2024-09-13T10:30:31.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.790+0000 7fb5e7b6c640 1 -- 172.21.15.181:0/3577205617 wait complete. 2024-09-13T10:30:31.833 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:30:31.833 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:30:31.833 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:30:31.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.929+0000 7f7d05cf7640 10 monclient: get_monmap_and_config 2024-09-13T10:30:31.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.929+0000 7f7d05cf7640 10 monclient: build_initial_monmap 2024-09-13T10:30:31.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.929+0000 7f7d05cf7640 10 monclient: monmap: 2024-09-13T10:30:31.931 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:31.931 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.931 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:31.930231+0000 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:31.930231+0000 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:31.932 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.930+0000 7f7d05cf7640 1 Processor -- start 2024-09-13T10:30:31.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.930+0000 7f7d05cf7640 1 -- start start 2024-09-13T10:30:31.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.930+0000 7f7d05cf7640 10 monclient: init 2024-09-13T10:30:31.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.930+0000 7f7d05cf7640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:31.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.930+0000 7f7d05cf7640 10 monclient: _add_conns ranks=[0,5,7,6,2,8,3,1,4] 2024-09-13T10:30:31.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.930+0000 7f7d05cf7640 10 monclient(hunting): picked mon.noname-a con 0x7f7d000a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:31.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.930+0000 7f7d05cf7640 10 monclient(hunting): picked mon.noname-h con 0x7f7d000a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:31.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.930+0000 7f7d05cf7640 10 monclient(hunting): picked mon.noname-i con 0x7f7d0013f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:31.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.931+0000 7f7d05cf7640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d000a4bc0 con 0x7f7d000a6640 2024-09-13T10:30:31.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.931+0000 7f7d05cf7640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d0013a320 con 0x7f7d000a8340 2024-09-13T10:30:31.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.931+0000 7f7d05cf7640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d000a8100 con 0x7f7d0013f750 2024-09-13T10:30:31.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.931+0000 7f7d05cf7640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:31.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.931+0000 7f7d05cf7640 10 monclient(hunting): authenticate will time out at 771.436057s 2024-09-13T10:30:31.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.931+0000 7f7cff7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7d000a6640 0x7f7d00139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50866/0 (socket says 172.21.15.181:50866) 2024-09-13T10:30:31.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.931+0000 7f7cff7fe640 1 -- 172.21.15.181:0/1534157194 learned_addr learned my addr 172.21.15.181:0/1534157194 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:31.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cff7fe640 1 -- 172.21.15.181:0/1534157194 >> v1:172.21.15.181:6789/0 conn(0x7f7d000a6640 legacy=0x7f7d00139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 1 -- 172.21.15.181:0/1534157194 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2824966358 0 0) 0x7f7d000a4bc0 con 0x7f7d000a6640 2024-09-13T10:30:31.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient(hunting): my global_id is 54324 2024-09-13T10:30:31.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 1 -- 172.21.15.181:0/1534157194 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce8003520 con 0x7f7d000a6640 2024-09-13T10:30:31.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfffff640 1 -- 172.21.15.181:0/1534157194 >> v1:172.21.15.195:6792/0 conn(0x7f7d0013f750 legacy=0x7f7d00141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfeffd640 1 -- 172.21.15.181:0/1534157194 >> v1:172.21.15.195:6791/0 conn(0x7f7d000a8340 legacy=0x7f7d00139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 1 -- 172.21.15.181:0/1534157194 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1688268783 0 0) 0x7f7ce8003520 con 0x7f7d000a6640 2024-09-13T10:30:31.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 1 -- 172.21.15.181:0/1534157194 >> v1:172.21.15.195:6792/0 conn(0x7f7d0013f750 legacy=0x7f7d00141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 1 -- 172.21.15.181:0/1534157194 >> v1:172.21.15.195:6791/0 conn(0x7f7d000a8340 legacy=0x7f7d00139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:31.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 1 monclient: found mon.noname-a 2024-09-13T10:30:31.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:31.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:30:31.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 1 -- 172.21.15.181:0/1534157194 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d000a48e0 con 0x7f7d000a6640 2024-09-13T10:30:31.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 1 -- 172.21.15.181:0/1534157194 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cf0001ae0 con 0x7f7d000a6640 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient: dump: 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.944 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7d05cf7640 5 monclient: authenticate success, global_id 54324 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7d05cf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 1 -- 172.21.15.181:0/1534157194 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cf00048a0 con 0x7f7d000a6640 2024-09-13T10:30:31.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 1 -- 172.21.15.181:0/1534157194 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cf0004dd0 con 0x7f7d000a6640 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7d05cf7640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7d05cf7640 4 set_mon_vals no callback set 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.933+0000 7f7cfe7fc640 10 monclient: dump: 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.946 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.934+0000 7f7d05cf7640 10 monclient: shutdown 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.934+0000 7f7d05cf7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.934+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1534157194 >> v1:172.21.15.181:6789/0 conn(0x7f7d000a6640 legacy=0x7f7d00139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.934+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1534157194 shutdown_connections 2024-09-13T10:30:31.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.934+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1534157194 >> 172.21.15.181:0/1534157194 conn(0x7f7d00077170 msgr2=0x7f7d000abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:31.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.934+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1534157194 shutdown_connections 2024-09-13T10:30:31.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.934+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1534157194 wait complete. 2024-09-13T10:30:31.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.934+0000 7f7d05cf7640 10 monclient: build_initial_monmap 2024-09-13T10:30:31.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.934+0000 7f7d05cf7640 10 monclient: monmap: 2024-09-13T10:30:31.948 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:31.948 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:31.948 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:31.948 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 1 Processor -- start 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 1 -- start start 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 10 monclient: init 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 10 monclient: _add_conns ranks=[0,8,3,6,2,1,7,4,5] 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 10 monclient(hunting): picked mon.noname-a con 0x7f7d000a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 10 monclient(hunting): picked mon.noname-e con 0x7f7d0013f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 10 monclient(hunting): picked mon.noname-g con 0x7f7d001420c0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d000a9c40 con 0x7f7d000a8340 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d00142b60 con 0x7f7d001420c0 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d0013bdb0 con 0x7f7d0013f750 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7d05cf7640 10 monclient(hunting): authenticate will time out at 771.440927s 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7cff7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7d000a8340 0x7f7d0012c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50870/0 (socket says 172.21.15.181:50870) 2024-09-13T10:30:31.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.935+0000 7f7cff7fe640 1 -- 172.21.15.181:0/1151305205 learned_addr learned my addr 172.21.15.181:0/1151305205 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7cff7fe640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.181:6789/0 conn(0x7f7d000a8340 legacy=0x7f7d0012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7cfeffd640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.181:6793/0 conn(0x7f7d0013f750 legacy=0x7f7d001d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3316900922 0 0) 0x7f7d000a9c40 con 0x7f7d000a8340 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): my global_id is 54333 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cec003550 con 0x7f7d000a8340 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 410552810 0 0) 0x7f7d0013bdb0 con 0x7f7d0013f750 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): my global_id is 4472 2024-09-13T10:30:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d000a9c40 con 0x7f7d0013f750 2024-09-13T10:30:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7cfffff640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.195:6790/0 conn(0x7f7d001420c0 legacy=0x7f7d001d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1199689075 0 0) 0x7f7cec003550 con 0x7f7d000a8340 2024-09-13T10:30:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d0013bdb0 con 0x7f7d000a8340 2024-09-13T10:30:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cf0004d90 con 0x7f7d000a8340 2024-09-13T10:30:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:30:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): dump: 2024-09-13T10:30:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.952 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.953 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 710200177 0 0) 0x7f7d000a9c40 con 0x7f7d0013f750 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cec003550 con 0x7f7d0013f750 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477162946 0 0) 0x7f7d00142b60 con 0x7f7d001420c0 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): my global_id is 4377 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d000a9c40 con 0x7f7d001420c0 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cf4003610 con 0x7f7d0013f750 2024-09-13T10:30:31.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient(hunting): dump: 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.955 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2006112935 0 0) 0x7f7d0013bdb0 con 0x7f7d000a8340 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.181:6793/0 conn(0x7f7d0013f750 legacy=0x7f7d001d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.195:6790/0 conn(0x7f7d001420c0 legacy=0x7f7d001d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 monclient: found mon.a 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:31.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0013baa0 con 0x7f7d000a8340 2024-09-13T10:30:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7d05cf7640 5 monclient: authenticate success, global_id 54333 2024-09-13T10:30:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7d05cf7640 10 monclient: _renew_subs 2024-09-13T10:30:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7d05cf7640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0013ae50 con 0x7f7d000a8340 2024-09-13T10:30:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7d05cf7640 10 monclient: _renew_subs 2024-09-13T10:30:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7d05cf7640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7d0012cff0 con 0x7f7d000a8340 2024-09-13T10:30:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cf0001d30 con 0x7f7d000a8340 2024-09-13T10:30:31.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cf0005700 con 0x7f7d000a8340 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7cfdffb640 4 set_mon_vals no callback set 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.938+0000 7f7ce7fff640 10 monclient: dump: 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.958 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.939+0000 7f7d05cf7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.939+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7ce00065c0 con 0x7f7ce0002860 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.939+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7cf0011d80 con 0x7f7d000a8340 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.940+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 1150789242 0 0) 0x7f7cf004e330 con 0x7f7d000a8340 2024-09-13T10:30:31.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.940+0000 7f7cfffff640 10 monclient: get_auth_request con 0x7f7cec040340 auth_method 0 2024-09-13T10:30:31.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.941+0000 7f7cfeffd640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.181:6790/0 conn(0x7f7ce0002860 legacy=0x7f7ce0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239671506 0 0) 0x7f7ce00065c0 con 0x7f7ce0002860 2024-09-13T10:30:31.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 10 monclient(hunting): my global_id is 4457 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d0013bdb0 con 0x7f7ce0002860 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3506359709 0 0) 0x7f7d0013bdb0 con 0x7f7ce0002860 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ce00065c0 con 0x7f7ce0002860 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cf4003e50 con 0x7f7ce0002860 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 10 monclient: dump: 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.963 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3018244368 0 0) 0x7f7ce00065c0 con 0x7f7ce0002860 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ce000a160 con 0x7f7ce0002860 2024-09-13T10:30:31.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7cf40040c0 con 0x7f7ce0002860 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.181:6790/0 conn(0x7f7ce0002860 legacy=0x7f7ce0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.942+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.181:6790/0 conn(0x7f7ce0002860 legacy=0x7f7ce0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.948+0000 7f7d05cf7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.948+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7ce0009e50 con 0x7f7ce0009110 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7cfeffd640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.181:6790/0 conn(0x7f7ce0009110 legacy=0x7f7ce00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175743314 0 0) 0x7f7ce0009e50 con 0x7f7ce0009110 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 10 monclient(hunting): my global_id is 4466 2024-09-13T10:30:31.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce00065c0 con 0x7f7ce0009110 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2297859626 0 0) 0x7f7ce00065c0 con 0x7f7ce0009110 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ce0009e50 con 0x7f7ce0009110 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cf4005b00 con 0x7f7ce0009110 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 10 monclient: dump: 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:31.966 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:31.967 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:31.967 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:31.967 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:31.967 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:31.967 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:31.967 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:31.967 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:31.967 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:31.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4191834928 0 0) 0x7f7ce0009e50 con 0x7f7ce0009110 2024-09-13T10:30:31.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.951+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7ce000c3f0 con 0x7f7ce0009110 2024-09-13T10:30:31.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7893 (unknown 0 0 3502992438) 0x7f7cf4007ee0 con 0x7f7ce0009110 2024-09-13T10:30:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7ce7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7ce7fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:31.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.181:6790/0 conn(0x7f7ce0009110 legacy=0x7f7ce00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.968 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:31.968 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:31.968 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:31.968 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:31.968 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 22, 2024-09-13T10:30:31.969 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 46397, 2024-09-13T10:30:31.969 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:31.969 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:31.969 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:31.969 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:30:31.969 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:31.969 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:31.969 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:31.969 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:31.969 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:31.969 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:31.969 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 30, 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:31.970 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:31.971 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:31.971 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:31.971 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:31.971 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:31.971 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:31.971 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:31.971 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:31.971 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:31.971 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:31.971 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:31.971 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:31.971 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:31.972 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:31.972 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:31.972 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:31.972 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:31.972 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.972 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:31.972 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:31.972 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:31.972 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:31.972 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:31.972 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:31.973 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:31.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:31.975 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.976 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.977 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:31.979 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.980 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.981 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:31.983 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.984 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:31.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.986 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:31.987 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:31.988 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:31.989 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:31.989 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:31.989 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:31.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:31.989 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:31.989 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:31.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7ce7fff640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.181:6790/0 conn(0x7f7ce0009110 legacy=0x7f7ce00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:31.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7cec040340 legacy=0x7f7cec042800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7d05cf7640 10 monclient: shutdown 2024-09-13T10:30:31.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7d05cf7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:31.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1151305205 >> v1:172.21.15.181:6789/0 conn(0x7f7d000a8340 legacy=0x7f7d0012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:31.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7cfffff640 1 -- 172.21.15.181:0/1151305205 reap_dead start 2024-09-13T10:30:31.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7cfffff640 1 -- 172.21.15.181:0/1151305205 reap_dead start 2024-09-13T10:30:31.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1151305205 shutdown_connections 2024-09-13T10:30:31.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1151305205 >> 172.21.15.181:0/1151305205 conn(0x7f7d000a6640 msgr2=0x7f7d000a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:31.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1151305205 shutdown_connections 2024-09-13T10:30:31.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:31.952+0000 7f7d05cf7640 1 -- 172.21.15.181:0/1151305205 wait complete. 2024-09-13T10:30:31.991 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:30:31.991 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:30:31.992 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:30:32.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.087+0000 7ff433abf640 10 monclient: get_monmap_and_config 2024-09-13T10:30:32.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.087+0000 7ff433abf640 10 monclient: build_initial_monmap 2024-09-13T10:30:32.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.088+0000 7ff433abf640 10 monclient: monmap: 2024-09-13T10:30:32.090 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:32.090 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.090 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:32.088602+0000 2024-09-13T10:30:32.091 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:32.088602+0000 2024-09-13T10:30:32.091 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:32.091 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.091 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:32.091 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:32.091 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:32.091 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:32.091 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:32.091 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:32.091 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:32.091 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:32.092 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:32.092 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.088+0000 7ff433abf640 1 Processor -- start 2024-09-13T10:30:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.088+0000 7ff433abf640 1 -- start start 2024-09-13T10:30:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.088+0000 7ff433abf640 10 monclient: init 2024-09-13T10:30:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.089+0000 7ff433abf640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.089+0000 7ff433abf640 10 monclient: _add_conns ranks=[1,4,3,6,2,5,8,7,0] 2024-09-13T10:30:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.089+0000 7ff433abf640 10 monclient(hunting): picked mon.noname-f con 0x7ff42c0a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.089+0000 7ff433abf640 10 monclient(hunting): picked mon.noname-c con 0x7ff42c0a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.089+0000 7ff433abf640 10 monclient(hunting): picked mon.noname-g con 0x7ff42c13f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:32.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.089+0000 7ff433abf640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c0a4bc0 con 0x7ff42c0a6640 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.089+0000 7ff433abf640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c13a320 con 0x7ff42c13f750 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.089+0000 7ff433abf640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c0a8100 con 0x7ff42c0a8340 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.089+0000 7ff433abf640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.089+0000 7ff433abf640 10 monclient(hunting): authenticate will time out at 771.594329s 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.089+0000 7ff43105a640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ff42c0a8340 0x7ff42c139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38500/0 (socket says 172.21.15.181:38500) 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.089+0000 7ff43105a640 1 -- 172.21.15.181:0/515482891 learned_addr learned my addr 172.21.15.181:0/515482891 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff43105a640 1 -- 172.21.15.181:0/515482891 >> v1:172.21.15.181:6791/0 conn(0x7ff42c0a8340 legacy=0x7ff42c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff43185b640 1 -- 172.21.15.181:0/515482891 >> v1:172.21.15.195:6789/0 conn(0x7ff42c0a6640 legacy=0x7ff42c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff43205c640 1 -- 172.21.15.181:0/515482891 >> v1:172.21.15.195:6790/0 conn(0x7ff42c13f750 legacy=0x7ff42c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345656207 0 0) 0x7ff42c0a8100 con 0x7ff42c0a8340 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient(hunting): my global_id is 4441 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff414003520 con 0x7ff42c0a8340 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076032035 0 0) 0x7ff42c0a4bc0 con 0x7ff42c0a6640 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient(hunting): my global_id is 54451 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff42c0a8100 con 0x7ff42c0a6640 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517862230 0 0) 0x7ff42c13a320 con 0x7ff42c13f750 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient(hunting): my global_id is 4386 2024-09-13T10:30:32.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff42c0a4bc0 con 0x7ff42c13f750 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1907355912 0 0) 0x7ff414003520 con 0x7ff42c0a8340 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 >> v1:172.21.15.195:6790/0 conn(0x7ff42c13f750 legacy=0x7ff42c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 >> v1:172.21.15.195:6789/0 conn(0x7ff42c0a6640 legacy=0x7ff42c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 10 monclient: _finish_hunting 0 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.091+0000 7ff430859640 1 monclient: found mon.noname-c 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c0a48e0 con 0x7ff42c0a8340 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 10 monclient: _finish_auth 0 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 10 monclient: _check_auth_tickets 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff420001e60 con 0x7ff42c0a8340 2024-09-13T10:30:32.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:32.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 10 monclient: dump: 2024-09-13T10:30:32.101 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.104 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.104 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.104 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.104 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff433abf640 5 monclient: authenticate success, global_id 4441 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff433abf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff420004c20 con 0x7ff42c0a8340 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 1 -- 172.21.15.181:0/515482891 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff4200051d0 con 0x7ff42c0a8340 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff433abf640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff433abf640 4 set_mon_vals no callback set 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff430859640 10 monclient: dump: 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.106 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff433abf640 10 monclient: shutdown 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff433abf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff433abf640 1 -- 172.21.15.181:0/515482891 >> v1:172.21.15.181:6791/0 conn(0x7ff42c0a8340 legacy=0x7ff42c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff433abf640 1 -- 172.21.15.181:0/515482891 shutdown_connections 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff433abf640 1 -- 172.21.15.181:0/515482891 >> 172.21.15.181:0/515482891 conn(0x7ff42c077170 msgr2=0x7ff42c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff433abf640 1 -- 172.21.15.181:0/515482891 shutdown_connections 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.092+0000 7ff433abf640 1 -- 172.21.15.181:0/515482891 wait complete. 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.093+0000 7ff433abf640 10 monclient: build_initial_monmap 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.093+0000 7ff433abf640 10 monclient: monmap: 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:32.108 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.093+0000 7ff433abf640 1 Processor -- start 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.093+0000 7ff433abf640 1 -- start start 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.093+0000 7ff433abf640 10 monclient: init 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.094+0000 7ff433abf640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.094+0000 7ff433abf640 10 monclient: _add_conns ranks=[3,2,0,4,8,6,5,1,7] 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.094+0000 7ff433abf640 10 monclient(hunting): picked mon.noname-g con 0x7ff42c0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:32.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.094+0000 7ff433abf640 10 monclient(hunting): picked mon.noname-b con 0x7ff42c13f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:32.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.094+0000 7ff433abf640 10 monclient(hunting): picked mon.noname-a con 0x7ff42c1422f0 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:32.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.094+0000 7ff433abf640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c0a9c40 con 0x7ff42c1422f0 2024-09-13T10:30:32.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.094+0000 7ff433abf640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c13bc90 con 0x7ff42c13f750 2024-09-13T10:30:32.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.094+0000 7ff433abf640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42c13c7f0 con 0x7ff42c0a8340 2024-09-13T10:30:32.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.094+0000 7ff433abf640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:32.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.094+0000 7ff433abf640 10 monclient(hunting): authenticate will time out at 771.599186s 2024-09-13T10:30:32.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.094+0000 7ff43105a640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7ff42c13f750 0x7ff42c1d3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48598/0 (socket says 172.21.15.181:48598) 2024-09-13T10:30:32.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.094+0000 7ff43105a640 1 -- 172.21.15.181:0/3068478301 learned_addr learned my addr 172.21.15.181:0/3068478301 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:32.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff43105a640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.181:6790/0 conn(0x7ff42c13f750 legacy=0x7ff42c1d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff43205c640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.181:6789/0 conn(0x7ff42c1422f0 legacy=0x7ff42c1d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2366887552 0 0) 0x7ff42c13bc90 con 0x7ff42c13f750 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): my global_id is 4475 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff418003550 con 0x7ff42c13f750 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516084316 0 0) 0x7ff42c0a9c40 con 0x7ff42c1422f0 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): my global_id is 54342 2024-09-13T10:30:32.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff42c13bc90 con 0x7ff42c1422f0 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff43185b640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.195:6790/0 conn(0x7ff42c0a8340 legacy=0x7ff42c12c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1622667302 0 0) 0x7ff418003550 con 0x7ff42c13f750 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff42c0a9c40 con 0x7ff42c13f750 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff420001de0 con 0x7ff42c13f750 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): dump: 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.117 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150994576 0 0) 0x7ff42c13c7f0 con 0x7ff42c0a8340 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): my global_id is 4395 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff418003550 con 0x7ff42c0a8340 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3356648824 0 0) 0x7ff42c13bc90 con 0x7ff42c1422f0 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff42c13c7f0 con 0x7ff42c1422f0 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff41c001be0 con 0x7ff42c1422f0 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 10 monclient(hunting): dump: 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.119 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.120 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.120 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.120 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.120 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.120 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.120 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.120 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.120 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.120 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.120 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.096+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1722122665 0 0) 0x7ff42c0a9c40 con 0x7ff42c13f750 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.195:6790/0 conn(0x7ff42c0a8340 legacy=0x7ff42c12c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.181:6789/0 conn(0x7ff42c1422f0 legacy=0x7ff42c1d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 1 monclient: found mon.b 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c0aa0a0 con 0x7ff42c13f750 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff433abf640 5 monclient: authenticate success, global_id 4475 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff433abf640 10 monclient: _renew_subs 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff433abf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff433abf640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff42c13a4a0 con 0x7ff42c13f750 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff433abf640 10 monclient: _renew_subs 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff433abf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff433abf640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff42c12cfc0 con 0x7ff42c13f750 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff4200020b0 con 0x7ff42c13f750 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff420004c20 con 0x7ff42c13f750 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42bfff640 4 set_mon_vals no callback set 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 10 monclient: dump: 2024-09-13T10:30:32.122 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.123 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff420011f20 con 0x7ff42c13f750 2024-09-13T10:30:32.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.097+0000 7ff433abf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:32.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.098+0000 7ff433abf640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff40c0065c0 con 0x7ff40c002860 2024-09-13T10:30:32.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.098+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 1150789242 0 0) 0x7ff42004e680 con 0x7ff42c13f750 2024-09-13T10:30:32.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.098+0000 7ff43205c640 10 monclient: get_auth_request con 0x7ff4180404b0 auth_method 0 2024-09-13T10:30:32.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff43185b640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.181:6791/0 conn(0x7ff40c002860 legacy=0x7ff40c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716890804 0 0) 0x7ff40c0065c0 con 0x7ff40c002860 2024-09-13T10:30:32.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 10 monclient(hunting): my global_id is 4450 2024-09-13T10:30:32.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff42c0a9c40 con 0x7ff40c002860 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3221699783 0 0) 0x7ff42c0a9c40 con 0x7ff40c002860 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff40c0065c0 con 0x7ff40c002860 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff424001c60 con 0x7ff40c002860 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 10 monclient: dump: 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.125 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2634571247 0 0) 0x7ff40c0065c0 con 0x7ff40c002860 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff40c00a160 con 0x7ff40c002860 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff424006830 con 0x7ff40c002860 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:32.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.181:6791/0 conn(0x7ff40c002860 legacy=0x7ff40c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.100+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.181:6791/0 conn(0x7ff40c002860 legacy=0x7ff40c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:32.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.106+0000 7ff433abf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:32.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.106+0000 7ff433abf640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff40c009e50 con 0x7ff40c009110 2024-09-13T10:30:32.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff43185b640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.181:6791/0 conn(0x7ff40c009110 legacy=0x7ff40c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700664454 0 0) 0x7ff40c009e50 con 0x7ff40c009110 2024-09-13T10:30:32.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 10 monclient(hunting): my global_id is 4459 2024-09-13T10:30:32.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff40c0065c0 con 0x7ff40c009110 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3267146777 0 0) 0x7ff40c0065c0 con 0x7ff40c009110 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff40c009e50 con 0x7ff40c009110 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff424003d40 con 0x7ff40c009110 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 10 monclient: dump: 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.128 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2873585778 0 0) 0x7ff40c009e50 con 0x7ff40c009110 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff40c00c3a0 con 0x7ff40c009110 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 623751289) 0x7ff424006a60 con 0x7ff40c009110 2024-09-13T10:30:32.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:32.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:32.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.181:6791/0 conn(0x7ff40c009110 legacy=0x7ff40c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.109+0000 7ff42a7fc640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.181:6791/0 conn(0x7ff40c009110 legacy=0x7ff40c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:32.130 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:32.130 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:32.130 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:32.130 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:32.130 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 22, 2024-09-13T10:30:32.130 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 46558, 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 30, 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:32.131 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.132 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.133 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:32.134 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.135 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.136 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.137 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.138 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.140 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:32.141 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:32.143 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.144 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.145 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:32.147 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.148 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.149 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:32.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.149 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.149 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.149 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:30:32.149 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.149 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.149 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:32.149 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:32.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.110+0000 7ff433abf640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff4180404b0 legacy=0x7ff418042970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.110+0000 7ff433abf640 10 monclient: shutdown 2024-09-13T10:30:32.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.110+0000 7ff433abf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:32.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.110+0000 7ff433abf640 1 -- 172.21.15.181:0/3068478301 >> v1:172.21.15.181:6790/0 conn(0x7ff42c13f750 legacy=0x7ff42c1d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.110+0000 7ff43205c640 1 -- 172.21.15.181:0/3068478301 reap_dead start 2024-09-13T10:30:32.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.110+0000 7ff43205c640 1 -- 172.21.15.181:0/3068478301 reap_dead start 2024-09-13T10:30:32.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.110+0000 7ff433abf640 1 -- 172.21.15.181:0/3068478301 shutdown_connections 2024-09-13T10:30:32.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.110+0000 7ff433abf640 1 -- 172.21.15.181:0/3068478301 >> 172.21.15.181:0/3068478301 conn(0x7ff42c0a6640 msgr2=0x7ff42c0a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:32.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.110+0000 7ff433abf640 1 -- 172.21.15.181:0/3068478301 shutdown_connections 2024-09-13T10:30:32.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.110+0000 7ff433abf640 1 -- 172.21.15.181:0/3068478301 wait complete. 2024-09-13T10:30:32.152 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:30:32.152 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:30:32.152 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:30:32.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.248+0000 7f7d872c8640 10 monclient: get_monmap_and_config 2024-09-13T10:30:32.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.248+0000 7f7d872c8640 10 monclient: build_initial_monmap 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.248+0000 7f7d872c8640 10 monclient: monmap: 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:32.248859+0000 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:32.248859+0000 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:32.250 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:32.251 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:32.251 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.248+0000 7f7d872c8640 1 Processor -- start 2024-09-13T10:30:32.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d872c8640 1 -- start start 2024-09-13T10:30:32.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d872c8640 10 monclient: init 2024-09-13T10:30:32.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d872c8640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:32.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d872c8640 10 monclient: _add_conns ranks=[1,6,7,0,3,2,8,4,5] 2024-09-13T10:30:32.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d872c8640 10 monclient(hunting): picked mon.noname-f con 0x7f7d800a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:32.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d872c8640 10 monclient(hunting): picked mon.noname-d con 0x7f7d800a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:32.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d872c8640 10 monclient(hunting): picked mon.noname-i con 0x7f7d8013f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:32.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d872c8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d800a4bc0 con 0x7f7d800a6640 2024-09-13T10:30:32.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d872c8640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8013a320 con 0x7f7d800a8340 2024-09-13T10:30:32.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d872c8640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d800a8100 con 0x7f7d8013f750 2024-09-13T10:30:32.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d872c8640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:32.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d872c8640 10 monclient(hunting): authenticate will time out at 771.754534s 2024-09-13T10:30:32.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d84863640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f7d800a8340 0x7f7d80139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45724/0 (socket says 172.21.15.181:45724) 2024-09-13T10:30:32.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.249+0000 7f7d84863640 1 -- 172.21.15.181:0/805971541 learned_addr learned my addr 172.21.15.181:0/805971541 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:32.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.251+0000 7f7d84863640 1 -- 172.21.15.181:0/805971541 >> v1:172.21.15.181:6792/0 conn(0x7f7d800a8340 legacy=0x7f7d80139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.251+0000 7f7d77fff640 1 -- 172.21.15.181:0/805971541 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395886934 0 0) 0x7f7d8013a320 con 0x7f7d800a8340 2024-09-13T10:30:32.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.251+0000 7f7d77fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.251+0000 7f7d77fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.251+0000 7f7d77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.251+0000 7f7d77fff640 10 monclient(hunting): my global_id is 4407 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.251+0000 7f7d77fff640 1 -- 172.21.15.181:0/805971541 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d6c003520 con 0x7f7d800a8340 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d85865640 1 -- 172.21.15.181:0/805971541 >> v1:172.21.15.195:6792/0 conn(0x7f7d8013f750 legacy=0x7f7d80141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d85064640 1 -- 172.21.15.181:0/805971541 >> v1:172.21.15.195:6789/0 conn(0x7f7d800a6640 legacy=0x7f7d80139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 1 -- 172.21.15.181:0/805971541 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2452951580 0 0) 0x7f7d6c003520 con 0x7f7d800a8340 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 1 -- 172.21.15.181:0/805971541 >> v1:172.21.15.195:6792/0 conn(0x7f7d8013f750 legacy=0x7f7d80141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 1 -- 172.21.15.181:0/805971541 >> v1:172.21.15.195:6789/0 conn(0x7f7d800a6640 legacy=0x7f7d80139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 1 monclient: found mon.noname-d 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 1 -- 172.21.15.181:0/805971541 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d800a48e0 con 0x7f7d800a8340 2024-09-13T10:30:32.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d872c8640 5 monclient: authenticate success, global_id 4407 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d872c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 1 -- 172.21.15.181:0/805971541 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d70001ae0 con 0x7f7d800a8340 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 10 monclient: dump: 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.258 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.259 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.259 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.259 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.259 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.259 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.259 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.259 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.259 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.259 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.259 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d872c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:32.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 1 -- 172.21.15.181:0/805971541 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d700048a0 con 0x7f7d800a8340 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 1 -- 172.21.15.181:0/805971541 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d70004e10 con 0x7f7d800a8340 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d872c8640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d872c8640 4 set_mon_vals no callback set 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d77fff640 10 monclient: dump: 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.260 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.261 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.261 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.261 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.261 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.261 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.261 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.261 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.261 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.261 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d872c8640 10 monclient: shutdown 2024-09-13T10:30:32.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d872c8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:32.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d872c8640 1 -- 172.21.15.181:0/805971541 >> v1:172.21.15.181:6792/0 conn(0x7f7d800a8340 legacy=0x7f7d80139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d872c8640 1 -- 172.21.15.181:0/805971541 shutdown_connections 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d872c8640 1 -- 172.21.15.181:0/805971541 >> 172.21.15.181:0/805971541 conn(0x7f7d80077170 msgr2=0x7f7d800abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d872c8640 1 -- 172.21.15.181:0/805971541 shutdown_connections 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.252+0000 7f7d872c8640 1 -- 172.21.15.181:0/805971541 wait complete. 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.253+0000 7f7d872c8640 10 monclient: build_initial_monmap 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.253+0000 7f7d872c8640 10 monclient: monmap: 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:32.262 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.253+0000 7f7d872c8640 1 Processor -- start 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.253+0000 7f7d872c8640 1 -- start start 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.253+0000 7f7d872c8640 10 monclient: init 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.254+0000 7f7d872c8640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.254+0000 7f7d872c8640 10 monclient: _add_conns ranks=[8,5,0,3,6,2,4,7,1] 2024-09-13T10:30:32.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.254+0000 7f7d872c8640 10 monclient(hunting): picked mon.noname-e con 0x7f7d800a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:32.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.254+0000 7f7d872c8640 10 monclient(hunting): picked mon.noname-h con 0x7f7d8013f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:32.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.254+0000 7f7d872c8640 10 monclient(hunting): picked mon.noname-a con 0x7f7d80142490 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:32.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.254+0000 7f7d872c8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8013c850 con 0x7f7d80142490 2024-09-13T10:30:32.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.254+0000 7f7d872c8640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d800a9cd0 con 0x7f7d8013f750 2024-09-13T10:30:32.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.254+0000 7f7d872c8640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8013b050 con 0x7f7d800a8340 2024-09-13T10:30:32.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.254+0000 7f7d872c8640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:32.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.254+0000 7f7d872c8640 10 monclient(hunting): authenticate will time out at 771.759292s 2024-09-13T10:30:32.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.254+0000 7f7d85064640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f7d800a8340 0x7f7d8012c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39970/0 (socket says 172.21.15.181:39970) 2024-09-13T10:30:32.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.254+0000 7f7d85064640 1 -- 172.21.15.181:0/727691857 learned_addr learned my addr 172.21.15.181:0/727691857 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:32.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d85064640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.181:6793/0 conn(0x7f7d800a8340 legacy=0x7f7d8012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d85865640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.181:6789/0 conn(0x7f7d80142490 legacy=0x7f7d801d6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d84863640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.195:6791/0 conn(0x7f7d8013f750 legacy=0x7f7d801d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556839799 0 0) 0x7f7d8013b050 con 0x7f7d800a8340 2024-09-13T10:30:32.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): my global_id is 4481 2024-09-13T10:30:32.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d64003520 con 0x7f7d800a8340 2024-09-13T10:30:32.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3191511483 0 0) 0x7f7d8013c850 con 0x7f7d80142490 2024-09-13T10:30:32.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): my global_id is 54351 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d8013b050 con 0x7f7d80142490 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054981191 0 0) 0x7f7d800a9cd0 con 0x7f7d8013f750 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): my global_id is 4469 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d8013c850 con 0x7f7d8013f750 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1241059910 0 0) 0x7f7d64003520 con 0x7f7d800a8340 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d800a9cd0 con 0x7f7d800a8340 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d7c003610 con 0x7f7d800a8340 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.271 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4152654452 0 0) 0x7f7d8013b050 con 0x7f7d80142490 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d64003520 con 0x7f7d80142490 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d78002000 con 0x7f7d80142490 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.256+0000 7f7d75ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.272 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.273 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 454937824 0 0) 0x7f7d8013c850 con 0x7f7d8013f750 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d8013b050 con 0x7f7d8013f750 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d70001a60 con 0x7f7d8013f750 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.274 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1907615279 0 0) 0x7f7d800a9cd0 con 0x7f7d800a8340 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.195:6791/0 conn(0x7f7d8013f750 legacy=0x7f7d801d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.181:6789/0 conn(0x7f7d80142490 legacy=0x7f7d801d6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 1 monclient: found mon.e 2024-09-13T10:30:32.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d800aa1a0 con 0x7f7d800a8340 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d872c8640 5 monclient: authenticate success, global_id 4481 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d872c8640 10 monclient: _renew_subs 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d872c8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d872c8640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8012ce10 con 0x7f7d800a8340 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d7c003bc0 con 0x7f7d800a8340 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d7c0040f0 con 0x7f7d800a8340 2024-09-13T10:30:32.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d75ffb640 10 monclient: dump: 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.277 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d777fe640 4 set_mon_vals no callback set 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d872c8640 10 monclient: _renew_subs 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d872c8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.257+0000 7f7d872c8640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f7d801d85e0 con 0x7f7d800a8340 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.258+0000 7f7d872c8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.258+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7d7c004290 con 0x7f7d800a8340 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.258+0000 7f7d872c8640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7d8006cab0 con 0x7f7d80077170 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.258+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 1150789242 0 0) 0x7f7d7c04e1d0 con 0x7f7d800a8340 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.258+0000 7f7d85865640 10 monclient: get_auth_request con 0x7f7d64040490 auth_method 0 2024-09-13T10:30:32.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d84863640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.181:6792/0 conn(0x7f7d80077170 legacy=0x7f7d80130a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223070670 0 0) 0x7f7d8013b050 con 0x7f7d80077170 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 10 monclient(hunting): my global_id is 4416 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d800a9cd0 con 0x7f7d80077170 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2712738818 0 0) 0x7f7d800a9cd0 con 0x7f7d80077170 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d8013b050 con 0x7f7d80077170 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d70001580 con 0x7f7d80077170 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 10 monclient: dump: 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.279 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.280 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1053965367 0 0) 0x7f7d8013b050 con 0x7f7d80077170 2024-09-13T10:30:32.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.260+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d8013e780 con 0x7f7d80077170 2024-09-13T10:30:32.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.261+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7d70001320 con 0x7f7d80077170 2024-09-13T10:30:32.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.261+0000 7f7d75ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:32.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.261+0000 7f7d75ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:32.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.261+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.181:6792/0 conn(0x7f7d80077170 legacy=0x7f7d80130a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.261+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.181:6792/0 conn(0x7f7d80077170 legacy=0x7f7d80130a50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:32.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.267+0000 7f7d872c8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:32.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.267+0000 7f7d872c8640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7d8013a470 con 0x7f7d80069b40 2024-09-13T10:30:32.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d84863640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.181:6792/0 conn(0x7f7d80069b40 legacy=0x7f7d80131160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1716763518 0 0) 0x7f7d8013a470 con 0x7f7d80069b40 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 10 monclient(hunting): my global_id is 4425 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d8013b050 con 0x7f7d80069b40 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 671722434 0 0) 0x7f7d8013b050 con 0x7f7d80069b40 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d8013a470 con 0x7f7d80069b40 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d70005b80 con 0x7f7d80069b40 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 10 monclient: dump: 2024-09-13T10:30:32.283 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.284 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.285 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 708658615 0 0) 0x7f7d8013a470 con 0x7f7d80069b40 2024-09-13T10:30:32.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.269+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7d800a3d10 con 0x7f7d80069b40 2024-09-13T10:30:32.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 1864346517) 0x7f7d700048a0 con 0x7f7d80069b40 2024-09-13T10:30:32.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d75ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:32.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d75ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:32.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.181:6792/0 conn(0x7f7d80069b40 legacy=0x7f7d80131160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d75ffb640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.181:6792/0 conn(0x7f7d80069b40 legacy=0x7f7d80131160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:32.285 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:32.285 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:32.285 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 22, 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 46713, 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:32.286 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 30, 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.287 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.288 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:32.289 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.290 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:32.291 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.292 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.293 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:32.293 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:32.293 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.293 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.293 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.293 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:32.293 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.293 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.293 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.294 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:32.295 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.296 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.298 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:32.299 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.301 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:32.301 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:32.301 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.301 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.301 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.301 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:32.301 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.301 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.301 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.302 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.303 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:32.304 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.305 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.305 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:32.305 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:32.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d872c8640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7d64040490 legacy=0x7f7d64042950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d872c8640 10 monclient: shutdown 2024-09-13T10:30:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d872c8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d872c8640 1 -- 172.21.15.181:0/727691857 >> v1:172.21.15.181:6793/0 conn(0x7f7d800a8340 legacy=0x7f7d8012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d85865640 1 -- 172.21.15.181:0/727691857 reap_dead start 2024-09-13T10:30:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d85865640 1 -- 172.21.15.181:0/727691857 reap_dead start 2024-09-13T10:30:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d872c8640 1 -- 172.21.15.181:0/727691857 shutdown_connections 2024-09-13T10:30:32.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d872c8640 1 -- 172.21.15.181:0/727691857 >> 172.21.15.181:0/727691857 conn(0x7f7d800a6640 msgr2=0x7f7d800a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d872c8640 1 -- 172.21.15.181:0/727691857 shutdown_connections 2024-09-13T10:30:32.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.270+0000 7f7d872c8640 1 -- 172.21.15.181:0/727691857 wait complete. 2024-09-13T10:30:32.311 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:30:32.311 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:30:32.311 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:30:32.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.413+0000 7f3087a40640 10 monclient: get_monmap_and_config 2024-09-13T10:30:32.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.413+0000 7f3087a40640 10 monclient: build_initial_monmap 2024-09-13T10:30:32.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.413+0000 7f3087a40640 10 monclient: monmap: 2024-09-13T10:30:32.415 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:32.415 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:32.414103+0000 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:32.414103+0000 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:32.416 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:32.417 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.414+0000 7f3087a40640 1 Processor -- start 2024-09-13T10:30:32.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.415+0000 7f3087a40640 1 -- start start 2024-09-13T10:30:32.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.415+0000 7f3087a40640 10 monclient: init 2024-09-13T10:30:32.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.415+0000 7f3087a40640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:32.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.415+0000 7f3087a40640 10 monclient: _add_conns ranks=[3,7,8,0,5,2,4,6,1] 2024-09-13T10:30:32.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.415+0000 7f3087a40640 10 monclient(hunting): picked mon.noname-g con 0x7f30800a34c0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:32.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.415+0000 7f3087a40640 10 monclient(hunting): picked mon.noname-i con 0x7f30800a3fb0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:32.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.415+0000 7f3087a40640 10 monclient(hunting): picked mon.noname-e con 0x7f308013fe20 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:32.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.415+0000 7f3087a40640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30800a1070 con 0x7f30800a34c0 2024-09-13T10:30:32.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.415+0000 7f3087a40640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30800705f0 con 0x7f30800a3fb0 2024-09-13T10:30:32.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.416+0000 7f3087a40640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30800708d0 con 0x7f308013fe20 2024-09-13T10:30:32.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.416+0000 7f3087a40640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:32.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.416+0000 7f3087a40640 10 monclient(hunting): authenticate will time out at 771.921020s 2024-09-13T10:30:32.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.416+0000 7f3085fdd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f308013fe20 0x7f3080142210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39974/0 (socket says 172.21.15.181:39974) 2024-09-13T10:30:32.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.416+0000 7f3085fdd640 1 -- 172.21.15.181:0/3641708577 learned_addr learned my addr 172.21.15.181:0/3641708577 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:32.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f30857dc640 1 -- 172.21.15.181:0/3641708577 >> v1:172.21.15.195:6790/0 conn(0x7f30800a34c0 legacy=0x7f30800a38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3084fdb640 1 -- 172.21.15.181:0/3641708577 >> v1:172.21.15.195:6792/0 conn(0x7f30800a3fb0 legacy=0x7f308013e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778115971 0 0) 0x7f30800a1070 con 0x7f30800a34c0 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3077fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3077fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3077fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3077fff640 10 monclient(hunting): my global_id is 4404 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f306c003520 con 0x7f30800a34c0 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3085fdd640 1 -- 172.21.15.181:0/3641708577 >> v1:172.21.15.181:6793/0 conn(0x7f308013fe20 legacy=0x7f3080142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933919101 0 0) 0x7f30800705f0 con 0x7f30800a3fb0 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3077fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3077fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3077fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3077fff640 10 monclient(hunting): my global_id is 54457 2024-09-13T10:30:32.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.418+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30800a1070 con 0x7f30800a3fb0 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 401287433 0 0) 0x7f30800708d0 con 0x7f308013fe20 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient(hunting): my global_id is 4490 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30800705f0 con 0x7f308013fe20 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1183919123 0 0) 0x7f306c003520 con 0x7f30800a34c0 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 >> v1:172.21.15.181:6793/0 conn(0x7f308013fe20 legacy=0x7f3080142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 >> v1:172.21.15.195:6792/0 conn(0x7f30800a3fb0 legacy=0x7f308013e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 1 monclient: found mon.noname-g 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:30:32.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30800a14b0 con 0x7f30800a34c0 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3087a40640 5 monclient: authenticate success, global_id 4404 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f307c001b20 con 0x7f30800a34c0 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3087a40640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient: dump: 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.424 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3087a40640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:32.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f307c003610 con 0x7f30800a34c0 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 1 -- 172.21.15.181:0/3641708577 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f307c003b80 con 0x7f30800a34c0 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3087a40640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3087a40640 4 set_mon_vals no callback set 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.419+0000 7f3077fff640 10 monclient: dump: 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.426 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.427 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.427 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.427 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.427 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.427 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.427 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.427 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.427 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.427 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.420+0000 7f3087a40640 10 monclient: shutdown 2024-09-13T10:30:32.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.420+0000 7f3087a40640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:32.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.420+0000 7f3087a40640 1 -- 172.21.15.181:0/3641708577 >> v1:172.21.15.195:6790/0 conn(0x7f30800a34c0 legacy=0x7f30800a38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.420+0000 7f3087a40640 1 -- 172.21.15.181:0/3641708577 shutdown_connections 2024-09-13T10:30:32.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.420+0000 7f3087a40640 1 -- 172.21.15.181:0/3641708577 >> 172.21.15.181:0/3641708577 conn(0x7f30800a80e0 msgr2=0x7f30800a45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:32.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.420+0000 7f3087a40640 1 -- 172.21.15.181:0/3641708577 shutdown_connections 2024-09-13T10:30:32.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.420+0000 7f3087a40640 1 -- 172.21.15.181:0/3641708577 wait complete. 2024-09-13T10:30:32.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.421+0000 7f3087a40640 10 monclient: build_initial_monmap 2024-09-13T10:30:32.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.421+0000 7f3087a40640 10 monclient: monmap: 2024-09-13T10:30:32.434 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:32.434 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:32.435 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:32.435 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:32.435 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:32.435 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:32.435 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:32.435 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:32.435 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:32.435 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:32.435 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:32.435 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:32.435 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:32.435 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:32.436 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:32.436 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.421+0000 7f3087a40640 1 Processor -- start 2024-09-13T10:30:32.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.421+0000 7f3087a40640 1 -- start start 2024-09-13T10:30:32.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.421+0000 7f3087a40640 10 monclient: init 2024-09-13T10:30:32.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.422+0000 7f3087a40640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:32.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.422+0000 7f3087a40640 10 monclient: _add_conns ranks=[0,5,4,1,8,7,2,3,6] 2024-09-13T10:30:32.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.422+0000 7f3087a40640 10 monclient(hunting): picked mon.noname-a con 0x7f30800a34c0 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:32.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.422+0000 7f3087a40640 10 monclient(hunting): picked mon.noname-h con 0x7f30800a3fb0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:32.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.422+0000 7f3087a40640 10 monclient(hunting): picked mon.noname-c con 0x7f308013fe20 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:32.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.422+0000 7f3087a40640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3080127560 con 0x7f30800a34c0 2024-09-13T10:30:32.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.422+0000 7f3087a40640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3080129020 con 0x7f308013fe20 2024-09-13T10:30:32.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.422+0000 7f3087a40640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3080129300 con 0x7f30800a3fb0 2024-09-13T10:30:32.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.422+0000 7f3087a40640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:32.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.422+0000 7f3087a40640 10 monclient(hunting): authenticate will time out at 771.927119s 2024-09-13T10:30:32.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.422+0000 7f30857dc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f30800a34c0 0x7f3080125fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50896/0 (socket says 172.21.15.181:50896) 2024-09-13T10:30:32.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.422+0000 7f30857dc640 1 -- 172.21.15.181:0/2857057646 learned_addr learned my addr 172.21.15.181:0/2857057646 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:32.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3085fdd640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.181:6791/0 conn(0x7f308013fe20 legacy=0x7f30801d6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f30857dc640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.181:6789/0 conn(0x7f30800a34c0 legacy=0x7f3080125fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290935863 0 0) 0x7f3080129020 con 0x7f308013fe20 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): my global_id is 4468 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3084fdb640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.195:6791/0 conn(0x7f30800a3fb0 legacy=0x7f308013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3064003550 con 0x7f308013fe20 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996797325 0 0) 0x7f3080127560 con 0x7f30800a34c0 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): my global_id is 54360 2024-09-13T10:30:32.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3080129020 con 0x7f30800a34c0 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620747187 0 0) 0x7f3080129300 con 0x7f30800a3fb0 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): my global_id is 4478 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3080127560 con 0x7f30800a3fb0 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2102405432 0 0) 0x7f3080129020 con 0x7f30800a34c0 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3080129300 con 0x7f30800a34c0 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1362355579 0 0) 0x7f3064003550 con 0x7f308013fe20 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3080129020 con 0x7f308013fe20 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f307c003b00 con 0x7f30800a34c0 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:30:32.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:32.440 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.440 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.440 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.440 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.440 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.440 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.440 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.440 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.440 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.440 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.441 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.441 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.441 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.441 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.441 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.441 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:32.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3078002020 con 0x7f308013fe20 2024-09-13T10:30:32.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.442 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.443 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.443 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.443 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2058979498 0 0) 0x7f3080127560 con 0x7f30800a3fb0 2024-09-13T10:30:32.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3064003550 con 0x7f30800a3fb0 2024-09-13T10:30:32.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3070003610 con 0x7f30800a3fb0 2024-09-13T10:30:32.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:32.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 10 monclient(hunting): dump: 2024-09-13T10:30:32.444 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.444 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.444 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.444 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.444 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.444 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.445 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.445 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.445 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.445 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.445 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.446 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.446 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.446 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.446 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.446 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.424+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2097030666 0 0) 0x7f3080129300 con 0x7f30800a34c0 2024-09-13T10:30:32.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.195:6791/0 conn(0x7f30800a3fb0 legacy=0x7f308013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.181:6791/0 conn(0x7f308013fe20 legacy=0x7f30801d6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:30:32.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 1 monclient: found mon.a 2024-09-13T10:30:32.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:32.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:32.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3080128360 con 0x7f30800a34c0 2024-09-13T10:30:32.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 10 monclient: _finish_auth 0 2024-09-13T10:30:32.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:30:32.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:32.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3087a40640 5 monclient: authenticate success, global_id 54360 2024-09-13T10:30:32.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3087a40640 10 monclient: _renew_subs 2024-09-13T10:30:32.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3087a40640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:32.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3087a40640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f308013e630 con 0x7f30800a34c0 2024-09-13T10:30:32.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f307c001ac0 con 0x7f30800a34c0 2024-09-13T10:30:32.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:32.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f307c0057c0 con 0x7f30800a34c0 2024-09-13T10:30:32.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:32.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 10 monclient: dump: 2024-09-13T10:30:32.449 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.449 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.450 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.450 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.450 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.450 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.450 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.451 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.451 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.451 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.451 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.451 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.451 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.452 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.452 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.452 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f30777fe640 4 set_mon_vals no callback set 2024-09-13T10:30:32.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3087a40640 10 monclient: _renew_subs 2024-09-13T10:30:32.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3087a40640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:32.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3087a40640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f30801d7e00 con 0x7f30800a34c0 2024-09-13T10:30:32.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.425+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f307c011e40 con 0x7f30800a34c0 2024-09-13T10:30:32.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.426+0000 7f3087a40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:32.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.426+0000 7f3087a40640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3080050d00 con 0x7f3080121120 2024-09-13T10:30:32.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.426+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 88007995 0 0) 0x7f307c04e250 con 0x7f30800a34c0 2024-09-13T10:30:32.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.426+0000 7f3085fdd640 10 monclient: get_auth_request con 0x7f3064040490 auth_method 0 2024-09-13T10:30:32.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3084fdb640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.181:6793/0 conn(0x7f3080121120 legacy=0x7f3080121500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790175160 0 0) 0x7f3064003550 con 0x7f3080121120 2024-09-13T10:30:32.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 10 monclient(hunting): my global_id is 4499 2024-09-13T10:30:32.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3080129300 con 0x7f3080121120 2024-09-13T10:30:32.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1574898962 0 0) 0x7f3080129300 con 0x7f3080121120 2024-09-13T10:30:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3064003550 con 0x7f3080121120 2024-09-13T10:30:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3070003ea0 con 0x7f3080121120 2024-09-13T10:30:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 10 monclient: dump: 2024-09-13T10:30:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.454 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4061893949 0 0) 0x7f3064003550 con 0x7f3080121120 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.428+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3080129770 con 0x7f3080121120 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.429+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3070004120 con 0x7f3080121120 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.429+0000 7f3075ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:32.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.429+0000 7f3075ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:32.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.429+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.181:6793/0 conn(0x7f3080121120 legacy=0x7f3080121500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.429+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.181:6793/0 conn(0x7f3080121120 legacy=0x7f3080121500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:32.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.435+0000 7f3087a40640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:32.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.435+0000 7f3087a40640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f30800a6ce0 con 0x7f3080121c10 2024-09-13T10:30:32.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3084fdb640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.181:6793/0 conn(0x7f3080121c10 legacy=0x7f30801dbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905087162 0 0) 0x7f30800a1070 con 0x7f3080121c10 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 10 monclient(hunting): my global_id is 4508 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3064003550 con 0x7f3080121c10 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 212352125 0 0) 0x7f3064003550 con 0x7f3080121c10 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f30800a1070 con 0x7f3080121c10 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3070005b00 con 0x7f3080121c10 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 10 monclient: dump: 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.458 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 609133017 0 0) 0x7f30800a1070 con 0x7f3080121c10 2024-09-13T10:30:32.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.437+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3080128c90 con 0x7f3080121c10 2024-09-13T10:30:32.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 3037479174) 0x7f3070007d90 con 0x7f3080121c10 2024-09-13T10:30:32.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3075ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:32.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3075ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:32.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.181:6793/0 conn(0x7f3080121c10 legacy=0x7f30801dbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3075ffb640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.181:6793/0 conn(0x7f3080121c10 legacy=0x7f30801dbff0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:32.460 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:32.460 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:32.460 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:32.460 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:32.461 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 22, 2024-09-13T10:30:32.461 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 46869, 2024-09-13T10:30:32.461 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:32.461 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:32.461 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:32.461 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:30:32.461 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:32.461 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:32.461 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:32.462 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:32.462 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:32.462 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:32.462 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.462 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 30, 2024-09-13T10:30:32.462 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:32.463 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:32.463 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:32.463 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.463 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.463 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.463 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.464 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.464 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.464 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.464 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.464 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.464 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.464 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.465 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.465 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:32.465 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:32.465 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.465 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.465 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.465 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.466 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.466 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.466 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.466 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.466 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.466 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.466 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.467 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.467 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:32.467 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:32.467 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:32.467 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:32.468 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:32.468 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:32.468 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:32.468 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:32.468 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:32.468 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:32.469 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:32.469 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:32.469 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:32.469 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:32.469 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:32.469 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:32.469 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:32.469 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.470 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.470 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.470 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.470 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.470 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.470 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.470 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.470 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.470 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.470 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.470 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.471 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:32.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.471 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:32.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.471 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:32.471 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:32.471 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.471 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.471 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.471 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:32.472 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.472 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.472 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.472 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:32.472 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:32.472 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.472 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.472 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.473 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:32.473 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:32.473 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.473 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.473 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.473 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:32.473 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.473 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.474 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:32.476 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.477 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.479 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.480 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.481 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.483 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.483 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:32.483 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.483 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.483 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.483 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:32.483 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:32.484 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.484 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.484 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.484 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.484 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.484 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:32.484 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:32.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.484 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.484 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.484 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:32.485 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.485 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.485 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:32.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.485 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.485 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.485 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:32.485 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.485 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.485 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:32.486 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:32.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3087a40640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3064040490 legacy=0x7f3064042950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3087a40640 10 monclient: shutdown 2024-09-13T10:30:32.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3087a40640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:32.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3087a40640 1 -- 172.21.15.181:0/2857057646 >> v1:172.21.15.181:6789/0 conn(0x7f30800a34c0 legacy=0x7f3080125fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3085fdd640 1 -- 172.21.15.181:0/2857057646 reap_dead start 2024-09-13T10:30:32.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3085fdd640 1 -- 172.21.15.181:0/2857057646 reap_dead start 2024-09-13T10:30:32.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3087a40640 1 -- 172.21.15.181:0/2857057646 shutdown_connections 2024-09-13T10:30:32.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3087a40640 1 -- 172.21.15.181:0/2857057646 >> 172.21.15.181:0/2857057646 conn(0x7f30800a80e0 msgr2=0x7f30800a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:32.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3087a40640 1 -- 172.21.15.181:0/2857057646 shutdown_connections 2024-09-13T10:30:32.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.438+0000 7f3087a40640 1 -- 172.21.15.181:0/2857057646 wait complete. 2024-09-13T10:30:32.489 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:30:32.489 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:30:32.489 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:30:32.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.586+0000 7f8199f44640 10 monclient: get_monmap_and_config 2024-09-13T10:30:32.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.586+0000 7f8199f44640 10 monclient: build_initial_monmap 2024-09-13T10:30:32.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.586+0000 7f8199f44640 10 monclient: monmap: 2024-09-13T10:30:32.588 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:32.588 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.588 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:32.587384+0000 2024-09-13T10:30:32.588 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:32.587384+0000 2024-09-13T10:30:32.588 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:32.589 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.589 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:32.589 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:32.589 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:32.589 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:32.589 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:32.589 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:32.589 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:32.589 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:32.590 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:32.590 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.587+0000 7f8199f44640 1 Processor -- start 2024-09-13T10:30:32.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.587+0000 7f8199f44640 1 -- start start 2024-09-13T10:30:32.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.587+0000 7f8199f44640 10 monclient: init 2024-09-13T10:30:32.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8199f44640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:32.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8199f44640 10 monclient: _add_conns ranks=[5,1,7,6,8,3,2,4,0] 2024-09-13T10:30:32.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8199f44640 10 monclient(hunting): picked mon.noname-h con 0x7f81940a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:32.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8199f44640 10 monclient(hunting): picked mon.noname-f con 0x7f81940a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:32.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8199f44640 10 monclient(hunting): picked mon.noname-i con 0x7f819413f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:32.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8199f44640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81940a5fe0 con 0x7f81940a6ab0 2024-09-13T10:30:32.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8199f44640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81940a8080 con 0x7f81940a66d0 2024-09-13T10:30:32.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8199f44640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81940a42c0 con 0x7f819413f9a0 2024-09-13T10:30:32.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8199f44640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:32.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8199f44640 10 monclient(hunting): authenticate will time out at 772.093131s 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8193fff640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f819413f9a0 0x7f8194141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:50328/0 (socket says 172.21.15.181:50328) 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f81937fe640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f81940a66d0 0x7f81940a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:54952/0 (socket says 172.21.15.181:54952) 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8193fff640 1 -- 172.21.15.181:0/3311597720 learned_addr learned my addr 172.21.15.181:0/3311597720 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.588+0000 7f8192ffd640 1 --1- 172.21.15.181:0/3311597720 >> v1:172.21.15.195:6789/0 conn(0x7f81940a6ab0 0x7f81940a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:35472/0 (socket says 172.21.15.181:35472) 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81937fe640 1 -- 172.21.15.181:0/3311597720 >> v1:172.21.15.195:6791/0 conn(0x7f81940a66d0 legacy=0x7f81940a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f8192ffd640 1 -- 172.21.15.181:0/3311597720 >> v1:172.21.15.195:6789/0 conn(0x7f81940a6ab0 legacy=0x7f81940a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f8193fff640 1 -- 172.21.15.181:0/3311597720 >> v1:172.21.15.195:6792/0 conn(0x7f819413f9a0 legacy=0x7f8194141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999041087 0 0) 0x7f81940a42c0 con 0x7f819413f9a0 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 10 monclient(hunting): my global_id is 54466 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f817c003520 con 0x7f819413f9a0 2024-09-13T10:30:32.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231214494 0 0) 0x7f81940a8080 con 0x7f81940a66d0 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 10 monclient(hunting): my global_id is 4487 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81940a42c0 con 0x7f81940a66d0 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2405550710 0 0) 0x7f81940a5fe0 con 0x7f81940a6ab0 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 10 monclient(hunting): my global_id is 54469 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.590+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81940a8080 con 0x7f81940a6ab0 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 482730693 0 0) 0x7f817c003520 con 0x7f819413f9a0 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 >> v1:172.21.15.195:6791/0 conn(0x7f81940a66d0 legacy=0x7f81940a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 >> v1:172.21.15.195:6789/0 conn(0x7f81940a6ab0 legacy=0x7f81940a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 1 monclient: found mon.noname-i 2024-09-13T10:30:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:30:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81941464e0 con 0x7f819413f9a0 2024-09-13T10:30:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f818c001e40 con 0x7f819413f9a0 2024-09-13T10:30:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:30:32.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 10 monclient: dump: 2024-09-13T10:30:32.600 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.600 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.600 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.600 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.600 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.600 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.600 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.600 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.601 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.601 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.601 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.601 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.601 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.601 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.602 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.602 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f8199f44640 5 monclient: authenticate success, global_id 54466 2024-09-13T10:30:32.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f8199f44640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:32.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f818c001fe0 con 0x7f819413f9a0 2024-09-13T10:30:32.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f8199f44640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f8199f44640 4 set_mon_vals no callback set 2024-09-13T10:30:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 1 -- 172.21.15.181:0/3311597720 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f818c004fa0 con 0x7f819413f9a0 2024-09-13T10:30:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f81927fc640 10 monclient: dump: 2024-09-13T10:30:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.604 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.605 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.605 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.605 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.605 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.605 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.605 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.605 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.605 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.606 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f8199f44640 10 monclient: shutdown 2024-09-13T10:30:32.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f8199f44640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:32.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f8199f44640 1 -- 172.21.15.181:0/3311597720 >> v1:172.21.15.195:6792/0 conn(0x7f819413f9a0 legacy=0x7f8194141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f8199f44640 1 -- 172.21.15.181:0/3311597720 shutdown_connections 2024-09-13T10:30:32.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f8199f44640 1 -- 172.21.15.181:0/3311597720 >> 172.21.15.181:0/3311597720 conn(0x7f81940abcd0 msgr2=0x7f81940ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:32.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f8199f44640 1 -- 172.21.15.181:0/3311597720 shutdown_connections 2024-09-13T10:30:32.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.591+0000 7f8199f44640 1 -- 172.21.15.181:0/3311597720 wait complete. 2024-09-13T10:30:32.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.592+0000 7f8199f44640 10 monclient: build_initial_monmap 2024-09-13T10:30:32.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.592+0000 7f8199f44640 10 monclient: monmap: 2024-09-13T10:30:32.607 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:32.607 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:32.607 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:32.608 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:32.608 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:32.608 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:32.608 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:32.608 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:32.608 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:32.608 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.592+0000 7f8199f44640 1 Processor -- start 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.592+0000 7f8199f44640 1 -- start start 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.592+0000 7f8199f44640 10 monclient: init 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8199f44640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8199f44640 10 monclient: _add_conns ranks=[1,2,4,3,6,0,7,8,5] 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8199f44640 10 monclient(hunting): picked mon.noname-f con 0x7f81940a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:32.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8199f44640 10 monclient(hunting): picked mon.noname-b con 0x7f81940a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:32.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8199f44640 10 monclient(hunting): picked mon.noname-c con 0x7f819413f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:32.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8199f44640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f819413e2e0 con 0x7f81940a66d0 2024-09-13T10:30:32.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8199f44640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8194068680 con 0x7f81940a6ab0 2024-09-13T10:30:32.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8199f44640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f819413c150 con 0x7f819413f9a0 2024-09-13T10:30:32.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8199f44640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:32.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8199f44640 10 monclient(hunting): authenticate will time out at 772.098226s 2024-09-13T10:30:32.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8192ffd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f81940a6ab0 0x7f819413ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48602/0 (socket says 172.21.15.181:48602) 2024-09-13T10:30:32.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8192ffd640 1 -- 172.21.15.181:0/4057195517 learned_addr learned my addr 172.21.15.181:0/4057195517 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:32.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.593+0000 7f8193fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f819413f9a0 0x7f81941d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38536/0 (socket says 172.21.15.181:38536) 2024-09-13T10:30:32.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f8192ffd640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.181:6790/0 conn(0x7f81940a6ab0 legacy=0x7f819413ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f8193fff640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.181:6791/0 conn(0x7f819413f9a0 legacy=0x7f81941d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f81937fe640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.195:6789/0 conn(0x7f81940a66d0 legacy=0x7f819413b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2936274310 0 0) 0x7f819413c150 con 0x7f819413f9a0 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): my global_id is 4477 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8180003520 con 0x7f819413f9a0 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820413613 0 0) 0x7f8194068680 con 0x7f81940a6ab0 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): my global_id is 4484 2024-09-13T10:30:32.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f819413c150 con 0x7f81940a6ab0 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113296130 0 0) 0x7f819413e2e0 con 0x7f81940a66d0 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): my global_id is 54478 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8194068680 con 0x7f81940a66d0 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3104011239 0 0) 0x7f819413c150 con 0x7f81940a6ab0 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f819413e2e0 con 0x7f81940a6ab0 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 880616226 0 0) 0x7f8180003520 con 0x7f819413f9a0 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f819413c150 con 0x7f819413f9a0 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f81880047e0 con 0x7f81940a6ab0 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.595+0000 7f817bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:32.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient(hunting): dump: 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.619 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f818c004ea0 con 0x7f819413f9a0 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient(hunting): dump: 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.620 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.621 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.621 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.621 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.621 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.621 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.621 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.621 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.621 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.621 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.621 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1856139012 0 0) 0x7f8194068680 con 0x7f81940a66d0 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8180003520 con 0x7f81940a66d0 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8184004880 con 0x7f81940a66d0 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient(hunting): dump: 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.622 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.623 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.623 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.623 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.623 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.623 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.623 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.623 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.623 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4180904247 0 0) 0x7f819413e2e0 con 0x7f81940a6ab0 2024-09-13T10:30:32.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.181:6791/0 conn(0x7f819413f9a0 legacy=0x7f81941d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.195:6789/0 conn(0x7f81940a66d0 legacy=0x7f819413b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 1 monclient: found mon.b 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819413cdf0 con 0x7f81940a6ab0 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient: _finish_auth 0 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f8199f44640 5 monclient: authenticate success, global_id 4484 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f8199f44640 10 monclient: _renew_subs 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f8199f44640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f8199f44640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f819413f150 con 0x7f81940a6ab0 2024-09-13T10:30:32.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f8199f44640 10 monclient: _renew_subs 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f8199f44640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f8199f44640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f81941374e0 con 0x7f81940a6ab0 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8188004c30 con 0x7f81940a6ab0 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8188005160 con 0x7f81940a6ab0 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f8191ffb640 4 set_mon_vals no callback set 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f817bfff640 10 monclient: dump: 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.625 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.596+0000 7f8199f44640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:32.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.597+0000 7f8199f44640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f81740065c0 con 0x7f8174002860 2024-09-13T10:30:32.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.597+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f8188005300 con 0x7f81940a6ab0 2024-09-13T10:30:32.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.597+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 88007995 0 0) 0x7f818804e2d0 con 0x7f81940a6ab0 2024-09-13T10:30:32.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.597+0000 7f8193fff640 10 monclient: get_auth_request con 0x7f8180040510 auth_method 0 2024-09-13T10:30:32.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f81937fe640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.195:6789/0 conn(0x7f8174002860 legacy=0x7f8174004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3825993483 0 0) 0x7f81740065c0 con 0x7f8174002860 2024-09-13T10:30:32.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f817bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f817bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f817bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f817bfff640 10 monclient(hunting): my global_id is 54487 2024-09-13T10:30:32.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f819413e2e0 con 0x7f8174002860 2024-09-13T10:30:32.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1328665089 0 0) 0x7f819413e2e0 con 0x7f8174002860 2024-09-13T10:30:32.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f81740065c0 con 0x7f8174002860 2024-09-13T10:30:32.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8184004f50 con 0x7f8174002860 2024-09-13T10:30:32.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f817bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f817bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:32.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.599+0000 7f817bfff640 10 monclient: dump: 2024-09-13T10:30:32.629 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.629 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.629 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.629 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.629 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.629 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.629 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.629 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.629 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.630 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.630 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.630 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.630 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.630 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.630 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.630 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.600+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3354752434 0 0) 0x7f81740065c0 con 0x7f8174002860 2024-09-13T10:30:32.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.600+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f817400a160 con 0x7f8174002860 2024-09-13T10:30:32.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.600+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8184006410 con 0x7f8174002860 2024-09-13T10:30:32.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.600+0000 7f817bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:32.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.600+0000 7f817bfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:32.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.600+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.195:6789/0 conn(0x7f8174002860 legacy=0x7f8174004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.600+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.195:6789/0 conn(0x7f8174002860 legacy=0x7f8174004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:32.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.606+0000 7f8199f44640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:32.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.606+0000 7f8199f44640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8174009e70 con 0x7f8174009130 2024-09-13T10:30:32.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f81937fe640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.195:6789/0 conn(0x7f8174009130 legacy=0x7f81740095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122588337 0 0) 0x7f8174009e70 con 0x7f8174009130 2024-09-13T10:30:32.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 10 monclient(hunting): my global_id is 54496 2024-09-13T10:30:32.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81740065c0 con 0x7f8174009130 2024-09-13T10:30:32.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1435044429 0 0) 0x7f81740065c0 con 0x7f8174009130 2024-09-13T10:30:32.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8174009e70 con 0x7f8174009130 2024-09-13T10:30:32.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8184005580 con 0x7f8174009130 2024-09-13T10:30:32.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:32.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 10 monclient: dump: 2024-09-13T10:30:32.633 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.634 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.635 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.635 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1972626098 0 0) 0x7f8174009e70 con 0x7f8174009130 2024-09-13T10:30:32.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.609+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f817400c3f0 con 0x7f8174009130 2024-09-13T10:30:32.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 1025299775) 0x7f81840058d0 con 0x7f8174009130 2024-09-13T10:30:32.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f817bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:32.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f817bfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:32.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.195:6789/0 conn(0x7f8174009130 legacy=0x7f81740095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f817bfff640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.195:6789/0 conn(0x7f8174009130 legacy=0x7f81740095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:32.636 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:32.636 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:32.636 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:32.636 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:32.636 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 22, 2024-09-13T10:30:32.636 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 47018, 2024-09-13T10:30:32.637 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:32.637 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:32.637 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:32.637 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:30:32.637 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:32.637 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:32.637 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:32.637 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:32.638 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:32.638 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:32.638 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.638 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 30, 2024-09-13T10:30:32.638 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:32.638 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:32.638 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:32.638 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.638 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.638 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.638 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.639 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.640 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.640 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.640 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.640 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.640 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.640 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.640 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.640 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.640 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.641 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:32.641 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:32.641 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:32.641 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:32.641 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:32.641 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:32.642 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:32.642 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:32.642 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:32.642 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:32.642 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:32.643 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:32.643 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:32.643 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:32.643 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:32.643 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:32.643 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:32.644 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.644 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.645 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.645 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.645 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.645 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.645 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.646 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.646 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.646 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.646 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.646 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.646 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:32.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.647 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:32.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.648 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:32.648 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:32.648 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.648 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:32.649 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.649 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.649 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.649 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:32.649 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:32.649 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.649 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.649 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.649 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:32.650 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:32.650 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.650 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.650 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:32.651 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.651 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:32.652 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:32.652 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.652 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.652 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.652 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:32.652 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:32.652 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.656 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.656 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.656 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:32.656 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:32.656 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.656 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.656 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.656 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:32.657 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.657 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.657 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.657 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:32.657 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:32.657 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.657 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.657 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.657 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:32.658 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:32.658 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.658 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.658 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.658 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:32.658 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.658 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.658 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.658 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:32.658 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.660 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.660 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:32.660 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:32.660 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.660 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.660 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.660 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:32.661 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:32.661 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.661 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.661 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.661 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:32.661 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.661 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.661 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.661 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:32.661 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.662 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:32.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.664 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.664 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.664 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:32.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.664 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.664 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:30:32.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.664 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.664 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.664 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:32.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.665 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.665 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:32.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.665 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.665 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.665 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:30:32.665 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.665 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.665 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:32.665 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:32.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f8199f44640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.195:6800/1839191919 conn(0x7f8180040510 legacy=0x7f81800429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f8199f44640 10 monclient: shutdown 2024-09-13T10:30:32.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f8199f44640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:32.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f8199f44640 1 -- 172.21.15.181:0/4057195517 >> v1:172.21.15.181:6790/0 conn(0x7f81940a6ab0 legacy=0x7f819413ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f8193fff640 1 -- 172.21.15.181:0/4057195517 reap_dead start 2024-09-13T10:30:32.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f8193fff640 1 -- 172.21.15.181:0/4057195517 reap_dead start 2024-09-13T10:30:32.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f8199f44640 1 -- 172.21.15.181:0/4057195517 shutdown_connections 2024-09-13T10:30:32.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f8199f44640 1 -- 172.21.15.181:0/4057195517 >> 172.21.15.181:0/4057195517 conn(0x7f81940abcd0 msgr2=0x7f81940a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:32.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f8199f44640 1 -- 172.21.15.181:0/4057195517 shutdown_connections 2024-09-13T10:30:32.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.610+0000 7f8199f44640 1 -- 172.21.15.181:0/4057195517 wait complete. 2024-09-13T10:30:32.668 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:30:32.668 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:30:32.668 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:30:32.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.764+0000 7fa842459640 10 monclient: get_monmap_and_config 2024-09-13T10:30:32.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.764+0000 7fa842459640 10 monclient: build_initial_monmap 2024-09-13T10:30:32.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.764+0000 7fa842459640 10 monclient: monmap: 2024-09-13T10:30:32.766 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:32.765114+0000 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:32.765114+0000 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:32.767 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:32.768 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 1 Processor -- start 2024-09-13T10:30:32.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 1 -- start start 2024-09-13T10:30:32.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 10 monclient: init 2024-09-13T10:30:32.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:32.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 10 monclient: _add_conns ranks=[4,8,0,7,1,6,3,5,2] 2024-09-13T10:30:32.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 10 monclient(hunting): picked mon.noname-c con 0x7fa83c0a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:32.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 10 monclient(hunting): picked mon.noname-e con 0x7fa83c0a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:32.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 10 monclient(hunting): picked mon.noname-a con 0x7fa83c13f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:32.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83c0a4bc0 con 0x7fa83c13f750 2024-09-13T10:30:32.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83c13a320 con 0x7fa83c0a6640 2024-09-13T10:30:32.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83c0a8100 con 0x7fa83c0a8340 2024-09-13T10:30:32.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:32.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.765+0000 7fa842459640 10 monclient(hunting): authenticate will time out at 772.270911s 2024-09-13T10:30:32.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.766+0000 7fa83bfff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fa83c0a6640 0x7fa83c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38550/0 (socket says 172.21.15.181:38550) 2024-09-13T10:30:32.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.766+0000 7fa83bfff640 1 -- 172.21.15.181:0/2693784544 learned_addr learned my addr 172.21.15.181:0/2693784544 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:32.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.766+0000 7fa8409f6640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa83c13f750 0x7fa83c141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50902/0 (socket says 172.21.15.181:50902) 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa8409f6640 1 -- 172.21.15.181:0/2693784544 >> v1:172.21.15.181:6789/0 conn(0x7fa83c13f750 legacy=0x7fa83c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83bfff640 1 -- 172.21.15.181:0/2693784544 >> v1:172.21.15.181:6791/0 conn(0x7fa83c0a6640 legacy=0x7fa83c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83b7fe640 1 -- 172.21.15.181:0/2693784544 >> v1:172.21.15.181:6793/0 conn(0x7fa83c0a8340 legacy=0x7fa83c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 208436573 0 0) 0x7fa83c13a320 con 0x7fa83c0a6640 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient(hunting): my global_id is 4486 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa824003520 con 0x7fa83c0a6640 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284043594 0 0) 0x7fa83c0a4bc0 con 0x7fa83c13f750 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient(hunting): my global_id is 54369 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa83c13a320 con 0x7fa83c13f750 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827711626 0 0) 0x7fa83c0a8100 con 0x7fa83c0a8340 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient(hunting): my global_id is 4517 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa83c0a4bc0 con 0x7fa83c0a8340 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3932521962 0 0) 0x7fa824003520 con 0x7fa83c0a6640 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa8409f6640 1 --1- 172.21.15.181:0/2693784544 >> v1:172.21.15.181:6789/0 conn(0x7fa83c13f750 0x7fa83c141b40 :-1 s=OPENED pgs=102 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fa834001e40 mon_map magic: 0 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 >> v1:172.21.15.181:6793/0 conn(0x7fa83c0a8340 legacy=0x7fa83c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 >> v1:172.21.15.181:6789/0 conn(0x7fa83c13f750 legacy=0x7fa83c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 monclient: found mon.noname-c 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c0a48e0 con 0x7fa83c0a6640 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient: _finish_auth 0 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa82c001a10 con 0x7fa83c0a6640 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa842459640 5 monclient: authenticate success, global_id 4486 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa842459640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:32.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient: dump: 2024-09-13T10:30:32.777 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.777 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.777 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.777 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.777 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.777 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.777 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.777 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.778 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.778 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.778 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.778 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.778 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.778 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.778 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.778 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa842459640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:32.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa834001e40 con 0x7fa83c13f750 2024-09-13T10:30:32.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:30:32.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa82c001ce0 con 0x7fa83c0a6640 2024-09-13T10:30:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa842459640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 1 -- 172.21.15.181:0/2693784544 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa82c004be0 con 0x7fa83c0a6640 2024-09-13T10:30:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa842459640 4 set_mon_vals no callback set 2024-09-13T10:30:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.768+0000 7fa83affd640 10 monclient: dump: 2024-09-13T10:30:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.779 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.780 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.780 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.780 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.780 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.780 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.780 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.780 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.780 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.780 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.780 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.780 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.781 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.769+0000 7fa842459640 10 monclient: shutdown 2024-09-13T10:30:32.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.769+0000 7fa842459640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:32.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.769+0000 7fa842459640 1 -- 172.21.15.181:0/2693784544 >> v1:172.21.15.181:6791/0 conn(0x7fa83c0a6640 legacy=0x7fa83c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.769+0000 7fa842459640 1 -- 172.21.15.181:0/2693784544 shutdown_connections 2024-09-13T10:30:32.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.769+0000 7fa842459640 1 -- 172.21.15.181:0/2693784544 >> 172.21.15.181:0/2693784544 conn(0x7fa83c077170 msgr2=0x7fa83c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:32.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.769+0000 7fa842459640 1 -- 172.21.15.181:0/2693784544 shutdown_connections 2024-09-13T10:30:32.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.769+0000 7fa842459640 1 -- 172.21.15.181:0/2693784544 wait complete. 2024-09-13T10:30:32.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.769+0000 7fa842459640 10 monclient: build_initial_monmap 2024-09-13T10:30:32.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.769+0000 7fa842459640 10 monclient: monmap: 2024-09-13T10:30:32.781 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:32.782 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:32.782 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:32.782 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:32.782 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:32.782 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:32.782 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:32.782 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:32.782 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:32.782 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:32.782 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:32.783 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:32.783 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:32.783 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:32.783 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:32.783 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 1 Processor -- start 2024-09-13T10:30:32.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 1 -- start start 2024-09-13T10:30:32.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 10 monclient: init 2024-09-13T10:30:32.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:32.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 10 monclient: _add_conns ranks=[3,2,6,5,7,1,4,8,0] 2024-09-13T10:30:32.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 10 monclient(hunting): picked mon.noname-g con 0x7fa83c0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:32.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 10 monclient(hunting): picked mon.noname-b con 0x7fa83c13f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:32.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 10 monclient(hunting): picked mon.noname-d con 0x7fa83c12eeb0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:32.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83c13c6d0 con 0x7fa83c13f750 2024-09-13T10:30:32.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83c134ce0 con 0x7fa83c0a8340 2024-09-13T10:30:32.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83c12f2f0 con 0x7fa83c12eeb0 2024-09-13T10:30:32.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:32.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa842459640 10 monclient(hunting): authenticate will time out at 772.275916s 2024-09-13T10:30:32.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa83b7fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fa83c13f750 0x7fa83c1d3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48614/0 (socket says 172.21.15.181:48614) 2024-09-13T10:30:32.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.770+0000 7fa83b7fe640 1 -- 172.21.15.181:0/8339555 learned_addr learned my addr 172.21.15.181:0/8339555 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:32.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa83b7fe640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.181:6790/0 conn(0x7fa83c13f750 legacy=0x7fa83c1d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa8409f6640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.181:6792/0 conn(0x7fa83c12eeb0 legacy=0x7fa83c1d6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090507760 0 0) 0x7fa83c13c6d0 con 0x7fa83c13f750 2024-09-13T10:30:32.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): my global_id is 4493 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa828003550 con 0x7fa83c13f750 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4255754638 0 0) 0x7fa834002090 con 0x7fa83c12eeb0 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): my global_id is 4434 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa83c13c6d0 con 0x7fa83c12eeb0 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa83bfff640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.195:6790/0 conn(0x7fa83c0a8340 legacy=0x7fa83c12e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4226964011 0 0) 0x7fa828003550 con 0x7fa83c13f750 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa834002090 con 0x7fa83c13f750 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa830003610 con 0x7fa83c13f750 2024-09-13T10:30:32.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): dump: 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.792 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3043683865 0 0) 0x7fa83c13c6d0 con 0x7fa83c12eeb0 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa828003550 con 0x7fa83c12eeb0 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa834004b60 con 0x7fa83c12eeb0 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): dump: 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.793 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.794 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616201647 0 0) 0x7fa83c0a48e0 con 0x7fa83c0a8340 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient(hunting): my global_id is 4413 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa83c13c6d0 con 0x7fa83c0a8340 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3375871742 0 0) 0x7fa834002090 con 0x7fa83c13f750 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.181:6792/0 conn(0x7fa83c12eeb0 legacy=0x7fa83c1d6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.195:6790/0 conn(0x7fa83c0a8340 legacy=0x7fa83c12e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 monclient: found mon.b 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:32.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c134100 con 0x7fa83c13f750 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient: _finish_auth 0 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa842459640 5 monclient: authenticate success, global_id 4493 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa842459640 10 monclient: _renew_subs 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa842459640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa842459640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa83c13e190 con 0x7fa83c13f750 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa842459640 10 monclient: _renew_subs 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa842459640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa842459640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa83c13d230 con 0x7fa83c13f750 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa830003bd0 con 0x7fa83c13f750 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa830004140 con 0x7fa83c13f750 2024-09-13T10:30:32.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa83a7fc640 4 set_mon_vals no callback set 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.773+0000 7fa838ff9640 10 monclient: dump: 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.797 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.798 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.798 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.798 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.798 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.798 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.774+0000 7fa842459640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:32.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.774+0000 7fa842459640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa81c0065c0 con 0x7fa81c002860 2024-09-13T10:30:32.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.774+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa8300042e0 con 0x7fa83c13f750 2024-09-13T10:30:32.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.774+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 88007995 0 0) 0x7fa83004e380 con 0x7fa83c13f750 2024-09-13T10:30:32.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.774+0000 7fa8409f6640 10 monclient: get_auth_request con 0x7fa828040340 auth_method 0 2024-09-13T10:30:32.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.776+0000 7fa83bfff640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.195:6790/0 conn(0x7fa81c002860 legacy=0x7fa81c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1253825583 0 0) 0x7fa81c0065c0 con 0x7fa81c002860 2024-09-13T10:30:32.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 10 monclient(hunting): my global_id is 4422 2024-09-13T10:30:32.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa834002090 con 0x7fa81c002860 2024-09-13T10:30:32.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3153013723 0 0) 0x7fa834002090 con 0x7fa81c002860 2024-09-13T10:30:32.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa81c0065c0 con 0x7fa81c002860 2024-09-13T10:30:32.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa82c004c60 con 0x7fa81c002860 2024-09-13T10:30:32.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:32.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 10 monclient: dump: 2024-09-13T10:30:32.800 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.800 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.800 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.800 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.800 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.800 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.800 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.800 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.800 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.800 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.800 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.801 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.801 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.801 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.801 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.801 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4009016219 0 0) 0x7fa81c0065c0 con 0x7fa81c002860 2024-09-13T10:30:32.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa81c00a160 con 0x7fa81c002860 2024-09-13T10:30:32.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa82c0015e0 con 0x7fa81c002860 2024-09-13T10:30:32.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:32.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:32.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.195:6790/0 conn(0x7fa81c002860 legacy=0x7fa81c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.777+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.195:6790/0 conn(0x7fa81c002860 legacy=0x7fa81c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:32.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.783+0000 7fa842459640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:32.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.783+0000 7fa842459640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa81c009e70 con 0x7fa81c009130 2024-09-13T10:30:32.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.786+0000 7fa83bfff640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.195:6790/0 conn(0x7fa81c009130 legacy=0x7fa81c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.786+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2406163309 0 0) 0x7fa81c009e70 con 0x7fa81c009130 2024-09-13T10:30:32.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.786+0000 7fa838ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.786+0000 7fa838ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.786+0000 7fa838ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.786+0000 7fa838ff9640 10 monclient(hunting): my global_id is 4431 2024-09-13T10:30:32.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.786+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa81c0065c0 con 0x7fa81c009130 2024-09-13T10:30:32.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3748929424 0 0) 0x7fa81c0065c0 con 0x7fa81c009130 2024-09-13T10:30:32.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa81c009e70 con 0x7fa81c009130 2024-09-13T10:30:32.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa82c001a90 con 0x7fa81c009130 2024-09-13T10:30:32.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:32.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 10 monclient: dump: 2024-09-13T10:30:32.803 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.803 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.803 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.803 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.803 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.804 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.804 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.804 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.804 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.804 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.804 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.804 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.804 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.804 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.804 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.805 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2948951003 0 0) 0x7fa81c009e70 con 0x7fa81c009130 2024-09-13T10:30:32.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa81c00c3f0 con 0x7fa81c009130 2024-09-13T10:30:32.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 1753658224) 0x7fa82c007480 con 0x7fa81c009130 2024-09-13T10:30:32.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:32.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:32.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.195:6790/0 conn(0x7fa81c009130 legacy=0x7fa81c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa838ff9640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.195:6790/0 conn(0x7fa81c009130 legacy=0x7fa81c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:32.806 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 22, 2024-09-13T10:30:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 47202, 2024-09-13T10:30:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:32.806 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:30:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 30, 2024-09-13T10:30:32.807 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.808 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.809 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:32.810 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:32.811 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:32.811 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:32.811 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:32.811 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:32.811 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:32.811 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:32.811 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:32.811 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:32.811 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:32.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.813 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:32.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.813 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:32.813 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:32.813 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.813 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.813 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.814 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:32.814 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.814 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.814 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.814 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:32.815 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:32.815 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.815 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.815 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.815 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:32.815 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:32.815 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.815 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.815 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.816 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:32.817 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:32.817 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.817 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:32.817 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.817 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:32.817 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:32.818 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.818 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.818 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.818 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:32.818 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:32.818 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.818 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:32.819 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.819 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.819 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:32.819 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:32.819 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.819 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.819 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:32.820 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.821 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.822 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:32.822 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:32.822 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.822 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.822 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.822 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:32.822 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:32.822 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.823 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.825 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.826 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.827 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.828 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:32.828 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:32.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.787+0000 7fa842459640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa828040340 legacy=0x7fa828042800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.788+0000 7fa842459640 10 monclient: shutdown 2024-09-13T10:30:32.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.788+0000 7fa842459640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:32.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.788+0000 7fa842459640 1 -- 172.21.15.181:0/8339555 >> v1:172.21.15.181:6790/0 conn(0x7fa83c13f750 legacy=0x7fa83c1d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.788+0000 7fa8409f6640 1 -- 172.21.15.181:0/8339555 reap_dead start 2024-09-13T10:30:32.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.788+0000 7fa8409f6640 1 -- 172.21.15.181:0/8339555 reap_dead start 2024-09-13T10:30:32.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.788+0000 7fa842459640 1 -- 172.21.15.181:0/8339555 shutdown_connections 2024-09-13T10:30:32.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.788+0000 7fa842459640 1 -- 172.21.15.181:0/8339555 >> 172.21.15.181:0/8339555 conn(0x7fa83c0a6640 msgr2=0x7fa83c0a6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:32.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.788+0000 7fa842459640 1 -- 172.21.15.181:0/8339555 shutdown_connections 2024-09-13T10:30:32.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.788+0000 7fa842459640 1 -- 172.21.15.181:0/8339555 wait complete. 2024-09-13T10:30:32.831 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:30:32.831 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:30:32.831 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:30:32.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.928+0000 7f56d48a2640 10 monclient: get_monmap_and_config 2024-09-13T10:30:32.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.928+0000 7f56d48a2640 10 monclient: build_initial_monmap 2024-09-13T10:30:32.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.928+0000 7f56d48a2640 10 monclient: monmap: 2024-09-13T10:30:32.930 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:32.930 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.930 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:32.928860+0000 2024-09-13T10:30:32.930 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:32.928860+0000 2024-09-13T10:30:32.930 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:32.930 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.930 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:32.931 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:32.931 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:32.931 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:32.931 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:32.931 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:32.931 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:32.931 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:32.931 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:32.931 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.928+0000 7f56d48a2640 1 Processor -- start 2024-09-13T10:30:32.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.928+0000 7f56d48a2640 1 -- start start 2024-09-13T10:30:32.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.928+0000 7f56d48a2640 10 monclient: init 2024-09-13T10:30:32.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.929+0000 7f56d48a2640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:32.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.929+0000 7f56d48a2640 10 monclient: _add_conns ranks=[3,8,2,4,7,6,1,0,5] 2024-09-13T10:30:32.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.929+0000 7f56d48a2640 10 monclient(hunting): picked mon.noname-g con 0x7f56d00a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:32.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.929+0000 7f56d48a2640 10 monclient(hunting): picked mon.noname-e con 0x7f56d00a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.929+0000 7f56d48a2640 10 monclient(hunting): picked mon.noname-b con 0x7f56d013f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.929+0000 7f56d48a2640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d00a4bc0 con 0x7f56d013f750 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.929+0000 7f56d48a2640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d013a320 con 0x7f56d00a6640 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.929+0000 7f56d48a2640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d00a8100 con 0x7f56d00a8340 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.929+0000 7f56d48a2640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.929+0000 7f56d48a2640 10 monclient(hunting): authenticate will time out at 772.434626s 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.929+0000 7f56cdd9b640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f56d00a8340 0x7f56d0139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39998/0 (socket says 172.21.15.181:39998) 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.929+0000 7f56cdd9b640 1 -- 172.21.15.181:0/1930595717 learned_addr learned my addr 172.21.15.181:0/1930595717 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cdd9b640 1 -- 172.21.15.181:0/1930595717 >> v1:172.21.15.181:6793/0 conn(0x7f56d00a8340 legacy=0x7f56d0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56ced9d640 1 -- 172.21.15.181:0/1930595717 >> v1:172.21.15.181:6790/0 conn(0x7f56d013f750 legacy=0x7f56d0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56ce59c640 1 -- 172.21.15.181:0/1930595717 >> v1:172.21.15.195:6790/0 conn(0x7f56d00a6640 legacy=0x7f56d0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274942609 0 0) 0x7f56d00a8100 con 0x7f56d00a8340 2024-09-13T10:30:32.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient(hunting): my global_id is 4526 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56b8003520 con 0x7f56d00a8340 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3302412705 0 0) 0x7f56d00a4bc0 con 0x7f56d013f750 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient(hunting): my global_id is 4502 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d00a8100 con 0x7f56d013f750 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174699042 0 0) 0x7f56d013a320 con 0x7f56d00a6640 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient(hunting): my global_id is 4440 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d00a4bc0 con 0x7f56d00a6640 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 144728358 0 0) 0x7f56d00a8100 con 0x7f56d013f750 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 >> v1:172.21.15.181:6793/0 conn(0x7f56d00a8340 legacy=0x7f56d0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 >> v1:172.21.15.195:6790/0 conn(0x7f56d00a6640 legacy=0x7f56d0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient: _finish_hunting 0 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 monclient: found mon.noname-b 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d00a48e0 con 0x7f56d013f750 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient: _finish_auth 0 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient: _check_auth_tickets 2024-09-13T10:30:32.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56c8001e90 con 0x7f56d013f750 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56d48a2640 5 monclient: authenticate success, global_id 4502 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56d48a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient: dump: 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.940 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56d48a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56c8003990 con 0x7f56d013f750 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 1 -- 172.21.15.181:0/1930595717 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56c8003f00 con 0x7f56d013f750 2024-09-13T10:30:32.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56d48a2640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56d48a2640 4 set_mon_vals no callback set 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.932+0000 7f56cd59a640 10 monclient: dump: 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.942 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.933+0000 7f56d48a2640 10 monclient: shutdown 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.933+0000 7f56d48a2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.933+0000 7f56d48a2640 1 -- 172.21.15.181:0/1930595717 >> v1:172.21.15.181:6790/0 conn(0x7f56d013f750 legacy=0x7f56d0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.933+0000 7f56d48a2640 1 -- 172.21.15.181:0/1930595717 shutdown_connections 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.933+0000 7f56d48a2640 1 -- 172.21.15.181:0/1930595717 >> 172.21.15.181:0/1930595717 conn(0x7f56d0077170 msgr2=0x7f56d00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.933+0000 7f56d48a2640 1 -- 172.21.15.181:0/1930595717 shutdown_connections 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.933+0000 7f56d48a2640 1 -- 172.21.15.181:0/1930595717 wait complete. 2024-09-13T10:30:32.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.933+0000 7f56d48a2640 10 monclient: build_initial_monmap 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.933+0000 7f56d48a2640 10 monclient: monmap: 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:32.944 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 1 Processor -- start 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 1 -- start start 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 10 monclient: init 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 10 monclient: _add_conns ranks=[4,0,1,8,7,6,5,2,3] 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 10 monclient(hunting): picked mon.noname-c con 0x7f56d00a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 10 monclient(hunting): picked mon.noname-a con 0x7f56d013f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 10 monclient(hunting): picked mon.noname-f con 0x7f56d00a28d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d00a1070 con 0x7f56d013f750 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d00a9e40 con 0x7f56d00a28d0 2024-09-13T10:30:32.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d0142ed0 con 0x7f56d00a8340 2024-09-13T10:30:32.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:32.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56d48a2640 10 monclient(hunting): authenticate will time out at 772.439763s 2024-09-13T10:30:32.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56ce59c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f56d00a8340 0x7f56d009d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38554/0 (socket says 172.21.15.181:38554) 2024-09-13T10:30:32.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56cdd9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f56d013f750 0x7f56d009d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50906/0 (socket says 172.21.15.181:50906) 2024-09-13T10:30:32.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.934+0000 7f56ce59c640 1 -- 172.21.15.181:0/1025437263 learned_addr learned my addr 172.21.15.181:0/1025437263 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:32.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.936+0000 7f56ce59c640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.181:6791/0 conn(0x7f56d00a8340 legacy=0x7f56d009d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.936+0000 7f56cdd9b640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.181:6789/0 conn(0x7f56d013f750 legacy=0x7f56d009d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1198293850 0 0) 0x7f56d0142ed0 con 0x7f56d00a8340 2024-09-13T10:30:32.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): my global_id is 4495 2024-09-13T10:30:32.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56b0003550 con 0x7f56d00a8340 2024-09-13T10:30:32.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291561795 0 0) 0x7f56d00a1070 con 0x7f56d013f750 2024-09-13T10:30:32.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): my global_id is 54378 2024-09-13T10:30:32.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d0142ed0 con 0x7f56d013f750 2024-09-13T10:30:32.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56ced9d640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.195:6789/0 conn(0x7f56d00a28d0 legacy=0x7f56d01d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4005554586 0 0) 0x7f56b0003550 con 0x7f56d00a8340 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56d00a1070 con 0x7f56d00a8340 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56c0003610 con 0x7f56d00a8340 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): dump: 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.952 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3886415498 0 0) 0x7f56d0142ed0 con 0x7f56d013f750 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56b0003550 con 0x7f56d013f750 2024-09-13T10:30:32.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56c40047e0 con 0x7f56d013f750 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): dump: 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.954 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 688466337 0 0) 0x7f56d00a9e40 con 0x7f56d00a28d0 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient(hunting): my global_id is 54505 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d0142ed0 con 0x7f56d00a28d0 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3114758829 0 0) 0x7f56d00a1070 con 0x7f56d00a8340 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.195:6789/0 conn(0x7f56d00a28d0 legacy=0x7f56d01d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.181:6789/0 conn(0x7f56d013f750 legacy=0x7f56d009d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 monclient: found mon.c 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d00a0200 con 0x7f56d00a8340 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient: _finish_auth 0 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56d48a2640 5 monclient: authenticate success, global_id 4495 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56d48a2640 10 monclient: _renew_subs 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56d48a2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56d48a2640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f56d009ed10 con 0x7f56d00a8340 2024-09-13T10:30:32.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56d48a2640 10 monclient: _renew_subs 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56d48a2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56d48a2640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f56d00a0d90 con 0x7f56d00a8340 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56c0003bd0 con 0x7f56d00a8340 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56c0004140 con 0x7f56d00a8340 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56ccd99640 4 set_mon_vals no callback set 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.937+0000 7f56beffd640 10 monclient: dump: 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.957 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.938+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f56c00042e0 con 0x7f56d00a8340 2024-09-13T10:30:32.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.938+0000 7f56d48a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.938+0000 7f56d48a2640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f56b40065c0 con 0x7f56b4002860 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.938+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 88007995 0 0) 0x7f56c004e480 con 0x7f56d00a8340 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.938+0000 7f56ced9d640 10 monclient: get_auth_request con 0x7f56b0040340 auth_method 0 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56cdd9b640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.195:6791/0 conn(0x7f56b4002860 legacy=0x7f56b4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2717674916 0 0) 0x7f56b40065c0 con 0x7f56b4002860 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 10 monclient(hunting): my global_id is 4496 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d00a1070 con 0x7f56b4002860 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1520801076 0 0) 0x7f56d00a1070 con 0x7f56b4002860 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56b40065c0 con 0x7f56b4002860 2024-09-13T10:30:32.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56c4005160 con 0x7f56b4002860 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 10 monclient: dump: 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.960 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 314262156 0 0) 0x7f56b40065c0 con 0x7f56b4002860 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.941+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56b400a160 con 0x7f56b4002860 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.942+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f56c4007340 con 0x7f56b4002860 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.942+0000 7f56beffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.942+0000 7f56beffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.942+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.195:6791/0 conn(0x7f56b4002860 legacy=0x7f56b4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.942+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.195:6791/0 conn(0x7f56b4002860 legacy=0x7f56b4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.948+0000 7f56d48a2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:32.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.948+0000 7f56d48a2640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f56b4009e70 con 0x7f56b4009130 2024-09-13T10:30:32.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56cdd9b640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.195:6791/0 conn(0x7f56b4009130 legacy=0x7f56b40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:32.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310158692 0 0) 0x7f56b4009e70 con 0x7f56b4009130 2024-09-13T10:30:32.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56beffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:32.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56beffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:32.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56beffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:32.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56beffd640 10 monclient(hunting): my global_id is 4505 2024-09-13T10:30:32.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56b40065c0 con 0x7f56b4009130 2024-09-13T10:30:32.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3949837060 0 0) 0x7f56b40065c0 con 0x7f56b4009130 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56b4009e70 con 0x7f56b4009130 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56c4005ab0 con 0x7f56b4009130 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56beffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.950+0000 7f56beffd640 10 monclient: dump: 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:32.964 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.951+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3623955052 0 0) 0x7f56b4009e70 con 0x7f56b4009130 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.951+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f56b400c3f0 con 0x7f56b4009130 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.951+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 1650751420) 0x7f56c4006f60 con 0x7f56b4009130 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.951+0000 7f56beffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.951+0000 7f56beffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.951+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.195:6791/0 conn(0x7f56b4009130 legacy=0x7f56b40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.951+0000 7f56beffd640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.195:6791/0 conn(0x7f56b4009130 legacy=0x7f56b40095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:32.966 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:32.966 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:32.966 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:32.966 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:32.966 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 22, 2024-09-13T10:30:32.966 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 47379, 2024-09-13T10:30:32.966 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:32.966 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:32.967 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:32.967 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:30:32.967 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:32.967 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:32.967 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:32.967 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:32.967 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:32.967 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:32.967 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.967 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 31, 2024-09-13T10:30:32.967 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:32.967 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.968 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.969 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:32.970 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:32.971 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:32.971 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:32.971 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:32.971 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:32.971 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:32.971 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:32.971 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:32.971 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:32.971 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:32.971 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:32.971 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:32.971 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:32.972 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.974 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.975 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:32.976 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.977 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.978 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.981 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:32.981 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:32.981 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.981 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.981 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.981 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:32.981 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.981 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.981 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.981 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:32.982 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:32.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.984 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:32.985 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:32.986 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:30:32.986 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:32.986 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:32.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:32.986 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:32.986 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:32.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.951+0000 7f56d48a2640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.195:6800/1839191919 conn(0x7f56b0040340 legacy=0x7f56b0042800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.951+0000 7f56d48a2640 10 monclient: shutdown 2024-09-13T10:30:32.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.951+0000 7f56d48a2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:32.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.951+0000 7f56d48a2640 1 -- 172.21.15.181:0/1025437263 >> v1:172.21.15.181:6791/0 conn(0x7f56d00a8340 legacy=0x7f56d009d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:32.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.951+0000 7f56ced9d640 1 -- 172.21.15.181:0/1025437263 reap_dead start 2024-09-13T10:30:32.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.952+0000 7f56ced9d640 1 -- 172.21.15.181:0/1025437263 reap_dead start 2024-09-13T10:30:32.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.952+0000 7f56d48a2640 1 -- 172.21.15.181:0/1025437263 shutdown_connections 2024-09-13T10:30:32.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.952+0000 7f56d48a2640 1 -- 172.21.15.181:0/1025437263 >> 172.21.15.181:0/1025437263 conn(0x7f56d00a6640 msgr2=0x7f56d013ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:32.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.952+0000 7f56d48a2640 1 -- 172.21.15.181:0/1025437263 shutdown_connections 2024-09-13T10:30:32.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:32.952+0000 7f56d48a2640 1 -- 172.21.15.181:0/1025437263 wait complete. 2024-09-13T10:30:32.988 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:30:32.988 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:30:32.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:30:33.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.086+0000 7fd9fdefe640 10 monclient: get_monmap_and_config 2024-09-13T10:30:33.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.086+0000 7fd9fdefe640 10 monclient: build_initial_monmap 2024-09-13T10:30:33.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.086+0000 7fd9fdefe640 10 monclient: monmap: 2024-09-13T10:30:33.088 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:33.088 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.088 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:33.087124+0000 2024-09-13T10:30:33.088 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:33.087124+0000 2024-09-13T10:30:33.088 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:33.088 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.088 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:33.089 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:33.089 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:33.089 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:33.089 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:33.089 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:33.089 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:33.089 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:33.089 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:33.089 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 1 Processor -- start 2024-09-13T10:30:33.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 1 -- start start 2024-09-13T10:30:33.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 10 monclient: init 2024-09-13T10:30:33.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:33.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 10 monclient: _add_conns ranks=[5,2,8,6,4,3,0,7,1] 2024-09-13T10:30:33.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 10 monclient(hunting): picked mon.noname-h con 0x7fd9f80a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:33.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 10 monclient(hunting): picked mon.noname-b con 0x7fd9f80a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:33.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 10 monclient(hunting): picked mon.noname-e con 0x7fd9f813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:33.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f80a4bc0 con 0x7fd9f80a8340 2024-09-13T10:30:33.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f813a320 con 0x7fd9f80a6640 2024-09-13T10:30:33.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f80a8100 con 0x7fd9f813f750 2024-09-13T10:30:33.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:33.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9fdefe640 10 monclient(hunting): authenticate will time out at 772.592916s 2024-09-13T10:30:33.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.087+0000 7fd9f7fff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fd9f813f750 0x7fd9f8141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40010/0 (socket says 172.21.15.181:40010) 2024-09-13T10:30:33.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.088+0000 7fd9f7fff640 1 -- 172.21.15.181:0/727028282 learned_addr learned my addr 172.21.15.181:0/727028282 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:33.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.088+0000 7fd9f6ffd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fd9f80a8340 0x7fd9f8139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:48624/0 (socket says 172.21.15.181:48624) 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f7fff640 1 -- 172.21.15.181:0/727028282 >> v1:172.21.15.181:6793/0 conn(0x7fd9f813f750 legacy=0x7fd9f8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f6ffd640 1 -- 172.21.15.181:0/727028282 >> v1:172.21.15.181:6790/0 conn(0x7fd9f80a8340 legacy=0x7fd9f8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 1 -- 172.21.15.181:0/727028282 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2863333401 0 0) 0x7fd9f80a8100 con 0x7fd9f813f750 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient(hunting): my global_id is 4535 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 1 -- 172.21.15.181:0/727028282 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9e0003520 con 0x7fd9f813f750 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 1 -- 172.21.15.181:0/727028282 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1871531705 0 0) 0x7fd9f80a4bc0 con 0x7fd9f80a8340 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient(hunting): my global_id is 4511 2024-09-13T10:30:33.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f77fe640 1 -- 172.21.15.181:0/727028282 >> v1:172.21.15.195:6791/0 conn(0x7fd9f80a6640 legacy=0x7fd9f8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 1 -- 172.21.15.181:0/727028282 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9f80a8100 con 0x7fd9f80a8340 2024-09-13T10:30:33.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 1 -- 172.21.15.181:0/727028282 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4072924779 0 0) 0x7fd9e0003520 con 0x7fd9f813f750 2024-09-13T10:30:33.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 1 -- 172.21.15.181:0/727028282 >> v1:172.21.15.195:6791/0 conn(0x7fd9f80a6640 legacy=0x7fd9f8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 1 -- 172.21.15.181:0/727028282 >> v1:172.21.15.181:6790/0 conn(0x7fd9f80a8340 legacy=0x7fd9f8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:33.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 1 monclient: found mon.noname-e 2024-09-13T10:30:33.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:33.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:30:33.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 1 -- 172.21.15.181:0/727028282 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f80a48e0 con 0x7fd9f813f750 2024-09-13T10:30:33.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:33.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 1 -- 172.21.15.181:0/727028282 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9f0001f20 con 0x7fd9f813f750 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9fdefe640 5 monclient: authenticate success, global_id 4535 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9fdefe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient: dump: 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.099 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9fdefe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f7fff640 1 --1- 172.21.15.181:0/727028282 >> v1:172.21.15.181:6793/0 conn(0x7fd9f813f750 0x7fd9f8141b40 :-1 s=OPENED pgs=97 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fd9f0004c20 config(0 keys) 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 1 -- 172.21.15.181:0/727028282 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9f0004c20 con 0x7fd9f813f750 2024-09-13T10:30:33.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9f67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9fdefe640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.090+0000 7fd9fdefe640 4 set_mon_vals no callback set 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.091+0000 7fd9fdefe640 10 monclient: shutdown 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.091+0000 7fd9fdefe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.091+0000 7fd9fdefe640 1 -- 172.21.15.181:0/727028282 >> v1:172.21.15.181:6793/0 conn(0x7fd9f813f750 legacy=0x7fd9f8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.091+0000 7fd9f67fc640 1 -- 172.21.15.181:0/727028282 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9f00020c0 con 0x7fd9f813f750 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.091+0000 7fd9f67fc640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.091+0000 7fd9fdefe640 1 -- 172.21.15.181:0/727028282 shutdown_connections 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.091+0000 7fd9fdefe640 1 -- 172.21.15.181:0/727028282 >> 172.21.15.181:0/727028282 conn(0x7fd9f8077170 msgr2=0x7fd9f80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.091+0000 7fd9fdefe640 1 -- 172.21.15.181:0/727028282 shutdown_connections 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.091+0000 7fd9fdefe640 1 -- 172.21.15.181:0/727028282 wait complete. 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.091+0000 7fd9fdefe640 10 monclient: build_initial_monmap 2024-09-13T10:30:33.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.091+0000 7fd9fdefe640 10 monclient: monmap: 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:33.102 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 1 Processor -- start 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 1 -- start start 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 10 monclient: init 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 10 monclient: _add_conns ranks=[6,5,4,7,0,1,3,2,8] 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 10 monclient(hunting): picked mon.noname-d con 0x7fd9f80a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 10 monclient(hunting): picked mon.noname-h con 0x7fd9f813f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 10 monclient(hunting): picked mon.noname-c con 0x7fd9f813cac0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f81349d0 con 0x7fd9f813cac0 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f813d400 con 0x7fd9f813f750 2024-09-13T10:30:33.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9f8134130 con 0x7fd9f80a8340 2024-09-13T10:30:33.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:33.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9fdefe640 10 monclient(hunting): authenticate will time out at 772.597758s 2024-09-13T10:30:33.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9f77fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fd9f80a8340 0x7fd9f813bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:45762/0 (socket says 172.21.15.181:45762) 2024-09-13T10:30:33.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.092+0000 7fd9f77fe640 1 -- 172.21.15.181:0/3622884306 learned_addr learned my addr 172.21.15.181:0/3622884306 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:33.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.094+0000 7fd9f77fe640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.181:6792/0 conn(0x7fd9f80a8340 legacy=0x7fd9f813bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.094+0000 7fd9f7fff640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.181:6791/0 conn(0x7fd9f813cac0 legacy=0x7fd9f81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 584917628 0 0) 0x7fd9f8134130 con 0x7fd9f80a8340 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): my global_id is 4443 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9e4003550 con 0x7fd9f80a8340 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 467752522 0 0) 0x7fd9f81349d0 con 0x7fd9f813cac0 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): my global_id is 4504 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9f8134130 con 0x7fd9f813cac0 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9f6ffd640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.195:6791/0 conn(0x7fd9f813f750 legacy=0x7fd9f813c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1312249820 0 0) 0x7fd9f8134130 con 0x7fd9f813cac0 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9f81349d0 con 0x7fd9f813cac0 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3597792838 0 0) 0x7fd9e4003550 con 0x7fd9f80a8340 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9f8134130 con 0x7fd9f80a8340 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9f0001de0 con 0x7fd9f813cac0 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): dump: 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:33.110 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9e8003610 con 0x7fd9f80a8340 2024-09-13T10:30:33.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): dump: 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:33.112 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:33.113 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:33.113 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:33.113 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:33.113 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:33.113 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108315365 0 0) 0x7fd9f813d400 con 0x7fd9f813f750 2024-09-13T10:30:33.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient(hunting): my global_id is 4523 2024-09-13T10:30:33.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9e4003550 con 0x7fd9f813f750 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3938182662 0 0) 0x7fd9f81349d0 con 0x7fd9f813cac0 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.181:6792/0 conn(0x7fd9f80a8340 legacy=0x7fd9f813bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.195:6791/0 conn(0x7fd9f813f750 legacy=0x7fd9f813c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 monclient: found mon.c 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f8134410 con 0x7fd9f813cac0 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient: _finish_auth 0 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9fdefe640 5 monclient: authenticate success, global_id 4504 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9fdefe640 10 monclient: _renew_subs 2024-09-13T10:30:33.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9fdefe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:33.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9fdefe640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f813e740 con 0x7fd9f813cac0 2024-09-13T10:30:33.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9fdefe640 10 monclient: _renew_subs 2024-09-13T10:30:33.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9fdefe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:33.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9fdefe640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd9f81d7b60 con 0x7fd9f813cac0 2024-09-13T10:30:33.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9f0001f80 con 0x7fd9f813cac0 2024-09-13T10:30:33.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:33.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9f0001900 con 0x7fd9f813cac0 2024-09-13T10:30:33.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:33.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9f5ffb640 4 set_mon_vals no callback set 2024-09-13T10:30:33.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:33.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.095+0000 7fd9dffff640 10 monclient: dump: 2024-09-13T10:30:33.115 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:33.116 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:33.117 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:33.117 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.096+0000 7fd9fdefe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:33.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.096+0000 7fd9fdefe640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd9d80065c0 con 0x7fd9d8002860 2024-09-13T10:30:33.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.096+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fd9f0011d10 con 0x7fd9f813cac0 2024-09-13T10:30:33.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.096+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 88007995 0 0) 0x7fd9f004e570 con 0x7fd9f813cac0 2024-09-13T10:30:33.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.096+0000 7fd9f6ffd640 10 monclient: get_auth_request con 0x7fd9e40401f0 auth_method 0 2024-09-13T10:30:33.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.098+0000 7fd9f77fe640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.195:6792/0 conn(0x7fd9d8002860 legacy=0x7fd9d8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.098+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984882510 0 0) 0x7fd9d80065c0 con 0x7fd9d8002860 2024-09-13T10:30:33.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.098+0000 7fd9dffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.098+0000 7fd9dffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.098+0000 7fd9dffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.098+0000 7fd9dffff640 10 monclient(hunting): my global_id is 54475 2024-09-13T10:30:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.098+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9f81349d0 con 0x7fd9d8002860 2024-09-13T10:30:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3803153557 0 0) 0x7fd9f81349d0 con 0x7fd9d8002860 2024-09-13T10:30:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9d80065c0 con 0x7fd9d8002860 2024-09-13T10:30:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9e8004160 con 0x7fd9d8002860 2024-09-13T10:30:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 10 monclient: dump: 2024-09-13T10:30:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.118 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4091794024 0 0) 0x7fd9d80065c0 con 0x7fd9d8002860 2024-09-13T10:30:33.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9d800a160 con 0x7fd9d8002860 2024-09-13T10:30:33.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd9e8004400 con 0x7fd9d8002860 2024-09-13T10:30:33.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:33.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:33.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.195:6792/0 conn(0x7fd9d8002860 legacy=0x7fd9d8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.099+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.195:6792/0 conn(0x7fd9d8002860 legacy=0x7fd9d8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:33.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.105+0000 7fd9fdefe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:33.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.105+0000 7fd9fdefe640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd9d8009e70 con 0x7fd9d8009130 2024-09-13T10:30:33.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9f77fe640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.195:6792/0 conn(0x7fd9d8009130 legacy=0x7fd9d80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686881754 0 0) 0x7fd9d8009e70 con 0x7fd9d8009130 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 10 monclient(hunting): my global_id is 54484 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9d80065c0 con 0x7fd9d8009130 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2979612726 0 0) 0x7fd9d80065c0 con 0x7fd9d8009130 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9d8009e70 con 0x7fd9d8009130 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9e8005df0 con 0x7fd9d8009130 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 10 monclient: dump: 2024-09-13T10:30:33.122 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:33.123 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:33.124 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:33.124 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 266989536 0 0) 0x7fd9d8009e70 con 0x7fd9d8009130 2024-09-13T10:30:33.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.108+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd9d800c3f0 con 0x7fd9d8009130 2024-09-13T10:30:33.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 3595637363) 0x7fd9e8007340 con 0x7fd9d8009130 2024-09-13T10:30:33.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9dffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:33.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9dffff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:33.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.195:6792/0 conn(0x7fd9d8009130 legacy=0x7fd9d80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9dffff640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.195:6792/0 conn(0x7fd9d8009130 legacy=0x7fd9d80095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:33.124 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 22, 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 47528, 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:33.125 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 31, 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:33.126 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:33.127 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:33.127 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:33.127 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:33.127 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:33.127 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:33.127 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:33.127 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:33.127 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:33.127 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:33.127 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:33.127 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:33.127 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:33.128 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:33.129 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:33.130 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:33.130 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:33.130 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:33.130 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:33.130 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:33.130 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:33.130 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:33.130 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:33.130 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:33.130 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:33.130 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:33.130 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:33.131 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:33.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.131 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:33.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.131 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:33.131 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:33.131 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:33.131 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:33.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.131 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:33.131 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:33.132 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:33.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.132 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:33.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.132 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:33.132 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:33.132 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:33.133 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:33.134 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:33.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.136 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:33.137 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:33.137 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:33.137 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:33.137 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:33.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.137 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:33.137 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:33.137 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:33.137 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:33.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.137 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.138 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:33.139 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:33.140 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:33.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.140 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:33.140 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:33.140 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:33.140 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:33.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.140 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:33.140 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:33.140 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:33.140 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:33.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.142 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:33.143 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.144 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:33.145 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:30:33.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.145 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:33.145 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:33.145 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:33.145 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.145 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:33.145 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:33.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:33.145 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:33.145 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:33.145 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:30:33.146 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:33.146 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:33.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:33.146 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:33.146 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:33.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9fdefe640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.195:6800/1839191919 conn(0x7fd9e40401f0 legacy=0x7fd9e40426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9fdefe640 10 monclient: shutdown 2024-09-13T10:30:33.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9fdefe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:33.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9fdefe640 1 -- 172.21.15.181:0/3622884306 >> v1:172.21.15.181:6791/0 conn(0x7fd9f813cac0 legacy=0x7fd9f81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9f7fff640 1 -- 172.21.15.181:0/3622884306 reap_dead start 2024-09-13T10:30:33.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9f7fff640 1 -- 172.21.15.181:0/3622884306 reap_dead start 2024-09-13T10:30:33.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9fdefe640 1 -- 172.21.15.181:0/3622884306 shutdown_connections 2024-09-13T10:30:33.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9fdefe640 1 -- 172.21.15.181:0/3622884306 >> 172.21.15.181:0/3622884306 conn(0x7fd9f80a6640 msgr2=0x7fd9f80a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:33.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9fdefe640 1 -- 172.21.15.181:0/3622884306 shutdown_connections 2024-09-13T10:30:33.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.109+0000 7fd9fdefe640 1 -- 172.21.15.181:0/3622884306 wait complete. 2024-09-13T10:30:33.148 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:30:33.149 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-13T10:30:33.149 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-13T10:30:33.149 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-13T10:30:33.149 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-13T10:30:33.149 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T10:30:33.149 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:30:33.161 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T10:30:33.161 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-09-13T10:30:33.161 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:30:33.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.295+0000 7f2db8460640 10 monclient: get_monmap_and_config 2024-09-13T10:30:33.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.295+0000 7f2db8460640 10 monclient: build_initial_monmap 2024-09-13T10:30:33.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.295+0000 7f2db8460640 10 monclient: monmap: 2024-09-13T10:30:33.298 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:33.298 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.298 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:33.296331+0000 2024-09-13T10:30:33.298 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:33.296331+0000 2024-09-13T10:30:33.298 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:33.298 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.298 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:33.298 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:33.298 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:33.298 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:33.299 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:33.299 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:33.299 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:33.299 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:33.299 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:33.299 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.296+0000 7f2db8460640 1 Processor -- start 2024-09-13T10:30:33.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.296+0000 7f2db8460640 1 -- start start 2024-09-13T10:30:33.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.296+0000 7f2db8460640 10 monclient: init 2024-09-13T10:30:33.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.297+0000 7f2db8460640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:33.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.297+0000 7f2db8460640 10 monclient: _add_conns ranks=[5,4,3,2,8,0,7,1,6] 2024-09-13T10:30:33.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.297+0000 7f2db8460640 10 monclient(hunting): picked mon.noname-h con 0x7f2db00a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:33.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.297+0000 7f2db8460640 10 monclient(hunting): picked mon.noname-c con 0x7f2db00a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:33.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.297+0000 7f2db8460640 10 monclient(hunting): picked mon.noname-g con 0x7f2db013f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:33.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.297+0000 7f2db8460640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db00a4bc0 con 0x7f2db013f750 2024-09-13T10:30:33.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.297+0000 7f2db8460640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db013a320 con 0x7f2db00a8340 2024-09-13T10:30:33.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.297+0000 7f2db8460640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db00a8100 con 0x7f2db00a6640 2024-09-13T10:30:33.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.297+0000 7f2db8460640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:33.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.297+0000 7f2db8460640 10 monclient(hunting): authenticate will time out at 772.802180s 2024-09-13T10:30:33.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.297+0000 7f2db59fb640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f2db00a8340 0x7f2db0139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35830/0 (socket says 172.21.15.181:35830) 2024-09-13T10:30:33.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.297+0000 7f2db59fb640 1 -- 172.21.15.181:0/1698515926 learned_addr learned my addr 172.21.15.181:0/1698515926 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:33.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db59fb640 1 -- 172.21.15.181:0/1698515926 >> v1:172.21.15.181:6791/0 conn(0x7f2db00a8340 legacy=0x7f2db0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db61fc640 1 -- 172.21.15.181:0/1698515926 >> v1:172.21.15.195:6791/0 conn(0x7f2db00a6640 legacy=0x7f2db0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db69fd640 1 -- 172.21.15.181:0/1698515926 >> v1:172.21.15.195:6790/0 conn(0x7f2db013f750 legacy=0x7f2db0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3624454483 0 0) 0x7f2db013a320 con 0x7f2db00a8340 2024-09-13T10:30:33.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 10 monclient(hunting): my global_id is 4513 2024-09-13T10:30:33.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d9c003520 con 0x7f2db00a8340 2024-09-13T10:30:33.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690036161 0 0) 0x7f2db00a8100 con 0x7f2db00a6640 2024-09-13T10:30:33.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 10 monclient(hunting): my global_id is 4532 2024-09-13T10:30:33.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2db013a320 con 0x7f2db00a6640 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2500088725 0 0) 0x7f2db00a4bc0 con 0x7f2db013f750 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 10 monclient(hunting): my global_id is 4449 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.299+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2db00a8100 con 0x7f2db013f750 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4084261293 0 0) 0x7f2d9c003520 con 0x7f2db00a8340 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 >> v1:172.21.15.195:6791/0 conn(0x7f2db00a6640 legacy=0x7f2db0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 >> v1:172.21.15.195:6790/0 conn(0x7f2db013f750 legacy=0x7f2db0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 10 monclient: _finish_hunting 0 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 1 monclient: found mon.noname-c 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:33.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db00a48e0 con 0x7f2db00a8340 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 10 monclient: _finish_auth 0 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 10 monclient: _check_auth_tickets 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2da0001ae0 con 0x7f2db00a8340 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db8460640 5 monclient: authenticate success, global_id 4513 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db8460640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 10 monclient: dump: 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.309 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:33.310 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db8460640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:33.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2da00048a0 con 0x7f2db00a8340 2024-09-13T10:30:33.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:33.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 1 -- 172.21.15.181:0/1698515926 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2da0004e10 con 0x7f2db00a8340 2024-09-13T10:30:33.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db8460640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:33.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db8460640 4 set_mon_vals no callback set 2024-09-13T10:30:33.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:33.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:33.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db51fa640 10 monclient: dump: 2024-09-13T10:30:33.311 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:33.311 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.311 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:33.312 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db8460640 10 monclient: shutdown 2024-09-13T10:30:33.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db8460640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:33.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db8460640 1 -- 172.21.15.181:0/1698515926 >> v1:172.21.15.181:6791/0 conn(0x7f2db00a8340 legacy=0x7f2db0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db8460640 1 -- 172.21.15.181:0/1698515926 shutdown_connections 2024-09-13T10:30:33.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db8460640 1 -- 172.21.15.181:0/1698515926 >> 172.21.15.181:0/1698515926 conn(0x7f2db0077170 msgr2=0x7f2db00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:33.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db8460640 1 -- 172.21.15.181:0/1698515926 shutdown_connections 2024-09-13T10:30:33.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.300+0000 7f2db8460640 1 -- 172.21.15.181:0/1698515926 wait complete. 2024-09-13T10:30:33.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.301+0000 7f2db8460640 10 monclient: build_initial_monmap 2024-09-13T10:30:33.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.301+0000 7f2db8460640 10 monclient: monmap: 2024-09-13T10:30:33.313 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:33.313 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:33.313 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:33.314 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:33.314 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:33.314 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:33.314 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:33.314 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:33.314 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:33.314 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:33.314 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:33.314 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:33.314 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:33.314 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:33.314 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.301+0000 7f2db8460640 1 Processor -- start 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.301+0000 7f2db8460640 1 -- start start 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.301+0000 7f2db8460640 10 monclient: init 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.302+0000 7f2db8460640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.302+0000 7f2db8460640 10 monclient: _add_conns ranks=[4,7,6,3,2,5,1,0,8] 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.302+0000 7f2db8460640 10 monclient(hunting): picked mon.noname-c con 0x7f2db00a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.302+0000 7f2db8460640 10 monclient(hunting): picked mon.noname-i con 0x7f2db013f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.302+0000 7f2db8460640 10 monclient(hunting): picked mon.noname-d con 0x7f2db013ba50 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.302+0000 7f2db8460640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db0133ee0 con 0x7f2db00a8340 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.302+0000 7f2db8460640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db013e290 con 0x7f2db013ba50 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.302+0000 7f2db8460640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db013d050 con 0x7f2db013f750 2024-09-13T10:30:33.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.302+0000 7f2db8460640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:33.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.302+0000 7f2db8460640 10 monclient(hunting): authenticate will time out at 772.807227s 2024-09-13T10:30:33.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.302+0000 7f2db61fc640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f2db00a8340 0x7f2db012e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35834/0 (socket says 172.21.15.181:35834) 2024-09-13T10:30:33.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.302+0000 7f2db61fc640 1 -- 172.21.15.181:0/3737907041 learned_addr learned my addr 172.21.15.181:0/3737907041 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:33.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2db61fc640 1 -- 172.21.15.181:0/3737907041 >> v1:172.21.15.181:6791/0 conn(0x7f2db00a8340 legacy=0x7f2db012e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2db69fd640 1 -- 172.21.15.181:0/3737907041 >> v1:172.21.15.181:6792/0 conn(0x7f2db013ba50 legacy=0x7f2db01d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2db59fb640 1 -- 172.21.15.181:0/3737907041 >> v1:172.21.15.195:6792/0 conn(0x7f2db013f750 legacy=0x7f2db01d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:33.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3414023766 0 0) 0x7f2db0133ee0 con 0x7f2db00a8340 2024-09-13T10:30:33.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): my global_id is 4522 2024-09-13T10:30:33.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d94003550 con 0x7f2db00a8340 2024-09-13T10:30:33.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697675377 0 0) 0x7f2db013e290 con 0x7f2db013ba50 2024-09-13T10:30:33.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): my global_id is 4452 2024-09-13T10:30:33.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2db0133ee0 con 0x7f2db013ba50 2024-09-13T10:30:33.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063653376 0 0) 0x7f2db013d050 con 0x7f2db013f750 2024-09-13T10:30:33.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:33.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:33.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:33.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): my global_id is 54493 2024-09-13T10:30:33.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2db013e290 con 0x7f2db013f750 2024-09-13T10:30:33.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3548532337 0 0) 0x7f2d94003550 con 0x7f2db00a8340 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2db013d050 con 0x7f2db00a8340 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2dac003610 con 0x7f2db00a8340 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): dump: 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:33.322 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3481547849 0 0) 0x7f2db0133ee0 con 0x7f2db013ba50 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d94003550 con 0x7f2db013ba50 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2da8002030 con 0x7f2db013ba50 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:33.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:33.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 10 monclient(hunting): dump: 2024-09-13T10:30:33.324 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:33.324 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.324 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.324 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.324 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:33.324 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.324 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:33.324 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:33.324 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:33.324 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:33.325 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:33.325 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:33.325 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:33.325 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:33.325 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:33.325 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 233155515 0 0) 0x7f2db013d050 con 0x7f2db00a8340 2024-09-13T10:30:33.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.304+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 >> v1:172.21.15.195:6792/0 conn(0x7f2db013f750 legacy=0x7f2db01d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 >> v1:172.21.15.181:6792/0 conn(0x7f2db013ba50 legacy=0x7f2db01d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:33.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 1 monclient: found mon.c 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db013e570 con 0x7f2db00a8340 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2db8460640 5 monclient: authenticate success, global_id 4522 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2db8460640 10 monclient: _renew_subs 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2db8460640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2db8460640 1 -- 172.21.15.181:0/3737907041 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2db012edd0 con 0x7f2db00a8340 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2db8460640 10 monclient: _renew_subs 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2db8460640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:33.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2db8460640 1 -- 172.21.15.181:0/3737907041 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2db01d8570 con 0x7f2db00a8340 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2dac003b90 con 0x7f2db00a8340 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2dac0040c0 con 0x7f2db00a8340 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2db49f9640 4 set_mon_vals no callback set 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 10 monclient: dump: 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:33.327 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2dac004260 con 0x7f2db00a8340 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2db8460640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.305+0000 7f2db8460640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:33.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.306+0000 7f2db8460640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:33.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.306+0000 7f2db8460640 1 -- 172.21.15.181:0/3737907041 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d98005080 con 0x7f2db00a8340 2024-09-13T10:30:33.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.306+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 88007995 0 0) 0x7f2dac04e450 con 0x7f2db00a8340 2024-09-13T10:30:33.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.306+0000 7f2db59fb640 10 monclient: get_auth_request con 0x7f2d94040200 auth_method 0 2024-09-13T10:30:33.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.310+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f2dac017960 con 0x7f2db00a8340 2024-09-13T10:30:33.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.310+0000 7f2da6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:33.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.310+0000 7f2da6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:33.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.556+0000 7f2db8460640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:30:33.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.556+0000 7f2db8460640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:30:33.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.556+0000 7f2db8460640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:33.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.556+0000 7f2db8460640 1 -- 172.21.15.181:0/3737907041 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2d98005370 con 0x7f2db00a8340 2024-09-13T10:30:33.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.556+0000 7f2da6ffd640 1 -- 172.21.15.181:0/3737907041 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 261314955) 0x7f2dac017260 con 0x7f2db00a8340 2024-09-13T10:30:33.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.556+0000 7f2da6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:30:33.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.556+0000 7f2da6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:33.559 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":22,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":31,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:30:33.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.558+0000 7f2db8460640 1 -- 172.21.15.181:0/3737907041 >> v1:172.21.15.195:6800/1839191919 conn(0x7f2d94040200 legacy=0x7f2d940426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.558+0000 7f2db8460640 10 monclient: shutdown 2024-09-13T10:30:33.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.558+0000 7f2db8460640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:33.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.558+0000 7f2db8460640 1 -- 172.21.15.181:0/3737907041 >> v1:172.21.15.181:6791/0 conn(0x7f2db00a8340 legacy=0x7f2db012e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:33.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.558+0000 7f2db8460640 1 -- 172.21.15.181:0/3737907041 shutdown_connections 2024-09-13T10:30:33.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.558+0000 7f2db8460640 1 -- 172.21.15.181:0/3737907041 >> 172.21.15.181:0/3737907041 conn(0x7f2db00a6640 msgr2=0x7f2db00a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:33.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.558+0000 7f2db8460640 1 -- 172.21.15.181:0/3737907041 shutdown_connections 2024-09-13T10:30:33.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:33.558+0000 7f2db8460640 1 -- 172.21.15.181:0/3737907041 wait complete. 2024-09-13T10:30:36.571 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:30:36.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.678+0000 7f8d81d75640 10 monclient: get_monmap_and_config 2024-09-13T10:30:36.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.678+0000 7f8d81d75640 10 monclient: build_initial_monmap 2024-09-13T10:30:36.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.678+0000 7f8d81d75640 10 monclient: monmap: 2024-09-13T10:30:36.680 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:36.680 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:36.680 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:36.679147+0000 2024-09-13T10:30:36.680 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:36.679147+0000 2024-09-13T10:30:36.680 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:36.680 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:36.680 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:36.680 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:36.681 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:36.681 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:36.681 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:36.681 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:36.681 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:36.681 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:36.681 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:36.681 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:36.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 1 Processor -- start 2024-09-13T10:30:36.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 1 -- start start 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 10 monclient: init 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 10 monclient: _add_conns ranks=[5,8,4,3,6,7,1,0,2] 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 10 monclient(hunting): picked mon.noname-h con 0x7f8d7c0a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 10 monclient(hunting): picked mon.noname-e con 0x7f8d7c0a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 10 monclient(hunting): picked mon.noname-c con 0x7f8d7c13f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7c0a4bc0 con 0x7f8d7c13f750 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7c13a320 con 0x7f8d7c0a6640 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7c0a8100 con 0x7f8d7c0a8340 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.679+0000 7f8d81d75640 10 monclient(hunting): authenticate will time out at 776.184918s 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.680+0000 7f8d7affd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f8d7c0a8340 0x7f8d7c139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:36470/0 (socket says 172.21.15.181:36470) 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.680+0000 7f8d7affd640 1 -- 172.21.15.181:0/308771983 learned_addr learned my addr 172.21.15.181:0/308771983 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:36.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.680+0000 7f8d7bfff640 1 --1- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6791/0 conn(0x7f8d7c13f750 0x7f8d7c141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35836/0 (socket says 172.21.15.181:35836) 2024-09-13T10:30:36.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.682+0000 7f8d7affd640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6793/0 conn(0x7f8d7c0a8340 legacy=0x7f8d7c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:36.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.682+0000 7f8d7bfff640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6791/0 conn(0x7f8d7c13f750 legacy=0x7f8d7c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:36.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:36.682+0000 7f8d7b7fe640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6791/0 conn(0x7f8d7c0a6640 legacy=0x7f8d7c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:39.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 10 monclient(hunting): tick 2024-09-13T10:30:39.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:30:39.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:30:39.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:30:39.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6793/0 conn(0x7f8d7c0a8340 legacy=0x7f8d7c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:39.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6791/0 conn(0x7f8d7c0a6640 legacy=0x7f8d7c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:39.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6791/0 conn(0x7f8d7c13f750 legacy=0x7f8d7c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:39.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 10 monclient: _add_conns ranks=[0,2,7,1,6,3] 2024-09-13T10:30:39.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-a con 0x7f8d68003960 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:39.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-b con 0x7f8d68007590 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:39.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-i con 0x7f8d6800b320 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:39.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7c0a48e0 con 0x7f8d68003960 2024-09-13T10:30:39.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d68010160 con 0x7f8d68007590 2024-09-13T10:30:39.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d68011400 con 0x7f8d6800b320 2024-09-13T10:30:39.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d797fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:39.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.680+0000 7f8d7affd640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6790/0 conn(0x7f8d68007590 legacy=0x7f8d68009a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:39.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.682+0000 7f8d7b7fe640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6789/0 conn(0x7f8d68003960 legacy=0x7f8d68005d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:39.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.682+0000 7f8d7bfff640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6792/0 conn(0x7f8d6800b320 legacy=0x7f8d6800d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:39.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:39.881+0000 7f8d7affd640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6790/0 conn(0x7f8d68007590 legacy=0x7f8d68009a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:40.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:40.282+0000 7f8d7affd640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6790/0 conn(0x7f8d68007590 legacy=0x7f8d68009a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:41.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:41.083+0000 7f8d7affd640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6790/0 conn(0x7f8d68007590 legacy=0x7f8d68009a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:42.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 10 monclient(hunting): tick 2024-09-13T10:30:42.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:30:42.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6792/0 conn(0x7f8d6800b320 legacy=0x7f8d6800d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6790/0 conn(0x7f8d68007590 legacy=0x7f8d68009a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6789/0 conn(0x7f8d68003960 legacy=0x7f8d68005d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 10 monclient: _add_conns ranks=[3,1,6] 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-g con 0x7f8d68011930 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d7bfff640 1 -- 172.21.15.181:0/308771983 reap_dead start 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-f con 0x7f8d6800f090 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-d con 0x7f8d6800a220 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d68012760 con 0x7f8d6800f090 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d68010160 con 0x7f8d68011930 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6800fe60 con 0x7f8d6800a220 2024-09-13T10:30:42.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.680+0000 7f8d797fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:42.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.683+0000 7f8d7bfff640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6792/0 conn(0x7f8d6800a220 legacy=0x7f8d68009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:42.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.683+0000 7f8d7affd640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6789/0 conn(0x7f8d6800f090 legacy=0x7f8d6800f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:42.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:42.683+0000 7f8d7b7fe640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6790/0 conn(0x7f8d68011930 legacy=0x7f8d68011d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:45.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 10 monclient(hunting): tick 2024-09-13T10:30:45.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:30:45.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:30:45.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:30:45.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6792/0 conn(0x7f8d6800a220 legacy=0x7f8d68009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:45.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6790/0 conn(0x7f8d68011930 legacy=0x7f8d68011d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:45.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6789/0 conn(0x7f8d6800f090 legacy=0x7f8d6800f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:45.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 10 monclient: _add_conns ranks=[7,5,0,1,4,6,2,8,3] 2024-09-13T10:30:45.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-i con 0x7f8d6800a600 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:45.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-h con 0x7f8d6800b7d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:45.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-a con 0x7f8d680191e0 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:45.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d68005dd0 con 0x7f8d680191e0 2024-09-13T10:30:45.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6801dd00 con 0x7f8d6800b7d0 2024-09-13T10:30:45.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6801eee0 con 0x7f8d6800a600 2024-09-13T10:30:45.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.681+0000 7f8d797fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:45.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.683+0000 7f8d7bfff640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6789/0 conn(0x7f8d680191e0 legacy=0x7f8d6801b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:45.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.683+0000 7f8d7b7fe640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6792/0 conn(0x7f8d6800a600 legacy=0x7f8d6800aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:45.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:45.683+0000 7f8d7affd640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6791/0 conn(0x7f8d6800b7d0 legacy=0x7f8d68017ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:48.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 10 monclient(hunting): tick 2024-09-13T10:30:48.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:30:48.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:30:48.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:30:48.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6792/0 conn(0x7f8d6800a600 legacy=0x7f8d6800aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:48.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6791/0 conn(0x7f8d6800b7d0 legacy=0x7f8d68017ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:48.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6789/0 conn(0x7f8d680191e0 legacy=0x7f8d6801b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:48.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d7bfff640 1 -- 172.21.15.181:0/308771983 reap_dead start 2024-09-13T10:30:48.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 10 monclient: _add_conns ranks=[1,6,3,8,4,2] 2024-09-13T10:30:48.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d7bfff640 1 -- 172.21.15.181:0/308771983 reap_dead start 2024-09-13T10:30:48.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-f con 0x7f8d6800a220 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:48.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-d con 0x7f8d68011d10 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:48.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-g con 0x7f8d6800f7a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:48.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d680200c0 con 0x7f8d6800a220 2024-09-13T10:30:48.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d68012190 con 0x7f8d6800f7a0 2024-09-13T10:30:48.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6801f350 con 0x7f8d68011d10 2024-09-13T10:30:48.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.681+0000 7f8d797fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:48.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.683+0000 7f8d7affd640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6792/0 conn(0x7f8d68011d10 legacy=0x7f8d6800f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:48.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.683+0000 7f8d7bfff640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6790/0 conn(0x7f8d6800f7a0 legacy=0x7f8d68009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:48.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:48.683+0000 7f8d7b7fe640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6789/0 conn(0x7f8d6800a220 legacy=0x7f8d6800aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:51.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 10 monclient(hunting): tick 2024-09-13T10:30:51.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:30:51.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:30:51.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:30:51.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6792/0 conn(0x7f8d68011d10 legacy=0x7f8d6800f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:51.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6790/0 conn(0x7f8d6800f7a0 legacy=0x7f8d68009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:51.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.195:6789/0 conn(0x7f8d6800a220 legacy=0x7f8d6800aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:51.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 10 monclient: _add_conns ranks=[4,8,2] 2024-09-13T10:30:51.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-c con 0x7f8d6801f870 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:51.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-e con 0x7f8d68006b70 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:51.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 10 monclient(hunting): picked mon.noname-b con 0x7f8d68006f80 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:51.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6801f520 con 0x7f8d68006f80 2024-09-13T10:30:51.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6801fec0 con 0x7f8d6801f870 2024-09-13T10:30:51.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6801d940 con 0x7f8d68006b70 2024-09-13T10:30:51.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d797fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:51.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.681+0000 7f8d7bfff640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6790/0 conn(0x7f8d68006f80 legacy=0x7f8d6801b170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:51.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.684+0000 7f8d7affd640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6793/0 conn(0x7f8d68006b70 legacy=0x7f8d68017a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:51.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.684+0000 7f8d7b7fe640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6791/0 conn(0x7f8d6801f870 legacy=0x7f8d68006460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:51.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:51.882+0000 7f8d7bfff640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6790/0 conn(0x7f8d68006f80 legacy=0x7f8d6801b170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:52.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.283+0000 7f8d7bfff640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6790/0 conn(0x7f8d68006f80 legacy=0x7f8d6801b170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:52.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.428+0000 7f8d7a7fc640 1 -- 172.21.15.181:0/308771983 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 930853376 0 0) 0x7f8d6801fec0 con 0x7f8d6801f870 2024-09-13T10:30:52.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.428+0000 7f8d7a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:52.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.428+0000 7f8d7a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:52.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.428+0000 7f8d7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:52.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.428+0000 7f8d7a7fc640 10 monclient(hunting): my global_id is 4531 2024-09-13T10:30:52.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.428+0000 7f8d7a7fc640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d64003520 con 0x7f8d6801f870 2024-09-13T10:30:52.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 1 -- 172.21.15.181:0/308771983 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891707312 0 0) 0x7f8d6801d940 con 0x7f8d68006b70 2024-09-13T10:30:52.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:52.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:52.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:52.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 10 monclient(hunting): my global_id is 4544 2024-09-13T10:30:52.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d6801fec0 con 0x7f8d68006b70 2024-09-13T10:30:52.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 1 -- 172.21.15.181:0/308771983 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2081665554 0 0) 0x7f8d64003520 con 0x7f8d6801f870 2024-09-13T10:30:52.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6793/0 conn(0x7f8d68006b70 legacy=0x7f8d68017a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6790/0 conn(0x7f8d68006f80 legacy=0x7f8d6801b170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7bfff640 1 -- 172.21.15.181:0/308771983 reap_dead start 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 1 monclient: found mon.noname-c 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 1 -- 172.21.15.181:0/308771983 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d680222b0 con 0x7f8d6801f870 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.429+0000 7f8d7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d81d75640 5 monclient: authenticate success, global_id 4531 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d81d75640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d7a7fc640 1 -- 172.21.15.181:0/308771983 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d6c001a40 con 0x7f8d6801f870 2024-09-13T10:30:52.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d7a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d7a7fc640 10 monclient: dump: 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.435 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d81d75640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d7a7fc640 1 -- 172.21.15.181:0/308771983 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d6c001be0 con 0x7f8d6801f870 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d7a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d81d75640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d81d75640 4 set_mon_vals no callback set 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d7a7fc640 1 -- 172.21.15.181:0/308771983 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d6c003950 con 0x7f8d6801f870 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d7a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.430+0000 7f8d7a7fc640 10 monclient: dump: 2024-09-13T10:30:52.436 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.437 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.438 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.431+0000 7f8d81d75640 10 monclient: shutdown 2024-09-13T10:30:52.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.431+0000 7f8d81d75640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:52.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.431+0000 7f8d81d75640 1 -- 172.21.15.181:0/308771983 >> v1:172.21.15.181:6791/0 conn(0x7f8d6801f870 legacy=0x7f8d68006460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.431+0000 7f8d81d75640 1 -- 172.21.15.181:0/308771983 shutdown_connections 2024-09-13T10:30:52.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.431+0000 7f8d81d75640 1 -- 172.21.15.181:0/308771983 >> 172.21.15.181:0/308771983 conn(0x7f8d7c077170 msgr2=0x7f8d7c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:52.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.432+0000 7f8d81d75640 1 -- 172.21.15.181:0/308771983 shutdown_connections 2024-09-13T10:30:52.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.432+0000 7f8d81d75640 1 -- 172.21.15.181:0/308771983 wait complete. 2024-09-13T10:30:52.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.433+0000 7f8d81d75640 10 monclient: build_initial_monmap 2024-09-13T10:30:52.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.433+0000 7f8d81d75640 10 monclient: monmap: 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:52.440 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.433+0000 7f8d81d75640 1 Processor -- start 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.434+0000 7f8d81d75640 1 -- start start 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.434+0000 7f8d81d75640 10 monclient: init 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.435+0000 7f8d81d75640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.435+0000 7f8d81d75640 10 monclient: _add_conns ranks=[0,6,8,5,2,1,3,7,4] 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.435+0000 7f8d81d75640 10 monclient(hunting): picked mon.noname-a con 0x7f8d7c09f350 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.435+0000 7f8d81d75640 10 monclient(hunting): picked mon.noname-d con 0x7f8d7c09fe40 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.435+0000 7f8d81d75640 10 monclient(hunting): picked mon.noname-e con 0x7f8d7c1d9070 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.435+0000 7f8d7affd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f8d7c09fe40 0x7f8d7c1d7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:51764/0 (socket says 172.21.15.181:51764) 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.435+0000 7f8d81d75640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7c0a11d0 con 0x7f8d7c09f350 2024-09-13T10:30:52.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.435+0000 7f8d7affd640 1 -- 172.21.15.181:0/2407414677 learned_addr learned my addr 172.21.15.181:0/2407414677 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:52.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.435+0000 7f8d81d75640 1 -- 172.21.15.181:0/2407414677 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7c13f070 con 0x7f8d7c09fe40 2024-09-13T10:30:52.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.435+0000 7f8d81d75640 1 -- 172.21.15.181:0/2407414677 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7c0aa430 con 0x7f8d7c1d9070 2024-09-13T10:30:52.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.435+0000 7f8d81d75640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:52.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.435+0000 7f8d81d75640 10 monclient(hunting): authenticate will time out at 791.940800s 2024-09-13T10:30:52.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.438+0000 7f8d7affd640 1 -- 172.21.15.181:0/2407414677 >> v1:172.21.15.181:6792/0 conn(0x7f8d7c09fe40 legacy=0x7f8d7c1d7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.438+0000 7f8d7bfff640 1 -- 172.21.15.181:0/2407414677 >> v1:172.21.15.181:6793/0 conn(0x7f8d7c1d9070 legacy=0x7f8d7c1db460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.440+0000 7f8d7b7fe640 1 -- 172.21.15.181:0/2407414677 >> v1:172.21.15.181:6789/0 conn(0x7f8d7c09f350 legacy=0x7f8d7c09f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.440+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3984946212 0 0) 0x7f8d7c0a11d0 con 0x7f8d7c09f350 2024-09-13T10:30:52.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.440+0000 7f8d63fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:52.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.440+0000 7f8d63fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:52.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.440+0000 7f8d63fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:52.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.440+0000 7f8d63fff640 10 monclient(hunting): my global_id is 54387 2024-09-13T10:30:52.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.440+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d6801d940 con 0x7f8d7c09f350 2024-09-13T10:30:52.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3845543375 0 0) 0x7f8d6801d940 con 0x7f8d7c09f350 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d7c0a11d0 con 0x7f8d7c09f350 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d6c003950 con 0x7f8d7c09f350 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 10 monclient(hunting): dump: 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.445 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 324144860 0 0) 0x7f8d7c0a11d0 con 0x7f8d7c09f350 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 >> v1:172.21.15.181:6793/0 conn(0x7f8d7c1d9070 legacy=0x7f8d7c1db460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 >> v1:172.21.15.181:6792/0 conn(0x7f8d7c09fe40 legacy=0x7f8d7c1d7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 1 monclient: found mon.a 2024-09-13T10:30:52.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c0a2890 con 0x7f8d7c09f350 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d81d75640 5 monclient: authenticate success, global_id 54387 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d81d75640 10 monclient: _renew_subs 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d81d75640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d81d75640 1 -- 172.21.15.181:0/2407414677 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c0a1650 con 0x7f8d7c09f350 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d81d75640 10 monclient: _renew_subs 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d81d75640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.441+0000 7f8d81d75640 1 -- 172.21.15.181:0/2407414677 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8d7c0a1650 con 0x7f8d7c09f350 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.442+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d6c001b20 con 0x7f8d7c09f350 2024-09-13T10:30:52.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.442+0000 7f8d63fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.442+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d6c0040e0 con 0x7f8d7c09f350 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.442+0000 7f8d63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.442+0000 7f8d63fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.442+0000 7f8d797fa640 4 set_mon_vals no callback set 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.442+0000 7f8d63fff640 10 monclient: dump: 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.448 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.449 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.449 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.449 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.449 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.449 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.449 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.449 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.443+0000 7f8d81d75640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:52.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.443+0000 7f8d81d75640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:52.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.443+0000 7f8d81d75640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:52.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.443+0000 7f8d81d75640 1 -- 172.21.15.181:0/2407414677 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d5c005080 con 0x7f8d7c09f350 2024-09-13T10:30:52.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.444+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f8d6c004280 con 0x7f8d7c09f350 2024-09-13T10:30:52.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.445+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (unknown 3963508485 0 0) 0x7f8d6c04dfa0 con 0x7f8d7c09f350 2024-09-13T10:30:52.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.445+0000 7f8d7affd640 10 monclient: get_auth_request con 0x7f8d68043d90 auth_method 0 2024-09-13T10:30:52.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.451+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f8d6c017550 con 0x7f8d7c09f350 2024-09-13T10:30:52.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.451+0000 7f8d63fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:52.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.451+0000 7f8d63fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:52.542 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35773]: starting. 2024-09-13T10:30:52.542 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35773]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-35772 2024-09-13T10:30:52.542 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35773]: created object 0... 2024-09-13T10:30:52.542 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35773]: created object 25... 2024-09-13T10:30:52.542 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35773]: created object 49... 2024-09-13T10:30:52.542 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35773]: finishing. 2024-09-13T10:30:52.543 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35773]: shutting down. 2024-09-13T10:30:52.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.710+0000 7f8d81d75640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:30:52.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.710+0000 7f8d81d75640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:30:52.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.710+0000 7f8d81d75640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:52.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.710+0000 7f8d81d75640 1 -- 172.21.15.181:0/2407414677 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8d5c005370 con 0x7f8d7c09f350 2024-09-13T10:30:52.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.710+0000 7f8d63fff640 1 -- 172.21.15.181:0/2407414677 <== mon.0 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2738 (unknown 254746657 0 1985342951) 0x7f8d6c016e50 con 0x7f8d7c09f350 2024-09-13T10:30:52.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.710+0000 7f8d63fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:30:52.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.710+0000 7f8d63fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:52.713 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":28,"quorum":[0,1,3,4,5,6,7,8],"quorum_names":["a","f","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:30:52.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.713+0000 7f8d81d75640 1 -- 172.21.15.181:0/2407414677 >> v1:172.21.15.195:6800/1839191919 conn(0x7f8d68043d90 legacy=0x7f8d68046250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.713+0000 7f8d81d75640 10 monclient: shutdown 2024-09-13T10:30:52.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.713+0000 7f8d81d75640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:52.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.713+0000 7f8d81d75640 1 -- 172.21.15.181:0/2407414677 >> v1:172.21.15.181:6789/0 conn(0x7f8d7c09f350 legacy=0x7f8d7c09f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.713+0000 7f8d81d75640 1 -- 172.21.15.181:0/2407414677 shutdown_connections 2024-09-13T10:30:52.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.713+0000 7f8d81d75640 1 -- 172.21.15.181:0/2407414677 >> 172.21.15.181:0/2407414677 conn(0x7f8d6801f870 msgr2=0x7f8d7c0a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:52.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.713+0000 7f8d81d75640 1 -- 172.21.15.181:0/2407414677 shutdown_connections 2024-09-13T10:30:52.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.713+0000 7f8d81d75640 1 -- 172.21.15.181:0/2407414677 wait complete. 2024-09-13T10:30:52.725 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-09-13T10:30:52.726 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-09-13T10:30:52.726 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:30:52.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.822+0000 7fbd8ea31640 10 monclient: get_monmap_and_config 2024-09-13T10:30:52.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.822+0000 7fbd8ea31640 10 monclient: build_initial_monmap 2024-09-13T10:30:52.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.823+0000 7fbd8ea31640 10 monclient: monmap: 2024-09-13T10:30:52.825 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:52.825 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.825 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:52.823607+0000 2024-09-13T10:30:52.825 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:52.823607+0000 2024-09-13T10:30:52.825 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:52.825 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.825 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:52.825 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:52.825 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:52.825 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:52.825 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:52.826 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:52.826 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:52.826 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:52.826 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:52.826 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.823+0000 7fbd8ea31640 1 Processor -- start 2024-09-13T10:30:52.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.823+0000 7fbd8ea31640 1 -- start start 2024-09-13T10:30:52.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.823+0000 7fbd8ea31640 10 monclient: init 2024-09-13T10:30:52.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.824+0000 7fbd8ea31640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:52.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.824+0000 7fbd8ea31640 10 monclient: _add_conns ranks=[0,1,5,2,8,7,6,4,3] 2024-09-13T10:30:52.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.824+0000 7fbd8ea31640 10 monclient(hunting): picked mon.noname-a con 0x7fbd880a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:52.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.824+0000 7fbd8ea31640 10 monclient(hunting): picked mon.noname-f con 0x7fbd880a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:52.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.824+0000 7fbd8ea31640 10 monclient(hunting): picked mon.noname-h con 0x7fbd8813f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:52.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.824+0000 7fbd8ea31640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd880a5fe0 con 0x7fbd880a66d0 2024-09-13T10:30:52.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.824+0000 7fbd8ea31640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd880a8080 con 0x7fbd880a6ab0 2024-09-13T10:30:52.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.824+0000 7fbd8ea31640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd880a42c0 con 0x7fbd8813f9a0 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.824+0000 7fbd8ea31640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.824+0000 7fbd8ea31640 10 monclient(hunting): authenticate will time out at 792.329494s 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.824+0000 7fbd87fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fbd880a66d0 0x7fbd880a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:32858/0 (socket says 172.21.15.181:32858) 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.824+0000 7fbd87fff640 1 -- 172.21.15.181:0/2137432755 learned_addr learned my addr 172.21.15.181:0/2137432755 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.826+0000 7fbd87fff640 1 -- 172.21.15.181:0/2137432755 >> v1:172.21.15.181:6789/0 conn(0x7fbd880a66d0 legacy=0x7fbd880a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.826+0000 7fbd86ffd640 1 -- 172.21.15.181:0/2137432755 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3980210997 0 0) 0x7fbd880a5fe0 con 0x7fbd880a66d0 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.826+0000 7fbd86ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.826+0000 7fbd86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.826+0000 7fbd86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.826+0000 7fbd86ffd640 10 monclient(hunting): my global_id is 54396 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.826+0000 7fbd86ffd640 1 -- 172.21.15.181:0/2137432755 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd70003520 con 0x7fbd880a66d0 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.826+0000 7fbd8cfce640 1 -- 172.21.15.181:0/2137432755 >> v1:172.21.15.195:6791/0 conn(0x7fbd8813f9a0 legacy=0x7fbd88141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.826+0000 7fbd877fe640 1 -- 172.21.15.181:0/2137432755 >> v1:172.21.15.195:6789/0 conn(0x7fbd880a6ab0 legacy=0x7fbd880a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.826+0000 7fbd86ffd640 1 -- 172.21.15.181:0/2137432755 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3746099063 0 0) 0x7fbd70003520 con 0x7fbd880a66d0 2024-09-13T10:30:52.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 1 -- 172.21.15.181:0/2137432755 >> v1:172.21.15.195:6791/0 conn(0x7fbd8813f9a0 legacy=0x7fbd88141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 1 -- 172.21.15.181:0/2137432755 >> v1:172.21.15.195:6789/0 conn(0x7fbd880a6ab0 legacy=0x7fbd880a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:52.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 1 monclient: found mon.noname-a 2024-09-13T10:30:52.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:52.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:30:52.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 1 -- 172.21.15.181:0/2137432755 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd881464e0 con 0x7fbd880a66d0 2024-09-13T10:30:52.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 10 monclient: _finish_auth 0 2024-09-13T10:30:52.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:52.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:52.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd8ea31640 5 monclient: authenticate success, global_id 54396 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 1 -- 172.21.15.181:0/2137432755 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd78001ad0 con 0x7fbd880a66d0 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 10 monclient: dump: 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.833 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd8ea31640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 1 -- 172.21.15.181:0/2137432755 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd780048a0 con 0x7fbd880a66d0 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 1 -- 172.21.15.181:0/2137432755 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd78004dd0 con 0x7fbd880a66d0 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd8ea31640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd8ea31640 4 set_mon_vals no callback set 2024-09-13T10:30:52.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd86ffd640 10 monclient: dump: 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.835 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.836 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.836 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.836 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd8ea31640 10 monclient: shutdown 2024-09-13T10:30:52.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd8ea31640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:52.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd8ea31640 1 -- 172.21.15.181:0/2137432755 >> v1:172.21.15.181:6789/0 conn(0x7fbd880a66d0 legacy=0x7fbd880a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd8ea31640 1 -- 172.21.15.181:0/2137432755 shutdown_connections 2024-09-13T10:30:52.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd8ea31640 1 -- 172.21.15.181:0/2137432755 >> 172.21.15.181:0/2137432755 conn(0x7fbd880abcd0 msgr2=0x7fbd880ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:52.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd8ea31640 1 -- 172.21.15.181:0/2137432755 shutdown_connections 2024-09-13T10:30:52.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.827+0000 7fbd8ea31640 1 -- 172.21.15.181:0/2137432755 wait complete. 2024-09-13T10:30:52.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.828+0000 7fbd8ea31640 10 monclient: build_initial_monmap 2024-09-13T10:30:52.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.828+0000 7fbd8ea31640 10 monclient: monmap: 2024-09-13T10:30:52.837 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:52.837 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:52.837 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:52.837 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:52.837 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:52.837 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:52.837 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:52.837 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:52.837 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:52.837 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:52.838 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:52.838 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:52.838 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:52.838 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:52.838 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:52.838 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.828+0000 7fbd8ea31640 1 Processor -- start 2024-09-13T10:30:52.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.828+0000 7fbd8ea31640 1 -- start start 2024-09-13T10:30:52.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.828+0000 7fbd8ea31640 10 monclient: init 2024-09-13T10:30:52.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.829+0000 7fbd8ea31640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:52.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.829+0000 7fbd8ea31640 10 monclient: _add_conns ranks=[4,1,7,0,3,6,2,8,5] 2024-09-13T10:30:52.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.829+0000 7fbd8ea31640 10 monclient(hunting): picked mon.noname-c con 0x7fbd880a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:52.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.829+0000 7fbd8ea31640 10 monclient(hunting): picked mon.noname-f con 0x7fbd880a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:52.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.829+0000 7fbd8ea31640 10 monclient(hunting): picked mon.noname-i con 0x7fbd8813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:52.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.829+0000 7fbd8ea31640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd880a2350 con 0x7fbd880a6ab0 2024-09-13T10:30:52.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.829+0000 7fbd8ea31640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8813f310 con 0x7fbd880a66d0 2024-09-13T10:30:52.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.829+0000 7fbd8ea31640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8813e770 con 0x7fbd8813f9a0 2024-09-13T10:30:52.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.829+0000 7fbd8ea31640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:52.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.829+0000 7fbd8ea31640 10 monclient(hunting): authenticate will time out at 792.334382s 2024-09-13T10:30:52.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.829+0000 7fbd87fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fbd880a66d0 0x7fbd8813b990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58284/0 (socket says 172.21.15.181:58284) 2024-09-13T10:30:52.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.829+0000 7fbd87fff640 1 -- 172.21.15.181:0/526512640 learned_addr learned my addr 172.21.15.181:0/526512640 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:52.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd87fff640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.181:6791/0 conn(0x7fbd880a66d0 legacy=0x7fbd8813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd877fe640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.195:6789/0 conn(0x7fbd880a6ab0 legacy=0x7fbd8813c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd8cfce640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.195:6792/0 conn(0x7fbd8813f9a0 legacy=0x7fbd881d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748096762 0 0) 0x7fbd8813f310 con 0x7fbd880a66d0 2024-09-13T10:30:52.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:52.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:52.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:52.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 10 monclient(hunting): my global_id is 4540 2024-09-13T10:30:52.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd74003550 con 0x7fbd880a66d0 2024-09-13T10:30:52.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444638904 0 0) 0x7fbd880a2350 con 0x7fbd880a6ab0 2024-09-13T10:30:52.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:52.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:52.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:52.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 10 monclient(hunting): my global_id is 54514 2024-09-13T10:30:52.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd8813f310 con 0x7fbd880a6ab0 2024-09-13T10:30:52.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2961639115 0 0) 0x7fbd8813e770 con 0x7fbd8813f9a0 2024-09-13T10:30:52.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:52.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:52.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:52.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 10 monclient(hunting): my global_id is 54502 2024-09-13T10:30:52.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.831+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd880a2350 con 0x7fbd8813f9a0 2024-09-13T10:30:52.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 14174211 0 0) 0x7fbd74003550 con 0x7fbd880a66d0 2024-09-13T10:30:52.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd8813e770 con 0x7fbd880a66d0 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd78004d90 con 0x7fbd880a66d0 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient(hunting): dump: 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.848 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2918002641 0 0) 0x7fbd8813f310 con 0x7fbd880a6ab0 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd74003550 con 0x7fbd880a6ab0 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3947769961 0 0) 0x7fbd880a2350 con 0x7fbd8813f9a0 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd8813f310 con 0x7fbd8813f9a0 2024-09-13T10:30:52.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd7c003610 con 0x7fbd880a6ab0 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient(hunting): dump: 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.850 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.851 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.851 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.851 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.851 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.851 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd80001f80 con 0x7fbd8813f9a0 2024-09-13T10:30:52.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:52.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:52.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient(hunting): dump: 2024-09-13T10:30:52.851 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.851 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.852 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2255234596 0 0) 0x7fbd8813e770 con 0x7fbd880a66d0 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.195:6792/0 conn(0x7fbd8813f9a0 legacy=0x7fbd881d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.195:6789/0 conn(0x7fbd880a6ab0 legacy=0x7fbd8813c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 monclient: found mon.c 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8813cfb0 con 0x7fbd880a66d0 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient: _finish_auth 0 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd8ea31640 5 monclient: authenticate success, global_id 4540 2024-09-13T10:30:52.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd8ea31640 10 monclient: _renew_subs 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd8ea31640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd8ea31640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8813f030 con 0x7fbd880a66d0 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd8ea31640 10 monclient: _renew_subs 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd8ea31640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd8ea31640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fbd8813c990 con 0x7fbd880a66d0 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd780048a0 con 0x7fbd880a66d0 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd78001d20 con 0x7fbd880a66d0 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd867fc640 4 set_mon_vals no callback set 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.832+0000 7fbd84ff9640 10 monclient: dump: 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.854 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.833+0000 7fbd8ea31640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.833+0000 7fbd8ea31640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbd680065c0 con 0x7fbd68002860 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.833+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fbd78011be0 con 0x7fbd880a66d0 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.833+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (unknown 3963508485 0 0) 0x7fbd7804e460 con 0x7fbd880a66d0 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.833+0000 7fbd8cfce640 10 monclient: get_auth_request con 0x7fbd74040580 auth_method 0 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd877fe640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.181:6789/0 conn(0x7fbd68002860 legacy=0x7fbd68004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2346055524 0 0) 0x7fbd680065c0 con 0x7fbd68002860 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 10 monclient(hunting): my global_id is 54405 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd8813e770 con 0x7fbd68002860 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 247360361 0 0) 0x7fbd8813e770 con 0x7fbd68002860 2024-09-13T10:30:52.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd680065c0 con 0x7fbd68002860 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd7c003e90 con 0x7fbd68002860 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 10 monclient: dump: 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.857 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2481573494 0 0) 0x7fbd680065c0 con 0x7fbd68002860 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.835+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd6800a160 con 0x7fbd68002860 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.836+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fbd7c0040e0 con 0x7fbd68002860 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.836+0000 7fbd84ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.836+0000 7fbd84ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.836+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.181:6789/0 conn(0x7fbd68002860 legacy=0x7fbd68004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.836+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.181:6789/0 conn(0x7fbd68002860 legacy=0x7fbd68004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:52.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.842+0000 7fbd8ea31640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:52.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.842+0000 7fbd8ea31640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbd68009e70 con 0x7fbd68009130 2024-09-13T10:30:52.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd877fe640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.181:6789/0 conn(0x7fbd68009130 legacy=0x7fbd680095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961835710 0 0) 0x7fbd68009e70 con 0x7fbd68009130 2024-09-13T10:30:52.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:30:52.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:52.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 10 monclient(hunting): my global_id is 54414 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd680065c0 con 0x7fbd68009130 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 481545755 0 0) 0x7fbd680065c0 con 0x7fbd68009130 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd68009e70 con 0x7fbd68009130 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd7c005b00 con 0x7fbd68009130 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 10 monclient: dump: 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.861 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1032660261 0 0) 0x7fbd68009e70 con 0x7fbd68009130 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.844+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd6800c410 con 0x7fbd68009130 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7716 (unknown 0 0 518706991) 0x7fbd7c006e00 con 0x7fbd68009130 2024-09-13T10:30:52.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd84ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:52.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd84ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:52.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.181:6789/0 conn(0x7fbd68009130 legacy=0x7fbd680095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd84ff9640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.181:6789/0 conn(0x7fbd68009130 legacy=0x7fbd680095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:52.863 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:30:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 28, 2024-09-13T10:30:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 67277, 2024-09-13T10:30:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:30:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:52.883 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:52.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd8ea31640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.195:6800/1839191919 conn(0x7fbd74040580 legacy=0x7fbd74042a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd8ea31640 10 monclient: shutdown 2024-09-13T10:30:52.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd8ea31640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:52.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd8ea31640 1 -- 172.21.15.181:0/526512640 >> v1:172.21.15.181:6791/0 conn(0x7fbd880a66d0 legacy=0x7fbd8813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd8cfce640 1 -- 172.21.15.181:0/526512640 reap_dead start 2024-09-13T10:30:52.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd8cfce640 1 -- 172.21.15.181:0/526512640 reap_dead start 2024-09-13T10:30:52.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd8ea31640 1 -- 172.21.15.181:0/526512640 shutdown_connections 2024-09-13T10:30:52.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd8ea31640 1 -- 172.21.15.181:0/526512640 >> 172.21.15.181:0/526512640 conn(0x7fbd880abcd0 msgr2=0x7fbd88137cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:52.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd8ea31640 1 -- 172.21.15.181:0/526512640 shutdown_connections 2024-09-13T10:30:52.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.845+0000 7fbd8ea31640 1 -- 172.21.15.181:0/526512640 wait complete. 2024-09-13T10:30:52.886 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:30:52.886 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-09-13T10:30:52.886 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:30:52.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.982+0000 7fd150b7c640 10 monclient: get_monmap_and_config 2024-09-13T10:30:52.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.982+0000 7fd150b7c640 10 monclient: build_initial_monmap 2024-09-13T10:30:52.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.982+0000 7fd150b7c640 10 monclient: monmap: 2024-09-13T10:30:52.984 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:52.984 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.984 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:52.983447+0000 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:52.983447+0000 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:52.985 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.983+0000 7fd150b7c640 1 Processor -- start 2024-09-13T10:30:52.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.983+0000 7fd150b7c640 1 -- start start 2024-09-13T10:30:52.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.983+0000 7fd150b7c640 10 monclient: init 2024-09-13T10:30:52.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.984+0000 7fd150b7c640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:52.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.984+0000 7fd150b7c640 10 monclient: _add_conns ranks=[8,1,4,2,5,6,3,7,0] 2024-09-13T10:30:52.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.984+0000 7fd150b7c640 10 monclient(hunting): picked mon.noname-e con 0x7fd14c139040 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:52.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.984+0000 7fd150b7c640 10 monclient(hunting): picked mon.noname-f con 0x7fd14c09cd50 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:52.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.984+0000 7fd150b7c640 10 monclient(hunting): picked mon.noname-c con 0x7fd14c13fae0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:52.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.984+0000 7fd150b7c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd14c09dbb0 con 0x7fd14c09cd50 2024-09-13T10:30:52.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.984+0000 7fd150b7c640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd14c09de90 con 0x7fd14c13fae0 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.984+0000 7fd150b7c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd14c09e170 con 0x7fd14c139040 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.984+0000 7fd150b7c640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.984+0000 7fd150b7c640 10 monclient(hunting): authenticate will time out at 792.489271s 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.984+0000 7fd14a59c640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fd14c139040 0x7fd14c0a58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:49846/0 (socket says 172.21.15.181:49846) 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.984+0000 7fd14a59c640 1 -- 172.21.15.181:0/1735306917 learned_addr learned my addr 172.21.15.181:0/1735306917 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14ad9d640 1 -- 172.21.15.181:0/1735306917 >> v1:172.21.15.181:6791/0 conn(0x7fd14c13fae0 legacy=0x7fd14c141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14a59c640 1 -- 172.21.15.181:0/1735306917 >> v1:172.21.15.181:6793/0 conn(0x7fd14c139040 legacy=0x7fd14c0a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838025223 0 0) 0x7fd14c09de90 con 0x7fd14c13fae0 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient(hunting): _negotiate 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient(hunting): my global_id is 4549 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd149d9b640 1 -- 172.21.15.181:0/1735306917 >> v1:172.21.15.195:6789/0 conn(0x7fd14c09cd50 legacy=0x7fd14c13e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:52.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd134003520 con 0x7fd14c13fae0 2024-09-13T10:30:52.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2863558262 0 0) 0x7fd14c09e170 con 0x7fd14c139040 2024-09-13T10:30:52.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient(hunting): _negotiate 2024-09-13T10:30:52.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:52.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:52.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient(hunting): my global_id is 4553 2024-09-13T10:30:52.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd14c09de90 con 0x7fd14c139040 2024-09-13T10:30:52.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1483733504 0 0) 0x7fd14c09dbb0 con 0x7fd14c09cd50 2024-09-13T10:30:52.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient(hunting): _negotiate 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient(hunting): my global_id is 54523 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd14c09e170 con 0x7fd14c09cd50 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1208585084 0 0) 0x7fd14c09de90 con 0x7fd14c139040 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 >> v1:172.21.15.181:6791/0 conn(0x7fd14c13fae0 legacy=0x7fd14c141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 >> v1:172.21.15.195:6789/0 conn(0x7fd14c09cd50 legacy=0x7fd14c13e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient: _finish_hunting 0 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 1 monclient: found mon.noname-e 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14c0a5ff0 con 0x7fd14c139040 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient: _finish_auth 0 2024-09-13T10:30:52.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient: _check_auth_tickets 2024-09-13T10:30:52.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:52.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd13c001a40 con 0x7fd14c139040 2024-09-13T10:30:52.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd150b7c640 5 monclient: authenticate success, global_id 4553 2024-09-13T10:30:52.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd150b7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:52.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:52.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:52.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd14959a640 10 monclient: dump: 2024-09-13T10:30:52.995 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.995 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.995 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.996 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.986+0000 7fd150b7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:52.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd13c0048a0 con 0x7fd14c139040 2024-09-13T10:30:52.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd14959a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:52.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd14959a640 1 -- 172.21.15.181:0/1735306917 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd13c004d90 con 0x7fd14c139040 2024-09-13T10:30:52.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd150b7c640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:52.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd150b7c640 4 set_mon_vals no callback set 2024-09-13T10:30:52.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd14959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:52.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd14959a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:52.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd14959a640 10 monclient: dump: 2024-09-13T10:30:52.997 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:52.998 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:52.998 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.998 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:52.998 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:52.998 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:52.998 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:52.998 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:52.998 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:52.998 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:52.998 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:52.998 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:52.999 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:52.999 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:52.999 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:52.999 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:52.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd150b7c640 10 monclient: shutdown 2024-09-13T10:30:52.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd150b7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:52.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd150b7c640 1 -- 172.21.15.181:0/1735306917 >> v1:172.21.15.181:6793/0 conn(0x7fd14c139040 legacy=0x7fd14c0a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:52.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd150b7c640 1 -- 172.21.15.181:0/1735306917 shutdown_connections 2024-09-13T10:30:52.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd150b7c640 1 -- 172.21.15.181:0/1735306917 >> 172.21.15.181:0/1735306917 conn(0x7fd14c077120 msgr2=0x7fd14c0abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd150b7c640 1 -- 172.21.15.181:0/1735306917 shutdown_connections 2024-09-13T10:30:53.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.987+0000 7fd150b7c640 1 -- 172.21.15.181:0/1735306917 wait complete. 2024-09-13T10:30:53.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.988+0000 7fd150b7c640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.988+0000 7fd150b7c640 10 monclient: monmap: 2024-09-13T10:30:53.000 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.000 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:53.000 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:53.000 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:53.001 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.001 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:53.001 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.001 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.001 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.001 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.001 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.001 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.001 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.001 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.001 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.001 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.988+0000 7fd150b7c640 1 Processor -- start 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.988+0000 7fd150b7c640 1 -- start start 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.988+0000 7fd150b7c640 10 monclient: init 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd150b7c640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd150b7c640 10 monclient: _add_conns ranks=[7,6,2,0,5,8,4,3,1] 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd150b7c640 10 monclient(hunting): picked mon.noname-i con 0x7fd14c09cd50 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd150b7c640 10 monclient(hunting): picked mon.noname-d con 0x7fd14c139040 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd150b7c640 10 monclient(hunting): picked mon.noname-b con 0x7fd14c13fae0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd150b7c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd14c13b320 con 0x7fd14c13fae0 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd150b7c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd14c13af00 con 0x7fd14c139040 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd150b7c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd14c135670 con 0x7fd14c09cd50 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd150b7c640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd150b7c640 10 monclient(hunting): authenticate will time out at 792.494231s 2024-09-13T10:30:53.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd14ad9d640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fd14c13fae0 legacy=0x7fd14c1d66b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:53.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd149d9b640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fd14c139040 0x7fd14c134350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:51774/0 (socket says 172.21.15.181:51774) 2024-09-13T10:30:53.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.989+0000 7fd149d9b640 1 -- 172.21.15.181:0/1847348796 learned_addr learned my addr 172.21.15.181:0/1847348796 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd149d9b640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.181:6792/0 conn(0x7fd14c139040 legacy=0x7fd14c134350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518366334 0 0) 0x7fd14c13af00 con 0x7fd14c139040 2024-09-13T10:30:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): my global_id is 4461 2024-09-13T10:30:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd14a59c640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.195:6792/0 conn(0x7fd14c09cd50 legacy=0x7fd14c133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd12c003520 con 0x7fd14c139040 2024-09-13T10:30:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 467263057 0 0) 0x7fd14c135670 con 0x7fd14c09cd50 2024-09-13T10:30:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): my global_id is 54511 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd14c13af00 con 0x7fd14c09cd50 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1167276592 0 0) 0x7fd12c003520 con 0x7fd14c139040 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd14c135670 con 0x7fd14c139040 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd140003610 con 0x7fd14c139040 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): dump: 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.011 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3930953840 0 0) 0x7fd14c13af00 con 0x7fd14c09cd50 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd12c003520 con 0x7fd14c09cd50 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd13c004d90 con 0x7fd14c09cd50 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 10 monclient(hunting): dump: 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.991+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4094687985 0 0) 0x7fd14c135670 con 0x7fd14c139040 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.195:6792/0 conn(0x7fd14c09cd50 legacy=0x7fd14c133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.181:6790/0 conn(0x7fd14c13fae0 legacy=0x7fd14c1d66b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:30:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 1 monclient: found mon.d 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14c143310 con 0x7fd14c139040 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd150b7c640 5 monclient: authenticate success, global_id 4461 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd150b7c640 10 monclient: _renew_subs 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd150b7c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd150b7c640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd14c134a60 con 0x7fd14c139040 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd150b7c640 10 monclient: _renew_subs 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd150b7c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd150b7c640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fd14c1361b0 con 0x7fd14c139040 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd140003bd0 con 0x7fd14c139040 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd140004140 con 0x7fd14c139040 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 10 monclient: dump: 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd148d99640 4 set_mon_vals no callback set 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd150b7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd150b7c640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd14c0008d0 con 0x7fd14c132e90 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.992+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fd1400042e0 con 0x7fd14c139040 2024-09-13T10:30:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.993+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (unknown 3963508485 0 0) 0x7fd14004e310 con 0x7fd14c139040 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.993+0000 7fd14ad9d640 10 monclient: get_auth_request con 0x7fd12c040100 auth_method 0 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.993+0000 7fd14ad9d640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.195:6800/1839191919 conn(0x7fd12c040100 legacy=0x7fd12c0425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.993+0000 7fd14ad9d640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.195:6800/1839191919 conn(0x7fd12c040100 legacy=0x7fd12c0425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.993+0000 7fd14ad9d640 1 --1- 172.21.15.181:0/1847348796 >> v1:172.21.15.195:6800/1839191919 conn(0x7fd12c040100 0x7fd12c0425c0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.993+0000 7fd14ad9d640 1 --1- 172.21.15.181:0/1847348796 >> v1:172.21.15.195:6800/1839191919 conn(0x7fd12c040100 0x7fd12c0425c0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.993+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.195:6800/1839191919 conn(0x7fd12c040100 legacy=0x7fd12c0425c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd14a59c640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.181:6791/0 conn(0x7fd14c132e90 legacy=0x7fd14c13fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173678080 0 0) 0x7fd14c0008d0 con 0x7fd14c132e90 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 10 monclient(hunting): my global_id is 4558 2024-09-13T10:30:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd14c135670 con 0x7fd14c132e90 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 781495523 0 0) 0x7fd14c135670 con 0x7fd14c132e90 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd14c0008d0 con 0x7fd14c132e90 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd13c0048a0 con 0x7fd14c132e90 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 10 monclient: dump: 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.018 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 773414508 0 0) 0x7fd14c0008d0 con 0x7fd14c132e90 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd14c133270 con 0x7fd14c132e90 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd13c005520 con 0x7fd14c132e90 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:53.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.181:6791/0 conn(0x7fd14c132e90 legacy=0x7fd14c13fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:52.995+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.181:6791/0 conn(0x7fd14c132e90 legacy=0x7fd14c13fec0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.001+0000 7fd150b7c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.001+0000 7fd150b7c640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd14c1435f0 con 0x7fd14c02e200 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd14a59c640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.181:6791/0 conn(0x7fd14c02e200 legacy=0x7fd14c1405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194801618 0 0) 0x7fd14c1435f0 con 0x7fd14c02e200 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 10 monclient(hunting): my global_id is 4567 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd14c0008d0 con 0x7fd14c02e200 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1398107916 0 0) 0x7fd14c0008d0 con 0x7fd14c02e200 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd14c1435f0 con 0x7fd14c02e200 2024-09-13T10:30:53.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd13c005c90 con 0x7fd14c02e200 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 10 monclient: dump: 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.021 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3352561477 0 0) 0x7fd14c1435f0 con 0x7fd14c02e200 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.004+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd14c02e5e0 con 0x7fd14c02e200 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7547 (unknown 0 0 3778143052) 0x7fd13c007140 con 0x7fd14c02e200 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd13affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd13affd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.181:6791/0 conn(0x7fd14c02e200 legacy=0x7fd14c1405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd13affd640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.181:6791/0 conn(0x7fd14c02e200 legacy=0x7fd14c1405d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd14ad9d640 1 -- 172.21.15.181:0/1847348796 reap_dead start 2024-09-13T10:30:53.023 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:53.023 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:53.023 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:53.023 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:53.023 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 28, 2024-09-13T10:30:53.023 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 67453, 2024-09-13T10:30:53.023 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:53.023 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.024 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.025 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.025 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.025 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.025 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.025 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.025 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.025 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.026 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.026 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.026 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.026 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:53.026 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:53.026 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.026 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.026 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.026 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.026 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.026 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.026 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.027 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.027 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.027 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.027 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.027 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.027 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:53.027 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:53.027 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:53.027 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:53.027 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:53.027 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:53.028 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.028 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.028 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:53.028 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:53.028 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:53.028 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:53.028 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:53.028 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:53.028 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:53.028 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.028 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.029 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.030 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.033 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.035 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.035 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.036 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.036 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.036 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.036 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.036 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:53.036 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:53.036 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.037 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.038 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:53.039 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.040 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.042 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.043 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.045 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.045 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:53.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.045 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.045 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.045 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:30:53.045 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.045 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.045 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:53.046 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:53.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd150b7c640 10 monclient: shutdown 2024-09-13T10:30:53.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd150b7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:53.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd150b7c640 1 -- 172.21.15.181:0/1847348796 >> v1:172.21.15.181:6792/0 conn(0x7fd14c139040 legacy=0x7fd14c134350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd150b7c640 1 -- 172.21.15.181:0/1847348796 shutdown_connections 2024-09-13T10:30:53.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd150b7c640 1 -- 172.21.15.181:0/1847348796 >> 172.21.15.181:0/1847348796 conn(0x7fd14c077120 msgr2=0x7fd14c137c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd150b7c640 1 -- 172.21.15.181:0/1847348796 shutdown_connections 2024-09-13T10:30:53.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.005+0000 7fd150b7c640 1 -- 172.21.15.181:0/1847348796 wait complete. 2024-09-13T10:30:53.048 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:30:53.048 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-09-13T10:30:53.048 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:30:53.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.145+0000 7f89e1ea2640 10 monclient: get_monmap_and_config 2024-09-13T10:30:53.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.145+0000 7f89e1ea2640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.145+0000 7f89e1ea2640 10 monclient: monmap: 2024-09-13T10:30:53.147 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.147 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.147 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:53.146162+0000 2024-09-13T10:30:53.147 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:53.146162+0000 2024-09-13T10:30:53.147 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.147 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.147 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.147 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.148 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.148 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.148 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.148 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.148 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.148 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.148 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.148 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 1 Processor -- start 2024-09-13T10:30:53.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 1 -- start start 2024-09-13T10:30:53.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 10 monclient: init 2024-09-13T10:30:53.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 10 monclient: _add_conns ranks=[7,4,6,2,3,1,0,5,8] 2024-09-13T10:30:53.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 10 monclient(hunting): picked mon.noname-i con 0x7f89dc0a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:53.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 10 monclient(hunting): picked mon.noname-c con 0x7f89dc0a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:53.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 10 monclient(hunting): picked mon.noname-d con 0x7f89dc13f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc0a4bc0 con 0x7f89dc0a8340 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc13a320 con 0x7f89dc13f750 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc0a8100 con 0x7f89dc0a6640 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89e1ea2640 10 monclient(hunting): authenticate will time out at 792.651843s 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89daffd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f89dc0a8340 0x7f89dc139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58328/0 (socket says 172.21.15.181:58328) 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89dbfff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f89dc13f750 0x7f89dc141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:51786/0 (socket says 172.21.15.181:51786) 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.146+0000 7f89daffd640 1 -- 172.21.15.181:0/502058644 learned_addr learned my addr 172.21.15.181:0/502058644 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89dbfff640 1 -- 172.21.15.181:0/502058644 >> v1:172.21.15.181:6792/0 conn(0x7f89dc13f750 legacy=0x7f89dc141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89daffd640 1 -- 172.21.15.181:0/502058644 >> v1:172.21.15.181:6791/0 conn(0x7f89dc0a8340 legacy=0x7f89dc139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89db7fe640 1 -- 172.21.15.181:0/502058644 >> v1:172.21.15.195:6792/0 conn(0x7f89dc0a6640 legacy=0x7f89dc139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1741826260 0 0) 0x7f89dc13a320 con 0x7f89dc13f750 2024-09-13T10:30:53.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient(hunting): my global_id is 4470 2024-09-13T10:30:53.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c4003520 con 0x7f89dc13f750 2024-09-13T10:30:53.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2027848022 0 0) 0x7f89dc0a4bc0 con 0x7f89dc0a8340 2024-09-13T10:30:53.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient(hunting): my global_id is 4576 2024-09-13T10:30:53.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89dc13a320 con 0x7f89dc0a8340 2024-09-13T10:30:53.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397523078 0 0) 0x7f89dc0a8100 con 0x7f89dc0a6640 2024-09-13T10:30:53.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient(hunting): my global_id is 54520 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89dc0a4bc0 con 0x7f89dc0a6640 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 797741586 0 0) 0x7f89dc13a320 con 0x7f89dc0a8340 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 >> v1:172.21.15.195:6792/0 conn(0x7f89dc0a6640 legacy=0x7f89dc139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 >> v1:172.21.15.181:6792/0 conn(0x7f89dc13f750 legacy=0x7f89dc141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 monclient: found mon.noname-c 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89dc0a48e0 con 0x7f89dc0a8340 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89e1ea2640 5 monclient: authenticate success, global_id 4576 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89d0001ac0 con 0x7f89dc0a8340 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient: dump: 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.158 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89e1ea2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89d00048a0 con 0x7f89dc0a8340 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 1 -- 172.21.15.181:0/502058644 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89d0004e10 con 0x7f89dc0a8340 2024-09-13T10:30:53.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89e1ea2640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89e1ea2640 4 set_mon_vals no callback set 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.149+0000 7f89da7fc640 10 monclient: dump: 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.160 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.150+0000 7f89e1ea2640 10 monclient: shutdown 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.150+0000 7f89e1ea2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.150+0000 7f89e1ea2640 1 -- 172.21.15.181:0/502058644 >> v1:172.21.15.181:6791/0 conn(0x7f89dc0a8340 legacy=0x7f89dc139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.150+0000 7f89e1ea2640 1 -- 172.21.15.181:0/502058644 shutdown_connections 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.150+0000 7f89e1ea2640 1 -- 172.21.15.181:0/502058644 >> 172.21.15.181:0/502058644 conn(0x7f89dc077170 msgr2=0x7f89dc0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.150+0000 7f89e1ea2640 1 -- 172.21.15.181:0/502058644 shutdown_connections 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.150+0000 7f89e1ea2640 1 -- 172.21.15.181:0/502058644 wait complete. 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.150+0000 7f89e1ea2640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.150+0000 7f89e1ea2640 10 monclient: monmap: 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.162 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 1 Processor -- start 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 1 -- start start 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 10 monclient: init 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 10 monclient: _add_conns ranks=[2,5,1,7,0,6,4,3,8] 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 10 monclient(hunting): picked mon.noname-b con 0x7f89dc0a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 10 monclient(hunting): picked mon.noname-h con 0x7f89dc13f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:53.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 10 monclient(hunting): picked mon.noname-f con 0x7f89dc09f7c0 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:53.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc0a0fc0 con 0x7f89dc09f7c0 2024-09-13T10:30:53.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89db7fe640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f89dc0a8340 legacy=0x7f89dc09d2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:53.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc142ed0 con 0x7f89dc0a8340 2024-09-13T10:30:53.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc0a0150 con 0x7f89dc13f750 2024-09-13T10:30:53.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89e1ea2640 10 monclient(hunting): authenticate will time out at 792.656743s 2024-09-13T10:30:53.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89daffd640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f89dc13f750 0x7f89dc09d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:50998/0 (socket says 172.21.15.181:50998) 2024-09-13T10:30:53.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.151+0000 7f89dbfff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f89dc09f7c0 0x7f89dc1d6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:41334/0 (socket says 172.21.15.181:41334) 2024-09-13T10:30:53.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.152+0000 7f89daffd640 1 -- 172.21.15.181:0/1893966719 learned_addr learned my addr 172.21.15.181:0/1893966719 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89dbfff640 1 -- 172.21.15.181:0/1893966719 >> v1:172.21.15.195:6789/0 conn(0x7f89dc09f7c0 legacy=0x7f89dc1d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89daffd640 1 -- 172.21.15.181:0/1893966719 >> v1:172.21.15.195:6791/0 conn(0x7f89dc13f750 legacy=0x7f89dc09d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433506943 0 0) 0x7f89dc0a0fc0 con 0x7f89dc09f7c0 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): my global_id is 54532 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c8003550 con 0x7f89dc09f7c0 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2279562682 0 0) 0x7f89dc0a0150 con 0x7f89dc13f750 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): my global_id is 4541 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89dc0a0fc0 con 0x7f89dc13f750 2024-09-13T10:30:53.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 544387862 0 0) 0x7f89c8003550 con 0x7f89dc09f7c0 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89dc0a0150 con 0x7f89dc09f7c0 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89d40020b0 con 0x7f89dc09f7c0 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): dump: 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.171 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.172 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.172 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.172 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.172 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.172 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.172 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.172 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.172 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:53.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3848354734 0 0) 0x7f89dc0a0fc0 con 0x7f89dc13f750 2024-09-13T10:30:53.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89c8003550 con 0x7f89dc13f750 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89d0004d90 con 0x7f89dc13f750 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient(hunting): dump: 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 108942972 0 0) 0x7f89dc0a0150 con 0x7f89dc09f7c0 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 >> v1:172.21.15.195:6791/0 conn(0x7f89dc13f750 legacy=0x7f89dc09d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 >> v1:172.21.15.181:6790/0 conn(0x7f89dc0a8340 legacy=0x7f89dc09d2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 monclient: found mon.f 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89dc09ec60 con 0x7f89dc09f7c0 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89e1ea2640 5 monclient: authenticate success, global_id 54532 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89e1ea2640 10 monclient: _renew_subs 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89e1ea2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89e1ea2640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89dc09e0c0 con 0x7f89dc09f7c0 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89e1ea2640 10 monclient: _renew_subs 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89e1ea2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.154+0000 7f89e1ea2640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f89dc0a2820 con 0x7f89dc09f7c0 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.155+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89d4001ca0 con 0x7f89dc09f7c0 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.155+0000 7f89c3fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.155+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89d4001e80 con 0x7f89dc09f7c0 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.155+0000 7f89c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.155+0000 7f89d9ffb640 4 set_mon_vals no callback set 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.155+0000 7f89c3fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.155+0000 7f89c3fff640 10 monclient: dump: 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.176 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.155+0000 7f89e1ea2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.155+0000 7f89e1ea2640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f89bc0065c0 con 0x7f89bc002860 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.155+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f89d4011a70 con 0x7f89dc09f7c0 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.156+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (unknown 3963508485 0 0) 0x7f89d404e620 con 0x7f89dc09f7c0 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.156+0000 7f89daffd640 10 monclient: get_auth_request con 0x7f89c8040280 auth_method 0 2024-09-13T10:30:53.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.157+0000 7f89db7fe640 1 -- 172.21.15.181:0/1893966719 >> v1:172.21.15.181:6792/0 conn(0x7f89bc002860 legacy=0x7f89bc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372409343 0 0) 0x7f89bc0065c0 con 0x7f89bc002860 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 10 monclient(hunting): my global_id is 4479 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89dc0a0150 con 0x7f89bc002860 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2334480979 0 0) 0x7f89dc0a0150 con 0x7f89bc002860 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89bc0065c0 con 0x7f89bc002860 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89cc001be0 con 0x7f89bc002860 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 10 monclient: dump: 2024-09-13T10:30:53.178 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.179 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.180 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.180 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1214562310 0 0) 0x7f89bc0065c0 con 0x7f89bc002860 2024-09-13T10:30:53.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89bc00a160 con 0x7f89bc002860 2024-09-13T10:30:53.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f89cc006850 con 0x7f89bc002860 2024-09-13T10:30:53.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:53.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 >> v1:172.21.15.181:6792/0 conn(0x7f89bc002860 legacy=0x7f89bc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.158+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 >> v1:172.21.15.181:6792/0 conn(0x7f89bc002860 legacy=0x7f89bc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.164+0000 7f89e1ea2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:53.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.164+0000 7f89e1ea2640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f89bc009e70 con 0x7f89bc009130 2024-09-13T10:30:53.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89db7fe640 1 -- 172.21.15.181:0/1893966719 >> v1:172.21.15.181:6792/0 conn(0x7f89bc009130 legacy=0x7f89bc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 117266651 0 0) 0x7f89bc009e70 con 0x7f89bc009130 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 10 monclient(hunting): my global_id is 4488 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89bc0065c0 con 0x7f89bc009130 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2726159613 0 0) 0x7f89bc0065c0 con 0x7f89bc009130 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89bc009e70 con 0x7f89bc009130 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89cc003d00 con 0x7f89bc009130 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 10 monclient: dump: 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.181 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.182 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1494229742 0 0) 0x7f89bc009e70 con 0x7f89bc009130 2024-09-13T10:30:53.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f89bc00c410 con 0x7f89bc009130 2024-09-13T10:30:53.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7714 (unknown 0 0 3100198902) 0x7f89cc004090 con 0x7f89bc009130 2024-09-13T10:30:53.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:53.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:53.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 >> v1:172.21.15.181:6792/0 conn(0x7f89bc009130 legacy=0x7f89bc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.167+0000 7f89c3fff640 1 -- 172.21.15.181:0/1893966719 >> v1:172.21.15.181:6792/0 conn(0x7f89bc009130 legacy=0x7f89bc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.183 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:53.183 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:53.184 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:53.184 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:53.184 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 28, 2024-09-13T10:30:53.184 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 67610, 2024-09-13T10:30:53.184 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:53.184 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:53.184 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:53.184 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:53.184 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:53.184 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:53.184 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:53.184 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.185 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.186 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:53.187 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:53.188 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.188 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.188 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:53.188 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:53.188 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:53.188 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:53.188 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:53.188 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:53.188 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:53.188 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.188 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:53.188 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:53.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.190 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.191 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:53.192 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.192 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.192 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.192 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.192 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.192 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.192 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.192 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.193 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.194 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:53.195 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.195 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.195 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.195 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.195 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.195 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.195 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.195 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.195 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:53.196 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:53.196 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.196 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.196 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.196 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:53.196 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.196 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.196 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.196 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.196 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:53.197 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.198 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.201 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:53.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:53.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.204 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.204 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.204 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.204 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.204 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.204 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:53.204 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:53.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.168+0000 7f89e1ea2640 1 -- 172.21.15.181:0/1893966719 >> v1:172.21.15.195:6800/1839191919 conn(0x7f89c8040280 legacy=0x7f89c8042740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.168+0000 7f89e1ea2640 10 monclient: shutdown 2024-09-13T10:30:53.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.168+0000 7f89e1ea2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:53.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.168+0000 7f89e1ea2640 1 -- 172.21.15.181:0/1893966719 >> v1:172.21.15.195:6789/0 conn(0x7f89dc09f7c0 legacy=0x7f89dc1d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.168+0000 7f89dbfff640 1 -- 172.21.15.181:0/1893966719 reap_dead start 2024-09-13T10:30:53.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.168+0000 7f89dbfff640 1 -- 172.21.15.181:0/1893966719 reap_dead start 2024-09-13T10:30:53.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.168+0000 7f89e1ea2640 1 -- 172.21.15.181:0/1893966719 shutdown_connections 2024-09-13T10:30:53.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.168+0000 7f89e1ea2640 1 -- 172.21.15.181:0/1893966719 >> 172.21.15.181:0/1893966719 conn(0x7f89dc0a6640 msgr2=0x7f89dc13ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.168+0000 7f89e1ea2640 1 -- 172.21.15.181:0/1893966719 shutdown_connections 2024-09-13T10:30:53.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.168+0000 7f89e1ea2640 1 -- 172.21.15.181:0/1893966719 wait complete. 2024-09-13T10:30:53.207 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:30:53.207 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-09-13T10:30:53.207 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:30:53.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.303+0000 7f48cfd7c640 10 monclient: get_monmap_and_config 2024-09-13T10:30:53.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.303+0000 7f48cfd7c640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.303+0000 7f48cfd7c640 10 monclient: monmap: 2024-09-13T10:30:53.305 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.305 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.305 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:53.304203+0000 2024-09-13T10:30:53.305 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:53.304203+0000 2024-09-13T10:30:53.305 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.305 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.305 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.306 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.306 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.306 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.306 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.306 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.306 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.306 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.306 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.306 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 1 Processor -- start 2024-09-13T10:30:53.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 1 -- start start 2024-09-13T10:30:53.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 10 monclient: init 2024-09-13T10:30:53.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 10 monclient: _add_conns ranks=[7,1,2,3,4,8,0,5,6] 2024-09-13T10:30:53.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 10 monclient(hunting): picked mon.noname-i con 0x7f48c80a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:53.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 10 monclient(hunting): picked mon.noname-f con 0x7f48c80a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:53.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 10 monclient(hunting): picked mon.noname-b con 0x7f48c813f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:53.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c80a4bc0 con 0x7f48c80a8340 2024-09-13T10:30:53.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c813a320 con 0x7f48c813f750 2024-09-13T10:30:53.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c80a8100 con 0x7f48c80a6640 2024-09-13T10:30:53.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48cfd7c640 10 monclient(hunting): authenticate will time out at 792.809885s 2024-09-13T10:30:53.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.304+0000 7f48ce319640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f48c813f750 legacy=0x7f48c8141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:53.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.305+0000 7f48cd317640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f48c80a8340 0x7f48c8139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:60538/0 (socket says 172.21.15.181:60538) 2024-09-13T10:30:53.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.305+0000 7f48cd317640 1 -- 172.21.15.181:0/2253977711 learned_addr learned my addr 172.21.15.181:0/2253977711 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.305+0000 7f48cdb18640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f48c80a6640 0x7f48c8139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:36748/0 (socket says 172.21.15.181:36748) 2024-09-13T10:30:53.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48cdb18640 1 -- 172.21.15.181:0/2253977711 >> v1:172.21.15.195:6792/0 conn(0x7f48c80a6640 legacy=0x7f48c8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48cd317640 1 -- 172.21.15.181:0/2253977711 >> v1:172.21.15.195:6789/0 conn(0x7f48c80a8340 legacy=0x7f48c8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 1 -- 172.21.15.181:0/2253977711 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3321073370 0 0) 0x7f48c80a4bc0 con 0x7f48c80a8340 2024-09-13T10:30:53.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 10 monclient(hunting): my global_id is 54541 2024-09-13T10:30:53.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 1 -- 172.21.15.181:0/2253977711 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48b4003520 con 0x7f48c80a8340 2024-09-13T10:30:53.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 1 -- 172.21.15.181:0/2253977711 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 892084441 0 0) 0x7f48c80a8100 con 0x7f48c80a6640 2024-09-13T10:30:53.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 10 monclient(hunting): my global_id is 54529 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 1 -- 172.21.15.181:0/2253977711 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c80a4bc0 con 0x7f48c80a6640 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 1 -- 172.21.15.181:0/2253977711 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2352152141 0 0) 0x7f48b4003520 con 0x7f48c80a8340 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 1 -- 172.21.15.181:0/2253977711 >> v1:172.21.15.195:6792/0 conn(0x7f48c80a6640 legacy=0x7f48c8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.307+0000 7f48ccb16640 1 -- 172.21.15.181:0/2253977711 >> v1:172.21.15.181:6790/0 conn(0x7f48c813f750 legacy=0x7f48c8141b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 1 monclient: found mon.noname-f 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 1 -- 172.21.15.181:0/2253977711 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c80a48e0 con 0x7f48c80a8340 2024-09-13T10:30:53.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48cfd7c640 5 monclient: authenticate success, global_id 54541 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48cfd7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 1 -- 172.21.15.181:0/2253977711 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48b8001ba0 con 0x7f48c80a8340 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 10 monclient: dump: 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.315 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48cfd7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:53.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 1 -- 172.21.15.181:0/2253977711 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48b80048a0 con 0x7f48c80a8340 2024-09-13T10:30:53.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48cfd7c640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:53.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48cfd7c640 4 set_mon_vals no callback set 2024-09-13T10:30:53.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 1 -- 172.21.15.181:0/2253977711 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48b8004e10 con 0x7f48c80a8340 2024-09-13T10:30:53.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:53.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48ccb16640 10 monclient: dump: 2024-09-13T10:30:53.317 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.317 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.318 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48cfd7c640 10 monclient: shutdown 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48cfd7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48cfd7c640 1 -- 172.21.15.181:0/2253977711 >> v1:172.21.15.195:6789/0 conn(0x7f48c80a8340 legacy=0x7f48c8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48cfd7c640 1 -- 172.21.15.181:0/2253977711 shutdown_connections 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48cfd7c640 1 -- 172.21.15.181:0/2253977711 >> 172.21.15.181:0/2253977711 conn(0x7f48c8077170 msgr2=0x7f48c80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48cfd7c640 1 -- 172.21.15.181:0/2253977711 shutdown_connections 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.308+0000 7f48cfd7c640 1 -- 172.21.15.181:0/2253977711 wait complete. 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.309+0000 7f48cfd7c640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.309+0000 7f48cfd7c640 10 monclient: monmap: 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:53.319 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.309+0000 7f48cfd7c640 1 Processor -- start 2024-09-13T10:30:53.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.309+0000 7f48cfd7c640 1 -- start start 2024-09-13T10:30:53.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.309+0000 7f48cfd7c640 10 monclient: init 2024-09-13T10:30:53.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.309+0000 7f48cfd7c640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.309+0000 7f48cfd7c640 10 monclient: _add_conns ranks=[6,5,4,3,0,7,8,1,2] 2024-09-13T10:30:53.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.309+0000 7f48cfd7c640 10 monclient(hunting): picked mon.noname-d con 0x7f48c80a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:53.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.310+0000 7f48cfd7c640 10 monclient(hunting): picked mon.noname-h con 0x7f48c813f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:53.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.310+0000 7f48cfd7c640 10 monclient(hunting): picked mon.noname-c con 0x7f48c813d0d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:53.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.310+0000 7f48cfd7c640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c813e2f0 con 0x7f48c813d0d0 2024-09-13T10:30:53.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.310+0000 7f48cfd7c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c813e040 con 0x7f48c813f750 2024-09-13T10:30:53.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.310+0000 7f48cfd7c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c81347d0 con 0x7f48c80a8340 2024-09-13T10:30:53.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.310+0000 7f48cfd7c640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.310+0000 7f48cfd7c640 10 monclient(hunting): authenticate will time out at 792.815058s 2024-09-13T10:30:53.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.310+0000 7f48cdb18640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f48c80a8340 0x7f48c812f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:53392/0 (socket says 172.21.15.181:53392) 2024-09-13T10:30:53.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.310+0000 7f48cdb18640 1 -- 172.21.15.181:0/3574125077 learned_addr learned my addr 172.21.15.181:0/3574125077 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48cdb18640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.181:6792/0 conn(0x7f48c80a8340 legacy=0x7f48c812f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48ce319640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.181:6791/0 conn(0x7f48c813d0d0 legacy=0x7f48c81d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48cd317640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.195:6791/0 conn(0x7f48c813f750 legacy=0x7f48c81d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1278803100 0 0) 0x7f48c81347d0 con 0x7f48c80a8340 2024-09-13T10:30:53.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): my global_id is 4497 2024-09-13T10:30:53.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48ac003520 con 0x7f48c80a8340 2024-09-13T10:30:53.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3630098952 0 0) 0x7f48c813e2f0 con 0x7f48c813d0d0 2024-09-13T10:30:53.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): my global_id is 4585 2024-09-13T10:30:53.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c81347d0 con 0x7f48c813d0d0 2024-09-13T10:30:53.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3592203869 0 0) 0x7f48c813e040 con 0x7f48c813f750 2024-09-13T10:30:53.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): my global_id is 4550 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c813e2f0 con 0x7f48c813f750 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1784993046 0 0) 0x7f48c81347d0 con 0x7f48c813d0d0 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48c813e040 con 0x7f48c813d0d0 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 622788386 0 0) 0x7f48ac003520 con 0x7f48c80a8340 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48c81347d0 con 0x7f48c80a8340 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48c00047c0 con 0x7f48c813d0d0 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): dump: 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.330 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.331 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.331 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.331 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.331 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.331 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.331 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.331 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.331 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.331 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.331 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.331 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.331 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48c40047e0 con 0x7f48c80a8340 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): dump: 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.332 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1640128737 0 0) 0x7f48c813e2f0 con 0x7f48c813f750 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48ac003520 con 0x7f48c813f750 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48b8001b60 con 0x7f48c813f750 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:53.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient(hunting): dump: 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.334 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2580931401 0 0) 0x7f48c81347d0 con 0x7f48c80a8340 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.195:6791/0 conn(0x7f48c813f750 legacy=0x7f48c81d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.181:6791/0 conn(0x7f48c813d0d0 legacy=0x7f48c81d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 monclient: found mon.d 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c8134ab0 con 0x7f48c80a8340 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48cfd7c640 5 monclient: authenticate success, global_id 4497 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48cfd7c640 10 monclient: _renew_subs 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48cfd7c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.312+0000 7f48cfd7c640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f48c8134d90 con 0x7f48c80a8340 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48cfd7c640 10 monclient: _renew_subs 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48cfd7c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48cfd7c640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f48c813d920 con 0x7f48c80a8340 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48c4004d60 con 0x7f48c80a8340 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48be7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48c4005250 con 0x7f48c80a8340 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48bffff640 4 set_mon_vals no callback set 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48be7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48be7fc640 10 monclient: dump: 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.337 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.338 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.338 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.338 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.338 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.338 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f48c40118d0 con 0x7f48c80a8340 2024-09-13T10:30:53.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48cfd7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.313+0000 7f48cfd7c640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f48b00065c0 con 0x7f48b0002860 2024-09-13T10:30:53.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.314+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (unknown 3963508485 0 0) 0x7f48c404e340 con 0x7f48c80a8340 2024-09-13T10:30:53.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.314+0000 7f48ce319640 10 monclient: get_auth_request con 0x7f48ac040450 auth_method 0 2024-09-13T10:30:53.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48cd317640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.181:6793/0 conn(0x7f48b0002860 legacy=0x7f48b0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1369122425 0 0) 0x7f48b00065c0 con 0x7f48b0002860 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 10 monclient(hunting): my global_id is 4562 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c81347d0 con 0x7f48b0002860 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3855845989 0 0) 0x7f48c81347d0 con 0x7f48b0002860 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48b00065c0 con 0x7f48b0002860 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48b8001d00 con 0x7f48b0002860 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 10 monclient: dump: 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.339 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.340 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 854046508 0 0) 0x7f48b00065c0 con 0x7f48b0002860 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48b000a160 con 0x7f48b0002860 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f48b8005410 con 0x7f48b0002860 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.181:6793/0 conn(0x7f48b0002860 legacy=0x7f48b0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.316+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.181:6793/0 conn(0x7f48b0002860 legacy=0x7f48b0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.322+0000 7f48cfd7c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.322+0000 7f48cfd7c640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f48b0009e70 con 0x7f48b0009130 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48cd317640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.181:6793/0 conn(0x7f48b0009130 legacy=0x7f48b00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910826762 0 0) 0x7f48b0009e70 con 0x7f48b0009130 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 10 monclient(hunting): my global_id is 4571 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48b00065c0 con 0x7f48b0009130 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2274097475 0 0) 0x7f48b00065c0 con 0x7f48b0009130 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48b0009e70 con 0x7f48b0009130 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48b8005af0 con 0x7f48b0009130 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 10 monclient: dump: 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.342 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2037551118 0 0) 0x7f48b0009e70 con 0x7f48b0009130 2024-09-13T10:30:53.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f48b000c3f0 con 0x7f48b0009130 2024-09-13T10:30:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7547 (unknown 0 0 1957203735) 0x7f48b8006f60 con 0x7f48b0009130 2024-09-13T10:30:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.181:6793/0 conn(0x7f48b0009130 legacy=0x7f48b00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.325+0000 7f48be7fc640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.181:6793/0 conn(0x7f48b0009130 legacy=0x7f48b00095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.344 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:53.344 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 28, 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 67757, 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:53.345 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.346 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.347 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.348 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.349 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:53.350 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.351 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.352 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:53.352 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:53.352 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.352 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.352 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.352 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:53.352 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.352 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.353 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.354 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.354 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:53.354 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.354 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.354 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.354 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.354 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.354 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.354 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.354 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.356 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.357 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.358 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.359 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.362 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.363 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.364 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:53.364 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:53.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.326+0000 7f48cfd7c640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.195:6800/1839191919 conn(0x7f48ac040450 legacy=0x7f48ac042910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.326+0000 7f48cfd7c640 10 monclient: shutdown 2024-09-13T10:30:53.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.326+0000 7f48cfd7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:53.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.326+0000 7f48cfd7c640 1 -- 172.21.15.181:0/3574125077 >> v1:172.21.15.181:6792/0 conn(0x7f48c80a8340 legacy=0x7f48c812f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.326+0000 7f48ce319640 1 -- 172.21.15.181:0/3574125077 reap_dead start 2024-09-13T10:30:53.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.326+0000 7f48ce319640 1 -- 172.21.15.181:0/3574125077 reap_dead start 2024-09-13T10:30:53.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.326+0000 7f48cfd7c640 1 -- 172.21.15.181:0/3574125077 shutdown_connections 2024-09-13T10:30:53.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.326+0000 7f48cfd7c640 1 -- 172.21.15.181:0/3574125077 >> 172.21.15.181:0/3574125077 conn(0x7f48c80a6640 msgr2=0x7f48c80a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.326+0000 7f48cfd7c640 1 -- 172.21.15.181:0/3574125077 shutdown_connections 2024-09-13T10:30:53.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.326+0000 7f48cfd7c640 1 -- 172.21.15.181:0/3574125077 wait complete. 2024-09-13T10:30:53.367 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:30:53.367 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-09-13T10:30:53.367 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:30:53.457 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[35774]: starting. 2024-09-13T10:30:53.457 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[35774]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-35772 2024-09-13T10:30:53.457 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[35774]: shutting down. 2024-09-13T10:30:53.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.472+0000 7fe0c5dab640 10 monclient: get_monmap_and_config 2024-09-13T10:30:53.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.472+0000 7fe0c5dab640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.472+0000 7fe0c5dab640 10 monclient: monmap: 2024-09-13T10:30:53.473 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.473 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.473 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:53.472723+0000 2024-09-13T10:30:53.473 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:53.472723+0000 2024-09-13T10:30:53.473 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.474 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.474 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.474 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.474 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.474 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.474 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.474 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.474 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.474 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.474 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.474 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.472+0000 7fe0c5dab640 1 Processor -- start 2024-09-13T10:30:53.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.472+0000 7fe0c5dab640 1 -- start start 2024-09-13T10:30:53.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.472+0000 7fe0c5dab640 10 monclient: init 2024-09-13T10:30:53.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0c5dab640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0c5dab640 10 monclient: _add_conns ranks=[4,6,2,3,7,0,5,1,8] 2024-09-13T10:30:53.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0c5dab640 10 monclient(hunting): picked mon.noname-c con 0x7fe0c00a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:53.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0c5dab640 10 monclient(hunting): picked mon.noname-d con 0x7fe0c00a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:53.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0c5dab640 10 monclient(hunting): picked mon.noname-b con 0x7fe0c013f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:53.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0c5dab640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c00a5fe0 con 0x7fe0c013f9a0 2024-09-13T10:30:53.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0c5dab640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c00a8080 con 0x7fe0c00a66d0 2024-09-13T10:30:53.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0c5dab640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c00a42c0 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0c5dab640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0c5dab640 10 monclient(hunting): authenticate will time out at 792.978400s 2024-09-13T10:30:53.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0bffff640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fe0c013f9a0 legacy=0x7fe0c0141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:53.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0beffd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fe0c00a6ab0 0x7fe0c00a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:53396/0 (socket says 172.21.15.181:53396) 2024-09-13T10:30:53.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0bf7fe640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fe0c00a66d0 0x7fe0c00a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:33808/0 (socket says 172.21.15.181:33808) 2024-09-13T10:30:53.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.473+0000 7fe0beffd640 1 -- 172.21.15.181:0/870627055 learned_addr learned my addr 172.21.15.181:0/870627055 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0beffd640 1 -- 172.21.15.181:0/870627055 >> v1:172.21.15.181:6792/0 conn(0x7fe0c00a6ab0 legacy=0x7fe0c00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0bf7fe640 1 -- 172.21.15.181:0/870627055 >> v1:172.21.15.181:6791/0 conn(0x7fe0c00a66d0 legacy=0x7fe0c00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 1 -- 172.21.15.181:0/870627055 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782338534 0 0) 0x7fe0c00a42c0 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 10 monclient(hunting): my global_id is 4524 2024-09-13T10:30:53.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 1 -- 172.21.15.181:0/870627055 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0a8003520 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 1 -- 172.21.15.181:0/870627055 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3665773801 0 0) 0x7fe0c00a8080 con 0x7fe0c00a66d0 2024-09-13T10:30:53.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 10 monclient(hunting): my global_id is 4594 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 1 -- 172.21.15.181:0/870627055 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c00a42c0 con 0x7fe0c00a66d0 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 1 -- 172.21.15.181:0/870627055 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3754752125 0 0) 0x7fe0a8003520 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 1 -- 172.21.15.181:0/870627055 >> v1:172.21.15.181:6791/0 conn(0x7fe0c00a66d0 legacy=0x7fe0c00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 1 -- 172.21.15.181:0/870627055 >> v1:172.21.15.181:6790/0 conn(0x7fe0c013f9a0 legacy=0x7fe0c0141d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 1 monclient: found mon.noname-d 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 1 -- 172.21.15.181:0/870627055 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c01464e0 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.475+0000 7fe0be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0c5dab640 5 monclient: authenticate success, global_id 4524 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0c5dab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0be7fc640 1 -- 172.21.15.181:0/870627055 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe0b4001ad0 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0be7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0be7fc640 10 monclient: dump: 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.483 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0c5dab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0be7fc640 1 -- 172.21.15.181:0/870627055 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0b40048a0 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0be7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0be7fc640 1 -- 172.21.15.181:0/870627055 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe0b4004e10 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0c5dab640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0c5dab640 4 set_mon_vals no callback set 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0be7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0be7fc640 10 monclient: dump: 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.485 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0c5dab640 10 monclient: shutdown 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0c5dab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0c5dab640 1 -- 172.21.15.181:0/870627055 >> v1:172.21.15.181:6792/0 conn(0x7fe0c00a6ab0 legacy=0x7fe0c00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0c5dab640 1 -- 172.21.15.181:0/870627055 shutdown_connections 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0c5dab640 1 -- 172.21.15.181:0/870627055 >> 172.21.15.181:0/870627055 conn(0x7fe0c00abcd0 msgr2=0x7fe0c00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0c5dab640 1 -- 172.21.15.181:0/870627055 shutdown_connections 2024-09-13T10:30:53.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.476+0000 7fe0c5dab640 1 -- 172.21.15.181:0/870627055 wait complete. 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.477+0000 7fe0c5dab640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.477+0000 7fe0c5dab640 10 monclient: monmap: 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.487 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.477+0000 7fe0c5dab640 1 Processor -- start 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0c5dab640 1 -- start start 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0c5dab640 10 monclient: init 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0c5dab640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0c5dab640 10 monclient: _add_conns ranks=[5,4,3,7,6,1,0,8,2] 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0c5dab640 10 monclient(hunting): picked mon.noname-h con 0x7fe0c00a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0c5dab640 10 monclient(hunting): picked mon.noname-c con 0x7fe0c00a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:30:53.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0c5dab640 10 monclient(hunting): picked mon.noname-g con 0x7fe0c013f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:53.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0c5dab640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c013ede0 con 0x7fe0c013f9a0 2024-09-13T10:30:53.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0c5dab640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c013f0c0 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0c5dab640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c0137720 con 0x7fe0c00a66d0 2024-09-13T10:30:53.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0c5dab640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0c5dab640 10 monclient(hunting): authenticate will time out at 792.983602s 2024-09-13T10:30:53.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0beffd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fe0c00a6ab0 0x7fe0c01d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:33822/0 (socket says 172.21.15.181:33822) 2024-09-13T10:30:53.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.478+0000 7fe0beffd640 1 -- 172.21.15.181:0/4117014240 learned_addr learned my addr 172.21.15.181:0/4117014240 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.480+0000 7fe0beffd640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.181:6791/0 conn(0x7fe0c00a6ab0 legacy=0x7fe0c01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.480+0000 7fe0bf7fe640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.195:6791/0 conn(0x7fe0c00a66d0 legacy=0x7fe0c01ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.480+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2432929370 0 0) 0x7fe0c013f0c0 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.480+0000 7fe0a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.480+0000 7fe0a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.480+0000 7fe0a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.480+0000 7fe0a7fff640 10 monclient(hunting): my global_id is 4612 2024-09-13T10:30:53.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.480+0000 7fe0bffff640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.195:6790/0 conn(0x7fe0c013f9a0 legacy=0x7fe0c01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.480+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0ac003520 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1982427387 0 0) 0x7fe0c0137720 con 0x7fe0c00a66d0 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient(hunting): my global_id is 4559 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c013f0c0 con 0x7fe0c00a66d0 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 532594865 0 0) 0x7fe0c013ede0 con 0x7fe0c013f9a0 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient(hunting): my global_id is 4476 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c0137720 con 0x7fe0c013f9a0 2024-09-13T10:30:53.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1088259411 0 0) 0x7fe0ac003520 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0c013ede0 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe0b4004d90 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient(hunting): dump: 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.495 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1749112691 0 0) 0x7fe0c013ede0 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.195:6791/0 conn(0x7fe0c00a66d0 legacy=0x7fe0c01ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.195:6790/0 conn(0x7fe0c013f9a0 legacy=0x7fe0c01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 monclient: found mon.c 2024-09-13T10:30:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c0068910 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0c5dab640 5 monclient: authenticate success, global_id 4612 2024-09-13T10:30:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0c5dab640 10 monclient: _renew_subs 2024-09-13T10:30:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0c5dab640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0c5dab640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c013eb00 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0c5dab640 10 monclient: _renew_subs 2024-09-13T10:30:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0c5dab640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:30:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0c5dab640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fe0c013c780 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0b4001af0 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe0b4005740 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:30:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0bdffb640 4 set_mon_vals no callback set 2024-09-13T10:30:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.481+0000 7fe0a7fff640 10 monclient: dump: 2024-09-13T10:30:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.482+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe0b4011dc0 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.482+0000 7fe0c5dab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.482+0000 7fe0c5dab640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe0a00065c0 con 0x7fe0a0002860 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.482+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (unknown 1942903626 0 0) 0x7fe0b404e290 con 0x7fe0c00a6ab0 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.482+0000 7fe0bffff640 10 monclient: get_auth_request con 0x7fe0ac03f920 auth_method 0 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.484+0000 7fe0bf7fe640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.195:6789/0 conn(0x7fe0a0002860 legacy=0x7fe0a0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.484+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835172938 0 0) 0x7fe0a00065c0 con 0x7fe0a0002860 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.484+0000 7fe0a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.484+0000 7fe0a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.484+0000 7fe0a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.484+0000 7fe0a7fff640 10 monclient(hunting): my global_id is 54568 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.484+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c013ede0 con 0x7fe0a0002860 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 663420504 0 0) 0x7fe0c013ede0 con 0x7fe0a0002860 2024-09-13T10:30:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0a00065c0 con 0x7fe0a0002860 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe0b0004e50 con 0x7fe0a0002860 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 10 monclient: dump: 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2162254633 0 0) 0x7fe0a00065c0 con 0x7fe0a0002860 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0a000a160 con 0x7fe0a0002860 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe0b0005310 con 0x7fe0a0002860 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:53.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.195:6789/0 conn(0x7fe0a0002860 legacy=0x7fe0a0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.485+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.195:6789/0 conn(0x7fe0a0002860 legacy=0x7fe0a0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.491+0000 7fe0c5dab640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:53.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.491+0000 7fe0c5dab640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe0a0009e50 con 0x7fe0a0009110 2024-09-13T10:30:53.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0bf7fe640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.195:6789/0 conn(0x7fe0a0009110 legacy=0x7fe0a00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 170936350 0 0) 0x7fe0a0009e50 con 0x7fe0a0009110 2024-09-13T10:30:53.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 10 monclient(hunting): my global_id is 54577 2024-09-13T10:30:53.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0a00065c0 con 0x7fe0a0009110 2024-09-13T10:30:53.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4102461483 0 0) 0x7fe0a00065c0 con 0x7fe0a0009110 2024-09-13T10:30:53.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0a0009e50 con 0x7fe0a0009110 2024-09-13T10:30:53.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe0b0005b50 con 0x7fe0a0009110 2024-09-13T10:30:53.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:30:53.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 10 monclient: dump: 2024-09-13T10:30:53.505 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.505 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.505 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.505 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.505 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.505 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.506 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2247106381 0 0) 0x7fe0a0009e50 con 0x7fe0a0009110 2024-09-13T10:30:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.494+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe0a000c3f0 con 0x7fe0a0009110 2024-09-13T10:30:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7714 (unknown 0 0 563176750) 0x7fe0b0007e30 con 0x7fe0a0009110 2024-09-13T10:30:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0a7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0a7fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.195:6789/0 conn(0x7fe0a0009110 legacy=0x7fe0a00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0a7fff640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.195:6789/0 conn(0x7fe0a0009110 legacy=0x7fe0a00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.507 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 28, 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 67903, 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:30:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:53.528 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:53.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0c5dab640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.195:6800/1839191919 conn(0x7fe0ac03f920 legacy=0x7fe0ac041de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0c5dab640 10 monclient: shutdown 2024-09-13T10:30:53.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0c5dab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:53.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0c5dab640 1 -- 172.21.15.181:0/4117014240 >> v1:172.21.15.181:6791/0 conn(0x7fe0c00a6ab0 legacy=0x7fe0c01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0bffff640 1 -- 172.21.15.181:0/4117014240 reap_dead start 2024-09-13T10:30:53.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0bffff640 1 -- 172.21.15.181:0/4117014240 reap_dead start 2024-09-13T10:30:53.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0c5dab640 1 -- 172.21.15.181:0/4117014240 shutdown_connections 2024-09-13T10:30:53.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0c5dab640 1 -- 172.21.15.181:0/4117014240 >> 172.21.15.181:0/4117014240 conn(0x7fe0c00abcd0 msgr2=0x7fe0c0145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0c5dab640 1 -- 172.21.15.181:0/4117014240 shutdown_connections 2024-09-13T10:30:53.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.495+0000 7fe0c5dab640 1 -- 172.21.15.181:0/4117014240 wait complete. 2024-09-13T10:30:53.531 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:30:53.531 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-09-13T10:30:53.531 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:30:53.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.627+0000 7f0d3f11e640 10 monclient: get_monmap_and_config 2024-09-13T10:30:53.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.627+0000 7f0d3f11e640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.627+0000 7f0d3f11e640 10 monclient: monmap: 2024-09-13T10:30:53.629 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.629 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.629 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:53.628425+0000 2024-09-13T10:30:53.629 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:53.628425+0000 2024-09-13T10:30:53.630 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.630 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.630 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.630 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.630 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.630 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.630 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.630 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.630 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.630 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.630 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.630 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.628+0000 7f0d3f11e640 1 Processor -- start 2024-09-13T10:30:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.628+0000 7f0d3f11e640 1 -- start start 2024-09-13T10:30:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.628+0000 7f0d3f11e640 10 monclient: init 2024-09-13T10:30:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.629+0000 7f0d3f11e640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.629+0000 7f0d3f11e640 10 monclient: _add_conns ranks=[3,7,8,2,4,6,5,1,0] 2024-09-13T10:30:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.629+0000 7f0d3f11e640 10 monclient(hunting): picked mon.noname-g con 0x7f0d380a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.629+0000 7f0d3f11e640 10 monclient(hunting): picked mon.noname-i con 0x7f0d380a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.629+0000 7f0d3f11e640 10 monclient(hunting): picked mon.noname-e con 0x7f0d3813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.629+0000 7f0d3f11e640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d380a4bc0 con 0x7f0d380a6640 2024-09-13T10:30:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.629+0000 7f0d3f11e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3813a320 con 0x7f0d380a8340 2024-09-13T10:30:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.629+0000 7f0d3f11e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d380a8100 con 0x7f0d3813f750 2024-09-13T10:30:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.629+0000 7f0d3f11e640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.629+0000 7f0d3f11e640 10 monclient(hunting): authenticate will time out at 793.134161s 2024-09-13T10:30:53.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.629+0000 7f0d3d6bb640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f0d3813f750 0x7f0d38141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:52204/0 (socket says 172.21.15.181:52204) 2024-09-13T10:30:53.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.629+0000 7f0d3d6bb640 1 -- 172.21.15.181:0/3819042783 learned_addr learned my addr 172.21.15.181:0/3819042783 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d3d6bb640 1 -- 172.21.15.181:0/3819042783 >> v1:172.21.15.181:6793/0 conn(0x7f0d3813f750 legacy=0x7f0d38141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d3ceba640 1 -- 172.21.15.181:0/3819042783 >> v1:172.21.15.195:6790/0 conn(0x7f0d380a6640 legacy=0x7f0d38139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d37fff640 1 -- 172.21.15.181:0/3819042783 >> v1:172.21.15.195:6792/0 conn(0x7f0d380a8340 legacy=0x7f0d38139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2535877031 0 0) 0x7f0d380a8100 con 0x7f0d3813f750 2024-09-13T10:30:53.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient(hunting): my global_id is 4589 2024-09-13T10:30:53.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d20003520 con 0x7f0d3813f750 2024-09-13T10:30:53.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280605199 0 0) 0x7f0d380a4bc0 con 0x7f0d380a6640 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient(hunting): my global_id is 4485 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d380a8100 con 0x7f0d380a6640 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618622301 0 0) 0x7f0d3813a320 con 0x7f0d380a8340 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient(hunting): my global_id is 54547 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d380a4bc0 con 0x7f0d380a8340 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2080369922 0 0) 0x7f0d20003520 con 0x7f0d3813f750 2024-09-13T10:30:53.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 >> v1:172.21.15.195:6792/0 conn(0x7f0d380a8340 legacy=0x7f0d38139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 >> v1:172.21.15.195:6790/0 conn(0x7f0d380a6640 legacy=0x7f0d38139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 1 monclient: found mon.noname-e 2024-09-13T10:30:53.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:30:53.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d380a48e0 con 0x7f0d3813f750 2024-09-13T10:30:53.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0d30001e60 con 0x7f0d3813f750 2024-09-13T10:30:53.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d3f11e640 5 monclient: authenticate success, global_id 4589 2024-09-13T10:30:53.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d3f11e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:53.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d377fe640 10 monclient: dump: 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.641 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.642 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.642 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.642 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.642 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.631+0000 7f0d3f11e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:53.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d30004c20 con 0x7f0d3813f750 2024-09-13T10:30:53.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d377fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d377fe640 1 -- 172.21.15.181:0/3819042783 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0d30005190 con 0x7f0d3813f750 2024-09-13T10:30:53.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d3f11e640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:53.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d3f11e640 4 set_mon_vals no callback set 2024-09-13T10:30:53.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d377fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d377fe640 10 monclient: dump: 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.643 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d3f11e640 10 monclient: shutdown 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d3f11e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3819042783 >> v1:172.21.15.181:6793/0 conn(0x7f0d3813f750 legacy=0x7f0d38141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3819042783 shutdown_connections 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3819042783 >> 172.21.15.181:0/3819042783 conn(0x7f0d38077170 msgr2=0x7f0d380abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3819042783 shutdown_connections 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.632+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3819042783 wait complete. 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.633+0000 7f0d3f11e640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.633+0000 7f0d3f11e640 10 monclient: monmap: 2024-09-13T10:30:53.644 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.645 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.633+0000 7f0d3f11e640 1 Processor -- start 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.633+0000 7f0d3f11e640 1 -- start start 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.633+0000 7f0d3f11e640 10 monclient: init 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3f11e640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3f11e640 10 monclient: _add_conns ranks=[6,7,2,5,8,0,3,4,1] 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3f11e640 10 monclient(hunting): picked mon.noname-d con 0x7f0d380a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3f11e640 10 monclient(hunting): picked mon.noname-i con 0x7f0d3813f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3f11e640 10 monclient(hunting): picked mon.noname-b con 0x7f0d3809f8e0 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3f11e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d380a0840 con 0x7f0d3809f8e0 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3f11e640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d38142ef0 con 0x7f0d380a8340 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3f11e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3809e0e0 con 0x7f0d3813f750 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3f11e640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3d6bb640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f0d3809f8e0 legacy=0x7f0d381d6530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:53.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3f11e640 10 monclient(hunting): authenticate will time out at 793.139207s 2024-09-13T10:30:53.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3ceba640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f0d380a8340 0x7f0d3809d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:53412/0 (socket says 172.21.15.181:53412) 2024-09-13T10:30:53.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.634+0000 7f0d3ceba640 1 -- 172.21.15.181:0/3227474821 learned_addr learned my addr 172.21.15.181:0/3227474821 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d3ceba640 1 -- 172.21.15.181:0/3227474821 >> v1:172.21.15.181:6792/0 conn(0x7f0d380a8340 legacy=0x7f0d3809d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3559099653 0 0) 0x7f0d38142ef0 con 0x7f0d380a8340 2024-09-13T10:30:53.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient(hunting): my global_id is 4533 2024-09-13T10:30:53.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d24003550 con 0x7f0d380a8340 2024-09-13T10:30:53.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d37fff640 1 -- 172.21.15.181:0/3227474821 >> v1:172.21.15.195:6792/0 conn(0x7f0d3813f750 legacy=0x7f0d3809d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2312158505 0 0) 0x7f0d24003550 con 0x7f0d380a8340 2024-09-13T10:30:53.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d38142ef0 con 0x7f0d380a8340 2024-09-13T10:30:53.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0d28003950 con 0x7f0d380a8340 2024-09-13T10:30:53.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:53.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:53.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient(hunting): dump: 2024-09-13T10:30:53.654 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.654 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.654 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.654 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.654 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.654 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.654 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.654 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.654 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.654 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.655 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.655 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.655 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.655 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.655 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.655 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:53.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 557694095 0 0) 0x7f0d3809e0e0 con 0x7f0d3813f750 2024-09-13T10:30:53.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient(hunting): my global_id is 54556 2024-09-13T10:30:53.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d24003550 con 0x7f0d3813f750 2024-09-13T10:30:53.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4200745542 0 0) 0x7f0d38142ef0 con 0x7f0d380a8340 2024-09-13T10:30:53.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 >> v1:172.21.15.195:6792/0 conn(0x7f0d3813f750 legacy=0x7f0d3809d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 >> v1:172.21.15.181:6790/0 conn(0x7f0d3809f8e0 legacy=0x7f0d381d6530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:30:53.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 1 monclient: found mon.d 2024-09-13T10:30:53.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:53.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d380a2ac0 con 0x7f0d380a8340 2024-09-13T10:30:53.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d3f11e640 5 monclient: authenticate success, global_id 4533 2024-09-13T10:30:53.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d3f11e640 10 monclient: _renew_subs 2024-09-13T10:30:53.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d3f11e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:53.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0d380a0270 con 0x7f0d380a8340 2024-09-13T10:30:53.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d3f11e640 10 monclient: _renew_subs 2024-09-13T10:30:53.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d3f11e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:30:53.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.636+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f0d380a10e0 con 0x7f0d380a8340 2024-09-13T10:30:53.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.637+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d28001bf0 con 0x7f0d380a8340 2024-09-13T10:30:53.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.637+0000 7f0d357fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.637+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0d28004160 con 0x7f0d380a8340 2024-09-13T10:30:53.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.637+0000 7f0d357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.637+0000 7f0d357fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:53.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.637+0000 7f0d36ffd640 4 set_mon_vals no callback set 2024-09-13T10:30:53.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.637+0000 7f0d357fa640 10 monclient: dump: 2024-09-13T10:30:53.658 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.658 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.658 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.658 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.658 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.658 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.659 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.659 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.659 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.659 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.659 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.659 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.659 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.659 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.659 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.659 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.637+0000 7f0d3f11e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.637+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0d180065c0 con 0x7f0d18002860 2024-09-13T10:30:53.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.637+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0d28004300 con 0x7f0d380a8340 2024-09-13T10:30:53.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.638+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (unknown 1942903626 0 0) 0x7f0d2804e380 con 0x7f0d380a8340 2024-09-13T10:30:53.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.638+0000 7f0d3d6bb640 10 monclient: get_auth_request con 0x7f0d2403fa60 auth_method 0 2024-09-13T10:30:53.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d37fff640 1 -- 172.21.15.181:0/3227474821 >> v1:172.21.15.195:6790/0 conn(0x7f0d18002860 legacy=0x7f0d18004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702634459 0 0) 0x7f0d180065c0 con 0x7f0d18002860 2024-09-13T10:30:53.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 10 monclient(hunting): my global_id is 4494 2024-09-13T10:30:53.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d38142ef0 con 0x7f0d18002860 2024-09-13T10:30:53.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1631006459 0 0) 0x7f0d38142ef0 con 0x7f0d18002860 2024-09-13T10:30:53.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d180065c0 con 0x7f0d18002860 2024-09-13T10:30:53.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0d2c001d20 con 0x7f0d18002860 2024-09-13T10:30:53.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:53.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 10 monclient: dump: 2024-09-13T10:30:53.661 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.661 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.661 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.661 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.661 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.661 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1750835946 0 0) 0x7f0d180065c0 con 0x7f0d18002860 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d1800a160 con 0x7f0d18002860 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0d2c0057c0 con 0x7f0d18002860 2024-09-13T10:30:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.640+0000 7f0d357fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.641+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 >> v1:172.21.15.195:6790/0 conn(0x7f0d18002860 legacy=0x7f0d18004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.641+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 >> v1:172.21.15.195:6790/0 conn(0x7f0d18002860 legacy=0x7f0d18004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.646+0000 7f0d3f11e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.647+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0d18009e50 con 0x7f0d18009110 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d37fff640 1 -- 172.21.15.181:0/3227474821 >> v1:172.21.15.195:6790/0 conn(0x7f0d18009110 legacy=0x7f0d180095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902267145 0 0) 0x7f0d18009e50 con 0x7f0d18009110 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d357fa640 10 monclient(hunting): my global_id is 4503 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d180065c0 con 0x7f0d18009110 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1081846338 0 0) 0x7f0d180065c0 con 0x7f0d18009110 2024-09-13T10:30:53.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d18009e50 con 0x7f0d18009110 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0d2c003da0 con 0x7f0d18009110 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d357fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.649+0000 7f0d357fa640 10 monclient: dump: 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.664 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.665 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.665 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.665 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.665 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.665 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.665 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.665 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3134707647 0 0) 0x7f0d18009e50 con 0x7f0d18009110 2024-09-13T10:30:53.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0d1800c3a0 con 0x7f0d18009110 2024-09-13T10:30:53.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7714 (unknown 0 0 2438734915) 0x7f0d2c004060 con 0x7f0d18009110 2024-09-13T10:30:53.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d357fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:53.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d357fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:53.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 >> v1:172.21.15.195:6790/0 conn(0x7f0d18009110 legacy=0x7f0d180095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d357fa640 1 -- 172.21.15.181:0/3227474821 >> v1:172.21.15.195:6790/0 conn(0x7f0d18009110 legacy=0x7f0d180095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.666 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 28, 2024-09-13T10:30:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 68065, 2024-09-13T10:30:53.666 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:30:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.667 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.668 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.669 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.670 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.671 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.672 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.673 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:53.674 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:53.675 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.676 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.677 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:53.678 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.679 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.680 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.681 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.682 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.684 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.685 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.686 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.687 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.687 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:53.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.687 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.687 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.687 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.687 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.687 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:53.687 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:53.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3227474821 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0d2403fa60 legacy=0x7f0d24041f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d3f11e640 10 monclient: shutdown 2024-09-13T10:30:53.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d3f11e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:53.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3227474821 >> v1:172.21.15.181:6792/0 conn(0x7f0d380a8340 legacy=0x7f0d3809d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d3d6bb640 1 -- 172.21.15.181:0/3227474821 reap_dead start 2024-09-13T10:30:53.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d3d6bb640 1 -- 172.21.15.181:0/3227474821 reap_dead start 2024-09-13T10:30:53.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3227474821 shutdown_connections 2024-09-13T10:30:53.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3227474821 >> 172.21.15.181:0/3227474821 conn(0x7f0d380a6640 msgr2=0x7f0d38141f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3227474821 shutdown_connections 2024-09-13T10:30:53.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.650+0000 7f0d3f11e640 1 -- 172.21.15.181:0/3227474821 wait complete. 2024-09-13T10:30:53.690 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:30:53.690 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-09-13T10:30:53.690 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:30:53.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.788+0000 7f0040608640 10 monclient: get_monmap_and_config 2024-09-13T10:30:53.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.788+0000 7f0040608640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.788+0000 7f0040608640 10 monclient: monmap: 2024-09-13T10:30:53.790 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.790 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.790 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:53.789037+0000 2024-09-13T10:30:53.790 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:53.789037+0000 2024-09-13T10:30:53.790 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.790 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.790 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.790 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.790 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.790 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.791 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.791 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.791 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.791 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.791 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.791 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 1 Processor -- start 2024-09-13T10:30:53.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 1 -- start start 2024-09-13T10:30:53.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 10 monclient: init 2024-09-13T10:30:53.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 10 monclient: _add_conns ranks=[1,2,3,7,6,8,0,5,4] 2024-09-13T10:30:53.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 10 monclient(hunting): picked mon.noname-f con 0x7f00380a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:30:53.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 10 monclient(hunting): picked mon.noname-b con 0x7f00380a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:53.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 10 monclient(hunting): picked mon.noname-g con 0x7f003813f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:53.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00380a4bc0 con 0x7f00380a6640 2024-09-13T10:30:53.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f003813a320 con 0x7f00380a8340 2024-09-13T10:30:53.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00380a8100 con 0x7f003813f750 2024-09-13T10:30:53.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f0040608640 10 monclient(hunting): authenticate will time out at 793.294774s 2024-09-13T10:30:53.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f003dba3640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f00380a8340 legacy=0x7f0038139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:53.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f003eba5640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f003813f750 0x7f0038141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:43432/0 (socket says 172.21.15.181:43432) 2024-09-13T10:30:53.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f003e3a4640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f00380a6640 0x7f0038139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:60566/0 (socket says 172.21.15.181:60566) 2024-09-13T10:30:53.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.789+0000 7f003eba5640 1 -- 172.21.15.181:0/2957075115 learned_addr learned my addr 172.21.15.181:0/2957075115 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003e3a4640 1 -- 172.21.15.181:0/2957075115 >> v1:172.21.15.195:6789/0 conn(0x7f00380a6640 legacy=0x7f0038139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003eba5640 1 -- 172.21.15.181:0/2957075115 >> v1:172.21.15.195:6790/0 conn(0x7f003813f750 legacy=0x7f0038141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 1 -- 172.21.15.181:0/2957075115 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884733981 0 0) 0x7f00380a8100 con 0x7f003813f750 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient(hunting): my global_id is 4512 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 1 -- 172.21.15.181:0/2957075115 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0024003520 con 0x7f003813f750 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 1 -- 172.21.15.181:0/2957075115 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192962002 0 0) 0x7f00380a4bc0 con 0x7f00380a6640 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient(hunting): my global_id is 54586 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 1 -- 172.21.15.181:0/2957075115 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00380a8100 con 0x7f00380a6640 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 1 -- 172.21.15.181:0/2957075115 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3855862233 0 0) 0x7f0024003520 con 0x7f003813f750 2024-09-13T10:30:53.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 1 -- 172.21.15.181:0/2957075115 >> v1:172.21.15.181:6790/0 conn(0x7f00380a8340 legacy=0x7f0038139c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 1 -- 172.21.15.181:0/2957075115 >> v1:172.21.15.195:6789/0 conn(0x7f00380a6640 legacy=0x7f0038139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 1 monclient: found mon.noname-g 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 1 -- 172.21.15.181:0/2957075115 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00380a48e0 con 0x7f003813f750 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 1 -- 172.21.15.181:0/2957075115 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0030001e50 con 0x7f003813f750 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:30:53.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient: dump: 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.800 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f0040608640 5 monclient: authenticate success, global_id 4512 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f0040608640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 1 -- 172.21.15.181:0/2957075115 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0030002070 con 0x7f003813f750 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f0040608640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f0040608640 4 set_mon_vals no callback set 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 1 -- 172.21.15.181:0/2957075115 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0030004fa0 con 0x7f003813f750 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.792+0000 7f003d3a2640 10 monclient: dump: 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.801 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.802 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.802 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.802 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.802 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.802 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.802 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.802 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.802 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.802 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.802 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.802 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.793+0000 7f0040608640 10 monclient: shutdown 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.793+0000 7f0040608640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.793+0000 7f0040608640 1 -- 172.21.15.181:0/2957075115 >> v1:172.21.15.195:6790/0 conn(0x7f003813f750 legacy=0x7f0038141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.793+0000 7f0040608640 1 -- 172.21.15.181:0/2957075115 shutdown_connections 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.793+0000 7f0040608640 1 -- 172.21.15.181:0/2957075115 >> 172.21.15.181:0/2957075115 conn(0x7f0038077170 msgr2=0x7f00380abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.793+0000 7f0040608640 1 -- 172.21.15.181:0/2957075115 shutdown_connections 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.793+0000 7f0040608640 1 -- 172.21.15.181:0/2957075115 wait complete. 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.793+0000 7f0040608640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.793+0000 7f0040608640 10 monclient: monmap: 2024-09-13T10:30:53.803 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.804 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.805 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 1 Processor -- start 2024-09-13T10:30:53.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 1 -- start start 2024-09-13T10:30:53.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 10 monclient: init 2024-09-13T10:30:53.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 10 monclient: _add_conns ranks=[3,7,0,1,4,5,6,2,8] 2024-09-13T10:30:53.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 10 monclient(hunting): picked mon.noname-g con 0x7f00380a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:53.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 10 monclient(hunting): picked mon.noname-i con 0x7f003813f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:30:53.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 10 monclient(hunting): picked mon.noname-a con 0x7f00380a28d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:30:53.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00380a0200 con 0x7f00380a28d0 2024-09-13T10:30:53.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00380a1070 con 0x7f00380a8340 2024-09-13T10:30:53.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f003809e040 con 0x7f003813f750 2024-09-13T10:30:53.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f0040608640 10 monclient(hunting): authenticate will time out at 793.299831s 2024-09-13T10:30:53.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f003eba5640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f00380a28d0 0x7f00381d6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:39200/0 (socket says 172.21.15.181:39200) 2024-09-13T10:30:53.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.794+0000 7f003eba5640 1 -- 172.21.15.181:0/1627092458 learned_addr learned my addr 172.21.15.181:0/1627092458 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f003eba5640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.181:6789/0 conn(0x7f00380a28d0 legacy=0x7f00381d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738808460 0 0) 0x7f00380a0200 con 0x7f00380a28d0 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): my global_id is 54459 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f001c003550 con 0x7f00380a28d0 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f003dba3640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.195:6792/0 conn(0x7f003813f750 legacy=0x7f003809d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f003e3a4640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.195:6790/0 conn(0x7f00380a8340 legacy=0x7f003809d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3312730446 0 0) 0x7f001c003550 con 0x7f00380a28d0 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00380a0200 con 0x7f00380a28d0 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0030001eb0 con 0x7f00380a28d0 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:30:53.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): dump: 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.811 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.812 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.812 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:53.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2239532563 0 0) 0x7f003809e040 con 0x7f003813f750 2024-09-13T10:30:53.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): my global_id is 54565 2024-09-13T10:30:53.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f001c003550 con 0x7f003813f750 2024-09-13T10:30:53.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566158481 0 0) 0x7f00380a1070 con 0x7f00380a8340 2024-09-13T10:30:53.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient(hunting): my global_id is 4521 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f003809e040 con 0x7f00380a8340 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1439218407 0 0) 0x7f00380a0200 con 0x7f00380a28d0 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.195:6792/0 conn(0x7f003813f750 legacy=0x7f003809d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.195:6790/0 conn(0x7f00380a8340 legacy=0x7f003809d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 monclient: found mon.a 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00380a0d90 con 0x7f00380a28d0 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f0040608640 5 monclient: authenticate success, global_id 54459 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f0040608640 10 monclient: _renew_subs 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f0040608640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f0040608640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f003809fae0 con 0x7f00380a28d0 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f0040608640 10 monclient: _renew_subs 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f0040608640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f0040608640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f00381d7c20 con 0x7f00380a28d0 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0030001890 con 0x7f00380a28d0 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0030005550 con 0x7f00380a28d0 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f003cba1640 4 set_mon_vals no callback set 2024-09-13T10:30:53.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:30:53.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.797+0000 7f002effd640 10 monclient: dump: 2024-09-13T10:30:53.815 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.815 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.815 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.815 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.815 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.815 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.815 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.815 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.815 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.815 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.815 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.816 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.816 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.816 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.816 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.816 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.798+0000 7f0040608640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.798+0000 7f0040608640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f00200065c0 con 0x7f0020002860 2024-09-13T10:30:53.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.798+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f00300057f0 con 0x7f00380a28d0 2024-09-13T10:30:53.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.798+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (unknown 1942903626 0 0) 0x7f003004e5e0 con 0x7f00380a28d0 2024-09-13T10:30:53.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.798+0000 7f003dba3640 10 monclient: get_auth_request con 0x7f001c03fd40 auth_method 0 2024-09-13T10:30:53.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.800+0000 7f003e3a4640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.195:6791/0 conn(0x7f0020002860 legacy=0x7f0020004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.800+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652421205 0 0) 0x7f00200065c0 con 0x7f0020002860 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.800+0000 7f002effd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.800+0000 7f002effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.800+0000 7f002effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.800+0000 7f002effd640 10 monclient(hunting): my global_id is 4568 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.800+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00380a0200 con 0x7f0020002860 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2219783703 0 0) 0x7f00380a0200 con 0x7f0020002860 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00200065c0 con 0x7f0020002860 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0028001320 con 0x7f0020002860 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 10 monclient: dump: 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.817 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.818 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2915463706 0 0) 0x7f00200065c0 con 0x7f0020002860 2024-09-13T10:30:53.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f002000a160 con 0x7f0020002860 2024-09-13T10:30:53.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0028004910 con 0x7f0020002860 2024-09-13T10:30:53.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:53.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.195:6791/0 conn(0x7f0020002860 legacy=0x7f0020004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.801+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.195:6791/0 conn(0x7f0020002860 legacy=0x7f0020004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.807+0000 7f0040608640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:53.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.807+0000 7f0040608640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0020009e50 con 0x7f0020009110 2024-09-13T10:30:53.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f003e3a4640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.195:6791/0 conn(0x7f0020009110 legacy=0x7f00200095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433794621 0 0) 0x7f0020009e50 con 0x7f0020009110 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 10 monclient(hunting): my global_id is 4577 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00200065c0 con 0x7f0020009110 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3312811111 0 0) 0x7f00200065c0 con 0x7f0020009110 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0020009e50 con 0x7f0020009110 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f00280051e0 con 0x7f0020009110 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 10 monclient: dump: 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.821 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.822 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.823 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1390784468 0 0) 0x7f0020009e50 con 0x7f0020009110 2024-09-13T10:30:53.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.810+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f002000c3f0 con 0x7f0020009110 2024-09-13T10:30:53.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7547 (unknown 0 0 433988902) 0x7f0028007500 con 0x7f0020009110 2024-09-13T10:30:53.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f002effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:53.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f002effd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:53.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.195:6791/0 conn(0x7f0020009110 legacy=0x7f00200095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f002effd640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.195:6791/0 conn(0x7f0020009110 legacy=0x7f00200095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.823 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:53.823 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:53.824 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:53.824 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:53.824 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 28, 2024-09-13T10:30:53.824 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 68238, 2024-09-13T10:30:53.824 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:53.824 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:53.824 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:53.824 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:53.824 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:53.824 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:53.824 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:53.824 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.825 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.826 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.827 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.827 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.827 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.827 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.827 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.827 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:53.827 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:53.827 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:53.828 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:53.828 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:53.828 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:53.828 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.828 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.828 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:53.828 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:53.828 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.829 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.830 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.830 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.830 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.830 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.830 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.830 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:53.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.830 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:53.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.831 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.832 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.834 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.835 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.836 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.837 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.838 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.838 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:53.838 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.838 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.838 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.838 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.838 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.838 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.838 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.838 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.839 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.840 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:53.841 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.842 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.843 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.844 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.844 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:30:53.844 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.844 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.844 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:53.844 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:53.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f0040608640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.195:6800/1839191919 conn(0x7f001c03fd40 legacy=0x7f001c042200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f0040608640 10 monclient: shutdown 2024-09-13T10:30:53.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f0040608640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:53.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f0040608640 1 -- 172.21.15.181:0/1627092458 >> v1:172.21.15.181:6789/0 conn(0x7f00380a28d0 legacy=0x7f00381d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f003eba5640 1 -- 172.21.15.181:0/1627092458 reap_dead start 2024-09-13T10:30:53.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f003eba5640 1 -- 172.21.15.181:0/1627092458 reap_dead start 2024-09-13T10:30:53.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f0040608640 1 -- 172.21.15.181:0/1627092458 shutdown_connections 2024-09-13T10:30:53.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f0040608640 1 -- 172.21.15.181:0/1627092458 >> 172.21.15.181:0/1627092458 conn(0x7f00380a6640 msgr2=0x7f0038141d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f0040608640 1 -- 172.21.15.181:0/1627092458 shutdown_connections 2024-09-13T10:30:53.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.811+0000 7f0040608640 1 -- 172.21.15.181:0/1627092458 wait complete. 2024-09-13T10:30:53.846 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:30:53.846 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-09-13T10:30:53.847 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:30:53.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.943+0000 7fb860ccd640 10 monclient: get_monmap_and_config 2024-09-13T10:30:53.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.943+0000 7fb860ccd640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.943+0000 7fb860ccd640 10 monclient: monmap: 2024-09-13T10:30:53.945 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.945 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.945 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:30:53.944270+0000 2024-09-13T10:30:53.945 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:30:53.944270+0000 2024-09-13T10:30:53.945 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.945 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.945 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.946 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.946 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.946 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.946 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.946 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.946 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.946 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.946 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.946 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.944+0000 7fb860ccd640 1 Processor -- start 2024-09-13T10:30:53.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.944+0000 7fb860ccd640 1 -- start start 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.944+0000 7fb860ccd640 10 monclient: init 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.944+0000 7fb860ccd640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.944+0000 7fb860ccd640 10 monclient: _add_conns ranks=[2,5,6,8,7,0,1,4,3] 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.944+0000 7fb860ccd640 10 monclient(hunting): picked mon.noname-b con 0x7fb85c0a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.944+0000 7fb860ccd640 10 monclient(hunting): picked mon.noname-h con 0x7fb85c0a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.944+0000 7fb860ccd640 10 monclient(hunting): picked mon.noname-d con 0x7fb85c13f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.944+0000 7fb860ccd640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85c0a4bc0 con 0x7fb85c0a6640 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.945+0000 7fb860ccd640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85c13a320 con 0x7fb85c0a8340 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.945+0000 7fb85a59c640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fb85c0a6640 legacy=0x7fb85c139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.945+0000 7fb860ccd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85c0a8100 con 0x7fb85c13f750 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.945+0000 7fb860ccd640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.945+0000 7fb860ccd640 10 monclient(hunting): authenticate will time out at 793.450041s 2024-09-13T10:30:53.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.945+0000 7fb85ad9d640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fb85c13f750 0x7fb85c141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:53424/0 (socket says 172.21.15.181:53424) 2024-09-13T10:30:53.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.945+0000 7fb85ad9d640 1 -- 172.21.15.181:0/179287880 learned_addr learned my addr 172.21.15.181:0/179287880 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85ad9d640 1 -- 172.21.15.181:0/179287880 >> v1:172.21.15.181:6792/0 conn(0x7fb85c13f750 legacy=0x7fb85c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 1 -- 172.21.15.181:0/179287880 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645654066 0 0) 0x7fb85c0a8100 con 0x7fb85c13f750 2024-09-13T10:30:53.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient(hunting): my global_id is 4542 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 1 -- 172.21.15.181:0/179287880 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb844003520 con 0x7fb85c13f750 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 1 -- 172.21.15.181:0/179287880 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3022004320 0 0) 0x7fb844003520 con 0x7fb85c13f750 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 1 -- 172.21.15.181:0/179287880 >> v1:172.21.15.195:6791/0 conn(0x7fb85c0a8340 legacy=0x7fb85c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb859d9b640 1 -- 172.21.15.181:0/179287880 >> v1:172.21.15.195:6791/0 conn(0x7fb85c0a8340 legacy=0x7fb85c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 1 -- 172.21.15.181:0/179287880 >> v1:172.21.15.181:6790/0 conn(0x7fb85c0a6640 legacy=0x7fb85c139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 1 monclient: found mon.noname-d 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 1 -- 172.21.15.181:0/179287880 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c0a48e0 con 0x7fb85c13f750 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 1 -- 172.21.15.181:0/179287880 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb854001e60 con 0x7fb85c13f750 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb860ccd640 5 monclient: authenticate success, global_id 4542 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb860ccd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient: dump: 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.954 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb860ccd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 1 -- 172.21.15.181:0/179287880 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb854004c20 con 0x7fb85c13f750 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 1 -- 172.21.15.181:0/179287880 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb854005150 con 0x7fb85c13f750 2024-09-13T10:30:53.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb860ccd640 10 monclient: get_monmap_and_config success 2024-09-13T10:30:53.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb860ccd640 4 set_mon_vals no callback set 2024-09-13T10:30:53.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:30:53.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.947+0000 7fb85959a640 10 monclient: dump: 2024-09-13T10:30:53.956 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.956 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.956 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.956 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.956 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.948+0000 7fb860ccd640 10 monclient: shutdown 2024-09-13T10:30:53.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.948+0000 7fb860ccd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.948+0000 7fb860ccd640 1 -- 172.21.15.181:0/179287880 >> v1:172.21.15.181:6792/0 conn(0x7fb85c13f750 legacy=0x7fb85c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.948+0000 7fb860ccd640 1 -- 172.21.15.181:0/179287880 shutdown_connections 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.948+0000 7fb860ccd640 1 -- 172.21.15.181:0/179287880 >> 172.21.15.181:0/179287880 conn(0x7fb85c077170 msgr2=0x7fb85c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.948+0000 7fb860ccd640 1 -- 172.21.15.181:0/179287880 shutdown_connections 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.948+0000 7fb860ccd640 1 -- 172.21.15.181:0/179287880 wait complete. 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.948+0000 7fb860ccd640 10 monclient: build_initial_monmap 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 10 monclient: monmap: 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:30:53.958 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 1 Processor -- start 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 1 -- start start 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 10 monclient: init 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 10 monclient: _reopen_session rank -1 2024-09-13T10:30:53.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 10 monclient: _add_conns ranks=[6,8,3,0,2,5,1,7,4] 2024-09-13T10:30:53.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 10 monclient(hunting): picked mon.noname-d con 0x7fb85c0a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:30:53.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 10 monclient(hunting): picked mon.noname-e con 0x7fb85c13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:30:53.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 10 monclient(hunting): picked mon.noname-g con 0x7fb85c1d4310 addr v1:172.21.15.195:6790/0 2024-09-13T10:30:53.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85c0a10e0 con 0x7fb85c1d4310 2024-09-13T10:30:53.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85c142e40 con 0x7fb85c0a8340 2024-09-13T10:30:53.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85c0a0270 con 0x7fb85c13f750 2024-09-13T10:30:53.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 10 monclient(hunting): _renew_subs 2024-09-13T10:30:53.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb860ccd640 10 monclient(hunting): authenticate will time out at 793.454848s 2024-09-13T10:30:53.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb85a59c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fb85c0a8340 0x7fb85c09d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:53436/0 (socket says 172.21.15.181:53436) 2024-09-13T10:30:53.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.949+0000 7fb85a59c640 1 -- 172.21.15.181:0/3864251920 learned_addr learned my addr 172.21.15.181:0/3864251920 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:30:53.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb85a59c640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.181:6792/0 conn(0x7fb85c0a8340 legacy=0x7fb85c09d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb859d9b640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.181:6793/0 conn(0x7fb85c13f750 legacy=0x7fb85c09d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3514254464 0 0) 0x7fb85c142e40 con 0x7fb85c0a8340 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 10 monclient(hunting): my global_id is 4551 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb83c003550 con 0x7fb85c0a8340 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611417905 0 0) 0x7fb85c0a0270 con 0x7fb85c13f750 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 10 monclient(hunting): my global_id is 4598 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb85c142e40 con 0x7fb85c13f750 2024-09-13T10:30:53.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1101748439 0 0) 0x7fb85c142e40 con 0x7fb85c13f750 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb85ad9d640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.195:6790/0 conn(0x7fb85c1d4310 legacy=0x7fb85c1d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb85c0a0270 con 0x7fb85c13f750 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.952+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb850003610 con 0x7fb85c13f750 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient(hunting): dump: 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.966 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437767534 0 0) 0x7fb85c0a10e0 con 0x7fb85c1d4310 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient(hunting): my global_id is 4530 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb85c142e40 con 0x7fb85c1d4310 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 444175029 0 0) 0x7fb83c003550 con 0x7fb85c0a8340 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb85c0a10e0 con 0x7fb85c0a8340 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 19947589 0 0) 0x7fb85c0a0270 con 0x7fb85c13f750 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.181:6792/0 conn(0x7fb85c0a8340 legacy=0x7fb85c09d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.195:6790/0 conn(0x7fb85c1d4310 legacy=0x7fb85c1d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient: _finish_hunting 0 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 1 monclient: found mon.e 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c09ed80 con 0x7fb85c13f750 2024-09-13T10:30:53.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient: _finish_auth 0 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient: _check_auth_tickets 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb860ccd640 5 monclient: authenticate success, global_id 4598 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb860ccd640 10 monclient: _renew_subs 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb860ccd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb860ccd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb85c09e0b0 con 0x7fb85c13f750 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb860ccd640 10 monclient: _renew_subs 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb860ccd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb860ccd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fb85c09fb80 con 0x7fb85c13f750 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb850003b20 con 0x7fb85c13f750 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb850004010 con 0x7fb85c13f750 2024-09-13T10:30:53.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb858d99640 4 set_mon_vals no callback set 2024-09-13T10:30:53.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:30:53.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.954+0000 7fb84affd640 10 monclient: dump: 2024-09-13T10:30:53.970 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.970 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.970 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.970 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.970 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.970 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.970 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.955+0000 7fb860ccd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.955+0000 7fb860ccd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb8400065c0 con 0x7fb840002860 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.955+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb8500041b0 con 0x7fb85c13f750 2024-09-13T10:30:53.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.955+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (unknown 1942903626 0 0) 0x7fb85004e140 con 0x7fb85c13f750 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.956+0000 7fb85ad9d640 10 monclient: get_auth_request con 0x7fb83c03ff30 auth_method 0 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb85a59c640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.195:6792/0 conn(0x7fb840002860 legacy=0x7fb840004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1977885230 0 0) 0x7fb8400065c0 con 0x7fb840002860 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 10 monclient(hunting): my global_id is 54574 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb85c0a0270 con 0x7fb840002860 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1571647133 0 0) 0x7fb85c0a0270 con 0x7fb840002860 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8400065c0 con 0x7fb840002860 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb84c004f50 con 0x7fb840002860 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 10 monclient: dump: 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.973 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.974 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.974 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.974 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.974 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2752338206 0 0) 0x7fb8400065c0 con 0x7fb840002860 2024-09-13T10:30:53.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.958+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb84000a160 con 0x7fb840002860 2024-09-13T10:30:53.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.959+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb84c007270 con 0x7fb840002860 2024-09-13T10:30:53.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.959+0000 7fb84affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:30:53.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.959+0000 7fb84affd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:30:53.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.959+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.195:6792/0 conn(0x7fb840002860 legacy=0x7fb840004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.959+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.195:6792/0 conn(0x7fb840002860 legacy=0x7fb840004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.965+0000 7fb860ccd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:30:53.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.965+0000 7fb860ccd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb840009e50 con 0x7fb840009110 2024-09-13T10:30:53.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb85a59c640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.195:6792/0 conn(0x7fb840009110 legacy=0x7fb8400095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:30:53.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1840445205 0 0) 0x7fb840009e50 con 0x7fb840009110 2024-09-13T10:30:53.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 10 monclient(hunting): _negotiate 2024-09-13T10:30:53.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:30:53.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:30:53.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 10 monclient(hunting): my global_id is 54583 2024-09-13T10:30:53.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8400065c0 con 0x7fb840009110 2024-09-13T10:30:53.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3629478897 0 0) 0x7fb8400065c0 con 0x7fb840009110 2024-09-13T10:30:53.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb840009e50 con 0x7fb840009110 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb84c005970 con 0x7fb840009110 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 10 monclient: dump: 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:30:53.977 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 204726543 0 0) 0x7fb840009e50 con 0x7fb840009110 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.968+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb84000c3a0 con 0x7fb840009110 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7714 (unknown 0 0 2674872560) 0x7fb84c006d70 con 0x7fb840009110 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb84affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb84affd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:30:53.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.195:6792/0 conn(0x7fb840009110 legacy=0x7fb8400095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:53.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb84affd640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.195:6792/0 conn(0x7fb840009110 legacy=0x7fb8400095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:30:53.979 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:30:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:30:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 28, 2024-09-13T10:30:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 68388, 2024-09-13T10:30:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:30:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:30:53.979 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:30:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:30:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:30:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:30:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:30:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:30:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:30:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:30:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:30:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:30:53.980 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:30:53.981 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:30:53.983 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:30:53.984 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:30:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:30:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:30:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:30:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:30:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:30:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:30:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.987 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:30:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:30:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:30:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.988 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:30:53.989 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.990 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.991 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.992 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.993 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.995 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:30:53.996 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:30:53.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:30:53.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:30:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:30:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:30:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:30:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:30:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:30:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:30:53.999 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:30:53.999 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:30:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb860ccd640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb83c03ff30 legacy=0x7fb83c0423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb860ccd640 10 monclient: shutdown 2024-09-13T10:30:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb860ccd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:30:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb860ccd640 1 -- 172.21.15.181:0/3864251920 >> v1:172.21.15.181:6793/0 conn(0x7fb85c13f750 legacy=0x7fb85c09d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:30:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb85ad9d640 1 -- 172.21.15.181:0/3864251920 reap_dead start 2024-09-13T10:30:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb85ad9d640 1 -- 172.21.15.181:0/3864251920 reap_dead start 2024-09-13T10:30:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb860ccd640 1 -- 172.21.15.181:0/3864251920 shutdown_connections 2024-09-13T10:30:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb860ccd640 1 -- 172.21.15.181:0/3864251920 >> 172.21.15.181:0/3864251920 conn(0x7fb85c0a6640 msgr2=0x7fb85c141e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:30:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb860ccd640 1 -- 172.21.15.181:0/3864251920 shutdown_connections 2024-09-13T10:30:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:30:53.969+0000 7fb860ccd640 1 -- 172.21.15.181:0/3864251920 wait complete. 2024-09-13T10:30:54.002 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:30:54.002 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T10:30:55.573 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:30:55.573 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35807]: starting. 2024-09-13T10:30:55.573 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35807]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-35772 2024-09-13T10:30:55.573 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35807]: created object 0... 2024-09-13T10:30:55.573 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35807]: created object 25... 2024-09-13T10:30:55.573 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35807]: created object 49... 2024-09-13T10:30:55.573 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35807]: finishing. 2024-09-13T10:30:55.574 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35807]: shutting down. 2024-09-13T10:30:55.610 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:30:55.610 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[35809]: starting. 2024-09-13T10:30:55.610 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[35809]: listing objects. 2024-09-13T10:30:55.610 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[35809]: listed object 0... 2024-09-13T10:30:55.610 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[35809]: listed object 25... 2024-09-13T10:30:55.610 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[35809]: saw 50 objects 2024-09-13T10:30:55.611 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[35809]: shutting down. 2024-09-13T10:30:56.483 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:30:56.484 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[35808]: starting. 2024-09-13T10:30:56.484 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[35808]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-35772 2024-09-13T10:30:56.484 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[35808]: shutting down. 2024-09-13T10:30:56.485 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:30:56.485 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:30:56.485 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:30:56.488 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:30:58.599 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35876]: starting. 2024-09-13T10:30:58.599 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35876]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-35875 2024-09-13T10:30:58.599 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35876]: created object 0... 2024-09-13T10:30:58.599 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35876]: created object 25... 2024-09-13T10:30:58.599 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35876]: created object 49... 2024-09-13T10:30:58.599 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35876]: finishing. 2024-09-13T10:30:58.599 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35876]: shutting down. 2024-09-13T10:30:59.498 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[35877]: starting. 2024-09-13T10:30:59.498 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[35877]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-35875 2024-09-13T10:30:59.498 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[35877]: shutting down. 2024-09-13T10:31:01.938 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:01.938 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35910]: starting. 2024-09-13T10:31:01.938 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35910]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-35875 2024-09-13T10:31:01.938 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35910]: created object 0... 2024-09-13T10:31:01.938 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35910]: created object 25... 2024-09-13T10:31:01.939 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35910]: created object 49... 2024-09-13T10:31:01.939 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35910]: finishing. 2024-09-13T10:31:01.939 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[35910]: shutting down. 2024-09-13T10:31:02.396 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:02.397 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[35912]: starting. 2024-09-13T10:31:02.397 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[35912]: listing objects. 2024-09-13T10:31:02.397 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[35912]: listed object 0... 2024-09-13T10:31:02.397 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[35912]: listed object 25... 2024-09-13T10:31:02.397 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[35912]: saw 50 objects 2024-09-13T10:31:02.397 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[35912]: shutting down. 2024-09-13T10:31:02.853 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:02.853 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[35911]: starting. 2024-09-13T10:31:02.853 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[35911]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-35875 2024-09-13T10:31:02.853 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[35911]: shutting down. 2024-09-13T10:31:02.855 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:02.855 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:02.855 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:31:02.857 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:31:04.959 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35979]: starting. 2024-09-13T10:31:04.959 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35979]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-35978 2024-09-13T10:31:04.959 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35979]: created object 0... 2024-09-13T10:31:04.959 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35979]: created object 25... 2024-09-13T10:31:04.959 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35979]: created object 49... 2024-09-13T10:31:04.959 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35979]: finishing. 2024-09-13T10:31:04.959 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[35979]: shutting down. 2024-09-13T10:31:05.860 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[35980]: starting. 2024-09-13T10:31:05.860 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[35980]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-35978 2024-09-13T10:31:05.860 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[35980]: shutting down. 2024-09-13T10:31:07.963 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:07.964 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36013]: starting. 2024-09-13T10:31:07.964 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36013]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-35978 2024-09-13T10:31:07.964 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36013]: created object 0... 2024-09-13T10:31:07.964 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36013]: created object 25... 2024-09-13T10:31:07.964 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36013]: created object 49... 2024-09-13T10:31:07.964 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36013]: finishing. 2024-09-13T10:31:07.964 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36013]: shutting down. 2024-09-13T10:31:08.002 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:08.002 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36015]: starting. 2024-09-13T10:31:08.002 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36015]: listing objects. 2024-09-13T10:31:08.002 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36015]: listed object 0... 2024-09-13T10:31:08.002 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36015]: listed object 25... 2024-09-13T10:31:08.002 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36015]: saw 50 objects 2024-09-13T10:31:08.003 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36015]: shutting down. 2024-09-13T10:31:08.871 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:08.871 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36014]: starting. 2024-09-13T10:31:08.871 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36014]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-35978 2024-09-13T10:31:08.871 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36014]: shutting down. 2024-09-13T10:31:08.872 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:08.872 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:08.873 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:31:08.875 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:31:11.518 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36082]: starting. 2024-09-13T10:31:11.518 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36082]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36081 2024-09-13T10:31:11.518 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36082]: created object 0... 2024-09-13T10:31:11.518 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36082]: created object 25... 2024-09-13T10:31:11.518 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36082]: created object 49... 2024-09-13T10:31:11.518 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36082]: finishing. 2024-09-13T10:31:11.518 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36082]: shutting down. 2024-09-13T10:31:12.417 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36083]: starting. 2024-09-13T10:31:12.417 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36083]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36081 2024-09-13T10:31:12.417 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36083]: shutting down. 2024-09-13T10:31:14.003 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-13T10:31:14.003 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T10:31:14.003 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T10:31:14.007 INFO:tasks.ceph.mon.b:Started 2024-09-13T10:31:14.007 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:31:14.007 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:31:14.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.115+0000 7f989c375640 10 monclient: get_monmap_and_config 2024-09-13T10:31:14.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.115+0000 7f989c375640 10 monclient: build_initial_monmap 2024-09-13T10:31:14.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.115+0000 7f989c375640 10 monclient: monmap: 2024-09-13T10:31:14.117 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:14.117 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.117 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:14.116189+0000 2024-09-13T10:31:14.117 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:14.116189+0000 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.116+0000 7f989c375640 1 Processor -- start 2024-09-13T10:31:14.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.116+0000 7f989c375640 1 -- start start 2024-09-13T10:31:14.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.116+0000 7f989c375640 10 monclient: init 2024-09-13T10:31:14.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.117+0000 7f989c375640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:14.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.117+0000 7f989c375640 10 monclient: _add_conns ranks=[7,8,1,3,0,4,5,2,6] 2024-09-13T10:31:14.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.117+0000 7f989c375640 10 monclient(hunting): picked mon.noname-i con 0x7f98940a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:14.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.117+0000 7f989c375640 10 monclient(hunting): picked mon.noname-e con 0x7f98940a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:14.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.117+0000 7f989c375640 10 monclient(hunting): picked mon.noname-f con 0x7f989413f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:14.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.117+0000 7f989c375640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98940a5fe0 con 0x7f989413f9a0 2024-09-13T10:31:14.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.117+0000 7f989c375640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98940a8080 con 0x7f98940a66d0 2024-09-13T10:31:14.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.117+0000 7f989c375640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98940a42c0 con 0x7f98940a6ab0 2024-09-13T10:31:14.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.117+0000 7f989c375640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:14.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.117+0000 7f989c375640 10 monclient(hunting): authenticate will time out at 813.622138s 2024-09-13T10:31:14.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.117+0000 7f9899910640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f98940a6ab0 0x7f98940a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:38780/0 (socket says 172.21.15.181:38780) 2024-09-13T10:31:14.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.117+0000 7f9899910640 1 -- 172.21.15.181:0/729705338 learned_addr learned my addr 172.21.15.181:0/729705338 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:14.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f9899910640 1 -- 172.21.15.181:0/729705338 >> v1:172.21.15.181:6793/0 conn(0x7f98940a6ab0 legacy=0x7f98940a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989a912640 1 -- 172.21.15.181:0/729705338 >> v1:172.21.15.195:6789/0 conn(0x7f989413f9a0 legacy=0x7f9894141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989a111640 1 -- 172.21.15.181:0/729705338 >> v1:172.21.15.195:6792/0 conn(0x7f98940a66d0 legacy=0x7f98940a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2982976304 0 0) 0x7f98940a42c0 con 0x7f98940a6ab0 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient(hunting): _negotiate 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient(hunting): my global_id is 4679 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9880003520 con 0x7f98940a6ab0 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2942079907 0 0) 0x7f98940a5fe0 con 0x7f989413f9a0 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient(hunting): _negotiate 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient(hunting): my global_id is 54667 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98940a42c0 con 0x7f989413f9a0 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 487473509 0 0) 0x7f98940a8080 con 0x7f98940a66d0 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient(hunting): _negotiate 2024-09-13T10:31:14.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient(hunting): my global_id is 54628 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98940a5fe0 con 0x7f98940a66d0 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2424662414 0 0) 0x7f9880003520 con 0x7f98940a6ab0 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 >> v1:172.21.15.195:6792/0 conn(0x7f98940a66d0 legacy=0x7f98940a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 >> v1:172.21.15.195:6789/0 conn(0x7f989413f9a0 legacy=0x7f9894141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient: _finish_hunting 0 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 1 monclient: found mon.noname-e 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98941464e0 con 0x7f98940a6ab0 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient: _finish_auth 0 2024-09-13T10:31:14.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient: _check_auth_tickets 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9884001ad0 con 0x7f98940a6ab0 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989c375640 5 monclient: authenticate success, global_id 4679 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.119+0000 7f989910f640 10 monclient: dump: 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.127 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989c375640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f988c001e20 con 0x7f989413f9a0 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989910f640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98840048a0 con 0x7f98940a6ab0 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989910f640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:14.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989c375640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989c375640 4 set_mon_vals no callback set 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989910f640 1 -- 172.21.15.181:0/729705338 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9884004e10 con 0x7f98940a6ab0 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989910f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989910f640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989910f640 10 monclient: dump: 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:14.129 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989c375640 10 monclient: shutdown 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989c375640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989c375640 1 -- 172.21.15.181:0/729705338 >> v1:172.21.15.181:6793/0 conn(0x7f98940a6ab0 legacy=0x7f98940a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989c375640 1 -- 172.21.15.181:0/729705338 shutdown_connections 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989c375640 1 -- 172.21.15.181:0/729705338 >> 172.21.15.181:0/729705338 conn(0x7f98940abcd0 msgr2=0x7f98940ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.120+0000 7f989c375640 1 -- 172.21.15.181:0/729705338 shutdown_connections 2024-09-13T10:31:14.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.121+0000 7f989c375640 1 -- 172.21.15.181:0/729705338 wait complete. 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.121+0000 7f989c375640 10 monclient: build_initial_monmap 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.121+0000 7f989c375640 10 monclient: monmap: 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:14.131 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.121+0000 7f989c375640 1 Processor -- start 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989c375640 1 -- start start 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989c375640 10 monclient: init 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989c375640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989c375640 10 monclient: _add_conns ranks=[2,5,1,0,7,8,3,4,6] 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989c375640 10 monclient(hunting): picked mon.noname-b con 0x7f98940a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989c375640 10 monclient(hunting): picked mon.noname-h con 0x7f98940a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989c375640 10 monclient(hunting): picked mon.noname-f con 0x7f989413f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989c375640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98940a2070 con 0x7f989413f9a0 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989c375640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989413f200 con 0x7f98940a66d0 2024-09-13T10:31:14.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989c375640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9894142db0 con 0x7f98940a6ab0 2024-09-13T10:31:14.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989c375640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:14.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989c375640 10 monclient(hunting): authenticate will time out at 813.627537s 2024-09-13T10:31:14.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989a111640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f98940a66d0 0x7f98941ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:59978/0 (socket says 172.21.15.181:59978) 2024-09-13T10:31:14.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.122+0000 7f989a111640 1 -- 172.21.15.181:0/1487875011 learned_addr learned my addr 172.21.15.181:0/1487875011 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:14.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.124+0000 7f989a111640 1 -- 172.21.15.181:0/1487875011 >> v1:172.21.15.181:6790/0 conn(0x7f98940a66d0 legacy=0x7f98941ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.124+0000 7f9899910640 1 -- 172.21.15.181:0/1487875011 >> v1:172.21.15.195:6791/0 conn(0x7f98940a6ab0 legacy=0x7f98941d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f989a912640 1 -- 172.21.15.181:0/1487875011 >> v1:172.21.15.195:6789/0 conn(0x7f989413f9a0 legacy=0x7f98941d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1427933827 0 0) 0x7f9894142db0 con 0x7f98940a6ab0 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 10 monclient(hunting): my global_id is 4676 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9878003520 con 0x7f98940a6ab0 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953958121 0 0) 0x7f98940a2070 con 0x7f989413f9a0 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 10 monclient(hunting): my global_id is 54676 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9894142db0 con 0x7f989413f9a0 2024-09-13T10:31:14.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2360687868 0 0) 0x7f9878003520 con 0x7f98940a6ab0 2024-09-13T10:31:14.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98940a2070 con 0x7f98940a6ab0 2024-09-13T10:31:14.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9884004d90 con 0x7f98940a6ab0 2024-09-13T10:31:14.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:14.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:31:14.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 10 monclient(hunting): dump: 2024-09-13T10:31:14.136 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:14.136 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.136 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.136 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.136 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:14.136 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.136 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:14.137 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:14.137 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:14.137 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:14.137 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:14.137 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:14.137 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:14.137 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:14.137 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:14.137 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.125+0000 7f988affd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:14.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1194609347 0 0) 0x7f98940a2070 con 0x7f98940a6ab0 2024-09-13T10:31:14.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 >> v1:172.21.15.181:6790/0 conn(0x7f98940a66d0 legacy=0x7f98941ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 >> v1:172.21.15.195:6789/0 conn(0x7f989413f9a0 legacy=0x7f98941d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 10 monclient: _finish_hunting 0 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 1 monclient: found mon.h 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989413cea0 con 0x7f98940a6ab0 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 10 monclient: _finish_auth 0 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 10 monclient: _check_auth_tickets 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f989c375640 5 monclient: authenticate success, global_id 4676 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f989c375640 10 monclient: _renew_subs 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f989c375640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f989c375640 1 -- 172.21.15.181:0/1487875011 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f989413ef20 con 0x7f98940a6ab0 2024-09-13T10:31:14.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f989c375640 10 monclient: _renew_subs 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f989c375640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f989c375640 1 -- 172.21.15.181:0/1487875011 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f98940a2b50 con 0x7f98940a6ab0 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9884001d20 con 0x7f98940a6ab0 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9884001af0 con 0x7f98940a6ab0 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f989890e640 4 set_mon_vals no callback set 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.541+0000 7f988affd640 10 monclient: dump: 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.545 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:14.546 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.546 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:14.546 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:14.546 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:14.546 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:14.546 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:14.546 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:14.546 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:14.546 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:14.546 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:14.546 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.542+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9884011ba0 con 0x7f98940a6ab0 2024-09-13T10:31:14.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.543+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(43..43 src has 1..43) ==== 3898+0+0 (unknown 4150674922 0 0) 0x7f988404e350 con 0x7f98940a6ab0 2024-09-13T10:31:14.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.543+0000 7f989c375640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:14.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.543+0000 7f989c375640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:14.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.543+0000 7f989c375640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:31:14.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.543+0000 7f989c375640 1 -- 172.21.15.181:0/1487875011 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f987c005080 con 0x7f98940a6ab0 2024-09-13T10:31:14.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.543+0000 7f989a111640 10 monclient: get_auth_request con 0x7f987803faf0 auth_method 0 2024-09-13T10:31:14.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.548+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 <== mon.5 v1:172.21.15.195:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f98840178a0 con 0x7f98940a6ab0 2024-09-13T10:31:14.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.548+0000 7f988affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:14.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.548+0000 7f988affd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:14.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.792+0000 7f989c375640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:31:14.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.792+0000 7f989c375640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:31:14.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.792+0000 7f989c375640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:31:14.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.792+0000 7f989c375640 1 -- 172.21.15.181:0/1487875011 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f987c005370 con 0x7f98940a6ab0 2024-09-13T10:31:14.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.793+0000 7f988affd640 1 -- 172.21.15.181:0/1487875011 <== mon.5 v1:172.21.15.195:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 2743941939) 0x7f98840171a0 con 0x7f98940a6ab0 2024-09-13T10:31:14.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.793+0000 7f988affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:31:14.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.793+0000 7f988affd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:14.795 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:31:14.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.795+0000 7f989c375640 1 -- 172.21.15.181:0/1487875011 >> v1:172.21.15.195:6800/1839191919 conn(0x7f987803faf0 legacy=0x7f9878041fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.795+0000 7f989c375640 10 monclient: shutdown 2024-09-13T10:31:14.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.795+0000 7f989c375640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:14.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.795+0000 7f989c375640 1 -- 172.21.15.181:0/1487875011 >> v1:172.21.15.195:6791/0 conn(0x7f98940a6ab0 legacy=0x7f98941d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.795+0000 7f989c375640 1 -- 172.21.15.181:0/1487875011 shutdown_connections 2024-09-13T10:31:14.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.795+0000 7f989c375640 1 -- 172.21.15.181:0/1487875011 >> 172.21.15.181:0/1487875011 conn(0x7f98940abcd0 msgr2=0x7f9894145d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:14.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.795+0000 7f989c375640 1 -- 172.21.15.181:0/1487875011 shutdown_connections 2024-09-13T10:31:14.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.795+0000 7f989c375640 1 -- 172.21.15.181:0/1487875011 wait complete. 2024-09-13T10:31:14.807 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:31:14.807 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:31:14.807 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:31:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.917+0000 7f2459732640 10 monclient: get_monmap_and_config 2024-09-13T10:31:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.917+0000 7f2459732640 10 monclient: build_initial_monmap 2024-09-13T10:31:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.917+0000 7f2459732640 10 monclient: monmap: 2024-09-13T10:31:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:14.918176+0000 2024-09-13T10:31:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:14.918176+0000 2024-09-13T10:31:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:14.921 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:14.921 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:14.921 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:14.921 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 1 Processor -- start 2024-09-13T10:31:14.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 1 -- start start 2024-09-13T10:31:14.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 10 monclient: init 2024-09-13T10:31:14.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:14.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 10 monclient: _add_conns ranks=[3,1,4,7,0,2,5,8,6] 2024-09-13T10:31:14.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 10 monclient(hunting): picked mon.noname-g con 0x7f24540a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:14.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 10 monclient(hunting): picked mon.noname-f con 0x7f24540a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:14.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 10 monclient(hunting): picked mon.noname-c con 0x7f245413f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:14.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24540a5fe0 con 0x7f24540a6ab0 2024-09-13T10:31:14.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24540a8080 con 0x7f24540a66d0 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24540a42c0 con 0x7f245413f9a0 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f2459732640 10 monclient(hunting): authenticate will time out at 814.423814s 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f24537fe640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f245413f9a0 0x7f2454141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:39074/0 (socket says 172.21.15.181:39074) 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.918+0000 7f24537fe640 1 -- 172.21.15.181:0/6851856 learned_addr learned my addr 172.21.15.181:0/6851856 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f24537fe640 1 -- 172.21.15.181:0/6851856 >> v1:172.21.15.181:6791/0 conn(0x7f245413f9a0 legacy=0x7f2454141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f24527fc640 1 -- 172.21.15.181:0/6851856 >> v1:172.21.15.195:6789/0 conn(0x7f24540a6ab0 legacy=0x7f24540a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2452ffd640 1 -- 172.21.15.181:0/6851856 >> v1:172.21.15.195:6790/0 conn(0x7f24540a66d0 legacy=0x7f24540a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 1 -- 172.21.15.181:0/6851856 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 71443110 0 0) 0x7f24540a42c0 con 0x7f245413f9a0 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:14.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient(hunting): my global_id is 4666 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 1 -- 172.21.15.181:0/6851856 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f243c003520 con 0x7f245413f9a0 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 1 -- 172.21.15.181:0/6851856 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963582173 0 0) 0x7f24540a8080 con 0x7f24540a66d0 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient(hunting): my global_id is 4656 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 1 -- 172.21.15.181:0/6851856 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24540a42c0 con 0x7f24540a66d0 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 1 -- 172.21.15.181:0/6851856 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3781098352 0 0) 0x7f243c003520 con 0x7f245413f9a0 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 1 -- 172.21.15.181:0/6851856 >> v1:172.21.15.195:6790/0 conn(0x7f24540a66d0 legacy=0x7f24540a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 1 -- 172.21.15.181:0/6851856 >> v1:172.21.15.195:6789/0 conn(0x7f24540a6ab0 legacy=0x7f24540a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 1 monclient: found mon.noname-c 2024-09-13T10:31:14.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:14.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:31:14.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 1 -- 172.21.15.181:0/6851856 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24541464e0 con 0x7f245413f9a0 2024-09-13T10:31:14.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:14.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:14.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:14.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2459732640 5 monclient: authenticate success, global_id 4666 2024-09-13T10:31:14.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2459732640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:14.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 1 -- 172.21.15.181:0/6851856 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f244c001e50 con 0x7f245413f9a0 2024-09-13T10:31:14.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:14.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:31:14.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient: dump: 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:14.935 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2459732640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 1 -- 172.21.15.181:0/6851856 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f244c004c20 con 0x7f245413f9a0 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 1 -- 172.21.15.181:0/6851856 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f244c005190 con 0x7f245413f9a0 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2459732640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2459732640 4 set_mon_vals no callback set 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.921+0000 7f2451ffb640 10 monclient: dump: 2024-09-13T10:31:14.936 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:14.937 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:14.938 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:14.938 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.922+0000 7f2459732640 10 monclient: shutdown 2024-09-13T10:31:14.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.922+0000 7f2459732640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:14.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.922+0000 7f2459732640 1 -- 172.21.15.181:0/6851856 >> v1:172.21.15.181:6791/0 conn(0x7f245413f9a0 legacy=0x7f2454141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.922+0000 7f2459732640 1 -- 172.21.15.181:0/6851856 shutdown_connections 2024-09-13T10:31:14.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.922+0000 7f2459732640 1 -- 172.21.15.181:0/6851856 >> 172.21.15.181:0/6851856 conn(0x7f24540abcd0 msgr2=0x7f24540ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:14.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.922+0000 7f2459732640 1 -- 172.21.15.181:0/6851856 shutdown_connections 2024-09-13T10:31:14.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.922+0000 7f2459732640 1 -- 172.21.15.181:0/6851856 wait complete. 2024-09-13T10:31:14.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.922+0000 7f2459732640 10 monclient: build_initial_monmap 2024-09-13T10:31:14.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.922+0000 7f2459732640 10 monclient: monmap: 2024-09-13T10:31:14.938 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:14.939 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:14.940 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.923+0000 7f2459732640 1 Processor -- start 2024-09-13T10:31:14.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.923+0000 7f2459732640 1 -- start start 2024-09-13T10:31:14.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.923+0000 7f2459732640 10 monclient: init 2024-09-13T10:31:14.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f2459732640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:14.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f2459732640 10 monclient: _add_conns ranks=[1,4,7,8,5,0,2,3,6] 2024-09-13T10:31:14.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f2459732640 10 monclient(hunting): picked mon.noname-f con 0x7f24540a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:14.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f2459732640 10 monclient(hunting): picked mon.noname-c con 0x7f24540a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:14.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f2459732640 10 monclient(hunting): picked mon.noname-i con 0x7f245413f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:14.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f2459732640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2454143170 con 0x7f24540a66d0 2024-09-13T10:31:14.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f2459732640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2454142db0 con 0x7f24540a6ab0 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f2459732640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f245413d140 con 0x7f245413f9a0 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f2459732640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f2459732640 10 monclient(hunting): authenticate will time out at 814.429187s 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f24527fc640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f24540a6ab0 0x7f24541d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:39084/0 (socket says 172.21.15.181:39084) 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f24527fc640 1 -- 172.21.15.181:0/128990920 learned_addr learned my addr 172.21.15.181:0/128990920 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.924+0000 7f2452ffd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f24540a66d0 0x7f24541ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:49144/0 (socket says 172.21.15.181:49144) 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f24527fc640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.181:6791/0 conn(0x7f24540a6ab0 legacy=0x7f24541d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f2452ffd640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.195:6789/0 conn(0x7f24540a66d0 legacy=0x7f24541ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f24537fe640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.195:6792/0 conn(0x7f245413f9a0 legacy=0x7f24541d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627230071 0 0) 0x7f2454142db0 con 0x7f24540a6ab0 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:14.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 10 monclient(hunting): my global_id is 4675 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2440003520 con 0x7f24540a6ab0 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1962925794 0 0) 0x7f245413d140 con 0x7f245413f9a0 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 10 monclient(hunting): my global_id is 54637 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2454142db0 con 0x7f245413f9a0 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3918541599 0 0) 0x7f2440003520 con 0x7f24540a6ab0 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f245413d140 con 0x7f24540a6ab0 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2448003610 con 0x7f24540a6ab0 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:31:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 10 monclient(hunting): dump: 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:14.944 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:14.944 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:14.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.926+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3379585420 0 0) 0x7f2454142db0 con 0x7f245413f9a0 2024-09-13T10:31:14.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2440003520 con 0x7f245413f9a0 2024-09-13T10:31:14.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f244c0020a0 con 0x7f245413f9a0 2024-09-13T10:31:14.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:14.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:31:14.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 10 monclient(hunting): dump: 2024-09-13T10:31:14.944 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:14.944 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.944 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:14.945 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2032958223 0 0) 0x7f245413d140 con 0x7f24540a6ab0 2024-09-13T10:31:14.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.195:6792/0 conn(0x7f245413f9a0 legacy=0x7f24541d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.195:6789/0 conn(0x7f24540a66d0 legacy=0x7f24541ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:31:14.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 1 monclient: found mon.c 2024-09-13T10:31:14.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:14.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:14.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245413f4a0 con 0x7f24540a6ab0 2024-09-13T10:31:14.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:31:14.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:31:14.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:14.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f2459732640 5 monclient: authenticate success, global_id 4675 2024-09-13T10:31:14.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f2459732640 10 monclient: _renew_subs 2024-09-13T10:31:14.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f2459732640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:14.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f2459732640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f245413dca0 con 0x7f24540a6ab0 2024-09-13T10:31:14.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f2459732640 10 monclient: _renew_subs 2024-09-13T10:31:14.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f2459732640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:14.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f2459732640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f245413c820 con 0x7f24540a6ab0 2024-09-13T10:31:14.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2448003bc0 con 0x7f24540a6ab0 2024-09-13T10:31:14.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:14.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f24480040b0 con 0x7f24540a6ab0 2024-09-13T10:31:14.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:14.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:14.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f24517fa640 4 set_mon_vals no callback set 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.927+0000 7f243b7fe640 10 monclient: dump: 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:14.948 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:14.949 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:14.949 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:14.949 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:14.949 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.928+0000 7f2459732640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:14.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.928+0000 7f2459732640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f24340065c0 con 0x7f2434002860 2024-09-13T10:31:14.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.928+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2448004300 con 0x7f24540a6ab0 2024-09-13T10:31:14.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.928+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(44..44 src has 1..44) ==== 3898+0+0 (unknown 1673377458 0 0) 0x7f244804e3c0 con 0x7f24540a6ab0 2024-09-13T10:31:14.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.928+0000 7f24537fe640 10 monclient: get_auth_request con 0x7f2440040140 auth_method 0 2024-09-13T10:31:14.950 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:14.950 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36116]: starting. 2024-09-13T10:31:14.950 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36116]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36081 2024-09-13T10:31:14.950 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36116]: created object 0... 2024-09-13T10:31:14.950 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36116]: created object 25... 2024-09-13T10:31:14.950 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36116]: created object 49... 2024-09-13T10:31:14.950 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36116]: finishing. 2024-09-13T10:31:14.951 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36116]: shutting down. 2024-09-13T10:31:14.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f2452ffd640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.181:6789/0 conn(0x7f2434002860 legacy=0x7f2434004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863607570 0 0) 0x7f24340065c0 con 0x7f2434002860 2024-09-13T10:31:14.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f243b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:14.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f243b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:14.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f243b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:14.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f243b7fe640 10 monclient(hunting): my global_id is 54567 2024-09-13T10:31:14.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f245413d140 con 0x7f2434002860 2024-09-13T10:31:14.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2385113675 0 0) 0x7f245413d140 con 0x7f2434002860 2024-09-13T10:31:14.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24340065c0 con 0x7f2434002860 2024-09-13T10:31:14.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2444001ca0 con 0x7f2434002860 2024-09-13T10:31:14.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f243b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:14.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f243b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:14.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.930+0000 7f243b7fe640 10 monclient: dump: 2024-09-13T10:31:14.954 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:14.954 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.954 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.954 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.954 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.931+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 747211415 0 0) 0x7f24340065c0 con 0x7f2434002860 2024-09-13T10:31:14.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.931+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f243400a160 con 0x7f2434002860 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.931+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2444006830 con 0x7f2434002860 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.931+0000 7f243b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.931+0000 7f243b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.931+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.181:6789/0 conn(0x7f2434002860 legacy=0x7f2434004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.931+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.181:6789/0 conn(0x7f2434002860 legacy=0x7f2434004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.938+0000 7f2459732640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.938+0000 7f2459732640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2434009e70 con 0x7f2434009130 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.940+0000 7f2452ffd640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.181:6789/0 conn(0x7f2434009130 legacy=0x7f24340095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.940+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 58377266 0 0) 0x7f2434009e70 con 0x7f2434009130 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.940+0000 7f243b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.940+0000 7f243b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.940+0000 7f243b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:14.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.940+0000 7f243b7fe640 10 monclient(hunting): my global_id is 54576 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24340065c0 con 0x7f2434009130 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3840187830 0 0) 0x7f24340065c0 con 0x7f2434009130 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2434009e70 con 0x7f2434009130 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2444003e00 con 0x7f2434009130 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 10 monclient: dump: 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:14.957 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 772433405 0 0) 0x7f2434009e70 con 0x7f2434009130 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f243400c410 con 0x7f2434009130 2024-09-13T10:31:14.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7894 (unknown 0 0 894479948) 0x7f2444004060 con 0x7f2434009130 2024-09-13T10:31:14.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:14.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:14.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.181:6789/0 conn(0x7f2434009130 legacy=0x7f24340095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f243b7fe640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.181:6789/0 conn(0x7f2434009130 legacy=0x7f24340095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:14.959 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:31:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:14.959 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 89373, 2024-09-13T10:31:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:14.960 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:31:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:14.961 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:14.962 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:14.963 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:14.963 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:14.964 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:14.965 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:14.966 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.967 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.968 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:14.969 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:14.970 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:14.971 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:14.972 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.973 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:14.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.975 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:14.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:14.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:14.979 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:14.980 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:14.981 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:31:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:14.982 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:14.982 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:14.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.941+0000 7f2459732640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.195:6800/1839191919 conn(0x7f2440040140 legacy=0x7f2440042600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.942+0000 7f2459732640 10 monclient: shutdown 2024-09-13T10:31:14.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.942+0000 7f2459732640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:14.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.942+0000 7f2459732640 1 -- 172.21.15.181:0/128990920 >> v1:172.21.15.181:6791/0 conn(0x7f24540a6ab0 legacy=0x7f24541d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:14.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.942+0000 7f24537fe640 1 -- 172.21.15.181:0/128990920 reap_dead start 2024-09-13T10:31:14.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.942+0000 7f24537fe640 1 -- 172.21.15.181:0/128990920 reap_dead start 2024-09-13T10:31:14.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.942+0000 7f2459732640 1 -- 172.21.15.181:0/128990920 shutdown_connections 2024-09-13T10:31:14.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.942+0000 7f2459732640 1 -- 172.21.15.181:0/128990920 >> 172.21.15.181:0/128990920 conn(0x7f24540abcd0 msgr2=0x7f2454138ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:14.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.942+0000 7f2459732640 1 -- 172.21.15.181:0/128990920 shutdown_connections 2024-09-13T10:31:14.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:14.942+0000 7f2459732640 1 -- 172.21.15.181:0/128990920 wait complete. 2024-09-13T10:31:14.985 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:14.985 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:31:14.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:31:15.021 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:15.021 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36118]: starting. 2024-09-13T10:31:15.021 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36118]: listing objects. 2024-09-13T10:31:15.021 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36118]: listed object 0... 2024-09-13T10:31:15.021 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36118]: listed object 25... 2024-09-13T10:31:15.021 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36118]: saw 50 objects 2024-09-13T10:31:15.021 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36118]: shutting down. 2024-09-13T10:31:15.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.082+0000 7f538f9cd640 10 monclient: get_monmap_and_config 2024-09-13T10:31:15.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.082+0000 7f538f9cd640 10 monclient: build_initial_monmap 2024-09-13T10:31:15.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.082+0000 7f538f9cd640 10 monclient: monmap: 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:15.082705+0000 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:15.082705+0000 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:15.084 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:15.085 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:15.085 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:15.085 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.082+0000 7f538f9cd640 1 Processor -- start 2024-09-13T10:31:15.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.082+0000 7f538f9cd640 1 -- start start 2024-09-13T10:31:15.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.082+0000 7f538f9cd640 10 monclient: init 2024-09-13T10:31:15.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.083+0000 7f538f9cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:15.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.083+0000 7f538f9cd640 10 monclient: _add_conns ranks=[5,6,7,3,0,1,8,4,2] 2024-09-13T10:31:15.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.083+0000 7f538f9cd640 10 monclient(hunting): picked mon.noname-h con 0x7f53880a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:15.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.083+0000 7f538f9cd640 10 monclient(hunting): picked mon.noname-d con 0x7f53880a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:15.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.083+0000 7f538f9cd640 10 monclient(hunting): picked mon.noname-i con 0x7f538813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:15.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.083+0000 7f538f9cd640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53880a5fe0 con 0x7f53880a66d0 2024-09-13T10:31:15.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.083+0000 7f538f9cd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53880a8080 con 0x7f53880a6ab0 2024-09-13T10:31:15.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.083+0000 7f538f9cd640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53880a42c0 con 0x7f538813f9a0 2024-09-13T10:31:15.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.083+0000 7f538f9cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:15.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.083+0000 7f538f9cd640 10 monclient(hunting): authenticate will time out at 814.588453s 2024-09-13T10:31:15.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.083+0000 7f538cf68640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f53880a6ab0 0x7f53880a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44282/0 (socket says 172.21.15.181:44282) 2024-09-13T10:31:15.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.083+0000 7f538cf68640 1 -- 172.21.15.181:0/1879456692 learned_addr learned my addr 172.21.15.181:0/1879456692 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:15.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.085+0000 7f538cf68640 1 -- 172.21.15.181:0/1879456692 >> v1:172.21.15.181:6792/0 conn(0x7f53880a6ab0 legacy=0x7f53880a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.085+0000 7f538d769640 1 -- 172.21.15.181:0/1879456692 >> v1:172.21.15.195:6791/0 conn(0x7f53880a66d0 legacy=0x7f53880a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.085+0000 7f538df6a640 1 -- 172.21.15.181:0/1879456692 >> v1:172.21.15.195:6792/0 conn(0x7f538813f9a0 legacy=0x7f5388141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602500952 0 0) 0x7f53880a8080 con 0x7f53880a6ab0 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient(hunting): my global_id is 4614 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5370003520 con 0x7f53880a6ab0 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1037941075 0 0) 0x7f53880a5fe0 con 0x7f53880a66d0 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient(hunting): my global_id is 4685 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53880a8080 con 0x7f53880a66d0 2024-09-13T10:31:15.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3989156613 0 0) 0x7f53880a42c0 con 0x7f538813f9a0 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient(hunting): my global_id is 54646 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53880a5fe0 con 0x7f538813f9a0 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2560034371 0 0) 0x7f5370003520 con 0x7f53880a6ab0 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 >> v1:172.21.15.195:6792/0 conn(0x7f538813f9a0 legacy=0x7f5388141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 >> v1:172.21.15.195:6791/0 conn(0x7f53880a66d0 legacy=0x7f53880a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient: _finish_hunting 0 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 monclient: found mon.noname-d 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:31:15.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53881464e0 con 0x7f53880a6ab0 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient: _finish_auth 0 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient: _check_auth_tickets 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f537c001ae0 con 0x7f53880a6ab0 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f538f9cd640 5 monclient: authenticate success, global_id 4614 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient: dump: 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.093 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f538f9cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f537c0048a0 con 0x7f53880a6ab0 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:15.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 1 -- 172.21.15.181:0/1879456692 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f537c004e10 con 0x7f53880a6ab0 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f5387fff640 10 monclient: dump: 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.095 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f538f9cd640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f538f9cd640 4 set_mon_vals no callback set 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.086+0000 7f538f9cd640 10 monclient: shutdown 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.087+0000 7f538f9cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.087+0000 7f538f9cd640 1 -- 172.21.15.181:0/1879456692 >> v1:172.21.15.181:6792/0 conn(0x7f53880a6ab0 legacy=0x7f53880a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.087+0000 7f538f9cd640 1 -- 172.21.15.181:0/1879456692 shutdown_connections 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.087+0000 7f538f9cd640 1 -- 172.21.15.181:0/1879456692 >> 172.21.15.181:0/1879456692 conn(0x7f53880abcd0 msgr2=0x7f53880ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.087+0000 7f538f9cd640 1 -- 172.21.15.181:0/1879456692 shutdown_connections 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.087+0000 7f538f9cd640 1 -- 172.21.15.181:0/1879456692 wait complete. 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.087+0000 7f538f9cd640 10 monclient: build_initial_monmap 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.087+0000 7f538f9cd640 10 monclient: monmap: 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 1 Processor -- start 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 1 -- start start 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 10 monclient: init 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 10 monclient: _add_conns ranks=[5,7,6,8,3,1,4,2,0] 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 10 monclient(hunting): picked mon.noname-h con 0x7f53880a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 10 monclient(hunting): picked mon.noname-i con 0x7f53880a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:15.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 10 monclient(hunting): picked mon.noname-d con 0x7f538813f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:15.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538813ef10 con 0x7f53880a66d0 2024-09-13T10:31:15.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538813f1f0 con 0x7f538813f9a0 2024-09-13T10:31:15.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538813ce90 con 0x7f53880a6ab0 2024-09-13T10:31:15.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:15.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538f9cd640 10 monclient(hunting): authenticate will time out at 814.593583s 2024-09-13T10:31:15.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538df6a640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f538813f9a0 0x7f53881d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44296/0 (socket says 172.21.15.181:44296) 2024-09-13T10:31:15.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.088+0000 7f538df6a640 1 -- 172.21.15.181:0/3863453413 learned_addr learned my addr 172.21.15.181:0/3863453413 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:15.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f538df6a640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.181:6792/0 conn(0x7f538813f9a0 legacy=0x7f53881d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f538d769640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.195:6791/0 conn(0x7f53880a66d0 legacy=0x7f53881ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f538cf68640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.195:6792/0 conn(0x7f53880a6ab0 legacy=0x7f53881d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255762040 0 0) 0x7f538813f1f0 con 0x7f538813f9a0 2024-09-13T10:31:15.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f5385ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f5385ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f5385ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f5385ffb640 10 monclient(hunting): my global_id is 4623 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5374003520 con 0x7f538813f9a0 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724242658 0 0) 0x7f538813ef10 con 0x7f53880a66d0 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f5385ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f5385ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f5385ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f5385ffb640 10 monclient(hunting): my global_id is 4694 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.090+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f538813f1f0 con 0x7f53880a66d0 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522952060 0 0) 0x7f538813ce90 con 0x7f53880a6ab0 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): my global_id is 54655 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f538813ef10 con 0x7f53880a6ab0 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3755819241 0 0) 0x7f5374003520 con 0x7f538813f9a0 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f538813ce90 con 0x7f538813f9a0 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5378003990 con 0x7f538813f9a0 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.106 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:15.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2576217780 0 0) 0x7f538813f1f0 con 0x7f53880a66d0 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5374003520 con 0x7f53880a66d0 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3851381375 0 0) 0x7f538813ef10 con 0x7f53880a6ab0 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f538813f1f0 con 0x7f53880a6ab0 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5380003610 con 0x7f53880a66d0 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.108 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f537c004d90 con 0x7f53880a6ab0 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.110 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3083126116 0 0) 0x7f538813ce90 con 0x7f538813f9a0 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.195:6792/0 conn(0x7f53880a6ab0 legacy=0x7f53881d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.195:6791/0 conn(0x7f53880a66d0 legacy=0x7f53881ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 monclient: found mon.d 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53880a21e0 con 0x7f538813f9a0 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:15.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f538f9cd640 5 monclient: authenticate success, global_id 4623 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f538f9cd640 10 monclient: _renew_subs 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f538f9cd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f538f9cd640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f538813e630 con 0x7f538813f9a0 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5378003de0 con 0x7f538813f9a0 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5378004310 con 0x7f538813f9a0 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f5385ffb640 10 monclient: dump: 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.112 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.113 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f538f9cd640 10 monclient: _renew_subs 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f538f9cd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f538f9cd640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f538813c4a0 con 0x7f538813f9a0 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.091+0000 7f53877fe640 4 set_mon_vals no callback set 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.092+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f53780044b0 con 0x7f538813f9a0 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.092+0000 7f538f9cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.092+0000 7f538f9cd640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f53880a3240 con 0x7f53881ced70 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.092+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(44..44 src has 1..44) ==== 3898+0+0 (unknown 1673377458 0 0) 0x7f537804e570 con 0x7f538813f9a0 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.092+0000 7f538cf68640 10 monclient: get_auth_request con 0x7f53740405e0 auth_method 0 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.094+0000 7f538d769640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.181:6790/0 conn(0x7f53881ced70 legacy=0x7f538813fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.094+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392435003 0 0) 0x7f53880a3240 con 0x7f53881ced70 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 10 monclient(hunting): my global_id is 64100 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f538813ce90 con 0x7f53881ced70 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2473625179 0 0) 0x7f538813ce90 con 0x7f53881ced70 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53880a3240 con 0x7f53881ced70 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5380003ed0 con 0x7f53881ced70 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 10 monclient: dump: 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.115 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4285733825 0 0) 0x7f53880a3240 con 0x7f53881ced70 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53880008d0 con 0x7f53881ced70 2024-09-13T10:31:15.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5380004140 con 0x7f53881ced70 2024-09-13T10:31:15.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:15.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:15.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.181:6790/0 conn(0x7f53881ced70 legacy=0x7f538813fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.095+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.181:6790/0 conn(0x7f53881ced70 legacy=0x7f538813fd80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:15.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.101+0000 7f538f9cd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:15.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.101+0000 7f538f9cd640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f53881cf150 con 0x7f538802e200 2024-09-13T10:31:15.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f538d769640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.181:6790/0 conn(0x7f538802e200 legacy=0x7f5388140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3053036971 0 0) 0x7f53881cf150 con 0x7f538802e200 2024-09-13T10:31:15.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 10 monclient(hunting): my global_id is 64109 2024-09-13T10:31:15.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53880a3240 con 0x7f538802e200 2024-09-13T10:31:15.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2148995537 0 0) 0x7f53880a3240 con 0x7f538802e200 2024-09-13T10:31:15.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53881cf150 con 0x7f538802e200 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5380005b00 con 0x7f538802e200 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 10 monclient: dump: 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.121 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2380892813 0 0) 0x7f53881cf150 con 0x7f538802e200 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f53881436c0 con 0x7f538802e200 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7557 (unknown 0 0 2645113680) 0x7f5380006fd0 con 0x7f538802e200 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.181:6790/0 conn(0x7f538802e200 legacy=0x7f5388140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.104+0000 7f5385ffb640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.181:6790/0 conn(0x7f538802e200 legacy=0x7f5388140490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:15.123 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 1008, 2024-09-13T10:31:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:15.135 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.136 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.137 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.138 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.140 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:15.141 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.142 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:15.142 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:15.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.105+0000 7f538f9cd640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.195:6800/1839191919 conn(0x7f53740405e0 legacy=0x7f5374042aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.105+0000 7f538f9cd640 10 monclient: shutdown 2024-09-13T10:31:15.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.105+0000 7f538f9cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:15.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.105+0000 7f538f9cd640 1 -- 172.21.15.181:0/3863453413 >> v1:172.21.15.181:6792/0 conn(0x7f538813f9a0 legacy=0x7f53881d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.105+0000 7f538df6a640 1 -- 172.21.15.181:0/3863453413 reap_dead start 2024-09-13T10:31:15.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.105+0000 7f538df6a640 1 -- 172.21.15.181:0/3863453413 reap_dead start 2024-09-13T10:31:15.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.105+0000 7f538f9cd640 1 -- 172.21.15.181:0/3863453413 shutdown_connections 2024-09-13T10:31:15.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.105+0000 7f538f9cd640 1 -- 172.21.15.181:0/3863453413 >> 172.21.15.181:0/3863453413 conn(0x7f53880abcd0 msgr2=0x7f5388137c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:15.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.105+0000 7f538f9cd640 1 -- 172.21.15.181:0/3863453413 shutdown_connections 2024-09-13T10:31:15.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.105+0000 7f538f9cd640 1 -- 172.21.15.181:0/3863453413 wait complete. 2024-09-13T10:31:15.145 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:15.145 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:31:15.145 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:31:15.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.241+0000 7f3aee794640 10 monclient: get_monmap_and_config 2024-09-13T10:31:15.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.241+0000 7f3aee794640 10 monclient: build_initial_monmap 2024-09-13T10:31:15.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.241+0000 7f3aee794640 10 monclient: monmap: 2024-09-13T10:31:15.243 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:15.243 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.243 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:15.242327+0000 2024-09-13T10:31:15.243 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:15.242327+0000 2024-09-13T10:31:15.244 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:15.244 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.244 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:15.244 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:15.244 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:15.244 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:15.244 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:15.244 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:15.244 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:15.244 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:15.244 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:15.244 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.242+0000 7f3aee794640 1 Processor -- start 2024-09-13T10:31:15.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.242+0000 7f3aee794640 1 -- start start 2024-09-13T10:31:15.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.242+0000 7f3aee794640 10 monclient: init 2024-09-13T10:31:15.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3aee794640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:15.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3aee794640 10 monclient: _add_conns ranks=[1,6,8,0,3,2,5,4,7] 2024-09-13T10:31:15.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3aee794640 10 monclient(hunting): picked mon.noname-f con 0x7f3ae80a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:15.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3aee794640 10 monclient(hunting): picked mon.noname-d con 0x7f3ae80a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:15.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3aee794640 10 monclient(hunting): picked mon.noname-e con 0x7f3ae813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:15.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3aee794640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae80a4bc0 con 0x7f3ae80a6640 2024-09-13T10:31:15.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3aee794640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae813a320 con 0x7f3ae80a8340 2024-09-13T10:31:15.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3aee794640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae80a8100 con 0x7f3ae813f750 2024-09-13T10:31:15.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3aee794640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:15.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3aee794640 10 monclient(hunting): authenticate will time out at 814.748154s 2024-09-13T10:31:15.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3aecd31640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f3ae813f750 0x7f3ae8141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:38790/0 (socket says 172.21.15.181:38790) 2024-09-13T10:31:15.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3ae77fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f3ae80a8340 0x7f3ae8139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44300/0 (socket says 172.21.15.181:44300) 2024-09-13T10:31:15.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.243+0000 7f3aecd31640 1 -- 172.21.15.181:0/3300363331 learned_addr learned my addr 172.21.15.181:0/3300363331 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:15.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae77fe640 1 -- 172.21.15.181:0/3300363331 >> v1:172.21.15.181:6792/0 conn(0x7f3ae80a8340 legacy=0x7f3ae8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3aecd31640 1 -- 172.21.15.181:0/3300363331 >> v1:172.21.15.181:6793/0 conn(0x7f3ae813f750 legacy=0x7f3ae8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae7fff640 1 -- 172.21.15.181:0/3300363331 >> v1:172.21.15.195:6789/0 conn(0x7f3ae80a6640 legacy=0x7f3ae8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2767282213 0 0) 0x7f3ae813a320 con 0x7f3ae80a8340 2024-09-13T10:31:15.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient(hunting): my global_id is 4632 2024-09-13T10:31:15.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ad0003520 con 0x7f3ae80a8340 2024-09-13T10:31:15.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799536993 0 0) 0x7f3ae80a8100 con 0x7f3ae813f750 2024-09-13T10:31:15.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient(hunting): my global_id is 4688 2024-09-13T10:31:15.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ae813a320 con 0x7f3ae813f750 2024-09-13T10:31:15.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2245328226 0 0) 0x7f3ae80a4bc0 con 0x7f3ae80a6640 2024-09-13T10:31:15.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient(hunting): my global_id is 54685 2024-09-13T10:31:15.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ae80a8100 con 0x7f3ae80a6640 2024-09-13T10:31:15.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3641417989 0 0) 0x7f3ae813a320 con 0x7f3ae813f750 2024-09-13T10:31:15.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 >> v1:172.21.15.181:6792/0 conn(0x7f3ae80a8340 legacy=0x7f3ae8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 >> v1:172.21.15.195:6789/0 conn(0x7f3ae80a6640 legacy=0x7f3ae8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 1 monclient: found mon.noname-e 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae80a48e0 con 0x7f3ae813f750 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3ae0001e40 con 0x7f3ae813f750 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3aee794640 5 monclient: authenticate success, global_id 4688 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3aee794640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:15.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3ae6ffd640 10 monclient: dump: 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.254 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.245+0000 7f3aee794640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ae0004c20 con 0x7f3ae813f750 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3ae6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3ae6ffd640 1 -- 172.21.15.181:0/3300363331 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3ae0005190 con 0x7f3ae813f750 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3aee794640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3aee794640 4 set_mon_vals no callback set 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3ae6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3ae6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3ae6ffd640 10 monclient: dump: 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.256 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3aee794640 10 monclient: shutdown 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3aee794640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3aee794640 1 -- 172.21.15.181:0/3300363331 >> v1:172.21.15.181:6793/0 conn(0x7f3ae813f750 legacy=0x7f3ae8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3aee794640 1 -- 172.21.15.181:0/3300363331 shutdown_connections 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3aee794640 1 -- 172.21.15.181:0/3300363331 >> 172.21.15.181:0/3300363331 conn(0x7f3ae8077170 msgr2=0x7f3ae80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3aee794640 1 -- 172.21.15.181:0/3300363331 shutdown_connections 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.246+0000 7f3aee794640 1 -- 172.21.15.181:0/3300363331 wait complete. 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.247+0000 7f3aee794640 10 monclient: build_initial_monmap 2024-09-13T10:31:15.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.247+0000 7f3aee794640 10 monclient: monmap: 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:15.258 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.247+0000 7f3aee794640 1 Processor -- start 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.247+0000 7f3aee794640 1 -- start start 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.247+0000 7f3aee794640 10 monclient: init 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3aee794640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3aee794640 10 monclient: _add_conns ranks=[7,6,8,5,1,0,3,2,4] 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3aee794640 10 monclient(hunting): picked mon.noname-i con 0x7f3ae80a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3aee794640 10 monclient(hunting): picked mon.noname-d con 0x7f3ae813f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3aee794640 10 monclient(hunting): picked mon.noname-e con 0x7f3ae81d4770 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3aee794640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae8133e90 con 0x7f3ae813f750 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3aee794640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae8134fe0 con 0x7f3ae80a8340 2024-09-13T10:31:15.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3aee794640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae813d0c0 con 0x7f3ae81d4770 2024-09-13T10:31:15.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3aee794640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:15.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3aee794640 10 monclient(hunting): authenticate will time out at 814.753142s 2024-09-13T10:31:15.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3ae77fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f3ae813f750 0x7f3ae813c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44304/0 (socket says 172.21.15.181:44304) 2024-09-13T10:31:15.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3ae77fe640 1 -- 172.21.15.181:0/3274643858 learned_addr learned my addr 172.21.15.181:0/3274643858 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:15.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.248+0000 7f3aecd31640 1 --1- 172.21.15.181:0/3274643858 >> v1:172.21.15.181:6793/0 conn(0x7f3ae81d4770 0x7f3ae81d6b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:38806/0 (socket says 172.21.15.181:38806) 2024-09-13T10:31:15.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3aecd31640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.181:6793/0 conn(0x7f3ae81d4770 legacy=0x7f3ae81d6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae77fe640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.181:6792/0 conn(0x7f3ae813f750 legacy=0x7f3ae813c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2269611186 0 0) 0x7f3ae813d0c0 con 0x7f3ae81d4770 2024-09-13T10:31:15.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): my global_id is 4697 2024-09-13T10:31:15.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ad4003550 con 0x7f3ae81d4770 2024-09-13T10:31:15.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 136629262 0 0) 0x7f3ae8133e90 con 0x7f3ae813f750 2024-09-13T10:31:15.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): my global_id is 4641 2024-09-13T10:31:15.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ae813d0c0 con 0x7f3ae813f750 2024-09-13T10:31:15.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae7fff640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.195:6792/0 conn(0x7f3ae80a8340 legacy=0x7f3ae813c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3681965085 0 0) 0x7f3ae813d0c0 con 0x7f3ae813f750 2024-09-13T10:31:15.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ae8133e90 con 0x7f3ae813f750 2024-09-13T10:31:15.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3adc001a10 con 0x7f3ae813f750 2024-09-13T10:31:15.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:31:15.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): dump: 2024-09-13T10:31:15.267 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.267 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.267 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.267 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.268 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.268 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.268 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.268 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.268 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.268 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.268 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.268 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.268 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.268 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.268 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.268 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 46749268 0 0) 0x7f3ad4003550 con 0x7f3ae81d4770 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ae813d0c0 con 0x7f3ae81d4770 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3ae0002090 con 0x7f3ae81d4770 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): dump: 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.269 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237063753 0 0) 0x7f3ae8134fe0 con 0x7f3ae80a8340 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient(hunting): my global_id is 54664 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ad4003550 con 0x7f3ae80a8340 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2102522801 0 0) 0x7f3ae8133e90 con 0x7f3ae813f750 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.181:6793/0 conn(0x7f3ae81d4770 legacy=0x7f3ae81d6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.195:6792/0 conn(0x7f3ae80a8340 legacy=0x7f3ae813c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 monclient: found mon.d 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae8142f90 con 0x7f3ae813f750 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient: _finish_auth 0 2024-09-13T10:31:15.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:31:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3ae4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3aee794640 5 monclient: authenticate success, global_id 4641 2024-09-13T10:31:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3aee794640 10 monclient: _renew_subs 2024-09-13T10:31:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3aee794640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:31:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3aee794640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae8134a40 con 0x7f3ae813f750 2024-09-13T10:31:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3aee794640 10 monclient: _renew_subs 2024-09-13T10:31:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3aee794640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:31:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.250+0000 7f3aee794640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f3ae813db00 con 0x7f3ae813f750 2024-09-13T10:31:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.251+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3adc004dd0 con 0x7f3ae813f750 2024-09-13T10:31:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.251+0000 7f3ae4ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.251+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3adc0052c0 con 0x7f3ae813f750 2024-09-13T10:31:15.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.251+0000 7f3ae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.251+0000 7f3ae67fc640 4 set_mon_vals no callback set 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.251+0000 7f3ae4ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.251+0000 7f3ae4ff9640 10 monclient: dump: 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.273 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.274 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.274 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.274 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.274 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.274 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.274 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.251+0000 7f3aee794640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:15.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.251+0000 7f3aee794640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3ac80065c0 con 0x7f3ac8002860 2024-09-13T10:31:15.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.251+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3adc011940 con 0x7f3ae813f750 2024-09-13T10:31:15.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.252+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(44..44 src has 1..44) ==== 3898+0+0 (unknown 1673377458 0 0) 0x7f3adc04e310 con 0x7f3ae813f750 2024-09-13T10:31:15.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.252+0000 7f3aecd31640 10 monclient: get_auth_request con 0x7f3ad40402a0 auth_method 0 2024-09-13T10:31:15.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.253+0000 7f3ae7fff640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.181:6791/0 conn(0x7f3ac8002860 legacy=0x7f3ac8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087715709 0 0) 0x7f3ac80065c0 con 0x7f3ac8002860 2024-09-13T10:31:15.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 10 monclient(hunting): my global_id is 4684 2024-09-13T10:31:15.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ae8133e90 con 0x7f3ac8002860 2024-09-13T10:31:15.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2300754386 0 0) 0x7f3ae8133e90 con 0x7f3ac8002860 2024-09-13T10:31:15.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ac80065c0 con 0x7f3ac8002860 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3ad8001ce0 con 0x7f3ac8002860 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 10 monclient: dump: 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.276 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4067944681 0 0) 0x7f3ac80065c0 con 0x7f3ac8002860 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ac800a160 con 0x7f3ac8002860 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3ad80057c0 con 0x7f3ac8002860 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:15.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.181:6791/0 conn(0x7f3ac8002860 legacy=0x7f3ac8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.254+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.181:6791/0 conn(0x7f3ac8002860 legacy=0x7f3ac8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.260+0000 7f3aee794640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.260+0000 7f3aee794640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3ac8009e50 con 0x7f3ac8009110 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae7fff640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.181:6791/0 conn(0x7f3ac8009110 legacy=0x7f3ac80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757554341 0 0) 0x7f3ac8009e50 con 0x7f3ac8009110 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 10 monclient(hunting): my global_id is 4693 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ac80065c0 con 0x7f3ac8009110 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2034651691 0 0) 0x7f3ac80065c0 con 0x7f3ac8009110 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ac8009e50 con 0x7f3ac8009110 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3ad8003cf0 con 0x7f3ac8009110 2024-09-13T10:31:15.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 10 monclient: dump: 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.279 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.280 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.280 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.280 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.280 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3128511147 0 0) 0x7f3ac8009e50 con 0x7f3ac8009110 2024-09-13T10:31:15.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3ac800c3f0 con 0x7f3ac8009110 2024-09-13T10:31:15.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7725 (unknown 0 0 2926594283) 0x7f3ad8004080 con 0x7f3ac8009110 2024-09-13T10:31:15.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:15.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:15.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.181:6791/0 conn(0x7f3ac8009110 legacy=0x7f3ac80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.263+0000 7f3ae4ff9640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.181:6791/0 conn(0x7f3ac8009110 legacy=0x7f3ac80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:15.281 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:15.281 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:15.281 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:15.281 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:15.281 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:15.281 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 89712, 2024-09-13T10:31:15.281 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:15.281 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:15.281 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:15.281 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:15.281 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:15.282 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:15.282 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:15.282 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:15.282 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:15.282 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:15.282 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.282 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:31:15.282 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:15.282 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:15.282 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:15.284 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.284 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.284 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.284 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.284 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.284 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.284 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.284 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.285 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:15.286 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.287 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:15.288 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.289 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.290 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:15.290 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:15.290 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.290 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.290 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.290 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:15.290 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.290 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.290 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:15.293 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:15.294 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.294 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.294 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.294 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:15.294 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:15.294 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.294 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.294 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.294 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:15.295 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.296 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.298 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:15.299 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.300 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.301 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.301 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:15.301 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:15.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.301 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.301 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.301 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:15.301 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.301 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.301 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:31:15.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.302 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:15.303 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:15.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.264+0000 7f3aee794640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3ad40402a0 legacy=0x7f3ad4042760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.264+0000 7f3aee794640 10 monclient: shutdown 2024-09-13T10:31:15.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.264+0000 7f3aee794640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:15.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.264+0000 7f3aee794640 1 -- 172.21.15.181:0/3274643858 >> v1:172.21.15.181:6792/0 conn(0x7f3ae813f750 legacy=0x7f3ae813c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.264+0000 7f3aecd31640 1 -- 172.21.15.181:0/3274643858 reap_dead start 2024-09-13T10:31:15.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.264+0000 7f3aecd31640 1 -- 172.21.15.181:0/3274643858 reap_dead start 2024-09-13T10:31:15.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.264+0000 7f3aee794640 1 -- 172.21.15.181:0/3274643858 shutdown_connections 2024-09-13T10:31:15.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.264+0000 7f3aee794640 1 -- 172.21.15.181:0/3274643858 >> 172.21.15.181:0/3274643858 conn(0x7f3ae80a6640 msgr2=0x7f3ae80a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:15.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.264+0000 7f3aee794640 1 -- 172.21.15.181:0/3274643858 shutdown_connections 2024-09-13T10:31:15.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.264+0000 7f3aee794640 1 -- 172.21.15.181:0/3274643858 wait complete. 2024-09-13T10:31:15.305 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:15.305 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:31:15.305 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:31:15.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.401+0000 7f3da7b9b640 10 monclient: get_monmap_and_config 2024-09-13T10:31:15.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.401+0000 7f3da7b9b640 10 monclient: build_initial_monmap 2024-09-13T10:31:15.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.401+0000 7f3da7b9b640 10 monclient: monmap: 2024-09-13T10:31:15.403 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:15.403 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.403 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:15.402357+0000 2024-09-13T10:31:15.403 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:15.402357+0000 2024-09-13T10:31:15.404 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:15.404 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.404 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:15.404 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:15.404 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:15.404 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:15.404 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:15.404 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:15.404 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:15.404 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:15.404 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:15.404 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.402+0000 7f3da7b9b640 1 Processor -- start 2024-09-13T10:31:15.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.402+0000 7f3da7b9b640 1 -- start start 2024-09-13T10:31:15.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.402+0000 7f3da7b9b640 10 monclient: init 2024-09-13T10:31:15.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.402+0000 7f3da7b9b640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:15.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.402+0000 7f3da7b9b640 10 monclient: _add_conns ranks=[6,2,8,0,5,7,3,4,1] 2024-09-13T10:31:15.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.402+0000 7f3da7b9b640 10 monclient(hunting): picked mon.noname-d con 0x7f3da00a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:15.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.403+0000 7f3da7b9b640 10 monclient(hunting): picked mon.noname-b con 0x7f3da00a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:15.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.403+0000 7f3da7b9b640 10 monclient(hunting): picked mon.noname-e con 0x7f3da013f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:15.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.403+0000 7f3da7b9b640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da00a5fe0 con 0x7f3da00a6ab0 2024-09-13T10:31:15.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.403+0000 7f3da7b9b640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da00a8080 con 0x7f3da00a66d0 2024-09-13T10:31:15.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.403+0000 7f3da7b9b640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da00a42c0 con 0x7f3da013f9a0 2024-09-13T10:31:15.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.403+0000 7f3da7b9b640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:15.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.403+0000 7f3da7b9b640 10 monclient(hunting): authenticate will time out at 814.908068s 2024-09-13T10:31:15.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.403+0000 7f3da5937640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f3da00a66d0 0x7f3da00a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44308/0 (socket says 172.21.15.181:44308) 2024-09-13T10:31:15.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.403+0000 7f3da5937640 1 -- 172.21.15.181:0/1411428201 learned_addr learned my addr 172.21.15.181:0/1411428201 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:15.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.403+0000 7f3da5136640 1 --1- 172.21.15.181:0/1411428201 >> v1:172.21.15.181:6790/0 conn(0x7f3da00a6ab0 0x7f3da00a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:60002/0 (socket says 172.21.15.181:60002) 2024-09-13T10:31:15.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da6138640 1 -- 172.21.15.181:0/1411428201 >> v1:172.21.15.181:6793/0 conn(0x7f3da013f9a0 legacy=0x7f3da0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da5937640 1 -- 172.21.15.181:0/1411428201 >> v1:172.21.15.181:6792/0 conn(0x7f3da00a66d0 legacy=0x7f3da00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da5136640 1 -- 172.21.15.181:0/1411428201 >> v1:172.21.15.181:6790/0 conn(0x7f3da00a6ab0 legacy=0x7f3da00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3524023100 0 0) 0x7f3da00a42c0 con 0x7f3da013f9a0 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient(hunting): my global_id is 4706 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d8c003520 con 0x7f3da013f9a0 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158974952 0 0) 0x7f3da00a8080 con 0x7f3da00a66d0 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient(hunting): my global_id is 4650 2024-09-13T10:31:15.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3da00a42c0 con 0x7f3da00a66d0 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 425204590 0 0) 0x7f3da00a5fe0 con 0x7f3da00a6ab0 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient(hunting): my global_id is 64118 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3da00a8080 con 0x7f3da00a6ab0 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3797171998 0 0) 0x7f3da00a42c0 con 0x7f3da00a66d0 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 >> v1:172.21.15.181:6793/0 conn(0x7f3da013f9a0 legacy=0x7f3da0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 >> v1:172.21.15.181:6790/0 conn(0x7f3da00a6ab0 legacy=0x7f3da00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient: _finish_hunting 0 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 monclient: found mon.noname-d 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:31:15.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da01464e0 con 0x7f3da00a66d0 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient: _finish_auth 0 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient: _check_auth_tickets 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d900019f0 con 0x7f3da00a66d0 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da7b9b640 5 monclient: authenticate success, global_id 4650 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da7b9b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient: dump: 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.416 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.417 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.417 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.417 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.417 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.417 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.417 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.417 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.417 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.417 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.417 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.417 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da7b9b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d90001cc0 con 0x7f3da00a66d0 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 1 -- 172.21.15.181:0/1411428201 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d90004be0 con 0x7f3da00a66d0 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da7b9b640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da7b9b640 4 set_mon_vals no callback set 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.405+0000 7f3da4935640 10 monclient: dump: 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.418 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.406+0000 7f3da7b9b640 10 monclient: shutdown 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.406+0000 7f3da7b9b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.406+0000 7f3da7b9b640 1 -- 172.21.15.181:0/1411428201 >> v1:172.21.15.181:6792/0 conn(0x7f3da00a66d0 legacy=0x7f3da00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.406+0000 7f3da7b9b640 1 -- 172.21.15.181:0/1411428201 shutdown_connections 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.406+0000 7f3da7b9b640 1 -- 172.21.15.181:0/1411428201 >> 172.21.15.181:0/1411428201 conn(0x7f3da00abcd0 msgr2=0x7f3da00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.406+0000 7f3da7b9b640 1 -- 172.21.15.181:0/1411428201 shutdown_connections 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.406+0000 7f3da7b9b640 1 -- 172.21.15.181:0/1411428201 wait complete. 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 10 monclient: build_initial_monmap 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 10 monclient: monmap: 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:15.420 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 1 Processor -- start 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 1 -- start start 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 10 monclient: init 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 10 monclient: _add_conns ranks=[4,8,6,7,0,5,1,3,2] 2024-09-13T10:31:15.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 10 monclient(hunting): picked mon.noname-c con 0x7f3da00a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:15.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 10 monclient(hunting): picked mon.noname-e con 0x7f3da00a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:15.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 10 monclient(hunting): picked mon.noname-d con 0x7f3da013f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:15.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da013ecf0 con 0x7f3da00a66d0 2024-09-13T10:31:15.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da013efd0 con 0x7f3da013f9a0 2024-09-13T10:31:15.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da0068d40 con 0x7f3da00a6ab0 2024-09-13T10:31:15.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:15.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da7b9b640 10 monclient(hunting): authenticate will time out at 814.912820s 2024-09-13T10:31:15.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da6138640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f3da013f9a0 0x7f3da01d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44310/0 (socket says 172.21.15.181:44310) 2024-09-13T10:31:15.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da5136640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f3da00a6ab0 0x7f3da01d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:38820/0 (socket says 172.21.15.181:38820) 2024-09-13T10:31:15.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da5937640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f3da00a66d0 0x7f3da01ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:39110/0 (socket says 172.21.15.181:39110) 2024-09-13T10:31:15.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.407+0000 7f3da6138640 1 -- 172.21.15.181:0/549314456 learned_addr learned my addr 172.21.15.181:0/549314456 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:15.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3da5136640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.181:6793/0 conn(0x7f3da00a6ab0 legacy=0x7f3da01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3da6138640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.181:6792/0 conn(0x7f3da013f9a0 legacy=0x7f3da01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3da5937640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.181:6791/0 conn(0x7f3da00a66d0 legacy=0x7f3da01ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267823637 0 0) 0x7f3da0068d40 con 0x7f3da00a6ab0 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): my global_id is 4715 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d84003520 con 0x7f3da00a6ab0 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2951639960 0 0) 0x7f3da013efd0 con 0x7f3da013f9a0 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): my global_id is 4659 2024-09-13T10:31:15.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3da0068d40 con 0x7f3da013f9a0 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2256247165 0 0) 0x7f3da013ecf0 con 0x7f3da00a66d0 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): my global_id is 4702 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3da013efd0 con 0x7f3da00a66d0 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3022209261 0 0) 0x7f3d84003520 con 0x7f3da00a6ab0 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3da013ecf0 con 0x7f3da00a6ab0 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d9c001c30 con 0x7f3da00a6ab0 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): dump: 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.425 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4220381111 0 0) 0x7f3da0068d40 con 0x7f3da013f9a0 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d84003520 con 0x7f3da013f9a0 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1067078533 0 0) 0x7f3da013efd0 con 0x7f3da00a66d0 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3da0068d40 con 0x7f3da00a66d0 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d98003cd0 con 0x7f3da013f9a0 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): dump: 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.426 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d90004b20 con 0x7f3da00a66d0 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient(hunting): dump: 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.428 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2946270562 0 0) 0x7f3da013ecf0 con 0x7f3da00a6ab0 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.181:6792/0 conn(0x7f3da013f9a0 legacy=0x7f3da01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.181:6791/0 conn(0x7f3da00a66d0 legacy=0x7f3da01ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient: _finish_hunting 0 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 monclient: found mon.e 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da0139330 con 0x7f3da00a6ab0 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient: _finish_auth 0 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient: _check_auth_tickets 2024-09-13T10:31:15.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3da7b9b640 5 monclient: authenticate success, global_id 4715 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3da7b9b640 10 monclient: _renew_subs 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3da7b9b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3da7b9b640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3da013ea10 con 0x7f3da00a6ab0 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3da7b9b640 10 monclient: _renew_subs 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3da7b9b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3da7b9b640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f3da013c510 con 0x7f3da00a6ab0 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d9c001880 con 0x7f3da00a6ab0 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d9c005110 con 0x7f3da00a6ab0 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d97fff640 4 set_mon_vals no callback set 2024-09-13T10:31:15.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.410+0000 7f3d967fc640 10 monclient: dump: 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.431 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.432 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.432 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.432 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.411+0000 7f3da7b9b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:15.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.411+0000 7f3da7b9b640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3d880065c0 con 0x7f3d88002860 2024-09-13T10:31:15.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.411+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3d9c011790 con 0x7f3da00a6ab0 2024-09-13T10:31:15.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.412+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(44..44 src has 1..44) ==== 3898+0+0 (unknown 1673377458 0 0) 0x7f3d9c04e2a0 con 0x7f3da00a6ab0 2024-09-13T10:31:15.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.412+0000 7f3da6138640 10 monclient: get_auth_request con 0x7f3d840406e0 auth_method 0 2024-09-13T10:31:15.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.413+0000 7f3da5937640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.181:6792/0 conn(0x7f3d88002860 legacy=0x7f3d88004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.413+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191859142 0 0) 0x7f3d880065c0 con 0x7f3d88002860 2024-09-13T10:31:15.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.413+0000 7f3d967fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.413+0000 7f3d967fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.413+0000 7f3d967fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.413+0000 7f3d967fc640 10 monclient(hunting): my global_id is 4668 2024-09-13T10:31:15.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.413+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3da013ecf0 con 0x7f3d88002860 2024-09-13T10:31:15.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3484129546 0 0) 0x7f3da013ecf0 con 0x7f3d88002860 2024-09-13T10:31:15.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d880065c0 con 0x7f3d88002860 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d90001c40 con 0x7f3d88002860 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 10 monclient: dump: 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.436 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 986125924 0 0) 0x7f3d880065c0 con 0x7f3d88002860 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d8800a160 con 0x7f3d88002860 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3d90005260 con 0x7f3d88002860 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.181:6792/0 conn(0x7f3d88002860 legacy=0x7f3d88004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.414+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.181:6792/0 conn(0x7f3d88002860 legacy=0x7f3d88004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.420+0000 7f3da7b9b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.420+0000 7f3da7b9b640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3d88009e70 con 0x7f3d88009130 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.422+0000 7f3da5937640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.181:6792/0 conn(0x7f3d88009130 legacy=0x7f3d880095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 941883499 0 0) 0x7f3d88009e70 con 0x7f3d88009130 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 10 monclient(hunting): my global_id is 4677 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d880065c0 con 0x7f3d88009130 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 435968627 0 0) 0x7f3d880065c0 con 0x7f3d88009130 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d88009e70 con 0x7f3d88009130 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d900059c0 con 0x7f3d88009130 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 10 monclient: dump: 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.439 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.440 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.440 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3468918288 0 0) 0x7f3d88009e70 con 0x7f3d88009130 2024-09-13T10:31:15.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3d8800c410 con 0x7f3d88009130 2024-09-13T10:31:15.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7725 (unknown 0 0 1903440204) 0x7f3d90007ea0 con 0x7f3d88009130 2024-09-13T10:31:15.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:15.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:15.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.181:6792/0 conn(0x7f3d88009130 legacy=0x7f3d880095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.423+0000 7f3d967fc640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.181:6792/0 conn(0x7f3d88009130 legacy=0x7f3d880095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:15.440 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 89866, 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:15.441 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.442 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.443 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:15.444 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.445 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:15.446 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.448 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:15.449 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.450 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:15.452 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:15.453 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.454 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.455 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.456 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.458 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.459 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.460 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:15.460 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.460 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.460 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:15.460 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:15.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.424+0000 7f3da7b9b640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3d840406e0 legacy=0x7f3d84042ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.424+0000 7f3da7b9b640 10 monclient: shutdown 2024-09-13T10:31:15.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.424+0000 7f3da7b9b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:15.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.424+0000 7f3da7b9b640 1 -- 172.21.15.181:0/549314456 >> v1:172.21.15.181:6793/0 conn(0x7f3da00a6ab0 legacy=0x7f3da01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.424+0000 7f3da6138640 1 -- 172.21.15.181:0/549314456 reap_dead start 2024-09-13T10:31:15.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.424+0000 7f3da6138640 1 -- 172.21.15.181:0/549314456 reap_dead start 2024-09-13T10:31:15.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.424+0000 7f3da7b9b640 1 -- 172.21.15.181:0/549314456 shutdown_connections 2024-09-13T10:31:15.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.424+0000 7f3da7b9b640 1 -- 172.21.15.181:0/549314456 >> 172.21.15.181:0/549314456 conn(0x7f3da00abcd0 msgr2=0x7f3da00a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:15.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.424+0000 7f3da7b9b640 1 -- 172.21.15.181:0/549314456 shutdown_connections 2024-09-13T10:31:15.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.424+0000 7f3da7b9b640 1 -- 172.21.15.181:0/549314456 wait complete. 2024-09-13T10:31:15.462 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:15.462 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:31:15.463 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:31:15.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.559+0000 7f994a924640 10 monclient: get_monmap_and_config 2024-09-13T10:31:15.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.559+0000 7f994a924640 10 monclient: build_initial_monmap 2024-09-13T10:31:15.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.559+0000 7f994a924640 10 monclient: monmap: 2024-09-13T10:31:15.561 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:15.561 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.561 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:15.560040+0000 2024-09-13T10:31:15.561 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:15.560040+0000 2024-09-13T10:31:15.561 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:15.561 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.561 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:15.561 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:15.561 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:15.561 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:15.562 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:15.562 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:15.562 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:15.562 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:15.562 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:15.562 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 1 Processor -- start 2024-09-13T10:31:15.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 1 -- start start 2024-09-13T10:31:15.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 10 monclient: init 2024-09-13T10:31:15.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:15.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 10 monclient: _add_conns ranks=[4,8,1,2,7,3,5,0,6] 2024-09-13T10:31:15.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 10 monclient(hunting): picked mon.noname-c con 0x7f99440a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:15.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 10 monclient(hunting): picked mon.noname-e con 0x7f99440a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:15.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 10 monclient(hunting): picked mon.noname-f con 0x7f994413f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:15.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99440a4bc0 con 0x7f994413f750 2024-09-13T10:31:15.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f994413a320 con 0x7f99440a6640 2024-09-13T10:31:15.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99440a8100 con 0x7f99440a8340 2024-09-13T10:31:15.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:15.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f994a924640 10 monclient(hunting): authenticate will time out at 815.065841s 2024-09-13T10:31:15.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f99437fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f99440a8340 0x7f9944139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:38826/0 (socket says 172.21.15.181:38826) 2024-09-13T10:31:15.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f9943fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f99440a6640 0x7f9944139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:39116/0 (socket says 172.21.15.181:39116) 2024-09-13T10:31:15.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.560+0000 7f99437fe640 1 -- 172.21.15.181:0/2636742434 learned_addr learned my addr 172.21.15.181:0/2636742434 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:15.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f99437fe640 1 -- 172.21.15.181:0/2636742434 >> v1:172.21.15.181:6793/0 conn(0x7f99440a8340 legacy=0x7f9944139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9943fff640 1 -- 172.21.15.181:0/2636742434 >> v1:172.21.15.181:6791/0 conn(0x7f99440a6640 legacy=0x7f9944139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 1 -- 172.21.15.181:0/2636742434 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187947943 0 0) 0x7f99440a8100 con 0x7f99440a8340 2024-09-13T10:31:15.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient(hunting): my global_id is 4724 2024-09-13T10:31:15.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 1 -- 172.21.15.181:0/2636742434 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f992c003520 con 0x7f99440a8340 2024-09-13T10:31:15.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 1 -- 172.21.15.181:0/2636742434 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2051633793 0 0) 0x7f994413a320 con 0x7f99440a6640 2024-09-13T10:31:15.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient(hunting): my global_id is 4711 2024-09-13T10:31:15.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 1 -- 172.21.15.181:0/2636742434 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99440a8100 con 0x7f99440a6640 2024-09-13T10:31:15.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9948ec1640 1 -- 172.21.15.181:0/2636742434 >> v1:172.21.15.195:6789/0 conn(0x7f994413f750 legacy=0x7f9944141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 1 -- 172.21.15.181:0/2636742434 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1540574397 0 0) 0x7f992c003520 con 0x7f99440a8340 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 1 -- 172.21.15.181:0/2636742434 >> v1:172.21.15.181:6791/0 conn(0x7f99440a6640 legacy=0x7f9944139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 1 -- 172.21.15.181:0/2636742434 >> v1:172.21.15.195:6789/0 conn(0x7f994413f750 legacy=0x7f9944141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 1 monclient: found mon.noname-e 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 1 -- 172.21.15.181:0/2636742434 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99440a48e0 con 0x7f99440a8340 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient: _finish_auth 0 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 1 -- 172.21.15.181:0/2636742434 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9938001ae0 con 0x7f99440a8340 2024-09-13T10:31:15.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f994a924640 5 monclient: authenticate success, global_id 4724 2024-09-13T10:31:15.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f994a924640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:15.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:31:15.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient: dump: 2024-09-13T10:31:15.571 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.571 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.571 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.571 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.571 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.571 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.572 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.572 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.572 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.572 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.572 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.572 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.572 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.572 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.572 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.572 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f994a924640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:15.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 1 -- 172.21.15.181:0/2636742434 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f99380048a0 con 0x7f99440a8340 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 1 -- 172.21.15.181:0/2636742434 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9938004d90 con 0x7f99440a8340 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f994a924640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f994a924640 4 set_mon_vals no callback set 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.563+0000 7f9942ffd640 10 monclient: dump: 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.573 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.574 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.574 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.574 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.574 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.574 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.574 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.574 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.574 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.574 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.564+0000 7f994a924640 10 monclient: shutdown 2024-09-13T10:31:15.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.564+0000 7f994a924640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:15.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.564+0000 7f994a924640 1 -- 172.21.15.181:0/2636742434 >> v1:172.21.15.181:6793/0 conn(0x7f99440a8340 legacy=0x7f9944139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.564+0000 7f994a924640 1 -- 172.21.15.181:0/2636742434 shutdown_connections 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.564+0000 7f994a924640 1 -- 172.21.15.181:0/2636742434 >> 172.21.15.181:0/2636742434 conn(0x7f9944077170 msgr2=0x7f99440abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.564+0000 7f994a924640 1 -- 172.21.15.181:0/2636742434 shutdown_connections 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.564+0000 7f994a924640 1 -- 172.21.15.181:0/2636742434 wait complete. 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.564+0000 7f994a924640 10 monclient: build_initial_monmap 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.564+0000 7f994a924640 10 monclient: monmap: 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:15.575 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 1 Processor -- start 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 1 -- start start 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 10 monclient: init 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 10 monclient: _add_conns ranks=[8,5,4,6,2,7,3,1,0] 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 10 monclient(hunting): picked mon.noname-e con 0x7f99440a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:15.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 10 monclient(hunting): picked mon.noname-h con 0x7f994413f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:15.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 10 monclient(hunting): picked mon.noname-c con 0x7f99441ca370 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:15.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99440a0d90 con 0x7f99441ca370 2024-09-13T10:31:15.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9944142b60 con 0x7f994413f750 2024-09-13T10:31:15.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99440a0ab0 con 0x7f99440a8340 2024-09-13T10:31:15.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:15.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f994a924640 10 monclient(hunting): authenticate will time out at 815.070797s 2024-09-13T10:31:15.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f9943fff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f99440a8340 0x7f99440a22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:38836/0 (socket says 172.21.15.181:38836) 2024-09-13T10:31:15.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.565+0000 7f9943fff640 1 -- 172.21.15.181:0/1834496938 learned_addr learned my addr 172.21.15.181:0/1834496938 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:15.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.567+0000 7f9943fff640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.181:6793/0 conn(0x7f99440a8340 legacy=0x7f99440a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.567+0000 7f9948ec1640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.181:6791/0 conn(0x7f99441ca370 legacy=0x7f99441d6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2496810691 0 0) 0x7f99440a0ab0 con 0x7f99440a8340 2024-09-13T10:31:15.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): my global_id is 4733 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9930003550 con 0x7f99440a8340 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4024353012 0 0) 0x7f99440a0d90 con 0x7f99441ca370 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): my global_id is 4720 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99440a0ab0 con 0x7f99441ca370 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f99437fe640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.195:6791/0 conn(0x7f994413f750 legacy=0x7f99441d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2152468123 0 0) 0x7f9930003550 con 0x7f99440a8340 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99440a0d90 con 0x7f99440a8340 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f99340047e0 con 0x7f99440a8340 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): dump: 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.583 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 128201680 0 0) 0x7f99440a0ab0 con 0x7f99441ca370 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9930003550 con 0x7f99441ca370 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f993c001fb0 con 0x7f99441ca370 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): dump: 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.584 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217263380 0 0) 0x7f9944142b60 con 0x7f994413f750 2024-09-13T10:31:15.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient(hunting): my global_id is 4703 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99440a0ab0 con 0x7f994413f750 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3779956621 0 0) 0x7f99440a0d90 con 0x7f99440a8340 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.195:6791/0 conn(0x7f994413f750 legacy=0x7f99441d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.181:6791/0 conn(0x7f99441ca370 legacy=0x7f99441d6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 monclient: found mon.e 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994409f860 con 0x7f99440a8340 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient: _finish_auth 0 2024-09-13T10:31:15.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:31:15.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:15.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f994a924640 5 monclient: authenticate success, global_id 4733 2024-09-13T10:31:15.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f994a924640 10 monclient: _renew_subs 2024-09-13T10:31:15.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f994a924640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:31:15.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f994a924640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f994409f590 con 0x7f99440a8340 2024-09-13T10:31:15.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f994a924640 10 monclient: _renew_subs 2024-09-13T10:31:15.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f994a924640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:31:15.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f994a924640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f99441d7a60 con 0x7f99440a8340 2024-09-13T10:31:15.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9934004cb0 con 0x7f99440a8340 2024-09-13T10:31:15.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:15.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f99340051e0 con 0x7f99440a8340 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f99427fc640 4 set_mon_vals no callback set 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.568+0000 7f9940ff9640 10 monclient: dump: 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.588 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.569+0000 7f994a924640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.569+0000 7f994a924640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f99240065c0 con 0x7f9924002860 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.569+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9934005380 con 0x7f99440a8340 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.569+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(44..44 src has 1..44) ==== 3898+0+0 (unknown 1673377458 0 0) 0x7f993404e3d0 con 0x7f99440a8340 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.569+0000 7f9948ec1640 10 monclient: get_auth_request con 0x7f9930040280 auth_method 0 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f99437fe640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.181:6793/0 conn(0x7f9924002860 legacy=0x7f9924004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122501805 0 0) 0x7f99240065c0 con 0x7f9924002860 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f9940ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f9940ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f9940ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f9940ff9640 10 monclient(hunting): my global_id is 4742 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99440a0d90 con 0x7f9924002860 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4272466911 0 0) 0x7f99440a0d90 con 0x7f9924002860 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99240065c0 con 0x7f9924002860 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9938001d30 con 0x7f9924002860 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f9940ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f9940ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.571+0000 7f9940ff9640 10 monclient: dump: 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.590 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.572+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 755325998 0 0) 0x7f99240065c0 con 0x7f9924002860 2024-09-13T10:31:15.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.572+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f992400a160 con 0x7f9924002860 2024-09-13T10:31:15.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.572+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9938004930 con 0x7f9924002860 2024-09-13T10:31:15.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.572+0000 7f9940ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:15.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.572+0000 7f9940ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:15.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.572+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.181:6793/0 conn(0x7f9924002860 legacy=0x7f9924004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.572+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.181:6793/0 conn(0x7f9924002860 legacy=0x7f9924004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:15.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.578+0000 7f994a924640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:15.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.578+0000 7f994a924640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9924009e70 con 0x7f9924009130 2024-09-13T10:31:15.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.580+0000 7f99437fe640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.181:6793/0 conn(0x7f9924009130 legacy=0x7f99240095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.594+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3513999732 0 0) 0x7f9924009e70 con 0x7f9924009130 2024-09-13T10:31:15.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.594+0000 7f9940ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.594+0000 7f9940ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.594+0000 7f9940ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.594+0000 7f9940ff9640 10 monclient(hunting): my global_id is 4751 2024-09-13T10:31:15.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.594+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99240065c0 con 0x7f9924009130 2024-09-13T10:31:15.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.595+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3199262667 0 0) 0x7f99240065c0 con 0x7f9924009130 2024-09-13T10:31:15.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.595+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9924009e70 con 0x7f9924009130 2024-09-13T10:31:15.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.595+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9938005410 con 0x7f9924009130 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.595+0000 7f9940ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.595+0000 7f9940ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.595+0000 7f9940ff9640 10 monclient: dump: 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.598 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.599 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.599 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.599 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.599 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.599 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.595+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3613372189 0 0) 0x7f9924009e70 con 0x7f9924009130 2024-09-13T10:31:15.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.595+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f992400c3f0 con 0x7f9924009130 2024-09-13T10:31:15.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 2781134628) 0x7f9938007d90 con 0x7f9924009130 2024-09-13T10:31:15.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f9940ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:15.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f9940ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:15.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.181:6793/0 conn(0x7f9924009130 legacy=0x7f99240095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f9940ff9640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.181:6793/0 conn(0x7f9924009130 legacy=0x7f99240095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:15.600 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:15.600 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:15.600 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:15.600 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:15.600 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:15.600 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 90027, 2024-09-13T10:31:15.600 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:15.600 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:15.600 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:15.600 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.601 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.602 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:15.603 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:15.604 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.605 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:15.606 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.607 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.608 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.615 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.616 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:15.619 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:15.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f994a924640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.195:6800/1839191919 conn(0x7f9930040280 legacy=0x7f9930042740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f994a924640 10 monclient: shutdown 2024-09-13T10:31:15.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f994a924640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:15.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f994a924640 1 -- 172.21.15.181:0/1834496938 >> v1:172.21.15.181:6793/0 conn(0x7f99440a8340 legacy=0x7f99440a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f9948ec1640 1 -- 172.21.15.181:0/1834496938 reap_dead start 2024-09-13T10:31:15.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f9948ec1640 1 -- 172.21.15.181:0/1834496938 reap_dead start 2024-09-13T10:31:15.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f994a924640 1 -- 172.21.15.181:0/1834496938 shutdown_connections 2024-09-13T10:31:15.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f994a924640 1 -- 172.21.15.181:0/1834496938 >> 172.21.15.181:0/1834496938 conn(0x7f99440a6640 msgr2=0x7f9944141b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:15.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.596+0000 7f994a924640 1 -- 172.21.15.181:0/1834496938 shutdown_connections 2024-09-13T10:31:15.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.597+0000 7f994a924640 1 -- 172.21.15.181:0/1834496938 wait complete. 2024-09-13T10:31:15.621 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:15.621 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:31:15.621 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:31:15.622 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:15.622 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36117]: starting. 2024-09-13T10:31:15.622 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36117]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36081 2024-09-13T10:31:15.623 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36117]: shutting down. 2024-09-13T10:31:15.623 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:15.623 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:15.623 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:31:15.623 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:31:15.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.722+0000 7f7b66564640 10 monclient: get_monmap_and_config 2024-09-13T10:31:15.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.722+0000 7f7b66564640 10 monclient: build_initial_monmap 2024-09-13T10:31:15.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.722+0000 7f7b66564640 10 monclient: monmap: 2024-09-13T10:31:15.724 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:15.724 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.724 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:15.723385+0000 2024-09-13T10:31:15.724 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:15.723385+0000 2024-09-13T10:31:15.725 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:15.725 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.725 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:15.725 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:15.725 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:15.725 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:15.725 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:15.725 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:15.725 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:15.725 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:15.725 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:15.725 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.723+0000 7f7b66564640 1 Processor -- start 2024-09-13T10:31:15.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.723+0000 7f7b66564640 1 -- start start 2024-09-13T10:31:15.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.723+0000 7f7b66564640 10 monclient: init 2024-09-13T10:31:15.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.724+0000 7f7b66564640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:15.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.724+0000 7f7b66564640 10 monclient: _add_conns ranks=[3,5,2,0,1,6,4,8,7] 2024-09-13T10:31:15.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.724+0000 7f7b66564640 10 monclient(hunting): picked mon.noname-g con 0x7f7b600a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:15.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.724+0000 7f7b66564640 10 monclient(hunting): picked mon.noname-h con 0x7f7b600a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:15.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.724+0000 7f7b66564640 10 monclient(hunting): picked mon.noname-b con 0x7f7b6013f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:15.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.724+0000 7f7b66564640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b600a4bc0 con 0x7f7b6013f750 2024-09-13T10:31:15.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.724+0000 7f7b66564640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b6013a320 con 0x7f7b600a6640 2024-09-13T10:31:15.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.724+0000 7f7b66564640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b600a8100 con 0x7f7b600a8340 2024-09-13T10:31:15.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.724+0000 7f7b66564640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:15.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.724+0000 7f7b66564640 10 monclient(hunting): authenticate will time out at 815.229254s 2024-09-13T10:31:15.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.724+0000 7f7b64b01640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f7b6013f750 0x7f7b60141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:60020/0 (socket says 172.21.15.181:60020) 2024-09-13T10:31:15.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.724+0000 7f7b64b01640 1 -- 172.21.15.181:0/381043969 learned_addr learned my addr 172.21.15.181:0/381043969 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:15.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b64b01640 1 -- 172.21.15.181:0/381043969 >> v1:172.21.15.181:6790/0 conn(0x7f7b6013f750 legacy=0x7f7b60141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5ffff640 1 -- 172.21.15.181:0/381043969 >> v1:172.21.15.195:6790/0 conn(0x7f7b600a6640 legacy=0x7f7b60139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5f7fe640 1 -- 172.21.15.181:0/381043969 >> v1:172.21.15.195:6791/0 conn(0x7f7b600a8340 legacy=0x7f7b60139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 1 -- 172.21.15.181:0/381043969 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324665221 0 0) 0x7f7b600a4bc0 con 0x7f7b6013f750 2024-09-13T10:31:15.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient(hunting): my global_id is 64127 2024-09-13T10:31:15.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 1 -- 172.21.15.181:0/381043969 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b48003520 con 0x7f7b6013f750 2024-09-13T10:31:15.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 1 -- 172.21.15.181:0/381043969 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2342966290 0 0) 0x7f7b600a8100 con 0x7f7b600a8340 2024-09-13T10:31:15.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient(hunting): my global_id is 4730 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 1 -- 172.21.15.181:0/381043969 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b600a4bc0 con 0x7f7b600a8340 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 1 -- 172.21.15.181:0/381043969 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3368866073 0 0) 0x7f7b48003520 con 0x7f7b6013f750 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 1 -- 172.21.15.181:0/381043969 >> v1:172.21.15.195:6791/0 conn(0x7f7b600a8340 legacy=0x7f7b60139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 1 -- 172.21.15.181:0/381043969 >> v1:172.21.15.195:6790/0 conn(0x7f7b600a6640 legacy=0x7f7b60139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient: _finish_hunting 0 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 1 monclient: found mon.noname-b 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 1 -- 172.21.15.181:0/381043969 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b600a48e0 con 0x7f7b6013f750 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient: _finish_auth 0 2024-09-13T10:31:15.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient: _check_auth_tickets 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 1 -- 172.21.15.181:0/381043969 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7b58001e60 con 0x7f7b6013f750 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b66564640 5 monclient: authenticate success, global_id 64127 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b66564640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b5effd640 10 monclient: dump: 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.734 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.726+0000 7f7b66564640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b5effd640 1 -- 172.21.15.181:0/381043969 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b58004c20 con 0x7f7b6013f750 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b5effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b5effd640 1 -- 172.21.15.181:0/381043969 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7b580051d0 con 0x7f7b6013f750 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b66564640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:15.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b66564640 4 set_mon_vals no callback set 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b5effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b5effd640 10 monclient: dump: 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.736 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b66564640 10 monclient: shutdown 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b66564640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b66564640 1 -- 172.21.15.181:0/381043969 >> v1:172.21.15.181:6790/0 conn(0x7f7b6013f750 legacy=0x7f7b60141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b66564640 1 -- 172.21.15.181:0/381043969 shutdown_connections 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b66564640 1 -- 172.21.15.181:0/381043969 >> 172.21.15.181:0/381043969 conn(0x7f7b60077170 msgr2=0x7f7b600abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b66564640 1 -- 172.21.15.181:0/381043969 shutdown_connections 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.727+0000 7f7b66564640 1 -- 172.21.15.181:0/381043969 wait complete. 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.728+0000 7f7b66564640 10 monclient: build_initial_monmap 2024-09-13T10:31:15.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.728+0000 7f7b66564640 10 monclient: monmap: 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:15.738 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.728+0000 7f7b66564640 1 Processor -- start 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.728+0000 7f7b66564640 1 -- start start 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.728+0000 7f7b66564640 10 monclient: init 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.729+0000 7f7b66564640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.729+0000 7f7b66564640 10 monclient: _add_conns ranks=[6,2,5,8,3,0,4,7,1] 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.729+0000 7f7b66564640 10 monclient(hunting): picked mon.noname-d con 0x7f7b600a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.729+0000 7f7b66564640 10 monclient(hunting): picked mon.noname-b con 0x7f7b6013f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.729+0000 7f7b66564640 10 monclient(hunting): picked mon.noname-h con 0x7f7b6013e470 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.729+0000 7f7b66564640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b60130280 con 0x7f7b6013f750 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.729+0000 7f7b66564640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b6013d670 con 0x7f7b6013e470 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.729+0000 7f7b66564640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b601345d0 con 0x7f7b600a8340 2024-09-13T10:31:15.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.729+0000 7f7b66564640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:15.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.729+0000 7f7b66564640 10 monclient(hunting): authenticate will time out at 815.234152s 2024-09-13T10:31:15.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.729+0000 7f7b5ffff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f7b600a8340 0x7f7b6012f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44324/0 (socket says 172.21.15.181:44324) 2024-09-13T10:31:15.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.729+0000 7f7b5ffff640 1 -- 172.21.15.181:0/308915675 learned_addr learned my addr 172.21.15.181:0/308915675 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:15.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5ffff640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.181:6792/0 conn(0x7f7b600a8340 legacy=0x7f7b6012f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5f7fe640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.181:6790/0 conn(0x7f7b6013f750 legacy=0x7f7b6012fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b64b01640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.195:6791/0 conn(0x7f7b6013e470 legacy=0x7f7b601d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870578454 0 0) 0x7f7b60130280 con 0x7f7b6013f750 2024-09-13T10:31:15.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): my global_id is 64136 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b4c003550 con 0x7f7b6013f750 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3246706881 0 0) 0x7f7b601345d0 con 0x7f7b600a8340 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): my global_id is 4695 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b60130280 con 0x7f7b600a8340 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038455784 0 0) 0x7f7b6013d670 con 0x7f7b6013e470 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): my global_id is 4739 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b601345d0 con 0x7f7b6013e470 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3624115041 0 0) 0x7f7b4c003550 con 0x7f7b6013f750 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b6013d670 con 0x7f7b6013f750 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7b54001cc0 con 0x7f7b6013f750 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): dump: 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.746 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3295730235 0 0) 0x7f7b601345d0 con 0x7f7b6013e470 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b4c003550 con 0x7f7b6013e470 2024-09-13T10:31:15.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3003796756 0 0) 0x7f7b60130280 con 0x7f7b600a8340 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b601345d0 con 0x7f7b600a8340 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7b580020b0 con 0x7f7b6013e470 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): dump: 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.748 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7b50003610 con 0x7f7b600a8340 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient(hunting): dump: 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.749 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.750 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2813753389 0 0) 0x7f7b6013d670 con 0x7f7b6013f750 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.181:6792/0 conn(0x7f7b600a8340 legacy=0x7f7b6012f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.195:6791/0 conn(0x7f7b6013e470 legacy=0x7f7b601d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient: _finish_hunting 0 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 monclient: found mon.b 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b601348b0 con 0x7f7b6013f750 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient: _finish_auth 0 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 10 monclient: _check_auth_tickets 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b5cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b66564640 5 monclient: authenticate success, global_id 64136 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.731+0000 7f7b66564640 10 monclient: _renew_subs 2024-09-13T10:31:15.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b66564640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b66564640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7b601342e0 con 0x7f7b6013f750 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b66564640 10 monclient: _renew_subs 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b66564640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b66564640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7b601d7c50 con 0x7f7b6013f750 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b54003a30 con 0x7f7b6013f750 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b5cff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7b54003f60 con 0x7f7b6013f750 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b5cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b5e7fc640 4 set_mon_vals no callback set 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b5cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b5cff9640 10 monclient: dump: 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.752 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.753 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b66564640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b66564640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7b400065c0 con 0x7f7b40002860 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.732+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7b54004100 con 0x7f7b6013f750 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.733+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(45..45 src has 1..45) ==== 3506+0+0 (unknown 1595584932 0 0) 0x7f7b5404e140 con 0x7f7b6013f750 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.733+0000 7f7b64b01640 10 monclient: get_auth_request con 0x7f7b4c040610 auth_method 0 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5ffff640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.195:6789/0 conn(0x7f7b40002860 legacy=0x7f7b40004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523791577 0 0) 0x7f7b400065c0 con 0x7f7b40002860 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 10 monclient(hunting): my global_id is 54721 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b6013d670 con 0x7f7b40002860 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1635634041 0 0) 0x7f7b6013d670 con 0x7f7b40002860 2024-09-13T10:31:15.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b400065c0 con 0x7f7b40002860 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7b50003e50 con 0x7f7b40002860 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 10 monclient: dump: 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.755 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 457802461 0 0) 0x7f7b400065c0 con 0x7f7b40002860 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.735+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b4000a160 con 0x7f7b40002860 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.736+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7b50004140 con 0x7f7b40002860 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.736+0000 7f7b5cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.736+0000 7f7b5cff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:15.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.736+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.195:6789/0 conn(0x7f7b40002860 legacy=0x7f7b40004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.736+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.195:6789/0 conn(0x7f7b40002860 legacy=0x7f7b40004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:15.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.742+0000 7f7b66564640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:15.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.742+0000 7f7b66564640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7b40009e70 con 0x7f7b40009130 2024-09-13T10:31:15.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.744+0000 7f7b5ffff640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.195:6789/0 conn(0x7f7b40009130 legacy=0x7f7b400095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.744+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1610849735 0 0) 0x7f7b40009e70 con 0x7f7b40009130 2024-09-13T10:31:15.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.744+0000 7f7b5cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.744+0000 7f7b5cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.744+0000 7f7b5cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.744+0000 7f7b5cff9640 10 monclient(hunting): my global_id is 54730 2024-09-13T10:31:15.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.744+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b400065c0 con 0x7f7b40009130 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 156040331 0 0) 0x7f7b400065c0 con 0x7f7b40009130 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b40009e70 con 0x7f7b40009130 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7b50005b00 con 0x7f7b40009130 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 10 monclient: dump: 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.759 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1524223507 0 0) 0x7f7b40009e70 con 0x7f7b40009130 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7b4000c410 con 0x7f7b40009130 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 600169794) 0x7f7b50007d90 con 0x7f7b40009130 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:15.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.195:6789/0 conn(0x7f7b40009130 legacy=0x7f7b400095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.745+0000 7f7b5cff9640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.195:6789/0 conn(0x7f7b40009130 legacy=0x7f7b400095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:15.761 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:15.761 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:15.761 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:15.761 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:15.761 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:15.761 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 90154, 2024-09-13T10:31:15.761 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:15.761 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:15.761 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.762 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.763 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:15.764 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:15.765 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:15.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.767 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.768 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:15.769 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.769 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.769 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:15.769 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:15.769 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.769 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.769 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.770 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.771 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:15.772 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.773 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.774 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.775 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:15.776 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.777 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.778 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.779 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:15.780 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.780 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.780 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:15.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.780 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.780 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.780 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:31:15.780 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.780 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.780 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:15.780 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:15.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.746+0000 7f7b66564640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7b4c040610 legacy=0x7f7b4c042ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.746+0000 7f7b66564640 10 monclient: shutdown 2024-09-13T10:31:15.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.746+0000 7f7b66564640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:15.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.746+0000 7f7b66564640 1 -- 172.21.15.181:0/308915675 >> v1:172.21.15.181:6790/0 conn(0x7f7b6013f750 legacy=0x7f7b6012fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.746+0000 7f7b64b01640 1 -- 172.21.15.181:0/308915675 reap_dead start 2024-09-13T10:31:15.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.746+0000 7f7b64b01640 1 -- 172.21.15.181:0/308915675 reap_dead start 2024-09-13T10:31:15.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.746+0000 7f7b66564640 1 -- 172.21.15.181:0/308915675 shutdown_connections 2024-09-13T10:31:15.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.746+0000 7f7b66564640 1 -- 172.21.15.181:0/308915675 >> 172.21.15.181:0/308915675 conn(0x7f7b600a6640 msgr2=0x7f7b600a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:15.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.746+0000 7f7b66564640 1 -- 172.21.15.181:0/308915675 shutdown_connections 2024-09-13T10:31:15.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.746+0000 7f7b66564640 1 -- 172.21.15.181:0/308915675 wait complete. 2024-09-13T10:31:15.783 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:15.783 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:31:15.783 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:31:15.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.884+0000 7fa2260b6640 10 monclient: get_monmap_and_config 2024-09-13T10:31:15.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.884+0000 7fa2260b6640 10 monclient: build_initial_monmap 2024-09-13T10:31:15.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.884+0000 7fa2260b6640 10 monclient: monmap: 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:15.884809+0000 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:15.884809+0000 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:15.886 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:15.887 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:15.887 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:15.887 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.884+0000 7fa2260b6640 1 Processor -- start 2024-09-13T10:31:15.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa2260b6640 1 -- start start 2024-09-13T10:31:15.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa2260b6640 10 monclient: init 2024-09-13T10:31:15.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa2260b6640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:15.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa2260b6640 10 monclient: _add_conns ranks=[6,5,0,8,3,4,7,1,2] 2024-09-13T10:31:15.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa2260b6640 10 monclient(hunting): picked mon.noname-d con 0x7fa2200a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:15.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa2260b6640 10 monclient(hunting): picked mon.noname-h con 0x7fa2200a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:15.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa2260b6640 10 monclient(hunting): picked mon.noname-a con 0x7fa22013f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:15.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa2260b6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2200a5fe0 con 0x7fa22013f9a0 2024-09-13T10:31:15.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa2260b6640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2200a8080 con 0x7fa2200a6ab0 2024-09-13T10:31:15.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa2260b6640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2200a42c0 con 0x7fa2200a66d0 2024-09-13T10:31:15.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa2260b6640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:15.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa2260b6640 10 monclient(hunting): authenticate will time out at 815.390550s 2024-09-13T10:31:15.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa21f7fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fa2200a66d0 0x7fa2200a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44334/0 (socket says 172.21.15.181:44334) 2024-09-13T10:31:15.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa21f7fe640 1 -- 172.21.15.181:0/1554734114 learned_addr learned my addr 172.21.15.181:0/1554734114 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:15.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.885+0000 7fa21ffff640 1 --1- 172.21.15.181:0/1554734114 >> v1:172.21.15.181:6789/0 conn(0x7fa22013f9a0 0x7fa220141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:58634/0 (socket says 172.21.15.181:58634) 2024-09-13T10:31:15.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.887+0000 7fa21f7fe640 1 -- 172.21.15.181:0/1554734114 >> v1:172.21.15.181:6792/0 conn(0x7fa2200a66d0 legacy=0x7fa2200a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.887+0000 7fa21ffff640 1 -- 172.21.15.181:0/1554734114 >> v1:172.21.15.181:6789/0 conn(0x7fa22013f9a0 legacy=0x7fa220141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.887+0000 7fa21effd640 1 -- 172.21.15.181:0/1554734114 >> v1:172.21.15.195:6791/0 conn(0x7fa2200a6ab0 legacy=0x7fa2200a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.887+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747626970 0 0) 0x7fa2200a5fe0 con 0x7fa22013f9a0 2024-09-13T10:31:15.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient(hunting): my global_id is 54594 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa208003520 con 0x7fa22013f9a0 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 748597488 0 0) 0x7fa2200a42c0 con 0x7fa2200a66d0 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient(hunting): my global_id is 4704 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2200a5fe0 con 0x7fa2200a66d0 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564819617 0 0) 0x7fa2200a8080 con 0x7fa2200a6ab0 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient(hunting): my global_id is 4748 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2200a42c0 con 0x7fa2200a6ab0 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3002260970 0 0) 0x7fa208003520 con 0x7fa22013f9a0 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 >> v1:172.21.15.181:6792/0 conn(0x7fa2200a66d0 legacy=0x7fa2200a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 >> v1:172.21.15.195:6791/0 conn(0x7fa2200a6ab0 legacy=0x7fa2200a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 monclient: found mon.noname-a 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2201464e0 con 0x7fa22013f9a0 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient: _finish_auth 0 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:31:15.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa2260b6640 5 monclient: authenticate success, global_id 54594 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa218001d80 con 0x7fa22013f9a0 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient: dump: 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.895 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa2260b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa218002050 con 0x7fa22013f9a0 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 1 -- 172.21.15.181:0/1554734114 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa218004ea0 con 0x7fa22013f9a0 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:15.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa21e7fc640 10 monclient: dump: 2024-09-13T10:31:15.897 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.897 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.897 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.897 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.897 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.897 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.897 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.897 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.897 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.897 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.897 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa2260b6640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa2260b6640 4 set_mon_vals no callback set 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa2260b6640 10 monclient: shutdown 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa2260b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa2260b6640 1 -- 172.21.15.181:0/1554734114 >> v1:172.21.15.181:6789/0 conn(0x7fa22013f9a0 legacy=0x7fa220141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.888+0000 7fa2260b6640 1 -- 172.21.15.181:0/1554734114 shutdown_connections 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.889+0000 7fa2260b6640 1 -- 172.21.15.181:0/1554734114 >> 172.21.15.181:0/1554734114 conn(0x7fa2200abcd0 msgr2=0x7fa2200ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:15.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.889+0000 7fa2260b6640 1 -- 172.21.15.181:0/1554734114 shutdown_connections 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.889+0000 7fa2260b6640 1 -- 172.21.15.181:0/1554734114 wait complete. 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.889+0000 7fa2260b6640 10 monclient: build_initial_monmap 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.889+0000 7fa2260b6640 10 monclient: monmap: 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:15.899 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.889+0000 7fa2260b6640 1 Processor -- start 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa2260b6640 1 -- start start 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa2260b6640 10 monclient: init 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa2260b6640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa2260b6640 10 monclient: _add_conns ranks=[0,4,3,2,8,7,6,1,5] 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa2260b6640 10 monclient(hunting): picked mon.noname-a con 0x7fa2200a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa2260b6640 10 monclient(hunting): picked mon.noname-c con 0x7fa2200a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa2260b6640 10 monclient(hunting): picked mon.noname-g con 0x7fa22013f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:15.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa2260b6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa22013f0e0 con 0x7fa2200a66d0 2024-09-13T10:31:15.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa2260b6640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2201cf210 con 0x7fa22013f9a0 2024-09-13T10:31:15.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa2260b6640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa220068680 con 0x7fa2200a6ab0 2024-09-13T10:31:15.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa2260b6640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:15.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa2260b6640 10 monclient(hunting): authenticate will time out at 815.395561s 2024-09-13T10:31:15.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa21f7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa2200a66d0 0x7fa2201ce3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:58646/0 (socket says 172.21.15.181:58646) 2024-09-13T10:31:15.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.890+0000 7fa21f7fe640 1 -- 172.21.15.181:0/3490453091 learned_addr learned my addr 172.21.15.181:0/3490453091 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa21f7fe640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.181:6789/0 conn(0x7fa2200a66d0 legacy=0x7fa2201ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa21effd640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.181:6791/0 conn(0x7fa2200a6ab0 legacy=0x7fa2201ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa21ffff640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.195:6790/0 conn(0x7fa22013f9a0 legacy=0x7fa2201d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261575132 0 0) 0x7fa22013f0e0 con 0x7fa2200a66d0 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa207fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa207fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa207fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa207fff640 10 monclient(hunting): my global_id is 54603 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa20c003520 con 0x7fa2200a66d0 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1750694607 0 0) 0x7fa220068680 con 0x7fa2200a6ab0 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa207fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa207fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa207fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa207fff640 10 monclient(hunting): my global_id is 4747 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.892+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa22013f0e0 con 0x7fa2200a6ab0 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124581198 0 0) 0x7fa2201cf210 con 0x7fa22013f9a0 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): my global_id is 4683 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa220068680 con 0x7fa22013f9a0 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3123919946 0 0) 0x7fa20c003520 con 0x7fa2200a66d0 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2201cf210 con 0x7fa2200a66d0 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa2100019f0 con 0x7fa2200a66d0 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): dump: 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.908 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.909 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.909 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.909 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:15.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3895132029 0 0) 0x7fa22013f0e0 con 0x7fa2200a6ab0 2024-09-13T10:31:15.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa20c003520 con 0x7fa2200a6ab0 2024-09-13T10:31:15.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa214003610 con 0x7fa2200a6ab0 2024-09-13T10:31:15.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:15.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): dump: 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.910 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 550097496 0 0) 0x7fa220068680 con 0x7fa22013f9a0 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa22013f0e0 con 0x7fa22013f9a0 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa218004ea0 con 0x7fa22013f9a0 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient(hunting): dump: 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.911 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.912 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.912 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.912 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.912 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.912 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.912 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.912 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.912 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.912 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.912 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.912 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3573838817 0 0) 0x7fa2201cf210 con 0x7fa2200a66d0 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.181:6791/0 conn(0x7fa2200a6ab0 legacy=0x7fa2201ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.195:6790/0 conn(0x7fa22013f9a0 legacy=0x7fa2201d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient: _finish_hunting 0 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 monclient: found mon.a 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa220142db0 con 0x7fa2200a66d0 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient: _finish_auth 0 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient: _check_auth_tickets 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa2260b6640 5 monclient: authenticate success, global_id 54603 2024-09-13T10:31:15.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa2260b6640 10 monclient: _renew_subs 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa2260b6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa2260b6640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa22013cd80 con 0x7fa2200a66d0 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa2260b6640 10 monclient: _renew_subs 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa2260b6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa2260b6640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2200a2150 con 0x7fa2200a66d0 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa210004dd0 con 0x7fa2200a66d0 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa2100052c0 con 0x7fa2200a66d0 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa21dffb640 4 set_mon_vals no callback set 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.893+0000 7fa207fff640 10 monclient: dump: 2024-09-13T10:31:15.914 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.915 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.894+0000 7fa2260b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.894+0000 7fa2260b6640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa2000065c0 con 0x7fa200002860 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.894+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa210011940 con 0x7fa2200a66d0 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.894+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(45..45 src has 1..45) ==== 3506+0+0 (unknown 1595584932 0 0) 0x7fa21004e250 con 0x7fa2200a66d0 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.895+0000 7fa21ffff640 10 monclient: get_auth_request con 0x7fa20c0404d0 auth_method 0 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.896+0000 7fa21effd640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.195:6790/0 conn(0x7fa200002860 legacy=0x7fa200004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.896+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 420869589 0 0) 0x7fa2000065c0 con 0x7fa200002860 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.896+0000 7fa207fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.896+0000 7fa207fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.896+0000 7fa207fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.896+0000 7fa207fff640 10 monclient(hunting): my global_id is 4692 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.896+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2201cf210 con 0x7fa200002860 2024-09-13T10:31:15.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1955239644 0 0) 0x7fa2201cf210 con 0x7fa200002860 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2000065c0 con 0x7fa200002860 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa214003e10 con 0x7fa200002860 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 10 monclient: dump: 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.917 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1538582969 0 0) 0x7fa2000065c0 con 0x7fa200002860 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa20000a160 con 0x7fa200002860 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa214004050 con 0x7fa200002860 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.195:6790/0 conn(0x7fa200002860 legacy=0x7fa200004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.897+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.195:6790/0 conn(0x7fa200002860 legacy=0x7fa200004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:15.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.903+0000 7fa2260b6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:15.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.903+0000 7fa2260b6640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa200009e50 con 0x7fa200009110 2024-09-13T10:31:15.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa21effd640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.195:6790/0 conn(0x7fa200009110 legacy=0x7fa2000095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:15.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2599442584 0 0) 0x7fa200009e50 con 0x7fa200009110 2024-09-13T10:31:15.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:15.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 10 monclient(hunting): my global_id is 4701 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2000065c0 con 0x7fa200009110 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1447560296 0 0) 0x7fa2000065c0 con 0x7fa200009110 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa200009e50 con 0x7fa200009110 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa214005b00 con 0x7fa200009110 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 10 monclient: dump: 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:15.921 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2435366384 0 0) 0x7fa200009e50 con 0x7fa200009110 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa20000c3f0 con 0x7fa200009110 2024-09-13T10:31:15.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 3856002583) 0x7fa214007d90 con 0x7fa200009110 2024-09-13T10:31:15.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:15.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:15.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.195:6790/0 conn(0x7fa200009110 legacy=0x7fa2000095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.906+0000 7fa207fff640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.195:6790/0 conn(0x7fa200009110 legacy=0x7fa2000095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:15.923 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:15.923 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:15.923 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:15.923 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:15.923 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:15.923 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 90321, 2024-09-13T10:31:15.923 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:15.924 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:15.925 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:15.927 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:15.928 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.929 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:15.930 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.931 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.933 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.935 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:15.936 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.937 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:15.940 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:15.941 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:15.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:15.942 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:15.942 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:15.942 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:15.942 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:15.942 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:15.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:15.942 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:15.942 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:15.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.907+0000 7fa2260b6640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa20c0404d0 legacy=0x7fa20c042990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.907+0000 7fa2260b6640 10 monclient: shutdown 2024-09-13T10:31:15.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.907+0000 7fa2260b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:15.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.907+0000 7fa2260b6640 1 -- 172.21.15.181:0/3490453091 >> v1:172.21.15.181:6789/0 conn(0x7fa2200a66d0 legacy=0x7fa2201ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:15.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.907+0000 7fa21ffff640 1 -- 172.21.15.181:0/3490453091 reap_dead start 2024-09-13T10:31:15.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.907+0000 7fa21ffff640 1 -- 172.21.15.181:0/3490453091 reap_dead start 2024-09-13T10:31:15.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.907+0000 7fa2260b6640 1 -- 172.21.15.181:0/3490453091 shutdown_connections 2024-09-13T10:31:15.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.907+0000 7fa2260b6640 1 -- 172.21.15.181:0/3490453091 >> 172.21.15.181:0/3490453091 conn(0x7fa2200abcd0 msgr2=0x7fa220145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:15.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.907+0000 7fa2260b6640 1 -- 172.21.15.181:0/3490453091 shutdown_connections 2024-09-13T10:31:15.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:15.907+0000 7fa2260b6640 1 -- 172.21.15.181:0/3490453091 wait complete. 2024-09-13T10:31:15.944 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:15.944 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:31:15.944 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:31:16.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.041+0000 7f58bf0f7640 10 monclient: get_monmap_and_config 2024-09-13T10:31:16.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.041+0000 7f58bf0f7640 10 monclient: build_initial_monmap 2024-09-13T10:31:16.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.041+0000 7f58bf0f7640 10 monclient: monmap: 2024-09-13T10:31:16.043 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:16.043 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.043 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:16.042120+0000 2024-09-13T10:31:16.043 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:16.042120+0000 2024-09-13T10:31:16.043 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:16.043 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.043 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:16.043 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:16.043 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:16.043 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:16.044 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:16.044 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:16.044 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:16.044 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:16.044 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:16.044 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 1 Processor -- start 2024-09-13T10:31:16.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 1 -- start start 2024-09-13T10:31:16.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 10 monclient: init 2024-09-13T10:31:16.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:16.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 10 monclient: _add_conns ranks=[6,1,8,4,0,7,3,2,5] 2024-09-13T10:31:16.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 10 monclient(hunting): picked mon.noname-d con 0x7f58b80a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:16.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 10 monclient(hunting): picked mon.noname-f con 0x7f58b80a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:16.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 10 monclient(hunting): picked mon.noname-e con 0x7f58b813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:16.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b80a4bc0 con 0x7f58b80a8340 2024-09-13T10:31:16.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b813a320 con 0x7f58b80a6640 2024-09-13T10:31:16.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b80a8100 con 0x7f58b813f750 2024-09-13T10:31:16.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:16.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bf0f7640 10 monclient(hunting): authenticate will time out at 815.547789s 2024-09-13T10:31:16.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bce93640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f58b80a6640 0x7f58b8139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44338/0 (socket says 172.21.15.181:44338) 2024-09-13T10:31:16.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bd694640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f58b813f750 0x7f58b8141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:38868/0 (socket says 172.21.15.181:38868) 2024-09-13T10:31:16.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.042+0000 7f58bce93640 1 -- 172.21.15.181:0/2253862669 learned_addr learned my addr 172.21.15.181:0/2253862669 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:16.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58bce93640 1 -- 172.21.15.181:0/2253862669 >> v1:172.21.15.181:6792/0 conn(0x7f58b80a6640 legacy=0x7f58b8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58bd694640 1 -- 172.21.15.181:0/2253862669 >> v1:172.21.15.181:6793/0 conn(0x7f58b813f750 legacy=0x7f58b8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138276620 0 0) 0x7f58b813a320 con 0x7f58b80a6640 2024-09-13T10:31:16.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient(hunting): my global_id is 4713 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58a8003520 con 0x7f58b80a6640 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b7fff640 1 -- 172.21.15.181:0/2253862669 >> v1:172.21.15.195:6789/0 conn(0x7f58b80a8340 legacy=0x7f58b8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 52886260 0 0) 0x7f58b80a8100 con 0x7f58b813f750 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient(hunting): my global_id is 4778 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b813a320 con 0x7f58b813f750 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1331512815 0 0) 0x7f58b80a4bc0 con 0x7f58b80a8340 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient(hunting): my global_id is 54739 2024-09-13T10:31:16.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b80a8100 con 0x7f58b80a8340 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 233204970 0 0) 0x7f58b813a320 con 0x7f58b813f750 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 >> v1:172.21.15.181:6792/0 conn(0x7f58b80a6640 legacy=0x7f58b8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 >> v1:172.21.15.195:6789/0 conn(0x7f58b80a8340 legacy=0x7f58b8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient: _finish_hunting 0 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 monclient: found mon.noname-e 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b80a48e0 con 0x7f58b813f750 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient: _finish_auth 0 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient: _check_auth_tickets 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58b0001e40 con 0x7f58b813f750 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:16.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient: dump: 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.056 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58bf0f7640 5 monclient: authenticate success, global_id 4778 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58bf0f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58b0004b60 con 0x7f58b813f750 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 1 -- 172.21.15.181:0/2253862669 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58b00050d0 con 0x7f58b813f750 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58bf0f7640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58bf0f7640 4 set_mon_vals no callback set 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.045+0000 7f58b77fe640 10 monclient: dump: 2024-09-13T10:31:16.057 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.058 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.046+0000 7f58bf0f7640 10 monclient: shutdown 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.046+0000 7f58bf0f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.046+0000 7f58bf0f7640 1 -- 172.21.15.181:0/2253862669 >> v1:172.21.15.181:6793/0 conn(0x7f58b813f750 legacy=0x7f58b8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.046+0000 7f58bf0f7640 1 -- 172.21.15.181:0/2253862669 shutdown_connections 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.046+0000 7f58bf0f7640 1 -- 172.21.15.181:0/2253862669 >> 172.21.15.181:0/2253862669 conn(0x7f58b8077170 msgr2=0x7f58b80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.046+0000 7f58bf0f7640 1 -- 172.21.15.181:0/2253862669 shutdown_connections 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.046+0000 7f58bf0f7640 1 -- 172.21.15.181:0/2253862669 wait complete. 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.046+0000 7f58bf0f7640 10 monclient: build_initial_monmap 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.046+0000 7f58bf0f7640 10 monclient: monmap: 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:16.059 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 1 Processor -- start 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 1 -- start start 2024-09-13T10:31:16.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 10 monclient: init 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 10 monclient: _add_conns ranks=[2,7,3,4,0,8,6,5,1] 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 10 monclient(hunting): picked mon.noname-b con 0x7f58b80a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 10 monclient(hunting): picked mon.noname-i con 0x7f58b813f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 10 monclient(hunting): picked mon.noname-g con 0x7f58b81353d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b80a9ed0 con 0x7f58b80a8340 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b8134cd0 con 0x7f58b81353d0 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b8134fb0 con 0x7f58b813f750 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bf0f7640 10 monclient(hunting): authenticate will time out at 815.552752s 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bce93640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f58b80a8340 0x7f58b812f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:60036/0 (socket says 172.21.15.181:60036) 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.047+0000 7f58bce93640 1 -- 172.21.15.181:0/1464351680 learned_addr learned my addr 172.21.15.181:0/1464351680 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.049+0000 7f58bce93640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.181:6790/0 conn(0x7f58b80a8340 legacy=0x7f58b812f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 618065181 0 0) 0x7f58ac0015e0 con 0x7f58b80a8340 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): my global_id is 64145 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f589c003550 con 0x7f58b80a8340 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b7fff640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.195:6792/0 conn(0x7f58b813f750 legacy=0x7f58b812fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58bd694640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.195:6790/0 conn(0x7f58b81353d0 legacy=0x7f58b81d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3852966613 0 0) 0x7f589c003550 con 0x7f58b80a8340 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58ac0015e0 con 0x7f58b80a8340 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58ac004b20 con 0x7f58b80a8340 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): dump: 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.062 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.063 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3519651118 0 0) 0x7f58b8134cd0 con 0x7f58b81353d0 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): my global_id is 4710 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f589c003550 con 0x7f58b81353d0 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4264165377 0 0) 0x7f58b8134fb0 con 0x7f58b813f750 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient(hunting): my global_id is 54682 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b8134cd0 con 0x7f58b813f750 2024-09-13T10:31:16.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1393761749 0 0) 0x7f58ac0015e0 con 0x7f58b80a8340 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.195:6792/0 conn(0x7f58b813f750 legacy=0x7f58b812fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.195:6790/0 conn(0x7f58b81353d0 legacy=0x7f58b81d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient: _finish_hunting 0 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 monclient: found mon.b 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b8130280 con 0x7f58b80a8340 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient: _finish_auth 0 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient: _check_auth_tickets 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58bf0f7640 5 monclient: authenticate success, global_id 64145 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58bf0f7640 10 monclient: _renew_subs 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58bf0f7640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:16.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58bf0f7640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f58b8142f60 con 0x7f58b80a8340 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58bf0f7640 10 monclient: _renew_subs 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58bf0f7640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58bf0f7640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f58b8134710 con 0x7f58b80a8340 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58ac004f70 con 0x7f58b80a8340 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58ac005460 con 0x7f58b80a8340 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b6ffd640 4 set_mon_vals no callback set 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.050+0000 7f58b57fa640 10 monclient: dump: 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.066 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.051+0000 7f58bf0f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.051+0000 7f58bf0f7640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f58980065c0 con 0x7f5898002860 2024-09-13T10:31:16.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.051+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f58ac011b60 con 0x7f58b80a8340 2024-09-13T10:31:16.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.051+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(45..45 src has 1..45) ==== 3506+0+0 (unknown 1595584932 0 0) 0x7f58ac04e450 con 0x7f58b80a8340 2024-09-13T10:31:16.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.051+0000 7f58bd694640 10 monclient: get_auth_request con 0x7f589c03fdb0 auth_method 0 2024-09-13T10:31:16.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.053+0000 7f58b7fff640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.195:6791/0 conn(0x7f5898002860 legacy=0x7f5898004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.053+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569137046 0 0) 0x7f58980065c0 con 0x7f5898002860 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.053+0000 7f58b57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.053+0000 7f58b57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.053+0000 7f58b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.053+0000 7f58b57fa640 10 monclient(hunting): my global_id is 4757 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.053+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58ac0015e0 con 0x7f5898002860 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 196463938 0 0) 0x7f58ac0015e0 con 0x7f5898002860 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58980065c0 con 0x7f5898002860 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58a4001ca0 con 0x7f5898002860 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 10 monclient: dump: 2024-09-13T10:31:16.071 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.072 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3072013324 0 0) 0x7f58980065c0 con 0x7f5898002860 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f589800a160 con 0x7f5898002860 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f58a40068b0 con 0x7f5898002860 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.195:6791/0 conn(0x7f5898002860 legacy=0x7f5898004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.054+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.195:6791/0 conn(0x7f5898002860 legacy=0x7f5898004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.061+0000 7f58bf0f7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.061+0000 7f58bf0f7640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5898009e50 con 0x7f5898009110 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.063+0000 7f58b7fff640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.195:6791/0 conn(0x7f5898009110 legacy=0x7f58980095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.063+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860642350 0 0) 0x7f5898009e50 con 0x7f5898009110 2024-09-13T10:31:16.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.063+0000 7f58b57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.063+0000 7f58b57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.063+0000 7f58b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.063+0000 7f58b57fa640 10 monclient(hunting): my global_id is 4766 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.063+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58980065c0 con 0x7f5898009110 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2691182267 0 0) 0x7f58980065c0 con 0x7f5898009110 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5898009e50 con 0x7f5898009110 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58a4003d40 con 0x7f5898009110 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 10 monclient: dump: 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.074 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1872657250 0 0) 0x7f5898009e50 con 0x7f5898009110 2024-09-13T10:31:16.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f589800c3a0 con 0x7f5898009110 2024-09-13T10:31:16.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 396600991) 0x7f58a4006b20 con 0x7f5898009110 2024-09-13T10:31:16.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:16.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:16.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.195:6791/0 conn(0x7f5898009110 legacy=0x7f58980095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58b57fa640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.195:6791/0 conn(0x7f5898009110 legacy=0x7f58980095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:16.076 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:16.076 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:16.076 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:16.076 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 90492, 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:16.077 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:16.078 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:16.079 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:16.080 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:16.081 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:16.084 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.085 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:16.087 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.088 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.090 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:16.091 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.092 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:16.093 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.094 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:16.095 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:16.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.095 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:16.095 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:16.095 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:16.095 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.095 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.095 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:16.095 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:16.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58bf0f7640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.195:6800/1839191919 conn(0x7f589c03fdb0 legacy=0x7f589c042270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58bf0f7640 10 monclient: shutdown 2024-09-13T10:31:16.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58bf0f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:16.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58bf0f7640 1 -- 172.21.15.181:0/1464351680 >> v1:172.21.15.181:6790/0 conn(0x7f58b80a8340 legacy=0x7f58b812f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58bd694640 1 -- 172.21.15.181:0/1464351680 reap_dead start 2024-09-13T10:31:16.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58bd694640 1 -- 172.21.15.181:0/1464351680 reap_dead start 2024-09-13T10:31:16.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.064+0000 7f58bf0f7640 1 -- 172.21.15.181:0/1464351680 shutdown_connections 2024-09-13T10:31:16.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.065+0000 7f58bf0f7640 1 -- 172.21.15.181:0/1464351680 >> 172.21.15.181:0/1464351680 conn(0x7f58b80a6640 msgr2=0x7f58b80a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:16.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.065+0000 7f58bf0f7640 1 -- 172.21.15.181:0/1464351680 shutdown_connections 2024-09-13T10:31:16.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.065+0000 7f58bf0f7640 1 -- 172.21.15.181:0/1464351680 wait complete. 2024-09-13T10:31:16.097 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:16.097 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:31:16.098 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:31:16.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.195+0000 7f5031631640 10 monclient: get_monmap_and_config 2024-09-13T10:31:16.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.195+0000 7f5031631640 10 monclient: build_initial_monmap 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.195+0000 7f5031631640 10 monclient: monmap: 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:16.195888+0000 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:16.195888+0000 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:16.197 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:16.198 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:16.198 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:16.198 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:16.198 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.195+0000 7f5031631640 1 Processor -- start 2024-09-13T10:31:16.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.195+0000 7f5031631640 1 -- start start 2024-09-13T10:31:16.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.195+0000 7f5031631640 10 monclient: init 2024-09-13T10:31:16.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.196+0000 7f5031631640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:16.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.196+0000 7f5031631640 10 monclient: _add_conns ranks=[2,7,1,0,5,8,4,6,3] 2024-09-13T10:31:16.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.196+0000 7f5031631640 10 monclient(hunting): picked mon.noname-b con 0x7f502c0a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:16.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.196+0000 7f5031631640 10 monclient(hunting): picked mon.noname-i con 0x7f502c0a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:16.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.196+0000 7f5031631640 10 monclient(hunting): picked mon.noname-f con 0x7f502c13f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:16.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.196+0000 7f5031631640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502c0a5fe0 con 0x7f502c13f9a0 2024-09-13T10:31:16.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.196+0000 7f5031631640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502c0a8080 con 0x7f502c0a66d0 2024-09-13T10:31:16.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.196+0000 7f5031631640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502c0a42c0 con 0x7f502c0a6ab0 2024-09-13T10:31:16.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.196+0000 7f5031631640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:16.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.196+0000 7f5031631640 10 monclient(hunting): authenticate will time out at 815.701458s 2024-09-13T10:31:16.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.196+0000 7f502affd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f502c0a66d0 0x7f502c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:60044/0 (socket says 172.21.15.181:60044) 2024-09-13T10:31:16.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.196+0000 7f502affd640 1 -- 172.21.15.181:0/2842015318 learned_addr learned my addr 172.21.15.181:0/2842015318 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:16.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.198+0000 7f502affd640 1 -- 172.21.15.181:0/2842015318 >> v1:172.21.15.181:6790/0 conn(0x7f502c0a66d0 legacy=0x7f502c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.198+0000 7f5029ffb640 1 -- 172.21.15.181:0/2842015318 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382935473 0 0) 0x7f502c0a8080 con 0x7f502c0a66d0 2024-09-13T10:31:16.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.198+0000 7f5029ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.198+0000 7f5029ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.198+0000 7f5029ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.198+0000 7f5029ffb640 10 monclient(hunting): my global_id is 64154 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.198+0000 7f5029ffb640 1 -- 172.21.15.181:0/2842015318 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5018003520 con 0x7f502c0a66d0 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.198+0000 7f502b7fe640 1 -- 172.21.15.181:0/2842015318 >> v1:172.21.15.195:6789/0 conn(0x7f502c13f9a0 legacy=0x7f502c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.198+0000 7f502a7fc640 1 -- 172.21.15.181:0/2842015318 >> v1:172.21.15.195:6792/0 conn(0x7f502c0a6ab0 legacy=0x7f502c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 1 -- 172.21.15.181:0/2842015318 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 656172275 0 0) 0x7f5018003520 con 0x7f502c0a66d0 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 1 -- 172.21.15.181:0/2842015318 >> v1:172.21.15.195:6792/0 conn(0x7f502c0a6ab0 legacy=0x7f502c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 1 -- 172.21.15.181:0/2842015318 >> v1:172.21.15.195:6789/0 conn(0x7f502c13f9a0 legacy=0x7f502c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 1 monclient: found mon.noname-b 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:16.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:31:16.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 1 -- 172.21.15.181:0/2842015318 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c1464e0 con 0x7f502c0a66d0 2024-09-13T10:31:16.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:16.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:16.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:16.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 1 -- 172.21.15.181:0/2842015318 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5024001ae0 con 0x7f502c0a66d0 2024-09-13T10:31:16.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5031631640 5 monclient: authenticate success, global_id 64154 2024-09-13T10:31:16.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5031631640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:16.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:16.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:16.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 10 monclient: dump: 2024-09-13T10:31:16.206 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.206 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.206 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.206 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.206 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.206 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5031631640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 1 -- 172.21.15.181:0/2842015318 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50240048a0 con 0x7f502c0a66d0 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5031631640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:16.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 1 -- 172.21.15.181:0/2842015318 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5024004e10 con 0x7f502c0a66d0 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5031631640 4 set_mon_vals no callback set 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5029ffb640 10 monclient: dump: 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.208 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5031631640 10 monclient: shutdown 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5031631640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5031631640 1 -- 172.21.15.181:0/2842015318 >> v1:172.21.15.181:6790/0 conn(0x7f502c0a66d0 legacy=0x7f502c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5031631640 1 -- 172.21.15.181:0/2842015318 shutdown_connections 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5031631640 1 -- 172.21.15.181:0/2842015318 >> 172.21.15.181:0/2842015318 conn(0x7f502c0abcd0 msgr2=0x7f502c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5031631640 1 -- 172.21.15.181:0/2842015318 shutdown_connections 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.199+0000 7f5031631640 1 -- 172.21.15.181:0/2842015318 wait complete. 2024-09-13T10:31:16.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.200+0000 7f5031631640 10 monclient: build_initial_monmap 2024-09-13T10:31:16.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.200+0000 7f5031631640 10 monclient: monmap: 2024-09-13T10:31:16.210 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:16.210 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:16.210 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:16.210 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:16.210 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:16.210 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:16.210 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:16.210 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:16.210 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:16.210 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.200+0000 7f5031631640 1 Processor -- start 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.200+0000 7f5031631640 1 -- start start 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.200+0000 7f5031631640 10 monclient: init 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.201+0000 7f5031631640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.201+0000 7f5031631640 10 monclient: _add_conns ranks=[1,2,0,7,8,5,3,4,6] 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.201+0000 7f5031631640 10 monclient(hunting): picked mon.noname-f con 0x7f502c0a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:16.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.201+0000 7f5031631640 10 monclient(hunting): picked mon.noname-b con 0x7f502c0a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:16.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.201+0000 7f5031631640 10 monclient(hunting): picked mon.noname-a con 0x7f502c13f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:16.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.201+0000 7f5031631640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502c13ef90 con 0x7f502c13f9a0 2024-09-13T10:31:16.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.201+0000 7f5031631640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502c13f270 con 0x7f502c0a66d0 2024-09-13T10:31:16.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.201+0000 7f5031631640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502c0a28c0 con 0x7f502c0a6ab0 2024-09-13T10:31:16.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.201+0000 7f5031631640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:16.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.201+0000 7f5031631640 10 monclient(hunting): authenticate will time out at 815.706335s 2024-09-13T10:31:16.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.201+0000 7f502a7fc640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f502c0a6ab0 0x7f502c1d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:60058/0 (socket says 172.21.15.181:60058) 2024-09-13T10:31:16.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.201+0000 7f502a7fc640 1 -- 172.21.15.181:0/2138393865 learned_addr learned my addr 172.21.15.181:0/2138393865 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:16.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f502b7fe640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.181:6789/0 conn(0x7f502c13f9a0 legacy=0x7f502c1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f502a7fc640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.181:6790/0 conn(0x7f502c0a6ab0 legacy=0x7f502c1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f502affd640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.195:6789/0 conn(0x7f502c0a66d0 legacy=0x7f502c1ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3009754548 0 0) 0x7f502c0a28c0 con 0x7f502c0a6ab0 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): my global_id is 64163 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f500c003520 con 0x7f502c0a6ab0 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188876164 0 0) 0x7f502c13ef90 con 0x7f502c13f9a0 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): my global_id is 54612 2024-09-13T10:31:16.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f502c0a28c0 con 0x7f502c13f9a0 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3609834432 0 0) 0x7f502c13f270 con 0x7f502c0a66d0 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): my global_id is 54757 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f502c13ef90 con 0x7f502c0a66d0 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4200555795 0 0) 0x7f500c003520 con 0x7f502c0a6ab0 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f502c13f270 con 0x7f502c0a6ab0 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5014003610 con 0x7f502c0a6ab0 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.203+0000 7f50237fe640 10 monclient(hunting): dump: 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.219 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.220 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1886085009 0 0) 0x7f502c0a28c0 con 0x7f502c13f9a0 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f500c003520 con 0x7f502c13f9a0 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f501c001f80 con 0x7f502c13f9a0 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient(hunting): dump: 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.221 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1268702353 0 0) 0x7f502c13ef90 con 0x7f502c0a66d0 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f502c0a28c0 con 0x7f502c0a66d0 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5024004d90 con 0x7f502c0a66d0 2024-09-13T10:31:16.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient(hunting): dump: 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.223 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 297653436 0 0) 0x7f502c13f270 con 0x7f502c0a6ab0 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.195:6789/0 conn(0x7f502c0a66d0 legacy=0x7f502c1ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.181:6789/0 conn(0x7f502c13f9a0 legacy=0x7f502c1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient: _finish_hunting 0 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 monclient: found mon.b 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c13cf10 con 0x7f502c0a6ab0 2024-09-13T10:31:16.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient: _finish_auth 0 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient: _check_auth_tickets 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f5031631640 5 monclient: authenticate success, global_id 64163 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f5031631640 10 monclient: _renew_subs 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f5031631640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f5031631640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f502c13e9d0 con 0x7f502c0a6ab0 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f5031631640 10 monclient: _renew_subs 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f5031631640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f5031631640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f502c137600 con 0x7f502c0a6ab0 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5014003b00 con 0x7f502c0a6ab0 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5014004030 con 0x7f502c0a6ab0 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:16.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50297fa640 4 set_mon_vals no callback set 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.204+0000 7f50237fe640 10 monclient: dump: 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.226 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.205+0000 7f5031631640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.205+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f50140041d0 con 0x7f502c0a6ab0 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.205+0000 7f5031631640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50100065c0 con 0x7f5010002860 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.205+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(45..45 src has 1..45) ==== 3506+0+0 (unknown 1595584932 0 0) 0x7f501404e160 con 0x7f502c0a6ab0 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.205+0000 7f502b7fe640 10 monclient: get_auth_request con 0x7f500c040530 auth_method 0 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f502affd640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.195:6792/0 conn(0x7f5010002860 legacy=0x7f5010004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2423492626 0 0) 0x7f50100065c0 con 0x7f5010002860 2024-09-13T10:31:16.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f50237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f50237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f50237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f50237fe640 10 monclient(hunting): my global_id is 54700 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f502c13f270 con 0x7f5010002860 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2417682498 0 0) 0x7f502c13f270 con 0x7f5010002860 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50100065c0 con 0x7f5010002860 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5024001580 con 0x7f5010002860 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f50237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f50237fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.207+0000 7f50237fe640 10 monclient: dump: 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.228 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.208+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1497763853 0 0) 0x7f50100065c0 con 0x7f5010002860 2024-09-13T10:31:16.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.208+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f501000a160 con 0x7f5010002860 2024-09-13T10:31:16.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.208+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f50240048a0 con 0x7f5010002860 2024-09-13T10:31:16.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.208+0000 7f50237fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:16.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.208+0000 7f50237fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:16.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.208+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.195:6792/0 conn(0x7f5010002860 legacy=0x7f5010004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.208+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.195:6792/0 conn(0x7f5010002860 legacy=0x7f5010004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:16.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.214+0000 7f5031631640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:16.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.214+0000 7f5031631640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5010009e70 con 0x7f5010009130 2024-09-13T10:31:16.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f502affd640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.195:6792/0 conn(0x7f5010009130 legacy=0x7f50100095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957616522 0 0) 0x7f5010009e70 con 0x7f5010009130 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 10 monclient(hunting): my global_id is 54709 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50100065c0 con 0x7f5010009130 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3906855657 0 0) 0x7f50100065c0 con 0x7f5010009130 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5010009e70 con 0x7f5010009130 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5024005a50 con 0x7f5010009130 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 10 monclient: dump: 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.232 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2136306328 0 0) 0x7f5010009e70 con 0x7f5010009130 2024-09-13T10:31:16.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f501000c410 con 0x7f5010009130 2024-09-13T10:31:16.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7725 (unknown 0 0 3756993759) 0x7f5024006f20 con 0x7f5010009130 2024-09-13T10:31:16.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:16.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:16.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.195:6792/0 conn(0x7f5010009130 legacy=0x7f50100095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.217+0000 7f50237fe640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.195:6792/0 conn(0x7f5010009130 legacy=0x7f50100095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:16.234 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 90637, 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:16.235 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:16.236 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:16.237 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:16.238 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:16.239 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.241 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.242 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.244 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:16.245 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.246 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.248 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:16.249 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:16.251 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:16.252 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:16.253 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:16.254 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:16.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:16.254 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:16.254 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.218+0000 7f5031631640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.195:6800/1839191919 conn(0x7f500c040530 legacy=0x7f500c0429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.218+0000 7f5031631640 10 monclient: shutdown 2024-09-13T10:31:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.218+0000 7f5031631640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.218+0000 7f5031631640 1 -- 172.21.15.181:0/2138393865 >> v1:172.21.15.181:6790/0 conn(0x7f502c0a6ab0 legacy=0x7f502c1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.218+0000 7f502b7fe640 1 -- 172.21.15.181:0/2138393865 reap_dead start 2024-09-13T10:31:16.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.218+0000 7f502b7fe640 1 -- 172.21.15.181:0/2138393865 reap_dead start 2024-09-13T10:31:16.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.218+0000 7f5031631640 1 -- 172.21.15.181:0/2138393865 shutdown_connections 2024-09-13T10:31:16.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.218+0000 7f5031631640 1 -- 172.21.15.181:0/2138393865 >> 172.21.15.181:0/2138393865 conn(0x7f502c0abcd0 msgr2=0x7f502c0a3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:16.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.218+0000 7f5031631640 1 -- 172.21.15.181:0/2138393865 shutdown_connections 2024-09-13T10:31:16.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.218+0000 7f5031631640 1 -- 172.21.15.181:0/2138393865 wait complete. 2024-09-13T10:31:16.256 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:16.256 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T10:31:16.256 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T10:31:16.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.351+0000 7f08beeef640 10 monclient: get_monmap_and_config 2024-09-13T10:31:16.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.351+0000 7f08beeef640 10 monclient: build_initial_monmap 2024-09-13T10:31:16.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.351+0000 7f08beeef640 10 monclient: monmap: 2024-09-13T10:31:16.353 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:16.353 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.353 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:16.352092+0000 2024-09-13T10:31:16.353 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:16.352092+0000 2024-09-13T10:31:16.353 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:16.353 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.353 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:16.353 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:16.353 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:16.354 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:16.354 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:16.354 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:16.354 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:16.354 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:16.354 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:16.354 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 1 Processor -- start 2024-09-13T10:31:16.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 1 -- start start 2024-09-13T10:31:16.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 10 monclient: init 2024-09-13T10:31:16.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:16.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 10 monclient: _add_conns ranks=[3,5,1,0,2,6,4,8,7] 2024-09-13T10:31:16.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 10 monclient(hunting): picked mon.noname-g con 0x7f08b80a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:16.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 10 monclient(hunting): picked mon.noname-h con 0x7f08b80a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:16.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 10 monclient(hunting): picked mon.noname-f con 0x7f08b813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:16.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b80a4bc0 con 0x7f08b813f750 2024-09-13T10:31:16.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b813a320 con 0x7f08b80a6640 2024-09-13T10:31:16.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b80a8100 con 0x7f08b80a8340 2024-09-13T10:31:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.352+0000 7f08beeef640 10 monclient(hunting): authenticate will time out at 815.857791s 2024-09-13T10:31:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.353+0000 7f08bd48c640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f08b813f750 0x7f08b8141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:49234/0 (socket says 172.21.15.181:49234) 2024-09-13T10:31:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.353+0000 7f08bcc8b640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f08b80a6640 0x7f08b8139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:42216/0 (socket says 172.21.15.181:42216) 2024-09-13T10:31:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.353+0000 7f08bd48c640 1 -- 172.21.15.181:0/3448964482 learned_addr learned my addr 172.21.15.181:0/3448964482 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.353+0000 7f08affff640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f08b80a8340 0x7f08b8139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:52250/0 (socket says 172.21.15.181:52250) 2024-09-13T10:31:16.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08bcc8b640 1 -- 172.21.15.181:0/3448964482 >> v1:172.21.15.195:6790/0 conn(0x7f08b80a6640 legacy=0x7f08b8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08affff640 1 -- 172.21.15.181:0/3448964482 >> v1:172.21.15.195:6791/0 conn(0x7f08b80a8340 legacy=0x7f08b8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08bd48c640 1 -- 172.21.15.181:0/3448964482 >> v1:172.21.15.195:6789/0 conn(0x7f08b813f750 legacy=0x7f08b8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 145206404 0 0) 0x7f08b813a320 con 0x7f08b80a6640 2024-09-13T10:31:16.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient(hunting): my global_id is 4719 2024-09-13T10:31:16.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08a0003520 con 0x7f08b80a6640 2024-09-13T10:31:16.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2309261857 0 0) 0x7f08b80a8100 con 0x7f08b80a8340 2024-09-13T10:31:16.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient(hunting): my global_id is 4775 2024-09-13T10:31:16.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b813a320 con 0x7f08b80a8340 2024-09-13T10:31:16.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258612564 0 0) 0x7f08b80a4bc0 con 0x7f08b813f750 2024-09-13T10:31:16.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient(hunting): my global_id is 54766 2024-09-13T10:31:16.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b80a8100 con 0x7f08b813f750 2024-09-13T10:31:16.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3591506344 0 0) 0x7f08a0003520 con 0x7f08b80a6640 2024-09-13T10:31:16.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 >> v1:172.21.15.195:6791/0 conn(0x7f08b80a8340 legacy=0x7f08b8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 >> v1:172.21.15.195:6789/0 conn(0x7f08b813f750 legacy=0x7f08b8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:31:16.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 monclient: found mon.noname-g 2024-09-13T10:31:16.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:16.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:31:16.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b80a48e0 con 0x7f08b80a6640 2024-09-13T10:31:16.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient: _finish_auth 0 2024-09-13T10:31:16.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:31:16.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:16.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08b4001ba0 con 0x7f08b80a6640 2024-09-13T10:31:16.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08beeef640 5 monclient: authenticate success, global_id 4719 2024-09-13T10:31:16.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08beeef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:16.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:16.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:31:16.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient: dump: 2024-09-13T10:31:16.368 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.368 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.369 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.369 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.369 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.369 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.369 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.369 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.369 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.369 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.369 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.369 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.369 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.369 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08beeef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f08b40047e0 con 0x7f08b80a6640 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08af7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08beeef640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08beeef640 4 set_mon_vals no callback set 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.355+0000 7f08bcc8b640 1 --1- 172.21.15.181:0/3448964482 >> v1:172.21.15.195:6790/0 conn(0x7f08b80a6640 0x7f08b8139500 :-1 s=OPENED pgs=130 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f08b4004d50 mon_map magic: 0 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.356+0000 7f08beeef640 10 monclient: shutdown 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.356+0000 7f08beeef640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.356+0000 7f08beeef640 1 -- 172.21.15.181:0/3448964482 >> v1:172.21.15.195:6790/0 conn(0x7f08b80a6640 legacy=0x7f08b8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.356+0000 7f08af7fe640 1 -- 172.21.15.181:0/3448964482 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08b4004d50 con 0x7f08b80a6640 2024-09-13T10:31:16.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.356+0000 7f08af7fe640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:31:16.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.356+0000 7f08beeef640 1 -- 172.21.15.181:0/3448964482 shutdown_connections 2024-09-13T10:31:16.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.356+0000 7f08beeef640 1 -- 172.21.15.181:0/3448964482 >> 172.21.15.181:0/3448964482 conn(0x7f08b8077170 msgr2=0x7f08b80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:16.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.356+0000 7f08beeef640 1 -- 172.21.15.181:0/3448964482 shutdown_connections 2024-09-13T10:31:16.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.356+0000 7f08beeef640 1 -- 172.21.15.181:0/3448964482 wait complete. 2024-09-13T10:31:16.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.356+0000 7f08beeef640 10 monclient: build_initial_monmap 2024-09-13T10:31:16.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.356+0000 7f08beeef640 10 monclient: monmap: 2024-09-13T10:31:16.371 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:16.371 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:16.371 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:16.371 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:16.371 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:16.371 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:16.372 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:16.372 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:16.372 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:16.372 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:16.372 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:16.372 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:16.372 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:16.372 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:16.373 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:16.373 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 1 Processor -- start 2024-09-13T10:31:16.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 1 -- start start 2024-09-13T10:31:16.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 10 monclient: init 2024-09-13T10:31:16.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:16.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 10 monclient: _add_conns ranks=[6,2,4,1,3,0,8,7,5] 2024-09-13T10:31:16.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 10 monclient(hunting): picked mon.noname-d con 0x7f08b80a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:16.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 10 monclient(hunting): picked mon.noname-b con 0x7f08b813f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:16.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 10 monclient(hunting): picked mon.noname-c con 0x7f08b8142760 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:16.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b813d220 con 0x7f08b813f750 2024-09-13T10:31:16.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b80aa270 con 0x7f08b8142760 2024-09-13T10:31:16.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b813a510 con 0x7f08b80a8340 2024-09-13T10:31:16.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:16.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.357+0000 7f08beeef640 10 monclient(hunting): authenticate will time out at 815.862942s 2024-09-13T10:31:16.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.358+0000 7f08affff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f08b813f750 0x7f08b81d38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:60068/0 (socket says 172.21.15.181:60068) 2024-09-13T10:31:16.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.358+0000 7f08bcc8b640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f08b80a8340 0x7f08b812c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44344/0 (socket says 172.21.15.181:44344) 2024-09-13T10:31:16.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.358+0000 7f08affff640 1 -- 172.21.15.181:0/1274686197 learned_addr learned my addr 172.21.15.181:0/1274686197 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:16.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08bd48c640 1 -- 172.21.15.181:0/1274686197 >> v1:172.21.15.181:6791/0 conn(0x7f08b8142760 legacy=0x7f08b81d6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08bcc8b640 1 -- 172.21.15.181:0/1274686197 >> v1:172.21.15.181:6792/0 conn(0x7f08b80a8340 legacy=0x7f08b812c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08affff640 1 -- 172.21.15.181:0/1274686197 >> v1:172.21.15.181:6790/0 conn(0x7f08b813f750 legacy=0x7f08b81d38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:16.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891706121 0 0) 0x7f08b813a510 con 0x7f08b80a8340 2024-09-13T10:31:16.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): my global_id is 4722 2024-09-13T10:31:16.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08a4003550 con 0x7f08b80a8340 2024-09-13T10:31:16.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2601986249 0 0) 0x7f08b80aa270 con 0x7f08b8142760 2024-09-13T10:31:16.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): my global_id is 4756 2024-09-13T10:31:16.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b813a510 con 0x7f08b8142760 2024-09-13T10:31:16.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 979759733 0 0) 0x7f08b813a320 con 0x7f08b813f750 2024-09-13T10:31:16.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:31:16.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:16.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:16.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): my global_id is 64172 2024-09-13T10:31:16.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b80aa270 con 0x7f08b813f750 2024-09-13T10:31:16.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 245907930 0 0) 0x7f08b813a510 con 0x7f08b8142760 2024-09-13T10:31:16.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08b813a320 con 0x7f08b8142760 2024-09-13T10:31:16.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08b0001e90 con 0x7f08b8142760 2024-09-13T10:31:16.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:16.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:31:16.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): dump: 2024-09-13T10:31:16.376 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.377 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.377 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.377 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.377 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.377 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.377 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.377 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.377 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.377 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.377 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.377 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.377 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.378 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.378 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.378 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:16.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3835525676 0 0) 0x7f08a4003550 con 0x7f08b80a8340 2024-09-13T10:31:16.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08b813a510 con 0x7f08b80a8340 2024-09-13T10:31:16.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1855138246 0 0) 0x7f08b80aa270 con 0x7f08b813f750 2024-09-13T10:31:16.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08a4003550 con 0x7f08b813f750 2024-09-13T10:31:16.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08b4001ba0 con 0x7f08b80a8340 2024-09-13T10:31:16.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:16.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:16.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): dump: 2024-09-13T10:31:16.379 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.379 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.379 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.379 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.379 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.379 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.379 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.379 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.379 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.379 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.380 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.380 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.380 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.380 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.380 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.380 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08a8001cb0 con 0x7f08b813f750 2024-09-13T10:31:16.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:16.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:16.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient(hunting): dump: 2024-09-13T10:31:16.380 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.381 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.381 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.381 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.381 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.381 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.381 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.381 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.381 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.381 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.381 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.381 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.381 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.382 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.382 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.382 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3173787821 0 0) 0x7f08b813a320 con 0x7f08b8142760 2024-09-13T10:31:16.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 >> v1:172.21.15.181:6792/0 conn(0x7f08b80a8340 legacy=0x7f08b812c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 >> v1:172.21.15.181:6790/0 conn(0x7f08b813f750 legacy=0x7f08b81d38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:31:16.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 monclient: found mon.c 2024-09-13T10:31:16.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:16.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:16.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b813c2a0 con 0x7f08b8142760 2024-09-13T10:31:16.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient: _finish_auth 0 2024-09-13T10:31:16.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:31:16.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:16.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08beeef640 5 monclient: authenticate success, global_id 4756 2024-09-13T10:31:16.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08beeef640 10 monclient: _renew_subs 2024-09-13T10:31:16.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08beeef640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:16.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.360+0000 7f08beeef640 1 -- 172.21.15.181:0/1274686197 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f08b813b100 con 0x7f08b8142760 2024-09-13T10:31:16.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08beeef640 10 monclient: _renew_subs 2024-09-13T10:31:16.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08beeef640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:16.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08beeef640 1 -- 172.21.15.181:0/1274686197 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f08b812cde0 con 0x7f08b8142760 2024-09-13T10:31:16.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f08b0002090 con 0x7f08b8142760 2024-09-13T10:31:16.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08ad7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:16.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08b0005150 con 0x7f08b8142760 2024-09-13T10:31:16.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:16.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08aeffd640 4 set_mon_vals no callback set 2024-09-13T10:31:16.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08ad7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:16.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08ad7fa640 10 monclient: dump: 2024-09-13T10:31:16.384 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:16.384 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:16.384 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.384 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:16.385 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:16.385 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:16.385 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:16.385 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:16.385 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:16.385 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:16.385 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:16.385 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:16.385 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:16.385 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:16.385 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:16.385 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:16.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08beeef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:16.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f08b00052f0 con 0x7f08b8142760 2024-09-13T10:31:16.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08beeef640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:16.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08beeef640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:16.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.361+0000 7f08beeef640 1 -- 172.21.15.181:0/1274686197 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0898005080 con 0x7f08b8142760 2024-09-13T10:31:16.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.362+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(45..45 src has 1..45) ==== 3506+0+0 (unknown 1595584932 0 0) 0x7f08b004e270 con 0x7f08b8142760 2024-09-13T10:31:16.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.362+0000 7f08bcc8b640 10 monclient: get_auth_request con 0x7f08a40404b0 auth_method 0 2024-09-13T10:31:16.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.365+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f08b00177c0 con 0x7f08b8142760 2024-09-13T10:31:16.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.365+0000 7f08ad7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:16.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.365+0000 7f08ad7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:16.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.612+0000 7f08beeef640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-13T10:31:16.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.612+0000 7f08beeef640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-13T10:31:16.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.612+0000 7f08beeef640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:16.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.612+0000 7f08beeef640 1 -- 172.21.15.181:0/1274686197 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f0898005c40 con 0x7f08b8142760 2024-09-13T10:31:16.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.614+0000 7f08ad7fa640 1 -- 172.21.15.181:0/1274686197 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f08b001b930 con 0x7f08b8142760 2024-09-13T10:31:16.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.614+0000 7f08ad7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-13T10:31:16.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.614+0000 7f08ad7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:16.621 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.621 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=11,logm=63} crc {auth=3269397257,config=2586702516,health=265506500,kv=3759619045,logm=1333483254}) 2024-09-13T10:31:16.621 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=13,config=2,health=11,kv=12,logm=62} crc {auth=2995826662,config=2586702516,health=2601537531,kv=3467323233,logm=3105700658}) 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=11,logm=63} crc {auth=3269397257,config=2586702516,health=265506500,kv=3759619045,logm=1333483254}) 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,config=2,health=12,kv=12,logm=61} crc {auth=2995826662,config=2586702516,health=3959530857,kv=3467323233,logm=3044484298}) 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=11,logm=63} crc {auth=3269397257,config=2586702516,health=265506500,kv=3759619045,logm=1333483254}) 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=10,config=2,health=11,kv=9,logm=68} crc {auth=3155839765,config=2586702516,health=4241309380,kv=4092454958,logm=3375262064}) 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=11,logm=63} crc {auth=3269397257,config=2586702516,health=265506500,kv=3759619045,logm=1333483254}) 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=12,config=2,health=12,kv=11,logm=63} crc {auth=1787624866,config=2586702516,health=3959530857,kv=3226510214,logm=1966093185}) 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=11,logm=63} crc {auth=3269397257,config=2586702516,health=265506500,kv=3759619045,logm=1333483254}) 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=1133809143,config=2586702516,health=3959530857,kv=3467323233,logm=3681857603}) 2024-09-13T10:31:16.622 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=11,logm=63} crc {auth=3269397257,config=2586702516,health=265506500,kv=3759619045,logm=1333483254}) 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=12,config=2,health=11,kv=12,logm=63} crc {auth=3494723931,config=2586702516,health=4241309380,kv=3467323233,logm=3873350896}) 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=11,logm=63} crc {auth=3269397257,config=2586702516,health=265506500,kv=3759619045,logm=1333483254}) 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=12,config=2,health=10,kv=12,logm=64} crc {auth=1044374040,config=2586702516,health=2882855776,kv=3467323233,logm=2642701569}) 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=11,logm=63} crc {auth=3269397257,config=2586702516,health=265506500,kv=3759619045,logm=1333483254}) 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.615+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=3431924611,config=2586702516,health=3959530857,kv=3467323233,logm=249463546}) 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1221884688}) 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=404307776}) 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1221884688}) 2024-09-13T10:31:16.623 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1764876157}) 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1221884688}) 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=383880856}) 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1221884688}) 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=130646533}) 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1221884688}) 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=628643560}) 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1221884688}) 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2123088975}) 2024-09-13T10:31:16.624 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.625 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1221884688}) 2024-09-13T10:31:16.625 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1595891600}) 2024-09-13T10:31:16.625 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.625 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1221884688}) 2024-09-13T10:31:16.625 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.616+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3729553009}) 2024-09-13T10:31:16.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.617+0000 7f08beeef640 1 -- 172.21.15.181:0/1274686197 >> v1:172.21.15.195:6800/1839191919 conn(0x7f08a40404b0 legacy=0x7f08a4042970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.617+0000 7f08beeef640 10 monclient: shutdown 2024-09-13T10:31:16.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.617+0000 7f08beeef640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:16.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.617+0000 7f08beeef640 1 -- 172.21.15.181:0/1274686197 >> v1:172.21.15.181:6791/0 conn(0x7f08b8142760 legacy=0x7f08b81d6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:16.626 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.626 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=329532282}) 2024-09-13T10:31:16.626 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=655228327}) 2024-09-13T10:31:16.626 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.626 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=329532282}) 2024-09-13T10:31:16.626 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2792143886}) 2024-09-13T10:31:16.626 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.627 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=329532282}) 2024-09-13T10:31:16.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f08beeef640 1 -- 172.21.15.181:0/1274686197 shutdown_connections 2024-09-13T10:31:16.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f08beeef640 1 -- 172.21.15.181:0/1274686197 >> 172.21.15.181:0/1274686197 conn(0x7f08b80a6640 msgr2=0x7f08b80a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:16.627 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3377886763}) 2024-09-13T10:31:16.627 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.627 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=329532282}) 2024-09-13T10:31:16.628 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2452925726}) 2024-09-13T10:31:16.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f08beeef640 1 -- 172.21.15.181:0/1274686197 shutdown_connections 2024-09-13T10:31:16.628 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.628 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=329532282}) 2024-09-13T10:31:16.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f08beeef640 1 -- 172.21.15.181:0/1274686197 wait complete. 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=343059016}) 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=329532282}) 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2234734799}) 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=329532282}) 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3260207462}) 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=329532282}) 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.618+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1129578798}) 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447037898}) 2024-09-13T10:31:16.637 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=576795690}) 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447037898}) 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1388341669}) 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447037898}) 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2708529561}) 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447037898}) 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1303597069}) 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447037898}) 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3003891475}) 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.638 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447037898}) 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=781585879}) 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447037898}) 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1948845769}) 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447037898}) 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.619+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3582164983}) 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668783764}) 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3092207158}) 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668783764}) 2024-09-13T10:31:16.639 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2156540923}) 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668783764}) 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1023849565}) 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668783764}) 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3802014610}) 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668783764}) 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3972135842}) 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668783764}) 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1791242888}) 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.640 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668783764}) 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2556692360}) 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1668783764}) 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.620+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3539929265}) 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=78,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=1} crc {logm=2655909133,mdsmap=1499304043,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1499266754,mon_config_key=3445763272}) 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=75,mdsmap=2,mgr=7,mgr_metadata=1,mgrstat=9,mon_config_key=6} crc {logm=596267284,mdsmap=3140514009,mgr=2043909638,mgr_metadata=1537866486,mgrstat=1743432158,mon_config_key=3198266901}) 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=78,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=1} crc {logm=2655909133,mdsmap=1499304043,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1499266754,mon_config_key=3445763272}) 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=79,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8} crc {logm=456901596,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3255793467}) 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=78,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=1} crc {logm=2655909133,mdsmap=1499304043,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1499266754,mon_config_key=3445763272}) 2024-09-13T10:31:16.641 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=78,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=9,mon_config_key=1} crc {logm=2992745966,mdsmap=3798851762,mgr=2286455831,mgr_command_descs=3192186153,mgrstat=1743432158,mon_config_key=3445763272}) 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=78,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=1} crc {logm=2655909133,mdsmap=1499304043,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1499266754,mon_config_key=3445763272}) 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=72,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7} crc {logm=2734630524,mdsmap=2874252693,mgr=1389828352,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1743432158,mon_config_key=1518384171}) 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=78,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=1} crc {logm=2655909133,mdsmap=1499304043,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1499266754,mon_config_key=3445763272}) 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=76,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=5} crc {logm=3527776765,mdsmap=2874252693,mgr=1942657901,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2187642268,mon_config_key=3760588917}) 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=78,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=1} crc {logm=2655909133,mdsmap=1499304043,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1499266754,mon_config_key=3445763272}) 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=73,mdsmap=2,mgr=7,mgr_metadata=1,mgrstat=8,mon_config_key=9} crc {logm=82408029,mdsmap=3985170090,mgr=1609905495,mgr_metadata=1537866486,mgrstat=4012983475,mon_config_key=3615435938}) 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=78,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=1} crc {logm=2655909133,mdsmap=1499304043,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1499266754,mon_config_key=3445763272}) 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=79,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9} crc {logm=3914754345,mdsmap=3798851762,mgr=1609905495,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1743432158}) 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.642 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=78,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=1} crc {logm=2655909133,mdsmap=1499304043,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1499266754,mon_config_key=3445763272}) 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.622+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=79,mdsmap=2,mgr=8,mgr_metadata=1,mgrstat=9,mon_config_key=1} crc {logm=3786048975,mdsmap=3985170090,mgr=2286455831,mgr_metadata=1537866486,mgrstat=1743432158,mon_config_key=3445763272}) 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=70} crc {mon_config_key=1611992856,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323047,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=2911133446}) 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=69} crc {mon_config_key=4109270437,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=818692909}) 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=70} crc {mon_config_key=1611992856,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323047,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=2911133446}) 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=1837532891,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2008106561,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=4203586552}) 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=70} crc {mon_config_key=1611992856,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323047,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=2911133446}) 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=3408551105,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=625630549}) 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=70} crc {mon_config_key=1611992856,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323047,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=2911133446}) 2024-09-13T10:31:16.643 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {mon_config_key=16,monmap=2,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=4109270437,monmap=2232244610,nvmeofgw=598337686,osd_metadata=4136060328,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=3059121567}) 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=70} crc {mon_config_key=1611992856,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323047,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=2911133446}) 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=69} crc {mon_config_key=4109270437,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=1618799255}) 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=70} crc {mon_config_key=1611992856,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323047,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=2911133446}) 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=70} crc {mon_config_key=4109270437,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3239952952,osd_snap=3823785925,osdmap=1888740382}) 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=70} crc {mon_config_key=1611992856,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323047,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=2911133446}) 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=70} crc {mon_config_key=1907536307,monmap=2763160955,nvmeofgw=598337686,osd_metadata=3276613974,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=800890451}) 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=70} crc {mon_config_key=1611992856,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323047,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=2911133446}) 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.623+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=70} crc {mon_config_key=698619738,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3239952952,osd_snap=4133920409,osdmap=1305776035}) 2024-09-13T10:31:16.644 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=12} crc {osdmap=2698478632}) 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=12} crc {osdmap=555972012}) 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=12} crc {osdmap=2698478632}) 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=12} crc {osdmap=2929848121}) 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=12} crc {osdmap=2698478632}) 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=9} crc {osdmap=1917403585}) 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=12} crc {osdmap=2698478632}) 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=11} crc {osdmap=411343726}) 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=12} crc {osdmap=2698478632}) 2024-09-13T10:31:16.645 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=10} crc {osdmap=3742069641}) 2024-09-13T10:31:16.646 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:31:16.646 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=12} crc {osdmap=2698478632}) 2024-09-13T10:31:16.646 INFO:tasks.ceph.mon.a.smithi181.stderr:2024-09-13T10:31:16.625+0000 7f4b2c1af640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=10} crc {osdmap=2947120680}) 2024-09-13T10:31:16.646 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-13T10:31:17.647 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:31:17.648 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:31:17.702 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36185]: starting. 2024-09-13T10:31:17.703 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36185]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36184 2024-09-13T10:31:17.703 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36185]: created object 0... 2024-09-13T10:31:17.703 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36185]: created object 25... 2024-09-13T10:31:17.703 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36185]: created object 49... 2024-09-13T10:31:17.703 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36185]: finishing. 2024-09-13T10:31:17.703 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36185]: shutting down. 2024-09-13T10:31:17.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.748+0000 7fc26b356640 10 monclient: get_monmap_and_config 2024-09-13T10:31:17.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.748+0000 7fc26b356640 10 monclient: build_initial_monmap 2024-09-13T10:31:17.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.749+0000 7fc26b356640 10 monclient: monmap: 2024-09-13T10:31:17.751 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:17.750616+0000 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:17.750616+0000 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:17.752 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:17.753 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:17.753 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:17.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.749+0000 7fc26b356640 1 Processor -- start 2024-09-13T10:31:17.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.749+0000 7fc26b356640 1 -- start start 2024-09-13T10:31:17.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.749+0000 7fc26b356640 10 monclient: init 2024-09-13T10:31:17.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc26b356640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:17.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc26b356640 10 monclient: _add_conns ranks=[7,1,3,8,0,5,2,4,6] 2024-09-13T10:31:17.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc26b356640 10 monclient(hunting): picked mon.noname-i con 0x7fc2640a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:17.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc26b356640 10 monclient(hunting): picked mon.noname-f con 0x7fc2640a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:17.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc26b356640 10 monclient(hunting): picked mon.noname-g con 0x7fc26413f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:17.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc26b356640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2640a4bc0 con 0x7fc2640a8340 2024-09-13T10:31:17.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc26b356640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc26413a320 con 0x7fc26413f750 2024-09-13T10:31:17.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc26b356640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2640a8100 con 0x7fc2640a6640 2024-09-13T10:31:17.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc26b356640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:17.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc26b356640 10 monclient(hunting): authenticate will time out at 817.256463s 2024-09-13T10:31:17.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc2688f1640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fc2640a8340 0x7fc264139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:49240/0 (socket says 172.21.15.181:49240) 2024-09-13T10:31:17.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc2688f1640 1 -- 172.21.15.181:0/4219952543 learned_addr learned my addr 172.21.15.181:0/4219952543 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:17.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.750+0000 7fc2690f2640 1 --1- 172.21.15.181:0/4219952543 >> v1:172.21.15.195:6792/0 conn(0x7fc2640a6640 0x7fc264139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:43766/0 (socket says 172.21.15.181:43766) 2024-09-13T10:31:17.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc2698f3640 1 -- 172.21.15.181:0/4219952543 >> v1:172.21.15.195:6790/0 conn(0x7fc26413f750 legacy=0x7fc264141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc2690f2640 1 -- 172.21.15.181:0/4219952543 >> v1:172.21.15.195:6792/0 conn(0x7fc2640a6640 legacy=0x7fc264139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc2688f1640 1 -- 172.21.15.181:0/4219952543 >> v1:172.21.15.195:6789/0 conn(0x7fc2640a8340 legacy=0x7fc264139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714780912 0 0) 0x7fc26413a320 con 0x7fc26413f750 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient(hunting): my global_id is 4728 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc250003520 con 0x7fc26413f750 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1028143038 0 0) 0x7fc2640a8100 con 0x7fc2640a6640 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:17.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient(hunting): my global_id is 54718 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc26413a320 con 0x7fc2640a6640 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297923913 0 0) 0x7fc2640a4bc0 con 0x7fc2640a8340 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient(hunting): my global_id is 54775 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2640a8100 con 0x7fc2640a8340 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2018848825 0 0) 0x7fc250003520 con 0x7fc26413f750 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 >> v1:172.21.15.195:6792/0 conn(0x7fc2640a6640 legacy=0x7fc264139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 >> v1:172.21.15.195:6789/0 conn(0x7fc2640a8340 legacy=0x7fc264139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 monclient: found mon.noname-g 2024-09-13T10:31:17.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2640a48e0 con 0x7fc26413f750 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient: _finish_auth 0 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc25c001bf0 con 0x7fc26413f750 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient: dump: 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:17.761 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc26b356640 5 monclient: authenticate success, global_id 4728 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc26b356640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:17.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc25c003610 con 0x7fc26413f750 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 1 -- 172.21.15.181:0/4219952543 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc25c003b80 con 0x7fc26413f750 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc26b356640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc26b356640 4 set_mon_vals no callback set 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.753+0000 7fc25bfff640 10 monclient: dump: 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:17.763 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.754+0000 7fc26b356640 10 monclient: shutdown 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.754+0000 7fc26b356640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.754+0000 7fc26b356640 1 -- 172.21.15.181:0/4219952543 >> v1:172.21.15.195:6790/0 conn(0x7fc26413f750 legacy=0x7fc264141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:17.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.754+0000 7fc26b356640 1 -- 172.21.15.181:0/4219952543 shutdown_connections 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.754+0000 7fc26b356640 1 -- 172.21.15.181:0/4219952543 >> 172.21.15.181:0/4219952543 conn(0x7fc264077170 msgr2=0x7fc2640abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.754+0000 7fc26b356640 1 -- 172.21.15.181:0/4219952543 shutdown_connections 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.754+0000 7fc26b356640 1 -- 172.21.15.181:0/4219952543 wait complete. 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.754+0000 7fc26b356640 10 monclient: build_initial_monmap 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.754+0000 7fc26b356640 10 monclient: monmap: 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:17.765 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 1 Processor -- start 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 1 -- start start 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 10 monclient: init 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 10 monclient: _add_conns ranks=[0,4,1,2,6,7,5,8,3] 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 10 monclient(hunting): picked mon.noname-a con 0x7fc2640a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:17.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 10 monclient(hunting): picked mon.noname-c con 0x7fc26413f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:17.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 10 monclient(hunting): picked mon.noname-f con 0x7fc2641426e0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:17.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc26413b030 con 0x7fc2640a8340 2024-09-13T10:31:17.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2640a9db0 con 0x7fc2641426e0 2024-09-13T10:31:17.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc26413c830 con 0x7fc26413f750 2024-09-13T10:31:17.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:17.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc26b356640 10 monclient(hunting): authenticate will time out at 817.261623s 2024-09-13T10:31:17.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc2690f2640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc2640a8340 0x7fc26412c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:58688/0 (socket says 172.21.15.181:58688) 2024-09-13T10:31:17.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc2690f2640 1 -- 172.21.15.181:0/3461802817 learned_addr learned my addr 172.21.15.181:0/3461802817 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:17.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.755+0000 7fc2688f1640 1 --1- 172.21.15.181:0/3461802817 >> v1:172.21.15.181:6791/0 conn(0x7fc26413f750 0x7fc2641d3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:39158/0 (socket says 172.21.15.181:39158) 2024-09-13T10:31:17.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.757+0000 7fc2688f1640 1 -- 172.21.15.181:0/3461802817 >> v1:172.21.15.181:6791/0 conn(0x7fc26413f750 legacy=0x7fc2641d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:17.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.757+0000 7fc2690f2640 1 -- 172.21.15.181:0/3461802817 >> v1:172.21.15.181:6789/0 conn(0x7fc2640a8340 legacy=0x7fc26412c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:17.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.757+0000 7fc2698f3640 1 -- 172.21.15.181:0/3461802817 >> v1:172.21.15.195:6789/0 conn(0x7fc2641426e0 legacy=0x7fc2641d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:17.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.757+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730408348 0 0) 0x7fc26413c830 con 0x7fc26413f750 2024-09-13T10:31:17.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.757+0000 7fc259ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:17.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.757+0000 7fc259ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:17.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.757+0000 7fc259ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:17.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.757+0000 7fc259ffb640 10 monclient(hunting): my global_id is 4765 2024-09-13T10:31:17.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.757+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc248003550 con 0x7fc26413f750 2024-09-13T10:31:17.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690096588 0 0) 0x7fc26413b030 con 0x7fc2640a8340 2024-09-13T10:31:17.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:17.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): my global_id is 54621 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc26413c830 con 0x7fc2640a8340 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4015928180 0 0) 0x7fc2640a9db0 con 0x7fc2641426e0 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): my global_id is 54784 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc26413b030 con 0x7fc2641426e0 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 593496627 0 0) 0x7fc248003550 con 0x7fc26413f750 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2640a9db0 con 0x7fc26413f750 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc254001cb0 con 0x7fc26413f750 2024-09-13T10:31:17.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:17.773 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1339520537 0 0) 0x7fc26413c830 con 0x7fc2640a8340 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc248003550 con 0x7fc2640a8340 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc260004b60 con 0x7fc2640a8340 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:17.774 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:17.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1023197515 0 0) 0x7fc26413b030 con 0x7fc2641426e0 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc26413c830 con 0x7fc2641426e0 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2039440415 0 0) 0x7fc2640a9db0 con 0x7fc26413f750 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 >> v1:172.21.15.195:6789/0 conn(0x7fc2641426e0 legacy=0x7fc2641d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 >> v1:172.21.15.181:6789/0 conn(0x7fc2640a8340 legacy=0x7fc26412c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 monclient: found mon.c 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26413bf90 con 0x7fc26413f750 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc26b356640 5 monclient: authenticate success, global_id 4765 2024-09-13T10:31:17.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc26b356640 10 monclient: _renew_subs 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc26b356640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc26b356640 1 -- 172.21.15.181:0/3461802817 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc26413d210 con 0x7fc26413f750 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc254004a90 con 0x7fc26413f750 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc254004fc0 con 0x7fc26413f750 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc259ffb640 10 monclient: dump: 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:17.777 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc26b356640 10 monclient: _renew_subs 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc26b356640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc26b356640 1 -- 172.21.15.181:0/3461802817 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc26412cdb0 con 0x7fc26413f750 2024-09-13T10:31:17.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.758+0000 7fc25b7fe640 4 set_mon_vals no callback set 2024-09-13T10:31:17.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.759+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fc254005160 con 0x7fc26413f750 2024-09-13T10:31:17.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.759+0000 7fc26b356640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:17.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.759+0000 7fc26b356640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:17.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.759+0000 7fc26b356640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:17.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.759+0000 7fc26b356640 1 -- 172.21.15.181:0/3461802817 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2640ac9b0 con 0x7fc26413f750 2024-09-13T10:31:17.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.759+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(47..47 src has 1..47) ==== 3898+0+0 (unknown 1565529601 0 0) 0x7fc25404e230 con 0x7fc26413f750 2024-09-13T10:31:17.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.759+0000 7fc2690f2640 10 monclient: get_auth_request con 0x7fc2480403f0 auth_method 0 2024-09-13T10:31:17.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.764+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fc2640ac9b0 con 0x7fc26413f750 2024-09-13T10:31:17.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.764+0000 7fc259ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:17.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:17.764+0000 7fc259ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:18.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.010+0000 7fc26b356640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:31:18.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.010+0000 7fc26b356640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:31:18.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.010+0000 7fc26b356640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:18.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.010+0000 7fc26b356640 1 -- 172.21.15.181:0/3461802817 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc264142af0 con 0x7fc26413f750 2024-09-13T10:31:18.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.011+0000 7fc259ffb640 1 -- 172.21.15.181:0/3461802817 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 4214461699) 0x7fc254017600 con 0x7fc26413f750 2024-09-13T10:31:18.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.011+0000 7fc259ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:31:18.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.011+0000 7fc259ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:18.014 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":30,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:31:18.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.013+0000 7fc26b356640 1 -- 172.21.15.181:0/3461802817 >> v1:172.21.15.195:6800/1839191919 conn(0x7fc2480403f0 legacy=0x7fc2480428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.013+0000 7fc26b356640 10 monclient: shutdown 2024-09-13T10:31:18.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.013+0000 7fc26b356640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:18.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.013+0000 7fc26b356640 1 -- 172.21.15.181:0/3461802817 >> v1:172.21.15.181:6791/0 conn(0x7fc26413f750 legacy=0x7fc2641d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.013+0000 7fc26b356640 1 -- 172.21.15.181:0/3461802817 shutdown_connections 2024-09-13T10:31:18.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.013+0000 7fc26b356640 1 -- 172.21.15.181:0/3461802817 >> 172.21.15.181:0/3461802817 conn(0x7fc2640a6640 msgr2=0x7fc2640a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:18.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.013+0000 7fc26b356640 1 -- 172.21.15.181:0/3461802817 shutdown_connections 2024-09-13T10:31:18.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.013+0000 7fc26b356640 1 -- 172.21.15.181:0/3461802817 wait complete. 2024-09-13T10:31:18.026 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:31:18.026 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T10:31:18.026 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:31:18.026 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:31:18.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.122+0000 7fc3f46e6640 10 monclient: get_monmap_and_config 2024-09-13T10:31:18.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.122+0000 7fc3f46e6640 10 monclient: build_initial_monmap 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.122+0000 7fc3f46e6640 10 monclient: monmap: 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:18.123813+0000 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:18.123813+0000 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:18.125 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:18.126 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:18.126 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:18.126 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.122+0000 7fc3f46e6640 1 Processor -- start 2024-09-13T10:31:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.122+0000 7fc3f46e6640 1 -- start start 2024-09-13T10:31:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.122+0000 7fc3f46e6640 10 monclient: init 2024-09-13T10:31:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f46e6640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f46e6640 10 monclient: _add_conns ranks=[6,8,5,4,0,2,7,3,1] 2024-09-13T10:31:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f46e6640 10 monclient(hunting): picked mon.noname-d con 0x7fc3ec0a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f46e6640 10 monclient(hunting): picked mon.noname-e con 0x7fc3ec0a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f46e6640 10 monclient(hunting): picked mon.noname-h con 0x7fc3ec13f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f46e6640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec0a4bc0 con 0x7fc3ec13f750 2024-09-13T10:31:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f46e6640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec13a320 con 0x7fc3ec0a6640 2024-09-13T10:31:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f46e6640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec0a8100 con 0x7fc3ec0a8340 2024-09-13T10:31:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f46e6640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f46e6640 10 monclient(hunting): authenticate will time out at 817.629511s 2024-09-13T10:31:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f2482640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fc3ec0a6640 0x7fc3ec139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44354/0 (socket says 172.21.15.181:44354) 2024-09-13T10:31:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f2482640 1 -- 172.21.15.181:0/343891556 learned_addr learned my addr 172.21.15.181:0/343891556 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.123+0000 7fc3f1c81640 1 --1- 172.21.15.181:0/343891556 >> v1:172.21.15.181:6793/0 conn(0x7fc3ec0a8340 0x7fc3ec139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:38880/0 (socket says 172.21.15.181:38880) 2024-09-13T10:31:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f2482640 1 -- 172.21.15.181:0/343891556 >> v1:172.21.15.181:6792/0 conn(0x7fc3ec0a6640 legacy=0x7fc3ec139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1c81640 1 -- 172.21.15.181:0/343891556 >> v1:172.21.15.181:6793/0 conn(0x7fc3ec0a8340 legacy=0x7fc3ec139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1480640 1 -- 172.21.15.181:0/343891556 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371739293 0 0) 0x7fc3ec13a320 con 0x7fc3ec0a6640 2024-09-13T10:31:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1480640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1480640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1480640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1480640 10 monclient(hunting): my global_id is 4731 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1480640 1 -- 172.21.15.181:0/343891556 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d8003520 con 0x7fc3ec0a6640 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1480640 1 -- 172.21.15.181:0/343891556 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3237373554 0 0) 0x7fc3ec0a8100 con 0x7fc3ec0a8340 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1480640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1480640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1480640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1480640 10 monclient(hunting): my global_id is 4787 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f1480640 1 -- 172.21.15.181:0/343891556 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ec13a320 con 0x7fc3ec0a8340 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.125+0000 7fc3f2c83640 1 -- 172.21.15.181:0/343891556 >> v1:172.21.15.195:6791/0 conn(0x7fc3ec13f750 legacy=0x7fc3ec141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 1 -- 172.21.15.181:0/343891556 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3884664122 0 0) 0x7fc3d8003520 con 0x7fc3ec0a6640 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 1 -- 172.21.15.181:0/343891556 >> v1:172.21.15.181:6793/0 conn(0x7fc3ec0a8340 legacy=0x7fc3ec139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 1 -- 172.21.15.181:0/343891556 >> v1:172.21.15.195:6791/0 conn(0x7fc3ec13f750 legacy=0x7fc3ec141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 10 monclient: _finish_hunting 0 2024-09-13T10:31:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 1 monclient: found mon.noname-d 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 1 -- 172.21.15.181:0/343891556 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec0a48e0 con 0x7fc3ec0a6640 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 10 monclient: _finish_auth 0 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 10 monclient: _check_auth_tickets 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 1 -- 172.21.15.181:0/343891556 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3e0001ae0 con 0x7fc3ec0a6640 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f46e6640 5 monclient: authenticate success, global_id 4731 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f46e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 10 monclient: dump: 2024-09-13T10:31:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.135 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f46e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 1 -- 172.21.15.181:0/343891556 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3e00048a0 con 0x7fc3ec0a6640 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f46e6640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 1 -- 172.21.15.181:0/343891556 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3e0004e10 con 0x7fc3ec0a6640 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f46e6640 4 set_mon_vals no callback set 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f1480640 10 monclient: dump: 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.136 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f46e6640 10 monclient: shutdown 2024-09-13T10:31:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f46e6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f46e6640 1 -- 172.21.15.181:0/343891556 >> v1:172.21.15.181:6792/0 conn(0x7fc3ec0a6640 legacy=0x7fc3ec139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f46e6640 1 -- 172.21.15.181:0/343891556 shutdown_connections 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f46e6640 1 -- 172.21.15.181:0/343891556 >> 172.21.15.181:0/343891556 conn(0x7fc3ec077170 msgr2=0x7fc3ec0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f46e6640 1 -- 172.21.15.181:0/343891556 shutdown_connections 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.126+0000 7fc3f46e6640 1 -- 172.21.15.181:0/343891556 wait complete. 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.127+0000 7fc3f46e6640 10 monclient: build_initial_monmap 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.127+0000 7fc3f46e6640 10 monclient: monmap: 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.127+0000 7fc3f46e6640 1 Processor -- start 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.127+0000 7fc3f46e6640 1 -- start start 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.127+0000 7fc3f46e6640 10 monclient: init 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.128+0000 7fc3f46e6640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.128+0000 7fc3f46e6640 10 monclient: _add_conns ranks=[3,5,1,7,0,8,2,6,4] 2024-09-13T10:31:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.128+0000 7fc3f46e6640 10 monclient(hunting): picked mon.noname-g con 0x7fc3ec0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.128+0000 7fc3f46e6640 10 monclient(hunting): picked mon.noname-h con 0x7fc3ec13f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.128+0000 7fc3f46e6640 10 monclient(hunting): picked mon.noname-f con 0x7fc3ec09f6c0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.128+0000 7fc3f46e6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec0a0050 con 0x7fc3ec09f6c0 2024-09-13T10:31:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.128+0000 7fc3f46e6640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec1ce250 con 0x7fc3ec0a8340 2024-09-13T10:31:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.128+0000 7fc3f46e6640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec09eb60 con 0x7fc3ec13f750 2024-09-13T10:31:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.128+0000 7fc3f46e6640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.128+0000 7fc3f46e6640 10 monclient(hunting): authenticate will time out at 817.634311s 2024-09-13T10:31:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.128+0000 7fc3f2482640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7fc3ec0a8340 0x7fc3ec0a22f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:42238/0 (socket says 172.21.15.181:42238) 2024-09-13T10:31:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.128+0000 7fc3f2482640 1 -- 172.21.15.181:0/1368916640 learned_addr learned my addr 172.21.15.181:0/1368916640 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3f1c81640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.195:6791/0 conn(0x7fc3ec13f750 legacy=0x7fc3ec1d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3f2482640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.195:6790/0 conn(0x7fc3ec0a8340 legacy=0x7fc3ec0a22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3f2c83640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.195:6789/0 conn(0x7fc3ec09f6c0 legacy=0x7fc3ec1d6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 794571631 0 0) 0x7fc3ec09eb60 con 0x7fc3ec13f750 2024-09-13T10:31:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 10 monclient(hunting): my global_id is 4793 2024-09-13T10:31:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d0003520 con 0x7fc3ec13f750 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2027197543 0 0) 0x7fc3ec1ce250 con 0x7fc3ec0a8340 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 10 monclient(hunting): my global_id is 4737 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ec09eb60 con 0x7fc3ec0a8340 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545832329 0 0) 0x7fc3ec0a0050 con 0x7fc3ec09f6c0 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 10 monclient(hunting): my global_id is 54793 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ec1ce250 con 0x7fc3ec09f6c0 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.130+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1586364615 0 0) 0x7fc3d0003520 con 0x7fc3ec13f750 2024-09-13T10:31:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3ec0a0050 con 0x7fc3ec13f750 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3e80047e0 con 0x7fc3ec13f750 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient(hunting): dump: 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1184750594 0 0) 0x7fc3ec09eb60 con 0x7fc3ec0a8340 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3d0003520 con 0x7fc3ec0a8340 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3e0004d90 con 0x7fc3ec0a8340 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:31:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient(hunting): dump: 2024-09-13T10:31:18.150 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.150 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.150 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.150 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.150 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.150 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.150 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.150 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.150 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.150 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2305400834 0 0) 0x7fc3ec1ce250 con 0x7fc3ec09f6c0 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3ec09eb60 con 0x7fc3ec09f6c0 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3e4001f70 con 0x7fc3ec09f6c0 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient(hunting): dump: 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4021522422 0 0) 0x7fc3ec0a0050 con 0x7fc3ec13f750 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.195:6790/0 conn(0x7fc3ec0a8340 legacy=0x7fc3ec0a22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.195:6789/0 conn(0x7fc3ec09f6c0 legacy=0x7fc3ec1d6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient: _finish_hunting 0 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 monclient: found mon.h 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec0a0ec0 con 0x7fc3ec13f750 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient: _finish_auth 0 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient: _check_auth_tickets 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3f46e6640 5 monclient: authenticate success, global_id 4793 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3f46e6640 10 monclient: _renew_subs 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3f46e6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3f46e6640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ec0a0620 con 0x7fc3ec13f750 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3f46e6640 10 monclient: _renew_subs 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3f46e6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3f46e6640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3ec1cde90 con 0x7fc3ec13f750 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3e8004c30 con 0x7fc3ec13f750 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3e8005160 con 0x7fc3ec13f750 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3f0c7f640 4 set_mon_vals no callback set 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:31:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3deffd640 10 monclient: dump: 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.155 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3f46e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.131+0000 7fc3f46e6640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3d40065c0 con 0x7fc3d4002860 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.132+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fc3e8005380 con 0x7fc3ec13f750 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.132+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(47..47 src has 1..47) ==== 3898+0+0 (unknown 1565529601 0 0) 0x7fc3e804e480 con 0x7fc3ec13f750 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.132+0000 7fc3f2c83640 10 monclient: get_auth_request con 0x7fc3d0040510 auth_method 0 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3f2482640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.181:6789/0 conn(0x7fc3d4002860 legacy=0x7fc3d4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898401514 0 0) 0x7fc3d40065c0 con 0x7fc3d4002860 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 10 monclient(hunting): my global_id is 54630 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ec0a0050 con 0x7fc3d4002860 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 933532791 0 0) 0x7fc3ec0a0050 con 0x7fc3d4002860 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3d40065c0 con 0x7fc3d4002860 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3e0001d30 con 0x7fc3d4002860 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 10 monclient: dump: 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.157 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1042138185 0 0) 0x7fc3d40065c0 con 0x7fc3d4002860 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3d400a160 con 0x7fc3d4002860 2024-09-13T10:31:18.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc3e0005490 con 0x7fc3d4002860 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.181:6789/0 conn(0x7fc3d4002860 legacy=0x7fc3d4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.134+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.181:6789/0 conn(0x7fc3d4002860 legacy=0x7fc3d4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.140+0000 7fc3f46e6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.140+0000 7fc3f46e6640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3d4009e50 con 0x7fc3d4009110 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3f2482640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.181:6789/0 conn(0x7fc3d4009110 legacy=0x7fc3d40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326122656 0 0) 0x7fc3d4009e50 con 0x7fc3d4009110 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 10 monclient(hunting): my global_id is 54639 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d40065c0 con 0x7fc3d4009110 2024-09-13T10:31:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1050776628 0 0) 0x7fc3d40065c0 con 0x7fc3d4009110 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3d4009e50 con 0x7fc3d4009110 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3e0005b70 con 0x7fc3d4009110 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 10 monclient: dump: 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.160 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2831840697 0 0) 0x7fc3d4009e50 con 0x7fc3d4009110 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc3d400c3f0 con 0x7fc3d4009110 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7894 (unknown 0 0 4093951861) 0x7fc3e0005fe0 con 0x7fc3d4009110 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:18.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:18.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.181:6789/0 conn(0x7fc3d4009110 legacy=0x7fc3d40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.143+0000 7fc3deffd640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.181:6789/0 conn(0x7fc3d4009110 legacy=0x7fc3d40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:18.162 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:31:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 92576, 2024-09-13T10:31:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.175 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:18.176 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.177 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.178 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:18.179 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:18.179 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.179 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.179 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.179 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:18.179 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.179 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.179 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.179 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:18.179 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:18.181 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.181 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.181 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:18.182 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.183 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:18.184 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.185 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.185 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:31:18.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.185 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.185 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.185 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:18.185 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.185 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.185 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:18.186 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:18.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.144+0000 7fc3f46e6640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.195:6800/1839191919 conn(0x7fc3d0040510 legacy=0x7fc3d00429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.144+0000 7fc3f46e6640 10 monclient: shutdown 2024-09-13T10:31:18.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.144+0000 7fc3f46e6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:18.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.144+0000 7fc3f46e6640 1 -- 172.21.15.181:0/1368916640 >> v1:172.21.15.195:6791/0 conn(0x7fc3ec13f750 legacy=0x7fc3ec1d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.144+0000 7fc3f2c83640 1 -- 172.21.15.181:0/1368916640 reap_dead start 2024-09-13T10:31:18.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.144+0000 7fc3f2c83640 1 -- 172.21.15.181:0/1368916640 reap_dead start 2024-09-13T10:31:18.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.144+0000 7fc3f46e6640 1 -- 172.21.15.181:0/1368916640 shutdown_connections 2024-09-13T10:31:18.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.144+0000 7fc3f46e6640 1 -- 172.21.15.181:0/1368916640 >> 172.21.15.181:0/1368916640 conn(0x7fc3ec0a6640 msgr2=0x7fc3ec0aa310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:18.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.144+0000 7fc3f46e6640 1 -- 172.21.15.181:0/1368916640 shutdown_connections 2024-09-13T10:31:18.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.144+0000 7fc3f46e6640 1 -- 172.21.15.181:0/1368916640 wait complete. 2024-09-13T10:31:18.188 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:18.188 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:31:18.188 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:31:18.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.283+0000 7f4b7d218640 10 monclient: get_monmap_and_config 2024-09-13T10:31:18.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.283+0000 7f4b7d218640 10 monclient: build_initial_monmap 2024-09-13T10:31:18.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.283+0000 7f4b7d218640 10 monclient: monmap: 2024-09-13T10:31:18.286 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:18.286 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.286 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:18.285048+0000 2024-09-13T10:31:18.286 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:18.285048+0000 2024-09-13T10:31:18.286 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:18.286 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.286 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:18.286 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:18.286 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:18.287 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:18.287 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:18.287 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:18.287 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:18.287 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:18.287 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:18.287 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.283+0000 7f4b7d218640 1 Processor -- start 2024-09-13T10:31:18.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7d218640 1 -- start start 2024-09-13T10:31:18.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7d218640 10 monclient: init 2024-09-13T10:31:18.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7d218640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:18.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7d218640 10 monclient: _add_conns ranks=[8,0,1,2,6,7,4,5,3] 2024-09-13T10:31:18.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7d218640 10 monclient(hunting): picked mon.noname-e con 0x7f4b780a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:18.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7d218640 10 monclient(hunting): picked mon.noname-a con 0x7f4b780a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:18.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7d218640 10 monclient(hunting): picked mon.noname-f con 0x7f4b7813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:18.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7d218640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b780a4bc0 con 0x7f4b780a8340 2024-09-13T10:31:18.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7d218640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b7813a320 con 0x7f4b7813f750 2024-09-13T10:31:18.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7d218640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b780a8100 con 0x7f4b780a6640 2024-09-13T10:31:18.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7d218640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:18.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7d218640 10 monclient(hunting): authenticate will time out at 817.790589s 2024-09-13T10:31:18.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b76d9d640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f4b780a6640 0x7f4b78139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:38884/0 (socket says 172.21.15.181:38884) 2024-09-13T10:31:18.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b7659c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4b780a8340 0x7f4b78139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:58714/0 (socket says 172.21.15.181:58714) 2024-09-13T10:31:18.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.284+0000 7f4b76d9d640 1 -- 172.21.15.181:0/2828217457 learned_addr learned my addr 172.21.15.181:0/2828217457 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:18.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.286+0000 7f4b7659c640 1 -- 172.21.15.181:0/2828217457 >> v1:172.21.15.181:6789/0 conn(0x7f4b780a8340 legacy=0x7f4b78139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.286+0000 7f4b76d9d640 1 -- 172.21.15.181:0/2828217457 >> v1:172.21.15.181:6793/0 conn(0x7f4b780a6640 legacy=0x7f4b78139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 1 -- 172.21.15.181:0/2828217457 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2510646598 0 0) 0x7f4b780a4bc0 con 0x7f4b780a8340 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient(hunting): my global_id is 54648 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 1 -- 172.21.15.181:0/2828217457 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b64003520 con 0x7f4b780a8340 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 1 -- 172.21.15.181:0/2828217457 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 527375991 0 0) 0x7f4b780a8100 con 0x7f4b780a6640 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient(hunting): my global_id is 4796 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 1 -- 172.21.15.181:0/2828217457 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b780a4bc0 con 0x7f4b780a6640 2024-09-13T10:31:18.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b7759e640 1 -- 172.21.15.181:0/2828217457 >> v1:172.21.15.195:6789/0 conn(0x7f4b7813f750 legacy=0x7f4b78141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 1 -- 172.21.15.181:0/2828217457 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1770159168 0 0) 0x7f4b64003520 con 0x7f4b780a8340 2024-09-13T10:31:18.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 1 -- 172.21.15.181:0/2828217457 >> v1:172.21.15.181:6793/0 conn(0x7f4b780a6640 legacy=0x7f4b78139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 1 -- 172.21.15.181:0/2828217457 >> v1:172.21.15.195:6789/0 conn(0x7f4b7813f750 legacy=0x7f4b78141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:31:18.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 1 monclient: found mon.noname-a 2024-09-13T10:31:18.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:18.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:31:18.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 1 -- 172.21.15.181:0/2828217457 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b780a48e0 con 0x7f4b780a8340 2024-09-13T10:31:18.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient: _finish_auth 0 2024-09-13T10:31:18.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:31:18.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:18.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 1 -- 172.21.15.181:0/2828217457 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b60001ae0 con 0x7f4b780a8340 2024-09-13T10:31:18.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:18.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient: dump: 2024-09-13T10:31:18.296 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.296 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.296 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.296 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.296 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.296 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.296 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.296 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.296 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b7d218640 5 monclient: authenticate success, global_id 54648 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b7d218640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 1 -- 172.21.15.181:0/2828217457 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b600047e0 con 0x7f4b780a8340 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 1 -- 172.21.15.181:0/2828217457 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b60004d50 con 0x7f4b780a8340 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b7d218640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b7d218640 4 set_mon_vals no callback set 2024-09-13T10:31:18.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b75d9b640 10 monclient: dump: 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b7d218640 10 monclient: shutdown 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b7d218640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b7d218640 1 -- 172.21.15.181:0/2828217457 >> v1:172.21.15.181:6789/0 conn(0x7f4b780a8340 legacy=0x7f4b78139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b7d218640 1 -- 172.21.15.181:0/2828217457 shutdown_connections 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b7d218640 1 -- 172.21.15.181:0/2828217457 >> 172.21.15.181:0/2828217457 conn(0x7f4b78077170 msgr2=0x7f4b780abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b7d218640 1 -- 172.21.15.181:0/2828217457 shutdown_connections 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.287+0000 7f4b7d218640 1 -- 172.21.15.181:0/2828217457 wait complete. 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.288+0000 7f4b7d218640 10 monclient: build_initial_monmap 2024-09-13T10:31:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.288+0000 7f4b7d218640 10 monclient: monmap: 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:18.300 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 1 Processor -- start 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 1 -- start start 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 10 monclient: init 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 10 monclient: _add_conns ranks=[7,1,6,5,3,8,4,0,2] 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 10 monclient(hunting): picked mon.noname-i con 0x7f4b780a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 10 monclient(hunting): picked mon.noname-f con 0x7f4b7813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 10 monclient(hunting): picked mon.noname-d con 0x7f4b781d4310 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b78134440 con 0x7f4b7813f750 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b78134720 con 0x7f4b781d4310 2024-09-13T10:31:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b78134a00 con 0x7f4b780a8340 2024-09-13T10:31:18.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:18.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7d218640 10 monclient(hunting): authenticate will time out at 817.795739s 2024-09-13T10:31:18.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7759e640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f4b781d4310 0x7f4b781d6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44368/0 (socket says 172.21.15.181:44368) 2024-09-13T10:31:18.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.289+0000 7f4b7759e640 1 -- 172.21.15.181:0/3221274223 learned_addr learned my addr 172.21.15.181:0/3221274223 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.291+0000 7f4b7759e640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6792/0 conn(0x7f4b781d4310 legacy=0x7f4b781d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b7659c640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.195:6789/0 conn(0x7f4b7813f750 legacy=0x7f4b7813c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b76d9d640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.195:6792/0 conn(0x7f4b780a8340 legacy=0x7f4b7813bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667105807 0 0) 0x7f4b78134720 con 0x7f4b781d4310 2024-09-13T10:31:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): my global_id is 4740 2024-09-13T10:31:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b58003550 con 0x7f4b781d4310 2024-09-13T10:31:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3360851022 0 0) 0x7f4b78134440 con 0x7f4b7813f750 2024-09-13T10:31:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): my global_id is 54811 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b78134720 con 0x7f4b7813f750 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317780599 0 0) 0x7f4b78134a00 con 0x7f4b780a8340 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): my global_id is 54727 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b78134440 con 0x7f4b780a8340 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 252302434 0 0) 0x7f4b58003550 con 0x7f4b781d4310 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b78134a00 con 0x7f4b781d4310 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b70003990 con 0x7f4b781d4310 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): dump: 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.309 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 753545887 0 0) 0x7f4b78134720 con 0x7f4b7813f750 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b58003550 con 0x7f4b7813f750 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b60004cd0 con 0x7f4b7813f750 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient(hunting): dump: 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.310 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3492450391 0 0) 0x7f4b78134a00 con 0x7f4b781d4310 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.195:6792/0 conn(0x7f4b780a8340 legacy=0x7f4b7813bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.195:6789/0 conn(0x7f4b7813f750 legacy=0x7f4b7813c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 monclient: found mon.d 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b78135170 con 0x7f4b781d4310 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b7d218640 5 monclient: authenticate success, global_id 4740 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b7d218640 10 monclient: _renew_subs 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b7d218640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:31:18.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b7d218640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4b7813e3f0 con 0x7f4b781d4310 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b7d218640 10 monclient: _renew_subs 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b7d218640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b7d218640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f4b7813d780 con 0x7f4b781d4310 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b70003e60 con 0x7f4b781d4310 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b70004390 con 0x7f4b781d4310 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b7559a640 4 set_mon_vals no callback set 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.292+0000 7f4b6f7fe640 10 monclient: dump: 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.313 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.293+0000 7f4b7d218640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.293+0000 7f4b7d218640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4b5c0065c0 con 0x7f4b5c002860 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.293+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4b70004660 con 0x7f4b781d4310 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.293+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(47..47 src has 1..47) ==== 3898+0+0 (unknown 1565529601 0 0) 0x7f4b7004e730 con 0x7f4b781d4310 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.293+0000 7f4b7659c640 10 monclient: get_auth_request con 0x7f4b58040210 auth_method 0 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b76d9d640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b5c002860 legacy=0x7f4b5c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680971987 0 0) 0x7f4b5c0065c0 con 0x7f4b5c002860 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b6f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b6f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b6f7fe640 10 monclient(hunting): my global_id is 64181 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b78134a00 con 0x7f4b5c002860 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b76d9d640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b5c002860 legacy=0x7f4b5c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b76d9d640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b5c002860 legacy=0x7f4b5c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b76d9d640 1 --1- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b5c002860 0x7f4b5c004d00 :-1 s=OPENED pgs=95 cs=1 l=1).handle_message read tag failed 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b76d9d640 1 --1- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b5c002860 0x7f4b5c004d00 :-1 s=OPENED pgs=95 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b5c002860 legacy=0x7f4b5c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b5c002860 legacy=0x7f4b5c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.295+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4b5c0065c0 con 0x7f4b58047400 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.298+0000 7f4b76d9d640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b58047400 legacy=0x7f4b58047810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1956832491 0 0) 0x7f4b5c0065c0 con 0x7f4b58047400 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 10 monclient(hunting): my global_id is 64190 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b78134440 con 0x7f4b58047400 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2186760404 0 0) 0x7f4b78134440 con 0x7f4b58047400 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b5c0065c0 con 0x7f4b58047400 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b68004ea0 con 0x7f4b58047400 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 10 monclient: dump: 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.317 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4023511414 0 0) 0x7f4b5c0065c0 con 0x7f4b58047400 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b68001d30 con 0x7f4b58047400 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4b68007220 con 0x7f4b58047400 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:18.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:18.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b58047400 legacy=0x7f4b58047810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.300+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b58047400 legacy=0x7f4b58047810 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:18.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.306+0000 7f4b7d218640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:18.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.306+0000 7f4b7d218640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4b5c009d80 con 0x7f4b5c009140 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b76d9d640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b5c009140 legacy=0x7f4b5c009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382141375 0 0) 0x7f4b5c009d80 con 0x7f4b5c009140 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 10 monclient(hunting): my global_id is 64199 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b5c0065c0 con 0x7f4b5c009140 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2607164706 0 0) 0x7f4b5c0065c0 con 0x7f4b5c009140 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b5c009d80 con 0x7f4b5c009140 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b680058e0 con 0x7f4b5c009140 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:18.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 10 monclient: dump: 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.322 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.323 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.323 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.323 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1790578575 0 0) 0x7f4b5c009d80 con 0x7f4b5c009140 2024-09-13T10:31:18.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4b5c00c350 con 0x7f4b5c009140 2024-09-13T10:31:18.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7557 (unknown 0 0 16407887) 0x7f4b6800a190 con 0x7f4b5c009140 2024-09-13T10:31:18.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:18.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:18.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b5c009140 legacy=0x7f4b5c009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b6f7fe640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6790/0 conn(0x7f4b5c009140 legacy=0x7f4b5c009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:18.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.309+0000 7f4b7759e640 1 -- 172.21.15.181:0/3221274223 reap_dead start 2024-09-13T10:31:18.324 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:18.324 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:18.324 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:18.324 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:18.324 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:18.324 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 4214, 2024-09-13T10:31:18.324 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:18.324 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:18.324 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:18.324 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:18.324 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:18.324 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.325 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.326 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:18.327 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:18.328 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.329 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.331 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:18.331 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:18.331 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.331 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.331 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.331 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:18.331 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:18.331 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.331 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:18.333 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:18.334 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:18.335 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.336 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.338 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.339 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:18.340 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.341 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:18.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.344 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:18.344 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.310+0000 7f4b7d218640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4b58040210 legacy=0x7f4b580426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.310+0000 7f4b7d218640 10 monclient: shutdown 2024-09-13T10:31:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.310+0000 7f4b7d218640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.310+0000 7f4b7d218640 1 -- 172.21.15.181:0/3221274223 >> v1:172.21.15.181:6792/0 conn(0x7f4b781d4310 legacy=0x7f4b781d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.310+0000 7f4b7d218640 1 -- 172.21.15.181:0/3221274223 shutdown_connections 2024-09-13T10:31:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.310+0000 7f4b7d218640 1 -- 172.21.15.181:0/3221274223 >> 172.21.15.181:0/3221274223 conn(0x7f4b780a6640 msgr2=0x7f4b780a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.310+0000 7f4b7d218640 1 -- 172.21.15.181:0/3221274223 shutdown_connections 2024-09-13T10:31:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.310+0000 7f4b7d218640 1 -- 172.21.15.181:0/3221274223 wait complete. 2024-09-13T10:31:18.346 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:18.346 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:31:18.346 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:31:18.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.441+0000 7f89acea2640 10 monclient: get_monmap_and_config 2024-09-13T10:31:18.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.441+0000 7f89acea2640 10 monclient: build_initial_monmap 2024-09-13T10:31:18.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.441+0000 7f89acea2640 10 monclient: monmap: 2024-09-13T10:31:18.444 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:18.444 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:18.443558+0000 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:18.443558+0000 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:18.445 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.442+0000 7f89acea2640 1 Processor -- start 2024-09-13T10:31:18.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.442+0000 7f89acea2640 1 -- start start 2024-09-13T10:31:18.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.442+0000 7f89acea2640 10 monclient: init 2024-09-13T10:31:18.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.443+0000 7f89acea2640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:18.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.443+0000 7f89acea2640 10 monclient: _add_conns ranks=[8,7,4,2,5,1,6,0,3] 2024-09-13T10:31:18.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.443+0000 7f89acea2640 10 monclient(hunting): picked mon.noname-e con 0x7f89a80a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:18.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.443+0000 7f89acea2640 10 monclient(hunting): picked mon.noname-i con 0x7f89a80a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:18.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.443+0000 7f89acea2640 10 monclient(hunting): picked mon.noname-c con 0x7f89a813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:18.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.443+0000 7f89acea2640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a80a4bc0 con 0x7f89a813f750 2024-09-13T10:31:18.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.443+0000 7f89acea2640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a813a320 con 0x7f89a80a8340 2024-09-13T10:31:18.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.443+0000 7f89acea2640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a80a8100 con 0x7f89a80a6640 2024-09-13T10:31:18.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.443+0000 7f89acea2640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:18.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.443+0000 7f89acea2640 10 monclient(hunting): authenticate will time out at 817.949310s 2024-09-13T10:31:18.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.443+0000 7f89a659c640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f89a80a6640 0x7f89a8139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:38900/0 (socket says 172.21.15.181:38900) 2024-09-13T10:31:18.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.443+0000 7f89a659c640 1 -- 172.21.15.181:0/4272719719 learned_addr learned my addr 172.21.15.181:0/4272719719 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:18.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.445+0000 7f89a6d9d640 1 -- 172.21.15.181:0/4272719719 >> v1:172.21.15.181:6791/0 conn(0x7f89a813f750 legacy=0x7f89a8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.445+0000 7f89a659c640 1 -- 172.21.15.181:0/4272719719 >> v1:172.21.15.181:6793/0 conn(0x7f89a80a6640 legacy=0x7f89a8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.445+0000 7f89a5d9b640 1 -- 172.21.15.181:0/4272719719 >> v1:172.21.15.195:6792/0 conn(0x7f89a80a8340 legacy=0x7f89a8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.445+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 282373116 0 0) 0x7f89a80a4bc0 con 0x7f89a813f750 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient(hunting): my global_id is 4774 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8990003520 con 0x7f89a813f750 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 400864526 0 0) 0x7f89a80a8100 con 0x7f89a80a6640 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient(hunting): my global_id is 4805 2024-09-13T10:31:18.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a80a4bc0 con 0x7f89a80a6640 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185139282 0 0) 0x7f89a813a320 con 0x7f89a80a8340 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient(hunting): my global_id is 54736 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a80a8100 con 0x7f89a80a8340 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1640091323 0 0) 0x7f8990003520 con 0x7f89a813f750 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 >> v1:172.21.15.181:6793/0 conn(0x7f89a80a6640 legacy=0x7f89a8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 >> v1:172.21.15.195:6792/0 conn(0x7f89a80a8340 legacy=0x7f89a8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient: _finish_hunting 0 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 monclient: found mon.noname-c 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:18.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a80a48e0 con 0x7f89a813f750 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient: _finish_auth 0 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient: _check_auth_tickets 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8998001b30 con 0x7f89a813f750 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89acea2640 5 monclient: authenticate success, global_id 4774 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89acea2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient: dump: 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.454 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.455 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89acea2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:18.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8998003610 con 0x7f89a813f750 2024-09-13T10:31:18.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:18.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 1 -- 172.21.15.181:0/4272719719 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8998003b00 con 0x7f89a813f750 2024-09-13T10:31:18.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89acea2640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:18.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89acea2640 4 set_mon_vals no callback set 2024-09-13T10:31:18.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89a559a640 10 monclient: dump: 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.457 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89acea2640 10 monclient: shutdown 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89acea2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89acea2640 1 -- 172.21.15.181:0/4272719719 >> v1:172.21.15.181:6791/0 conn(0x7f89a813f750 legacy=0x7f89a8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89acea2640 1 -- 172.21.15.181:0/4272719719 shutdown_connections 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89acea2640 1 -- 172.21.15.181:0/4272719719 >> 172.21.15.181:0/4272719719 conn(0x7f89a8077170 msgr2=0x7f89a80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.446+0000 7f89acea2640 1 -- 172.21.15.181:0/4272719719 shutdown_connections 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.447+0000 7f89acea2640 1 -- 172.21.15.181:0/4272719719 wait complete. 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.447+0000 7f89acea2640 10 monclient: build_initial_monmap 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.447+0000 7f89acea2640 10 monclient: monmap: 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:18.458 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:18.459 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 1 Processor -- start 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 1 -- start start 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 10 monclient: init 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 10 monclient: _add_conns ranks=[3,4,5,1,6,7,0,2,8] 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 10 monclient(hunting): picked mon.noname-g con 0x7f89a80a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 10 monclient(hunting): picked mon.noname-c con 0x7f89a813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 10 monclient(hunting): picked mon.noname-h con 0x7f89a81d4520 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a80a1090 con 0x7f89a80a8340 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a80a1370 con 0x7f89a813f750 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a81cf0f0 con 0x7f89a81d4520 2024-09-13T10:31:18.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:18.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89acea2640 10 monclient(hunting): authenticate will time out at 817.954577s 2024-09-13T10:31:18.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89a5d9b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f89a813f750 0x7f89a81ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:39176/0 (socket says 172.21.15.181:39176) 2024-09-13T10:31:18.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.448+0000 7f89a5d9b640 1 -- 172.21.15.181:0/1888119719 learned_addr learned my addr 172.21.15.181:0/1888119719 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.450+0000 7f89a5d9b640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.181:6791/0 conn(0x7f89a813f750 legacy=0x7f89a81ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.450+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168030175 0 0) 0x7f89a80a1370 con 0x7f89a813f750 2024-09-13T10:31:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.450+0000 7f8996ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.450+0000 7f8996ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.450+0000 7f8996ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.450+0000 7f8996ffd640 10 monclient(hunting): my global_id is 4783 2024-09-13T10:31:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.450+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8988003550 con 0x7f89a813f750 2024-09-13T10:31:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.450+0000 7f89a6d9d640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.195:6791/0 conn(0x7f89a81d4520 legacy=0x7f89a81d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.450+0000 7f89a659c640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.195:6790/0 conn(0x7f89a80a8340 legacy=0x7f89a81ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1244181863 0 0) 0x7f8988003550 con 0x7f89a813f750 2024-09-13T10:31:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89a80a1370 con 0x7f89a813f750 2024-09-13T10:31:18.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f899c003990 con 0x7f89a813f750 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient(hunting): dump: 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.466 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3312486882 0 0) 0x7f89a81cf0f0 con 0x7f89a81d4520 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient(hunting): my global_id is 4802 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8988003550 con 0x7f89a81d4520 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2915043399 0 0) 0x7f89a80a1090 con 0x7f89a80a8340 2024-09-13T10:31:18.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient(hunting): my global_id is 4746 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a81cf0f0 con 0x7f89a80a8340 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1931122799 0 0) 0x7f89a80a1370 con 0x7f89a813f750 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.195:6791/0 conn(0x7f89a81d4520 legacy=0x7f89a81d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.195:6790/0 conn(0x7f89a80a8340 legacy=0x7f89a81ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 monclient: found mon.c 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a80a0500 con 0x7f89a813f750 2024-09-13T10:31:18.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient: _finish_auth 0 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f89acea2640 5 monclient: authenticate success, global_id 4783 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f89acea2640 10 monclient: _renew_subs 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f89acea2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f89acea2640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89a80a0db0 con 0x7f89a813f750 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f89acea2640 10 monclient: _renew_subs 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f89acea2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f89acea2640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f89a81d8030 con 0x7f89a813f750 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f899c003f90 con 0x7f89a813f750 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f899c004500 con 0x7f89a813f750 2024-09-13T10:31:18.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f89a4d99640 4 set_mon_vals no callback set 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.451+0000 7f8996ffd640 10 monclient: dump: 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.470 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.452+0000 7f89acea2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.452+0000 7f89acea2640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f898c0065c0 con 0x7f898c002860 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.452+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f899c0046a0 con 0x7f89a813f750 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.452+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(47..47 src has 1..47) ==== 3898+0+0 (unknown 1565529601 0 0) 0x7f899c04e870 con 0x7f89a813f750 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.452+0000 7f89a6d9d640 10 monclient: get_auth_request con 0x7f898803fdb0 auth_method 0 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f89a659c640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.181:6791/0 conn(0x7f898c002860 legacy=0x7f898c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 813286164 0 0) 0x7f898c0065c0 con 0x7f898c002860 2024-09-13T10:31:18.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 10 monclient(hunting): my global_id is 4792 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a80a1370 con 0x7f898c002860 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2945941023 0 0) 0x7f89a80a1370 con 0x7f898c002860 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f898c0065c0 con 0x7f898c002860 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89a00047e0 con 0x7f898c002860 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 10 monclient: dump: 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2841353522 0 0) 0x7f898c0065c0 con 0x7f898c002860 2024-09-13T10:31:18.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.454+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f898c00a160 con 0x7f898c002860 2024-09-13T10:31:18.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.455+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f89a00048d0 con 0x7f898c002860 2024-09-13T10:31:18.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.455+0000 7f8996ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:18.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.455+0000 7f8996ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:18.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.455+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.181:6791/0 conn(0x7f898c002860 legacy=0x7f898c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.455+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.181:6791/0 conn(0x7f898c002860 legacy=0x7f898c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:18.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.461+0000 7f89acea2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:18.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.461+0000 7f89acea2640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f898c009e50 con 0x7f898c009110 2024-09-13T10:31:18.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f89a659c640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.181:6791/0 conn(0x7f898c009110 legacy=0x7f898c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198586503 0 0) 0x7f898c009e50 con 0x7f898c009110 2024-09-13T10:31:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 10 monclient(hunting): my global_id is 4801 2024-09-13T10:31:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f898c0065c0 con 0x7f898c009110 2024-09-13T10:31:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1455837507 0 0) 0x7f898c0065c0 con 0x7f898c009110 2024-09-13T10:31:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f898c009e50 con 0x7f898c009110 2024-09-13T10:31:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89a0005180 con 0x7f898c009110 2024-09-13T10:31:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 10 monclient: dump: 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.478 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.478 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2485030204 0 0) 0x7f898c009e50 con 0x7f898c009110 2024-09-13T10:31:18.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.463+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f898c00c3f0 con 0x7f898c009110 2024-09-13T10:31:18.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7725 (unknown 0 0 152374573) 0x7f89a0007420 con 0x7f898c009110 2024-09-13T10:31:18.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f8996ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:18.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f8996ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:18.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.181:6791/0 conn(0x7f898c009110 legacy=0x7f898c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f8996ffd640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.181:6791/0 conn(0x7f898c009110 legacy=0x7f898c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:18.478 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:18.478 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:18.479 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:18.479 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:18.479 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:18.479 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 92914, 2024-09-13T10:31:18.479 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:18.479 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:18.479 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:18.479 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.480 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:18.481 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:18.482 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:18.483 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.484 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.485 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.486 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:18.487 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.488 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.490 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:18.490 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:18.490 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.490 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.490 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.491 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:18.491 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:18.491 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.491 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.491 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.491 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:18.491 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.491 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.491 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:18.494 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.495 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.496 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.497 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.498 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.499 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:18.499 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.499 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.499 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:18.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.499 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.499 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.499 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:31:18.499 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.499 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.500 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:18.500 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f89acea2640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.195:6800/1839191919 conn(0x7f898803fdb0 legacy=0x7f8988042270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f89acea2640 10 monclient: shutdown 2024-09-13T10:31:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f89acea2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:18.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f89acea2640 1 -- 172.21.15.181:0/1888119719 >> v1:172.21.15.181:6791/0 conn(0x7f89a813f750 legacy=0x7f89a81ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f89a6d9d640 1 -- 172.21.15.181:0/1888119719 reap_dead start 2024-09-13T10:31:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f89a6d9d640 1 -- 172.21.15.181:0/1888119719 reap_dead start 2024-09-13T10:31:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f89acea2640 1 -- 172.21.15.181:0/1888119719 shutdown_connections 2024-09-13T10:31:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f89acea2640 1 -- 172.21.15.181:0/1888119719 >> 172.21.15.181:0/1888119719 conn(0x7f89a80a6640 msgr2=0x7f89a813efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f89acea2640 1 -- 172.21.15.181:0/1888119719 shutdown_connections 2024-09-13T10:31:18.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.464+0000 7f89acea2640 1 -- 172.21.15.181:0/1888119719 wait complete. 2024-09-13T10:31:18.502 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:18.502 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:31:18.503 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:31:18.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.601+0000 7f5cf23e2640 10 monclient: get_monmap_and_config 2024-09-13T10:31:18.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.601+0000 7f5cf23e2640 10 monclient: build_initial_monmap 2024-09-13T10:31:18.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.601+0000 7f5cf23e2640 10 monclient: monmap: 2024-09-13T10:31:18.605 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:18.603046+0000 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:18.603046+0000 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:18.606 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:18.607 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:18.607 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.607 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36186]: starting. 2024-09-13T10:31:18.607 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36186]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36184 2024-09-13T10:31:18.607 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36186]: shutting down. 2024-09-13T10:31:18.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.602+0000 7f5cf23e2640 1 Processor -- start 2024-09-13T10:31:18.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.602+0000 7f5cf23e2640 1 -- start start 2024-09-13T10:31:18.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.602+0000 7f5cf23e2640 10 monclient: init 2024-09-13T10:31:18.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.602+0000 7f5cf23e2640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:18.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.602+0000 7f5cf23e2640 10 monclient: _add_conns ranks=[5,0,7,1,3,8,4,6,2] 2024-09-13T10:31:18.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.602+0000 7f5cf23e2640 10 monclient(hunting): picked mon.noname-h con 0x7f5cec0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:18.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.602+0000 7f5cf23e2640 10 monclient(hunting): picked mon.noname-a con 0x7f5cec0a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:18.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.603+0000 7f5cf23e2640 10 monclient(hunting): picked mon.noname-i con 0x7f5cec13f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:18.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.603+0000 7f5cf23e2640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cec0a5fe0 con 0x7f5cec0a6ab0 2024-09-13T10:31:18.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.603+0000 7f5cf23e2640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cec0a8080 con 0x7f5cec0a66d0 2024-09-13T10:31:18.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.603+0000 7f5cf23e2640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cec0a42c0 con 0x7f5cec13f9a0 2024-09-13T10:31:18.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.603+0000 7f5cf23e2640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:18.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.603+0000 7f5cf23e2640 10 monclient(hunting): authenticate will time out at 818.109072s 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.603+0000 7f5ceb7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5cec0a6ab0 0x7f5cec0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:58724/0 (socket says 172.21.15.181:58724) 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.603+0000 7f5ceb7fe640 1 -- 172.21.15.181:0/3265843654 learned_addr learned my addr 172.21.15.181:0/3265843654 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceb7fe640 1 -- 172.21.15.181:0/3265843654 >> v1:172.21.15.181:6789/0 conn(0x7f5cec0a6ab0 legacy=0x7f5cec0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 1 -- 172.21.15.181:0/3265843654 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401151297 0 0) 0x7f5cec0a5fe0 con 0x7f5cec0a6ab0 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient(hunting): my global_id is 54657 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 1 -- 172.21.15.181:0/3265843654 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cd4003520 con 0x7f5cec0a6ab0 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5cf097f640 1 -- 172.21.15.181:0/3265843654 >> v1:172.21.15.195:6792/0 conn(0x7f5cec13f9a0 legacy=0x7f5cec141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 1 -- 172.21.15.181:0/3265843654 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2703373745 0 0) 0x7f5cd4003520 con 0x7f5cec0a6ab0 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 1 -- 172.21.15.181:0/3265843654 >> v1:172.21.15.195:6792/0 conn(0x7f5cec13f9a0 legacy=0x7f5cec141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 1 -- 172.21.15.181:0/3265843654 >> v1:172.21.15.195:6791/0 conn(0x7f5cec0a66d0 legacy=0x7f5cec0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient: _finish_hunting 0 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 1 monclient: found mon.noname-a 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 1 -- 172.21.15.181:0/3265843654 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec1464e0 con 0x7f5cec0a6ab0 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient: _finish_auth 0 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient: _check_auth_tickets 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5cf23e2640 5 monclient: authenticate success, global_id 54657 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 1 -- 172.21.15.181:0/3265843654 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ce0001b90 con 0x7f5cec0a6ab0 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5cf23e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:18.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient: dump: 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.615 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5cf23e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 1 -- 172.21.15.181:0/3265843654 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ce00048a0 con 0x7f5cec0a6ab0 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5cf23e2640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5cf23e2640 4 set_mon_vals no callback set 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 1 -- 172.21.15.181:0/3265843654 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ce0004d90 con 0x7f5cec0a6ab0 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.605+0000 7f5ceaffd640 10 monclient: dump: 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.616 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.617 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.606+0000 7f5cf23e2640 10 monclient: shutdown 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.606+0000 7f5cf23e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.606+0000 7f5cf23e2640 1 -- 172.21.15.181:0/3265843654 >> v1:172.21.15.181:6789/0 conn(0x7f5cec0a6ab0 legacy=0x7f5cec0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.606+0000 7f5cf23e2640 1 -- 172.21.15.181:0/3265843654 shutdown_connections 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.606+0000 7f5cf23e2640 1 -- 172.21.15.181:0/3265843654 >> 172.21.15.181:0/3265843654 conn(0x7f5cec0abcd0 msgr2=0x7f5cec0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.606+0000 7f5cf23e2640 1 -- 172.21.15.181:0/3265843654 shutdown_connections 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.606+0000 7f5cf23e2640 1 -- 172.21.15.181:0/3265843654 wait complete. 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.607+0000 7f5cf23e2640 10 monclient: build_initial_monmap 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.607+0000 7f5cf23e2640 10 monclient: monmap: 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:18.618 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.607+0000 7f5cf23e2640 1 Processor -- start 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.607+0000 7f5cf23e2640 1 -- start start 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.607+0000 7f5cf23e2640 10 monclient: init 2024-09-13T10:31:18.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.607+0000 7f5cf23e2640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:18.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.608+0000 7f5cf23e2640 10 monclient: _add_conns ranks=[0,1,7,4,6,8,5,2,3] 2024-09-13T10:31:18.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.608+0000 7f5cf23e2640 10 monclient(hunting): picked mon.noname-a con 0x7f5cec0a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:18.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.608+0000 7f5cf23e2640 10 monclient(hunting): picked mon.noname-f con 0x7f5cec0a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:18.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.608+0000 7f5cf23e2640 10 monclient(hunting): picked mon.noname-i con 0x7f5cec13f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:18.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.608+0000 7f5cf23e2640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cec139290 con 0x7f5cec0a66d0 2024-09-13T10:31:18.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.608+0000 7f5cf23e2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cec1cf210 con 0x7f5cec0a6ab0 2024-09-13T10:31:18.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.608+0000 7f5cf23e2640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cec13dd50 con 0x7f5cec13f9a0 2024-09-13T10:31:18.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.608+0000 7f5cf23e2640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:18.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.608+0000 7f5cf23e2640 10 monclient(hunting): authenticate will time out at 818.114077s 2024-09-13T10:31:18.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.608+0000 7f5cebfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5cec0a66d0 0x7f5cec1ce3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:58726/0 (socket says 172.21.15.181:58726) 2024-09-13T10:31:18.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.608+0000 7f5cebfff640 1 -- 172.21.15.181:0/2426736762 learned_addr learned my addr 172.21.15.181:0/2426736762 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:18.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5cebfff640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.181:6789/0 conn(0x7f5cec0a66d0 legacy=0x7f5cec1ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3941827629 0 0) 0x7f5cec139290 con 0x7f5cec0a66d0 2024-09-13T10:31:18.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): my global_id is 54666 2024-09-13T10:31:18.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cd8003520 con 0x7f5cec0a66d0 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5cf097f640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.195:6792/0 conn(0x7f5cec13f9a0 legacy=0x7f5cec1d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ceb7fe640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.195:6789/0 conn(0x7f5cec0a6ab0 legacy=0x7f5cec1ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1343656276 0 0) 0x7f5cd8003520 con 0x7f5cec0a66d0 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cec139290 con 0x7f5cec0a66d0 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5cdc000ed0 con 0x7f5cec0a66d0 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): dump: 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.625 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.626 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.626 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.626 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.626 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.626 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.626 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.626 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.626 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.626 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4090395058 0 0) 0x7f5cec1cf210 con 0x7f5cec0a6ab0 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): my global_id is 54820 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cd8003520 con 0x7f5cec0a6ab0 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379398548 0 0) 0x7f5cec13dd50 con 0x7f5cec13f9a0 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient(hunting): my global_id is 54754 2024-09-13T10:31:18.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cec1cf210 con 0x7f5cec13f9a0 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4226385219 0 0) 0x7f5cec139290 con 0x7f5cec0a66d0 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.195:6792/0 conn(0x7f5cec13f9a0 legacy=0x7f5cec1d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.195:6789/0 conn(0x7f5cec0a6ab0 legacy=0x7f5cec1ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 monclient: found mon.a 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec13eba0 con 0x7f5cec0a66d0 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient: _finish_auth 0 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5cf23e2640 5 monclient: authenticate success, global_id 54666 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5cf23e2640 10 monclient: _renew_subs 2024-09-13T10:31:18.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5cf23e2640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5cf23e2640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec13f160 con 0x7f5cec0a66d0 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5cf23e2640 10 monclient: _renew_subs 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5cf23e2640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5cf23e2640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5cec13c870 con 0x7f5cec0a66d0 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5cdc001490 con 0x7f5cec0a66d0 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5cdc0019c0 con 0x7f5cec0a66d0 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5cea7fc640 4 set_mon_vals no callback set 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.610+0000 7f5ce8ff9640 10 monclient: dump: 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.629 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.611+0000 7f5cf23e2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.611+0000 7f5cf23e2640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5ccc0065c0 con 0x7f5ccc002860 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.611+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5cdc001b60 con 0x7f5cec0a66d0 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.612+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(48..48 src has 1..48) ==== 3506+0+0 (unknown 2567533886 0 0) 0x7f5cdc04e2b0 con 0x7f5cec0a66d0 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.612+0000 7f5cf097f640 10 monclient: get_auth_request con 0x7f5cd803fd60 auth_method 0 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ceb7fe640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.181:6792/0 conn(0x7f5ccc002860 legacy=0x7f5ccc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224295361 0 0) 0x7f5ccc0065c0 con 0x7f5ccc002860 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 10 monclient(hunting): my global_id is 4749 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cec139290 con 0x7f5ccc002860 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1638895781 0 0) 0x7f5cec139290 con 0x7f5ccc002860 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ccc0065c0 con 0x7f5ccc002860 2024-09-13T10:31:18.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ce0001320 con 0x7f5ccc002860 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 10 monclient: dump: 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.632 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1602976055 0 0) 0x7f5ccc0065c0 con 0x7f5ccc002860 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ccc00a160 con 0x7f5ccc002860 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5ce00048a0 con 0x7f5ccc002860 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.181:6792/0 conn(0x7f5ccc002860 legacy=0x7f5ccc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.614+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.181:6792/0 conn(0x7f5ccc002860 legacy=0x7f5ccc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:18.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.621+0000 7f5cf23e2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:18.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.621+0000 7f5cf23e2640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5ccc009e70 con 0x7f5ccc009130 2024-09-13T10:31:18.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ceb7fe640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.181:6792/0 conn(0x7f5ccc009130 legacy=0x7f5ccc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150850384 0 0) 0x7f5ccc009e70 con 0x7f5ccc009130 2024-09-13T10:31:18.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 10 monclient(hunting): my global_id is 4776 2024-09-13T10:31:18.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ccc0065c0 con 0x7f5ccc009130 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2683854067 0 0) 0x7f5ccc0065c0 con 0x7f5ccc009130 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ccc009e70 con 0x7f5ccc009130 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ce0005440 con 0x7f5ccc009130 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 10 monclient: dump: 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.636 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1610027695 0 0) 0x7f5ccc009e70 con 0x7f5ccc009130 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.624+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5ccc00c3f0 con 0x7f5ccc009130 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7725 (unknown 0 0 972176622) 0x7f5ce00085b0 con 0x7f5ccc009130 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5ce8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:18.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5ce8ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:18.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.181:6792/0 conn(0x7f5ccc009130 legacy=0x7f5ccc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5ce8ff9640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.181:6792/0 conn(0x7f5ccc009130 legacy=0x7f5ccc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:18.638 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:18.638 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:18.638 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:18.638 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:18.638 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:18.638 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 93069, 2024-09-13T10:31:18.638 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:18.638 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:18.639 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:18.640 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:18.642 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.643 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:18.644 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:18.645 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:18.647 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:18.648 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.649 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:18.651 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.652 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.653 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:18.655 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:18.656 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:18.657 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.658 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.658 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:18.658 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:18.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5cf23e2640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5cd803fd60 legacy=0x7f5cd8042220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5cf23e2640 10 monclient: shutdown 2024-09-13T10:31:18.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5cf23e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:18.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5cf23e2640 1 -- 172.21.15.181:0/2426736762 >> v1:172.21.15.181:6789/0 conn(0x7f5cec0a66d0 legacy=0x7f5cec1ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5cf097f640 1 -- 172.21.15.181:0/2426736762 reap_dead start 2024-09-13T10:31:18.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5cf097f640 1 -- 172.21.15.181:0/2426736762 reap_dead start 2024-09-13T10:31:18.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5cf23e2640 1 -- 172.21.15.181:0/2426736762 shutdown_connections 2024-09-13T10:31:18.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5cf23e2640 1 -- 172.21.15.181:0/2426736762 >> 172.21.15.181:0/2426736762 conn(0x7f5cec0abcd0 msgr2=0x7f5cec068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:18.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5cf23e2640 1 -- 172.21.15.181:0/2426736762 shutdown_connections 2024-09-13T10:31:18.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.625+0000 7f5cf23e2640 1 -- 172.21.15.181:0/2426736762 wait complete. 2024-09-13T10:31:18.660 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:18.660 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:31:18.660 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:31:18.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.756+0000 7f7d2c296640 10 monclient: get_monmap_and_config 2024-09-13T10:31:18.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.756+0000 7f7d2c296640 10 monclient: build_initial_monmap 2024-09-13T10:31:18.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.756+0000 7f7d2c296640 10 monclient: monmap: 2024-09-13T10:31:18.766 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:18.766 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.766 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:18.757671+0000 2024-09-13T10:31:18.766 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:18.757671+0000 2024-09-13T10:31:18.766 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:18.766 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.766 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:18.767 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:18.767 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:18.767 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:18.767 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:18.767 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:18.767 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:18.767 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:18.767 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:18.767 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.756+0000 7f7d2c296640 1 Processor -- start 2024-09-13T10:31:18.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.756+0000 7f7d2c296640 1 -- start start 2024-09-13T10:31:18.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.756+0000 7f7d2c296640 10 monclient: init 2024-09-13T10:31:18.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.757+0000 7f7d2c296640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:18.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.757+0000 7f7d2c296640 10 monclient: _add_conns ranks=[7,6,0,3,1,5,2,8,4] 2024-09-13T10:31:18.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.757+0000 7f7d2c296640 10 monclient(hunting): picked mon.noname-i con 0x7f7d240a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:18.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.757+0000 7f7d2c296640 10 monclient(hunting): picked mon.noname-d con 0x7f7d240a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:18.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.757+0000 7f7d2c296640 10 monclient(hunting): picked mon.noname-a con 0x7f7d2413f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:18.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.757+0000 7f7d2c296640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d240a5fe0 con 0x7f7d2413f9a0 2024-09-13T10:31:18.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.757+0000 7f7d2c296640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d240a8080 con 0x7f7d240a6ab0 2024-09-13T10:31:18.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.757+0000 7f7d2c296640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d240a42c0 con 0x7f7d240a66d0 2024-09-13T10:31:18.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.757+0000 7f7d2c296640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:18.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.757+0000 7f7d2c296640 10 monclient(hunting): authenticate will time out at 818.263407s 2024-09-13T10:31:18.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.757+0000 7f7d29831640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f7d240a6ab0 0x7f7d240a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44402/0 (socket says 172.21.15.181:44402) 2024-09-13T10:31:18.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.757+0000 7f7d29831640 1 -- 172.21.15.181:0/4141227124 learned_addr learned my addr 172.21.15.181:0/4141227124 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:18.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29831640 1 -- 172.21.15.181:0/4141227124 >> v1:172.21.15.181:6792/0 conn(0x7f7d240a6ab0 legacy=0x7f7d240a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d2a833640 1 -- 172.21.15.181:0/4141227124 >> v1:172.21.15.181:6789/0 conn(0x7f7d2413f9a0 legacy=0x7f7d24141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d2a032640 1 -- 172.21.15.181:0/4141227124 >> v1:172.21.15.195:6792/0 conn(0x7f7d240a66d0 legacy=0x7f7d240a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183208966 0 0) 0x7f7d240a8080 con 0x7f7d240a6ab0 2024-09-13T10:31:18.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29030640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29030640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29030640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29030640 10 monclient(hunting): my global_id is 4785 2024-09-13T10:31:18.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d0c003520 con 0x7f7d240a6ab0 2024-09-13T10:31:18.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341216871 0 0) 0x7f7d240a5fe0 con 0x7f7d2413f9a0 2024-09-13T10:31:18.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29030640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29030640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29030640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29030640 10 monclient(hunting): my global_id is 54693 2024-09-13T10:31:18.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.759+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d240a8080 con 0x7f7d2413f9a0 2024-09-13T10:31:18.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398595659 0 0) 0x7f7d240a42c0 con 0x7f7d240a66d0 2024-09-13T10:31:18.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient(hunting): my global_id is 54799 2024-09-13T10:31:18.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d240a5fe0 con 0x7f7d240a66d0 2024-09-13T10:31:18.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1980444281 0 0) 0x7f7d0c003520 con 0x7f7d240a6ab0 2024-09-13T10:31:18.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 >> v1:172.21.15.195:6792/0 conn(0x7f7d240a66d0 legacy=0x7f7d240a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 >> v1:172.21.15.181:6789/0 conn(0x7f7d2413f9a0 legacy=0x7f7d24141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient: _finish_hunting 0 2024-09-13T10:31:18.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 1 monclient: found mon.noname-d 2024-09-13T10:31:18.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:18.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:31:18.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d241464e0 con 0x7f7d240a6ab0 2024-09-13T10:31:18.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient: _finish_auth 0 2024-09-13T10:31:18.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient: _check_auth_tickets 2024-09-13T10:31:18.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:18.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d18001ae0 con 0x7f7d240a6ab0 2024-09-13T10:31:18.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d2c296640 5 monclient: authenticate success, global_id 4785 2024-09-13T10:31:18.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d2c296640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:18.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:31:18.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient: dump: 2024-09-13T10:31:18.772 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.772 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.772 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.772 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.772 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.772 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.772 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.772 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.773 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.773 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.773 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.773 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.773 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.773 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.773 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.773 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d2c296640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:18.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d180048a0 con 0x7f7d240a6ab0 2024-09-13T10:31:18.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:18.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 1 -- 172.21.15.181:0/4141227124 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d18004e10 con 0x7f7d240a6ab0 2024-09-13T10:31:18.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d2c296640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:18.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d2c296640 4 set_mon_vals no callback set 2024-09-13T10:31:18.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:18.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d29030640 10 monclient: dump: 2024-09-13T10:31:18.774 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.774 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.774 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.774 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.774 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.774 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.775 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.775 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.775 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.775 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.775 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.775 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.775 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.775 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.775 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.776 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d2c296640 10 monclient: shutdown 2024-09-13T10:31:18.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d2c296640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:18.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d2c296640 1 -- 172.21.15.181:0/4141227124 >> v1:172.21.15.181:6792/0 conn(0x7f7d240a6ab0 legacy=0x7f7d240a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d2c296640 1 -- 172.21.15.181:0/4141227124 shutdown_connections 2024-09-13T10:31:18.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d2c296640 1 -- 172.21.15.181:0/4141227124 >> 172.21.15.181:0/4141227124 conn(0x7f7d240abcd0 msgr2=0x7f7d240ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:18.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d2c296640 1 -- 172.21.15.181:0/4141227124 shutdown_connections 2024-09-13T10:31:18.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.760+0000 7f7d2c296640 1 -- 172.21.15.181:0/4141227124 wait complete. 2024-09-13T10:31:18.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.761+0000 7f7d2c296640 10 monclient: build_initial_monmap 2024-09-13T10:31:18.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.761+0000 7f7d2c296640 10 monclient: monmap: 2024-09-13T10:31:18.776 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:18.777 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:18.777 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:18.777 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:18.777 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:18.777 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:18.777 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:18.777 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:18.777 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:18.778 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:18.778 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:18.778 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:18.778 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:18.778 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:18.778 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:18.778 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.761+0000 7f7d2c296640 1 Processor -- start 2024-09-13T10:31:18.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.761+0000 7f7d2c296640 1 -- start start 2024-09-13T10:31:18.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.761+0000 7f7d2c296640 10 monclient: init 2024-09-13T10:31:18.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.762+0000 7f7d2c296640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:18.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.762+0000 7f7d2c296640 10 monclient: _add_conns ranks=[6,1,2,5,0,7,4,3,8] 2024-09-13T10:31:18.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.762+0000 7f7d2c296640 10 monclient(hunting): picked mon.noname-d con 0x7f7d240a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:18.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.762+0000 7f7d2c296640 10 monclient(hunting): picked mon.noname-f con 0x7f7d240a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:18.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.762+0000 7f7d2c296640 10 monclient(hunting): picked mon.noname-b con 0x7f7d2413f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:18.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.762+0000 7f7d2c296640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d2413f230 con 0x7f7d240a6ab0 2024-09-13T10:31:18.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.762+0000 7f7d2c296640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d2413ced0 con 0x7f7d2413f9a0 2024-09-13T10:31:18.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.762+0000 7f7d2c296640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d24143060 con 0x7f7d240a66d0 2024-09-13T10:31:18.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.762+0000 7f7d2c296640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:18.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.762+0000 7f7d2c296640 10 monclient(hunting): authenticate will time out at 818.268313s 2024-09-13T10:31:18.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.762+0000 7f7d2a032640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f7d240a66d0 0x7f7d241ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44410/0 (socket says 172.21.15.181:44410) 2024-09-13T10:31:18.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.762+0000 7f7d2a032640 1 -- 172.21.15.181:0/2198150453 learned_addr learned my addr 172.21.15.181:0/2198150453 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:18.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d2a032640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.181:6792/0 conn(0x7f7d240a66d0 legacy=0x7f7d241ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d2a833640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.181:6790/0 conn(0x7f7d2413f9a0 legacy=0x7f7d241d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d29831640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.195:6789/0 conn(0x7f7d240a6ab0 legacy=0x7f7d241d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2814002568 0 0) 0x7f7d24143060 con 0x7f7d240a66d0 2024-09-13T10:31:18.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 10 monclient(hunting): my global_id is 4794 2024-09-13T10:31:18.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d10003520 con 0x7f7d240a66d0 2024-09-13T10:31:18.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2886532642 0 0) 0x7f7d2413ced0 con 0x7f7d2413f9a0 2024-09-13T10:31:18.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 10 monclient(hunting): my global_id is 64208 2024-09-13T10:31:18.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d24143060 con 0x7f7d2413f9a0 2024-09-13T10:31:18.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1363532050 0 0) 0x7f7d10003520 con 0x7f7d240a66d0 2024-09-13T10:31:18.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d2413ced0 con 0x7f7d240a66d0 2024-09-13T10:31:18.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d14003cd0 con 0x7f7d240a66d0 2024-09-13T10:31:18.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:18.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:31:18.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 10 monclient(hunting): dump: 2024-09-13T10:31:18.787 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.787 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.787 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.788 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.788 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.788 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.788 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.788 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.788 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.788 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.788 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.788 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.788 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.789 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.789 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.789 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:18.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1263053750 0 0) 0x7f7d24143060 con 0x7f7d2413f9a0 2024-09-13T10:31:18.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d10003520 con 0x7f7d2413f9a0 2024-09-13T10:31:18.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.764+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099218783 0 0) 0x7f7d2413f230 con 0x7f7d240a6ab0 2024-09-13T10:31:18.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient(hunting): my global_id is 54838 2024-09-13T10:31:18.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d24143060 con 0x7f7d240a6ab0 2024-09-13T10:31:18.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d1c001cc0 con 0x7f7d2413f9a0 2024-09-13T10:31:18.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:18.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:18.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient(hunting): dump: 2024-09-13T10:31:18.790 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.790 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.790 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.790 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.790 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.790 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.790 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.791 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.791 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.791 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.791 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.791 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.791 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.791 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.791 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.791 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 294246758 0 0) 0x7f7d2413ced0 con 0x7f7d240a66d0 2024-09-13T10:31:18.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.181:6790/0 conn(0x7f7d2413f9a0 legacy=0x7f7d241d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.195:6789/0 conn(0x7f7d240a6ab0 legacy=0x7f7d241d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:31:18.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 1 monclient: found mon.d 2024-09-13T10:31:18.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:18.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:31:18.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d24068a30 con 0x7f7d240a66d0 2024-09-13T10:31:18.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient: _finish_auth 0 2024-09-13T10:31:18.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:31:18.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:18.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d2c296640 5 monclient: authenticate success, global_id 4794 2024-09-13T10:31:18.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d2c296640 10 monclient: _renew_subs 2024-09-13T10:31:18.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d2c296640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:31:18.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d2c296640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7d240a2880 con 0x7f7d240a66d0 2024-09-13T10:31:18.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d2c296640 10 monclient: _renew_subs 2024-09-13T10:31:18.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d2c296640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:31:18.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d2c296640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f7d2413f650 con 0x7f7d240a66d0 2024-09-13T10:31:18.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d14002050 con 0x7f7d240a66d0 2024-09-13T10:31:18.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:18.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d140044e0 con 0x7f7d240a66d0 2024-09-13T10:31:18.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d2882f640 4 set_mon_vals no callback set 2024-09-13T10:31:18.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:18.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d22ffd640 10 monclient: dump: 2024-09-13T10:31:18.794 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.794 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.794 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.794 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.794 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.794 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.794 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.794 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.794 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.794 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.795 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.795 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.795 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.795 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.795 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.795 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d2c296640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:18.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.765+0000 7f7d2c296640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7d040065c0 con 0x7f7d04002860 2024-09-13T10:31:18.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.766+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7d14012020 con 0x7f7d240a66d0 2024-09-13T10:31:18.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.766+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(48..48 src has 1..48) ==== 3506+0+0 (unknown 2567533886 0 0) 0x7f7d1404e6c0 con 0x7f7d240a66d0 2024-09-13T10:31:18.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.766+0000 7f7d2a833640 10 monclient: get_auth_request con 0x7f7d100402c0 auth_method 0 2024-09-13T10:31:18.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d29831640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.181:6793/0 conn(0x7f7d04002860 legacy=0x7f7d04004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991898631 0 0) 0x7f7d040065c0 con 0x7f7d04002860 2024-09-13T10:31:18.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 10 monclient(hunting): my global_id is 4832 2024-09-13T10:31:18.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d2413ced0 con 0x7f7d04002860 2024-09-13T10:31:18.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1607567057 0 0) 0x7f7d2413ced0 con 0x7f7d04002860 2024-09-13T10:31:18.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d040065c0 con 0x7f7d04002860 2024-09-13T10:31:18.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d18001d30 con 0x7f7d04002860 2024-09-13T10:31:18.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:31:18.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 10 monclient: dump: 2024-09-13T10:31:18.797 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.797 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.797 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.797 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.797 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.797 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.797 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.797 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.797 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.797 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.797 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.798 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.798 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.798 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.798 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.798 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2696879663 0 0) 0x7f7d040065c0 con 0x7f7d04002860 2024-09-13T10:31:18.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d0400a160 con 0x7f7d04002860 2024-09-13T10:31:18.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7d18004b50 con 0x7f7d04002860 2024-09-13T10:31:18.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:18.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:18.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.181:6793/0 conn(0x7f7d04002860 legacy=0x7f7d04004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.768+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.181:6793/0 conn(0x7f7d04002860 legacy=0x7f7d04004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:18.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.774+0000 7f7d2c296640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:18.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.774+0000 7f7d2c296640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7d04009e70 con 0x7f7d04009130 2024-09-13T10:31:18.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d29831640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.181:6793/0 conn(0x7f7d04009130 legacy=0x7f7d040095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503987907 0 0) 0x7f7d04009e70 con 0x7f7d04009130 2024-09-13T10:31:18.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:18.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:18.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:18.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 10 monclient(hunting): my global_id is 4841 2024-09-13T10:31:18.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d040065c0 con 0x7f7d04009130 2024-09-13T10:31:18.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1139731697 0 0) 0x7f7d040065c0 con 0x7f7d04009130 2024-09-13T10:31:18.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d04009e70 con 0x7f7d04009130 2024-09-13T10:31:18.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d18005490 con 0x7f7d04009130 2024-09-13T10:31:18.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:18.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:31:18.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 10 monclient: dump: 2024-09-13T10:31:18.800 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:18.800 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.800 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.800 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:18.800 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:18.800 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.801 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:18.801 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:18.801 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:18.801 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:18.801 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:18.801 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:18.801 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:18.802 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:18.802 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:18.802 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2033589894 0 0) 0x7f7d04009e70 con 0x7f7d04009130 2024-09-13T10:31:18.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7d0400c3f0 con 0x7f7d04009130 2024-09-13T10:31:18.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 3407841862) 0x7f7d18008600 con 0x7f7d04009130 2024-09-13T10:31:18.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:18.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:18.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.181:6793/0 conn(0x7f7d04009130 legacy=0x7f7d040095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.777+0000 7f7d22ffd640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.181:6793/0 conn(0x7f7d04009130 legacy=0x7f7d040095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:18.803 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:18.803 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:18.803 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:18.803 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:18.803 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:18.803 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 93210, 2024-09-13T10:31:18.803 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:18.803 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:18.804 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:18.804 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.805 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:18.806 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:18.807 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:18.808 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:18.809 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:18.809 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:18.809 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:18.809 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:18.809 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:18.809 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:18.809 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.810 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.812 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:18.812 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:18.812 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.812 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.812 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.812 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:18.812 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.812 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.812 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.813 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:18.814 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.815 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.816 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:18.816 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:18.816 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.816 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:18.816 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.816 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.816 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.818 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.819 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.820 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:18.820 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:18.820 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.820 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:18.821 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:18.822 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:18.823 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:18.824 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:18.824 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:18.824 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:18.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:18.824 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:18.824 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:18.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.778+0000 7f7d2c296640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7d100402c0 legacy=0x7f7d10042780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.778+0000 7f7d2c296640 10 monclient: shutdown 2024-09-13T10:31:18.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.778+0000 7f7d2c296640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:18.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.778+0000 7f7d2c296640 1 -- 172.21.15.181:0/2198150453 >> v1:172.21.15.181:6792/0 conn(0x7f7d240a66d0 legacy=0x7f7d241ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:18.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.778+0000 7f7d2a833640 1 -- 172.21.15.181:0/2198150453 reap_dead start 2024-09-13T10:31:18.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.778+0000 7f7d2a833640 1 -- 172.21.15.181:0/2198150453 reap_dead start 2024-09-13T10:31:18.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.778+0000 7f7d2c296640 1 -- 172.21.15.181:0/2198150453 shutdown_connections 2024-09-13T10:31:18.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.778+0000 7f7d2c296640 1 -- 172.21.15.181:0/2198150453 >> 172.21.15.181:0/2198150453 conn(0x7f7d240abcd0 msgr2=0x7f7d240a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:18.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.778+0000 7f7d2c296640 1 -- 172.21.15.181:0/2198150453 shutdown_connections 2024-09-13T10:31:18.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.778+0000 7f7d2c296640 1 -- 172.21.15.181:0/2198150453 wait complete. 2024-09-13T10:31:18.827 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:18.827 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:31:18.827 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:31:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.925+0000 7f3d1793a640 10 monclient: get_monmap_and_config 2024-09-13T10:31:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.925+0000 7f3d1793a640 10 monclient: build_initial_monmap 2024-09-13T10:31:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.925+0000 7f3d1793a640 10 monclient: monmap: 2024-09-13T10:31:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:18.927240+0000 2024-09-13T10:31:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:18.927240+0000 2024-09-13T10:31:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:18.930 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 1 Processor -- start 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 1 -- start start 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 10 monclient: init 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 10 monclient: _add_conns ranks=[7,2,6,4,0,3,1,5,8] 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 10 monclient(hunting): picked mon.noname-i con 0x7f3d100a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 10 monclient(hunting): picked mon.noname-b con 0x7f3d100a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 10 monclient(hunting): picked mon.noname-d con 0x7f3d1013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d100a4bc0 con 0x7f3d100a8340 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d1013a320 con 0x7f3d1013f750 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d100a8100 con 0x7f3d100a6640 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d1793a640 10 monclient(hunting): authenticate will time out at 818.432876s 2024-09-13T10:31:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d14ed5640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f3d100a8340 0x7f3d10139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:60142/0 (socket says 172.21.15.181:60142) 2024-09-13T10:31:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d14ed5640 1 -- 172.21.15.181:0/2927608711 learned_addr learned my addr 172.21.15.181:0/2927608711 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.926+0000 7f3d15ed7640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f3d1013f750 0x7f3d10141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44412/0 (socket says 172.21.15.181:44412) 2024-09-13T10:31:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.929+0000 7f3d15ed7640 1 -- 172.21.15.181:0/2927608711 >> v1:172.21.15.181:6792/0 conn(0x7f3d1013f750 legacy=0x7f3d10141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.929+0000 7f3d15ed7640 1 -- 172.21.15.181:0/2927608711 >> v1:172.21.15.181:6792/0 conn(0x7f3d1013f750 legacy=0x7f3d10141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-09-13T10:31:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.929+0000 7f3d15ed7640 1 -- 172.21.15.181:0/2927608711 >> v1:172.21.15.181:6792/0 conn(0x7f3d1013f750 legacy=0x7f3d10141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:31:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.929+0000 7f3d15ed7640 1 --1- 172.21.15.181:0/2927608711 >> v1:172.21.15.181:6792/0 conn(0x7f3d1013f750 0x7f3d10141b40 :-1 s=OPENED pgs=168 cs=1 l=1).handle_message read tag failed 2024-09-13T10:31:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.929+0000 7f3d15ed7640 1 --1- 172.21.15.181:0/2927608711 >> v1:172.21.15.181:6792/0 conn(0x7f3d1013f750 0x7f3d10141b40 :-1 s=OPENED pgs=168 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:31:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.929+0000 7f3d14ed5640 1 -- 172.21.15.181:0/2927608711 >> v1:172.21.15.181:6790/0 conn(0x7f3d100a8340 legacy=0x7f3d10139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.929+0000 7f3d07fff640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.181:6792/0 2024-09-13T10:31:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:18.929+0000 7f3d156d6640 1 -- 172.21.15.181:0/2927608711 >> v1:172.21.15.195:6792/0 conn(0x7f3d100a6640 legacy=0x7f3d10139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.696+0000 7f3d07fff640 1 -- 172.21.15.181:0/2927608711 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552833413 0 0) 0x7f3d100a4bc0 con 0x7f3d100a8340 2024-09-13T10:31:19.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.696+0000 7f3d07fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.696+0000 7f3d07fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.696+0000 7f3d07fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.696+0000 7f3d07fff640 10 monclient(hunting): my global_id is 64217 2024-09-13T10:31:19.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.696+0000 7f3d07fff640 1 -- 172.21.15.181:0/2927608711 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cfc003520 con 0x7f3d100a8340 2024-09-13T10:31:19.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.696+0000 7f3d07fff640 1 -- 172.21.15.181:0/2927608711 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224520049 0 0) 0x7f3d100a8100 con 0x7f3d100a6640 2024-09-13T10:31:19.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.696+0000 7f3d07fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.696+0000 7f3d07fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.696+0000 7f3d07fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.696+0000 7f3d07fff640 10 monclient(hunting): my global_id is 54808 2024-09-13T10:31:19.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.696+0000 7f3d07fff640 1 -- 172.21.15.181:0/2927608711 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d100a4bc0 con 0x7f3d100a6640 2024-09-13T10:31:19.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 1 -- 172.21.15.181:0/2927608711 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2291664057 0 0) 0x7f3d100a4bc0 con 0x7f3d100a6640 2024-09-13T10:31:19.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 1 -- 172.21.15.181:0/2927608711 >> v1:172.21.15.181:6792/0 conn(0x7f3d1013f750 legacy=0x7f3d10141b40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:19.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 1 -- 172.21.15.181:0/2927608711 >> v1:172.21.15.181:6790/0 conn(0x7f3d100a8340 legacy=0x7f3d10139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 10 monclient: _finish_hunting 0 2024-09-13T10:31:19.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 1 monclient: found mon.noname-i 2024-09-13T10:31:19.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:19.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:31:19.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 1 -- 172.21.15.181:0/2927608711 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d100a48e0 con 0x7f3d100a6640 2024-09-13T10:31:19.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 10 monclient: _finish_auth 0 2024-09-13T10:31:19.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 10 monclient: _check_auth_tickets 2024-09-13T10:31:19.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:19.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 1 -- 172.21.15.181:0/2927608711 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d0c001ad0 con 0x7f3d100a6640 2024-09-13T10:31:19.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:19.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:31:19.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 10 monclient: dump: 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.706 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d1793a640 5 monclient: authenticate success, global_id 54808 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d1793a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 1 -- 172.21.15.181:0/2927608711 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d0c003610 con 0x7f3d100a6640 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 1 -- 172.21.15.181:0/2927608711 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d0c003b00 con 0x7f3d100a6640 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d07fff640 10 monclient: dump: 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.707 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d1793a640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:19.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.702+0000 7f3d1793a640 4 set_mon_vals no callback set 2024-09-13T10:31:19.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.703+0000 7f3d1793a640 10 monclient: shutdown 2024-09-13T10:31:19.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.703+0000 7f3d1793a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:19.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.703+0000 7f3d1793a640 1 -- 172.21.15.181:0/2927608711 >> v1:172.21.15.195:6792/0 conn(0x7f3d100a6640 legacy=0x7f3d10139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.704+0000 7f3d1793a640 1 -- 172.21.15.181:0/2927608711 shutdown_connections 2024-09-13T10:31:19.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.704+0000 7f3d1793a640 1 -- 172.21.15.181:0/2927608711 >> 172.21.15.181:0/2927608711 conn(0x7f3d10077170 msgr2=0x7f3d100abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:19.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.704+0000 7f3d1793a640 1 -- 172.21.15.181:0/2927608711 shutdown_connections 2024-09-13T10:31:19.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.704+0000 7f3d1793a640 1 -- 172.21.15.181:0/2927608711 wait complete. 2024-09-13T10:31:19.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.705+0000 7f3d1793a640 10 monclient: build_initial_monmap 2024-09-13T10:31:19.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.705+0000 7f3d1793a640 10 monclient: monmap: 2024-09-13T10:31:19.712 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:19.712 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:19.712 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:19.712 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:19.712 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.706+0000 7f3d1793a640 1 Processor -- start 2024-09-13T10:31:19.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.706+0000 7f3d1793a640 1 -- start start 2024-09-13T10:31:19.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.706+0000 7f3d1793a640 10 monclient: init 2024-09-13T10:31:19.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.707+0000 7f3d1793a640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:19.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.707+0000 7f3d1793a640 10 monclient: _add_conns ranks=[8,5,3,1,6,7,0,2,4] 2024-09-13T10:31:19.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.707+0000 7f3d1793a640 10 monclient(hunting): picked mon.noname-e con 0x7f3d100a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:19.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.707+0000 7f3d1793a640 10 monclient(hunting): picked mon.noname-h con 0x7f3d1013f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:19.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.707+0000 7f3d1793a640 10 monclient(hunting): picked mon.noname-g con 0x7f3d1013cc30 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:19.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.707+0000 7f3d1793a640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d1013d600 con 0x7f3d1013cc30 2024-09-13T10:31:19.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.707+0000 7f3d156d6640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f3d100a8340 0x7f3d101ce570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:38938/0 (socket says 172.21.15.181:38938) 2024-09-13T10:31:19.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.707+0000 7f3d156d6640 1 -- 172.21.15.181:0/3870858580 learned_addr learned my addr 172.21.15.181:0/3870858580 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:19.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.707+0000 7f3d1793a640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d100a9f40 con 0x7f3d1013f750 2024-09-13T10:31:19.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.707+0000 7f3d1793a640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d10134de0 con 0x7f3d100a8340 2024-09-13T10:31:19.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.707+0000 7f3d1793a640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:19.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.707+0000 7f3d1793a640 10 monclient(hunting): authenticate will time out at 819.213925s 2024-09-13T10:31:19.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d156d6640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.181:6793/0 conn(0x7f3d100a8340 legacy=0x7f3d101ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d14ed5640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.195:6791/0 conn(0x7f3d1013f750 legacy=0x7f3d101d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d15ed7640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.195:6790/0 conn(0x7f3d1013cc30 legacy=0x7f3d101d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857345007 0 0) 0x7f3d10134de0 con 0x7f3d100a8340 2024-09-13T10:31:19.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): my global_id is 4850 2024-09-13T10:31:19.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cf4003550 con 0x7f3d100a8340 2024-09-13T10:31:19.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611541971 0 0) 0x7f3d1013d600 con 0x7f3d1013cc30 2024-09-13T10:31:19.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): my global_id is 4755 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d10134de0 con 0x7f3d1013cc30 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180991840 0 0) 0x7f3d100a9f40 con 0x7f3d1013f750 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): my global_id is 4820 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d1013d600 con 0x7f3d1013f750 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3560472008 0 0) 0x7f3cf4003550 con 0x7f3d100a8340 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d100a9f40 con 0x7f3d100a8340 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d0c003b00 con 0x7f3d100a8340 2024-09-13T10:31:19.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:19.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:31:19.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:19.722 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.722 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.722 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.722 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.722 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.722 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.722 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.722 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.722 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.722 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1879855665 0 0) 0x7f3d1013d600 con 0x7f3d1013f750 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3cf4003550 con 0x7f3d1013f750 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 509269649 0 0) 0x7f3d10134de0 con 0x7f3d1013cc30 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d1013d600 con 0x7f3d1013cc30 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d000047e0 con 0x7f3d1013f750 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:19.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:31:19.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:19.724 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.724 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.724 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.724 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.724 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.724 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.724 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.724 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.724 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.724 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.724 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.725 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.725 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.725 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.725 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.725 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d08001f80 con 0x7f3d1013cc30 2024-09-13T10:31:19.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:19.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:31:19.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:19.725 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.725 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.725 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4092790615 0 0) 0x7f3d100a9f40 con 0x7f3d100a8340 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.195:6791/0 conn(0x7f3d1013f750 legacy=0x7f3d101d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.195:6790/0 conn(0x7f3d1013cc30 legacy=0x7f3d101d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 monclient: found mon.e 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d10134540 con 0x7f3d100a8340 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d1793a640 5 monclient: authenticate success, global_id 4850 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d1793a640 10 monclient: _renew_subs 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d1793a640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:31:19.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d1793a640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1013e710 con 0x7f3d100a8340 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d0c001350 con 0x7f3d100a8340 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d0c004430 con 0x7f3d100a8340 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d05ffb640 10 monclient: dump: 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.728 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.729 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.729 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.729 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.729 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.729 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.729 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.729 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.729 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.729 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.710+0000 7f3d077fe640 4 set_mon_vals no callback set 2024-09-13T10:31:19.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.711+0000 7f3d1793a640 10 monclient: _renew_subs 2024-09-13T10:31:19.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.711+0000 7f3d1793a640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:31:19.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.711+0000 7f3d1793a640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f3d101cec80 con 0x7f3d100a8340 2024-09-13T10:31:19.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.711+0000 7f3d1793a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:19.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.712+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3d0c011ca0 con 0x7f3d100a8340 2024-09-13T10:31:19.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.712+0000 7f3d1793a640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3d10143260 con 0x7f3d10077170 2024-09-13T10:31:19.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.712+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(49..49 src has 1..49) ==== 3898+0+0 (unknown 3523879950 0 0) 0x7f3d0c04e350 con 0x7f3d100a8340 2024-09-13T10:31:19.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.712+0000 7f3d15ed7640 10 monclient: get_auth_request con 0x7f3cf4040650 auth_method 0 2024-09-13T10:31:19.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d14ed5640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.195:6789/0 conn(0x7f3d10077170 legacy=0x7f3d1013fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 213665077 0 0) 0x7f3d10143260 con 0x7f3d10077170 2024-09-13T10:31:19.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d05ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d05ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d05ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d05ffb640 10 monclient(hunting): my global_id is 54847 2024-09-13T10:31:19.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d100a9f40 con 0x7f3d10077170 2024-09-13T10:31:19.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 863480832 0 0) 0x7f3d100a9f40 con 0x7f3d10077170 2024-09-13T10:31:19.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d10143260 con 0x7f3d10077170 2024-09-13T10:31:19.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d00004eb0 con 0x7f3d10077170 2024-09-13T10:31:19.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d05ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d05ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.714+0000 7f3d05ffb640 10 monclient: dump: 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.732 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.733 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.733 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.733 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.733 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.733 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.715+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4061514019 0 0) 0x7f3d10143260 con 0x7f3d10077170 2024-09-13T10:31:19.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.715+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d10142ff0 con 0x7f3d10077170 2024-09-13T10:31:19.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.715+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3d000063f0 con 0x7f3d10077170 2024-09-13T10:31:19.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.715+0000 7f3d05ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:19.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.715+0000 7f3d05ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:19.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.715+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.195:6789/0 conn(0x7f3d10077170 legacy=0x7f3d1013fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.715+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.195:6789/0 conn(0x7f3d10077170 legacy=0x7f3d1013fb30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:19.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.721+0000 7f3d1793a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:19.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.721+0000 7f3d1793a640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3d10140950 con 0x7f3d10069b40 2024-09-13T10:31:19.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d14ed5640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.195:6789/0 conn(0x7f3d10069b40 legacy=0x7f3d10140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4162180553 0 0) 0x7f3d10140950 con 0x7f3d10069b40 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d05ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d05ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d05ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d05ffb640 10 monclient(hunting): my global_id is 54856 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d10143260 con 0x7f3d10069b40 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 36358256 0 0) 0x7f3d10143260 con 0x7f3d10069b40 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d10140950 con 0x7f3d10069b40 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3d0000a480 con 0x7f3d10069b40 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d05ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d05ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.724+0000 7f3d05ffb640 10 monclient: dump: 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.736 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.737 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.738 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 438853866 0 0) 0x7f3d10140950 con 0x7f3d10069b40 2024-09-13T10:31:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3d1013d040 con 0x7f3d10069b40 2024-09-13T10:31:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 2067984034) 0x7f3d00005870 con 0x7f3d10069b40 2024-09-13T10:31:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d05ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d05ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.195:6789/0 conn(0x7f3d10069b40 legacy=0x7f3d10140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d05ffb640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.195:6789/0 conn(0x7f3d10069b40 legacy=0x7f3d10140240 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:19.739 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:19.739 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:19.739 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:19.739 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:19.739 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:19.739 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 94135, 2024-09-13T10:31:19.739 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:19.739 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:19.739 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:19.740 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:19.741 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.742 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:19.743 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:19.743 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:19.743 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:19.743 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:19.743 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:19.743 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:19.743 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:19.743 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:19.743 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:19.743 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:19.743 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:19.743 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:19.744 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:19.744 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:19.744 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:19.744 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:19.744 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:19.744 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:19.744 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:19.744 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:19.744 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:19.744 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:19.744 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:19.744 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.747 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:19.747 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:19.747 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.747 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.747 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.747 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:19.747 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.747 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.747 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.747 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.748 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:19.749 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.750 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.752 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.753 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:19.754 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:19.755 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.755 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.755 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.755 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:19.755 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:19.755 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.755 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.755 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.755 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:19.756 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.756 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.756 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.756 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:19.756 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:19.756 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.756 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.756 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.756 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.757 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:19.758 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:19.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.759 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:19.759 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:19.759 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:19.759 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.759 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.759 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:19.759 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:19.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d1793a640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3cf4040650 legacy=0x7f3cf4042b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d1793a640 10 monclient: shutdown 2024-09-13T10:31:19.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d1793a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:19.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d1793a640 1 -- 172.21.15.181:0/3870858580 >> v1:172.21.15.181:6793/0 conn(0x7f3d100a8340 legacy=0x7f3d101ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d15ed7640 1 -- 172.21.15.181:0/3870858580 reap_dead start 2024-09-13T10:31:19.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d15ed7640 1 -- 172.21.15.181:0/3870858580 reap_dead start 2024-09-13T10:31:19.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d1793a640 1 -- 172.21.15.181:0/3870858580 shutdown_connections 2024-09-13T10:31:19.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.725+0000 7f3d1793a640 1 -- 172.21.15.181:0/3870858580 >> 172.21.15.181:0/3870858580 conn(0x7f3d100a6640 msgr2=0x7f3d100a6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:19.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.726+0000 7f3d1793a640 1 -- 172.21.15.181:0/3870858580 shutdown_connections 2024-09-13T10:31:19.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.726+0000 7f3d1793a640 1 -- 172.21.15.181:0/3870858580 wait complete. 2024-09-13T10:31:19.762 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:19.762 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:31:19.762 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:31:19.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.863+0000 7fba2ea2b640 10 monclient: get_monmap_and_config 2024-09-13T10:31:19.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.863+0000 7fba2ea2b640 10 monclient: build_initial_monmap 2024-09-13T10:31:19.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.863+0000 7fba2ea2b640 10 monclient: monmap: 2024-09-13T10:31:19.866 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:19.866 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.866 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:19.865466+0000 2024-09-13T10:31:19.866 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:19.865466+0000 2024-09-13T10:31:19.866 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:19.867 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.867 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:19.867 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:19.867 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:19.867 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:19.867 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:19.867 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:19.867 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:19.867 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:19.867 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:19.867 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.864+0000 7fba2ea2b640 1 Processor -- start 2024-09-13T10:31:19.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.864+0000 7fba2ea2b640 1 -- start start 2024-09-13T10:31:19.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.864+0000 7fba2ea2b640 10 monclient: init 2024-09-13T10:31:19.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba2ea2b640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:19.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba2ea2b640 10 monclient: _add_conns ranks=[6,7,4,2,0,3,5,8,1] 2024-09-13T10:31:19.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba2ea2b640 10 monclient(hunting): picked mon.noname-d con 0x7fba280a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:19.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba2ea2b640 10 monclient(hunting): picked mon.noname-i con 0x7fba280a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:19.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba2ea2b640 10 monclient(hunting): picked mon.noname-c con 0x7fba2813f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:19.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba2ea2b640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba280a5fe0 con 0x7fba2813f9a0 2024-09-13T10:31:19.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba2ea2b640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba280a8080 con 0x7fba280a66d0 2024-09-13T10:31:19.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba2ea2b640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba280a42c0 con 0x7fba280a6ab0 2024-09-13T10:31:19.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba2ea2b640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:19.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba2ea2b640 10 monclient(hunting): authenticate will time out at 819.371236s 2024-09-13T10:31:19.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba2cfc8640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fba2813f9a0 0x7fba28141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:39214/0 (socket says 172.21.15.181:39214) 2024-09-13T10:31:19.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba27fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fba280a66d0 0x7fba280a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44422/0 (socket says 172.21.15.181:44422) 2024-09-13T10:31:19.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.865+0000 7fba2cfc8640 1 -- 172.21.15.181:0/2238147710 learned_addr learned my addr 172.21.15.181:0/2238147710 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:19.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba27fff640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.181:6792/0 conn(0x7fba280a66d0 legacy=0x7fba280a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba2cfc8640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.181:6791/0 conn(0x7fba2813f9a0 legacy=0x7fba28141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba277fe640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.195:6792/0 conn(0x7fba280a6ab0 legacy=0x7fba280a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141387678 0 0) 0x7fba280a8080 con 0x7fba280a66d0 2024-09-13T10:31:19.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient(hunting): my global_id is 4803 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba10003520 con 0x7fba280a66d0 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2156666351 0 0) 0x7fba280a5fe0 con 0x7fba2813f9a0 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient(hunting): my global_id is 4828 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba280a8080 con 0x7fba2813f9a0 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2498829769 0 0) 0x7fba280a42c0 con 0x7fba280a6ab0 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient(hunting): my global_id is 54817 2024-09-13T10:31:19.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba280a5fe0 con 0x7fba280a6ab0 2024-09-13T10:31:19.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 846285925 0 0) 0x7fba10003520 con 0x7fba280a66d0 2024-09-13T10:31:19.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.195:6792/0 conn(0x7fba280a6ab0 legacy=0x7fba280a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.181:6791/0 conn(0x7fba2813f9a0 legacy=0x7fba28141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:31:19.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 1 monclient: found mon.noname-d 2024-09-13T10:31:19.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:19.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:31:19.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.867+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba281464e0 con 0x7fba280a66d0 2024-09-13T10:31:19.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient: _finish_auth 0 2024-09-13T10:31:19.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:31:19.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba2ea2b640 5 monclient: authenticate success, global_id 4803 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba18001ae0 con 0x7fba280a66d0 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba2ea2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient: dump: 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.877 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba27fff640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.181:6792/0 conn(0x7fba280a66d0 legacy=0x7fba280a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba27fff640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.181:6792/0 conn(0x7fba280a66d0 legacy=0x7fba280a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba2ea2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba27fff640 1 --1- 172.21.15.181:0/2238147710 >> v1:172.21.15.181:6792/0 conn(0x7fba280a66d0 0x7fba280a53b0 :-1 s=OPENED pgs=169 cs=1 l=1).handle_message read tag failed 2024-09-13T10:31:19.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba27fff640 1 --1- 172.21.15.181:0/2238147710 >> v1:172.21.15.181:6792/0 conn(0x7fba280a66d0 0x7fba280a53b0 :-1 s=OPENED pgs=169 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient: ms_handle_reset current mon v1:172.21.15.181:6792/0 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.181:6792/0 conn(0x7fba280a66d0 legacy=0x7fba280a53b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient: _add_conns ranks=[3,0,8,4,6,5,7,2,1] 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient(hunting): picked mon.g con 0x7fba10004800 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient(hunting): picked mon.a con 0x7fba100052f0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient(hunting): picked mon.e con 0x7fba1000c220 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba10003520 con 0x7fba100052f0 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba280a8080 con 0x7fba10004800 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba280a5fe0 con 0x7fba1000c220 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.868+0000 7fba26ffd640 10 monclient(hunting): ms_handle_reset stray mon v1:172.21.15.181:6792/0 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba277fe640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.181:6789/0 conn(0x7fba100052f0 legacy=0x7fba1000a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba2cfc8640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.181:6793/0 conn(0x7fba1000c220 legacy=0x7fba1000e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba27fff640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.195:6790/0 conn(0x7fba10004800 legacy=0x7fba10004be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319931721 0 0) 0x7fba10003520 con 0x7fba100052f0 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 --> v1:172.21.15.181:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fba100121b0 con 0x7fba100052f0 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656140304 0 0) 0x7fba280a5fe0 con 0x7fba1000c220 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 --> v1:172.21.15.181:6793/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fba10003520 con 0x7fba1000c220 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631292263 0 0) 0x7fba280a8080 con 0x7fba10004800 2024-09-13T10:31:19.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 --> v1:172.21.15.195:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fba280a5fe0 con 0x7fba10004800 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 338523723 0 0) 0x7fba100121b0 con 0x7fba100052f0 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.181:6793/0 conn(0x7fba1000c220 legacy=0x7fba1000e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.195:6790/0 conn(0x7fba10004800 legacy=0x7fba10004be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 monclient: found mon.a 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=2+}) -- 0x7fba280a42c0 con 0x7fba100052f0 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba2cfc8640 1 -- 172.21.15.181:0/2238147710 reap_dead start 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient: _finish_auth 0 2024-09-13T10:31:19.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:31:19.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:19.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba1c003b20 con 0x7fba100052f0 2024-09-13T10:31:19.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:19.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:19.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient: dump: 2024-09-13T10:31:19.882 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.882 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.882 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.882 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.882 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.882 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.882 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba2ea2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 1 -- 172.21.15.181:0/2238147710 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba1c003dc0 con 0x7fba100052f0 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba26ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba2ea2b640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:19.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.870+0000 7fba2ea2b640 4 set_mon_vals no callback set 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.871+0000 7fba2ea2b640 10 monclient: shutdown 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.871+0000 7fba2ea2b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.871+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2238147710 >> v1:172.21.15.181:6789/0 conn(0x7fba100052f0 legacy=0x7fba1000a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.871+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2238147710 shutdown_connections 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.871+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2238147710 >> 172.21.15.181:0/2238147710 conn(0x7fba280abcd0 msgr2=0x7fba280ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.871+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2238147710 shutdown_connections 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.871+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2238147710 wait complete. 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.872+0000 7fba2ea2b640 10 monclient: build_initial_monmap 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.872+0000 7fba2ea2b640 10 monclient: monmap: 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:19.884 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:19.885 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:19.885 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:19.885 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:19.885 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:19.885 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:19.885 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:19.885 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:19.885 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:19.885 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:19.885 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:19.885 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.872+0000 7fba2ea2b640 1 Processor -- start 2024-09-13T10:31:19.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.872+0000 7fba2ea2b640 1 -- start start 2024-09-13T10:31:19.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.872+0000 7fba2ea2b640 10 monclient: init 2024-09-13T10:31:19.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.873+0000 7fba2ea2b640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:19.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.873+0000 7fba2ea2b640 10 monclient: _add_conns ranks=[7,0,1,8,6,5,3,2,4] 2024-09-13T10:31:19.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.873+0000 7fba2ea2b640 10 monclient(hunting): picked mon.noname-i con 0x7fba100052f0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:19.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.873+0000 7fba2ea2b640 10 monclient(hunting): picked mon.noname-a con 0x7fba280a2250 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:19.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.873+0000 7fba2ea2b640 10 monclient(hunting): picked mon.noname-f con 0x7fba28142b40 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:19.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.873+0000 7fba2ea2b640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba281435d0 con 0x7fba280a2250 2024-09-13T10:31:19.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.873+0000 7fba2ea2b640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba28144240 con 0x7fba28142b40 2024-09-13T10:31:19.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.873+0000 7fba2ea2b640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba28137a10 con 0x7fba100052f0 2024-09-13T10:31:19.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.873+0000 7fba2ea2b640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:19.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.873+0000 7fba2ea2b640 10 monclient(hunting): authenticate will time out at 819.379210s 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.873+0000 7fba277fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fba280a2250 0x7fba281d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:58746/0 (socket says 172.21.15.181:58746) 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.873+0000 7fba277fe640 1 -- 172.21.15.181:0/2197767301 learned_addr learned my addr 172.21.15.181:0/2197767301 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba277fe640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.181:6789/0 conn(0x7fba280a2250 legacy=0x7fba281d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276005325 0 0) 0x7fba281435d0 con 0x7fba280a2250 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): my global_id is 54702 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba14003520 con 0x7fba280a2250 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba2cfc8640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.195:6789/0 conn(0x7fba28142b40 legacy=0x7fba281d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba27fff640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.195:6792/0 conn(0x7fba100052f0 legacy=0x7fba280a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067583631 0 0) 0x7fba28144240 con 0x7fba28142b40 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): my global_id is 54865 2024-09-13T10:31:19.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba281435d0 con 0x7fba28142b40 2024-09-13T10:31:19.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888516182 0 0) 0x7fba28137a10 con 0x7fba100052f0 2024-09-13T10:31:19.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): my global_id is 54826 2024-09-13T10:31:19.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba28144240 con 0x7fba100052f0 2024-09-13T10:31:19.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1018144918 0 0) 0x7fba14003520 con 0x7fba280a2250 2024-09-13T10:31:19.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba28137a10 con 0x7fba280a2250 2024-09-13T10:31:19.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba1c0042b0 con 0x7fba280a2250 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): dump: 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.894 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.895 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.895 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.895 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.895 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.895 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:19.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1129737096 0 0) 0x7fba28137a10 con 0x7fba280a2250 2024-09-13T10:31:19.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.195:6792/0 conn(0x7fba100052f0 legacy=0x7fba280a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.195:6789/0 conn(0x7fba28142b40 legacy=0x7fba281d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:31:19.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 monclient: found mon.a 2024-09-13T10:31:19.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba28145930 con 0x7fba280a2250 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient: _finish_auth 0 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba24ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba2ea2b640 5 monclient: authenticate success, global_id 54702 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba2ea2b640 10 monclient: _renew_subs 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba2ea2b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.875+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fba28145090 con 0x7fba280a2250 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba2ea2b640 10 monclient: _renew_subs 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba2ea2b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fba281d8480 con 0x7fba280a2250 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba1c004450 con 0x7fba280a2250 2024-09-13T10:31:19.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba24ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba1c003b40 con 0x7fba280a2250 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba24ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba24ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba24ff9640 10 monclient: dump: 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.897 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba267fc640 4 set_mon_vals no callback set 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba2ea2b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba28074d40 con 0x7fba2813c770 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.876+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fba1c011ca0 con 0x7fba280a2250 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.877+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(49..49 src has 1..49) ==== 3898+0+0 (unknown 3523879950 0 0) 0x7fba1c04e2c0 con 0x7fba280a2250 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.877+0000 7fba2cfc8640 10 monclient: get_auth_request con 0x7fba1403fdb0 auth_method 0 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba27fff640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.195:6790/0 conn(0x7fba2813c770 legacy=0x7fba2813cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2682040485 0 0) 0x7fba28144240 con 0x7fba2813c770 2024-09-13T10:31:19.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 10 monclient(hunting): my global_id is 4764 2024-09-13T10:31:19.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba28137a10 con 0x7fba2813c770 2024-09-13T10:31:19.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1369047683 0 0) 0x7fba28137a10 con 0x7fba2813c770 2024-09-13T10:31:19.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba28144240 con 0x7fba2813c770 2024-09-13T10:31:19.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba18001ab0 con 0x7fba2813c770 2024-09-13T10:31:19.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:19.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:31:19.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 10 monclient: dump: 2024-09-13T10:31:19.899 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.900 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.900 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.900 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.900 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.900 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.900 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.900 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.900 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.900 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.900 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.900 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.900 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.901 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.901 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.901 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 298868402 0 0) 0x7fba28144240 con 0x7fba2813c770 2024-09-13T10:31:19.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.879+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba28146240 con 0x7fba2813c770 2024-09-13T10:31:19.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.880+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fba18006820 con 0x7fba2813c770 2024-09-13T10:31:19.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.880+0000 7fba24ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:19.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.880+0000 7fba24ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:19.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.880+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.195:6790/0 conn(0x7fba2813c770 legacy=0x7fba2813cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.880+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.195:6790/0 conn(0x7fba2813c770 legacy=0x7fba2813cb50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:19.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.886+0000 7fba2ea2b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:19.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.886+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba28139010 con 0x7fba2813d260 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba27fff640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.195:6790/0 conn(0x7fba2813d260 legacy=0x7fba281dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43926785 0 0) 0x7fba281464e0 con 0x7fba2813d260 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba24ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba24ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba24ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba24ff9640 10 monclient(hunting): my global_id is 4773 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba28144240 con 0x7fba2813d260 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 54983262 0 0) 0x7fba28144240 con 0x7fba2813d260 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba281464e0 con 0x7fba2813d260 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba18004f10 con 0x7fba2813d260 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba24ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba24ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:31:19.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.889+0000 7fba24ff9640 10 monclient: dump: 2024-09-13T10:31:19.904 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:19.904 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:19.904 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.904 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:19.904 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:19.904 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:19.904 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:19.904 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:19.904 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:19.904 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:19.904 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:19.905 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1309799020 0 0) 0x7fba281464e0 con 0x7fba2813d260 2024-09-13T10:31:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba280a3240 con 0x7fba2813d260 2024-09-13T10:31:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 2108645147) 0x7fba180064e0 con 0x7fba2813d260 2024-09-13T10:31:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba24ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba24ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.195:6790/0 conn(0x7fba2813d260 legacy=0x7fba281dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba24ff9640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.195:6790/0 conn(0x7fba2813d260 legacy=0x7fba281dc670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:19.906 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:19.906 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:19.906 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:19.906 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:19.906 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:19.906 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 94306, 2024-09-13T10:31:19.906 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:19.906 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:19.906 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:19.906 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:19.906 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:19.907 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:19.908 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:19.909 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:19.910 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:19.911 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:19.911 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:19.911 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:19.911 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:19.911 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:19.911 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:19.911 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:19.911 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:19.911 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:19.911 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:19.911 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:19.911 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.912 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:19.913 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.914 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.916 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:19.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:19.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:19.920 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:19.923 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.924 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:19.925 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:19.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:19.925 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:19.925 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:19.925 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:19.925 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:19.925 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:19.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:19.925 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:19.925 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:19.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.195:6800/1839191919 conn(0x7fba1403fdb0 legacy=0x7fba14042270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba2ea2b640 10 monclient: shutdown 2024-09-13T10:31:19.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba2ea2b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:19.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2197767301 >> v1:172.21.15.181:6789/0 conn(0x7fba280a2250 legacy=0x7fba281d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:19.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba2cfc8640 1 -- 172.21.15.181:0/2197767301 reap_dead start 2024-09-13T10:31:19.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba2cfc8640 1 -- 172.21.15.181:0/2197767301 reap_dead start 2024-09-13T10:31:19.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2197767301 shutdown_connections 2024-09-13T10:31:19.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.890+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2197767301 >> 172.21.15.181:0/2197767301 conn(0x7fba280abcd0 msgr2=0x7fba280ab3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:19.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.891+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2197767301 shutdown_connections 2024-09-13T10:31:19.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:19.891+0000 7fba2ea2b640 1 -- 172.21.15.181:0/2197767301 wait complete. 2024-09-13T10:31:19.927 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:19.928 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:31:19.928 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:31:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.024+0000 7ff057a7c640 10 monclient: get_monmap_and_config 2024-09-13T10:31:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.024+0000 7ff057a7c640 10 monclient: build_initial_monmap 2024-09-13T10:31:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.024+0000 7ff057a7c640 10 monclient: monmap: 2024-09-13T10:31:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:20.025782+0000 2024-09-13T10:31:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:20.025782+0000 2024-09-13T10:31:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:20.029 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.024+0000 7ff057a7c640 1 Processor -- start 2024-09-13T10:31:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.024+0000 7ff057a7c640 1 -- start start 2024-09-13T10:31:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.024+0000 7ff057a7c640 10 monclient: init 2024-09-13T10:31:20.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.025+0000 7ff057a7c640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:20.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.025+0000 7ff057a7c640 10 monclient: _add_conns ranks=[2,5,0,1,6,7,3,4,8] 2024-09-13T10:31:20.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.025+0000 7ff057a7c640 10 monclient(hunting): picked mon.noname-b con 0x7ff0500a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:20.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.025+0000 7ff057a7c640 10 monclient(hunting): picked mon.noname-h con 0x7ff0500a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:20.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.025+0000 7ff057a7c640 10 monclient(hunting): picked mon.noname-a con 0x7ff05013f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.025+0000 7ff057a7c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0500a5fe0 con 0x7ff05013f9a0 2024-09-13T10:31:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.025+0000 7ff057a7c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0500a8080 con 0x7ff0500a66d0 2024-09-13T10:31:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.025+0000 7ff057a7c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0500a42c0 con 0x7ff0500a6ab0 2024-09-13T10:31:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.025+0000 7ff057a7c640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.025+0000 7ff057a7c640 10 monclient(hunting): authenticate will time out at 819.531516s 2024-09-13T10:31:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.025+0000 7ff055818640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7ff0500a66d0 0x7ff0500a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:60146/0 (socket says 172.21.15.181:60146) 2024-09-13T10:31:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.025+0000 7ff055818640 1 -- 172.21.15.181:0/1319313720 learned_addr learned my addr 172.21.15.181:0/1319313720 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.027+0000 7ff056019640 1 -- 172.21.15.181:0/1319313720 >> v1:172.21.15.181:6789/0 conn(0x7ff05013f9a0 legacy=0x7ff050141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.027+0000 7ff055818640 1 -- 172.21.15.181:0/1319313720 >> v1:172.21.15.181:6790/0 conn(0x7ff0500a66d0 legacy=0x7ff0500a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.027+0000 7ff054816640 1 -- 172.21.15.181:0/1319313720 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1477141451 0 0) 0x7ff0500a8080 con 0x7ff0500a66d0 2024-09-13T10:31:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient(hunting): my global_id is 64226 2024-09-13T10:31:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 1 -- 172.21.15.181:0/1319313720 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff03c003520 con 0x7ff0500a66d0 2024-09-13T10:31:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 1 -- 172.21.15.181:0/1319313720 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1539171217 0 0) 0x7ff0500a5fe0 con 0x7ff05013f9a0 2024-09-13T10:31:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient(hunting): my global_id is 54711 2024-09-13T10:31:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 1 -- 172.21.15.181:0/1319313720 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0500a8080 con 0x7ff05013f9a0 2024-09-13T10:31:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff055017640 1 -- 172.21.15.181:0/1319313720 >> v1:172.21.15.195:6791/0 conn(0x7ff0500a6ab0 legacy=0x7ff0500a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 1 -- 172.21.15.181:0/1319313720 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2396647200 0 0) 0x7ff03c003520 con 0x7ff0500a66d0 2024-09-13T10:31:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 1 -- 172.21.15.181:0/1319313720 >> v1:172.21.15.195:6791/0 conn(0x7ff0500a6ab0 legacy=0x7ff0500a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 1 -- 172.21.15.181:0/1319313720 >> v1:172.21.15.181:6789/0 conn(0x7ff05013f9a0 legacy=0x7ff050141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient: _finish_hunting 0 2024-09-13T10:31:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 1 monclient: found mon.noname-b 2024-09-13T10:31:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:31:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 1 -- 172.21.15.181:0/1319313720 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0501464e0 con 0x7ff0500a66d0 2024-09-13T10:31:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient: _finish_auth 0 2024-09-13T10:31:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient: _check_auth_tickets 2024-09-13T10:31:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 1 -- 172.21.15.181:0/1319313720 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff048001f20 con 0x7ff0500a66d0 2024-09-13T10:31:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff057a7c640 5 monclient: authenticate success, global_id 64226 2024-09-13T10:31:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff057a7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient: dump: 2024-09-13T10:31:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.044 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff057a7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 1 -- 172.21.15.181:0/1319313720 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff048004c20 con 0x7ff0500a66d0 2024-09-13T10:31:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 1 -- 172.21.15.181:0/1319313720 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff048005190 con 0x7ff0500a66d0 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff057a7c640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff057a7c640 4 set_mon_vals no callback set 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff054816640 10 monclient: dump: 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.047 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff057a7c640 10 monclient: shutdown 2024-09-13T10:31:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff057a7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff057a7c640 1 -- 172.21.15.181:0/1319313720 >> v1:172.21.15.181:6790/0 conn(0x7ff0500a66d0 legacy=0x7ff0500a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff057a7c640 1 -- 172.21.15.181:0/1319313720 shutdown_connections 2024-09-13T10:31:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.028+0000 7ff057a7c640 1 -- 172.21.15.181:0/1319313720 >> 172.21.15.181:0/1319313720 conn(0x7ff0500abcd0 msgr2=0x7ff0500ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.029+0000 7ff057a7c640 1 -- 172.21.15.181:0/1319313720 shutdown_connections 2024-09-13T10:31:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.029+0000 7ff057a7c640 1 -- 172.21.15.181:0/1319313720 wait complete. 2024-09-13T10:31:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.029+0000 7ff057a7c640 10 monclient: build_initial_monmap 2024-09-13T10:31:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.029+0000 7ff057a7c640 10 monclient: monmap: 2024-09-13T10:31:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:20.049 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.029+0000 7ff057a7c640 1 Processor -- start 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.029+0000 7ff057a7c640 1 -- start start 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.029+0000 7ff057a7c640 10 monclient: init 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.030+0000 7ff057a7c640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.030+0000 7ff057a7c640 10 monclient: _add_conns ranks=[0,2,3,8,4,5,1,6,7] 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.030+0000 7ff057a7c640 10 monclient(hunting): picked mon.noname-a con 0x7ff0500a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.030+0000 7ff057a7c640 10 monclient(hunting): picked mon.noname-b con 0x7ff0500a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.030+0000 7ff057a7c640 10 monclient(hunting): picked mon.noname-g con 0x7ff05013f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.030+0000 7ff057a7c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff05013d1e0 con 0x7ff0500a66d0 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.030+0000 7ff057a7c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff050068ea0 con 0x7ff0500a6ab0 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.030+0000 7ff057a7c640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff05013f540 con 0x7ff05013f9a0 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.030+0000 7ff057a7c640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.030+0000 7ff057a7c640 10 monclient(hunting): authenticate will time out at 819.536369s 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.030+0000 7ff055818640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff0500a66d0 0x7ff0501366d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:58772/0 (socket says 172.21.15.181:58772) 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.030+0000 7ff055818640 1 -- 172.21.15.181:0/4173196220 learned_addr learned my addr 172.21.15.181:0/4173196220 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff055818640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.181:6789/0 conn(0x7ff0500a66d0 legacy=0x7ff0501366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff055017640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.181:6790/0 conn(0x7ff0500a6ab0 legacy=0x7ff0501d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153597520 0 0) 0x7ff05013d1e0 con 0x7ff0500a66d0 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 10 monclient(hunting): my global_id is 54720 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff034003550 con 0x7ff0500a66d0 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff056019640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.195:6790/0 conn(0x7ff05013f9a0 legacy=0x7ff0501d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1674754409 0 0) 0x7ff0500a42c0 con 0x7ff0500a6ab0 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 10 monclient(hunting): my global_id is 64235 2024-09-13T10:31:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff05013d1e0 con 0x7ff0500a6ab0 2024-09-13T10:31:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 199373812 0 0) 0x7ff034003550 con 0x7ff0500a66d0 2024-09-13T10:31:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0500a42c0 con 0x7ff0500a66d0 2024-09-13T10:31:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3559357537 0 0) 0x7ff05013d1e0 con 0x7ff0500a6ab0 2024-09-13T10:31:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff034003550 con 0x7ff0500a6ab0 2024-09-13T10:31:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.032+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff048001ee0 con 0x7ff0500a66d0 2024-09-13T10:31:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient(hunting): dump: 2024-09-13T10:31:20.053 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.053 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.053 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.053 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.053 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.053 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.053 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.053 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.053 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.053 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff040001ca0 con 0x7ff0500a6ab0 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient(hunting): dump: 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.054 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.055 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.055 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.055 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.055 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.055 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.055 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.055 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.055 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.055 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.055 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.055 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.055 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.056 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.056 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578033670 0 0) 0x7ff05013f540 con 0x7ff05013f9a0 2024-09-13T10:31:20.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient(hunting): my global_id is 4782 2024-09-13T10:31:20.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff05013d1e0 con 0x7ff05013f9a0 2024-09-13T10:31:20.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3110531839 0 0) 0x7ff0500a42c0 con 0x7ff0500a66d0 2024-09-13T10:31:20.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.195:6790/0 conn(0x7ff05013f9a0 legacy=0x7ff0501d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.181:6790/0 conn(0x7ff0500a6ab0 legacy=0x7ff0501d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient: _finish_hunting 0 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 1 monclient: found mon.a 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0501374e0 con 0x7ff0500a66d0 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient: _finish_auth 0 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient: _check_auth_tickets 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff057a7c640 5 monclient: authenticate success, global_id 54720 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff057a7c640 10 monclient: _renew_subs 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff057a7c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff057a7c640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff05013dd40 con 0x7ff0500a66d0 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff057a7c640 10 monclient: _renew_subs 2024-09-13T10:31:20.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff057a7c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff057a7c640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff05013c8e0 con 0x7ff0500a66d0 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff048004c20 con 0x7ff0500a66d0 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff048002080 con 0x7ff0500a66d0 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff047fff640 4 set_mon_vals no callback set 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff0467fc640 10 monclient: dump: 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.058 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff057a7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.033+0000 7ff057a7c640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff0380065c0 con 0x7ff038002860 2024-09-13T10:31:20.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.034+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff048012050 con 0x7ff0500a66d0 2024-09-13T10:31:20.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.034+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(49..49 src has 1..49) ==== 3898+0+0 (unknown 3523879950 0 0) 0x7ff04804e820 con 0x7ff0500a66d0 2024-09-13T10:31:20.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.034+0000 7ff056019640 10 monclient: get_auth_request con 0x7ff034040290 auth_method 0 2024-09-13T10:31:20.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.036+0000 7ff055017640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.195:6791/0 conn(0x7ff038002860 legacy=0x7ff038004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.036+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737901893 0 0) 0x7ff0380065c0 con 0x7ff038002860 2024-09-13T10:31:20.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.036+0000 7ff0467fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.036+0000 7ff0467fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.036+0000 7ff0467fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.036+0000 7ff0467fc640 10 monclient(hunting): my global_id is 4838 2024-09-13T10:31:20.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.036+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0500a42c0 con 0x7ff038002860 2024-09-13T10:31:20.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1811549623 0 0) 0x7ff0500a42c0 con 0x7ff038002860 2024-09-13T10:31:20.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0380065c0 con 0x7ff038002860 2024-09-13T10:31:20.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff040003c70 con 0x7ff038002860 2024-09-13T10:31:20.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:20.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:31:20.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 10 monclient: dump: 2024-09-13T10:31:20.065 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.065 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.065 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.065 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.065 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.065 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.065 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.065 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.065 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.065 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.065 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.066 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.066 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.066 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.066 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.066 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2177663780 0 0) 0x7ff0380065c0 con 0x7ff038002860 2024-09-13T10:31:20.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff03800a160 con 0x7ff038002860 2024-09-13T10:31:20.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff040004000 con 0x7ff038002860 2024-09-13T10:31:20.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:20.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:20.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.195:6791/0 conn(0x7ff038002860 legacy=0x7ff038004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.037+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.195:6791/0 conn(0x7ff038002860 legacy=0x7ff038004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:20.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.043+0000 7ff057a7c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:20.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.043+0000 7ff057a7c640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff038009e50 con 0x7ff038009110 2024-09-13T10:31:20.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff055017640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.195:6791/0 conn(0x7ff038009110 legacy=0x7ff0380095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806736051 0 0) 0x7ff038009e50 con 0x7ff038009110 2024-09-13T10:31:20.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 10 monclient(hunting): my global_id is 4847 2024-09-13T10:31:20.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0380065c0 con 0x7ff038009110 2024-09-13T10:31:20.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2394814943 0 0) 0x7ff0380065c0 con 0x7ff038009110 2024-09-13T10:31:20.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff038009e50 con 0x7ff038009110 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff040005b00 con 0x7ff038009110 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 10 monclient: dump: 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.068 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.069 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.069 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.069 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.069 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.069 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.069 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.069 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2652309776 0 0) 0x7ff038009e50 con 0x7ff038009110 2024-09-13T10:31:20.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.046+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff03800c3a0 con 0x7ff038009110 2024-09-13T10:31:20.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 3250576306) 0x7ff040005bb0 con 0x7ff038009110 2024-09-13T10:31:20.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff0467fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:20.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff0467fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:20.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.195:6791/0 conn(0x7ff038009110 legacy=0x7ff0380095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff0467fc640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.195:6791/0 conn(0x7ff038009110 legacy=0x7ff0380095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:20.070 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 94475, 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:31:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:20.072 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:20.073 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:20.073 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:20.073 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:20.073 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:20.073 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:20.073 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:20.073 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:20.073 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:20.073 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:20.073 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:20.073 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:20.073 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:20.074 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:20.074 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:20.074 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.074 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:20.074 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:20.074 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:20.074 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:20.075 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:20.076 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:20.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.077 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:20.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.077 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:20.077 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:20.077 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.077 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:20.077 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:20.078 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.079 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:20.081 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:20.081 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.081 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.081 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.081 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:20.081 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:20.081 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:20.083 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:20.084 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.084 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.084 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.084 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:20.084 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:20.084 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.085 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:20.085 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.085 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.085 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:20.086 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:20.086 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.086 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.086 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.086 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:20.086 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:20.087 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.087 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.087 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.087 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:20.087 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.087 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.087 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:20.087 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:20.088 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.088 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.088 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.088 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:20.088 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:20.088 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.088 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.089 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.089 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:20.089 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.089 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.089 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.089 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:20.090 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:20.090 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.090 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.090 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.090 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:20.090 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:20.090 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.090 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.090 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.092 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:20.092 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:20.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.092 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:20.092 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:20.092 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:20.092 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.092 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:20.092 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:20.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.092 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:20.092 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:20.093 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:20.093 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.093 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.093 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:20.093 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff057a7c640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff034040290 legacy=0x7ff034042750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff057a7c640 10 monclient: shutdown 2024-09-13T10:31:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff057a7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff057a7c640 1 -- 172.21.15.181:0/4173196220 >> v1:172.21.15.181:6789/0 conn(0x7ff0500a66d0 legacy=0x7ff0501366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff056019640 1 -- 172.21.15.181:0/4173196220 reap_dead start 2024-09-13T10:31:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff056019640 1 -- 172.21.15.181:0/4173196220 reap_dead start 2024-09-13T10:31:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff057a7c640 1 -- 172.21.15.181:0/4173196220 shutdown_connections 2024-09-13T10:31:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff057a7c640 1 -- 172.21.15.181:0/4173196220 >> 172.21.15.181:0/4173196220 conn(0x7ff0500abcd0 msgr2=0x7ff050145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff057a7c640 1 -- 172.21.15.181:0/4173196220 shutdown_connections 2024-09-13T10:31:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.047+0000 7ff057a7c640 1 -- 172.21.15.181:0/4173196220 wait complete. 2024-09-13T10:31:20.095 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:20.096 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:31:20.096 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.192+0000 7f930f6e6640 10 monclient: get_monmap_and_config 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.192+0000 7f930f6e6640 10 monclient: build_initial_monmap 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.192+0000 7f930f6e6640 10 monclient: monmap: 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:20.194120+0000 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:20.194120+0000 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:20.195 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:20.196 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:20.196 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:20.196 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:20.196 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:20.196 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:20.196 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 1 Processor -- start 2024-09-13T10:31:20.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 1 -- start start 2024-09-13T10:31:20.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 10 monclient: init 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 10 monclient: _add_conns ranks=[6,3,0,2,4,8,5,1,7] 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 10 monclient(hunting): picked mon.noname-d con 0x7f93080a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 10 monclient(hunting): picked mon.noname-g con 0x7f93080a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 10 monclient(hunting): picked mon.noname-a con 0x7f930813f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93080a4bc0 con 0x7f930813f750 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f930813a320 con 0x7f93080a8340 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93080a8100 con 0x7f93080a6640 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930f6e6640 10 monclient(hunting): authenticate will time out at 819.699795s 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930dc83640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f930813f750 0x7f9308141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:58774/0 (socket says 172.21.15.181:58774) 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930dc83640 1 -- 172.21.15.181:0/3919341134 learned_addr learned my addr 172.21.15.181:0/3919341134 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:20.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.193+0000 7f930d482640 1 --1- 172.21.15.181:0/3919341134 >> v1:172.21.15.181:6792/0 conn(0x7f93080a6640 0x7f9308139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44438/0 (socket says 172.21.15.181:44438) 2024-09-13T10:31:20.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f930d482640 1 -- 172.21.15.181:0/3919341134 >> v1:172.21.15.181:6792/0 conn(0x7f93080a6640 legacy=0x7f9308139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f930dc83640 1 -- 172.21.15.181:0/3919341134 >> v1:172.21.15.181:6789/0 conn(0x7f930813f750 legacy=0x7f9308141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 1 -- 172.21.15.181:0/3919341134 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518074805 0 0) 0x7f93080a4bc0 con 0x7f930813f750 2024-09-13T10:31:20.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient(hunting): my global_id is 54729 2024-09-13T10:31:20.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 1 -- 172.21.15.181:0/3919341134 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92f4003520 con 0x7f930813f750 2024-09-13T10:31:20.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 1 -- 172.21.15.181:0/3919341134 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213907628 0 0) 0x7f93080a8100 con 0x7f93080a6640 2024-09-13T10:31:20.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient(hunting): my global_id is 4812 2024-09-13T10:31:20.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 1 -- 172.21.15.181:0/3919341134 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93080a4bc0 con 0x7f93080a6640 2024-09-13T10:31:20.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f930cc81640 1 -- 172.21.15.181:0/3919341134 >> v1:172.21.15.195:6790/0 conn(0x7f93080a8340 legacy=0x7f9308139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 1 -- 172.21.15.181:0/3919341134 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3815169168 0 0) 0x7f92f4003520 con 0x7f930813f750 2024-09-13T10:31:20.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 1 -- 172.21.15.181:0/3919341134 >> v1:172.21.15.181:6792/0 conn(0x7f93080a6640 legacy=0x7f9308139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 1 -- 172.21.15.181:0/3919341134 >> v1:172.21.15.195:6790/0 conn(0x7f93080a8340 legacy=0x7f9308139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient: _finish_hunting 0 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 1 monclient: found mon.noname-a 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 1 -- 172.21.15.181:0/3919341134 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93080a48e0 con 0x7f930813f750 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient: _finish_auth 0 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient: _check_auth_tickets 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 1 -- 172.21.15.181:0/3919341134 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9300001e60 con 0x7f930813f750 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f930f6e6640 5 monclient: authenticate success, global_id 54729 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f930f6e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:20.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient: dump: 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.205 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f930f6e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 1 -- 172.21.15.181:0/3919341134 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9300004c20 con 0x7f930813f750 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 1 -- 172.21.15.181:0/3919341134 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9300005190 con 0x7f930813f750 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f92fffff640 10 monclient: dump: 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.206 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f930f6e6640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.196+0000 7f930f6e6640 4 set_mon_vals no callback set 2024-09-13T10:31:20.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.197+0000 7f930f6e6640 10 monclient: shutdown 2024-09-13T10:31:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.197+0000 7f930f6e6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.197+0000 7f930f6e6640 1 -- 172.21.15.181:0/3919341134 >> v1:172.21.15.181:6789/0 conn(0x7f930813f750 legacy=0x7f9308141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.197+0000 7f930f6e6640 1 -- 172.21.15.181:0/3919341134 shutdown_connections 2024-09-13T10:31:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.197+0000 7f930f6e6640 1 -- 172.21.15.181:0/3919341134 >> 172.21.15.181:0/3919341134 conn(0x7f9308077170 msgr2=0x7f93080abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.197+0000 7f930f6e6640 1 -- 172.21.15.181:0/3919341134 shutdown_connections 2024-09-13T10:31:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.197+0000 7f930f6e6640 1 -- 172.21.15.181:0/3919341134 wait complete. 2024-09-13T10:31:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.197+0000 7f930f6e6640 10 monclient: build_initial_monmap 2024-09-13T10:31:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.197+0000 7f930f6e6640 10 monclient: monmap: 2024-09-13T10:31:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 1 Processor -- start 2024-09-13T10:31:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 1 -- start start 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 10 monclient: init 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 10 monclient: _add_conns ranks=[2,5,1,4,3,6,0,8,7] 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 10 monclient(hunting): picked mon.noname-b con 0x7f93080a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 10 monclient(hunting): picked mon.noname-h con 0x7f930813f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 10 monclient(hunting): picked mon.noname-f con 0x7f93081d4310 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93080a1180 con 0x7f93081d4310 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9308142b60 con 0x7f93080a8340 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93080a0310 con 0x7f930813f750 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930f6e6640 10 monclient(hunting): authenticate will time out at 819.704728s 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930d482640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f93080a8340 0x7f930809d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:60166/0 (socket says 172.21.15.181:60166) 2024-09-13T10:31:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.198+0000 7f930d482640 1 -- 172.21.15.181:0/2274356216 learned_addr learned my addr 172.21.15.181:0/2274356216 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:20.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.200+0000 7f930d482640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.181:6790/0 conn(0x7f93080a8340 legacy=0x7f930809d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.200+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1988266398 0 0) 0x7f9308142b60 con 0x7f93080a8340 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): my global_id is 64244 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92ec003550 con 0x7f93080a8340 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f930dc83640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.195:6789/0 conn(0x7f93081d4310 legacy=0x7f93081d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f930cc81640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.195:6791/0 conn(0x7f930813f750 legacy=0x7f930809db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3471807182 0 0) 0x7f93080a1180 con 0x7f93081d4310 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): my global_id is 54874 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9308142b60 con 0x7f93081d4310 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2977759691 0 0) 0x7f92ec003550 con 0x7f93080a8340 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f93080a1180 con 0x7f93080a8340 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f93040047e0 con 0x7f93080a8340 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): dump: 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.216 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3967085012 0 0) 0x7f93080a0310 con 0x7f930813f750 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient(hunting): my global_id is 4856 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92ec003550 con 0x7f930813f750 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 920500396 0 0) 0x7f93080a1180 con 0x7f93080a8340 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.195:6791/0 conn(0x7f930813f750 legacy=0x7f930809db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.195:6789/0 conn(0x7f93081d4310 legacy=0x7f93081d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 monclient: found mon.b 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930809ee20 con 0x7f93080a8340 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:20.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f930f6e6640 5 monclient: authenticate success, global_id 64244 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f930f6e6640 10 monclient: _renew_subs 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f930f6e6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f930f6e6640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f930809e280 con 0x7f93080a8340 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9304004c30 con 0x7f93080a8340 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9304005160 con 0x7f93080a8340 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92fdffb640 10 monclient: dump: 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.219 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.220 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.220 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.220 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.220 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.220 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.220 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.220 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.220 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.220 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.220 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.220 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.220 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f92ff7fe640 4 set_mon_vals no callback set 2024-09-13T10:31:20.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f930f6e6640 10 monclient: _renew_subs 2024-09-13T10:31:20.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f930f6e6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:20.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.201+0000 7f930f6e6640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f93080a29e0 con 0x7f93080a8340 2024-09-13T10:31:20.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.202+0000 7f930f6e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:20.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.202+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9304005300 con 0x7f93080a8340 2024-09-13T10:31:20.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.202+0000 7f930f6e6640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f93080a9c20 con 0x7f9308077170 2024-09-13T10:31:20.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.202+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(49..49 src has 1..49) ==== 3898+0+0 (unknown 3523879950 0 0) 0x7f930404e3b0 con 0x7f93080a8340 2024-09-13T10:31:20.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.203+0000 7f930dc83640 10 monclient: get_auth_request con 0x7f92ec03fd40 auth_method 0 2024-09-13T10:31:20.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.204+0000 7f930cc81640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.195:6792/0 conn(0x7f9308077170 legacy=0x7f930813a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3589940236 0 0) 0x7f93080a9c20 con 0x7f9308077170 2024-09-13T10:31:20.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 10 monclient(hunting): my global_id is 54835 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93080a1180 con 0x7f9308077170 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1045328339 0 0) 0x7f93080a1180 con 0x7f9308077170 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f93080a9c20 con 0x7f9308077170 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f92f8001cb0 con 0x7f9308077170 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 10 monclient: dump: 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.222 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 223864648 0 0) 0x7f93080a9c20 con 0x7f9308077170 2024-09-13T10:31:20.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9308142490 con 0x7f9308077170 2024-09-13T10:31:20.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f92f8006850 con 0x7f9308077170 2024-09-13T10:31:20.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:20.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:20.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.205+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.195:6792/0 conn(0x7f9308077170 legacy=0x7f930813a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.206+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.195:6792/0 conn(0x7f9308077170 legacy=0x7f930813a490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:20.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.212+0000 7f930f6e6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:20.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.212+0000 7f930f6e6640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9308143260 con 0x7f9308069b40 2024-09-13T10:31:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.214+0000 7f930cc81640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.195:6792/0 conn(0x7f9308069b40 legacy=0x7f930813aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2809844009 0 0) 0x7f9308143260 con 0x7f9308069b40 2024-09-13T10:31:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:20.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 10 monclient(hunting): my global_id is 54844 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93080a9c20 con 0x7f9308069b40 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1890251920 0 0) 0x7f93080a9c20 con 0x7f9308069b40 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9308143260 con 0x7f9308069b40 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f92f8003d40 con 0x7f9308069b40 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 10 monclient: dump: 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:20.226 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4044646731 0 0) 0x7f9308143260 con 0x7f9308069b40 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f930809fbf0 con 0x7f9308069b40 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7725 (unknown 0 0 3297797423) 0x7f92f8004070 con 0x7f9308069b40 2024-09-13T10:31:20.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:20.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:20.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.195:6792/0 conn(0x7f9308069b40 legacy=0x7f930813aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.215+0000 7f92fdffb640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.195:6792/0 conn(0x7f9308069b40 legacy=0x7f930813aba0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:20.228 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 30, 2024-09-13T10:31:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 94636, 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:31:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.236 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:20.237 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.238 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:20.243 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.244 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.244 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.244 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:20.244 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:20.244 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.244 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.244 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.244 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:20.244 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:20.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.246 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:20.247 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:20.248 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.248 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:20.248 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:20.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:20.248 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:20.248 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:20.248 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:31:20.248 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:20.248 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:20.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:20.248 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:20.248 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.216+0000 7f930f6e6640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.195:6800/1839191919 conn(0x7f92ec03fd40 legacy=0x7f92ec042200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.216+0000 7f930f6e6640 10 monclient: shutdown 2024-09-13T10:31:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.216+0000 7f930f6e6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.216+0000 7f930f6e6640 1 -- 172.21.15.181:0/2274356216 >> v1:172.21.15.181:6790/0 conn(0x7f93080a8340 legacy=0x7f930809d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.216+0000 7f930dc83640 1 -- 172.21.15.181:0/2274356216 reap_dead start 2024-09-13T10:31:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.216+0000 7f930dc83640 1 -- 172.21.15.181:0/2274356216 reap_dead start 2024-09-13T10:31:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.216+0000 7f930f6e6640 1 -- 172.21.15.181:0/2274356216 shutdown_connections 2024-09-13T10:31:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.216+0000 7f930f6e6640 1 -- 172.21.15.181:0/2274356216 >> 172.21.15.181:0/2274356216 conn(0x7f93080a6640 msgr2=0x7f9308141d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.216+0000 7f930f6e6640 1 -- 172.21.15.181:0/2274356216 shutdown_connections 2024-09-13T10:31:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:20.216+0000 7f930f6e6640 1 -- 172.21.15.181:0/2274356216 wait complete. 2024-09-13T10:31:20.251 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:31:20.251 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['e'] 2024-09-13T10:31:20.251 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-09-13T10:31:20.251 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-09-13T10:31:20.251 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-09-13T10:31:20.252 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-09-13T10:31:20.252 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:31:20.262 INFO:tasks.ceph.mon.e:Stopped 2024-09-13T10:31:20.262 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-09-13T10:31:20.262 INFO:tasks.ceph.mon.a:Sent signal 19 2024-09-13T10:31:20.262 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-13T10:31:35.262 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-09-13T10:31:35.263 INFO:tasks.ceph.mon.a:Sent signal 18 2024-09-13T10:31:35.263 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-09-13T10:31:35.264 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:31:35.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.369+0000 7fb8c33f8640 10 monclient: get_monmap_and_config 2024-09-13T10:31:35.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.369+0000 7fb8c33f8640 10 monclient: build_initial_monmap 2024-09-13T10:31:35.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.370+0000 7fb8c33f8640 10 monclient: monmap: 2024-09-13T10:31:35.372 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:35.372 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:35.371588+0000 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:35.371588+0000 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:35.373 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:35.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.370+0000 7fb8c33f8640 1 Processor -- start 2024-09-13T10:31:35.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.370+0000 7fb8c33f8640 1 -- start start 2024-09-13T10:31:35.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.370+0000 7fb8c33f8640 10 monclient: init 2024-09-13T10:31:35.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c33f8640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:35.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c33f8640 10 monclient: _add_conns ranks=[1,5,7,2,3,4,8,6,0] 2024-09-13T10:31:35.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c33f8640 10 monclient(hunting): picked mon.noname-f con 0x7fb8bc139040 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:35.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c33f8640 10 monclient(hunting): picked mon.noname-h con 0x7fb8bc09cd50 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:35.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c33f8640 10 monclient(hunting): picked mon.noname-i con 0x7fb8bc13fae0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c33f8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc09dbb0 con 0x7fb8bc139040 2024-09-13T10:31:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c33f8640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc09de90 con 0x7fb8bc09cd50 2024-09-13T10:31:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c33f8640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc09e170 con 0x7fb8bc13fae0 2024-09-13T10:31:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c33f8640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c33f8640 10 monclient(hunting): authenticate will time out at 834.877553s 2024-09-13T10:31:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c1995640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7fb8bc13fae0 0x7fb8bc141ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:60434/0 (socket says 172.21.15.181:60434) 2024-09-13T10:31:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c1194640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb8bc139040 0x7fb8bc0a58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:34646/0 (socket says 172.21.15.181:34646) 2024-09-13T10:31:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c0993640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7fb8bc09cd50 0x7fb8bc13e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:51976/0 (socket says 172.21.15.181:51976) 2024-09-13T10:31:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.371+0000 7fb8c1995640 1 -- 172.21.15.181:0/3460734154 learned_addr learned my addr 172.21.15.181:0/3460734154 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:35.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.374+0000 7fb8c1995640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.195:6792/0 conn(0x7fb8bc13fae0 legacy=0x7fb8bc141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:35.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.374+0000 7fb8c0993640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.195:6791/0 conn(0x7fb8bc09cd50 legacy=0x7fb8bc13e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:35.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:35.374+0000 7fb8c1194640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.195:6789/0 conn(0x7fb8bc139040 legacy=0x7fb8bc0a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:38.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 10 monclient(hunting): tick 2024-09-13T10:31:38.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:31:38.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 1 monclient(hunting): continuing hunt 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.195:6792/0 conn(0x7fb8bc13fae0 legacy=0x7fb8bc141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.195:6791/0 conn(0x7fb8bc09cd50 legacy=0x7fb8bc13e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.195:6789/0 conn(0x7fb8bc139040 legacy=0x7fb8bc0a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 10 monclient: _add_conns ranks=[8,4,2,3,0,6] 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 10 monclient(hunting): picked mon.noname-e con 0x7fb8a0003960 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fb8a0007550 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 10 monclient(hunting): picked mon.noname-b con 0x7fb8a000b2e0 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 1 -- 172.21.15.181:0/3460734154 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc0a5ff0 con 0x7fb8a000b2e0 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 1 -- 172.21.15.181:0/3460734154 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a0010190 con 0x7fb8a0007550 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 1 -- 172.21.15.181:0/3460734154 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a0011410 con 0x7fb8a0003960 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8b2ffd640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.371+0000 7fb8c1194640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.181:6793/0 conn(0x7fb8a0003960 legacy=0x7fb8a0005db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:31:38.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.374+0000 7fb8c0993640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.181:6791/0 conn(0x7fb8a0007550 legacy=0x7fb8a0009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:38.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.374+0000 7fb8c1995640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.181:6790/0 conn(0x7fb8a000b2e0 legacy=0x7fb8a000d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:38.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.572+0000 7fb8c1194640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.181:6793/0 conn(0x7fb8a0003960 legacy=0x7fb8a0005db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:31:38.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:38.973+0000 7fb8c1194640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.181:6793/0 conn(0x7fb8a0003960 legacy=0x7fb8a0005db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:31:39.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 1 -- 172.21.15.181:0/3460734154 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 834251742 0 0) 0x7fb8a0010190 con 0x7fb8a0007550 2024-09-13T10:31:39.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:39.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:39.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:39.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient(hunting): my global_id is 4837 2024-09-13T10:31:39.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 1 -- 172.21.15.181:0/3460734154 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a8003520 con 0x7fb8a0007550 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 1 -- 172.21.15.181:0/3460734154 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3401542846 0 0) 0x7fb8a8003520 con 0x7fb8a0007550 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.181:6793/0 conn(0x7fb8a0003960 legacy=0x7fb8a0005db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.181:6790/0 conn(0x7fb8a000b2e0 legacy=0x7fb8a000d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient: _finish_hunting 0 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 1 monclient: found mon.noname-c 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8c1995640 1 -- 172.21.15.181:0/3460734154 reap_dead start 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 1 -- 172.21.15.181:0/3460734154 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a0012690 con 0x7fb8a0007550 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient: _finish_auth 0 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient: _check_auth_tickets 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:39.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 1 -- 172.21.15.181:0/3460734154 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb8ac0019d0 con 0x7fb8a0007550 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient: dump: 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:39.724 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8c33f8640 5 monclient: authenticate success, global_id 4837 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8c33f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 1 -- 172.21.15.181:0/3460734154 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8ac001be0 con 0x7fb8a0007550 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 1 -- 172.21.15.181:0/3460734154 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb8ac004b20 con 0x7fb8a0007550 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:39.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8b3fff640 10 monclient: dump: 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:39.726 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:39.727 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:39.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8c33f8640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:39.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.719+0000 7fb8c33f8640 4 set_mon_vals no callback set 2024-09-13T10:31:39.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.720+0000 7fb8c33f8640 10 monclient: shutdown 2024-09-13T10:31:39.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.720+0000 7fb8c33f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:39.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.720+0000 7fb8c33f8640 1 -- 172.21.15.181:0/3460734154 >> v1:172.21.15.181:6791/0 conn(0x7fb8a0007550 legacy=0x7fb8a0009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:39.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.720+0000 7fb8c33f8640 1 -- 172.21.15.181:0/3460734154 shutdown_connections 2024-09-13T10:31:39.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.720+0000 7fb8c33f8640 1 -- 172.21.15.181:0/3460734154 >> 172.21.15.181:0/3460734154 conn(0x7fb8bc077120 msgr2=0x7fb8bc0abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:39.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.721+0000 7fb8c33f8640 1 -- 172.21.15.181:0/3460734154 shutdown_connections 2024-09-13T10:31:39.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.721+0000 7fb8c33f8640 1 -- 172.21.15.181:0/3460734154 wait complete. 2024-09-13T10:31:39.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.721+0000 7fb8c33f8640 10 monclient: build_initial_monmap 2024-09-13T10:31:39.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.721+0000 7fb8c33f8640 10 monclient: monmap: 2024-09-13T10:31:39.734 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:39.734 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:39.734 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:39.734 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:39.734 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:39.734 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:39.735 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:39.735 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:39.735 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:39.735 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:39.735 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:39.735 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:39.735 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:39.735 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:39.735 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:39.735 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:39.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 1 Processor -- start 2024-09-13T10:31:39.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 1 -- start start 2024-09-13T10:31:39.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 10 monclient: init 2024-09-13T10:31:39.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:39.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 10 monclient: _add_conns ranks=[1,3,2,6,0,4,8,5,7] 2024-09-13T10:31:39.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 10 monclient(hunting): picked mon.noname-f con 0x7fb8a0007550 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:39.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 10 monclient(hunting): picked mon.noname-g con 0x7fb8bc1cb420 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:39.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 10 monclient(hunting): picked mon.noname-b con 0x7fb8bc1cb840 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:39.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc0aace0 con 0x7fb8a0007550 2024-09-13T10:31:39.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc13ed00 con 0x7fb8bc1cb840 2024-09-13T10:31:39.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc09e9a0 con 0x7fb8bc1cb420 2024-09-13T10:31:39.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:39.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c33f8640 10 monclient(hunting): authenticate will time out at 839.228814s 2024-09-13T10:31:39.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c1995640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fb8bc1cb840 0x7fb8bc1d6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:52528/0 (socket says 172.21.15.181:52528) 2024-09-13T10:31:39.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.722+0000 7fb8c1995640 1 -- 172.21.15.181:0/2531373433 learned_addr learned my addr 172.21.15.181:0/2531373433 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:39.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8c1995640 1 -- 172.21.15.181:0/2531373433 >> v1:172.21.15.181:6790/0 conn(0x7fb8bc1cb840 legacy=0x7fb8bc1d6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:39.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8c1194640 1 -- 172.21.15.181:0/2531373433 >> v1:172.21.15.195:6789/0 conn(0x7fb8a0007550 legacy=0x7fb8bc1cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:39.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051204054 0 0) 0x7fb8bc13ed00 con 0x7fb8bc1cb840 2024-09-13T10:31:39.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:39.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:39.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:39.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient(hunting): my global_id is 64253 2024-09-13T10:31:39.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8c0993640 1 -- 172.21.15.181:0/2531373433 >> v1:172.21.15.195:6790/0 conn(0x7fb8bc1cb420 legacy=0x7fb8bc1d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:39.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a0009110 con 0x7fb8bc1cb840 2024-09-13T10:31:39.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2784457582 0 0) 0x7fb8a0009110 con 0x7fb8bc1cb840 2024-09-13T10:31:39.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8bc13ed00 con 0x7fb8bc1cb840 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb8b4001e80 con 0x7fb8bc1cb840 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:39.738 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1725729009 0 0) 0x7fb8bc09dbb0 con 0x7fb8a0007550 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:39.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient(hunting): my global_id is 54883 2024-09-13T10:31:39.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a0009110 con 0x7fb8a0007550 2024-09-13T10:31:39.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 972274054 0 0) 0x7fb8bc13ed00 con 0x7fb8bc1cb840 2024-09-13T10:31:39.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 >> v1:172.21.15.195:6790/0 conn(0x7fb8bc1cb420 legacy=0x7fb8bc1d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:39.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 >> v1:172.21.15.195:6789/0 conn(0x7fb8a0007550 legacy=0x7fb8bc1cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:39.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:39.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 monclient: found mon.b 2024-09-13T10:31:39.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:39.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:39.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc13dac0 con 0x7fb8bc1cb840 2024-09-13T10:31:39.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:39.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:39.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8c33f8640 5 monclient: authenticate success, global_id 64253 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8c33f8640 10 monclient: _renew_subs 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8c33f8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8c33f8640 1 -- 172.21.15.181:0/2531373433 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb8bc13efe0 con 0x7fb8bc1cb840 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8b4004e10 con 0x7fb8bc1cb840 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb8b4005300 con 0x7fb8bc1cb840 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b1ffb640 10 monclient: dump: 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:39.741 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.725+0000 7fb8b37fe640 4 set_mon_vals no callback set 2024-09-13T10:31:39.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.726+0000 7fb8c33f8640 10 monclient: _renew_subs 2024-09-13T10:31:39.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.726+0000 7fb8c33f8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:39.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.726+0000 7fb8c33f8640 1 -- 172.21.15.181:0/2531373433 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb8bc1d8600 con 0x7fb8bc1cb840 2024-09-13T10:31:39.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.726+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb8b40054a0 con 0x7fb8bc1cb840 2024-09-13T10:31:39.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.727+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(49..49 src has 1..49) ==== 3898+0+0 (unknown 3523879950 0 0) 0x7fb8b404e310 con 0x7fb8bc1cb840 2024-09-13T10:31:39.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.727+0000 7fb8c1194640 10 monclient: get_auth_request con 0x7fb8a0040f90 auth_method 0 2024-09-13T10:31:39.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.727+0000 7fb8c33f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:39.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.727+0000 7fb8c33f8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:39.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.727+0000 7fb8c33f8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:39.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.727+0000 7fb8c33f8640 1 -- 172.21.15.181:0/2531373433 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8bc131240 con 0x7fb8bc1cb840 2024-09-13T10:31:39.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.732+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fb8b4017740 con 0x7fb8bc1cb840 2024-09-13T10:31:39.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.732+0000 7fb8b1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:39.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.732+0000 7fb8b1ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:39.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.977+0000 7fb8c33f8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:31:39.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.977+0000 7fb8c33f8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:31:39.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.977+0000 7fb8c33f8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:39.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.977+0000 7fb8c33f8640 1 -- 172.21.15.181:0/2531373433 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb8bc06d240 con 0x7fb8bc1cb840 2024-09-13T10:31:39.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.978+0000 7fb8b1ffb640 1 -- 172.21.15.181:0/2531373433 <== mon.2 v1:172.21.15.181:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2732 (unknown 254746657 0 2147212753) 0x7fb8b4017040 con 0x7fb8bc1cb840 2024-09-13T10:31:39.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.978+0000 7fb8b1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:31:39.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.978+0000 7fb8b1ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:39.981 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":36,"quorum":[1,2,3,4,5,6,7],"quorum_names":["f","b","g","c","h","d","i"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:31:39.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.980+0000 7fb8c33f8640 1 -- 172.21.15.181:0/2531373433 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb8a0040f90 legacy=0x7fb8a0043450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:39.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.980+0000 7fb8c33f8640 10 monclient: shutdown 2024-09-13T10:31:39.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.980+0000 7fb8c33f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:39.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.980+0000 7fb8c33f8640 1 -- 172.21.15.181:0/2531373433 >> v1:172.21.15.181:6790/0 conn(0x7fb8bc1cb840 legacy=0x7fb8bc1d6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:39.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.980+0000 7fb8c33f8640 1 -- 172.21.15.181:0/2531373433 shutdown_connections 2024-09-13T10:31:39.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.980+0000 7fb8c33f8640 1 -- 172.21.15.181:0/2531373433 >> 172.21.15.181:0/2531373433 conn(0x7fb8bc077120 msgr2=0x7fb8bc130370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:39.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.980+0000 7fb8c33f8640 1 -- 172.21.15.181:0/2531373433 shutdown_connections 2024-09-13T10:31:39.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:39.980+0000 7fb8c33f8640 1 -- 172.21.15.181:0/2531373433 wait complete. 2024-09-13T10:31:42.994 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:31:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.100+0000 7f64e8057640 10 monclient: get_monmap_and_config 2024-09-13T10:31:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.100+0000 7f64e8057640 10 monclient: build_initial_monmap 2024-09-13T10:31:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.100+0000 7f64e8057640 10 monclient: monmap: 2024-09-13T10:31:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:43.102042+0000 2024-09-13T10:31:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:43.102042+0000 2024-09-13T10:31:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:43.107 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 1 Processor -- start 2024-09-13T10:31:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 1 -- start start 2024-09-13T10:31:43.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 10 monclient: init 2024-09-13T10:31:43.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:43.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 10 monclient: _add_conns ranks=[1,6,7,4,0,5,2,8,3] 2024-09-13T10:31:43.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 10 monclient(hunting): picked mon.noname-f con 0x7f64e00a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:43.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 10 monclient(hunting): picked mon.noname-d con 0x7f64e00a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:43.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 10 monclient(hunting): picked mon.noname-i con 0x7f64e013f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:43.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e00a5fe0 con 0x7f64e00a66d0 2024-09-13T10:31:43.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e00a8080 con 0x7f64e00a6ab0 2024-09-13T10:31:43.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e00a42c0 con 0x7f64e013f9a0 2024-09-13T10:31:43.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:43.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e8057640 10 monclient(hunting): authenticate will time out at 842.607887s 2024-09-13T10:31:43.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e55f2640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f64e00a6ab0 0x7f64e00a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:59756/0 (socket says 172.21.15.181:59756) 2024-09-13T10:31:43.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.101+0000 7f64e55f2640 1 -- 172.21.15.181:0/2522903261 learned_addr learned my addr 172.21.15.181:0/2522903261 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:43.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.104+0000 7f64e55f2640 1 -- 172.21.15.181:0/2522903261 >> v1:172.21.15.181:6792/0 conn(0x7f64e00a6ab0 legacy=0x7f64e00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:43.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.104+0000 7f64e65f4640 1 -- 172.21.15.181:0/2522903261 >> v1:172.21.15.195:6792/0 conn(0x7f64e013f9a0 legacy=0x7f64e0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:43.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:43.104+0000 7f64e5df3640 1 -- 172.21.15.181:0/2522903261 >> v1:172.21.15.195:6789/0 conn(0x7f64e00a66d0 legacy=0x7f64e00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 10 monclient(hunting): tick 2024-09-13T10:31:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:31:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 1 monclient(hunting): continuing hunt 2024-09-13T10:31:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:31:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 1 -- 172.21.15.181:0/2522903261 >> v1:172.21.15.195:6792/0 conn(0x7f64e013f9a0 legacy=0x7f64e0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 1 -- 172.21.15.181:0/2522903261 >> v1:172.21.15.181:6792/0 conn(0x7f64e00a6ab0 legacy=0x7f64e00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 1 -- 172.21.15.181:0/2522903261 >> v1:172.21.15.195:6789/0 conn(0x7f64e00a66d0 legacy=0x7f64e00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 10 monclient: _add_conns ranks=[3,8,2,0,4,5] 2024-09-13T10:31:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 10 monclient(hunting): picked mon.noname-g con 0x7f64c4003960 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:46.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 10 monclient(hunting): picked mon.noname-e con 0x7f64c40075f0 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:46.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 10 monclient(hunting): picked mon.noname-b con 0x7f64c400b360 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:46.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 1 -- 172.21.15.181:0/2522903261 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e01464e0 con 0x7f64c400b360 2024-09-13T10:31:46.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 1 -- 172.21.15.181:0/2522903261 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64c4010160 con 0x7f64c4003960 2024-09-13T10:31:46.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 1 -- 172.21.15.181:0/2522903261 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64c4011400 con 0x7f64c40075f0 2024-09-13T10:31:46.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64d77fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:46.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.102+0000 7f64e55f2640 1 -- 172.21.15.181:0/2522903261 >> v1:172.21.15.181:6793/0 conn(0x7f64c40075f0 legacy=0x7f64c4009ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:31:46.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.104+0000 7f64e65f4640 1 -- 172.21.15.181:0/2522903261 >> v1:172.21.15.181:6790/0 conn(0x7f64c400b360 legacy=0x7f64c400d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.104+0000 7f64e5df3640 1 -- 172.21.15.181:0/2522903261 >> v1:172.21.15.195:6790/0 conn(0x7f64c4003960 legacy=0x7f64c4005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 1 -- 172.21.15.181:0/2522903261 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666329035 0 0) 0x7f64e01464e0 con 0x7f64c400b360 2024-09-13T10:31:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient(hunting): my global_id is 64262 2024-09-13T10:31:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 1 -- 172.21.15.181:0/2522903261 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64cc003520 con 0x7f64c400b360 2024-09-13T10:31:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 1 -- 172.21.15.181:0/2522903261 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211062380 0 0) 0x7f64c4010160 con 0x7f64c4003960 2024-09-13T10:31:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient(hunting): my global_id is 4800 2024-09-13T10:31:46.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 1 -- 172.21.15.181:0/2522903261 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64e01464e0 con 0x7f64c4003960 2024-09-13T10:31:46.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 1 -- 172.21.15.181:0/2522903261 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3178357678 0 0) 0x7f64cc003520 con 0x7f64c400b360 2024-09-13T10:31:46.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 1 -- 172.21.15.181:0/2522903261 >> v1:172.21.15.181:6793/0 conn(0x7f64c40075f0 legacy=0x7f64c4009ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:31:46.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 1 -- 172.21.15.181:0/2522903261 >> v1:172.21.15.195:6790/0 conn(0x7f64c4003960 legacy=0x7f64c4005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient: _finish_hunting 0 2024-09-13T10:31:46.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 1 monclient: found mon.noname-b 2024-09-13T10:31:46.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:46.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e65f4640 1 -- 172.21.15.181:0/2522903261 reap_dead start 2024-09-13T10:31:46.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:31:46.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 1 -- 172.21.15.181:0/2522903261 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c40126a0 con 0x7f64c400b360 2024-09-13T10:31:46.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient: _finish_auth 0 2024-09-13T10:31:46.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient: _check_auth_tickets 2024-09-13T10:31:46.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:46.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 1 -- 172.21.15.181:0/2522903261 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f64d8001ec0 con 0x7f64c400b360 2024-09-13T10:31:46.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:46.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e4df1640 10 monclient: dump: 2024-09-13T10:31:46.284 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.284 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.284 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.284 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.285 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.285 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.285 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.285 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.285 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.285 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.285 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.285 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.285 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.285 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.285 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.285 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e8057640 5 monclient: authenticate success, global_id 64262 2024-09-13T10:31:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.278+0000 7f64e8057640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.279+0000 7f64e4df1640 1 -- 172.21.15.181:0/2522903261 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64d8003990 con 0x7f64c400b360 2024-09-13T10:31:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.279+0000 7f64e4df1640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.279+0000 7f64e4df1640 1 -- 172.21.15.181:0/2522903261 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f64d8003e80 con 0x7f64c400b360 2024-09-13T10:31:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.279+0000 7f64e4df1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.279+0000 7f64e4df1640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.279+0000 7f64e4df1640 10 monclient: dump: 2024-09-13T10:31:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.287 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.287 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.287 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.287 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.287 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.287 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.287 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.287 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.287 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.287 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.287 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.288 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.279+0000 7f64e8057640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:46.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.279+0000 7f64e8057640 4 set_mon_vals no callback set 2024-09-13T10:31:46.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.280+0000 7f64e8057640 10 monclient: shutdown 2024-09-13T10:31:46.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.280+0000 7f64e8057640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:46.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.280+0000 7f64e8057640 1 -- 172.21.15.181:0/2522903261 >> v1:172.21.15.181:6790/0 conn(0x7f64c400b360 legacy=0x7f64c400d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.280+0000 7f64e8057640 1 -- 172.21.15.181:0/2522903261 shutdown_connections 2024-09-13T10:31:46.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.280+0000 7f64e8057640 1 -- 172.21.15.181:0/2522903261 >> 172.21.15.181:0/2522903261 conn(0x7f64e00abcd0 msgr2=0x7f64e00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:46.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.280+0000 7f64e8057640 1 -- 172.21.15.181:0/2522903261 shutdown_connections 2024-09-13T10:31:46.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.280+0000 7f64e8057640 1 -- 172.21.15.181:0/2522903261 wait complete. 2024-09-13T10:31:46.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.281+0000 7f64e8057640 10 monclient: build_initial_monmap 2024-09-13T10:31:46.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.281+0000 7f64e8057640 10 monclient: monmap: 2024-09-13T10:31:46.294 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:46.294 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:46.294 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:46.294 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:46.294 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:46.294 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:46.294 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:46.295 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:46.295 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:46.295 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:46.295 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:46.295 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:46.295 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:46.295 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:46.295 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:46.295 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.282+0000 7f64e8057640 1 Processor -- start 2024-09-13T10:31:46.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.282+0000 7f64e8057640 1 -- start start 2024-09-13T10:31:46.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.282+0000 7f64e8057640 10 monclient: init 2024-09-13T10:31:46.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e8057640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:46.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e8057640 10 monclient: _add_conns ranks=[5,4,2,8,6,1,7,0,3] 2024-09-13T10:31:46.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e8057640 10 monclient(hunting): picked mon.noname-h con 0x7f64c400b360 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:46.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e8057640 10 monclient(hunting): picked mon.noname-c con 0x7f64e009fba0 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:46.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e8057640 10 monclient(hunting): picked mon.noname-b con 0x7f64e01d4d50 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:46.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e8057640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e01461b0 con 0x7f64e01d4d50 2024-09-13T10:31:46.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e8057640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e00a0600 con 0x7f64e009fba0 2024-09-13T10:31:46.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e8057640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64e00a2680 con 0x7f64c400b360 2024-09-13T10:31:46.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e8057640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:46.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e8057640 10 monclient(hunting): authenticate will time out at 845.789275s 2024-09-13T10:31:46.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e65f4640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f64e01d4d50 0x7f64e01d7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:38748/0 (socket says 172.21.15.181:38748) 2024-09-13T10:31:46.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e65f4640 1 -- 172.21.15.181:0/2326039326 learned_addr learned my addr 172.21.15.181:0/2326039326 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:46.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.283+0000 7f64e55f2640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f64e009fba0 0x7f64e01d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:34086/0 (socket says 172.21.15.181:34086) 2024-09-13T10:31:46.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.285+0000 7f64e65f4640 1 -- 172.21.15.181:0/2326039326 >> v1:172.21.15.181:6790/0 conn(0x7f64e01d4d50 legacy=0x7f64e01d7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.285+0000 7f64e5df3640 1 -- 172.21.15.181:0/2326039326 >> v1:172.21.15.195:6791/0 conn(0x7f64c400b360 legacy=0x7f64e01452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.285+0000 7f64e55f2640 1 -- 172.21.15.181:0/2326039326 >> v1:172.21.15.181:6791/0 conn(0x7f64e009fba0 legacy=0x7f64e01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.285+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157300720 0 0) 0x7f64e00a0600 con 0x7f64e009fba0 2024-09-13T10:31:46.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.285+0000 7f64d67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.285+0000 7f64d67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.285+0000 7f64d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.285+0000 7f64d67fc640 10 monclient(hunting): my global_id is 4846 2024-09-13T10:31:46.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.285+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64c400f170 con 0x7f64e009fba0 2024-09-13T10:31:46.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1043288519 0 0) 0x7f64c400f170 con 0x7f64e009fba0 2024-09-13T10:31:46.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f64e00a0600 con 0x7f64e009fba0 2024-09-13T10:31:46.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f64d0001cf0 con 0x7f64e009fba0 2024-09-13T10:31:46.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:46.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 10 monclient(hunting): dump: 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.299 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.300 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.300 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.300 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.300 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:46.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1182623 0 0) 0x7f64e00a0600 con 0x7f64e009fba0 2024-09-13T10:31:46.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 >> v1:172.21.15.195:6791/0 conn(0x7f64c400b360 legacy=0x7f64e01452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 >> v1:172.21.15.181:6790/0 conn(0x7f64e01d4d50 legacy=0x7f64e01d7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:31:46.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 1 monclient: found mon.c 2024-09-13T10:31:46.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:46.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:46.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e00a1620 con 0x7f64e009fba0 2024-09-13T10:31:46.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 10 monclient: _finish_auth 0 2024-09-13T10:31:46.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:31:46.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:46.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64e8057640 5 monclient: authenticate success, global_id 4846 2024-09-13T10:31:46.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64e8057640 10 monclient: _renew_subs 2024-09-13T10:31:46.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64e8057640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:46.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64e8057640 1 -- 172.21.15.181:0/2326039326 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f64e00a2960 con 0x7f64e009fba0 2024-09-13T10:31:46.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64e8057640 10 monclient: _renew_subs 2024-09-13T10:31:46.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64e8057640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:46.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64e8057640 1 -- 172.21.15.181:0/2326039326 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f64e01459f0 con 0x7f64e009fba0 2024-09-13T10:31:46.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64d0004b10 con 0x7f64e009fba0 2024-09-13T10:31:46.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:46.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f64d0005080 con 0x7f64e009fba0 2024-09-13T10:31:46.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:46.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d7fff640 4 set_mon_vals no callback set 2024-09-13T10:31:46.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.286+0000 7f64d67fc640 10 monclient: dump: 2024-09-13T10:31:46.302 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.302 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.302 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.303 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.303 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.303 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.303 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.303 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.303 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.303 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.303 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.303 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.303 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.303 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.303 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.304 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.287+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f64d0005320 con 0x7f64e009fba0 2024-09-13T10:31:46.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.288+0000 7f64e8057640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:46.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.288+0000 7f64e8057640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:46.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.288+0000 7f64e8057640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:46.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.288+0000 7f64e8057640 1 -- 172.21.15.181:0/2326039326 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c8005080 con 0x7f64e009fba0 2024-09-13T10:31:46.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.288+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(50..50 src has 1..50) ==== 3898+0+0 (unknown 3974595773 0 0) 0x7f64d004e300 con 0x7f64e009fba0 2024-09-13T10:31:46.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.288+0000 7f64e5df3640 10 monclient: get_auth_request con 0x7f64c4041090 auth_method 0 2024-09-13T10:31:46.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.293+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f64d00176d0 con 0x7f64e009fba0 2024-09-13T10:31:46.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.293+0000 7f64d67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:46.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.293+0000 7f64d67fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:46.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.542+0000 7f64e8057640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:31:46.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.542+0000 7f64e8057640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:31:46.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.542+0000 7f64e8057640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:46.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.542+0000 7f64e8057640 1 -- 172.21.15.181:0/2326039326 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f64c8005370 con 0x7f64e009fba0 2024-09-13T10:31:46.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.542+0000 7f64d67fc640 1 -- 172.21.15.181:0/2326039326 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2738 (unknown 254746657 0 1364312071) 0x7f64d001b840 con 0x7f64e009fba0 2024-09-13T10:31:46.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.542+0000 7f64d67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:31:46.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.542+0000 7f64d67fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:46.545 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":42,"quorum":[0,1,2,3,4,5,6,7],"quorum_names":["a","f","b","g","c","h","d","i"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:31:46.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.544+0000 7f64e8057640 1 -- 172.21.15.181:0/2326039326 >> v1:172.21.15.195:6800/1839191919 conn(0x7f64c4041090 legacy=0x7f64c4043550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.544+0000 7f64e8057640 10 monclient: shutdown 2024-09-13T10:31:46.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.545+0000 7f64e8057640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:46.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.545+0000 7f64e8057640 1 -- 172.21.15.181:0/2326039326 >> v1:172.21.15.181:6791/0 conn(0x7f64e009fba0 legacy=0x7f64e01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.545+0000 7f64e8057640 1 -- 172.21.15.181:0/2326039326 shutdown_connections 2024-09-13T10:31:46.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.545+0000 7f64e8057640 1 -- 172.21.15.181:0/2326039326 >> 172.21.15.181:0/2326039326 conn(0x7f64e00abcd0 msgr2=0x7f64e00a9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:46.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.545+0000 7f64e8057640 1 -- 172.21.15.181:0/2326039326 shutdown_connections 2024-09-13T10:31:46.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.545+0000 7f64e8057640 1 -- 172.21.15.181:0/2326039326 wait complete. 2024-09-13T10:31:46.558 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-09-13T10:31:46.558 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-09-13T10:31:46.558 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:31:46.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.655+0000 7f4ee783c640 10 monclient: get_monmap_and_config 2024-09-13T10:31:46.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.655+0000 7f4ee783c640 10 monclient: build_initial_monmap 2024-09-13T10:31:46.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.655+0000 7f4ee783c640 10 monclient: monmap: 2024-09-13T10:31:46.658 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:46.658 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.658 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:46.656794+0000 2024-09-13T10:31:46.658 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:46.656794+0000 2024-09-13T10:31:46.658 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:46.658 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.658 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:46.659 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:46.659 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:46.659 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:46.659 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:46.659 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:46.659 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:46.659 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:46.659 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:46.659 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.655+0000 7f4ee783c640 1 Processor -- start 2024-09-13T10:31:46.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.655+0000 7f4ee783c640 1 -- start start 2024-09-13T10:31:46.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.655+0000 7f4ee783c640 10 monclient: init 2024-09-13T10:31:46.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.656+0000 7f4ee783c640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:46.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.656+0000 7f4ee783c640 10 monclient: _add_conns ranks=[6,2,5,8,1,0,3,7,4] 2024-09-13T10:31:46.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.656+0000 7f4ee783c640 10 monclient(hunting): picked mon.noname-d con 0x7f4ee00a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:46.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.656+0000 7f4ee783c640 10 monclient(hunting): picked mon.noname-b con 0x7f4ee00a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:46.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.656+0000 7f4ee783c640 10 monclient(hunting): picked mon.noname-h con 0x7f4ee013f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:46.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.656+0000 7f4ee783c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee00a5fe0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.656+0000 7f4ee783c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee00a8080 con 0x7f4ee013f9a0 2024-09-13T10:31:46.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.656+0000 7f4ee783c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee00a42c0 con 0x7f4ee00a66d0 2024-09-13T10:31:46.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.656+0000 7f4ee783c640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:46.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.656+0000 7f4ee783c640 10 monclient(hunting): authenticate will time out at 846.162493s 2024-09-13T10:31:46.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.656+0000 7f4ee4dd7640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f4ee00a6ab0 0x7f4ee00a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:38754/0 (socket says 172.21.15.181:38754) 2024-09-13T10:31:46.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.656+0000 7f4ee4dd7640 1 -- 172.21.15.181:0/561421525 learned_addr learned my addr 172.21.15.181:0/561421525 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:46.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.658+0000 7f4ee55d8640 1 -- 172.21.15.181:0/561421525 >> v1:172.21.15.181:6792/0 conn(0x7f4ee00a66d0 legacy=0x7f4ee00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.658+0000 7f4ee4dd7640 1 -- 172.21.15.181:0/561421525 >> v1:172.21.15.181:6790/0 conn(0x7f4ee00a6ab0 legacy=0x7f4ee00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 1 -- 172.21.15.181:0/561421525 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299380660 0 0) 0x7f4ee00a5fe0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient(hunting): my global_id is 64271 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 1 -- 172.21.15.181:0/561421525 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ecc003520 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee5dd9640 1 -- 172.21.15.181:0/561421525 >> v1:172.21.15.195:6791/0 conn(0x7f4ee013f9a0 legacy=0x7f4ee0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 1 -- 172.21.15.181:0/561421525 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3629251562 0 0) 0x7f4ecc003520 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 1 -- 172.21.15.181:0/561421525 >> v1:172.21.15.181:6792/0 conn(0x7f4ee00a66d0 legacy=0x7f4ee00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 1 -- 172.21.15.181:0/561421525 >> v1:172.21.15.195:6791/0 conn(0x7f4ee013f9a0 legacy=0x7f4ee0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient: _finish_hunting 0 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 1 monclient: found mon.noname-b 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 1 -- 172.21.15.181:0/561421525 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee01464e0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient: _finish_auth 0 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient: _check_auth_tickets 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:46.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee783c640 5 monclient: authenticate success, global_id 64271 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 1 -- 172.21.15.181:0/561421525 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ed0001ad0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee783c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient: dump: 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.667 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.669 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.669 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.669 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.669 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.669 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.669 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.669 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee783c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 1 -- 172.21.15.181:0/561421525 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ed00048a0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 1 -- 172.21.15.181:0/561421525 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ed0004dd0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee783c640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee783c640 4 set_mon_vals no callback set 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ed7fff640 10 monclient: dump: 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.670 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee783c640 10 monclient: shutdown 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee783c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee783c640 1 -- 172.21.15.181:0/561421525 >> v1:172.21.15.181:6790/0 conn(0x7f4ee00a6ab0 legacy=0x7f4ee00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee783c640 1 -- 172.21.15.181:0/561421525 shutdown_connections 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee783c640 1 -- 172.21.15.181:0/561421525 >> 172.21.15.181:0/561421525 conn(0x7f4ee00abcd0 msgr2=0x7f4ee00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee783c640 1 -- 172.21.15.181:0/561421525 shutdown_connections 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.659+0000 7f4ee783c640 1 -- 172.21.15.181:0/561421525 wait complete. 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.660+0000 7f4ee783c640 10 monclient: build_initial_monmap 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.660+0000 7f4ee783c640 10 monclient: monmap: 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:46.672 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.660+0000 7f4ee783c640 1 Processor -- start 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.660+0000 7f4ee783c640 1 -- start start 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.660+0000 7f4ee783c640 10 monclient: init 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee783c640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee783c640 10 monclient: _add_conns ranks=[3,0,8,2,7,4,6,1,5] 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee783c640 10 monclient(hunting): picked mon.noname-g con 0x7f4ee00a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:46.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee783c640 10 monclient(hunting): picked mon.noname-a con 0x7f4ee00a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee783c640 10 monclient(hunting): picked mon.noname-e con 0x7f4ee013f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee783c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee013f0f0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee783c640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee013f3d0 con 0x7f4ee00a66d0 2024-09-13T10:31:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee783c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee01cf210 con 0x7f4ee013f9a0 2024-09-13T10:31:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee783c640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee783c640 10 monclient(hunting): authenticate will time out at 846.167280s 2024-09-13T10:31:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee5dd9640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f4ee013f9a0 legacy=0x7f4ee01d6650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:31:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee4dd7640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4ee00a6ab0 0x7f4ee01ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49790/0 (socket says 172.21.15.181:49790) 2024-09-13T10:31:46.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.661+0000 7f4ee4dd7640 1 -- 172.21.15.181:0/2186215533 learned_addr learned my addr 172.21.15.181:0/2186215533 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:46.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.663+0000 7f4ee4dd7640 1 -- 172.21.15.181:0/2186215533 >> v1:172.21.15.181:6789/0 conn(0x7f4ee00a6ab0 legacy=0x7f4ee01ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.663+0000 7f4ee55d8640 1 -- 172.21.15.181:0/2186215533 >> v1:172.21.15.195:6790/0 conn(0x7f4ee00a66d0 legacy=0x7f4ee01ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.680+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2740357433 0 0) 0x7f4ee013f0f0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.680+0000 7f4ed5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.680+0000 7f4ed5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.680+0000 7f4ed5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.680+0000 7f4ed5ffb640 10 monclient(hunting): my global_id is 54738 2024-09-13T10:31:46.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.680+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ec4003550 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.680+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2151860911 0 0) 0x7f4ee013f3d0 con 0x7f4ee00a66d0 2024-09-13T10:31:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.681+0000 7f4ed5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.681+0000 7f4ed5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.681+0000 7f4ed5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.681+0000 7f4ed5ffb640 10 monclient(hunting): my global_id is 4809 2024-09-13T10:31:46.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.681+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ee013f0f0 con 0x7f4ee00a66d0 2024-09-13T10:31:46.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.685+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3118631683 0 0) 0x7f4ec4003550 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.685+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ee013f3d0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.685+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ed0004d90 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.685+0000 7f4ed5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:46.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.685+0000 7f4ed5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:46.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.685+0000 7f4ed5ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:46.690 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.690 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.690 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.690 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.691 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.691 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.691 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.691 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.691 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.691 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.691 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.685+0000 7f4ed5ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.685+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 136260952 0 0) 0x7f4ee013f3d0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.685+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 >> v1:172.21.15.181:6793/0 conn(0x7f4ee013f9a0 legacy=0x7f4ee01d6650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.685+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 >> v1:172.21.15.195:6790/0 conn(0x7f4ee00a66d0 legacy=0x7f4ee01ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ed5ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ed5ffb640 1 monclient: found mon.a 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ed5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:46.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ed5ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee01376e0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ed5ffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ed5ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ed5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ee783c640 5 monclient: authenticate success, global_id 54738 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ee783c640 10 monclient: _renew_subs 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ee783c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ee783c640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee01430b0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ee783c640 10 monclient: _renew_subs 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ee783c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.686+0000 7f4ee783c640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4ee013da30 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.687+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ed00048a0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.687+0000 7f4ed5ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:46.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.687+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ed0001a70 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.687+0000 7f4ed5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.687+0000 7f4ed5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.687+0000 7f4ed5ffb640 10 monclient: dump: 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.694 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.695 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.695 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.695 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.695 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.695 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.687+0000 7f4ed77fe640 4 set_mon_vals no callback set 2024-09-13T10:31:46.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.687+0000 7f4ee783c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:46.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.688+0000 7f4ee783c640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4ec00065c0 con 0x7f4ec0002860 2024-09-13T10:31:46.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.688+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4ed0011be0 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.689+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(51..51 src has 1..51) ==== 3898+0+0 (unknown 99038851 0 0) 0x7f4ed004e420 con 0x7f4ee00a6ab0 2024-09-13T10:31:46.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.689+0000 7f4ee5dd9640 10 monclient: get_auth_request con 0x7f4ec403fbe0 auth_method 0 2024-09-13T10:31:46.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.690+0000 7f4ee55d8640 1 -- 172.21.15.181:0/2186215533 >> v1:172.21.15.181:6789/0 conn(0x7f4ec0002860 legacy=0x7f4ec0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.691+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4117779858 0 0) 0x7f4ec00065c0 con 0x7f4ec0002860 2024-09-13T10:31:46.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.691+0000 7f4ed5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.691+0000 7f4ed5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.691+0000 7f4ed5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.691+0000 7f4ed5ffb640 10 monclient(hunting): my global_id is 54747 2024-09-13T10:31:46.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.691+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ee013f3d0 con 0x7f4ec0002860 2024-09-13T10:31:46.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.692+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 603058301 0 0) 0x7f4ee013f3d0 con 0x7f4ec0002860 2024-09-13T10:31:46.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.692+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ec00065c0 con 0x7f4ec0002860 2024-09-13T10:31:46.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.692+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4edc001cc0 con 0x7f4ec0002860 2024-09-13T10:31:46.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.692+0000 7f4ed5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.692+0000 7f4ed5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:46.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.692+0000 7f4ed5ffb640 10 monclient: dump: 2024-09-13T10:31:46.699 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.699 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.699 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.699 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.699 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.699 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.699 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.699 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.699 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.700 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.700 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.700 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.700 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.700 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.700 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.700 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.692+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2464239518 0 0) 0x7f4ec00065c0 con 0x7f4ec0002860 2024-09-13T10:31:46.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.692+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ec000a160 con 0x7f4ec0002860 2024-09-13T10:31:46.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.693+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4edc0057c0 con 0x7f4ec0002860 2024-09-13T10:31:46.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.693+0000 7f4ed5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:46.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.693+0000 7f4ed5ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:46.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.693+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 >> v1:172.21.15.181:6789/0 conn(0x7f4ec0002860 legacy=0x7f4ec0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.693+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 >> v1:172.21.15.181:6789/0 conn(0x7f4ec0002860 legacy=0x7f4ec0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:46.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.700+0000 7f4ee783c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:46.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.700+0000 7f4ee783c640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4ec000c4f0 con 0x7f4ec0009110 2024-09-13T10:31:46.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ee55d8640 1 -- 172.21.15.181:0/2186215533 >> v1:172.21.15.181:6789/0 conn(0x7f4ec0009110 legacy=0x7f4ec0009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3741182372 0 0) 0x7f4ec000c4f0 con 0x7f4ec0009110 2024-09-13T10:31:46.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 10 monclient(hunting): my global_id is 54756 2024-09-13T10:31:46.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ec00065c0 con 0x7f4ec0009110 2024-09-13T10:31:46.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2836264076 0 0) 0x7f4ec00065c0 con 0x7f4ec0009110 2024-09-13T10:31:46.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ec000c4f0 con 0x7f4ec0009110 2024-09-13T10:31:46.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4edc003c80 con 0x7f4ec0009110 2024-09-13T10:31:46.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:46.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 10 monclient: dump: 2024-09-13T10:31:46.708 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.708 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.708 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.708 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 794304792 0 0) 0x7f4ec000c4f0 con 0x7f4ec0009110 2024-09-13T10:31:46.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4ec0009ce0 con 0x7f4ec0009110 2024-09-13T10:31:46.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7882 (unknown 0 0 2910608719) 0x7f4edc005a70 con 0x7f4ec0009110 2024-09-13T10:31:46.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:46.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:46.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 >> v1:172.21.15.181:6789/0 conn(0x7f4ec0009110 legacy=0x7f4ec0009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.703+0000 7f4ed5ffb640 1 -- 172.21.15.181:0/2186215533 >> v1:172.21.15.181:6789/0 conn(0x7f4ec0009110 legacy=0x7f4ec0009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:46.710 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:46.710 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:46.710 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:46.710 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 42, 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 121136, 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:46.711 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:46.712 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:46.713 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:46.714 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:46.715 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:46.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.719 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:46.722 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.723 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.726 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:46.728 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.729 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:46.730 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:46.730 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:46.730 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.730 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:46.730 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:31:46.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.730 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:46.730 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:46.730 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:46.730 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.730 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.731 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:46.731 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:46.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.704+0000 7f4ee783c640 1 -- 172.21.15.181:0/2186215533 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4ec403fbe0 legacy=0x7f4ec40420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.704+0000 7f4ee783c640 10 monclient: shutdown 2024-09-13T10:31:46.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.704+0000 7f4ee783c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:46.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.704+0000 7f4ee783c640 1 -- 172.21.15.181:0/2186215533 >> v1:172.21.15.181:6789/0 conn(0x7f4ee00a6ab0 legacy=0x7f4ee01ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.704+0000 7f4ee5dd9640 1 -- 172.21.15.181:0/2186215533 reap_dead start 2024-09-13T10:31:46.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.704+0000 7f4ee5dd9640 1 -- 172.21.15.181:0/2186215533 reap_dead start 2024-09-13T10:31:46.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.704+0000 7f4ee783c640 1 -- 172.21.15.181:0/2186215533 shutdown_connections 2024-09-13T10:31:46.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.704+0000 7f4ee783c640 1 -- 172.21.15.181:0/2186215533 >> 172.21.15.181:0/2186215533 conn(0x7f4ee00abcd0 msgr2=0x7f4ee0138ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:46.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.704+0000 7f4ee783c640 1 -- 172.21.15.181:0/2186215533 shutdown_connections 2024-09-13T10:31:46.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.704+0000 7f4ee783c640 1 -- 172.21.15.181:0/2186215533 wait complete. 2024-09-13T10:31:46.733 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:31:46.733 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-09-13T10:31:46.734 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:31:46.783 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:46.783 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36219]: starting. 2024-09-13T10:31:46.784 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36219]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36184 2024-09-13T10:31:46.784 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36219]: created object 0... 2024-09-13T10:31:46.784 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36219]: created object 25... 2024-09-13T10:31:46.784 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36219]: created object 49... 2024-09-13T10:31:46.784 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36219]: finishing. 2024-09-13T10:31:46.784 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36219]: shutting down. 2024-09-13T10:31:46.820 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:46.820 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36221]: starting. 2024-09-13T10:31:46.820 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36221]: listing objects. 2024-09-13T10:31:46.821 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36221]: listed object 0... 2024-09-13T10:31:46.821 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36221]: listed object 25... 2024-09-13T10:31:46.821 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36221]: saw 50 objects 2024-09-13T10:31:46.821 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36221]: shutting down. 2024-09-13T10:31:46.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.835+0000 7fab2b4db640 10 monclient: get_monmap_and_config 2024-09-13T10:31:46.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.835+0000 7fab2b4db640 10 monclient: build_initial_monmap 2024-09-13T10:31:46.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.835+0000 7fab2b4db640 10 monclient: monmap: 2024-09-13T10:31:46.837 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:46.837 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.837 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:46.836708+0000 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:46.836708+0000 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:46.838 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.835+0000 7fab2b4db640 1 Processor -- start 2024-09-13T10:31:46.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.835+0000 7fab2b4db640 1 -- start start 2024-09-13T10:31:46.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.835+0000 7fab2b4db640 10 monclient: init 2024-09-13T10:31:46.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.836+0000 7fab2b4db640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:46.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.836+0000 7fab2b4db640 10 monclient: _add_conns ranks=[5,0,7,2,8,6,4,3,1] 2024-09-13T10:31:46.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.836+0000 7fab2b4db640 10 monclient(hunting): picked mon.noname-h con 0x7fab240a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:46.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.836+0000 7fab2b4db640 10 monclient(hunting): picked mon.noname-a con 0x7fab240a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:46.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.836+0000 7fab2b4db640 10 monclient(hunting): picked mon.noname-i con 0x7fab2413f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:46.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.836+0000 7fab2b4db640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab240a5fe0 con 0x7fab240a6ab0 2024-09-13T10:31:46.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.836+0000 7fab2b4db640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab240a8080 con 0x7fab240a66d0 2024-09-13T10:31:46.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.836+0000 7fab2b4db640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab240a42c0 con 0x7fab2413f9a0 2024-09-13T10:31:46.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.836+0000 7fab2b4db640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:46.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.836+0000 7fab2b4db640 10 monclient(hunting): authenticate will time out at 846.342438s 2024-09-13T10:31:46.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.836+0000 7fab28a76640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fab240a6ab0 0x7fab240a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49826/0 (socket says 172.21.15.181:49826) 2024-09-13T10:31:46.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.836+0000 7fab28a76640 1 -- 172.21.15.181:0/1399535930 learned_addr learned my addr 172.21.15.181:0/1399535930 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:46.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.838+0000 7fab28a76640 1 -- 172.21.15.181:0/1399535930 >> v1:172.21.15.181:6789/0 conn(0x7fab240a6ab0 legacy=0x7fab240a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.838+0000 7fab1bfff640 1 -- 172.21.15.181:0/1399535930 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545895863 0 0) 0x7fab240a5fe0 con 0x7fab240a6ab0 2024-09-13T10:31:46.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.838+0000 7fab1bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.838+0000 7fab1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.838+0000 7fab1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.838+0000 7fab1bfff640 10 monclient(hunting): my global_id is 54765 2024-09-13T10:31:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.838+0000 7fab29a78640 1 -- 172.21.15.181:0/1399535930 >> v1:172.21.15.195:6792/0 conn(0x7fab2413f9a0 legacy=0x7fab24141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.838+0000 7fab1bfff640 1 -- 172.21.15.181:0/1399535930 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab10003520 con 0x7fab240a6ab0 2024-09-13T10:31:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.838+0000 7fab29277640 1 -- 172.21.15.181:0/1399535930 >> v1:172.21.15.195:6791/0 conn(0x7fab240a66d0 legacy=0x7fab240a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 1 -- 172.21.15.181:0/1399535930 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 314907776 0 0) 0x7fab10003520 con 0x7fab240a6ab0 2024-09-13T10:31:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 1 -- 172.21.15.181:0/1399535930 >> v1:172.21.15.195:6792/0 conn(0x7fab2413f9a0 legacy=0x7fab24141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 1 -- 172.21.15.181:0/1399535930 >> v1:172.21.15.195:6791/0 conn(0x7fab240a66d0 legacy=0x7fab240a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:31:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 1 monclient: found mon.noname-a 2024-09-13T10:31:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 1 -- 172.21.15.181:0/1399535930 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab241464e0 con 0x7fab240a6ab0 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 10 monclient: _finish_auth 0 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 1 -- 172.21.15.181:0/1399535930 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fab14001ad0 con 0x7fab240a6ab0 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 10 monclient: dump: 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.846 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab2b4db640 5 monclient: authenticate success, global_id 54765 2024-09-13T10:31:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab2b4db640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 1 -- 172.21.15.181:0/1399535930 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab140048a0 con 0x7fab240a6ab0 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 1 -- 172.21.15.181:0/1399535930 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fab14004dd0 con 0x7fab240a6ab0 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab2b4db640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab2b4db640 4 set_mon_vals no callback set 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab1bfff640 10 monclient: dump: 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab2b4db640 10 monclient: shutdown 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab2b4db640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab2b4db640 1 -- 172.21.15.181:0/1399535930 >> v1:172.21.15.181:6789/0 conn(0x7fab240a6ab0 legacy=0x7fab240a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab2b4db640 1 -- 172.21.15.181:0/1399535930 shutdown_connections 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab2b4db640 1 -- 172.21.15.181:0/1399535930 >> 172.21.15.181:0/1399535930 conn(0x7fab240abcd0 msgr2=0x7fab240ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab2b4db640 1 -- 172.21.15.181:0/1399535930 shutdown_connections 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.839+0000 7fab2b4db640 1 -- 172.21.15.181:0/1399535930 wait complete. 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.840+0000 7fab2b4db640 10 monclient: build_initial_monmap 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.840+0000 7fab2b4db640 10 monclient: monmap: 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:46.851 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.840+0000 7fab2b4db640 1 Processor -- start 2024-09-13T10:31:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.840+0000 7fab2b4db640 1 -- start start 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.840+0000 7fab2b4db640 10 monclient: init 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.841+0000 7fab2b4db640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.841+0000 7fab2b4db640 10 monclient: _add_conns ranks=[7,4,3,0,2,6,8,1,5] 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.841+0000 7fab2b4db640 10 monclient(hunting): picked mon.noname-i con 0x7fab240a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.841+0000 7fab2b4db640 10 monclient(hunting): picked mon.noname-c con 0x7fab240a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.841+0000 7fab2b4db640 10 monclient(hunting): picked mon.noname-g con 0x7fab2413f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.841+0000 7fab2b4db640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab2413ed20 con 0x7fab2413f9a0 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.841+0000 7fab2b4db640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab24137820 con 0x7fab240a6ab0 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.841+0000 7fab2b4db640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab2413ea40 con 0x7fab240a66d0 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.841+0000 7fab2b4db640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.841+0000 7fab2b4db640 10 monclient(hunting): authenticate will time out at 846.347236s 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.841+0000 7fab28a76640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fab240a6ab0 0x7fab2413bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:34108/0 (socket says 172.21.15.181:34108) 2024-09-13T10:31:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.841+0000 7fab28a76640 1 -- 172.21.15.181:0/1669762034 learned_addr learned my addr 172.21.15.181:0/1669762034 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab28a76640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.181:6791/0 conn(0x7fab240a6ab0 legacy=0x7fab2413bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab29a78640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.195:6790/0 conn(0x7fab2413f9a0 legacy=0x7fab2413c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab29277640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.195:6792/0 conn(0x7fab240a66d0 legacy=0x7fab2413b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3042495302 0 0) 0x7fab24137820 con 0x7fab240a6ab0 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): my global_id is 4855 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab08003550 con 0x7fab240a6ab0 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789736667 0 0) 0x7fab2413ed20 con 0x7fab2413f9a0 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): my global_id is 4818 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab24137820 con 0x7fab2413f9a0 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593798378 0 0) 0x7fab2413ea40 con 0x7fab240a66d0 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): my global_id is 54862 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab2413ed20 con 0x7fab240a66d0 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 61363910 0 0) 0x7fab08003550 con 0x7fab240a6ab0 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab2413ea40 con 0x7fab240a6ab0 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fab14004d90 con 0x7fab240a6ab0 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:31:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2597084558 0 0) 0x7fab24137820 con 0x7fab2413f9a0 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab08003550 con 0x7fab2413f9a0 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4101832275 0 0) 0x7fab2413ed20 con 0x7fab240a66d0 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab24137820 con 0x7fab240a66d0 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fab1c002000 con 0x7fab2413f9a0 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fab20001c80 con 0x7fab240a66d0 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.843+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3651942228 0 0) 0x7fab2413ea40 con 0x7fab240a6ab0 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.195:6792/0 conn(0x7fab240a66d0 legacy=0x7fab2413b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.195:6790/0 conn(0x7fab2413f9a0 legacy=0x7fab2413c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 1 monclient: found mon.c 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab241da480 con 0x7fab240a6ab0 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab2b4db640 5 monclient: authenticate success, global_id 4855 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab2b4db640 10 monclient: _renew_subs 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab2b4db640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab2b4db640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fab241d7450 con 0x7fab240a6ab0 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab14001d20 con 0x7fab240a6ab0 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fab14005700 con 0x7fab240a6ab0 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 10 monclient: dump: 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.867 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.868 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.868 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.868 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.868 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.868 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.868 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.868 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.868 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.868 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.868 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.868 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab2b4db640 10 monclient: _renew_subs 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab2b4db640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab1b7fe640 4 set_mon_vals no callback set 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab2b4db640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fab241d79b0 con 0x7fab240a6ab0 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.844+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fab14011d80 con 0x7fab240a6ab0 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.845+0000 7fab2b4db640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.845+0000 7fab2b4db640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fab240a3240 con 0x7fab2413fd80 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.845+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(51..51 src has 1..51) ==== 3898+0+0 (unknown 99038851 0 0) 0x7fab1404e4b0 con 0x7fab240a6ab0 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.845+0000 7fab29a78640 10 monclient: get_auth_request con 0x7fab080405c0 auth_method 0 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab29277640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.181:6790/0 conn(0x7fab2413fd80 legacy=0x7fab241d9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2165933174 0 0) 0x7fab240a3240 con 0x7fab2413fd80 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 10 monclient(hunting): my global_id is 64280 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab2413ea40 con 0x7fab2413fd80 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4131193019 0 0) 0x7fab2413ea40 con 0x7fab2413fd80 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab240a3240 con 0x7fab2413fd80 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fab20003c00 con 0x7fab2413fd80 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 10 monclient: dump: 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.870 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.871 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3170593716 0 0) 0x7fab240a3240 con 0x7fab2413fd80 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.847+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab241391e0 con 0x7fab2413fd80 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.848+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fab20003ef0 con 0x7fab2413fd80 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.848+0000 7fab19ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.848+0000 7fab19ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.848+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.181:6790/0 conn(0x7fab2413fd80 legacy=0x7fab241d9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.848+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.181:6790/0 conn(0x7fab2413fd80 legacy=0x7fab241d9cb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.854+0000 7fab2b4db640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.854+0000 7fab2b4db640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fab2406dfc0 con 0x7fab2402e200 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.856+0000 7fab29277640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.181:6790/0 conn(0x7fab2402e200 legacy=0x7fab24140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.856+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164329572 0 0) 0x7fab2406dfc0 con 0x7fab2402e200 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.856+0000 7fab19ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:46.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.856+0000 7fab19ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.856+0000 7fab19ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.856+0000 7fab19ffb640 10 monclient(hunting): my global_id is 64289 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.856+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab240a3240 con 0x7fab2402e200 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3378122999 0 0) 0x7fab240a3240 con 0x7fab2402e200 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab2406dfc0 con 0x7fab2402e200 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fab20004310 con 0x7fab2402e200 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 10 monclient: dump: 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:46.873 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3792653836 0 0) 0x7fab2406dfc0 con 0x7fab2402e200 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fab24068ce0 con 0x7fab2402e200 2024-09-13T10:31:46.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7547 (unknown 0 0 2789060802) 0x7fab20005b00 con 0x7fab2402e200 2024-09-13T10:31:46.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:46.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:46.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.181:6790/0 conn(0x7fab2402e200 legacy=0x7fab24140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab19ffb640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.181:6790/0 conn(0x7fab2402e200 legacy=0x7fab24140160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:46.875 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 42, 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 32762, 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:46.880 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:46.880 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.880 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:46.880 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:46.880 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:46.880 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:46.880 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:46.880 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:46.880 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:46.880 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:46.881 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:46.881 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:46.881 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:46.881 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:46.881 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:46.881 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:46.881 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:46.881 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:46.881 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:46.881 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:46.881 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:46.881 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:46.897 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:46.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab2b4db640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.195:6800/1839191919 conn(0x7fab080405c0 legacy=0x7fab08042a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab2b4db640 10 monclient: shutdown 2024-09-13T10:31:46.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab2b4db640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:46.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab2b4db640 1 -- 172.21.15.181:0/1669762034 >> v1:172.21.15.181:6791/0 conn(0x7fab240a6ab0 legacy=0x7fab2413bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:46.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab29a78640 1 -- 172.21.15.181:0/1669762034 reap_dead start 2024-09-13T10:31:46.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab29a78640 1 -- 172.21.15.181:0/1669762034 reap_dead start 2024-09-13T10:31:46.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab2b4db640 1 -- 172.21.15.181:0/1669762034 shutdown_connections 2024-09-13T10:31:46.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.857+0000 7fab2b4db640 1 -- 172.21.15.181:0/1669762034 >> 172.21.15.181:0/1669762034 conn(0x7fab240abcd0 msgr2=0x7fab240a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:46.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.858+0000 7fab2b4db640 1 -- 172.21.15.181:0/1669762034 shutdown_connections 2024-09-13T10:31:46.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.858+0000 7fab2b4db640 1 -- 172.21.15.181:0/1669762034 wait complete. 2024-09-13T10:31:46.899 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:31:46.899 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-09-13T10:31:46.899 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:31:46.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.995+0000 7f2495975640 10 monclient: get_monmap_and_config 2024-09-13T10:31:46.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.995+0000 7f2495975640 10 monclient: build_initial_monmap 2024-09-13T10:31:46.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.995+0000 7f2495975640 10 monclient: monmap: 2024-09-13T10:31:46.998 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:46.998 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:46.997425+0000 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:46.997425+0000 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:46.999 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.996+0000 7f2495975640 1 Processor -- start 2024-09-13T10:31:47.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.996+0000 7f2495975640 1 -- start start 2024-09-13T10:31:47.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.996+0000 7f2495975640 10 monclient: init 2024-09-13T10:31:47.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.996+0000 7f2495975640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:47.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.996+0000 7f2495975640 10 monclient: _add_conns ranks=[6,5,8,1,3,7,2,4,0] 2024-09-13T10:31:47.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.996+0000 7f2495975640 10 monclient(hunting): picked mon.noname-d con 0x7f24900a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:47.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.996+0000 7f2495975640 10 monclient(hunting): picked mon.noname-h con 0x7f24900a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:47.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.997+0000 7f2495975640 10 monclient(hunting): picked mon.noname-e con 0x7f249013f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:47.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.997+0000 7f2495975640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24900a5fe0 con 0x7f24900a6ab0 2024-09-13T10:31:47.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.997+0000 7f2495975640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24900a8080 con 0x7f24900a66d0 2024-09-13T10:31:47.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.997+0000 7f2495975640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24900a42c0 con 0x7f249013f9a0 2024-09-13T10:31:47.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.997+0000 7f2495975640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:47.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.997+0000 7f2495975640 10 monclient(hunting): authenticate will time out at 846.503064s 2024-09-13T10:31:47.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.997+0000 7f248f7fe640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f249013f9a0 legacy=0x7f2490141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:31:47.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.997+0000 7f248effd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f24900a66d0 0x7f24900a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:39568/0 (socket says 172.21.15.181:39568) 2024-09-13T10:31:47.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.997+0000 7f248effd640 1 -- 172.21.15.181:0/2466282026 learned_addr learned my addr 172.21.15.181:0/2466282026 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:47.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248effd640 1 -- 172.21.15.181:0/2466282026 >> v1:172.21.15.181:6792/0 conn(0x7f24900a66d0 legacy=0x7f24900a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 1 -- 172.21.15.181:0/2466282026 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440344835 0 0) 0x7f24900a8080 con 0x7f24900a66d0 2024-09-13T10:31:47.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient(hunting): my global_id is 4821 2024-09-13T10:31:47.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 1 -- 172.21.15.181:0/2466282026 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2478003520 con 0x7f24900a66d0 2024-09-13T10:31:47.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248e7fc640 1 -- 172.21.15.181:0/2466282026 >> v1:172.21.15.195:6791/0 conn(0x7f24900a6ab0 legacy=0x7f24900a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 1 -- 172.21.15.181:0/2466282026 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2367445516 0 0) 0x7f24900a5fe0 con 0x7f24900a6ab0 2024-09-13T10:31:47.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient(hunting): my global_id is 4874 2024-09-13T10:31:47.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 1 -- 172.21.15.181:0/2466282026 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24900a8080 con 0x7f24900a6ab0 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 1 -- 172.21.15.181:0/2466282026 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3658532904 0 0) 0x7f2478003520 con 0x7f24900a66d0 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 1 -- 172.21.15.181:0/2466282026 >> v1:172.21.15.181:6793/0 conn(0x7f249013f9a0 legacy=0x7f2490141d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 1 -- 172.21.15.181:0/2466282026 >> v1:172.21.15.195:6791/0 conn(0x7f24900a6ab0 legacy=0x7f24900a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 1 monclient: found mon.noname-d 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 1 -- 172.21.15.181:0/2466282026 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24901464e0 con 0x7f24900a66d0 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 1 -- 172.21.15.181:0/2466282026 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2480001ae0 con 0x7f24900a66d0 2024-09-13T10:31:47.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:31:47.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient: dump: 2024-09-13T10:31:47.011 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.011 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.011 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.012 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.012 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.012 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.012 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.012 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.012 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.012 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.012 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.012 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.012 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.012 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.012 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f2495975640 5 monclient: authenticate success, global_id 4821 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f2495975640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 1 -- 172.21.15.181:0/2466282026 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2480001d30 con 0x7f24900a66d0 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 1 -- 172.21.15.181:0/2466282026 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2480004be0 con 0x7f24900a66d0 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f2495975640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f2495975640 4 set_mon_vals no callback set 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:46.999+0000 7f248dffb640 10 monclient: dump: 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.013 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.000+0000 7f2495975640 10 monclient: shutdown 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.000+0000 7f2495975640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.000+0000 7f2495975640 1 -- 172.21.15.181:0/2466282026 >> v1:172.21.15.181:6792/0 conn(0x7f24900a66d0 legacy=0x7f24900a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.000+0000 7f2495975640 1 -- 172.21.15.181:0/2466282026 shutdown_connections 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.000+0000 7f2495975640 1 -- 172.21.15.181:0/2466282026 >> 172.21.15.181:0/2466282026 conn(0x7f24900abcd0 msgr2=0x7f24900ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.000+0000 7f2495975640 1 -- 172.21.15.181:0/2466282026 shutdown_connections 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.000+0000 7f2495975640 1 -- 172.21.15.181:0/2466282026 wait complete. 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.000+0000 7f2495975640 10 monclient: build_initial_monmap 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.000+0000 7f2495975640 10 monclient: monmap: 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:47.015 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.001+0000 7f2495975640 1 Processor -- start 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.001+0000 7f2495975640 1 -- start start 2024-09-13T10:31:47.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.001+0000 7f2495975640 10 monclient: init 2024-09-13T10:31:47.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.001+0000 7f2495975640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:47.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.001+0000 7f2495975640 10 monclient: _add_conns ranks=[4,2,1,5,6,0,3,7,8] 2024-09-13T10:31:47.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.001+0000 7f2495975640 10 monclient(hunting): picked mon.noname-c con 0x7f24900a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:47.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.001+0000 7f2495975640 10 monclient(hunting): picked mon.noname-b con 0x7f24900a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:47.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.001+0000 7f2495975640 10 monclient(hunting): picked mon.noname-f con 0x7f249013f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:47.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.001+0000 7f2495975640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2490142db0 con 0x7f249013f9a0 2024-09-13T10:31:47.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.002+0000 7f2495975640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2490068c50 con 0x7f24900a6ab0 2024-09-13T10:31:47.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.002+0000 7f2495975640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249013da10 con 0x7f24900a66d0 2024-09-13T10:31:47.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.002+0000 7f248effd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f24900a66d0 0x7f2490136730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:34110/0 (socket says 172.21.15.181:34110) 2024-09-13T10:31:47.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.002+0000 7f248effd640 1 -- 172.21.15.181:0/1267685509 learned_addr learned my addr 172.21.15.181:0/1267685509 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:47.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.002+0000 7f2495975640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:47.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.002+0000 7f2495975640 10 monclient(hunting): authenticate will time out at 846.508110s 2024-09-13T10:31:47.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f248e7fc640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6790/0 conn(0x7f24900a6ab0 legacy=0x7f24901d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f248effd640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f24900a66d0 legacy=0x7f2490136730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f248f7fe640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.195:6789/0 conn(0x7f249013f9a0 legacy=0x7f24901d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3994076875 0 0) 0x7f2490068c50 con 0x7f24900a6ab0 2024-09-13T10:31:47.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): my global_id is 64298 2024-09-13T10:31:47.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f247c003520 con 0x7f24900a6ab0 2024-09-13T10:31:47.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1882234850 0 0) 0x7f249013da10 con 0x7f24900a66d0 2024-09-13T10:31:47.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): my global_id is 4864 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2490068c50 con 0x7f24900a66d0 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3246570677 0 0) 0x7f2490142db0 con 0x7f249013f9a0 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): my global_id is 54892 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f249013da10 con 0x7f249013f9a0 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3175854451 0 0) 0x7f247c003520 con 0x7f24900a6ab0 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2490142db0 con 0x7f24900a6ab0 2024-09-13T10:31:47.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2484003610 con 0x7f24900a6ab0 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): dump: 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.027 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1660256224 0 0) 0x7f2490068c50 con 0x7f24900a66d0 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f247c003520 con 0x7f24900a66d0 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 97362592 0 0) 0x7f249013da10 con 0x7f249013f9a0 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2490068c50 con 0x7f249013f9a0 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2480004b20 con 0x7f24900a66d0 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:47.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): dump: 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.029 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.030 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.030 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.030 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f24880047d0 con 0x7f249013f9a0 2024-09-13T10:31:47.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:47.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:31:47.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient(hunting): dump: 2024-09-13T10:31:47.030 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.031 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.031 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.031 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.031 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.031 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.031 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.031 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.031 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.031 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.031 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.031 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.031 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.032 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.032 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.032 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3893556820 0 0) 0x7f2490142db0 con 0x7f24900a6ab0 2024-09-13T10:31:47.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f24900a66d0 legacy=0x7f2490136730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.195:6789/0 conn(0x7f249013f9a0 legacy=0x7f24901d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient: _finish_hunting 0 2024-09-13T10:31:47.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 monclient: found mon.b 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249013f1b0 con 0x7f24900a6ab0 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient: _finish_auth 0 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 10 monclient: _check_auth_tickets 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2477fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2495975640 5 monclient: authenticate success, global_id 64298 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2495975640 10 monclient: _renew_subs 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2495975640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2495975640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f24901374e0 con 0x7f24900a6ab0 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2495975640 10 monclient: _renew_subs 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2495975640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:47.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.004+0000 7f2495975640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f249013c680 con 0x7f24900a6ab0 2024-09-13T10:31:47.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.005+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2484003b00 con 0x7f24900a6ab0 2024-09-13T10:31:47.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.005+0000 7f2477fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:47.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.005+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2484004030 con 0x7f24900a6ab0 2024-09-13T10:31:47.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.005+0000 7f2477fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.005+0000 7f248d7fa640 4 set_mon_vals no callback set 2024-09-13T10:31:47.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.005+0000 7f2477fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:47.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.005+0000 7f2477fff640 10 monclient: dump: 2024-09-13T10:31:47.034 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.034 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.035 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.005+0000 7f2495975640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.005+0000 7f2495975640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f24700065c0 con 0x7f2470002860 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.005+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f24840041d0 con 0x7f24900a6ab0 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.006+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(51..51 src has 1..51) ==== 3898+0+0 (unknown 99038851 0 0) 0x7f248404e3d0 con 0x7f24900a6ab0 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.006+0000 7f248f7fe640 10 monclient: get_auth_request con 0x7f247c0404d0 auth_method 0 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.007+0000 7f248effd640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f2470002860 legacy=0x7f2470004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195613131 0 0) 0x7f24700065c0 con 0x7f2470002860 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f2477fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f2477fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f2477fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f2477fff640 10 monclient(hunting): my global_id is 4873 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2490142db0 con 0x7f2470002860 2024-09-13T10:31:47.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f248effd640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f2470002860 legacy=0x7f2470004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f248effd640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f2470002860 legacy=0x7f2470004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f248effd640 1 --1- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f2470002860 0x7f2470004d00 :-1 s=OPENED pgs=190 cs=1 l=1).handle_message read tag failed 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f248effd640 1 --1- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f2470002860 0x7f2470004d00 :-1 s=OPENED pgs=190 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f2470002860 legacy=0x7f2470004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f2470002860 legacy=0x7f2470004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.008+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f24700065c0 con 0x7f247c047730 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f248effd640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f247c047730 legacy=0x7f247c047b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437683622 0 0) 0x7f24700065c0 con 0x7f247c047730 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 10 monclient(hunting): my global_id is 4882 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f249013da10 con 0x7f247c047730 2024-09-13T10:31:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 472070425 0 0) 0x7f249013da10 con 0x7f247c047730 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24700065c0 con 0x7f247c047730 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2480001ac0 con 0x7f247c047730 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 10 monclient: dump: 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.038 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3011327819 0 0) 0x7f24700065c0 con 0x7f247c047730 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.010+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f247c049390 con 0x7f247c047730 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.011+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2480007440 con 0x7f247c047730 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.011+0000 7f2477fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.011+0000 7f2477fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.011+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f247c047730 legacy=0x7f247c047b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.011+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f247c047730 legacy=0x7f247c047b40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.017+0000 7f2495975640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.017+0000 7f2495975640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2470009d80 con 0x7f2470009140 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f248effd640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f2470009140 legacy=0x7f2470009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4018948576 0 0) 0x7f2470009d80 con 0x7f2470009140 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 10 monclient(hunting): my global_id is 4891 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24700065c0 con 0x7f2470009140 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2515888261 0 0) 0x7f24700065c0 con 0x7f2470009140 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2470009d80 con 0x7f2470009140 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2480005bc0 con 0x7f2470009140 2024-09-13T10:31:47.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 10 monclient: dump: 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.042 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.042 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.042 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.042 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1503407763 0 0) 0x7f2470009d80 con 0x7f2470009140 2024-09-13T10:31:47.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f247000c350 con 0x7f2470009140 2024-09-13T10:31:47.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7717 (unknown 0 0 969428567) 0x7f24800075f0 con 0x7f2470009140 2024-09-13T10:31:47.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:47.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.019+0000 7f2477fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:47.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.020+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f2470009140 legacy=0x7f2470009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.020+0000 7f2477fff640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6791/0 conn(0x7f2470009140 legacy=0x7f2470009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.020+0000 7f248f7fe640 1 -- 172.21.15.181:0/1267685509 reap_dead start 2024-09-13T10:31:47.043 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:47.043 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:47.043 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:47.043 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:31:47.043 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 42, 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 121469, 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:31:47.044 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.045 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.046 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:47.047 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.048 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.049 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.050 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:47.051 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.052 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:47.055 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.056 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.058 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.059 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.060 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.061 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.062 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.062 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:47.062 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.062 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.062 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:31:47.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.063 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.063 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.063 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:47.063 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.063 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.063 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:47.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.064 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.064 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.064 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:47.064 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.064 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.065 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:47.065 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:47.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.020+0000 7f2495975640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.195:6800/1839191919 conn(0x7f247c0404d0 legacy=0x7f247c042990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.020+0000 7f2495975640 10 monclient: shutdown 2024-09-13T10:31:47.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.020+0000 7f2495975640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:47.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.020+0000 7f2495975640 1 -- 172.21.15.181:0/1267685509 >> v1:172.21.15.181:6790/0 conn(0x7f24900a6ab0 legacy=0x7f24901d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.020+0000 7f2495975640 1 -- 172.21.15.181:0/1267685509 shutdown_connections 2024-09-13T10:31:47.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.020+0000 7f2495975640 1 -- 172.21.15.181:0/1267685509 >> 172.21.15.181:0/1267685509 conn(0x7f24900abcd0 msgr2=0x7f24900ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:47.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.020+0000 7f2495975640 1 -- 172.21.15.181:0/1267685509 shutdown_connections 2024-09-13T10:31:47.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.020+0000 7f2495975640 1 -- 172.21.15.181:0/1267685509 wait complete. 2024-09-13T10:31:47.067 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:31:47.067 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-09-13T10:31:47.067 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:31:47.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.163+0000 7f2d3963c640 10 monclient: get_monmap_and_config 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.163+0000 7f2d3963c640 10 monclient: build_initial_monmap 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.164+0000 7f2d3963c640 10 monclient: monmap: 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:47.165601+0000 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:47.165601+0000 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:47.167 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:47.168 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:47.168 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:47.168 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:47.168 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:47.168 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.164+0000 7f2d3963c640 1 Processor -- start 2024-09-13T10:31:47.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.164+0000 7f2d3963c640 1 -- start start 2024-09-13T10:31:47.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.164+0000 7f2d3963c640 10 monclient: init 2024-09-13T10:31:47.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d3963c640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:47.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d3963c640 10 monclient: _add_conns ranks=[2,4,7,6,1,3,8,5,0] 2024-09-13T10:31:47.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d3963c640 10 monclient(hunting): picked mon.noname-b con 0x7f2d340a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:47.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d3963c640 10 monclient(hunting): picked mon.noname-c con 0x7f2d340a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:47.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d3963c640 10 monclient(hunting): picked mon.noname-i con 0x7f2d3413f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:47.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d3963c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d340a5fe0 con 0x7f2d340a66d0 2024-09-13T10:31:47.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d3963c640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d340a8080 con 0x7f2d340a6ab0 2024-09-13T10:31:47.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d3963c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d340a42c0 con 0x7f2d3413f9a0 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d3963c640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d3963c640 10 monclient(hunting): authenticate will time out at 846.671217s 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d327fc640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f2d340a6ab0 0x7f2d340a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:34164/0 (socket says 172.21.15.181:34164) 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d327fc640 1 -- 172.21.15.181:0/51679702 learned_addr learned my addr 172.21.15.181:0/51679702 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.165+0000 7f2d32ffd640 1 --1- 172.21.15.181:0/51679702 >> v1:172.21.15.181:6790/0 conn(0x7f2d340a66d0 0x7f2d340a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:38780/0 (socket says 172.21.15.181:38780) 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d32ffd640 1 -- 172.21.15.181:0/51679702 >> v1:172.21.15.181:6790/0 conn(0x7f2d340a66d0 legacy=0x7f2d340a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d327fc640 1 -- 172.21.15.181:0/51679702 >> v1:172.21.15.181:6791/0 conn(0x7f2d340a6ab0 legacy=0x7f2d340a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 1 -- 172.21.15.181:0/51679702 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537375711 0 0) 0x7f2d340a5fe0 con 0x7f2d340a66d0 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient(hunting): my global_id is 64307 2024-09-13T10:31:47.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 1 -- 172.21.15.181:0/51679702 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d1c003520 con 0x7f2d340a66d0 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d337fe640 1 -- 172.21.15.181:0/51679702 >> v1:172.21.15.195:6792/0 conn(0x7f2d3413f9a0 legacy=0x7f2d34141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 1 -- 172.21.15.181:0/51679702 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880721709 0 0) 0x7f2d340a8080 con 0x7f2d340a6ab0 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient(hunting): my global_id is 4900 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 1 -- 172.21.15.181:0/51679702 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d340a5fe0 con 0x7f2d340a6ab0 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 1 -- 172.21.15.181:0/51679702 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2487637207 0 0) 0x7f2d1c003520 con 0x7f2d340a66d0 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 1 -- 172.21.15.181:0/51679702 >> v1:172.21.15.195:6792/0 conn(0x7f2d3413f9a0 legacy=0x7f2d34141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 1 -- 172.21.15.181:0/51679702 >> v1:172.21.15.181:6791/0 conn(0x7f2d340a6ab0 legacy=0x7f2d340a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 1 monclient: found mon.noname-b 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:31:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 1 -- 172.21.15.181:0/51679702 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d341464e0 con 0x7f2d340a66d0 2024-09-13T10:31:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 1 -- 172.21.15.181:0/51679702 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d24001b90 con 0x7f2d340a66d0 2024-09-13T10:31:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d3963c640 5 monclient: authenticate success, global_id 64307 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d3963c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient: dump: 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d3963c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 1 -- 172.21.15.181:0/51679702 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2d240047e0 con 0x7f2d340a66d0 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d3963c640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d3963c640 4 set_mon_vals no callback set 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 1 -- 172.21.15.181:0/51679702 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d24004d90 con 0x7f2d340a66d0 2024-09-13T10:31:47.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.167+0000 7f2d31ffb640 10 monclient: dump: 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.180 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.168+0000 7f2d3963c640 10 monclient: shutdown 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.168+0000 7f2d3963c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.168+0000 7f2d3963c640 1 -- 172.21.15.181:0/51679702 >> v1:172.21.15.181:6790/0 conn(0x7f2d340a66d0 legacy=0x7f2d340a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.168+0000 7f2d3963c640 1 -- 172.21.15.181:0/51679702 shutdown_connections 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.168+0000 7f2d3963c640 1 -- 172.21.15.181:0/51679702 >> 172.21.15.181:0/51679702 conn(0x7f2d340abcd0 msgr2=0x7f2d340ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.168+0000 7f2d3963c640 1 -- 172.21.15.181:0/51679702 shutdown_connections 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.168+0000 7f2d3963c640 1 -- 172.21.15.181:0/51679702 wait complete. 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.169+0000 7f2d3963c640 10 monclient: build_initial_monmap 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.169+0000 7f2d3963c640 10 monclient: monmap: 2024-09-13T10:31:47.181 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:47.182 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.169+0000 7f2d3963c640 1 Processor -- start 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.169+0000 7f2d3963c640 1 -- start start 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.169+0000 7f2d3963c640 10 monclient: init 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.170+0000 7f2d3963c640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.170+0000 7f2d3963c640 10 monclient: _add_conns ranks=[5,7,4,3,8,2,1,6,0] 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.170+0000 7f2d3963c640 10 monclient(hunting): picked mon.noname-h con 0x7f2d340a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.170+0000 7f2d3963c640 10 monclient(hunting): picked mon.noname-i con 0x7f2d340a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.170+0000 7f2d3963c640 10 monclient(hunting): picked mon.noname-c con 0x7f2d3413f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.170+0000 7f2d3963c640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d34068680 con 0x7f2d3413f9a0 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.170+0000 7f2d3963c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d3413f280 con 0x7f2d340a66d0 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.170+0000 7f2d3963c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d34142db0 con 0x7f2d340a6ab0 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.170+0000 7f2d3963c640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:47.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.170+0000 7f2d3963c640 10 monclient(hunting): authenticate will time out at 846.676226s 2024-09-13T10:31:47.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.170+0000 7f2d337fe640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f2d3413f9a0 0x7f2d341d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:34180/0 (socket says 172.21.15.181:34180) 2024-09-13T10:31:47.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.170+0000 7f2d337fe640 1 -- 172.21.15.181:0/2367872802 learned_addr learned my addr 172.21.15.181:0/2367872802 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:47.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d337fe640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.181:6791/0 conn(0x7f2d3413f9a0 legacy=0x7f2d341d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608455598 0 0) 0x7f2d340a42c0 con 0x7f2d3413f9a0 2024-09-13T10:31:47.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): my global_id is 4909 2024-09-13T10:31:47.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d20003520 con 0x7f2d3413f9a0 2024-09-13T10:31:47.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d327fc640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.195:6792/0 conn(0x7f2d340a6ab0 legacy=0x7f2d341d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d32ffd640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.195:6791/0 conn(0x7f2d340a66d0 legacy=0x7f2d341ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3332074104 0 0) 0x7f2d20003520 con 0x7f2d3413f9a0 2024-09-13T10:31:47.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d340a42c0 con 0x7f2d3413f9a0 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d2c003990 con 0x7f2d3413f9a0 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): dump: 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.190 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 851710168 0 0) 0x7f2d34142db0 con 0x7f2d340a6ab0 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): my global_id is 54880 2024-09-13T10:31:47.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d20003520 con 0x7f2d340a6ab0 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884446508 0 0) 0x7f2d3413f280 con 0x7f2d340a66d0 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient(hunting): my global_id is 4883 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d34142db0 con 0x7f2d340a66d0 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 543726158 0 0) 0x7f2d340a42c0 con 0x7f2d3413f9a0 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.195:6792/0 conn(0x7f2d340a6ab0 legacy=0x7f2d341d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.195:6791/0 conn(0x7f2d340a66d0 legacy=0x7f2d341ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 monclient: found mon.c 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:47.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d34137600 con 0x7f2d3413f9a0 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d1b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d3963c640 5 monclient: authenticate success, global_id 4909 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.172+0000 7f2d3963c640 10 monclient: _renew_subs 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d3963c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d3963c640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3413efa0 con 0x7f2d3413f9a0 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d3963c640 10 monclient: _renew_subs 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d3963c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d3963c640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2d3413c440 con 0x7f2d3413f9a0 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2d2c003ed0 con 0x7f2d3413f9a0 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d1b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:47.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d2c0043c0 con 0x7f2d3413f9a0 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d317fa640 4 set_mon_vals no callback set 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d1b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d1b7fe640 10 monclient: dump: 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.194 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d3963c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2d2c004560 con 0x7f2d3413f9a0 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.173+0000 7f2d3963c640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2d140065c0 con 0x7f2d14002860 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.174+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(51..51 src has 1..51) ==== 3898+0+0 (unknown 99038851 0 0) 0x7f2d2c04e740 con 0x7f2d3413f9a0 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.174+0000 7f2d327fc640 10 monclient: get_auth_request con 0x7f2d2003fd10 auth_method 0 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d32ffd640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.181:6792/0 conn(0x7f2d14002860 legacy=0x7f2d14004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3666436246 0 0) 0x7f2d140065c0 con 0x7f2d14002860 2024-09-13T10:31:47.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 10 monclient(hunting): my global_id is 4830 2024-09-13T10:31:47.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d340a42c0 con 0x7f2d14002860 2024-09-13T10:31:47.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3619140140 0 0) 0x7f2d340a42c0 con 0x7f2d14002860 2024-09-13T10:31:47.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d140065c0 con 0x7f2d14002860 2024-09-13T10:31:47.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d240047e0 con 0x7f2d14002860 2024-09-13T10:31:47.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:47.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 10 monclient: dump: 2024-09-13T10:31:47.196 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.197 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 970839098 0 0) 0x7f2d140065c0 con 0x7f2d14002860 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d1400a160 con 0x7f2d14002860 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2d24004a00 con 0x7f2d14002860 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.181:6792/0 conn(0x7f2d14002860 legacy=0x7f2d14004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.176+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.181:6792/0 conn(0x7f2d14002860 legacy=0x7f2d14004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.182+0000 7f2d3963c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.182+0000 7f2d3963c640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2d14009e70 con 0x7f2d14009130 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d32ffd640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.181:6792/0 conn(0x7f2d14009130 legacy=0x7f2d140095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371992428 0 0) 0x7f2d14009e70 con 0x7f2d14009130 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 10 monclient(hunting): my global_id is 4839 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d140065c0 con 0x7f2d14009130 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1131813636 0 0) 0x7f2d140065c0 con 0x7f2d14009130 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d14009e70 con 0x7f2d14009130 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d24004de0 con 0x7f2d14009130 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 10 monclient: dump: 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.199 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.200 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.200 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.200 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.200 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.200 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.200 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.200 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.200 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.200 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.200 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.200 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.200 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1893816713 0 0) 0x7f2d14009e70 con 0x7f2d14009130 2024-09-13T10:31:47.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2d1400c410 con 0x7f2d14009130 2024-09-13T10:31:47.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7715 (unknown 0 0 164238501) 0x7f2d240074d0 con 0x7f2d14009130 2024-09-13T10:31:47.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:47.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:47.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.181:6792/0 conn(0x7f2d14009130 legacy=0x7f2d140095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.185+0000 7f2d1b7fe640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.181:6792/0 conn(0x7f2d14009130 legacy=0x7f2d140095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.201 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:47.201 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:47.201 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 42, 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 121629, 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.202 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.203 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.204 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:47.205 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:47.206 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:47.206 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:47.206 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:47.206 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:47.206 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:47.206 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.206 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.206 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.206 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:47.207 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.208 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.209 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:47.209 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:47.209 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.209 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.209 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:47.210 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.211 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.213 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:47.214 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:47.216 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:47.217 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.218 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:47.220 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.221 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.221 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:47.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.221 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.221 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.221 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:47.221 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.221 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.221 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:47.221 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:47.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.186+0000 7f2d3963c640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.195:6800/1839191919 conn(0x7f2d2003fd10 legacy=0x7f2d200421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.186+0000 7f2d3963c640 10 monclient: shutdown 2024-09-13T10:31:47.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.186+0000 7f2d3963c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:47.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.186+0000 7f2d3963c640 1 -- 172.21.15.181:0/2367872802 >> v1:172.21.15.181:6791/0 conn(0x7f2d3413f9a0 legacy=0x7f2d341d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.186+0000 7f2d337fe640 1 -- 172.21.15.181:0/2367872802 reap_dead start 2024-09-13T10:31:47.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.186+0000 7f2d337fe640 1 -- 172.21.15.181:0/2367872802 reap_dead start 2024-09-13T10:31:47.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.186+0000 7f2d3963c640 1 -- 172.21.15.181:0/2367872802 shutdown_connections 2024-09-13T10:31:47.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.186+0000 7f2d3963c640 1 -- 172.21.15.181:0/2367872802 >> 172.21.15.181:0/2367872802 conn(0x7f2d340abcd0 msgr2=0x7f2d340a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:47.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.186+0000 7f2d3963c640 1 -- 172.21.15.181:0/2367872802 shutdown_connections 2024-09-13T10:31:47.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.186+0000 7f2d3963c640 1 -- 172.21.15.181:0/2367872802 wait complete. 2024-09-13T10:31:47.223 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:31:47.224 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-09-13T10:31:47.224 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:31:47.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.322+0000 7f841d695640 10 monclient: get_monmap_and_config 2024-09-13T10:31:47.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.322+0000 7f841d695640 10 monclient: build_initial_monmap 2024-09-13T10:31:47.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.322+0000 7f841d695640 10 monclient: monmap: 2024-09-13T10:31:47.326 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:47.326 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.326 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:47.324569+0000 2024-09-13T10:31:47.326 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:47.324569+0000 2024-09-13T10:31:47.326 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:47.326 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.326 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:47.326 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:47.326 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:47.326 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:47.327 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:47.327 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:47.327 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:47.327 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:47.327 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:47.327 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.323+0000 7f841d695640 1 Processor -- start 2024-09-13T10:31:47.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.323+0000 7f841d695640 1 -- start start 2024-09-13T10:31:47.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.323+0000 7f841d695640 10 monclient: init 2024-09-13T10:31:47.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f841d695640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:47.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f841d695640 10 monclient: _add_conns ranks=[3,0,6,5,1,2,8,4,7] 2024-09-13T10:31:47.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f841d695640 10 monclient(hunting): picked mon.noname-g con 0x7f84180a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:47.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f841d695640 10 monclient(hunting): picked mon.noname-a con 0x7f84180a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:47.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f841d695640 10 monclient(hunting): picked mon.noname-d con 0x7f841813f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:31:47.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f841d695640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84180a4bc0 con 0x7f84180a8340 2024-09-13T10:31:47.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f841d695640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f841813a320 con 0x7f84180a6640 2024-09-13T10:31:47.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f841d695640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84180a8100 con 0x7f841813f750 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f841d695640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f841d695640 10 monclient(hunting): authenticate will time out at 846.830142s 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f84167fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f84180a8340 0x7f8418139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49834/0 (socket says 172.21.15.181:49834) 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f84167fc640 1 -- 172.21.15.181:0/2680763313 learned_addr learned my addr 172.21.15.181:0/2680763313 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.324+0000 7f84177fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f841813f750 0x7f8418141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:39598/0 (socket says 172.21.15.181:39598) 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f84167fc640 1 -- 172.21.15.181:0/2680763313 >> v1:172.21.15.181:6789/0 conn(0x7f84180a8340 legacy=0x7f8418139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f84177fe640 1 -- 172.21.15.181:0/2680763313 >> v1:172.21.15.181:6792/0 conn(0x7f841813f750 legacy=0x7f8418141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 1 -- 172.21.15.181:0/2680763313 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2942034 0 0) 0x7f84180a8100 con 0x7f841813f750 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient(hunting): my global_id is 4848 2024-09-13T10:31:47.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 1 -- 172.21.15.181:0/2680763313 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8400003520 con 0x7f841813f750 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 1 -- 172.21.15.181:0/2680763313 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757626043 0 0) 0x7f84180a4bc0 con 0x7f84180a8340 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient(hunting): my global_id is 54774 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 1 -- 172.21.15.181:0/2680763313 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84180a8100 con 0x7f84180a8340 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8416ffd640 1 -- 172.21.15.181:0/2680763313 >> v1:172.21.15.195:6790/0 conn(0x7f84180a6640 legacy=0x7f8418139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 1 -- 172.21.15.181:0/2680763313 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1326695592 0 0) 0x7f8400003520 con 0x7f841813f750 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 1 -- 172.21.15.181:0/2680763313 >> v1:172.21.15.195:6790/0 conn(0x7f84180a6640 legacy=0x7f8418139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 1 -- 172.21.15.181:0/2680763313 >> v1:172.21.15.181:6789/0 conn(0x7f84180a8340 legacy=0x7f8418139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 1 monclient: found mon.noname-d 2024-09-13T10:31:47.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 1 -- 172.21.15.181:0/2680763313 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84180a48e0 con 0x7f841813f750 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f841d695640 5 monclient: authenticate success, global_id 4848 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 1 -- 172.21.15.181:0/2680763313 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8410001e60 con 0x7f841813f750 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f841d695640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient: dump: 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.335 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f841d695640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 1 -- 172.21.15.181:0/2680763313 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8410004b60 con 0x7f841813f750 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f841d695640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 1 -- 172.21.15.181:0/2680763313 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f84100050d0 con 0x7f841813f750 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f841d695640 4 set_mon_vals no callback set 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.326+0000 7f8415ffb640 10 monclient: dump: 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.337 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.327+0000 7f841d695640 10 monclient: shutdown 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.327+0000 7f841d695640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.327+0000 7f841d695640 1 -- 172.21.15.181:0/2680763313 >> v1:172.21.15.181:6792/0 conn(0x7f841813f750 legacy=0x7f8418141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.327+0000 7f841d695640 1 -- 172.21.15.181:0/2680763313 shutdown_connections 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.327+0000 7f841d695640 1 -- 172.21.15.181:0/2680763313 >> 172.21.15.181:0/2680763313 conn(0x7f8418077170 msgr2=0x7f84180abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.327+0000 7f841d695640 1 -- 172.21.15.181:0/2680763313 shutdown_connections 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.327+0000 7f841d695640 1 -- 172.21.15.181:0/2680763313 wait complete. 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.328+0000 7f841d695640 10 monclient: build_initial_monmap 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.328+0000 7f841d695640 10 monclient: monmap: 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:47.339 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.328+0000 7f841d695640 1 Processor -- start 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.328+0000 7f841d695640 1 -- start start 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.328+0000 7f841d695640 10 monclient: init 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.328+0000 7f841d695640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.328+0000 7f841d695640 10 monclient: _add_conns ranks=[2,1,0,3,8,6,5,7,4] 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.328+0000 7f841d695640 10 monclient(hunting): picked mon.noname-b con 0x7f84180a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:47.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.328+0000 7f841d695640 10 monclient(hunting): picked mon.noname-f con 0x7f841813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:47.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.328+0000 7f841d695640 10 monclient(hunting): picked mon.noname-a con 0x7f84181d4310 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:47.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.329+0000 7f841d695640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84180a1100 con 0x7f84181d4310 2024-09-13T10:31:47.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.329+0000 7f841d695640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84180a9db0 con 0x7f841813f750 2024-09-13T10:31:47.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.329+0000 7f841d695640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8418142e60 con 0x7f84180a8340 2024-09-13T10:31:47.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.329+0000 7f841d695640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:47.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.329+0000 7f841d695640 10 monclient(hunting): authenticate will time out at 846.835063s 2024-09-13T10:31:47.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.329+0000 7f8416ffd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f84180a8340 0x7f841809d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:38790/0 (socket says 172.21.15.181:38790) 2024-09-13T10:31:47.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.329+0000 7f8416ffd640 1 -- 172.21.15.181:0/4077273687 learned_addr learned my addr 172.21.15.181:0/4077273687 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:47.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f84177fe640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.181:6789/0 conn(0x7f84181d4310 legacy=0x7f84181d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f8416ffd640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.181:6790/0 conn(0x7f84180a8340 legacy=0x7f841809d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2294380308 0 0) 0x7f84180a1100 con 0x7f84181d4310 2024-09-13T10:31:47.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): my global_id is 54783 2024-09-13T10:31:47.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8404003520 con 0x7f84181d4310 2024-09-13T10:31:47.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2184993347 0 0) 0x7f8418142e60 con 0x7f84180a8340 2024-09-13T10:31:47.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): my global_id is 64316 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84180a1100 con 0x7f84180a8340 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f84167fc640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f841813f750 legacy=0x7f841809da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3527560778 0 0) 0x7f8404003520 con 0x7f84181d4310 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8418142e60 con 0x7f84181d4310 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f84100020b0 con 0x7f84181d4310 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): dump: 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.347 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1308648406 0 0) 0x7f84180a1100 con 0x7f84180a8340 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8404003520 con 0x7f84180a8340 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 106279907 0 0) 0x7f84180a9db0 con 0x7f841813f750 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): my global_id is 54901 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84180a1100 con 0x7f841813f750 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8408003610 con 0x7f84180a8340 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient(hunting): dump: 2024-09-13T10:31:47.349 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.350 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3489103233 0 0) 0x7f8418142e60 con 0x7f84181d4310 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.181:6790/0 conn(0x7f84180a8340 legacy=0x7f841809d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f841813f750 legacy=0x7f841809da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 monclient: found mon.a 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84180a0290 con 0x7f84181d4310 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient: _finish_auth 0 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f83ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f841d695640 5 monclient: authenticate success, global_id 54783 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f841d695640 10 monclient: _renew_subs 2024-09-13T10:31:47.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f841d695640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:47.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f841d695640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f841809eda0 con 0x7f84181d4310 2024-09-13T10:31:47.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f841d695640 10 monclient: _renew_subs 2024-09-13T10:31:47.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f841d695640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:47.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.331+0000 7f841d695640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f84180a0e20 con 0x7f84181d4310 2024-09-13T10:31:47.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.332+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8410004b60 con 0x7f84181d4310 2024-09-13T10:31:47.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.332+0000 7f83ff7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:47.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.332+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8410001900 con 0x7f84181d4310 2024-09-13T10:31:47.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.332+0000 7f83ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.332+0000 7f83ff7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:47.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.332+0000 7f84157fa640 4 set_mon_vals no callback set 2024-09-13T10:31:47.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.332+0000 7f83ff7fe640 10 monclient: dump: 2024-09-13T10:31:47.352 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.353 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.332+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f8410011b20 con 0x7f84181d4310 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.332+0000 7f841d695640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.332+0000 7f841d695640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f83f80065c0 con 0x7f83f8002860 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.333+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(51..51 src has 1..51) ==== 3898+0+0 (unknown 99038851 0 0) 0x7f841004e5c0 con 0x7f84181d4310 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.333+0000 7f84167fc640 10 monclient: get_auth_request con 0x7f8404040460 auth_method 0 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f8416ffd640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f83f8002860 legacy=0x7f83f8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606700793 0 0) 0x7f83f80065c0 con 0x7f83f8002860 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 10 monclient(hunting): my global_id is 54910 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8418142e60 con 0x7f83f8002860 2024-09-13T10:31:47.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2015039942 0 0) 0x7f8418142e60 con 0x7f83f8002860 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83f80065c0 con 0x7f83f8002860 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8408004180 con 0x7f83f8002860 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 10 monclient: dump: 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.355 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f8416ffd640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f83f8002860 legacy=0x7f83f8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f8416ffd640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f83f8002860 legacy=0x7f83f8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f8416ffd640 1 --1- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f83f8002860 0x7f83f8004d00 :-1 s=OPENED pgs=179 cs=1 l=1).handle_message read tag failed 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f8416ffd640 1 --1- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f83f8002860 0x7f83f8004d00 :-1 s=OPENED pgs=179 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f83f8002860 legacy=0x7f83f8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f83f8002860 legacy=0x7f83f8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.335+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8418142e60 con 0x7f8404048d00 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.337+0000 7f8416ffd640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f8404048d00 legacy=0x7f8404047670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2236598726 0 0) 0x7f8418142e60 con 0x7f8404048d00 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 10 monclient(hunting): my global_id is 54919 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8404003520 con 0x7f8404048d00 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2260234408 0 0) 0x7f8404003520 con 0x7f8404048d00 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8418142e60 con 0x7f8404048d00 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8408004480 con 0x7f8404048d00 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 10 monclient: dump: 2024-09-13T10:31:47.357 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.358 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2289548873 0 0) 0x7f8418142e60 con 0x7f8404048d00 2024-09-13T10:31:47.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84100020b0 con 0x7f8404048d00 2024-09-13T10:31:47.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8408007be0 con 0x7f8404048d00 2024-09-13T10:31:47.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:47.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:47.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f8404048d00 legacy=0x7f8404047670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.338+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f8404048d00 legacy=0x7f8404047670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.344+0000 7f841d695640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:47.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.345+0000 7f841d695640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f83f800c4c0 con 0x7f83f80090e0 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.347+0000 7f8416ffd640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f83f80090e0 legacy=0x7f83f8009550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.347+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4119476913 0 0) 0x7f83f800c4c0 con 0x7f83f80090e0 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.347+0000 7f83ff7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.347+0000 7f83ff7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.347+0000 7f83ff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.347+0000 7f83ff7fe640 10 monclient(hunting): my global_id is 54928 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.347+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8418142e60 con 0x7f83f80090e0 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1678986577 0 0) 0x7f8418142e60 con 0x7f83f80090e0 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83f800c4c0 con 0x7f83f80090e0 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8408006270 con 0x7f83f80090e0 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:31:47.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 10 monclient: dump: 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.362 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.363 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.363 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3353654309 0 0) 0x7f83f800c4c0 con 0x7f83f80090e0 2024-09-13T10:31:47.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f83f8009c60 con 0x7f83f80090e0 2024-09-13T10:31:47.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7548 (unknown 0 0 3512463418) 0x7f8408006500 con 0x7f83f80090e0 2024-09-13T10:31:47.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:47.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:47.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f83f80090e0 legacy=0x7f83f8009550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f83ff7fe640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6789/0 conn(0x7f83f80090e0 legacy=0x7f83f8009550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.348+0000 7f84177fe640 1 -- 172.21.15.181:0/4077273687 reap_dead start 2024-09-13T10:31:47.363 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:47.364 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:47.364 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:47.364 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:47.364 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 42, 2024-09-13T10:31:47.364 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 121758, 2024-09-13T10:31:47.364 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:47.364 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:47.364 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:47.364 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:47.364 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:47.364 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:47.364 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.365 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.366 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:47.367 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.368 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:47.369 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.370 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.371 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:47.372 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.373 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.375 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:47.375 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:47.375 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.375 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.377 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.378 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:47.379 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.380 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.381 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.381 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:47.381 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:47.381 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.381 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.381 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.382 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:47.382 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.382 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.382 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.382 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:47.382 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:47.382 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.382 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.382 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.383 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.384 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.384 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:47.384 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.384 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.384 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:47.384 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:47.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.349+0000 7f841d695640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.195:6800/1839191919 conn(0x7f8404040460 legacy=0x7f8404042920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.349+0000 7f841d695640 10 monclient: shutdown 2024-09-13T10:31:47.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.349+0000 7f841d695640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:47.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.349+0000 7f841d695640 1 -- 172.21.15.181:0/4077273687 >> v1:172.21.15.181:6789/0 conn(0x7f84181d4310 legacy=0x7f84181d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.349+0000 7f841d695640 1 -- 172.21.15.181:0/4077273687 shutdown_connections 2024-09-13T10:31:47.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.349+0000 7f841d695640 1 -- 172.21.15.181:0/4077273687 >> 172.21.15.181:0/4077273687 conn(0x7f84180a6640 msgr2=0x7f841813efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:47.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.349+0000 7f841d695640 1 -- 172.21.15.181:0/4077273687 shutdown_connections 2024-09-13T10:31:47.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.349+0000 7f841d695640 1 -- 172.21.15.181:0/4077273687 wait complete. 2024-09-13T10:31:47.386 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:31:47.386 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-09-13T10:31:47.386 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:31:47.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.482+0000 7f6f79b26640 10 monclient: get_monmap_and_config 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.482+0000 7f6f79b26640 10 monclient: build_initial_monmap 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.482+0000 7f6f79b26640 10 monclient: monmap: 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:47.483914+0000 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:47.483914+0000 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:47.485 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:47.486 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:47.486 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:47.486 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:47.486 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:47.486 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 1 Processor -- start 2024-09-13T10:31:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 1 -- start start 2024-09-13T10:31:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 10 monclient: init 2024-09-13T10:31:47.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 10 monclient: _add_conns ranks=[1,0,5,7,2,8,4,6,3] 2024-09-13T10:31:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 10 monclient(hunting): picked mon.noname-f con 0x7f6f740a44d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 10 monclient(hunting): picked mon.noname-a con 0x7f6f740771e0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 10 monclient(hunting): picked mon.noname-h con 0x7f6f740a4fc0 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f74076750 con 0x7f6f740771e0 2024-09-13T10:31:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f740a1710 con 0x7f6f740a44d0 2024-09-13T10:31:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f740a19f0 con 0x7f6f740a4fc0 2024-09-13T10:31:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f79b26640 10 monclient(hunting): authenticate will time out at 846.989597s 2024-09-13T10:31:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f72ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6f740771e0 0x7f6f7413e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49842/0 (socket says 172.21.15.181:49842) 2024-09-13T10:31:47.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.483+0000 7f6f72ffd640 1 -- 172.21.15.181:0/3449221797 learned_addr learned my addr 172.21.15.181:0/3449221797 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.485+0000 7f6f72ffd640 1 -- 172.21.15.181:0/3449221797 >> v1:172.21.15.181:6789/0 conn(0x7f6f740771e0 legacy=0x7f6f7413e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f737fe640 1 -- 172.21.15.181:0/3449221797 >> v1:172.21.15.195:6789/0 conn(0x7f6f740a44d0 legacy=0x7f6f740a48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f73fff640 1 -- 172.21.15.181:0/3449221797 >> v1:172.21.15.195:6791/0 conn(0x7f6f740a4fc0 legacy=0x7f6f74141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900233080 0 0) 0x7f6f74076750 con 0x7f6f740771e0 2024-09-13T10:31:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient(hunting): my global_id is 54792 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f60003520 con 0x7f6f740771e0 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1944314778 0 0) 0x7f6f740a1710 con 0x7f6f740a44d0 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient(hunting): my global_id is 54937 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f74076750 con 0x7f6f740a44d0 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150380492 0 0) 0x7f6f740a19f0 con 0x7f6f740a4fc0 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient(hunting): my global_id is 4892 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f740a1710 con 0x7f6f740a4fc0 2024-09-13T10:31:47.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2827688495 0 0) 0x7f6f60003520 con 0x7f6f740771e0 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 >> v1:172.21.15.195:6791/0 conn(0x7f6f740a4fc0 legacy=0x7f6f74141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 >> v1:172.21.15.195:6789/0 conn(0x7f6f740a44d0 legacy=0x7f6f740a48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient: _finish_hunting 0 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 monclient: found mon.noname-a 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f74076b60 con 0x7f6f740771e0 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient: _finish_auth 0 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient: _check_auth_tickets 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6f5c001ae0 con 0x7f6f740771e0 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f79b26640 5 monclient: authenticate success, global_id 54792 2024-09-13T10:31:47.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f79b26640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient: dump: 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.495 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f79b26640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f5c0048a0 con 0x7f6f740771e0 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f79b26640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 1 -- 172.21.15.181:0/3449221797 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6f5c004e10 con 0x7f6f740771e0 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f79b26640 4 set_mon_vals no callback set 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.486+0000 7f6f727fc640 10 monclient: dump: 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.497 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.487+0000 7f6f79b26640 10 monclient: shutdown 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.487+0000 7f6f79b26640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.487+0000 7f6f79b26640 1 -- 172.21.15.181:0/3449221797 >> v1:172.21.15.181:6789/0 conn(0x7f6f740771e0 legacy=0x7f6f7413e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.487+0000 7f6f79b26640 1 -- 172.21.15.181:0/3449221797 shutdown_connections 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.487+0000 7f6f79b26640 1 -- 172.21.15.181:0/3449221797 >> 172.21.15.181:0/3449221797 conn(0x7f6f7406e6e0 msgr2=0x7f6f7406eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.487+0000 7f6f79b26640 1 -- 172.21.15.181:0/3449221797 shutdown_connections 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.487+0000 7f6f79b26640 1 -- 172.21.15.181:0/3449221797 wait complete. 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.487+0000 7f6f79b26640 10 monclient: build_initial_monmap 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.487+0000 7f6f79b26640 10 monclient: monmap: 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:47.498 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:47.499 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.487+0000 7f6f79b26640 1 Processor -- start 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f79b26640 1 -- start start 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f79b26640 10 monclient: init 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f79b26640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f79b26640 10 monclient: _add_conns ranks=[0,3,4,8,1,5,7,6,2] 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f79b26640 10 monclient(hunting): picked mon.noname-a con 0x7f6f740771e0 addr v1:172.21.15.181:6789/0 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f79b26640 10 monclient(hunting): picked mon.noname-g con 0x7f6f740a44d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f79b26640 10 monclient(hunting): picked mon.noname-c con 0x7f6f740a4fc0 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f79b26640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f74142570 con 0x7f6f740771e0 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f79b26640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f740a40e0 con 0x7f6f740a44d0 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f79b26640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f74128950 con 0x7f6f740a4fc0 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f79b26640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f79b26640 10 monclient(hunting): authenticate will time out at 846.994649s 2024-09-13T10:31:47.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f737fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6f740771e0 0x7f6f74141e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49854/0 (socket says 172.21.15.181:49854) 2024-09-13T10:31:47.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.488+0000 7f6f737fe640 1 -- 172.21.15.181:0/4102201999 learned_addr learned my addr 172.21.15.181:0/4102201999 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.490+0000 7f6f737fe640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.181:6789/0 conn(0x7f6f740771e0 legacy=0x7f6f74141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.490+0000 7f6f73fff640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.181:6791/0 conn(0x7f6f740a4fc0 legacy=0x7f6f741d65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.490+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260865631 0 0) 0x7f6f74142570 con 0x7f6f740771e0 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.490+0000 7f6f6bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.490+0000 7f6f6bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.490+0000 7f6f6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.490+0000 7f6f6bfff640 10 monclient(hunting): my global_id is 54801 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.490+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f54003520 con 0x7f6f740771e0 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.490+0000 7f6f73fff640 1 --1- 172.21.15.181:0/4102201999 >> v1:172.21.15.181:6791/0 conn(0x7f6f740a4fc0 0x7f6f741d65d0 :-1 s=OPENED pgs=195 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f6f74128950 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f72ffd640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.195:6790/0 conn(0x7f6f740a44d0 legacy=0x7f6f741d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 638716892 0 0) 0x7f6f740a40e0 con 0x7f6f740a44d0 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient(hunting): my global_id is 4836 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f74142570 con 0x7f6f740a44d0 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1098817925 0 0) 0x7f6f54003520 con 0x7f6f740771e0 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f740a40e0 con 0x7f6f740771e0 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6f64003610 con 0x7f6f740771e0 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient(hunting): dump: 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.507 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:47.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3399962210 0 0) 0x7f6f74142570 con 0x7f6f740a44d0 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f54003520 con 0x7f6f740a44d0 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6f5c004d90 con 0x7f6f740a44d0 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient(hunting): dump: 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.509 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.510 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.510 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.510 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.510 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.510 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.510 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.510 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3498419148 0 0) 0x7f6f740a40e0 con 0x7f6f740771e0 2024-09-13T10:31:47.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.181:6791/0 conn(0x7f6f740a4fc0 legacy=0x7f6f741d65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.195:6790/0 conn(0x7f6f740a44d0 legacy=0x7f6f741d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 monclient: found mon.a 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f74127460 con 0x7f6f740771e0 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient: _finish_auth 0 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f79b26640 5 monclient: authenticate success, global_id 54801 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277752234 0 0) 0x7f6f74128950 con 0x7f6f740a4fc0 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f79b26640 10 monclient: _renew_subs 2024-09-13T10:31:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f79b26640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f79b26640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f741297c0 con 0x7f6f740771e0 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f79b26640 10 monclient: _renew_subs 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f79b26640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f79b26640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f74127fc0 con 0x7f6f740771e0 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f64003b90 con 0x7f6f740771e0 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6f640040c0 con 0x7f6f740771e0 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f71ffb640 4 set_mon_vals no callback set 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.491+0000 7f6f6bfff640 10 monclient: dump: 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.513 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.492+0000 7f6f79b26640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.492+0000 7f6f79b26640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6f580065c0 con 0x7f6f58002860 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.492+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6f64004260 con 0x7f6f740771e0 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.492+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(51..51 src has 1..51) ==== 3898+0+0 (unknown 99038851 0 0) 0x7f6f6404e440 con 0x7f6f740771e0 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.492+0000 7f6f73fff640 10 monclient: get_auth_request con 0x7f6f54040050 auth_method 0 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.494+0000 7f6f72ffd640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.195:6790/0 conn(0x7f6f58002860 legacy=0x7f6f58004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.494+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606098637 0 0) 0x7f6f580065c0 con 0x7f6f58002860 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.494+0000 7f6f6bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.494+0000 7f6f6bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.494+0000 7f6f6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.494+0000 7f6f6bfff640 10 monclient(hunting): my global_id is 4845 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.494+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f74128950 con 0x7f6f58002860 2024-09-13T10:31:47.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 687815998 0 0) 0x7f6f74128950 con 0x7f6f58002860 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f580065c0 con 0x7f6f58002860 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6f5c001580 con 0x7f6f58002860 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 10 monclient: dump: 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.515 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2318558811 0 0) 0x7f6f580065c0 con 0x7f6f58002860 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f5800a160 con 0x7f6f58002860 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6f5c001320 con 0x7f6f58002860 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.195:6790/0 conn(0x7f6f58002860 legacy=0x7f6f58004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.495+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.195:6790/0 conn(0x7f6f58002860 legacy=0x7f6f58004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.501+0000 7f6f79b26640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:47.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.501+0000 7f6f79b26640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6f58009e50 con 0x7f6f58009110 2024-09-13T10:31:47.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f72ffd640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.195:6790/0 conn(0x7f6f58009110 legacy=0x7f6f580095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379740428 0 0) 0x7f6f58009e50 con 0x7f6f58009110 2024-09-13T10:31:47.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 10 monclient(hunting): my global_id is 4854 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f580065c0 con 0x7f6f58009110 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3885724644 0 0) 0x7f6f580065c0 con 0x7f6f58009110 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f58009e50 con 0x7f6f58009110 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6f5c005bf0 con 0x7f6f58009110 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 10 monclient: dump: 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.519 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1663511839 0 0) 0x7f6f58009e50 con 0x7f6f58009110 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.504+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6f5800c3a0 con 0x7f6f58009110 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7548 (unknown 0 0 3382353481) 0x7f6f5c0048a0 con 0x7f6f58009110 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f6bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:47.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f6bfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:47.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.195:6790/0 conn(0x7f6f58009110 legacy=0x7f6f580095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f6bfff640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.195:6790/0 conn(0x7f6f58009110 legacy=0x7f6f580095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.521 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:47.521 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:47.521 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:47.521 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:47.521 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 42, 2024-09-13T10:31:47.521 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 121920, 2024-09-13T10:31:47.521 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:47.521 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.522 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:47.523 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:47.524 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:47.525 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.526 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.527 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.528 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.530 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:47.531 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:47.532 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.533 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.534 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:47.535 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:47.535 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.535 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.535 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.535 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:47.535 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:47.535 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.535 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.537 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:47.538 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:47.539 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.541 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:47.541 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f79b26640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6f54040050 legacy=0x7f6f54042510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f79b26640 10 monclient: shutdown 2024-09-13T10:31:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f79b26640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f79b26640 1 -- 172.21.15.181:0/4102201999 >> v1:172.21.15.181:6789/0 conn(0x7f6f740771e0 legacy=0x7f6f74141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f73fff640 1 -- 172.21.15.181:0/4102201999 reap_dead start 2024-09-13T10:31:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f73fff640 1 -- 172.21.15.181:0/4102201999 reap_dead start 2024-09-13T10:31:47.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f79b26640 1 -- 172.21.15.181:0/4102201999 shutdown_connections 2024-09-13T10:31:47.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f79b26640 1 -- 172.21.15.181:0/4102201999 >> 172.21.15.181:0/4102201999 conn(0x7f6f7406e6e0 msgr2=0x7f6f74142dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:47.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f79b26640 1 -- 172.21.15.181:0/4102201999 shutdown_connections 2024-09-13T10:31:47.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.505+0000 7f6f79b26640 1 -- 172.21.15.181:0/4102201999 wait complete. 2024-09-13T10:31:47.543 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:31:47.543 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-09-13T10:31:47.543 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:31:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.640+0000 7f0bab5ec640 10 monclient: get_monmap_and_config 2024-09-13T10:31:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.640+0000 7f0bab5ec640 10 monclient: build_initial_monmap 2024-09-13T10:31:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.640+0000 7f0bab5ec640 10 monclient: monmap: 2024-09-13T10:31:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:47.642036+0000 2024-09-13T10:31:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:47.642036+0000 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 1 Processor -- start 2024-09-13T10:31:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 1 -- start start 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 10 monclient: init 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 10 monclient: _add_conns ranks=[1,2,7,0,4,5,8,3,6] 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 10 monclient(hunting): picked mon.noname-f con 0x7f0ba40a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 10 monclient(hunting): picked mon.noname-b con 0x7f0ba40a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 10 monclient(hunting): picked mon.noname-i con 0x7f0ba413f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba40a4bc0 con 0x7f0ba40a6640 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba413a320 con 0x7f0ba40a8340 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba40a8100 con 0x7f0ba413f750 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0bab5ec640 10 monclient(hunting): authenticate will time out at 847.147718s 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0ba8b87640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f0ba40a8340 0x7f0ba4139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:38802/0 (socket says 172.21.15.181:38802) 2024-09-13T10:31:47.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.641+0000 7f0ba8b87640 1 -- 172.21.15.181:0/746674962 learned_addr learned my addr 172.21.15.181:0/746674962 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:47.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.643+0000 7f0ba8b87640 1 -- 172.21.15.181:0/746674962 >> v1:172.21.15.181:6790/0 conn(0x7f0ba40a8340 legacy=0x7f0ba4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 681951657 0 0) 0x7f0ba413a320 con 0x7f0ba40a8340 2024-09-13T10:31:47.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient(hunting): my global_id is 64325 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0ba9388640 1 -- 172.21.15.181:0/746674962 >> v1:172.21.15.195:6789/0 conn(0x7f0ba40a6640 legacy=0x7f0ba4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b90003520 con 0x7f0ba40a8340 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0ba9b89640 1 -- 172.21.15.181:0/746674962 >> v1:172.21.15.195:6792/0 conn(0x7f0ba413f750 legacy=0x7f0ba4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4044833097 0 0) 0x7f0ba40a8100 con 0x7f0ba413f750 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient(hunting): my global_id is 54889 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ba413a320 con 0x7f0ba413f750 2024-09-13T10:31:47.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816046168 0 0) 0x7f0ba40a4bc0 con 0x7f0ba40a6640 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient(hunting): my global_id is 54946 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ba40a8100 con 0x7f0ba40a6640 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3620398361 0 0) 0x7f0b90003520 con 0x7f0ba40a8340 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 >> v1:172.21.15.195:6792/0 conn(0x7f0ba413f750 legacy=0x7f0ba4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 >> v1:172.21.15.195:6789/0 conn(0x7f0ba40a6640 legacy=0x7f0ba4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 monclient: found mon.noname-b 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba40a48e0 con 0x7f0ba40a8340 2024-09-13T10:31:47.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient: _finish_auth 0 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0bab5ec640 5 monclient: authenticate success, global_id 64325 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0ba0001b20 con 0x7f0ba40a8340 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0bab5ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient: dump: 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.656 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0bab5ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ba0001cc0 con 0x7f0ba40a8340 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:47.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0bab5ec640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 1 -- 172.21.15.181:0/746674962 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0ba0004be0 con 0x7f0ba40a8340 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0bab5ec640 4 set_mon_vals no callback set 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.644+0000 7f0b9bfff640 10 monclient: dump: 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.658 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.645+0000 7f0bab5ec640 10 monclient: shutdown 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.645+0000 7f0bab5ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.645+0000 7f0bab5ec640 1 -- 172.21.15.181:0/746674962 >> v1:172.21.15.181:6790/0 conn(0x7f0ba40a8340 legacy=0x7f0ba4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.645+0000 7f0bab5ec640 1 -- 172.21.15.181:0/746674962 shutdown_connections 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.645+0000 7f0bab5ec640 1 -- 172.21.15.181:0/746674962 >> 172.21.15.181:0/746674962 conn(0x7f0ba4077170 msgr2=0x7f0ba40abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.645+0000 7f0bab5ec640 1 -- 172.21.15.181:0/746674962 shutdown_connections 2024-09-13T10:31:47.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.645+0000 7f0bab5ec640 1 -- 172.21.15.181:0/746674962 wait complete. 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.645+0000 7f0bab5ec640 10 monclient: build_initial_monmap 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.645+0000 7f0bab5ec640 10 monclient: monmap: 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:47.660 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 1 Processor -- start 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 1 -- start start 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 10 monclient: init 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 10 monclient: _add_conns ranks=[2,5,7,4,3,6,0,1,8] 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 10 monclient(hunting): picked mon.noname-b con 0x7f0ba40a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 10 monclient(hunting): picked mon.noname-h con 0x7f0ba413f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 10 monclient(hunting): picked mon.noname-i con 0x7f0ba4135440 addr v1:172.21.15.195:6792/0 2024-09-13T10:31:47.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba4134f90 con 0x7f0ba40a8340 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba413cce0 con 0x7f0ba413f750 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba40a9c40 con 0x7f0ba4135440 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0bab5ec640 10 monclient(hunting): authenticate will time out at 847.152652s 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0ba9388640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f0ba40a8340 0x7f0ba413bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:38810/0 (socket says 172.21.15.181:38810) 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.646+0000 7f0ba9388640 1 -- 172.21.15.181:0/889283728 learned_addr learned my addr 172.21.15.181:0/889283728 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.648+0000 7f0ba9388640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.181:6790/0 conn(0x7f0ba40a8340 legacy=0x7f0ba413bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.648+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 633426321 0 0) 0x7f0ba4134f90 con 0x7f0ba40a8340 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.648+0000 7f0b99ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.648+0000 7f0b99ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.648+0000 7f0b99ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.648+0000 7f0b99ffb640 10 monclient(hunting): my global_id is 64334 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.648+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b88003550 con 0x7f0ba40a8340 2024-09-13T10:31:47.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.648+0000 7f0ba9b89640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.195:6792/0 conn(0x7f0ba4135440 legacy=0x7f0ba41d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.648+0000 7f0ba8b87640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.195:6791/0 conn(0x7f0ba413f750 legacy=0x7f0ba413c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 121687176 0 0) 0x7f0b88003550 con 0x7f0ba40a8340 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ba4134f90 con 0x7f0ba40a8340 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0b94003610 con 0x7f0ba40a8340 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient(hunting): dump: 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.663 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3887007067 0 0) 0x7f0ba40a9c40 con 0x7f0ba4135440 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient(hunting): my global_id is 54898 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b88003550 con 0x7f0ba4135440 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231678776 0 0) 0x7f0ba413cce0 con 0x7f0ba413f750 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient(hunting): my global_id is 4901 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ba40a9c40 con 0x7f0ba413f750 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2808385572 0 0) 0x7f0ba4134f90 con 0x7f0ba40a8340 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.195:6792/0 conn(0x7f0ba4135440 legacy=0x7f0ba41d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.195:6791/0 conn(0x7f0ba413f750 legacy=0x7f0ba413c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:31:47.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 monclient: found mon.b 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba413d780 con 0x7f0ba40a8340 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient: _finish_auth 0 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0bab5ec640 5 monclient: authenticate success, global_id 64334 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0bab5ec640 10 monclient: _renew_subs 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0bab5ec640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0bab5ec640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba41349d0 con 0x7f0ba40a8340 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0b94003c20 con 0x7f0ba40a8340 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:47.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0b94004190 con 0x7f0ba40a8340 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b99ffb640 10 monclient: dump: 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.667 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0b9b7fe640 4 set_mon_vals no callback set 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0bab5ec640 10 monclient: _renew_subs 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0bab5ec640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.649+0000 7f0bab5ec640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0ba4134310 con 0x7f0ba40a8340 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.650+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0b94011ca0 con 0x7f0ba40a8340 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.650+0000 7f0bab5ec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.650+0000 7f0bab5ec640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0ba41347d0 con 0x7f0ba4077170 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.650+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(51..51 src has 1..51) ==== 3898+0+0 (unknown 99038851 0 0) 0x7f0b9404e4f0 con 0x7f0ba40a8340 2024-09-13T10:31:47.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.650+0000 7f0ba9b89640 10 monclient: get_auth_request con 0x7f0b8803fde0 auth_method 0 2024-09-13T10:31:47.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.652+0000 7f0ba8b87640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.195:6791/0 conn(0x7f0ba4077170 legacy=0x7f0ba413fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.652+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3365808471 0 0) 0x7f0ba41347d0 con 0x7f0ba4077170 2024-09-13T10:31:47.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.652+0000 7f0b99ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.652+0000 7f0b99ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.652+0000 7f0b99ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.652+0000 7f0b99ffb640 10 monclient(hunting): my global_id is 4910 2024-09-13T10:31:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.652+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ba4134f90 con 0x7f0ba4077170 2024-09-13T10:31:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2575076097 0 0) 0x7f0ba4134f90 con 0x7f0ba4077170 2024-09-13T10:31:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ba41347d0 con 0x7f0ba4077170 2024-09-13T10:31:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0ba00018c0 con 0x7f0ba4077170 2024-09-13T10:31:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:31:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 10 monclient: dump: 2024-09-13T10:31:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.672 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2772468003 0 0) 0x7f0ba41347d0 con 0x7f0ba4077170 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ba4050c40 con 0x7f0ba4077170 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0ba0001c60 con 0x7f0ba4077170 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.195:6791/0 conn(0x7f0ba4077170 legacy=0x7f0ba413fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.653+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.195:6791/0 conn(0x7f0ba4077170 legacy=0x7f0ba413fb30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.659+0000 7f0bab5ec640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.659+0000 7f0bab5ec640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0ba4143220 con 0x7f0ba4069b40 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0ba8b87640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.195:6791/0 conn(0x7f0ba4069b40 legacy=0x7f0ba4140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3981017160 0 0) 0x7f0ba4143220 con 0x7f0ba4069b40 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 10 monclient(hunting): my global_id is 4919 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ba41347d0 con 0x7f0ba4069b40 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3545222151 0 0) 0x7f0ba41347d0 con 0x7f0ba4069b40 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ba4143220 con 0x7f0ba4069b40 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0ba0005340 con 0x7f0ba4069b40 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 10 monclient: dump: 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.675 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4158282188 0 0) 0x7f0ba4143220 con 0x7f0ba4069b40 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.662+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0ba4140950 con 0x7f0ba4069b40 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7548 (unknown 0 0 3551061386) 0x7f0ba0005480 con 0x7f0ba4069b40 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0b99ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:47.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0b99ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.195:6791/0 conn(0x7f0ba4069b40 legacy=0x7f0ba4140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0b99ffb640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.195:6791/0 conn(0x7f0ba4069b40 legacy=0x7f0ba4140240 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.677 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:47.677 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:47.677 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:47.677 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:47.677 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 42, 2024-09-13T10:31:47.677 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 122091, 2024-09-13T10:31:47.677 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:47.678 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:47.679 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.680 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.680 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.680 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.680 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.680 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.680 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.680 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.680 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.680 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.680 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.680 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:47.681 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.682 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.683 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:47.684 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.685 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.686 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:47.687 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.688 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:47.690 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.691 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.692 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:47.693 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.694 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.695 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.696 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.696 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:31:47.696 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.696 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.696 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:47.696 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:47.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0bab5ec640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0b8803fde0 legacy=0x7f0b880422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0bab5ec640 10 monclient: shutdown 2024-09-13T10:31:47.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0bab5ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:47.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0bab5ec640 1 -- 172.21.15.181:0/889283728 >> v1:172.21.15.181:6790/0 conn(0x7f0ba40a8340 legacy=0x7f0ba413bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0ba9b89640 1 -- 172.21.15.181:0/889283728 reap_dead start 2024-09-13T10:31:47.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0ba9b89640 1 -- 172.21.15.181:0/889283728 reap_dead start 2024-09-13T10:31:47.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0bab5ec640 1 -- 172.21.15.181:0/889283728 shutdown_connections 2024-09-13T10:31:47.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0bab5ec640 1 -- 172.21.15.181:0/889283728 >> 172.21.15.181:0/889283728 conn(0x7f0ba40a6640 msgr2=0x7f0ba40a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:47.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0bab5ec640 1 -- 172.21.15.181:0/889283728 shutdown_connections 2024-09-13T10:31:47.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.663+0000 7f0bab5ec640 1 -- 172.21.15.181:0/889283728 wait complete. 2024-09-13T10:31:47.698 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:31:47.698 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-09-13T10:31:47.699 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:31:47.700 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:47.700 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36220]: starting. 2024-09-13T10:31:47.700 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36220]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36184 2024-09-13T10:31:47.700 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36220]: shutting down. 2024-09-13T10:31:47.700 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:47.700 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:47.700 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:31:47.700 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:31:47.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.797+0000 7fad6fc40640 10 monclient: get_monmap_and_config 2024-09-13T10:31:47.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.797+0000 7fad6fc40640 10 monclient: build_initial_monmap 2024-09-13T10:31:47.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.797+0000 7fad6fc40640 10 monclient: monmap: 2024-09-13T10:31:47.800 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:47.800 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.800 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:31:47.799199+0000 2024-09-13T10:31:47.800 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:31:47.799199+0000 2024-09-13T10:31:47.800 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:47.800 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.800 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:47.801 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:47.801 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:47.801 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:47.801 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:47.801 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:47.801 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:47.801 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:47.801 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:47.801 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 1 Processor -- start 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 1 -- start start 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 10 monclient: init 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 10 monclient: _add_conns ranks=[2,8,4,0,5,7,3,6,1] 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 10 monclient(hunting): picked mon.noname-b con 0x7fad680a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 10 monclient(hunting): picked mon.noname-e con 0x7fad680a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 10 monclient(hunting): picked mon.noname-c con 0x7fad6813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad680a4bc0 con 0x7fad680a6640 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad6813a320 con 0x7fad6813f750 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad680a8100 con 0x7fad680a8340 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6d1db640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7fad680a8340 legacy=0x7fad68139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:31:47.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:47.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.798+0000 7fad6fc40640 10 monclient(hunting): authenticate will time out at 847.304963s 2024-09-13T10:31:47.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.799+0000 7fad6d9dc640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fad680a6640 0x7fad68139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:38816/0 (socket says 172.21.15.181:38816) 2024-09-13T10:31:47.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.799+0000 7fad6d9dc640 1 -- 172.21.15.181:0/538092634 learned_addr learned my addr 172.21.15.181:0/538092634 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:47.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6d9dc640 1 -- 172.21.15.181:0/538092634 >> v1:172.21.15.181:6790/0 conn(0x7fad680a6640 legacy=0x7fad68139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6e1dd640 1 -- 172.21.15.181:0/538092634 >> v1:172.21.15.181:6791/0 conn(0x7fad6813f750 legacy=0x7fad68141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 -- 172.21.15.181:0/538092634 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1560039814 0 0) 0x7fad680a4bc0 con 0x7fad680a6640 2024-09-13T10:31:47.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient(hunting): my global_id is 64352 2024-09-13T10:31:47.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 -- 172.21.15.181:0/538092634 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad54003520 con 0x7fad680a6640 2024-09-13T10:31:47.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 -- 172.21.15.181:0/538092634 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2096702906 0 0) 0x7fad6813a320 con 0x7fad6813f750 2024-09-13T10:31:47.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient(hunting): my global_id is 4945 2024-09-13T10:31:47.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 -- 172.21.15.181:0/538092634 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad680a4bc0 con 0x7fad6813f750 2024-09-13T10:31:47.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 -- 172.21.15.181:0/538092634 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3483042652 0 0) 0x7fad54003520 con 0x7fad680a6640 2024-09-13T10:31:47.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 -- 172.21.15.181:0/538092634 >> v1:172.21.15.181:6793/0 conn(0x7fad680a8340 legacy=0x7fad68139c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:31:47.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 -- 172.21.15.181:0/538092634 >> v1:172.21.15.181:6791/0 conn(0x7fad6813f750 legacy=0x7fad68141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient: _finish_hunting 0 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 monclient: found mon.noname-b 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 -- 172.21.15.181:0/538092634 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad680a48e0 con 0x7fad680a6640 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient: _finish_auth 0 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient: _check_auth_tickets 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 -- 172.21.15.181:0/538092634 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fad64001ae0 con 0x7fad680a6640 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6fc40640 5 monclient: authenticate success, global_id 64352 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6fc40640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient: dump: 2024-09-13T10:31:47.809 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.810 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6fc40640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 -- 172.21.15.181:0/538092634 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fad60001e90 con 0x7fad6813f750 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 -- 172.21.15.181:0/538092634 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad640048a0 con 0x7fad680a6640 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 1 -- 172.21.15.181:0/538092634 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fad64004e10 con 0x7fad680a6640 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6fc40640 10 monclient: get_monmap_and_config success 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6fc40640 4 set_mon_vals no callback set 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.801+0000 7fad6c9da640 10 monclient: dump: 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.811 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.812 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.812 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.812 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.812 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.812 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.812 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.812 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.812 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.812 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.812 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.812 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.812 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.813 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.813 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.802+0000 7fad6fc40640 10 monclient: shutdown 2024-09-13T10:31:47.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.802+0000 7fad6fc40640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:47.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.802+0000 7fad6fc40640 1 -- 172.21.15.181:0/538092634 >> v1:172.21.15.181:6790/0 conn(0x7fad680a6640 legacy=0x7fad68139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.802+0000 7fad6fc40640 1 -- 172.21.15.181:0/538092634 shutdown_connections 2024-09-13T10:31:47.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.802+0000 7fad6fc40640 1 -- 172.21.15.181:0/538092634 >> 172.21.15.181:0/538092634 conn(0x7fad68077170 msgr2=0x7fad680abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:47.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.802+0000 7fad6fc40640 1 -- 172.21.15.181:0/538092634 shutdown_connections 2024-09-13T10:31:47.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.802+0000 7fad6fc40640 1 -- 172.21.15.181:0/538092634 wait complete. 2024-09-13T10:31:47.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.802+0000 7fad6fc40640 10 monclient: build_initial_monmap 2024-09-13T10:31:47.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.802+0000 7fad6fc40640 10 monclient: monmap: 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:31:47.814 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 1 Processor -- start 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 1 -- start start 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 10 monclient: init 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 10 monclient: _reopen_session rank -1 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 10 monclient: _add_conns ranks=[1,4,2,5,7,8,6,0,3] 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 10 monclient(hunting): picked mon.noname-f con 0x7fad680a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 10 monclient(hunting): picked mon.noname-c con 0x7fad6813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 10 monclient(hunting): picked mon.noname-b con 0x7fad681d4730 addr v1:172.21.15.181:6790/0 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad680a1020 con 0x7fad680a8340 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad680a1300 con 0x7fad681d4730 2024-09-13T10:31:47.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad68139310 con 0x7fad6813f750 2024-09-13T10:31:47.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 10 monclient(hunting): _renew_subs 2024-09-13T10:31:47.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6fc40640 10 monclient(hunting): authenticate will time out at 847.309674s 2024-09-13T10:31:47.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6d1db640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fad6813f750 0x7fad68138c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:34204/0 (socket says 172.21.15.181:34204) 2024-09-13T10:31:47.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.803+0000 7fad6d1db640 1 -- 172.21.15.181:0/3378278355 learned_addr learned my addr 172.21.15.181:0/3378278355 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:31:47.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.805+0000 7fad6e1dd640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.181:6790/0 conn(0x7fad681d4730 legacy=0x7fad681d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.805+0000 7fad6d1db640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.181:6791/0 conn(0x7fad6813f750 legacy=0x7fad68138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.805+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2137754178 0 0) 0x7fad680a1300 con 0x7fad681d4730 2024-09-13T10:31:47.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): my global_id is 64361 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad4c003550 con 0x7fad681d4730 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2789235154 0 0) 0x7fad68139310 con 0x7fad6813f750 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): my global_id is 4954 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad680a1300 con 0x7fad6813f750 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad6d9dc640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.195:6789/0 conn(0x7fad680a8340 legacy=0x7fad681384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2338817259 0 0) 0x7fad4c003550 con 0x7fad681d4730 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad68139310 con 0x7fad681d4730 2024-09-13T10:31:47.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fad60003cd0 con 0x7fad681d4730 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): dump: 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.822 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2262012315 0 0) 0x7fad680a1300 con 0x7fad6813f750 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad4c003550 con 0x7fad6813f750 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3598484888 0 0) 0x7fad680a1020 con 0x7fad680a8340 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): my global_id is 54955 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad680a1300 con 0x7fad680a8340 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fad58004760 con 0x7fad6813f750 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient(hunting): dump: 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.824 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 389477248 0 0) 0x7fad68139310 con 0x7fad681d4730 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.181:6791/0 conn(0x7fad6813f750 legacy=0x7fad68138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.195:6789/0 conn(0x7fad680a8340 legacy=0x7fad681384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 monclient: found mon.b 2024-09-13T10:31:47.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad68142c40 con 0x7fad681d4730 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient: _finish_auth 0 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad6fc40640 5 monclient: authenticate success, global_id 64361 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad6fc40640 10 monclient: _renew_subs 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad6fc40640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad6fc40640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fad680a9b40 con 0x7fad681d4730 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad6fc40640 10 monclient: _renew_subs 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad6fc40640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad6fc40640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fad680a15e0 con 0x7fad681d4730 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad60001950 con 0x7fad681d4730 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:31:47.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fad60004460 con 0x7fad681d4730 2024-09-13T10:31:47.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5ffff640 4 set_mon_vals no callback set 2024-09-13T10:31:47.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:31:47.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.806+0000 7fad5e7fc640 10 monclient: dump: 2024-09-13T10:31:47.827 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.827 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.827 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.827 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.827 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.827 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.827 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.827 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.807+0000 7fad6fc40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.807+0000 7fad6fc40640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fad500065c0 con 0x7fad50002860 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.807+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fad60012020 con 0x7fad681d4730 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.807+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(52..52 src has 1..52) ==== 3506+0+0 (unknown 2193420748 0 0) 0x7fad6004e4a0 con 0x7fad681d4730 2024-09-13T10:31:47.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.807+0000 7fad6d1db640 10 monclient: get_auth_request con 0x7fad4c040340 auth_method 0 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.809+0000 7fad6d9dc640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.195:6792/0 conn(0x7fad50002860 legacy=0x7fad50004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.809+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217342944 0 0) 0x7fad500065c0 con 0x7fad50002860 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.809+0000 7fad5e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.809+0000 7fad5e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.809+0000 7fad5e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.809+0000 7fad5e7fc640 10 monclient(hunting): my global_id is 54916 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.809+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad68139310 con 0x7fad50002860 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.809+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1501196983 0 0) 0x7fad68139310 con 0x7fad50002860 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.810+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad500065c0 con 0x7fad50002860 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.810+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fad64004be0 con 0x7fad50002860 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.810+0000 7fad5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.810+0000 7fad5e7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:31:47.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.810+0000 7fad5e7fc640 10 monclient: dump: 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.830 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.831 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.831 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.810+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 568525682 0 0) 0x7fad500065c0 con 0x7fad50002860 2024-09-13T10:31:47.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.810+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad5000a160 con 0x7fad50002860 2024-09-13T10:31:47.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.810+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fad64001320 con 0x7fad50002860 2024-09-13T10:31:47.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.810+0000 7fad5e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:31:47.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.810+0000 7fad5e7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:31:47.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.810+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.195:6792/0 conn(0x7fad50002860 legacy=0x7fad50004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.810+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.195:6792/0 conn(0x7fad50002860 legacy=0x7fad50004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.816+0000 7fad6fc40640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:31:47.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.816+0000 7fad6fc40640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fad50009e70 con 0x7fad50009130 2024-09-13T10:31:47.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad6d9dc640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.195:6792/0 conn(0x7fad50009130 legacy=0x7fad500095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:31:47.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808464416 0 0) 0x7fad50009e70 con 0x7fad50009130 2024-09-13T10:31:47.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:31:47.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:31:47.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:31:47.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 10 monclient(hunting): my global_id is 54925 2024-09-13T10:31:47.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad500065c0 con 0x7fad50009130 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 25856992 0 0) 0x7fad500065c0 con 0x7fad50009130 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad50009e70 con 0x7fad50009130 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fad64005150 con 0x7fad50009130 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 10 monclient: dump: 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:31:47.834 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3760759212 0 0) 0x7fad50009e70 con 0x7fad50009130 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fad5000c410 con 0x7fad50009130 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7715 (unknown 0 0 1688342218) 0x7fad640080e0 con 0x7fad50009130 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:31:47.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:31:47.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.195:6792/0 conn(0x7fad50009130 legacy=0x7fad500095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.819+0000 7fad5e7fc640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.195:6792/0 conn(0x7fad50009130 legacy=0x7fad500095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:31:47.836 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:31:47.836 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:47.836 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:47.836 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:31:47.836 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 42, 2024-09-13T10:31:47.836 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 122240, 2024-09-13T10:31:47.836 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:31:47.837 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:31:47.838 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.838 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.838 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.838 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.838 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.839 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.839 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.839 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.839 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.839 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.839 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.840 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:31:47.841 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:31:47.842 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.844 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.845 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.846 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.846 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:31:47.846 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:31:47.846 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.846 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.848 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.848 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:31:47.848 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.848 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.849 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.851 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:31:47.851 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:31:47.851 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.851 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.852 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.852 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:31:47.852 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.852 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.852 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.852 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:31:47.852 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:31:47.852 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.852 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.852 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.854 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.855 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:31:47.855 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.855 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.855 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.855 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:31:47.855 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:31:47.855 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.855 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.855 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:31:47.856 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:31:47.857 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:31:47.858 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.859 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:31:47.860 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:31:47.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:31:47.860 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:31:47.860 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:31:47.860 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:31:47.860 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:31:47.860 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:31:47.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:31:47.860 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:31:47.860 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:31:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.820+0000 7fad6fc40640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.195:6800/1839191919 conn(0x7fad4c040340 legacy=0x7fad4c042800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.820+0000 7fad6fc40640 10 monclient: shutdown 2024-09-13T10:31:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.820+0000 7fad6fc40640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:31:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.820+0000 7fad6fc40640 1 -- 172.21.15.181:0/3378278355 >> v1:172.21.15.181:6790/0 conn(0x7fad681d4730 legacy=0x7fad681d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:31:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.820+0000 7fad6e1dd640 1 -- 172.21.15.181:0/3378278355 reap_dead start 2024-09-13T10:31:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.820+0000 7fad6e1dd640 1 -- 172.21.15.181:0/3378278355 reap_dead start 2024-09-13T10:31:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.820+0000 7fad6fc40640 1 -- 172.21.15.181:0/3378278355 shutdown_connections 2024-09-13T10:31:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.820+0000 7fad6fc40640 1 -- 172.21.15.181:0/3378278355 >> 172.21.15.181:0/3378278355 conn(0x7fad680a6640 msgr2=0x7fad68141e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:31:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.820+0000 7fad6fc40640 1 -- 172.21.15.181:0/3378278355 shutdown_connections 2024-09-13T10:31:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:31:47.820+0000 7fad6fc40640 1 -- 172.21.15.181:0/3378278355 wait complete. 2024-09-13T10:31:47.863 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:31:47.863 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T10:31:49.805 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36288]: starting. 2024-09-13T10:31:49.805 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36288]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36287 2024-09-13T10:31:49.805 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36288]: created object 0... 2024-09-13T10:31:49.806 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36288]: created object 25... 2024-09-13T10:31:49.806 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36288]: created object 49... 2024-09-13T10:31:49.806 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36288]: finishing. 2024-09-13T10:31:49.806 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36288]: shutting down. 2024-09-13T10:31:50.576 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36289]: starting. 2024-09-13T10:31:50.576 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36289]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36287 2024-09-13T10:31:50.576 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36289]: shutting down. 2024-09-13T10:31:52.701 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:52.701 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36322]: starting. 2024-09-13T10:31:52.701 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36322]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36287 2024-09-13T10:31:52.702 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36322]: created object 0... 2024-09-13T10:31:52.702 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36322]: created object 25... 2024-09-13T10:31:52.702 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36322]: created object 49... 2024-09-13T10:31:52.702 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36322]: finishing. 2024-09-13T10:31:52.702 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36322]: shutting down. 2024-09-13T10:31:52.739 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:52.739 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36324]: starting. 2024-09-13T10:31:52.739 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36324]: listing objects. 2024-09-13T10:31:52.739 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36324]: listed object 0... 2024-09-13T10:31:52.740 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36324]: listed object 25... 2024-09-13T10:31:52.740 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36324]: saw 50 objects 2024-09-13T10:31:52.740 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36324]: shutting down. 2024-09-13T10:31:53.586 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:53.586 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36323]: starting. 2024-09-13T10:31:53.586 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36323]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36287 2024-09-13T10:31:53.586 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36323]: shutting down. 2024-09-13T10:31:53.588 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:53.588 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:53.588 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:31:53.593 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:31:55.724 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36391]: starting. 2024-09-13T10:31:55.724 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36391]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36390 2024-09-13T10:31:55.724 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36391]: created object 0... 2024-09-13T10:31:55.725 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36391]: created object 25... 2024-09-13T10:31:55.725 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36391]: created object 49... 2024-09-13T10:31:55.725 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36391]: finishing. 2024-09-13T10:31:55.725 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36391]: shutting down. 2024-09-13T10:31:56.617 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36392]: starting. 2024-09-13T10:31:56.618 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36392]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36390 2024-09-13T10:31:56.618 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36392]: shutting down. 2024-09-13T10:31:59.144 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:59.144 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36425]: starting. 2024-09-13T10:31:59.144 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36425]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36390 2024-09-13T10:31:59.144 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36425]: created object 0... 2024-09-13T10:31:59.144 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36425]: created object 25... 2024-09-13T10:31:59.144 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36425]: created object 49... 2024-09-13T10:31:59.145 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36425]: finishing. 2024-09-13T10:31:59.145 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36425]: shutting down. 2024-09-13T10:31:59.181 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:59.181 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36427]: starting. 2024-09-13T10:31:59.181 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36427]: listing objects. 2024-09-13T10:31:59.181 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36427]: listed object 0... 2024-09-13T10:31:59.181 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36427]: listed object 25... 2024-09-13T10:31:59.182 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36427]: saw 50 objects 2024-09-13T10:31:59.182 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36427]: shutting down. 2024-09-13T10:31:59.837 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:59.837 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36426]: starting. 2024-09-13T10:31:59.837 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36426]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36390 2024-09-13T10:31:59.837 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36426]: shutting down. 2024-09-13T10:31:59.839 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:59.839 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:31:59.839 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:31:59.842 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:32:01.688 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36494]: starting. 2024-09-13T10:32:01.688 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36494]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36493 2024-09-13T10:32:01.688 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36494]: created object 0... 2024-09-13T10:32:01.688 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36494]: created object 25... 2024-09-13T10:32:01.688 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36494]: created object 49... 2024-09-13T10:32:01.688 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36494]: finishing. 2024-09-13T10:32:01.688 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36494]: shutting down. 2024-09-13T10:32:02.582 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36495]: starting. 2024-09-13T10:32:02.583 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36495]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36493 2024-09-13T10:32:02.583 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36495]: shutting down. 2024-09-13T10:32:04.695 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:04.695 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36528]: starting. 2024-09-13T10:32:04.695 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36528]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36493 2024-09-13T10:32:04.695 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36528]: created object 0... 2024-09-13T10:32:04.696 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36528]: created object 25... 2024-09-13T10:32:04.696 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36528]: created object 49... 2024-09-13T10:32:04.696 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36528]: finishing. 2024-09-13T10:32:04.696 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36528]: shutting down. 2024-09-13T10:32:04.732 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:04.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36530]: starting. 2024-09-13T10:32:04.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36530]: listing objects. 2024-09-13T10:32:04.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36530]: listed object 0... 2024-09-13T10:32:04.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36530]: listed object 25... 2024-09-13T10:32:04.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36530]: saw 50 objects 2024-09-13T10:32:04.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36530]: shutting down. 2024-09-13T10:32:06.286 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:06.286 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36529]: starting. 2024-09-13T10:32:06.286 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36529]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36493 2024-09-13T10:32:06.286 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36529]: shutting down. 2024-09-13T10:32:06.287 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:06.287 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:06.287 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:32:06.290 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:32:07.864 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-09-13T10:32:07.864 INFO:tasks.ceph.mon.e:Restarting daemon 2024-09-13T10:32:07.864 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-09-13T10:32:07.867 INFO:tasks.ceph.mon.e:Started 2024-09-13T10:32:07.867 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-09-13T10:32:07.867 INFO:tasks.ceph.mon.a:Sent signal 19 2024-09-13T10:32:07.868 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-13T10:32:22.869 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-09-13T10:32:22.870 INFO:tasks.ceph.mon.a:Sent signal 18 2024-09-13T10:32:22.870 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:32:22.870 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:32:22.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.978+0000 7f6574d17640 10 monclient: get_monmap_and_config 2024-09-13T10:32:22.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.978+0000 7f6574d17640 10 monclient: build_initial_monmap 2024-09-13T10:32:22.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.978+0000 7f6574d17640 10 monclient: monmap: 2024-09-13T10:32:22.981 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:22.981 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:22.981 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:22.980354+0000 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:22.980354+0000 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:22.982 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:22.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.979+0000 7f6574d17640 1 Processor -- start 2024-09-13T10:32:22.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.979+0000 7f6574d17640 1 -- start start 2024-09-13T10:32:22.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.979+0000 7f6574d17640 10 monclient: init 2024-09-13T10:32:22.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.979+0000 7f6574d17640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:22.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.979+0000 7f6574d17640 10 monclient: _add_conns ranks=[1,0,3,6,8,2,7,5,4] 2024-09-13T10:32:22.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.980+0000 7f6574d17640 10 monclient(hunting): picked mon.noname-f con 0x7f65700a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:22.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.980+0000 7f6574d17640 10 monclient(hunting): picked mon.noname-a con 0x7f65700a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:22.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.980+0000 7f6574d17640 10 monclient(hunting): picked mon.noname-g con 0x7f657013f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:22.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.980+0000 7f6574d17640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65700a4bc0 con 0x7f65700a8340 2024-09-13T10:32:22.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.980+0000 7f6574d17640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f657013a320 con 0x7f65700a6640 2024-09-13T10:32:22.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.980+0000 7f6574d17640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65700a8100 con 0x7f657013f750 2024-09-13T10:32:22.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.980+0000 7f6574d17640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:22.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.980+0000 7f6574d17640 10 monclient(hunting): authenticate will time out at 882.486074s 2024-09-13T10:32:22.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.980+0000 7f6567fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f65700a8340 0x7f6570139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:39052/0 (socket says 172.21.15.181:39052) 2024-09-13T10:32:22.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.980+0000 7f6567fff640 1 -- 172.21.15.181:0/4081836867 learned_addr learned my addr 172.21.15.181:0/4081836867 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:22.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f6567fff640 1 -- 172.21.15.181:0/4081836867 >> v1:172.21.15.181:6789/0 conn(0x7f65700a8340 legacy=0x7f6570139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:22.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656ed9d640 1 -- 172.21.15.181:0/4081836867 >> v1:172.21.15.195:6790/0 conn(0x7f657013f750 legacy=0x7f6570141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:22.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656e59c640 1 -- 172.21.15.181:0/4081836867 >> v1:172.21.15.195:6789/0 conn(0x7f65700a6640 legacy=0x7f6570139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:22.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 1 -- 172.21.15.181:0/4081836867 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092578169 0 0) 0x7f65700a8100 con 0x7f657013f750 2024-09-13T10:32:22.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 10 monclient(hunting): _negotiate 2024-09-13T10:32:22.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:22.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:22.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 10 monclient(hunting): my global_id is 4926 2024-09-13T10:32:22.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 1 -- 172.21.15.181:0/4081836867 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f655c003520 con 0x7f657013f750 2024-09-13T10:32:22.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 1 -- 172.21.15.181:0/4081836867 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1143395605 0 0) 0x7f655c003520 con 0x7f657013f750 2024-09-13T10:32:22.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 1 -- 172.21.15.181:0/4081836867 >> v1:172.21.15.195:6789/0 conn(0x7f65700a6640 legacy=0x7f6570139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:22.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 1 -- 172.21.15.181:0/4081836867 >> v1:172.21.15.181:6789/0 conn(0x7f65700a8340 legacy=0x7f6570139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:22.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 10 monclient: _finish_hunting 0 2024-09-13T10:32:22.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 1 monclient: found mon.noname-g 2024-09-13T10:32:22.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 1 -- 172.21.15.181:0/4081836867 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65700a48e0 con 0x7f657013f750 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 10 monclient: _finish_auth 0 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 10 monclient: _check_auth_tickets 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f6574d17640 5 monclient: authenticate success, global_id 4926 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 1 -- 172.21.15.181:0/4081836867 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6568001eb0 con 0x7f657013f750 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f6574d17640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 10 monclient: dump: 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:22.991 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:22.992 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f6574d17640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 1 -- 172.21.15.181:0/4081836867 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6568003990 con 0x7f657013f750 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f6574d17640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.982+0000 7f656dd9b640 1 -- 172.21.15.181:0/4081836867 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6568003f00 con 0x7f657013f750 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.983+0000 7f6574d17640 4 set_mon_vals no callback set 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.983+0000 7f656dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.983+0000 7f656dd9b640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.983+0000 7f656dd9b640 10 monclient: dump: 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:22.993 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.983+0000 7f6574d17640 10 monclient: shutdown 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.983+0000 7f6574d17640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:22.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.983+0000 7f6574d17640 1 -- 172.21.15.181:0/4081836867 >> v1:172.21.15.195:6790/0 conn(0x7f657013f750 legacy=0x7f6570141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:22.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.983+0000 7f6574d17640 1 -- 172.21.15.181:0/4081836867 shutdown_connections 2024-09-13T10:32:22.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.983+0000 7f6574d17640 1 -- 172.21.15.181:0/4081836867 >> 172.21.15.181:0/4081836867 conn(0x7f6570077170 msgr2=0x7f65700abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:22.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.983+0000 7f6574d17640 1 -- 172.21.15.181:0/4081836867 shutdown_connections 2024-09-13T10:32:22.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.983+0000 7f6574d17640 1 -- 172.21.15.181:0/4081836867 wait complete. 2024-09-13T10:32:22.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.984+0000 7f6574d17640 10 monclient: build_initial_monmap 2024-09-13T10:32:22.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.984+0000 7f6574d17640 10 monclient: monmap: 2024-09-13T10:32:22.995 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:22.995 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:22.995 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:22.995 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:22.995 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:22.995 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:22.996 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:22.996 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:22.996 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:22.996 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:22.996 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:22.996 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:22.996 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:22.996 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:22.997 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:22.997 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:22.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.984+0000 7f6574d17640 1 Processor -- start 2024-09-13T10:32:22.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.984+0000 7f6574d17640 1 -- start start 2024-09-13T10:32:22.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.984+0000 7f6574d17640 10 monclient: init 2024-09-13T10:32:22.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.985+0000 7f6574d17640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:22.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.985+0000 7f6574d17640 10 monclient: _add_conns ranks=[7,4,3,8,6,0,2,1,5] 2024-09-13T10:32:22.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.985+0000 7f6574d17640 10 monclient(hunting): picked mon.noname-i con 0x7f65700a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:22.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.985+0000 7f6574d17640 10 monclient(hunting): picked mon.noname-c con 0x7f657013f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:22.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.985+0000 7f6574d17640 10 monclient(hunting): picked mon.noname-g con 0x7f6570142640 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:22.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.985+0000 7f6574d17640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65700aa070 con 0x7f6570142640 2024-09-13T10:32:22.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.985+0000 7f6574d17640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f657013b100 con 0x7f657013f750 2024-09-13T10:32:22.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.985+0000 7f6574d17640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f657013c600 con 0x7f65700a8340 2024-09-13T10:32:22.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.985+0000 7f6574d17640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:22.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.985+0000 7f6574d17640 10 monclient(hunting): authenticate will time out at 882.491131s 2024-09-13T10:32:22.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.985+0000 7f6567fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f657013f750 0x7f65701d3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:59732/0 (socket says 172.21.15.181:59732) 2024-09-13T10:32:22.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.985+0000 7f6567fff640 1 -- 172.21.15.181:0/3753506657 learned_addr learned my addr 172.21.15.181:0/3753506657 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:23.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.987+0000 7f6567fff640 1 -- 172.21.15.181:0/3753506657 >> v1:172.21.15.181:6791/0 conn(0x7f657013f750 legacy=0x7f65701d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.987+0000 7f656e59c640 1 -- 172.21.15.181:0/3753506657 >> v1:172.21.15.195:6792/0 conn(0x7f65700a8340 legacy=0x7f657012c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.987+0000 7f656ed9d640 1 -- 172.21.15.181:0/3753506657 >> v1:172.21.15.195:6790/0 conn(0x7f6570142640 legacy=0x7f65701d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.987+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354031031 0 0) 0x7f65700a48e0 con 0x7f6570142640 2024-09-13T10:32:23.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.987+0000 7f6566ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.987+0000 7f6566ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.987+0000 7f6566ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.987+0000 7f6566ffd640 10 monclient(hunting): my global_id is 4935 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.987+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6550003550 con 0x7f6570142640 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.987+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2444388586 0 0) 0x7f6550003550 con 0x7f6570142640 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.987+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65700a48e0 con 0x7f6570142640 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.987+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6568003e80 con 0x7f6570142640 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 10 monclient(hunting): dump: 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.002 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.003 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.003 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.003 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.003 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.003 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.003 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.003 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.003 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.003 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2363746162 0 0) 0x7f65700a48e0 con 0x7f6570142640 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 >> v1:172.21.15.195:6792/0 conn(0x7f65700a8340 legacy=0x7f657012c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 >> v1:172.21.15.181:6791/0 conn(0x7f657013f750 legacy=0x7f65701d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 1 monclient: found mon.g 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657013c8e0 con 0x7f6570142640 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 10 monclient: _finish_auth 0 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:23.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6574d17640 5 monclient: authenticate success, global_id 4935 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6574d17640 10 monclient: _renew_subs 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6574d17640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6574d17640 1 -- 172.21.15.181:0/3753506657 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f657013abe0 con 0x7f6570142640 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6574d17640 10 monclient: _renew_subs 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6574d17640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6574d17640 1 -- 172.21.15.181:0/3753506657 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f657012cf90 con 0x7f6570142640 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65680016f0 con 0x7f6570142640 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6568001950 con 0x7f6570142640 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f656d59a640 4 set_mon_vals no callback set 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:23.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.988+0000 7f6566ffd640 10 monclient: dump: 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.006 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.007 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.989+0000 7f6574d17640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:23.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.989+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6568012020 con 0x7f6570142640 2024-09-13T10:32:23.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.989+0000 7f6574d17640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:23.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.989+0000 7f6574d17640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:32:23.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.989+0000 7f6574d17640 1 -- 172.21.15.181:0/3753506657 --> v1:172.21.15.195:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6554005080 con 0x7f6570142640 2024-09-13T10:32:23.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.989+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(75..75 src has 1..75) ==== 3898+0+0 (unknown 861344605 0 0) 0x7f656804e610 con 0x7f6570142640 2024-09-13T10:32:23.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.989+0000 7f656e59c640 10 monclient: get_auth_request con 0x7f655003fac0 auth_method 0 2024-09-13T10:32:23.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.994+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 <== mon.3 v1:172.21.15.195:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f65700aa070 con 0x7f6570142640 2024-09-13T10:32:23.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.994+0000 7f6566ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:23.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:22.994+0000 7f6566ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:23.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.240+0000 7f6574d17640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:32:23.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.240+0000 7f6574d17640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:32:23.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.240+0000 7f6574d17640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:32:23.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.240+0000 7f6574d17640 1 -- 172.21.15.181:0/3753506657 --> v1:172.21.15.195:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6554005370 con 0x7f6570142640 2024-09-13T10:32:23.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.240+0000 7f6566ffd640 1 -- 172.21.15.181:0/3753506657 <== mon.3 v1:172.21.15.195:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 2188483333) 0x7f6568017a40 con 0x7f6570142640 2024-09-13T10:32:23.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.241+0000 7f6566ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:32:23.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.241+0000 7f6566ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:23.244 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":48,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:32:23.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.243+0000 7f6574d17640 1 -- 172.21.15.181:0/3753506657 >> v1:172.21.15.195:6800/1839191919 conn(0x7f655003fac0 legacy=0x7f6550041f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.243+0000 7f6574d17640 10 monclient: shutdown 2024-09-13T10:32:23.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.243+0000 7f6574d17640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:23.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.243+0000 7f6574d17640 1 -- 172.21.15.181:0/3753506657 >> v1:172.21.15.195:6790/0 conn(0x7f6570142640 legacy=0x7f65701d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.243+0000 7f6574d17640 1 -- 172.21.15.181:0/3753506657 shutdown_connections 2024-09-13T10:32:23.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.243+0000 7f6574d17640 1 -- 172.21.15.181:0/3753506657 >> 172.21.15.181:0/3753506657 conn(0x7f65700a6640 msgr2=0x7f65700a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:23.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.243+0000 7f6574d17640 1 -- 172.21.15.181:0/3753506657 shutdown_connections 2024-09-13T10:32:23.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.243+0000 7f6574d17640 1 -- 172.21.15.181:0/3753506657 wait complete. 2024-09-13T10:32:23.256 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:32:23.256 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:32:23.256 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:32:23.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.352+0000 7f5d0c31e640 10 monclient: get_monmap_and_config 2024-09-13T10:32:23.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.352+0000 7f5d0c31e640 10 monclient: build_initial_monmap 2024-09-13T10:32:23.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.352+0000 7f5d0c31e640 10 monclient: monmap: 2024-09-13T10:32:23.355 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:23.355 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.355 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:23.354250+0000 2024-09-13T10:32:23.355 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:23.354250+0000 2024-09-13T10:32:23.355 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:23.355 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.355 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:23.355 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:23.356 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:23.356 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:23.356 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:23.356 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:23.356 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:23.356 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:23.356 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:23.356 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.353+0000 7f5d0c31e640 1 Processor -- start 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.353+0000 7f5d0c31e640 1 -- start start 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.353+0000 7f5d0c31e640 10 monclient: init 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.353+0000 7f5d0c31e640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.353+0000 7f5d0c31e640 10 monclient: _add_conns ranks=[5,6,0,8,7,4,3,1,2] 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.353+0000 7f5d0c31e640 10 monclient(hunting): picked mon.noname-h con 0x7f5d040a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.353+0000 7f5d0c31e640 10 monclient(hunting): picked mon.noname-d con 0x7f5d040a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.353+0000 7f5d0c31e640 10 monclient(hunting): picked mon.noname-a con 0x7f5d0413f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.353+0000 7f5d0c31e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d040a4bc0 con 0x7f5d0413f750 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.353+0000 7f5d0c31e640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d0413a320 con 0x7f5d040a6640 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.353+0000 7f5d0c31e640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d040a8100 con 0x7f5d040a8340 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.353+0000 7f5d0c31e640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.354+0000 7f5d0c31e640 10 monclient(hunting): authenticate will time out at 882.860009s 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.354+0000 7f5d098b9640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f5d040a8340 0x7f5d04139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46436/0 (socket says 172.21.15.181:46436) 2024-09-13T10:32:23.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.354+0000 7f5d0a8bb640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5d0413f750 0x7f5d04141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:52986/0 (socket says 172.21.15.181:52986) 2024-09-13T10:32:23.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.354+0000 7f5d098b9640 1 -- 172.21.15.181:0/1005985006 learned_addr learned my addr 172.21.15.181:0/1005985006 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:23.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.356+0000 7f5d098b9640 1 -- 172.21.15.181:0/1005985006 >> v1:172.21.15.181:6792/0 conn(0x7f5d040a8340 legacy=0x7f5d04139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.356+0000 7f5d0a8bb640 1 -- 172.21.15.181:0/1005985006 >> v1:172.21.15.181:6789/0 conn(0x7f5d0413f750 legacy=0x7f5d04141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.356+0000 7f5d0a0ba640 1 -- 172.21.15.181:0/1005985006 >> v1:172.21.15.195:6791/0 conn(0x7f5d040a6640 legacy=0x7f5d04139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.673+0000 7f5d090b8640 1 -- 172.21.15.181:0/1005985006 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776701379 0 0) 0x7f5d040a4bc0 con 0x7f5d0413f750 2024-09-13T10:32:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient(hunting): my global_id is 54864 2024-09-13T10:32:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 1 -- 172.21.15.181:0/1005985006 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cf0003520 con 0x7f5d0413f750 2024-09-13T10:32:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 1 -- 172.21.15.181:0/1005985006 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 775797795 0 0) 0x7f5cf0003520 con 0x7f5d0413f750 2024-09-13T10:32:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 1 -- 172.21.15.181:0/1005985006 >> v1:172.21.15.181:6792/0 conn(0x7f5d040a8340 legacy=0x7f5d04139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 1 -- 172.21.15.181:0/1005985006 >> v1:172.21.15.195:6791/0 conn(0x7f5d040a6640 legacy=0x7f5d04139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient: _finish_hunting 0 2024-09-13T10:32:23.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 1 monclient: found mon.noname-a 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 1 -- 172.21.15.181:0/1005985006 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d040a48e0 con 0x7f5d0413f750 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient: _finish_auth 0 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient: _check_auth_tickets 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 1 -- 172.21.15.181:0/1005985006 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5cfc001d90 con 0x7f5d0413f750 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient: dump: 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.679 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.680 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d0c31e640 5 monclient: authenticate success, global_id 54864 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d0c31e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 1 -- 172.21.15.181:0/1005985006 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5cfc0020a0 con 0x7f5d0413f750 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d0c31e640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 1 -- 172.21.15.181:0/1005985006 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5cfc004ea0 con 0x7f5d0413f750 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d0c31e640 4 set_mon_vals no callback set 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.674+0000 7f5d090b8640 10 monclient: dump: 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.681 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.682 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.682 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.682 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.682 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.682 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.682 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.682 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.682 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.682 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.682 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.682 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.682 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.675+0000 7f5d0c31e640 10 monclient: shutdown 2024-09-13T10:32:23.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.675+0000 7f5d0c31e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:23.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.675+0000 7f5d0c31e640 1 -- 172.21.15.181:0/1005985006 >> v1:172.21.15.181:6789/0 conn(0x7f5d0413f750 legacy=0x7f5d04141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.675+0000 7f5d0c31e640 1 -- 172.21.15.181:0/1005985006 shutdown_connections 2024-09-13T10:32:23.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.675+0000 7f5d0c31e640 1 -- 172.21.15.181:0/1005985006 >> 172.21.15.181:0/1005985006 conn(0x7f5d04077170 msgr2=0x7f5d040abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:23.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.675+0000 7f5d0c31e640 1 -- 172.21.15.181:0/1005985006 shutdown_connections 2024-09-13T10:32:23.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.675+0000 7f5d0c31e640 1 -- 172.21.15.181:0/1005985006 wait complete. 2024-09-13T10:32:23.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.676+0000 7f5d0c31e640 10 monclient: build_initial_monmap 2024-09-13T10:32:23.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.676+0000 7f5d0c31e640 10 monclient: monmap: 2024-09-13T10:32:23.689 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:23.689 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:23.689 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:23.689 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:23.689 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.677+0000 7f5d0c31e640 1 Processor -- start 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.677+0000 7f5d0c31e640 1 -- start start 2024-09-13T10:32:23.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.677+0000 7f5d0c31e640 10 monclient: init 2024-09-13T10:32:23.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.677+0000 7f5d0c31e640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:23.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.677+0000 7f5d0c31e640 10 monclient: _add_conns ranks=[4,1,5,8,3,6,0,7,2] 2024-09-13T10:32:23.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.678+0000 7f5d0c31e640 10 monclient(hunting): picked mon.noname-c con 0x7f5d040a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:23.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.678+0000 7f5d0c31e640 10 monclient(hunting): picked mon.noname-f con 0x7f5d0413f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:23.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.678+0000 7f5d0a0ba640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f5d040a8340 0x7f5d041ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:33962/0 (socket says 172.21.15.181:33962) 2024-09-13T10:32:23.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.678+0000 7f5d0a0ba640 1 -- 172.21.15.181:0/103874870 learned_addr learned my addr 172.21.15.181:0/103874870 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:23.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.678+0000 7f5d0c31e640 10 monclient(hunting): picked mon.noname-h con 0x7f5d0413cb30 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:23.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.678+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d041343b0 con 0x7f5d0413f750 2024-09-13T10:32:23.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.678+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d04134690 con 0x7f5d040a8340 2024-09-13T10:32:23.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.678+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d04134970 con 0x7f5d0413cb30 2024-09-13T10:32:23.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.678+0000 7f5d0c31e640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:23.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.678+0000 7f5d0c31e640 10 monclient(hunting): authenticate will time out at 883.184553s 2024-09-13T10:32:23.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.680+0000 7f5d0a0ba640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.181:6791/0 conn(0x7f5d040a8340 legacy=0x7f5d041ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.680+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 800918859 0 0) 0x7f5d04134690 con 0x7f5d040a8340 2024-09-13T10:32:23.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.680+0000 7f5cf6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.680+0000 7f5cf6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.680+0000 7f5cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.680+0000 7f5cf6ffd640 10 monclient(hunting): my global_id is 5053 2024-09-13T10:32:23.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.680+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ce8003550 con 0x7f5d040a8340 2024-09-13T10:32:23.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5d098b9640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.195:6789/0 conn(0x7f5d0413f750 legacy=0x7f5d041d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5d0a8bb640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.195:6791/0 conn(0x7f5d0413cb30 legacy=0x7f5d041d6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2462191391 0 0) 0x7f5ce8003550 con 0x7f5d040a8340 2024-09-13T10:32:23.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d04134690 con 0x7f5d040a8340 2024-09-13T10:32:23.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d00003610 con 0x7f5d040a8340 2024-09-13T10:32:23.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:23.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:32:23.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient(hunting): dump: 2024-09-13T10:32:23.693 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.693 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.693 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.693 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.693 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.693 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.693 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.693 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.693 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.694 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.694 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.694 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.694 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.694 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.694 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.694 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:23.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 726920835 0 0) 0x7f5d04134970 con 0x7f5d0413cb30 2024-09-13T10:32:23.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient(hunting): my global_id is 5045 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ce8003550 con 0x7f5d0413cb30 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1596600492 0 0) 0x7f5d04134690 con 0x7f5d040a8340 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.195:6791/0 conn(0x7f5d0413cb30 legacy=0x7f5d041d6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.195:6789/0 conn(0x7f5d0413f750 legacy=0x7f5d041d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 1 monclient: found mon.c 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0413e6d0 con 0x7f5d040a8340 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:23.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5d0c31e640 5 monclient: authenticate success, global_id 5053 2024-09-13T10:32:23.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5d0c31e640 10 monclient: _renew_subs 2024-09-13T10:32:23.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5d0c31e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:23.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0413dfa0 con 0x7f5d040a8340 2024-09-13T10:32:23.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5d0c31e640 10 monclient: _renew_subs 2024-09-13T10:32:23.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5d0c31e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:23.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f5d041ced10 con 0x7f5d040a8340 2024-09-13T10:32:23.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d00003c70 con 0x7f5d040a8340 2024-09-13T10:32:23.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:23.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d000041a0 con 0x7f5d040a8340 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5d088b7640 4 set_mon_vals no callback set 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.681+0000 7f5cf6ffd640 10 monclient: dump: 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.697 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.698 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.698 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.698 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.698 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.698 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.698 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.682+0000 7f5d0c31e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:23.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.682+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5cec0065c0 con 0x7f5cec002860 2024-09-13T10:32:23.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.682+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5d00011ca0 con 0x7f5d040a8340 2024-09-13T10:32:23.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.683+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(76..76 src has 1..76) ==== 3898+0+0 (unknown 2811027461 0 0) 0x7f5d0004e440 con 0x7f5d040a8340 2024-09-13T10:32:23.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.683+0000 7f5d0a8bb640 10 monclient: get_auth_request con 0x7f5ce803faf0 auth_method 0 2024-09-13T10:32:23.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.684+0000 7f5d098b9640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.181:6789/0 conn(0x7f5cec002860 legacy=0x7f5cec004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.684+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631286727 0 0) 0x7f5cec0065c0 con 0x7f5cec002860 2024-09-13T10:32:23.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.684+0000 7f5cf6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.684+0000 7f5cf6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.684+0000 7f5cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.684+0000 7f5cf6ffd640 10 monclient(hunting): my global_id is 54873 2024-09-13T10:32:23.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.684+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d04134690 con 0x7f5cec002860 2024-09-13T10:32:23.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1620213102 0 0) 0x7f5d04134690 con 0x7f5cec002860 2024-09-13T10:32:23.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cec0065c0 con 0x7f5cec002860 2024-09-13T10:32:23.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5cf8001ce0 con 0x7f5cec002860 2024-09-13T10:32:23.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:23.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 10 monclient: dump: 2024-09-13T10:32:23.700 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.700 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.700 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.700 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.700 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.701 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.701 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.701 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.701 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.701 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.701 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.701 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.701 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.701 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.701 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.701 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1350662677 0 0) 0x7f5cec0065c0 con 0x7f5cec002860 2024-09-13T10:32:23.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5cec00a160 con 0x7f5cec002860 2024-09-13T10:32:23.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5cf80058d0 con 0x7f5cec002860 2024-09-13T10:32:23.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:23.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:23.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.181:6789/0 conn(0x7f5cec002860 legacy=0x7f5cec004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.685+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.181:6789/0 conn(0x7f5cec002860 legacy=0x7f5cec004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:23.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.691+0000 7f5d0c31e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:23.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.691+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5cec009e70 con 0x7f5cec009130 2024-09-13T10:32:23.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5d098b9640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.181:6789/0 conn(0x7f5cec009130 legacy=0x7f5cec0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1027439585 0 0) 0x7f5cec009e70 con 0x7f5cec009130 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 10 monclient(hunting): my global_id is 54882 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cec0065c0 con 0x7f5cec009130 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3891112313 0 0) 0x7f5cec0065c0 con 0x7f5cec009130 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cec009e70 con 0x7f5cec009130 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5cf8004fd0 con 0x7f5cec009130 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 10 monclient: dump: 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.705 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.706 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3227746108 0 0) 0x7f5cec009e70 con 0x7f5cec009130 2024-09-13T10:32:23.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5cec00c410 con 0x7f5cec009130 2024-09-13T10:32:23.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 3239866058) 0x7f5cf8005a80 con 0x7f5cec009130 2024-09-13T10:32:23.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:23.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:23.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.181:6789/0 conn(0x7f5cec009130 legacy=0x7f5cec0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.694+0000 7f5cf6ffd640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.181:6789/0 conn(0x7f5cec009130 legacy=0x7f5cec0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:23.707 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:23.707 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:23.707 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:23.708 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:23.708 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:23.708 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 158127, 2024-09-13T10:32:23.708 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:23.708 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:23.708 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:23.708 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:23.708 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:23.708 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:23.708 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:23.708 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:23.708 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:23.709 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:23.710 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:23.711 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:23.712 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:23.713 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.714 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.715 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:23.716 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:23.719 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.720 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:23.722 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:23.724 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.725 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.726 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.727 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:23.727 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:23.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.695+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5ce803faf0 legacy=0x7f5ce8041fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.695+0000 7f5d0c31e640 10 monclient: shutdown 2024-09-13T10:32:23.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.695+0000 7f5d0c31e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:23.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.695+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 >> v1:172.21.15.181:6791/0 conn(0x7f5d040a8340 legacy=0x7f5d041ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.695+0000 7f5d0a8bb640 1 -- 172.21.15.181:0/103874870 reap_dead start 2024-09-13T10:32:23.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.695+0000 7f5d0a8bb640 1 -- 172.21.15.181:0/103874870 reap_dead start 2024-09-13T10:32:23.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.695+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 shutdown_connections 2024-09-13T10:32:23.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.695+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 >> 172.21.15.181:0/103874870 conn(0x7f5d040a6640 msgr2=0x7f5d040a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:23.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.695+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 shutdown_connections 2024-09-13T10:32:23.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.695+0000 7f5d0c31e640 1 -- 172.21.15.181:0/103874870 wait complete. 2024-09-13T10:32:23.729 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:23.729 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:32:23.729 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:32:23.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.825+0000 7f46b3775640 10 monclient: get_monmap_and_config 2024-09-13T10:32:23.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.825+0000 7f46b3775640 10 monclient: build_initial_monmap 2024-09-13T10:32:23.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.825+0000 7f46b3775640 10 monclient: monmap: 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:23.826808+0000 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:23.826808+0000 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:23.828 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:23.829 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:23.829 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.825+0000 7f46b3775640 1 Processor -- start 2024-09-13T10:32:23.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.825+0000 7f46b3775640 1 -- start start 2024-09-13T10:32:23.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.825+0000 7f46b3775640 10 monclient: init 2024-09-13T10:32:23.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b3775640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:23.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b3775640 10 monclient: _add_conns ranks=[7,4,0,5,1,8,3,6,2] 2024-09-13T10:32:23.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b3775640 10 monclient(hunting): picked mon.noname-i con 0x7f46ac0a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:23.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b3775640 10 monclient(hunting): picked mon.noname-c con 0x7f46ac0a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:23.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b3775640 10 monclient(hunting): picked mon.noname-a con 0x7f46ac13f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:23.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b3775640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ac0a4bc0 con 0x7f46ac13f750 2024-09-13T10:32:23.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b3775640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ac13a320 con 0x7f46ac0a8340 2024-09-13T10:32:23.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b3775640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ac0a8100 con 0x7f46ac0a6640 2024-09-13T10:32:23.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b3775640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:23.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b3775640 10 monclient(hunting): authenticate will time out at 883.332505s 2024-09-13T10:32:23.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b1d12640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f46ac13f750 0x7f46ac141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53002/0 (socket says 172.21.15.181:53002) 2024-09-13T10:32:23.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b0d10640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f46ac0a8340 0x7f46ac139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:33978/0 (socket says 172.21.15.181:33978) 2024-09-13T10:32:23.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.826+0000 7f46b1d12640 1 -- 172.21.15.181:0/950736081 learned_addr learned my addr 172.21.15.181:0/950736081 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:23.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46b1d12640 1 -- 172.21.15.181:0/950736081 >> v1:172.21.15.181:6789/0 conn(0x7f46ac13f750 legacy=0x7f46ac141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46b0d10640 1 -- 172.21.15.181:0/950736081 >> v1:172.21.15.181:6791/0 conn(0x7f46ac0a8340 legacy=0x7f46ac139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46abfff640 1 -- 172.21.15.181:0/950736081 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907751753 0 0) 0x7f46ac0a4bc0 con 0x7f46ac13f750 2024-09-13T10:32:23.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46abfff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46abfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46abfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46abfff640 10 monclient(hunting): my global_id is 54891 2024-09-13T10:32:23.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46abfff640 1 -- 172.21.15.181:0/950736081 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4694003520 con 0x7f46ac13f750 2024-09-13T10:32:23.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46abfff640 1 -- 172.21.15.181:0/950736081 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1824870883 0 0) 0x7f46ac13a320 con 0x7f46ac0a8340 2024-09-13T10:32:23.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46abfff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46abfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46abfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46abfff640 10 monclient(hunting): my global_id is 5062 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46b1511640 1 -- 172.21.15.181:0/950736081 >> v1:172.21.15.195:6792/0 conn(0x7f46ac0a6640 legacy=0x7f46ac139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.828+0000 7f46abfff640 1 -- 172.21.15.181:0/950736081 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46ac0a4bc0 con 0x7f46ac0a8340 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 1 -- 172.21.15.181:0/950736081 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1612826936 0 0) 0x7f4694003520 con 0x7f46ac13f750 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 1 -- 172.21.15.181:0/950736081 >> v1:172.21.15.195:6792/0 conn(0x7f46ac0a6640 legacy=0x7f46ac139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 1 -- 172.21.15.181:0/950736081 >> v1:172.21.15.181:6791/0 conn(0x7f46ac0a8340 legacy=0x7f46ac139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 10 monclient: _finish_hunting 0 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 1 monclient: found mon.noname-a 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 1 -- 172.21.15.181:0/950736081 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac0a48e0 con 0x7f46ac13f750 2024-09-13T10:32:23.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 10 monclient: _finish_auth 0 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 10 monclient: _check_auth_tickets 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46b3775640 5 monclient: authenticate success, global_id 54891 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 1 -- 172.21.15.181:0/950736081 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f469c001e60 con 0x7f46ac13f750 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 10 monclient: dump: 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.840 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.841 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.841 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.841 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.841 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.841 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.841 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.841 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.841 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.841 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46b3775640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:23.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 1 -- 172.21.15.181:0/950736081 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f469c004c20 con 0x7f46ac13f750 2024-09-13T10:32:23.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 1 -- 172.21.15.181:0/950736081 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f469c005190 con 0x7f46ac13f750 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46b3775640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46b3775640 4 set_mon_vals no callback set 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46abfff640 10 monclient: dump: 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.842 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46b3775640 10 monclient: shutdown 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46b3775640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46b3775640 1 -- 172.21.15.181:0/950736081 >> v1:172.21.15.181:6789/0 conn(0x7f46ac13f750 legacy=0x7f46ac141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46b3775640 1 -- 172.21.15.181:0/950736081 shutdown_connections 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46b3775640 1 -- 172.21.15.181:0/950736081 >> 172.21.15.181:0/950736081 conn(0x7f46ac077170 msgr2=0x7f46ac0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:23.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.829+0000 7f46b3775640 1 -- 172.21.15.181:0/950736081 shutdown_connections 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.830+0000 7f46b3775640 1 -- 172.21.15.181:0/950736081 wait complete. 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.830+0000 7f46b3775640 10 monclient: build_initial_monmap 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.830+0000 7f46b3775640 10 monclient: monmap: 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:23.844 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.830+0000 7f46b3775640 1 Processor -- start 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.830+0000 7f46b3775640 1 -- start start 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.830+0000 7f46b3775640 10 monclient: init 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.831+0000 7f46b3775640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.831+0000 7f46b3775640 10 monclient: _add_conns ranks=[5,8,1,7,2,3,6,4,0] 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.831+0000 7f46b3775640 10 monclient(hunting): picked mon.noname-h con 0x7f46ac0a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.831+0000 7f46b3775640 10 monclient(hunting): picked mon.noname-e con 0x7f46ac13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:23.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.831+0000 7f46b3775640 10 monclient(hunting): picked mon.noname-f con 0x7f46ac1d4310 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.831+0000 7f46b3775640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ac0a10e0 con 0x7f46ac1d4310 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.831+0000 7f46b3775640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ac142cf0 con 0x7f46ac0a8340 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.831+0000 7f46b3775640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ac0a0270 con 0x7f46ac13f750 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.831+0000 7f46b3775640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.831+0000 7f46b3775640 10 monclient(hunting): authenticate will time out at 883.337469s 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.831+0000 7f46b0d10640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f46ac13f750 0x7f46ac09db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40366/0 (socket says 172.21.15.181:40366) 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.831+0000 7f46b0d10640 1 -- 172.21.15.181:0/2208518577 learned_addr learned my addr 172.21.15.181:0/2208518577 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.833+0000 7f46b0d10640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.181:6793/0 conn(0x7f46ac13f750 legacy=0x7f46ac09db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.833+0000 7f46b1511640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.195:6791/0 conn(0x7f46ac0a8340 legacy=0x7f46ac09d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.833+0000 7f46b1d12640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.195:6789/0 conn(0x7f46ac1d4310 legacy=0x7f46ac1d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.833+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 986861178 0 0) 0x7f46ac0a0270 con 0x7f46ac13f750 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.833+0000 7f46a9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.833+0000 7f46a9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.833+0000 7f46a9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.833+0000 7f46a9ffb640 10 monclient(hunting): my global_id is 74105 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.833+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4698003550 con 0x7f46ac13f750 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.833+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 412164425 0 0) 0x7f4698003550 con 0x7f46ac13f750 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46ac0a0270 con 0x7f46ac13f750 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f46a0001d00 con 0x7f46ac13f750 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient(hunting): dump: 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.847 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825308228 0 0) 0x7f46ac0a10e0 con 0x7f46ac1d4310 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient(hunting): my global_id is 55072 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4698003550 con 0x7f46ac1d4310 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408500560 0 0) 0x7f46ac142cf0 con 0x7f46ac0a8340 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient(hunting): my global_id is 5054 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46ac0a10e0 con 0x7f46ac0a8340 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2859083603 0 0) 0x7f46ac0a0270 con 0x7f46ac13f750 2024-09-13T10:32:23.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.195:6791/0 conn(0x7f46ac0a8340 legacy=0x7f46ac09d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.195:6789/0 conn(0x7f46ac1d4310 legacy=0x7f46ac1d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 monclient: found mon.e 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac09ed80 con 0x7f46ac13f750 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient: _finish_auth 0 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46b3775640 5 monclient: authenticate success, global_id 74105 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46b3775640 10 monclient: _renew_subs 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46b3775640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46b3775640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f46ac09e230 con 0x7f46ac13f750 2024-09-13T10:32:23.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f46a0004b80 con 0x7f46ac13f750 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f46a0005070 con 0x7f46ac13f750 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46a9ffb640 10 monclient: dump: 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.851 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.852 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.852 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.852 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.852 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.852 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.852 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.852 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.852 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46b3775640 10 monclient: _renew_subs 2024-09-13T10:32:23.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46ab7fe640 4 set_mon_vals no callback set 2024-09-13T10:32:23.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46b3775640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:23.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.834+0000 7f46b3775640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f46ac09fb80 con 0x7f46ac13f750 2024-09-13T10:32:23.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.835+0000 7f46b3775640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:23.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.835+0000 7f46b3775640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f46ac143260 con 0x7f46ac077170 2024-09-13T10:32:23.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.835+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f46a00052d0 con 0x7f46ac13f750 2024-09-13T10:32:23.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.835+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(76..76 src has 1..76) ==== 3898+0+0 (unknown 2811027461 0 0) 0x7f46a004e320 con 0x7f46ac13f750 2024-09-13T10:32:23.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.835+0000 7f46b1d12640 10 monclient: get_auth_request con 0x7f469803fce0 auth_method 0 2024-09-13T10:32:23.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46b1511640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.181:6790/0 conn(0x7f46ac077170 legacy=0x7f46ac13a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4020173916 0 0) 0x7f46ac143260 con 0x7f46ac077170 2024-09-13T10:32:23.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46a9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46a9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46a9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46a9ffb640 10 monclient(hunting): my global_id is 64469 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46ac0a0270 con 0x7f46ac077170 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1744503749 0 0) 0x7f46ac0a0270 con 0x7f46ac077170 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46ac143260 con 0x7f46ac077170 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f46a4001c70 con 0x7f46ac077170 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46a9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.837+0000 7f46a9ffb640 10 monclient: dump: 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.856 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.857 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.838+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3747709483 0 0) 0x7f46ac143260 con 0x7f46ac077170 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.838+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46ac0a2940 con 0x7f46ac077170 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.838+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f46a4006870 con 0x7f46ac077170 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.838+0000 7f46a9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.838+0000 7f46a9ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.838+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.181:6790/0 conn(0x7f46ac077170 legacy=0x7f46ac13a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.838+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.181:6790/0 conn(0x7f46ac077170 legacy=0x7f46ac13a4f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.844+0000 7f46b3775640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.844+0000 7f46b3775640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f46ac0a2af0 con 0x7f46ac069b40 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46b1511640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.181:6790/0 conn(0x7f46ac069b40 legacy=0x7f46ac13ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415563885 0 0) 0x7f46ac0a10e0 con 0x7f46ac069b40 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46a9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46a9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46a9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46a9ffb640 10 monclient(hunting): my global_id is 64478 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46ac143260 con 0x7f46ac069b40 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 681650580 0 0) 0x7f46ac143260 con 0x7f46ac069b40 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46ac0a10e0 con 0x7f46ac069b40 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f46a4003d00 con 0x7f46ac069b40 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46a9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.846+0000 7f46a9ffb640 10 monclient: dump: 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.859 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2694417463 0 0) 0x7f46ac0a10e0 con 0x7f46ac069b40 2024-09-13T10:32:23.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f46ac13b310 con 0x7f46ac069b40 2024-09-13T10:32:23.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 398550186) 0x7f46a40040d0 con 0x7f46ac069b40 2024-09-13T10:32:23.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46a9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:23.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46a9ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:23.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.181:6790/0 conn(0x7f46ac069b40 legacy=0x7f46ac13ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46a9ffb640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.181:6790/0 conn(0x7f46ac069b40 legacy=0x7f46ac13ac00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:23.861 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:23.861 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:23.861 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 69752, 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:23.862 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:23.863 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:23.864 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:23.865 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:23.866 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:23.867 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.868 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.870 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.871 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:23.872 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.873 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.874 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:23.875 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:23.876 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.876 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.876 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.876 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:23.876 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.876 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.876 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.876 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:23.876 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:23.876 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.877 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:23.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.879 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:23.880 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:23.881 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:23.881 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:23.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:23.881 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:23.881 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46b3775640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.195:6800/1839191919 conn(0x7f469803fce0 legacy=0x7f46980421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46b3775640 10 monclient: shutdown 2024-09-13T10:32:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46b3775640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46b3775640 1 -- 172.21.15.181:0/2208518577 >> v1:172.21.15.181:6793/0 conn(0x7f46ac13f750 legacy=0x7f46ac09db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46b1d12640 1 -- 172.21.15.181:0/2208518577 reap_dead start 2024-09-13T10:32:23.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46b1d12640 1 -- 172.21.15.181:0/2208518577 reap_dead start 2024-09-13T10:32:23.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46b3775640 1 -- 172.21.15.181:0/2208518577 shutdown_connections 2024-09-13T10:32:23.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46b3775640 1 -- 172.21.15.181:0/2208518577 >> 172.21.15.181:0/2208518577 conn(0x7f46ac0a6640 msgr2=0x7f46ac141ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:23.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46b3775640 1 -- 172.21.15.181:0/2208518577 shutdown_connections 2024-09-13T10:32:23.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.847+0000 7f46b3775640 1 -- 172.21.15.181:0/2208518577 wait complete. 2024-09-13T10:32:23.883 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:23.883 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:32:23.883 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:32:23.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.979+0000 7f5355e31640 10 monclient: get_monmap_and_config 2024-09-13T10:32:23.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.979+0000 7f5355e31640 10 monclient: build_initial_monmap 2024-09-13T10:32:23.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.979+0000 7f5355e31640 10 monclient: monmap: 2024-09-13T10:32:23.982 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:23.982 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.982 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:23.981467+0000 2024-09-13T10:32:23.982 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:23.981467+0000 2024-09-13T10:32:23.982 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:23.983 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:23.983 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.980+0000 7f5355e31640 1 Processor -- start 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.980+0000 7f5355e31640 1 -- start start 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.980+0000 7f5355e31640 10 monclient: init 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.981+0000 7f5355e31640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.981+0000 7f5355e31640 10 monclient: _add_conns ranks=[7,5,8,6,3,0,4,2,1] 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.981+0000 7f5355e31640 10 monclient(hunting): picked mon.noname-i con 0x7f53500a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.981+0000 7f5355e31640 10 monclient(hunting): picked mon.noname-h con 0x7f53500a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.981+0000 7f5355e31640 10 monclient(hunting): picked mon.noname-e con 0x7f535013f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.981+0000 7f5355e31640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53500a4bc0 con 0x7f53500a8340 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.981+0000 7f5355e31640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535013a320 con 0x7f53500a6640 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.981+0000 7f5355e31640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53500a8100 con 0x7f535013f750 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.981+0000 7f5355e31640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.981+0000 7f5355e31640 10 monclient(hunting): authenticate will time out at 883.487393s 2024-09-13T10:32:23.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.981+0000 7f534ffff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f535013f750 0x7f5350141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40370/0 (socket says 172.21.15.181:40370) 2024-09-13T10:32:23.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.981+0000 7f534ffff640 1 -- 172.21.15.181:0/353023461 learned_addr learned my addr 172.21.15.181:0/353023461 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:23.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534ffff640 1 -- 172.21.15.181:0/353023461 >> v1:172.21.15.181:6793/0 conn(0x7f535013f750 legacy=0x7f5350141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f5347fff640 1 -- 172.21.15.181:0/353023461 >> v1:172.21.15.195:6791/0 conn(0x7f53500a8340 legacy=0x7f5350139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534f7fe640 1 -- 172.21.15.181:0/353023461 >> v1:172.21.15.195:6792/0 conn(0x7f53500a6640 legacy=0x7f5350139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:23.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3467388970 0 0) 0x7f53500a8100 con 0x7f535013f750 2024-09-13T10:32:23.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 10 monclient(hunting): my global_id is 74114 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f533c003520 con 0x7f535013f750 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 485373604 0 0) 0x7f53500a4bc0 con 0x7f53500a8340 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 10 monclient(hunting): my global_id is 5063 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53500a8100 con 0x7f53500a8340 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 670847847 0 0) 0x7f535013a320 con 0x7f53500a6640 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:23.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 10 monclient(hunting): my global_id is 55024 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.983+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53500a4bc0 con 0x7f53500a6640 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2541746861 0 0) 0x7f533c003520 con 0x7f535013f750 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 >> v1:172.21.15.195:6792/0 conn(0x7f53500a6640 legacy=0x7f5350139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 >> v1:172.21.15.195:6791/0 conn(0x7f53500a8340 legacy=0x7f5350139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 1 monclient: found mon.noname-e 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53500a48e0 con 0x7f535013f750 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 10 monclient: _finish_auth 0 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f5355e31640 5 monclient: authenticate success, global_id 74114 2024-09-13T10:32:23.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5348001e60 con 0x7f535013f750 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f5355e31640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 10 monclient: dump: 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.992 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f5355e31640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5348004c20 con 0x7f535013f750 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 1 -- 172.21.15.181:0/353023461 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5348005190 con 0x7f535013f750 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f5355e31640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f5355e31640 4 set_mon_vals no callback set 2024-09-13T10:32:23.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f534effd640 10 monclient: dump: 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:23.994 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f5355e31640 10 monclient: shutdown 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f5355e31640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.984+0000 7f5355e31640 1 -- 172.21.15.181:0/353023461 >> v1:172.21.15.181:6793/0 conn(0x7f535013f750 legacy=0x7f5350141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.985+0000 7f5355e31640 1 -- 172.21.15.181:0/353023461 shutdown_connections 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.985+0000 7f5355e31640 1 -- 172.21.15.181:0/353023461 >> 172.21.15.181:0/353023461 conn(0x7f5350077170 msgr2=0x7f53500abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.985+0000 7f5355e31640 1 -- 172.21.15.181:0/353023461 shutdown_connections 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.985+0000 7f5355e31640 1 -- 172.21.15.181:0/353023461 wait complete. 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.985+0000 7f5355e31640 10 monclient: build_initial_monmap 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.985+0000 7f5355e31640 10 monclient: monmap: 2024-09-13T10:32:23.995 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:23.996 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.986+0000 7f5355e31640 1 Processor -- start 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.986+0000 7f5355e31640 1 -- start start 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.986+0000 7f5355e31640 10 monclient: init 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.987+0000 7f5355e31640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.987+0000 7f5355e31640 10 monclient: _add_conns ranks=[3,5,7,4,8,0,2,1,6] 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.987+0000 7f5355e31640 10 monclient(hunting): picked mon.noname-g con 0x7f53500a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.987+0000 7f5355e31640 10 monclient(hunting): picked mon.noname-h con 0x7f535013f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.987+0000 7f5355e31640 10 monclient(hunting): picked mon.noname-i con 0x7f535013e560 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.987+0000 7f5355e31640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5350071a50 con 0x7f53500a8340 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.987+0000 7f5355e31640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5350071d30 con 0x7f535013f750 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.987+0000 7f5355e31640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53501392e0 con 0x7f535013e560 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.987+0000 7f5355e31640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:23.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.987+0000 7f5355e31640 10 monclient(hunting): authenticate will time out at 883.493186s 2024-09-13T10:32:23.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.987+0000 7f534f7fe640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f53500a8340 0x7f5350074480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:60646/0 (socket says 172.21.15.181:60646) 2024-09-13T10:32:23.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.987+0000 7f534f7fe640 1 -- 172.21.15.181:0/2291674507 learned_addr learned my addr 172.21.15.181:0/2291674507 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:24.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534f7fe640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.195:6790/0 conn(0x7f53500a8340 legacy=0x7f5350074480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534ffff640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.195:6792/0 conn(0x7f535013e560 legacy=0x7f53501daa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f5347fff640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.195:6791/0 conn(0x7f535013f750 legacy=0x7f53501d7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574328343 0 0) 0x7f53501392e0 con 0x7f535013e560 2024-09-13T10:32:24.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): my global_id is 55033 2024-09-13T10:32:24.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5330003550 con 0x7f535013e560 2024-09-13T10:32:24.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 755903368 0 0) 0x7f5350071a50 con 0x7f53500a8340 2024-09-13T10:32:24.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): my global_id is 4944 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53501392e0 con 0x7f53500a8340 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 20019140 0 0) 0x7f5350071d30 con 0x7f535013f750 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): my global_id is 5072 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5350071a50 con 0x7f535013f750 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1293846163 0 0) 0x7f53501392e0 con 0x7f53500a8340 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5350071d30 con 0x7f53500a8340 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5340003610 con 0x7f53500a8340 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.989+0000 7f534cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:24.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient(hunting): dump: 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.004 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2999195672 0 0) 0x7f5350071a50 con 0x7f535013f750 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53501392e0 con 0x7f535013f750 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5338003610 con 0x7f535013f750 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient(hunting): dump: 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.005 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 597883325 0 0) 0x7f5330003550 con 0x7f535013e560 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5350071a50 con 0x7f535013e560 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f53480020b0 con 0x7f535013e560 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient(hunting): dump: 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.007 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3586998454 0 0) 0x7f5350071d30 con 0x7f53500a8340 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.195:6792/0 conn(0x7f535013e560 legacy=0x7f53501daa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.195:6791/0 conn(0x7f535013f750 legacy=0x7f53501d7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient: _finish_hunting 0 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 monclient: found mon.g 2024-09-13T10:32:24.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535013d800 con 0x7f53500a8340 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient: _finish_auth 0 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient: _check_auth_tickets 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f5355e31640 5 monclient: authenticate success, global_id 4944 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f5355e31640 10 monclient: _renew_subs 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f5355e31640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f5355e31640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5350071490 con 0x7f53500a8340 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f5355e31640 10 monclient: _renew_subs 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f5355e31640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f5355e31640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f53501dc190 con 0x7f53500a8340 2024-09-13T10:32:24.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5340003b60 con 0x7f53500a8340 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f53400040d0 con 0x7f53500a8340 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534e7fc640 4 set_mon_vals no callback set 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.990+0000 7f534cff9640 10 monclient: dump: 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.010 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.991+0000 7f5355e31640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.991+0000 7f5355e31640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f53340065c0 con 0x7f5334002860 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.991+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5340011ca0 con 0x7f53500a8340 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.991+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(76..76 src has 1..76) ==== 3898+0+0 (unknown 2811027461 0 0) 0x7f534004e420 con 0x7f53500a8340 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.991+0000 7f534ffff640 10 monclient: get_auth_request con 0x7f53300406d0 auth_method 0 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f5347fff640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.181:6791/0 conn(0x7f5334002860 legacy=0x7f5334004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1016866633 0 0) 0x7f53340065c0 con 0x7f5334002860 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 10 monclient(hunting): my global_id is 5071 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5350071d30 con 0x7f5334002860 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2311959777 0 0) 0x7f5350071d30 con 0x7f5334002860 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53340065c0 con 0x7f5334002860 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5338003de0 con 0x7f5334002860 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 10 monclient: dump: 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.012 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 582921770 0 0) 0x7f53340065c0 con 0x7f5334002860 2024-09-13T10:32:24.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.993+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f533400a160 con 0x7f5334002860 2024-09-13T10:32:24.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.994+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f53380040d0 con 0x7f5334002860 2024-09-13T10:32:24.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.994+0000 7f534cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:24.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.994+0000 7f534cff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:24.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.994+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.181:6791/0 conn(0x7f5334002860 legacy=0x7f5334004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:23.994+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.181:6791/0 conn(0x7f5334002860 legacy=0x7f5334004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:24.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.000+0000 7f5355e31640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:24.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.000+0000 7f5355e31640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5334009e70 con 0x7f5334009130 2024-09-13T10:32:24.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f5347fff640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.181:6791/0 conn(0x7f5334009130 legacy=0x7f53340095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4070066637 0 0) 0x7f5334009e70 con 0x7f5334009130 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 10 monclient(hunting): my global_id is 5080 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53340065c0 con 0x7f5334009130 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1829184349 0 0) 0x7f53340065c0 con 0x7f5334009130 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5334009e70 con 0x7f5334009130 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5338005b00 con 0x7f5334009130 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 10 monclient: dump: 2024-09-13T10:32:24.016 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.017 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.018 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2486884875 0 0) 0x7f5334009e70 con 0x7f5334009130 2024-09-13T10:32:24.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.002+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f533400c3f0 con 0x7f5334009130 2024-09-13T10:32:24.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 2185779784) 0x7f5338007e40 con 0x7f5334009130 2024-09-13T10:32:24.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f534cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:24.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f534cff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:24.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.181:6791/0 conn(0x7f5334009130 legacy=0x7f53340095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f534cff9640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.181:6791/0 conn(0x7f5334009130 legacy=0x7f53340095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:24.018 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:24.018 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 158453, 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:24.019 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.020 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.021 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:24.022 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.023 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.027 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.028 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.029 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.030 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:24.031 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.032 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.033 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.034 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.037 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.038 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:24.039 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:24.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f5355e31640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.195:6800/1839191919 conn(0x7f53300406d0 legacy=0x7f5330042b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f5355e31640 10 monclient: shutdown 2024-09-13T10:32:24.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f5355e31640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:24.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f5355e31640 1 -- 172.21.15.181:0/2291674507 >> v1:172.21.15.195:6790/0 conn(0x7f53500a8340 legacy=0x7f5350074480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f534ffff640 1 -- 172.21.15.181:0/2291674507 reap_dead start 2024-09-13T10:32:24.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f534ffff640 1 -- 172.21.15.181:0/2291674507 reap_dead start 2024-09-13T10:32:24.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f5355e31640 1 -- 172.21.15.181:0/2291674507 shutdown_connections 2024-09-13T10:32:24.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f5355e31640 1 -- 172.21.15.181:0/2291674507 >> 172.21.15.181:0/2291674507 conn(0x7f53500a6640 msgr2=0x7f53500a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:24.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f5355e31640 1 -- 172.21.15.181:0/2291674507 shutdown_connections 2024-09-13T10:32:24.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.003+0000 7f5355e31640 1 -- 172.21.15.181:0/2291674507 wait complete. 2024-09-13T10:32:24.042 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:24.042 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:32:24.042 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:32:24.069 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36597]: starting. 2024-09-13T10:32:24.069 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36597]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36596 2024-09-13T10:32:24.069 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36597]: created object 0... 2024-09-13T10:32:24.069 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36597]: created object 25... 2024-09-13T10:32:24.069 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36597]: created object 49... 2024-09-13T10:32:24.069 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36597]: finishing. 2024-09-13T10:32:24.070 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36597]: shutting down. 2024-09-13T10:32:24.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.141+0000 7f136a257640 10 monclient: get_monmap_and_config 2024-09-13T10:32:24.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.141+0000 7f136a257640 10 monclient: build_initial_monmap 2024-09-13T10:32:24.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.141+0000 7f136a257640 10 monclient: monmap: 2024-09-13T10:32:24.144 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:24.144 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:24.143409+0000 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:24.143409+0000 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:24.145 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.142+0000 7f136a257640 1 Processor -- start 2024-09-13T10:32:24.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.142+0000 7f136a257640 1 -- start start 2024-09-13T10:32:24.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.142+0000 7f136a257640 10 monclient: init 2024-09-13T10:32:24.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f136a257640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:24.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f136a257640 10 monclient: _add_conns ranks=[3,1,5,8,4,7,6,0,2] 2024-09-13T10:32:24.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f136a257640 10 monclient(hunting): picked mon.noname-g con 0x7f13640a6f30 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:24.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f136a257640 10 monclient(hunting): picked mon.noname-f con 0x7f1364074360 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:24.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f136a257640 10 monclient(hunting): picked mon.noname-h con 0x7f13641342c0 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:24.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f136a257640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1364073980 con 0x7f1364074360 2024-09-13T10:32:24.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f136a257640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13640a7310 con 0x7f13640a6f30 2024-09-13T10:32:24.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f136a257640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13640736a0 con 0x7f13641342c0 2024-09-13T10:32:24.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f136a257640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:24.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f136a257640 10 monclient(hunting): authenticate will time out at 883.649294s 2024-09-13T10:32:24.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f135bfff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f1364074360 0x7f136413c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:54352/0 (socket says 172.21.15.181:54352) 2024-09-13T10:32:24.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f13637fe640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f13640a6f30 0x7f1364133bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:60654/0 (socket says 172.21.15.181:60654) 2024-09-13T10:32:24.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f135bfff640 1 -- 172.21.15.181:0/68332646 learned_addr learned my addr 172.21.15.181:0/68332646 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:24.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.143+0000 7f1363fff640 1 --1- 172.21.15.181:0/68332646 >> v1:172.21.15.195:6791/0 conn(0x7f13641342c0 0x7f136413f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:42616/0 (socket says 172.21.15.181:42616) 2024-09-13T10:32:24.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f13637fe640 1 -- 172.21.15.181:0/68332646 >> v1:172.21.15.195:6790/0 conn(0x7f13640a6f30 legacy=0x7f1364133bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f135bfff640 1 -- 172.21.15.181:0/68332646 >> v1:172.21.15.195:6789/0 conn(0x7f1364074360 legacy=0x7f136413c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1363fff640 1 -- 172.21.15.181:0/68332646 >> v1:172.21.15.195:6791/0 conn(0x7f13641342c0 legacy=0x7f136413f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708745924 0 0) 0x7f13640a7310 con 0x7f13640a6f30 2024-09-13T10:32:24.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 10 monclient(hunting): my global_id is 4953 2024-09-13T10:32:24.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1350003520 con 0x7f13640a6f30 2024-09-13T10:32:24.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334317820 0 0) 0x7f13640736a0 con 0x7f13641342c0 2024-09-13T10:32:24.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 10 monclient(hunting): my global_id is 5081 2024-09-13T10:32:24.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13640a7310 con 0x7f13641342c0 2024-09-13T10:32:24.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490875600 0 0) 0x7f134c001450 con 0x7f1364074360 2024-09-13T10:32:24.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 10 monclient(hunting): my global_id is 55081 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.145+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13640736a0 con 0x7f1364074360 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2936935975 0 0) 0x7f13640736a0 con 0x7f1364074360 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 >> v1:172.21.15.195:6791/0 conn(0x7f13641342c0 legacy=0x7f136413f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 >> v1:172.21.15.195:6790/0 conn(0x7f13640a6f30 legacy=0x7f1364133bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 1 monclient: found mon.noname-f 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1364073c60 con 0x7f1364074360 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 10 monclient: _finish_auth 0 2024-09-13T10:32:24.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f134c001c10 con 0x7f1364074360 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f136a257640 5 monclient: authenticate success, global_id 55081 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f136a257640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 10 monclient: dump: 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.155 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f136a257640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f134c0048a0 con 0x7f1364074360 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:24.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f136a257640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f136a257640 4 set_mon_vals no callback set 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 1 -- 172.21.15.181:0/68332646 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f134c004ed0 con 0x7f1364074360 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f1362ffd640 10 monclient: dump: 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.157 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f136a257640 10 monclient: shutdown 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f136a257640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f136a257640 1 -- 172.21.15.181:0/68332646 >> v1:172.21.15.195:6789/0 conn(0x7f1364074360 legacy=0x7f136413c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f136a257640 1 -- 172.21.15.181:0/68332646 shutdown_connections 2024-09-13T10:32:24.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f136a257640 1 -- 172.21.15.181:0/68332646 >> 172.21.15.181:0/68332646 conn(0x7f13640aa310 msgr2=0x7f13640a6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f136a257640 1 -- 172.21.15.181:0/68332646 shutdown_connections 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.146+0000 7f136a257640 1 -- 172.21.15.181:0/68332646 wait complete. 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.147+0000 7f136a257640 10 monclient: build_initial_monmap 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.147+0000 7f136a257640 10 monclient: monmap: 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:24.159 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.147+0000 7f136a257640 1 Processor -- start 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.147+0000 7f136a257640 1 -- start start 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.147+0000 7f136a257640 10 monclient: init 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.148+0000 7f136a257640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.148+0000 7f136a257640 10 monclient: _add_conns ranks=[7,8,1,5,2,0,6,4,3] 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.148+0000 7f136a257640 10 monclient(hunting): picked mon.noname-i con 0x7f13640a6f30 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.148+0000 7f136a257640 10 monclient(hunting): picked mon.noname-e con 0x7f13641342c0 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:24.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.148+0000 7f136a257640 10 monclient(hunting): picked mon.noname-f con 0x7f13641d1fa0 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:24.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.148+0000 7f136a257640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1364138de0 con 0x7f13641d1fa0 2024-09-13T10:32:24.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.148+0000 7f136a257640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13641390c0 con 0x7f13640a6f30 2024-09-13T10:32:24.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.148+0000 7f136a257640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13640a9130 con 0x7f13641342c0 2024-09-13T10:32:24.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.148+0000 7f136a257640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:24.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.148+0000 7f136a257640 10 monclient(hunting): authenticate will time out at 883.654315s 2024-09-13T10:32:24.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.148+0000 7f135bfff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f13641342c0 0x7f1364135a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40382/0 (socket says 172.21.15.181:40382) 2024-09-13T10:32:24.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.148+0000 7f135bfff640 1 -- 172.21.15.181:0/995653353 learned_addr learned my addr 172.21.15.181:0/995653353 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:24.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f135bfff640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.181:6793/0 conn(0x7f13641342c0 legacy=0x7f1364135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f13637fe640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.195:6792/0 conn(0x7f13640a6f30 legacy=0x7f1364135330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1363fff640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.195:6789/0 conn(0x7f13641d1fa0 legacy=0x7f13641d4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2259480524 0 0) 0x7f13640a9130 con 0x7f13641342c0 2024-09-13T10:32:24.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): my global_id is 74123 2024-09-13T10:32:24.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1344003520 con 0x7f13641342c0 2024-09-13T10:32:24.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3355119492 0 0) 0x7f13641390c0 con 0x7f13640a6f30 2024-09-13T10:32:24.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): my global_id is 55042 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13640a9130 con 0x7f13640a6f30 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093232374 0 0) 0x7f1364138de0 con 0x7f13641d1fa0 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): my global_id is 55090 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13641390c0 con 0x7f13641d1fa0 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2046117601 0 0) 0x7f1344003520 con 0x7f13641342c0 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1364138de0 con 0x7f13641342c0 2024-09-13T10:32:24.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f134c001500 con 0x7f13641342c0 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.169 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.150+0000 7f1360ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4145835975 0 0) 0x7f13640a9130 con 0x7f13640a6f30 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1344003520 con 0x7f13640a6f30 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f13540047e0 con 0x7f13640a6f30 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:24.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.171 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4217122915 0 0) 0x7f1364138de0 con 0x7f13641342c0 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.195:6792/0 conn(0x7f13640a6f30 legacy=0x7f1364135330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.195:6789/0 conn(0x7f13641d1fa0 legacy=0x7f13641d4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 1 monclient: found mon.e 2024-09-13T10:32:24.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1364136d60 con 0x7f13641342c0 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 10 monclient: _finish_auth 0 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f136a257640 5 monclient: authenticate success, global_id 74123 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f136a257640 10 monclient: _renew_subs 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f136a257640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f136a257640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1364136150 con 0x7f13641342c0 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f136a257640 10 monclient: _renew_subs 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f136a257640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f136a257640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f13641394e0 con 0x7f13641342c0 2024-09-13T10:32:24.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f134c005040 con 0x7f13641342c0 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f134c005530 con 0x7f13641342c0 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 10 monclient: dump: 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.174 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f13627fc640 4 set_mon_vals no callback set 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.151+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f134c011bb0 con 0x7f13641342c0 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.152+0000 7f136a257640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.152+0000 7f136a257640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f13640008d0 con 0x7f1364074360 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.152+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(76..76 src has 1..76) ==== 3898+0+0 (unknown 2811027461 0 0) 0x7f134c04e2a0 con 0x7f13641342c0 2024-09-13T10:32:24.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.152+0000 7f1363fff640 10 monclient: get_auth_request con 0x7f13440400e0 auth_method 0 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f13637fe640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.181:6792/0 conn(0x7f1364074360 legacy=0x7f136409ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3269395527 0 0) 0x7f13640008d0 con 0x7f1364074360 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 10 monclient(hunting): my global_id is 4956 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1364138de0 con 0x7f1364074360 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4000201238 0 0) 0x7f1364138de0 con 0x7f1364074360 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13640008d0 con 0x7f1364074360 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1354004eb0 con 0x7f1364074360 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:24.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 10 monclient: dump: 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.177 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2179867424 0 0) 0x7f13640008d0 con 0x7f1364074360 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.154+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1364133800 con 0x7f1364074360 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.155+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f13540063d0 con 0x7f1364074360 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.155+0000 7f1360ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.155+0000 7f1360ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.155+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.181:6792/0 conn(0x7f1364074360 legacy=0x7f136409ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.155+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.181:6792/0 conn(0x7f1364074360 legacy=0x7f136409ea70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.161+0000 7f136a257640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.161+0000 7f136a257640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f136402e5e0 con 0x7f136402e200 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f13637fe640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.181:6792/0 conn(0x7f136402e200 legacy=0x7f136409f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673734625 0 0) 0x7f136402e5e0 con 0x7f136402e200 2024-09-13T10:32:24.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 10 monclient(hunting): my global_id is 4965 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13640008d0 con 0x7f136402e200 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 25777178 0 0) 0x7f13640008d0 con 0x7f136402e200 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f136402e5e0 con 0x7f136402e200 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1354005460 con 0x7f136402e200 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 10 monclient: dump: 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.179 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1304572881 0 0) 0x7f136402e5e0 con 0x7f136402e200 2024-09-13T10:32:24.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.163+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f136409f890 con 0x7f136402e200 2024-09-13T10:32:24.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 1092829397) 0x7f1354005830 con 0x7f136402e200 2024-09-13T10:32:24.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f1360ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:24.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f1360ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:24.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.181:6792/0 conn(0x7f136402e200 legacy=0x7f136409f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f1360ff9640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.181:6792/0 conn(0x7f136402e200 legacy=0x7f136409f180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:24.181 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:24.181 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:24.181 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:24.181 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 158608, 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.182 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.183 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.184 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:24.185 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.186 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.187 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:24.189 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.190 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.191 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:24.193 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.194 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:24.197 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:24.198 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:24.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.200 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:24.201 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:24.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f136a257640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.195:6800/1839191919 conn(0x7f13440400e0 legacy=0x7f13440425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f136a257640 10 monclient: shutdown 2024-09-13T10:32:24.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f136a257640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:24.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f136a257640 1 -- 172.21.15.181:0/995653353 >> v1:172.21.15.181:6793/0 conn(0x7f13641342c0 legacy=0x7f1364135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f1363fff640 1 -- 172.21.15.181:0/995653353 reap_dead start 2024-09-13T10:32:24.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f1363fff640 1 -- 172.21.15.181:0/995653353 reap_dead start 2024-09-13T10:32:24.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f136a257640 1 -- 172.21.15.181:0/995653353 shutdown_connections 2024-09-13T10:32:24.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f136a257640 1 -- 172.21.15.181:0/995653353 >> 172.21.15.181:0/995653353 conn(0x7f13640aa310 msgr2=0x7f13640a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:24.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f136a257640 1 -- 172.21.15.181:0/995653353 shutdown_connections 2024-09-13T10:32:24.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.164+0000 7f136a257640 1 -- 172.21.15.181:0/995653353 wait complete. 2024-09-13T10:32:24.203 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:24.203 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:32:24.203 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:32:24.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.299+0000 7fa4e391e640 10 monclient: get_monmap_and_config 2024-09-13T10:32:24.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.299+0000 7fa4e391e640 10 monclient: build_initial_monmap 2024-09-13T10:32:24.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.299+0000 7fa4e391e640 10 monclient: monmap: 2024-09-13T10:32:24.302 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:24.302 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.302 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:24.301203+0000 2024-09-13T10:32:24.302 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:24.301203+0000 2024-09-13T10:32:24.302 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:24.303 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.303 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:24.303 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:24.303 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:24.303 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:24.303 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:24.303 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:24.303 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:24.303 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:24.303 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:24.303 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 1 Processor -- start 2024-09-13T10:32:24.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 1 -- start start 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 10 monclient: init 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 10 monclient: _add_conns ranks=[3,6,2,4,0,1,8,7,5] 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 10 monclient(hunting): picked mon.noname-g con 0x7fa4dc0a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 10 monclient(hunting): picked mon.noname-d con 0x7fa4dc0a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 10 monclient(hunting): picked mon.noname-b con 0x7fa4dc13f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc0a4bc0 con 0x7fa4dc13f750 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc13a320 con 0x7fa4dc0a6640 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc0a8100 con 0x7fa4dc0a8340 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e391e640 10 monclient(hunting): authenticate will time out at 883.806859s 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e0eb9640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fa4dc0a8340 0x7fa4dc139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46458/0 (socket says 172.21.15.181:46458) 2024-09-13T10:32:24.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.300+0000 7fa4e0eb9640 1 -- 172.21.15.181:0/1722098096 learned_addr learned my addr 172.21.15.181:0/1722098096 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:24.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4e0eb9640 1 -- 172.21.15.181:0/1722098096 >> v1:172.21.15.181:6792/0 conn(0x7fa4dc0a8340 legacy=0x7fa4dc139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4e1ebb640 1 -- 172.21.15.181:0/1722098096 >> v1:172.21.15.181:6790/0 conn(0x7fa4dc13f750 legacy=0x7fa4dc141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4e16ba640 1 -- 172.21.15.181:0/1722098096 >> v1:172.21.15.195:6790/0 conn(0x7fa4dc0a6640 legacy=0x7fa4dc139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2565005580 0 0) 0x7fa4dc0a8100 con 0x7fa4dc0a8340 2024-09-13T10:32:24.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient(hunting): my global_id is 4974 2024-09-13T10:32:24.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c8003520 con 0x7fa4dc0a8340 2024-09-13T10:32:24.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354902498 0 0) 0x7fa4dc0a4bc0 con 0x7fa4dc13f750 2024-09-13T10:32:24.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient(hunting): my global_id is 64487 2024-09-13T10:32:24.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4dc0a8100 con 0x7fa4dc13f750 2024-09-13T10:32:24.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1726559111 0 0) 0x7fa4dc13a320 con 0x7fa4dc0a6640 2024-09-13T10:32:24.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient(hunting): my global_id is 4962 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4dc0a4bc0 con 0x7fa4dc0a6640 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2096009121 0 0) 0x7fa4dc0a8100 con 0x7fa4dc13f750 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 >> v1:172.21.15.181:6792/0 conn(0x7fa4dc0a8340 legacy=0x7fa4dc139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 >> v1:172.21.15.195:6790/0 conn(0x7fa4dc0a6640 legacy=0x7fa4dc139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient: _finish_hunting 0 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 monclient: found mon.noname-b 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc0a48e0 con 0x7fa4dc13f750 2024-09-13T10:32:24.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient: _finish_auth 0 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient: _check_auth_tickets 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4e391e640 5 monclient: authenticate success, global_id 64487 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4e391e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4d4001e90 con 0x7fa4dc13f750 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient: dump: 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.315 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4e391e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4d4003990 con 0x7fa4dc13f750 2024-09-13T10:32:24.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4e391e640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 1 -- 172.21.15.181:0/1722098096 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4d4003f00 con 0x7fa4dc13f750 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4e391e640 4 set_mon_vals no callback set 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.303+0000 7fa4d3fff640 10 monclient: dump: 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.317 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.304+0000 7fa4e391e640 10 monclient: shutdown 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.304+0000 7fa4e391e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.304+0000 7fa4e391e640 1 -- 172.21.15.181:0/1722098096 >> v1:172.21.15.181:6790/0 conn(0x7fa4dc13f750 legacy=0x7fa4dc141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.304+0000 7fa4e391e640 1 -- 172.21.15.181:0/1722098096 shutdown_connections 2024-09-13T10:32:24.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.304+0000 7fa4e391e640 1 -- 172.21.15.181:0/1722098096 >> 172.21.15.181:0/1722098096 conn(0x7fa4dc077170 msgr2=0x7fa4dc0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.304+0000 7fa4e391e640 1 -- 172.21.15.181:0/1722098096 shutdown_connections 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.304+0000 7fa4e391e640 1 -- 172.21.15.181:0/1722098096 wait complete. 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.304+0000 7fa4e391e640 10 monclient: build_initial_monmap 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.304+0000 7fa4e391e640 10 monclient: monmap: 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:24.319 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:24.320 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:24.320 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:24.320 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:24.320 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:24.320 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:24.320 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 1 Processor -- start 2024-09-13T10:32:24.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 1 -- start start 2024-09-13T10:32:24.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 10 monclient: init 2024-09-13T10:32:24.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:24.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 10 monclient: _add_conns ranks=[3,1,0,6,8,2,5,7,4] 2024-09-13T10:32:24.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 10 monclient(hunting): picked mon.noname-g con 0x7fa4dc0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 10 monclient(hunting): picked mon.noname-f con 0x7fa4dc13f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 10 monclient(hunting): picked mon.noname-a con 0x7fa4dc09fa00 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc0a0c40 con 0x7fa4dc09fa00 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc0a0f20 con 0x7fa4dc13f750 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc1cf0f0 con 0x7fa4dc0a8340 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e391e640 10 monclient(hunting): authenticate will time out at 883.811638s 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e1ebb640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa4dc09fa00 0x7fa4dc1d6530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53006/0 (socket says 172.21.15.181:53006) 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.305+0000 7fa4e1ebb640 1 -- 172.21.15.181:0/2506474253 learned_addr learned my addr 172.21.15.181:0/2506474253 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.307+0000 7fa4e1ebb640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.181:6789/0 conn(0x7fa4dc09fa00 legacy=0x7fa4dc1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.307+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 891518354 0 0) 0x7fa4dc0a0c40 con 0x7fa4dc09fa00 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.307+0000 7fa4d1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.307+0000 7fa4d1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.307+0000 7fa4d1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.307+0000 7fa4d1ffb640 10 monclient(hunting): my global_id is 54900 2024-09-13T10:32:24.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c0003550 con 0x7fa4dc09fa00 2024-09-13T10:32:24.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4e16ba640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.195:6790/0 conn(0x7fa4dc0a8340 legacy=0x7fa4dc1ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4e0eb9640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.195:6789/0 conn(0x7fa4dc13f750 legacy=0x7fa4dc1ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1860007013 0 0) 0x7fa4c0003550 con 0x7fa4dc09fa00 2024-09-13T10:32:24.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4dc0a0c40 con 0x7fa4dc09fa00 2024-09-13T10:32:24.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4d4003e80 con 0x7fa4dc09fa00 2024-09-13T10:32:24.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:24.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:32:24.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient(hunting): dump: 2024-09-13T10:32:24.322 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.322 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.323 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.323 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.323 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.323 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.323 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.323 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.323 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.323 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.323 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.323 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.323 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.324 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.324 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.324 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:24.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29196948 0 0) 0x7fa4dc0a0f20 con 0x7fa4dc13f750 2024-09-13T10:32:24.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient(hunting): my global_id is 55099 2024-09-13T10:32:24.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c0003550 con 0x7fa4dc13f750 2024-09-13T10:32:24.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2170069558 0 0) 0x7fa4dc1cf0f0 con 0x7fa4dc0a8340 2024-09-13T10:32:24.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient(hunting): my global_id is 4971 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4dc0a0f20 con 0x7fa4dc0a8340 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 262218921 0 0) 0x7fa4dc0a0c40 con 0x7fa4dc09fa00 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.195:6790/0 conn(0x7fa4dc0a8340 legacy=0x7fa4dc1ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.195:6789/0 conn(0x7fa4dc13f750 legacy=0x7fa4dc1ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 monclient: found mon.a 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc0a0390 con 0x7fa4dc09fa00 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient: _finish_auth 0 2024-09-13T10:32:24.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4e391e640 5 monclient: authenticate success, global_id 54900 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4e391e640 10 monclient: _renew_subs 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4e391e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4e391e640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa4dc09eea0 con 0x7fa4dc09fa00 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4d4001e30 con 0x7fa4dc09fa00 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4d40046d0 con 0x7fa4dc09fa00 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d1ffb640 10 monclient: dump: 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.326 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.327 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4d37fe640 4 set_mon_vals no callback set 2024-09-13T10:32:24.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4e391e640 10 monclient: _renew_subs 2024-09-13T10:32:24.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4e391e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:24.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.308+0000 7fa4e391e640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4dc1d7c50 con 0x7fa4dc09fa00 2024-09-13T10:32:24.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.309+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa4d4012020 con 0x7fa4dc09fa00 2024-09-13T10:32:24.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.309+0000 7fa4e391e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:24.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.309+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(76..76 src has 1..76) ==== 3898+0+0 (unknown 2811027461 0 0) 0x7fa4d404e630 con 0x7fa4dc09fa00 2024-09-13T10:32:24.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.309+0000 7fa4e391e640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa4dc0a9c20 con 0x7fa4dc077170 2024-09-13T10:32:24.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.309+0000 7fa4e16ba640 10 monclient: get_auth_request con 0x7fa4c003fd80 auth_method 0 2024-09-13T10:32:24.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.311+0000 7fa4e0eb9640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.181:6793/0 conn(0x7fa4dc077170 legacy=0x7fa4dc13a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.311+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 941665347 0 0) 0x7fa4dc0a9c20 con 0x7fa4dc077170 2024-09-13T10:32:24.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.311+0000 7fa4d1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.311+0000 7fa4d1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.311+0000 7fa4d1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.311+0000 7fa4d1ffb640 10 monclient(hunting): my global_id is 74132 2024-09-13T10:32:24.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.311+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4dc0a0c40 con 0x7fa4dc077170 2024-09-13T10:32:24.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1998699540 0 0) 0x7fa4dc0a0c40 con 0x7fa4dc077170 2024-09-13T10:32:24.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4dc0a9c20 con 0x7fa4dc077170 2024-09-13T10:32:24.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4cc0047e0 con 0x7fa4dc077170 2024-09-13T10:32:24.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:24.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 10 monclient: dump: 2024-09-13T10:32:24.332 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.332 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.333 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.333 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.333 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.333 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.333 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.333 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.333 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.333 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.333 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.333 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.333 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4211415019 0 0) 0x7fa4dc0a9c20 con 0x7fa4dc077170 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4dc06e060 con 0x7fa4dc077170 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa4cc004970 con 0x7fa4dc077170 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.181:6793/0 conn(0x7fa4dc077170 legacy=0x7fa4dc13a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.312+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.181:6793/0 conn(0x7fa4dc077170 legacy=0x7fa4dc13a4a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.318+0000 7fa4e391e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.318+0000 7fa4e391e640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa4dc142c30 con 0x7fa4dc069b40 2024-09-13T10:32:24.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4e0eb9640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.181:6793/0 conn(0x7fa4dc069b40 legacy=0x7fa4dc13abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519921892 0 0) 0x7fa4dc142c30 con 0x7fa4dc069b40 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 10 monclient(hunting): my global_id is 74141 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4dc0a9c20 con 0x7fa4dc069b40 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 909019944 0 0) 0x7fa4dc0a9c20 con 0x7fa4dc069b40 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4dc142c30 con 0x7fa4dc069b40 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4cc0050e0 con 0x7fa4dc069b40 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 10 monclient: dump: 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.335 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.336 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3825273 0 0) 0x7fa4dc142c30 con 0x7fa4dc069b40 2024-09-13T10:32:24.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa4dc1431e0 con 0x7fa4dc069b40 2024-09-13T10:32:24.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 3215700095) 0x7fa4cc0073a0 con 0x7fa4dc069b40 2024-09-13T10:32:24.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:24.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:24.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.181:6793/0 conn(0x7fa4dc069b40 legacy=0x7fa4dc13abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.321+0000 7fa4d1ffb640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.181:6793/0 conn(0x7fa4dc069b40 legacy=0x7fa4dc13abb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:24.337 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 16367, 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:24.338 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.339 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.340 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:24.341 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.342 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:24.343 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.344 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.346 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.352 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:24.352 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.352 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.352 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.352 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:24.353 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:24.353 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.353 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.353 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.353 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.354 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.355 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.356 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.357 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.358 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.359 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.359 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:24.359 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:24.359 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.359 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.360 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.361 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:24.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.363 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.363 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.363 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:24.363 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.363 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.363 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:24.363 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:24.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.322+0000 7fa4e391e640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa4c003fd80 legacy=0x7fa4c0042240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.322+0000 7fa4e391e640 10 monclient: shutdown 2024-09-13T10:32:24.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.322+0000 7fa4e391e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:24.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.322+0000 7fa4e391e640 1 -- 172.21.15.181:0/2506474253 >> v1:172.21.15.181:6789/0 conn(0x7fa4dc09fa00 legacy=0x7fa4dc1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.322+0000 7fa4e1ebb640 1 -- 172.21.15.181:0/2506474253 reap_dead start 2024-09-13T10:32:24.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.322+0000 7fa4e1ebb640 1 -- 172.21.15.181:0/2506474253 reap_dead start 2024-09-13T10:32:24.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.322+0000 7fa4e391e640 1 -- 172.21.15.181:0/2506474253 shutdown_connections 2024-09-13T10:32:24.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.322+0000 7fa4e391e640 1 -- 172.21.15.181:0/2506474253 >> 172.21.15.181:0/2506474253 conn(0x7fa4dc0a6640 msgr2=0x7fa4dc141ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:24.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.322+0000 7fa4e391e640 1 -- 172.21.15.181:0/2506474253 shutdown_connections 2024-09-13T10:32:24.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.322+0000 7fa4e391e640 1 -- 172.21.15.181:0/2506474253 wait complete. 2024-09-13T10:32:24.366 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:24.366 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:32:24.366 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:32:24.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.461+0000 7f4d14707640 10 monclient: get_monmap_and_config 2024-09-13T10:32:24.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.461+0000 7f4d14707640 10 monclient: build_initial_monmap 2024-09-13T10:32:24.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.461+0000 7f4d14707640 10 monclient: monmap: 2024-09-13T10:32:24.464 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:24.464 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.464 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:24.463264+0000 2024-09-13T10:32:24.464 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:24.463264+0000 2024-09-13T10:32:24.464 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:24.464 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.464 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:24.465 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:24.465 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 1 Processor -- start 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 1 -- start start 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 10 monclient: init 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 10 monclient: _add_conns ranks=[0,3,8,7,4,5,6,2,1] 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 10 monclient(hunting): picked mon.noname-a con 0x7f4d0c0a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 10 monclient(hunting): picked mon.noname-g con 0x7f4d0c0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 10 monclient(hunting): picked mon.noname-e con 0x7f4d0c13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c0a4bc0 con 0x7f4d0c0a6640 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c13a320 con 0x7f4d0c0a8340 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c0a8100 con 0x7f4d0c13f750 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.462+0000 7f4d14707640 10 monclient(hunting): authenticate will time out at 883.968932s 2024-09-13T10:32:24.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.463+0000 7f4d124a3640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4d0c0a6640 0x7f4d0c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53022/0 (socket says 172.21.15.181:53022) 2024-09-13T10:32:24.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.463+0000 7f4d12ca4640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f4d0c13f750 0x7f4d0c141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40390/0 (socket says 172.21.15.181:40390) 2024-09-13T10:32:24.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.463+0000 7f4d12ca4640 1 -- 172.21.15.181:0/4271576716 learned_addr learned my addr 172.21.15.181:0/4271576716 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:24.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d124a3640 1 -- 172.21.15.181:0/4271576716 >> v1:172.21.15.181:6789/0 conn(0x7f4d0c0a6640 legacy=0x7f4d0c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d12ca4640 1 -- 172.21.15.181:0/4271576716 >> v1:172.21.15.181:6793/0 conn(0x7f4d0c13f750 legacy=0x7f4d0c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3657892105 0 0) 0x7f4d0c0a4bc0 con 0x7f4d0c0a6640 2024-09-13T10:32:24.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient(hunting): my global_id is 54909 2024-09-13T10:32:24.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d11ca2640 1 -- 172.21.15.181:0/4271576716 >> v1:172.21.15.195:6790/0 conn(0x7f4d0c0a8340 legacy=0x7f4d0c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf8003520 con 0x7f4d0c0a6640 2024-09-13T10:32:24.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822633055 0 0) 0x7f4d0c0a8100 con 0x7f4d0c13f750 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient(hunting): my global_id is 74150 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d0c0a4bc0 con 0x7f4d0c13f750 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502813513 0 0) 0x7f4d0c13a320 con 0x7f4d0c0a8340 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient(hunting): my global_id is 4980 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d0c0a8100 con 0x7f4d0c0a8340 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2815523977 0 0) 0x7f4cf8003520 con 0x7f4d0c0a6640 2024-09-13T10:32:24.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 >> v1:172.21.15.181:6793/0 conn(0x7f4d0c13f750 legacy=0x7f4d0c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 >> v1:172.21.15.195:6790/0 conn(0x7f4d0c0a8340 legacy=0x7f4d0c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient: _finish_hunting 0 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 monclient: found mon.noname-a 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c0a48e0 con 0x7f4d0c0a6640 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient: _finish_auth 0 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient: _check_auth_tickets 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4d08001ae0 con 0x7f4d0c0a6640 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d14707640 5 monclient: authenticate success, global_id 54909 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d14707640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient: dump: 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.478 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d14707640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d080047e0 con 0x7f4d0c0a6640 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 1 -- 172.21.15.181:0/4271576716 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4d08004d50 con 0x7f4d0c0a6640 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d14707640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d14707640 4 set_mon_vals no callback set 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.465+0000 7f4d114a1640 10 monclient: dump: 2024-09-13T10:32:24.479 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.480 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.466+0000 7f4d14707640 10 monclient: shutdown 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.466+0000 7f4d14707640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.466+0000 7f4d14707640 1 -- 172.21.15.181:0/4271576716 >> v1:172.21.15.181:6789/0 conn(0x7f4d0c0a6640 legacy=0x7f4d0c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.466+0000 7f4d14707640 1 -- 172.21.15.181:0/4271576716 shutdown_connections 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.466+0000 7f4d14707640 1 -- 172.21.15.181:0/4271576716 >> 172.21.15.181:0/4271576716 conn(0x7f4d0c077170 msgr2=0x7f4d0c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.466+0000 7f4d14707640 1 -- 172.21.15.181:0/4271576716 shutdown_connections 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.466+0000 7f4d14707640 1 -- 172.21.15.181:0/4271576716 wait complete. 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.466+0000 7f4d14707640 10 monclient: build_initial_monmap 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.466+0000 7f4d14707640 10 monclient: monmap: 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:24.481 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:24.482 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 1 Processor -- start 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 1 -- start start 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 10 monclient: init 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 10 monclient: _add_conns ranks=[4,8,3,7,1,2,0,5,6] 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 10 monclient(hunting): picked mon.noname-c con 0x7f4d0c0a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 10 monclient(hunting): picked mon.noname-e con 0x7f4d0c13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 10 monclient(hunting): picked mon.noname-g con 0x7f4d0c13ce40 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c135040 con 0x7f4d0c13ce40 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c0a9c40 con 0x7f4d0c0a8340 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c0a9f70 con 0x7f4d0c13f750 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:24.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d14707640 10 monclient(hunting): authenticate will time out at 883.973713s 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d11ca2640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f4d0c13f750 0x7f4d0c1d3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40394/0 (socket says 172.21.15.181:40394) 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d124a3640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f4d0c0a8340 0x7f4d0c12f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:34018/0 (socket says 172.21.15.181:34018) 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.467+0000 7f4d11ca2640 1 -- 172.21.15.181:0/1469516171 learned_addr learned my addr 172.21.15.181:0/1469516171 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.469+0000 7f4d11ca2640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.181:6793/0 conn(0x7f4d0c13f750 legacy=0x7f4d0c1d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.469+0000 7f4d124a3640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.181:6791/0 conn(0x7f4d0c0a8340 legacy=0x7f4d0c12f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580153261 0 0) 0x7f4d0c0a9f70 con 0x7f4d0c13f750 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): my global_id is 74159 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf0003550 con 0x7f4d0c13f750 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874403677 0 0) 0x7f4d0c0a9c40 con 0x7f4d0c0a8340 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): my global_id is 5089 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d0c0a9f70 con 0x7f4d0c0a8340 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d12ca4640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.195:6790/0 conn(0x7f4d0c13ce40 legacy=0x7f4d0c1d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 701246477 0 0) 0x7f4cf0003550 con 0x7f4d0c13f750 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d0c0a9c40 con 0x7f4d0c13f750 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4cfc003610 con 0x7f4d0c13f750 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): dump: 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.485 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:24.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4018380948 0 0) 0x7f4d0c0a9f70 con 0x7f4d0c0a8340 2024-09-13T10:32:24.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4cf0003550 con 0x7f4d0c0a8340 2024-09-13T10:32:24.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4d08004cd0 con 0x7f4d0c0a8340 2024-09-13T10:32:24.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:24.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:24.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient(hunting): dump: 2024-09-13T10:32:24.487 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.487 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.487 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.487 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.487 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.487 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.487 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.488 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.488 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.488 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.488 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.488 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.488 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.488 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.488 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.488 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1208364662 0 0) 0x7f4d0c0a9c40 con 0x7f4d0c13f750 2024-09-13T10:32:24.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.181:6791/0 conn(0x7f4d0c0a8340 legacy=0x7f4d0c12f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.195:6790/0 conn(0x7f4d0c13ce40 legacy=0x7f4d0c1d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:24.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 monclient: found mon.e 2024-09-13T10:32:24.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:24.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:24.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c13d6d0 con 0x7f4d0c13f750 2024-09-13T10:32:24.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient: _finish_auth 0 2024-09-13T10:32:24.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:24.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:24.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d14707640 5 monclient: authenticate success, global_id 74159 2024-09-13T10:32:24.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d14707640 10 monclient: _renew_subs 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d14707640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d14707640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0c1344e0 con 0x7f4d0c13f750 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d14707640 10 monclient: _renew_subs 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d14707640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d14707640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f4d0c13e3c0 con 0x7f4d0c13f750 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4cfc003bd0 con 0x7f4d0c13f750 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4cfc004140 con 0x7f4d0c13f750 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d10ca0640 4 set_mon_vals no callback set 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.470+0000 7f4d02ffd640 10 monclient: dump: 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.490 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.491 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.471+0000 7f4d14707640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:24.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.471+0000 7f4d14707640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4cf40065c0 con 0x7f4cf4002860 2024-09-13T10:32:24.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.471+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4cfc0042e0 con 0x7f4d0c13f750 2024-09-13T10:32:24.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.471+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(76..76 src has 1..76) ==== 3898+0+0 (unknown 2811027461 0 0) 0x7f4cfc04e460 con 0x7f4d0c13f750 2024-09-13T10:32:24.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.471+0000 7f4d12ca4640 10 monclient: get_auth_request con 0x7f4cf0040010 auth_method 0 2024-09-13T10:32:24.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.473+0000 7f4d124a3640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.195:6789/0 conn(0x7f4cf4002860 legacy=0x7f4cf4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.473+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522429100 0 0) 0x7f4cf40065c0 con 0x7f4cf4002860 2024-09-13T10:32:24.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.473+0000 7f4d02ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.473+0000 7f4d02ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.473+0000 7f4d02ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.473+0000 7f4d02ffd640 10 monclient(hunting): my global_id is 55108 2024-09-13T10:32:24.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.473+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d0c0a9c40 con 0x7f4cf4002860 2024-09-13T10:32:24.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3454968707 0 0) 0x7f4d0c0a9c40 con 0x7f4cf4002860 2024-09-13T10:32:24.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4cf40065c0 con 0x7f4cf4002860 2024-09-13T10:32:24.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4d08001d30 con 0x7f4cf4002860 2024-09-13T10:32:24.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:32:24.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 10 monclient: dump: 2024-09-13T10:32:24.496 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.496 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.496 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.496 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.496 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.496 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.496 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.496 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.496 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.496 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.496 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.497 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.497 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.497 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.497 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.497 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2016636268 0 0) 0x7f4cf40065c0 con 0x7f4cf4002860 2024-09-13T10:32:24.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4cf400a160 con 0x7f4cf4002860 2024-09-13T10:32:24.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4d08005710 con 0x7f4cf4002860 2024-09-13T10:32:24.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:24.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:24.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.195:6789/0 conn(0x7f4cf4002860 legacy=0x7f4cf4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.474+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.195:6789/0 conn(0x7f4cf4002860 legacy=0x7f4cf4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.480+0000 7f4d14707640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.480+0000 7f4d14707640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4cf4009e70 con 0x7f4cf4009130 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d124a3640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.195:6789/0 conn(0x7f4cf4009130 legacy=0x7f4cf40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530636907 0 0) 0x7f4cf4009e70 con 0x7f4cf4009130 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 10 monclient(hunting): my global_id is 55117 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf40065c0 con 0x7f4cf4009130 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2120501683 0 0) 0x7f4cf40065c0 con 0x7f4cf4009130 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4cf4009e70 con 0x7f4cf4009130 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4d08005ef0 con 0x7f4cf4009130 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 10 monclient: dump: 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.499 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.500 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.500 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.500 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 460347426 0 0) 0x7f4cf4009e70 con 0x7f4cf4009130 2024-09-13T10:32:24.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.483+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4cf400c3f0 con 0x7f4cf4009130 2024-09-13T10:32:24.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7893 (unknown 0 0 1599277656) 0x7f4d080073a0 con 0x7f4cf4009130 2024-09-13T10:32:24.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d02ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:24.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d02ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:24.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.195:6789/0 conn(0x7f4cf4009130 legacy=0x7f4cf40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d02ffd640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.195:6789/0 conn(0x7f4cf4009130 legacy=0x7f4cf40095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:24.501 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 158893, 2024-09-13T10:32:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:24.501 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:24.502 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:32:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.504 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.505 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:24.506 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:24.507 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:24.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.510 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:24.511 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.512 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.514 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:24.515 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.516 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.517 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.518 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:24.519 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.520 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:32:24.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:32:24.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.523 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:24.523 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:24.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d14707640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4cf0040010 legacy=0x7f4cf00424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d14707640 10 monclient: shutdown 2024-09-13T10:32:24.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d14707640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:24.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d14707640 1 -- 172.21.15.181:0/1469516171 >> v1:172.21.15.181:6793/0 conn(0x7f4d0c13f750 legacy=0x7f4d0c1d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d12ca4640 1 -- 172.21.15.181:0/1469516171 reap_dead start 2024-09-13T10:32:24.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d12ca4640 1 -- 172.21.15.181:0/1469516171 reap_dead start 2024-09-13T10:32:24.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d14707640 1 -- 172.21.15.181:0/1469516171 shutdown_connections 2024-09-13T10:32:24.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d14707640 1 -- 172.21.15.181:0/1469516171 >> 172.21.15.181:0/1469516171 conn(0x7f4d0c0a6640 msgr2=0x7f4d0c0a6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:24.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d14707640 1 -- 172.21.15.181:0/1469516171 shutdown_connections 2024-09-13T10:32:24.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.484+0000 7f4d14707640 1 -- 172.21.15.181:0/1469516171 wait complete. 2024-09-13T10:32:24.525 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:24.526 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:32:24.526 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:32:24.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.622+0000 7f2d0c8e4640 10 monclient: get_monmap_and_config 2024-09-13T10:32:24.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.622+0000 7f2d0c8e4640 10 monclient: build_initial_monmap 2024-09-13T10:32:24.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.622+0000 7f2d0c8e4640 10 monclient: monmap: 2024-09-13T10:32:24.625 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:24.625 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.625 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:24.624124+0000 2024-09-13T10:32:24.625 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:24.624124+0000 2024-09-13T10:32:24.625 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:24.625 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.625 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:24.625 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:24.625 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:24.626 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:24.626 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:24.626 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:24.626 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:24.626 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:24.626 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:24.626 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 1 Processor -- start 2024-09-13T10:32:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 1 -- start start 2024-09-13T10:32:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 10 monclient: init 2024-09-13T10:32:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 10 monclient: _add_conns ranks=[8,2,0,1,3,5,7,4,6] 2024-09-13T10:32:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 10 monclient(hunting): picked mon.noname-e con 0x7f2d080a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 10 monclient(hunting): picked mon.noname-b con 0x7f2d080a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 10 monclient(hunting): picked mon.noname-a con 0x7f2d0813f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d080a4bc0 con 0x7f2d0813f750 2024-09-13T10:32:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d0813a320 con 0x7f2d080a8340 2024-09-13T10:32:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d080a8100 con 0x7f2d080a6640 2024-09-13T10:32:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:24.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0c8e4640 10 monclient(hunting): authenticate will time out at 884.129803s 2024-09-13T10:32:24.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0659c640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f2d080a6640 0x7f2d08139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40404/0 (socket says 172.21.15.181:40404) 2024-09-13T10:32:24.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d0659c640 1 -- 172.21.15.181:0/3074336940 learned_addr learned my addr 172.21.15.181:0/3074336940 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:24.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d06d9d640 1 --1- 172.21.15.181:0/3074336940 >> v1:172.21.15.181:6789/0 conn(0x7f2d0813f750 0x7f2d08141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53036/0 (socket says 172.21.15.181:53036) 2024-09-13T10:32:24.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.623+0000 7f2d05d9b640 1 --1- 172.21.15.181:0/3074336940 >> v1:172.21.15.181:6790/0 conn(0x7f2d080a8340 0x7f2d08139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:39216/0 (socket says 172.21.15.181:39216) 2024-09-13T10:32:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0659c640 1 -- 172.21.15.181:0/3074336940 >> v1:172.21.15.181:6793/0 conn(0x7f2d080a6640 legacy=0x7f2d08139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d05d9b640 1 -- 172.21.15.181:0/3074336940 >> v1:172.21.15.181:6790/0 conn(0x7f2d080a8340 legacy=0x7f2d08139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d06d9d640 1 -- 172.21.15.181:0/3074336940 >> v1:172.21.15.181:6789/0 conn(0x7f2d0813f750 legacy=0x7f2d08141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062405018 0 0) 0x7f2d0813a320 con 0x7f2d080a8340 2024-09-13T10:32:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient(hunting): my global_id is 64496 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cf0003520 con 0x7f2d080a8340 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 965215467 0 0) 0x7f2d080a8100 con 0x7f2d080a6640 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient(hunting): my global_id is 74168 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d0813a320 con 0x7f2d080a6640 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555575689 0 0) 0x7f2d080a4bc0 con 0x7f2d0813f750 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient(hunting): my global_id is 54918 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d080a8100 con 0x7f2d0813f750 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0659c640 1 --1- 172.21.15.181:0/3074336940 >> v1:172.21.15.181:6793/0 conn(0x7f2d080a6640 0x7f2d08139500 :-1 s=OPENED pgs=191 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f2d00001a40 mon_map magic: 0 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2289965880 0 0) 0x7f2cf0003520 con 0x7f2d080a8340 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 >> v1:172.21.15.181:6793/0 conn(0x7f2d080a6640 legacy=0x7f2d08139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 >> v1:172.21.15.181:6789/0 conn(0x7f2d0813f750 legacy=0x7f2d08141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient: _finish_hunting 0 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 monclient: found mon.noname-b 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d080a48e0 con 0x7f2d080a8340 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient: _finish_auth 0 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient: _check_auth_tickets 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:24.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0c8e4640 5 monclient: authenticate success, global_id 64496 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0c8e4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2cfc001a10 con 0x7f2d080a8340 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient: dump: 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.636 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0c8e4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d00001a40 con 0x7f2d080a6640 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cfc001ce0 con 0x7f2d080a8340 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 1 -- 172.21.15.181:0/3074336940 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2cfc004b20 con 0x7f2d080a8340 2024-09-13T10:32:24.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0c8e4640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0c8e4640 4 set_mon_vals no callback set 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.626+0000 7f2d0559a640 10 monclient: dump: 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.638 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.627+0000 7f2d0c8e4640 10 monclient: shutdown 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.627+0000 7f2d0c8e4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.627+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/3074336940 >> v1:172.21.15.181:6790/0 conn(0x7f2d080a8340 legacy=0x7f2d08139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.627+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/3074336940 shutdown_connections 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.627+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/3074336940 >> 172.21.15.181:0/3074336940 conn(0x7f2d08077170 msgr2=0x7f2d080abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.627+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/3074336940 shutdown_connections 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.627+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/3074336940 wait complete. 2024-09-13T10:32:24.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 10 monclient: build_initial_monmap 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 10 monclient: monmap: 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:24.640 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 1 Processor -- start 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 1 -- start start 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 10 monclient: init 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 10 monclient: _add_conns ranks=[7,3,8,6,2,4,1,0,5] 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 10 monclient(hunting): picked mon.noname-i con 0x7f2d080a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 10 monclient(hunting): picked mon.noname-g con 0x7f2d0813f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 10 monclient(hunting): picked mon.noname-e con 0x7f2d081d4310 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d080a1160 con 0x7f2d0813f750 2024-09-13T10:32:24.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d0809e160 con 0x7f2d080a8340 2024-09-13T10:32:24.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d080a9cd0 con 0x7f2d081d4310 2024-09-13T10:32:24.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:24.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d0c8e4640 10 monclient(hunting): authenticate will time out at 884.134861s 2024-09-13T10:32:24.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d06d9d640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f2d081d4310 0x7f2d081d6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40414/0 (socket says 172.21.15.181:40414) 2024-09-13T10:32:24.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.628+0000 7f2d06d9d640 1 -- 172.21.15.181:0/2185126179 learned_addr learned my addr 172.21.15.181:0/2185126179 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:24.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.631+0000 7f2d06d9d640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.181:6793/0 conn(0x7f2d081d4310 legacy=0x7f2d081d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.631+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:32:24.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.631+0000 7f2d0659c640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.195:6792/0 conn(0x7f2d080a8340 legacy=0x7f2d0809d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.631+0000 7f2d05d9b640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.195:6790/0 conn(0x7f2d0813f750 legacy=0x7f2d0809da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003730958 0 0) 0x7f2d080a9cd0 con 0x7f2d081d4310 2024-09-13T10:32:24.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): my global_id is 74177 2024-09-13T10:32:24.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ce8003520 con 0x7f2d081d4310 2024-09-13T10:32:24.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463745322 0 0) 0x7f2d0809e160 con 0x7f2d080a8340 2024-09-13T10:32:24.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): my global_id is 55051 2024-09-13T10:32:24.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d080a9cd0 con 0x7f2d080a8340 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577858877 0 0) 0x7f2d080a1160 con 0x7f2d0813f750 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): my global_id is 4989 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d0809e160 con 0x7f2d0813f750 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1254872986 0 0) 0x7f2ce8003520 con 0x7f2d081d4310 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d080a1160 con 0x7f2d081d4310 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2cf8002030 con 0x7f2d081d4310 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): dump: 2024-09-13T10:32:24.648 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.649 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 121174790 0 0) 0x7f2d080a9cd0 con 0x7f2d080a8340 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ce8003520 con 0x7f2d080a8340 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d00001920 con 0x7f2d080a8340 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient(hunting): dump: 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.650 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1918153767 0 0) 0x7f2d0809e160 con 0x7f2d0813f750 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d080a9cd0 con 0x7f2d0813f750 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2228798217 0 0) 0x7f2d080a1160 con 0x7f2d081d4310 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.195:6792/0 conn(0x7f2d080a8340 legacy=0x7f2d0809d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.195:6790/0 conn(0x7f2d0813f750 legacy=0x7f2d0809da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 monclient: found mon.e 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d08142dd0 con 0x7f2d081d4310 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2d0c8e4640 5 monclient: authenticate success, global_id 74177 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2d0c8e4640 10 monclient: _renew_subs 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2d0c8e4640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2d080a02f0 con 0x7f2d081d4310 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2d0c8e4640 10 monclient: _renew_subs 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2d0c8e4640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:24.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f2d080a0e80 con 0x7f2d081d4310 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cf8001dc0 con 0x7f2d081d4310 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2cf8005490 con 0x7f2d081d4310 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2d04d99640 4 set_mon_vals no callback set 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.633+0000 7f2cf6ffd640 10 monclient: dump: 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.653 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.634+0000 7f2d0c8e4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.634+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2cec0065c0 con 0x7f2cec002860 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.634+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2cf8011b10 con 0x7f2d081d4310 2024-09-13T10:32:24.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.634+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(76..76 src has 1..76) ==== 3898+0+0 (unknown 2811027461 0 0) 0x7f2cf804e640 con 0x7f2d081d4310 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.635+0000 7f2d05d9b640 10 monclient: get_auth_request con 0x7f2ce8040380 auth_method 0 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.636+0000 7f2d0659c640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.195:6790/0 conn(0x7f2cec002860 legacy=0x7f2cec004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.636+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 16334308 0 0) 0x7f2cec0065c0 con 0x7f2cec002860 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.636+0000 7f2cf6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.636+0000 7f2cf6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.636+0000 7f2cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.636+0000 7f2cf6ffd640 10 monclient(hunting): my global_id is 4998 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d080a1160 con 0x7f2cec002860 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3126532774 0 0) 0x7f2d080a1160 con 0x7f2cec002860 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cec0065c0 con 0x7f2cec002860 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d00005050 con 0x7f2cec002860 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:24.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 10 monclient: dump: 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.656 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.657 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2722376412 0 0) 0x7f2cec0065c0 con 0x7f2cec002860 2024-09-13T10:32:24.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cec00a160 con 0x7f2cec002860 2024-09-13T10:32:24.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2d00005120 con 0x7f2cec002860 2024-09-13T10:32:24.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:24.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:24.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.195:6790/0 conn(0x7f2cec002860 legacy=0x7f2cec004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.637+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.195:6790/0 conn(0x7f2cec002860 legacy=0x7f2cec004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:24.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.643+0000 7f2d0c8e4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:24.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.643+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2cec009e70 con 0x7f2cec009130 2024-09-13T10:32:24.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.646+0000 7f2d0659c640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.195:6790/0 conn(0x7f2cec009130 legacy=0x7f2cec0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.646+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603752021 0 0) 0x7f2cec009e70 con 0x7f2cec009130 2024-09-13T10:32:24.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.646+0000 7f2cf6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.646+0000 7f2cf6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.646+0000 7f2cf6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.646+0000 7f2cf6ffd640 10 monclient(hunting): my global_id is 5007 2024-09-13T10:32:24.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.646+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cec0065c0 con 0x7f2cec009130 2024-09-13T10:32:24.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4035938496 0 0) 0x7f2cec0065c0 con 0x7f2cec009130 2024-09-13T10:32:24.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cec009e70 con 0x7f2cec009130 2024-09-13T10:32:24.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d00005910 con 0x7f2cec009130 2024-09-13T10:32:24.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 10 monclient: dump: 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.660 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.661 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.661 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.661 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2578522040 0 0) 0x7f2cec009e70 con 0x7f2cec009130 2024-09-13T10:32:24.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2cec00c410 con 0x7f2cec009130 2024-09-13T10:32:24.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7561 (unknown 0 0 2944546026) 0x7f2d00007d80 con 0x7f2cec009130 2024-09-13T10:32:24.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:24.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:24.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.195:6790/0 conn(0x7f2cec009130 legacy=0x7f2cec0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.647+0000 7f2cf6ffd640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.195:6790/0 conn(0x7f2cec009130 legacy=0x7f2cec0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:24.661 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 159062, 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:24.662 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.663 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.664 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.664 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.664 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.664 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.664 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.664 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:24.664 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:24.664 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.664 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.664 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.664 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:24.665 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:24.666 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:24.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.668 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.669 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:24.670 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.671 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.673 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:24.674 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.675 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.676 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:24.676 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:24.676 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.676 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.676 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.676 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:24.676 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.676 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.677 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.678 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.679 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.680 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.681 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.681 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:24.681 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.681 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.681 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:24.681 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:24.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.648+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.195:6800/1839191919 conn(0x7f2ce8040380 legacy=0x7f2ce8042840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.648+0000 7f2d0c8e4640 10 monclient: shutdown 2024-09-13T10:32:24.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.648+0000 7f2d0c8e4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:24.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.648+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/2185126179 >> v1:172.21.15.181:6793/0 conn(0x7f2d081d4310 legacy=0x7f2d081d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.648+0000 7f2d06d9d640 1 -- 172.21.15.181:0/2185126179 reap_dead start 2024-09-13T10:32:24.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.648+0000 7f2d06d9d640 1 -- 172.21.15.181:0/2185126179 reap_dead start 2024-09-13T10:32:24.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.648+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/2185126179 shutdown_connections 2024-09-13T10:32:24.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.648+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/2185126179 >> 172.21.15.181:0/2185126179 conn(0x7f2d080a6640 msgr2=0x7f2d08141d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:24.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.648+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/2185126179 shutdown_connections 2024-09-13T10:32:24.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.648+0000 7f2d0c8e4640 1 -- 172.21.15.181:0/2185126179 wait complete. 2024-09-13T10:32:24.683 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:24.683 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:32:24.684 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:32:24.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.779+0000 7f7576209640 10 monclient: get_monmap_and_config 2024-09-13T10:32:24.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.779+0000 7f7576209640 10 monclient: build_initial_monmap 2024-09-13T10:32:24.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.780+0000 7f7576209640 10 monclient: monmap: 2024-09-13T10:32:24.782 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:24.781610+0000 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:24.781610+0000 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:24.783 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:24.784 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.780+0000 7f7576209640 1 Processor -- start 2024-09-13T10:32:24.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.780+0000 7f7576209640 1 -- start start 2024-09-13T10:32:24.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.780+0000 7f7576209640 10 monclient: init 2024-09-13T10:32:24.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f7576209640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:24.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f7576209640 10 monclient: _add_conns ranks=[7,6,8,4,2,5,0,1,3] 2024-09-13T10:32:24.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f7576209640 10 monclient(hunting): picked mon.noname-i con 0x7f75700a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:24.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f7576209640 10 monclient(hunting): picked mon.noname-d con 0x7f75700a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:24.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f7576209640 10 monclient(hunting): picked mon.noname-e con 0x7f757013f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:24.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f7576209640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75700a4bc0 con 0x7f75700a8340 2024-09-13T10:32:24.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f7576209640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757013a320 con 0x7f75700a6640 2024-09-13T10:32:24.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f7576209640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75700a8100 con 0x7f757013f750 2024-09-13T10:32:24.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f7576209640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:24.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f7576209640 10 monclient(hunting): authenticate will time out at 884.287460s 2024-09-13T10:32:24.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f7567fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f75700a8340 0x7f7570139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46468/0 (socket says 172.21.15.181:46468) 2024-09-13T10:32:24.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f756ffff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f757013f750 0x7f7570141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40418/0 (socket says 172.21.15.181:40418) 2024-09-13T10:32:24.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.781+0000 7f7567fff640 1 -- 172.21.15.181:0/1633113169 learned_addr learned my addr 172.21.15.181:0/1633113169 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:24.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.783+0000 7f7567fff640 1 -- 172.21.15.181:0/1633113169 >> v1:172.21.15.181:6792/0 conn(0x7f75700a8340 legacy=0x7f7570139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.783+0000 7f756ffff640 1 -- 172.21.15.181:0/1633113169 >> v1:172.21.15.181:6793/0 conn(0x7f757013f750 legacy=0x7f7570141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.784+0000 7f756f7fe640 1 -- 172.21.15.181:0/1633113169 >> v1:172.21.15.195:6792/0 conn(0x7f75700a6640 legacy=0x7f7570139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 1 -- 172.21.15.181:0/1633113169 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880294677 0 0) 0x7f75700a8100 con 0x7f757013f750 2024-09-13T10:32:24.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient(hunting): my global_id is 74186 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 1 -- 172.21.15.181:0/1633113169 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f755c003520 con 0x7f757013f750 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 1 -- 172.21.15.181:0/1633113169 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2329002967 0 0) 0x7f75700a4bc0 con 0x7f75700a8340 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient(hunting): my global_id is 4983 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 1 -- 172.21.15.181:0/1633113169 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75700a8100 con 0x7f75700a8340 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 1 -- 172.21.15.181:0/1633113169 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3570751108 0 0) 0x7f755c003520 con 0x7f757013f750 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 1 -- 172.21.15.181:0/1633113169 >> v1:172.21.15.195:6792/0 conn(0x7f75700a6640 legacy=0x7f7570139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 1 -- 172.21.15.181:0/1633113169 >> v1:172.21.15.181:6792/0 conn(0x7f75700a8340 legacy=0x7f7570139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 1 monclient: found mon.noname-e 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 1 -- 172.21.15.181:0/1633113169 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75700a48e0 con 0x7f757013f750 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient: _finish_auth 0 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 1 -- 172.21.15.181:0/1633113169 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7568001e60 con 0x7f757013f750 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f756effd640 10 monclient: dump: 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.878 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.879 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f7576209640 5 monclient: authenticate success, global_id 74186 2024-09-13T10:32:24.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.873+0000 7f7576209640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:24.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.876+0000 7f756effd640 1 -- 172.21.15.181:0/1633113169 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7568004b60 con 0x7f757013f750 2024-09-13T10:32:24.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.876+0000 7f756effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:24.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.876+0000 7f756effd640 1 -- 172.21.15.181:0/1633113169 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f75680050d0 con 0x7f757013f750 2024-09-13T10:32:24.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.876+0000 7f7576209640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:24.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.876+0000 7f7576209640 4 set_mon_vals no callback set 2024-09-13T10:32:24.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.876+0000 7f756effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.876+0000 7f756effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.876+0000 7f756effd640 10 monclient: dump: 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.883 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.876+0000 7f7576209640 10 monclient: shutdown 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.876+0000 7f7576209640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.876+0000 7f7576209640 1 -- 172.21.15.181:0/1633113169 >> v1:172.21.15.181:6793/0 conn(0x7f757013f750 legacy=0x7f7570141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.877+0000 7f7576209640 1 -- 172.21.15.181:0/1633113169 shutdown_connections 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.877+0000 7f7576209640 1 -- 172.21.15.181:0/1633113169 >> 172.21.15.181:0/1633113169 conn(0x7f7570077170 msgr2=0x7f75700abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.877+0000 7f7576209640 1 -- 172.21.15.181:0/1633113169 shutdown_connections 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.877+0000 7f7576209640 1 -- 172.21.15.181:0/1633113169 wait complete. 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.877+0000 7f7576209640 10 monclient: build_initial_monmap 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.877+0000 7f7576209640 10 monclient: monmap: 2024-09-13T10:32:24.884 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:24.885 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 1 Processor -- start 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 1 -- start start 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 10 monclient: init 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 10 monclient: _add_conns ranks=[2,1,5,4,8,3,0,7,6] 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 10 monclient(hunting): picked mon.noname-b con 0x7f75700a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 10 monclient(hunting): picked mon.noname-f con 0x7f757013f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 10 monclient(hunting): picked mon.noname-h con 0x7f75701d4310 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75700a1100 con 0x7f757013f750 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75700a9db0 con 0x7f75700a8340 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7570142e60 con 0x7f75701d4310 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f7576209640 10 monclient(hunting): authenticate will time out at 884.384859s 2024-09-13T10:32:24.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f756f7fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f75700a8340 0x7f757009d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:39224/0 (socket says 172.21.15.181:39224) 2024-09-13T10:32:24.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.878+0000 7f756f7fe640 1 -- 172.21.15.181:0/3671262498 learned_addr learned my addr 172.21.15.181:0/3671262498 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:24.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.881+0000 7f756f7fe640 1 -- 172.21.15.181:0/3671262498 >> v1:172.21.15.181:6790/0 conn(0x7f75700a8340 legacy=0x7f757009d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f7567fff640 1 -- 172.21.15.181:0/3671262498 >> v1:172.21.15.195:6789/0 conn(0x7f757013f750 legacy=0x7f757009da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3310551065 0 0) 0x7f75700a9db0 con 0x7f75700a8340 2024-09-13T10:32:24.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 10 monclient(hunting): my global_id is 64505 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7550003520 con 0x7f75700a8340 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4154609123 0 0) 0x7f7550003520 con 0x7f75700a8340 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75700a9db0 con 0x7f75700a8340 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7560003610 con 0x7f75700a8340 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 10 monclient(hunting): dump: 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.890 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.882+0000 7f756cff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2889730670 0 0) 0x7f75700a9db0 con 0x7f75700a8340 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 >> v1:172.21.15.195:6791/0 conn(0x7f75701d4310 legacy=0x7f75701d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 >> v1:172.21.15.195:6789/0 conn(0x7f757013f750 legacy=0x7f757009da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 10 monclient: _finish_hunting 0 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 1 monclient: found mon.b 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75700a0290 con 0x7f75700a8340 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 10 monclient: _finish_auth 0 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 10 monclient: _check_auth_tickets 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7560003bf0 con 0x7f75700a8340 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f75600040e0 con 0x7f75700a8340 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756cff9640 10 monclient: dump: 2024-09-13T10:32:24.892 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.893 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f756e7fc640 4 set_mon_vals no callback set 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f7576209640 5 monclient: authenticate success, global_id 64505 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f7576209640 10 monclient: _renew_subs 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f7576209640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f7576209640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f757009eda0 con 0x7f75700a8340 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f7576209640 10 monclient: _renew_subs 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f7576209640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.884+0000 7f7576209640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f75700a0e20 con 0x7f75700a8340 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.885+0000 7f7576209640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.885+0000 7f7576209640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7570143260 con 0x7f7570077170 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.886+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7560011ca0 con 0x7f75700a8340 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.886+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(77..77 src has 1..77) ==== 3506+0+0 (unknown 1006809061 0 0) 0x7f756004e310 con 0x7f75700a8340 2024-09-13T10:32:24.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.886+0000 7f756ffff640 10 monclient: get_auth_request con 0x7f755003fa70 auth_method 0 2024-09-13T10:32:24.896 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36598]: starting. 2024-09-13T10:32:24.896 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36598]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36596 2024-09-13T10:32:24.896 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36598]: shutting down. 2024-09-13T10:32:24.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f7567fff640 1 -- 172.21.15.181:0/3671262498 >> v1:172.21.15.195:6791/0 conn(0x7f7570077170 legacy=0x7f757013a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2865949893 0 0) 0x7f7570143260 con 0x7f7570077170 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f756cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f756cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f756cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f756cff9640 10 monclient(hunting): my global_id is 5090 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75700a9db0 con 0x7f7570077170 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4032536421 0 0) 0x7f75700a9db0 con 0x7f7570077170 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7570143260 con 0x7f7570077170 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f75580047e0 con 0x7f7570077170 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f756cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f756cff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.888+0000 7f756cff9640 10 monclient: dump: 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.898 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.889+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1616861399 0 0) 0x7f7570143260 con 0x7f7570077170 2024-09-13T10:32:24.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.889+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75700a09f0 con 0x7f7570077170 2024-09-13T10:32:24.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.889+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7558004870 con 0x7f7570077170 2024-09-13T10:32:24.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.889+0000 7f756cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:24.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.889+0000 7f756cff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:24.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.889+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 >> v1:172.21.15.195:6791/0 conn(0x7f7570077170 legacy=0x7f757013a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.889+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 >> v1:172.21.15.195:6791/0 conn(0x7f7570077170 legacy=0x7f757013a4f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:24.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.896+0000 7f7576209640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:24.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.896+0000 7f7576209640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f757009fb70 con 0x7f7570069b40 2024-09-13T10:32:24.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.898+0000 7f7567fff640 1 -- 172.21.15.181:0/3671262498 >> v1:172.21.15.195:6791/0 conn(0x7f7570069b40 legacy=0x7f757013ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:24.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.898+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943970804 0 0) 0x7f757009fb70 con 0x7f7570069b40 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.898+0000 7f756cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.898+0000 7f756cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.898+0000 7f756cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.898+0000 7f756cff9640 10 monclient(hunting): my global_id is 5099 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.898+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7570143260 con 0x7f7570069b40 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 63885320 0 0) 0x7f7570143260 con 0x7f7570069b40 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f757009fb70 con 0x7f7570069b40 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f75580050d0 con 0x7f7570069b40 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 10 monclient: dump: 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:24.902 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 17492570 0 0) 0x7f757009fb70 con 0x7f7570069b40 2024-09-13T10:32:24.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f75700a2960 con 0x7f7570069b40 2024-09-13T10:32:24.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 1991546139) 0x7f7558007410 con 0x7f7570069b40 2024-09-13T10:32:24.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:24.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:24.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 >> v1:172.21.15.195:6791/0 conn(0x7f7570069b40 legacy=0x7f757013ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.899+0000 7f756cff9640 1 -- 172.21.15.181:0/3671262498 >> v1:172.21.15.195:6791/0 conn(0x7f7570069b40 legacy=0x7f757013ac00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:24.905 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:24.905 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:24.905 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:24.905 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:24.905 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:24.905 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 159327, 2024-09-13T10:32:24.905 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:24.905 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:24.905 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:24.905 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:24.905 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:24.905 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.906 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.907 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:24.908 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:24.910 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:24.910 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:24.910 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:24.910 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:24.910 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:24.910 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:24.910 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:24.911 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:24.911 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:24.912 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:24.913 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:24.915 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.916 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.919 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.920 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.921 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:24.922 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:24.923 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:24.924 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:24.925 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:24.925 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:24.925 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:24.925 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:24.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:24.925 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:24.925 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:24.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.900+0000 7f7576209640 1 -- 172.21.15.181:0/3671262498 >> v1:172.21.15.195:6800/1839191919 conn(0x7f755003fa70 legacy=0x7f7550041f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.900+0000 7f7576209640 10 monclient: shutdown 2024-09-13T10:32:24.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.900+0000 7f7576209640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:24.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.900+0000 7f7576209640 1 -- 172.21.15.181:0/3671262498 >> v1:172.21.15.181:6790/0 conn(0x7f75700a8340 legacy=0x7f757009d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:24.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.900+0000 7f756ffff640 1 -- 172.21.15.181:0/3671262498 reap_dead start 2024-09-13T10:32:24.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.900+0000 7f756ffff640 1 -- 172.21.15.181:0/3671262498 reap_dead start 2024-09-13T10:32:24.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.900+0000 7f7576209640 1 -- 172.21.15.181:0/3671262498 shutdown_connections 2024-09-13T10:32:24.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.900+0000 7f7576209640 1 -- 172.21.15.181:0/3671262498 >> 172.21.15.181:0/3671262498 conn(0x7f75700a6640 msgr2=0x7f757013efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:24.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.900+0000 7f7576209640 1 -- 172.21.15.181:0/3671262498 shutdown_connections 2024-09-13T10:32:24.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:24.900+0000 7f7576209640 1 -- 172.21.15.181:0/3671262498 wait complete. 2024-09-13T10:32:24.927 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:24.927 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:32:24.928 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:32:25.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.024+0000 7f69ce8f7640 10 monclient: get_monmap_and_config 2024-09-13T10:32:25.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.024+0000 7f69ce8f7640 10 monclient: build_initial_monmap 2024-09-13T10:32:25.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.024+0000 7f69ce8f7640 10 monclient: monmap: 2024-09-13T10:32:25.027 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:25.027 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.027 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:25.026117+0000 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:25.026117+0000 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:25.028 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 1 Processor -- start 2024-09-13T10:32:25.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 1 -- start start 2024-09-13T10:32:25.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 10 monclient: init 2024-09-13T10:32:25.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:25.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 10 monclient: _add_conns ranks=[5,2,1,3,0,7,6,8,4] 2024-09-13T10:32:25.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 10 monclient(hunting): picked mon.noname-h con 0x7f69c80a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:25.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 10 monclient(hunting): picked mon.noname-b con 0x7f69c80a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:25.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 10 monclient(hunting): picked mon.noname-f con 0x7f69c813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:25.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c80a4bc0 con 0x7f69c813f750 2024-09-13T10:32:25.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c813a320 con 0x7f69c80a8340 2024-09-13T10:32:25.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c80a8100 con 0x7f69c80a6640 2024-09-13T10:32:25.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:25.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69ce8f7640 10 monclient(hunting): authenticate will time out at 884.531777s 2024-09-13T10:32:25.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69c77fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f69c80a8340 0x7f69c8139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:39226/0 (socket says 172.21.15.181:39226) 2024-09-13T10:32:25.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.025+0000 7f69c77fe640 1 -- 172.21.15.181:0/1658704883 learned_addr learned my addr 172.21.15.181:0/1658704883 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:25.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c77fe640 1 -- 172.21.15.181:0/1658704883 >> v1:172.21.15.181:6790/0 conn(0x7f69c80a8340 legacy=0x7f69c8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69cce94640 1 -- 172.21.15.181:0/1658704883 >> v1:172.21.15.195:6789/0 conn(0x7f69c813f750 legacy=0x7f69c8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 1 -- 172.21.15.181:0/1658704883 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125244354 0 0) 0x7f69c813a320 con 0x7f69c80a8340 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient(hunting): my global_id is 64532 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 1 -- 172.21.15.181:0/1658704883 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69b0003520 con 0x7f69c80a8340 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c7fff640 1 -- 172.21.15.181:0/1658704883 >> v1:172.21.15.195:6791/0 conn(0x7f69c80a6640 legacy=0x7f69c8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 1 -- 172.21.15.181:0/1658704883 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258910437 0 0) 0x7f69c80a4bc0 con 0x7f69c813f750 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient(hunting): my global_id is 55153 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 1 -- 172.21.15.181:0/1658704883 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69c813a320 con 0x7f69c813f750 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 1 -- 172.21.15.181:0/1658704883 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1429698065 0 0) 0x7f69b0003520 con 0x7f69c80a8340 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 1 -- 172.21.15.181:0/1658704883 >> v1:172.21.15.195:6791/0 conn(0x7f69c80a6640 legacy=0x7f69c8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 1 -- 172.21.15.181:0/1658704883 >> v1:172.21.15.195:6789/0 conn(0x7f69c813f750 legacy=0x7f69c8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 1 monclient: found mon.noname-b 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 1 -- 172.21.15.181:0/1658704883 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c80a48e0 con 0x7f69c80a8340 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 1 -- 172.21.15.181:0/1658704883 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f69bc001ae0 con 0x7f69c80a8340 2024-09-13T10:32:25.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient: dump: 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.037 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69ce8f7640 5 monclient: authenticate success, global_id 64532 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69ce8f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 1 -- 172.21.15.181:0/1658704883 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69bc0048a0 con 0x7f69c80a8340 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69ce8f7640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 1 -- 172.21.15.181:0/1658704883 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f69bc004e10 con 0x7f69c80a8340 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69ce8f7640 4 set_mon_vals no callback set 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:25.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.028+0000 7f69c6ffd640 10 monclient: dump: 2024-09-13T10:32:25.039 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.039 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.039 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.039 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.039 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.039 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.039 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.039 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.039 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.029+0000 7f69ce8f7640 10 monclient: shutdown 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.029+0000 7f69ce8f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.029+0000 7f69ce8f7640 1 -- 172.21.15.181:0/1658704883 >> v1:172.21.15.181:6790/0 conn(0x7f69c80a8340 legacy=0x7f69c8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.029+0000 7f69ce8f7640 1 -- 172.21.15.181:0/1658704883 shutdown_connections 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.029+0000 7f69ce8f7640 1 -- 172.21.15.181:0/1658704883 >> 172.21.15.181:0/1658704883 conn(0x7f69c8077170 msgr2=0x7f69c80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.029+0000 7f69ce8f7640 1 -- 172.21.15.181:0/1658704883 shutdown_connections 2024-09-13T10:32:25.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.029+0000 7f69ce8f7640 1 -- 172.21.15.181:0/1658704883 wait complete. 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.029+0000 7f69ce8f7640 10 monclient: build_initial_monmap 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.029+0000 7f69ce8f7640 10 monclient: monmap: 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:25.041 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 1 Processor -- start 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 1 -- start start 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 10 monclient: init 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 10 monclient: _add_conns ranks=[2,8,1,6,0,4,7,5,3] 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 10 monclient(hunting): picked mon.noname-b con 0x7f69c80a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 10 monclient(hunting): picked mon.noname-e con 0x7f69c813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 10 monclient(hunting): picked mon.noname-f con 0x7f69c81d4310 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c80a1110 con 0x7f69c81d4310 2024-09-13T10:32:25.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c809e110 con 0x7f69c80a8340 2024-09-13T10:32:25.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c80a9d60 con 0x7f69c813f750 2024-09-13T10:32:25.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:25.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69c7fff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f69c80a8340 0x7f69c809d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:39236/0 (socket says 172.21.15.181:39236) 2024-09-13T10:32:25.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69ce8f7640 10 monclient(hunting): authenticate will time out at 884.536752s 2024-09-13T10:32:25.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.030+0000 7f69c7fff640 1 -- 172.21.15.181:0/3734998157 learned_addr learned my addr 172.21.15.181:0/3734998157 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:25.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.032+0000 7f69c77fe640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.181:6793/0 conn(0x7f69c813f750 legacy=0x7f69c809da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.032+0000 7f69c7fff640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.181:6790/0 conn(0x7f69c80a8340 legacy=0x7f69c809d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69cce94640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.195:6789/0 conn(0x7f69c81d4310 legacy=0x7f69c81d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1484336160 0 0) 0x7f69c809e110 con 0x7f69c80a8340 2024-09-13T10:32:25.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): my global_id is 64541 2024-09-13T10:32:25.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69b4003550 con 0x7f69c80a8340 2024-09-13T10:32:25.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3791890597 0 0) 0x7f69c80a9d60 con 0x7f69c813f750 2024-09-13T10:32:25.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): my global_id is 74222 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69c809e110 con 0x7f69c813f750 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429539715 0 0) 0x7f69c80a1110 con 0x7f69c81d4310 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): my global_id is 55162 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69c80a9d60 con 0x7f69c81d4310 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 990282629 0 0) 0x7f69b4003550 con 0x7f69c80a8340 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69c80a1110 con 0x7f69c80a8340 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f69b8003610 con 0x7f69c80a8340 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:25.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.050 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2128593246 0 0) 0x7f69c809e110 con 0x7f69c813f750 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69b4003550 con 0x7f69c813f750 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f69bc004d90 con 0x7f69c813f750 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.051 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1017644948 0 0) 0x7f69c80a9d60 con 0x7f69c81d4310 2024-09-13T10:32:25.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69c809e110 con 0x7f69c81d4310 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f69c00020b0 con 0x7f69c81d4310 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.053 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3847665247 0 0) 0x7f69c80a1110 con 0x7f69c80a8340 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.181:6793/0 conn(0x7f69c813f750 legacy=0x7f69c809da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.195:6789/0 conn(0x7f69c81d4310 legacy=0x7f69c81d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 monclient: found mon.b 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:25.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c8142e40 con 0x7f69c80a8340 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient: _finish_auth 0 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69ce8f7640 5 monclient: authenticate success, global_id 64541 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69ce8f7640 10 monclient: _renew_subs 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69ce8f7640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69ce8f7640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f69c80a02a0 con 0x7f69c80a8340 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69ce8f7640 10 monclient: _renew_subs 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69ce8f7640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69ce8f7640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f69c80a0e30 con 0x7f69c80a8340 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69b8003b90 con 0x7f69c80a8340 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f69b80040c0 con 0x7f69c80a8340 2024-09-13T10:32:25.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c67fc640 4 set_mon_vals no callback set 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.033+0000 7f69c4ff9640 10 monclient: dump: 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.056 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.034+0000 7f69ce8f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.034+0000 7f69ce8f7640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f69a80065c0 con 0x7f69a8002860 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.034+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f69b8004260 con 0x7f69c80a8340 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.034+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(77..77 src has 1..77) ==== 3506+0+0 (unknown 1006809061 0 0) 0x7f69b804e2b0 con 0x7f69c80a8340 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.034+0000 7f69cce94640 10 monclient: get_auth_request con 0x7f69b40406e0 auth_method 0 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.036+0000 7f69c77fe640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.195:6792/0 conn(0x7f69a8002860 legacy=0x7f69a8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.036+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128884151 0 0) 0x7f69a80065c0 con 0x7f69a8002860 2024-09-13T10:32:25.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.036+0000 7f69c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.036+0000 7f69c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.036+0000 7f69c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.036+0000 7f69c4ff9640 10 monclient(hunting): my global_id is 55069 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69c80a1110 con 0x7f69a8002860 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3124797179 0 0) 0x7f69c80a1110 con 0x7f69a8002860 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69a80065c0 con 0x7f69a8002860 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f69bc001580 con 0x7f69a8002860 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 10 monclient: dump: 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.058 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2437599545 0 0) 0x7f69a80065c0 con 0x7f69a8002860 2024-09-13T10:32:25.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69a800a160 con 0x7f69a8002860 2024-09-13T10:32:25.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f69bc0048a0 con 0x7f69a8002860 2024-09-13T10:32:25.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:25.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:25.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.195:6792/0 conn(0x7f69a8002860 legacy=0x7f69a8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.037+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.195:6792/0 conn(0x7f69a8002860 legacy=0x7f69a8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:25.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.043+0000 7f69ce8f7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:25.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.043+0000 7f69ce8f7640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f69a8009e50 con 0x7f69a8009110 2024-09-13T10:32:25.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c77fe640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.195:6792/0 conn(0x7f69a8009110 legacy=0x7f69a80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080249471 0 0) 0x7f69a8009e50 con 0x7f69a8009110 2024-09-13T10:32:25.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 10 monclient(hunting): my global_id is 55078 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69a80065c0 con 0x7f69a8009110 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 204297117 0 0) 0x7f69a80065c0 con 0x7f69a8009110 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69a8009e50 con 0x7f69a8009110 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f69bc005a00 con 0x7f69a8009110 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 10 monclient: dump: 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.062 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.063 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.063 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.063 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.063 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.063 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.063 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.063 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.063 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.063 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.064 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.064 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.064 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2866577208 0 0) 0x7f69a8009e50 con 0x7f69a8009110 2024-09-13T10:32:25.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.046+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f69a800c3f0 con 0x7f69a8009110 2024-09-13T10:32:25.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 3877754439) 0x7f69bc001320 con 0x7f69a8009110 2024-09-13T10:32:25.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69c4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:25.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69c4ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:25.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.195:6792/0 conn(0x7f69a8009110 legacy=0x7f69a80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69c4ff9640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.195:6792/0 conn(0x7f69a8009110 legacy=0x7f69a80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:25.064 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:25.065 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:25.065 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:25.065 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:25.065 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:25.065 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 159466, 2024-09-13T10:32:25.065 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:25.065 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:25.065 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:25.065 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:25.065 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:25.065 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:25.065 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:25.066 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:25.066 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:25.066 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:25.066 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:25.066 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:32:25.066 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:25.066 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:25.067 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:25.068 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:25.070 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:25.071 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:25.072 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:25.074 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.075 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:25.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:25.076 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:25.076 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:25.076 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:25.076 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:25.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.076 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:25.076 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:25.077 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:25.079 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:25.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.081 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:25.082 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.083 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:25.084 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69ce8f7640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.195:6800/1839191919 conn(0x7f69b40406e0 legacy=0x7f69b4042ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69ce8f7640 10 monclient: shutdown 2024-09-13T10:32:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69ce8f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69ce8f7640 1 -- 172.21.15.181:0/3734998157 >> v1:172.21.15.181:6790/0 conn(0x7f69c80a8340 legacy=0x7f69c809d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69cce94640 1 -- 172.21.15.181:0/3734998157 reap_dead start 2024-09-13T10:32:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69cce94640 1 -- 172.21.15.181:0/3734998157 reap_dead start 2024-09-13T10:32:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69ce8f7640 1 -- 172.21.15.181:0/3734998157 shutdown_connections 2024-09-13T10:32:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69ce8f7640 1 -- 172.21.15.181:0/3734998157 >> 172.21.15.181:0/3734998157 conn(0x7f69c80a6640 msgr2=0x7f69c813eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:25.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69ce8f7640 1 -- 172.21.15.181:0/3734998157 shutdown_connections 2024-09-13T10:32:25.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.047+0000 7f69ce8f7640 1 -- 172.21.15.181:0/3734998157 wait complete. 2024-09-13T10:32:25.087 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:25.087 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T10:32:25.087 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T10:32:25.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.184+0000 7fcdf348e640 10 monclient: get_monmap_and_config 2024-09-13T10:32:25.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.184+0000 7fcdf348e640 10 monclient: build_initial_monmap 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.184+0000 7fcdf348e640 10 monclient: monmap: 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:25.185942+0000 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:25.185942+0000 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:25.187 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:25.188 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:25.188 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:25.188 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.184+0000 7fcdf348e640 1 Processor -- start 2024-09-13T10:32:25.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf348e640 1 -- start start 2024-09-13T10:32:25.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf348e640 10 monclient: init 2024-09-13T10:32:25.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf348e640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:25.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf348e640 10 monclient: _add_conns ranks=[5,8,3,6,4,0,1,7,2] 2024-09-13T10:32:25.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf348e640 10 monclient(hunting): picked mon.noname-h con 0x7fcdec0a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:25.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf348e640 10 monclient(hunting): picked mon.noname-e con 0x7fcdec0a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:25.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf348e640 10 monclient(hunting): picked mon.noname-g con 0x7fcdec13f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:25.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf348e640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdec0a4bc0 con 0x7fcdec13f750 2024-09-13T10:32:25.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf348e640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdec13a320 con 0x7fcdec0a6640 2024-09-13T10:32:25.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf348e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdec0a8100 con 0x7fcdec0a8340 2024-09-13T10:32:25.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf348e640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:25.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf348e640 10 monclient(hunting): authenticate will time out at 884.691590s 2024-09-13T10:32:25.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf0a29640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fcdec0a8340 0x7fcdec139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40434/0 (socket says 172.21.15.181:40434) 2024-09-13T10:32:25.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.185+0000 7fcdf0a29640 1 -- 172.21.15.181:0/4223565107 learned_addr learned my addr 172.21.15.181:0/4223565107 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:25.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.187+0000 7fcdf0a29640 1 -- 172.21.15.181:0/4223565107 >> v1:172.21.15.181:6793/0 conn(0x7fcdec0a8340 legacy=0x7fcdec139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcdf1a2b640 1 -- 172.21.15.181:0/4223565107 >> v1:172.21.15.195:6790/0 conn(0x7fcdec13f750 legacy=0x7fcdec141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcdf122a640 1 -- 172.21.15.181:0/4223565107 >> v1:172.21.15.195:6791/0 conn(0x7fcdec0a6640 legacy=0x7fcdec139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995930947 0 0) 0x7fcdec0a8100 con 0x7fcdec0a8340 2024-09-13T10:32:25.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient(hunting): my global_id is 74231 2024-09-13T10:32:25.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdd8003520 con 0x7fcdec0a8340 2024-09-13T10:32:25.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3621423422 0 0) 0x7fcdec0a4bc0 con 0x7fcdec13f750 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient(hunting): my global_id is 5016 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdec0a8100 con 0x7fcdec13f750 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199649478 0 0) 0x7fcdec13a320 con 0x7fcdec0a6640 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient(hunting): my global_id is 5126 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdec0a4bc0 con 0x7fcdec0a6640 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2823449602 0 0) 0x7fcdd8003520 con 0x7fcdec0a8340 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 >> v1:172.21.15.195:6791/0 conn(0x7fcdec0a6640 legacy=0x7fcdec139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 >> v1:172.21.15.195:6790/0 conn(0x7fcdec13f750 legacy=0x7fcdec141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient: _finish_hunting 0 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 monclient: found mon.noname-e 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdec0a48e0 con 0x7fcdec0a8340 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient: _finish_auth 0 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient: _check_auth_tickets 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcdf348e640 5 monclient: authenticate success, global_id 74231 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcdf348e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcddc001ae0 con 0x7fcdec0a8340 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:25.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient: dump: 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.197 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcdf348e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcddc0048a0 con 0x7fcdec0a8340 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 1 -- 172.21.15.181:0/4223565107 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcddc004e10 con 0x7fcdec0a8340 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcdf348e640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcdf348e640 4 set_mon_vals no callback set 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.188+0000 7fcde3fff640 10 monclient: dump: 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.198 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.189+0000 7fcdf348e640 10 monclient: shutdown 2024-09-13T10:32:25.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.189+0000 7fcdf348e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.189+0000 7fcdf348e640 1 -- 172.21.15.181:0/4223565107 >> v1:172.21.15.181:6793/0 conn(0x7fcdec0a8340 legacy=0x7fcdec139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.189+0000 7fcdf348e640 1 -- 172.21.15.181:0/4223565107 shutdown_connections 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.189+0000 7fcdf348e640 1 -- 172.21.15.181:0/4223565107 >> 172.21.15.181:0/4223565107 conn(0x7fcdec077170 msgr2=0x7fcdec0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.189+0000 7fcdf348e640 1 -- 172.21.15.181:0/4223565107 shutdown_connections 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.189+0000 7fcdf348e640 1 -- 172.21.15.181:0/4223565107 wait complete. 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.189+0000 7fcdf348e640 10 monclient: build_initial_monmap 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.189+0000 7fcdf348e640 10 monclient: monmap: 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:25.200 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 1 Processor -- start 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 1 -- start start 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 10 monclient: init 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:25.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 10 monclient: _add_conns ranks=[4,6,2,3,5,7,8,1,0] 2024-09-13T10:32:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 10 monclient(hunting): picked mon.noname-c con 0x7fcdec0a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 10 monclient(hunting): picked mon.noname-d con 0x7fcdec13f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 10 monclient(hunting): picked mon.noname-b con 0x7fcdec135460 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdec13ddd0 con 0x7fcdec135460 2024-09-13T10:32:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdec0a9cb0 con 0x7fcdec0a8340 2024-09-13T10:32:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdec134d60 con 0x7fcdec13f750 2024-09-13T10:32:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf348e640 10 monclient(hunting): authenticate will time out at 884.696699s 2024-09-13T10:32:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf122a640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fcdec0a8340 0x7fcdec12f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:34022/0 (socket says 172.21.15.181:34022) 2024-09-13T10:32:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.190+0000 7fcdf122a640 1 -- 172.21.15.181:0/327180204 learned_addr learned my addr 172.21.15.181:0/327180204 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:25.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.192+0000 7fcdf122a640 1 -- 172.21.15.181:0/327180204 >> v1:172.21.15.181:6791/0 conn(0x7fcdec0a8340 legacy=0x7fcdec12f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.192+0000 7fcdf1a2b640 1 -- 172.21.15.181:0/327180204 >> v1:172.21.15.181:6790/0 conn(0x7fcdec135460 legacy=0x7fcdec1d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.192+0000 7fcdf0a29640 1 -- 172.21.15.181:0/327180204 >> v1:172.21.15.181:6792/0 conn(0x7fcdec13f750 legacy=0x7fcdec12fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:25.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2982028540 0 0) 0x7fcdec0a4bc0 con 0x7fcdec0a8340 2024-09-13T10:32:25.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): my global_id is 5116 2024-09-13T10:32:25.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdd0003550 con 0x7fcdec0a8340 2024-09-13T10:32:25.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906799636 0 0) 0x7fcdec13ddd0 con 0x7fcdec135460 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): my global_id is 64550 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdec0a4bc0 con 0x7fcdec135460 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428410921 0 0) 0x7fcdec134d60 con 0x7fcdec13f750 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): my global_id is 5001 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdec13ddd0 con 0x7fcdec13f750 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2422053527 0 0) 0x7fcdd0003550 con 0x7fcdec0a8340 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcdec134d60 con 0x7fcdec0a8340 2024-09-13T10:32:25.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcde8001d10 con 0x7fcdec0a8340 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): dump: 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.208 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3157886706 0 0) 0x7fcdec0a4bc0 con 0x7fcdec135460 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcdd0003550 con 0x7fcdec135460 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3159103377 0 0) 0x7fcdec13ddd0 con 0x7fcdec13f750 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcdec0a4bc0 con 0x7fcdec13f750 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcde40020b0 con 0x7fcdec135460 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:25.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): dump: 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.210 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcddc004d90 con 0x7fcdec13f750 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient(hunting): dump: 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.211 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3191542558 0 0) 0x7fcdec134d60 con 0x7fcdec0a8340 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 >> v1:172.21.15.181:6792/0 conn(0x7fcdec13f750 legacy=0x7fcdec12fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 >> v1:172.21.15.181:6790/0 conn(0x7fcdec135460 legacy=0x7fcdec1d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 monclient: found mon.c 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:25.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdec135040 con 0x7fcdec0a8340 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient: _finish_auth 0 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcdf348e640 5 monclient: authenticate success, global_id 5116 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcdf348e640 10 monclient: _renew_subs 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcdf348e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcdf348e640 1 -- 172.21.15.181:0/327180204 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcdec130280 con 0x7fcdec0a8340 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcde8003a80 con 0x7fcdec0a8340 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcde8003ff0 con 0x7fcdec0a8340 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:25.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde1ffb640 10 monclient: dump: 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:25.214 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcdf348e640 10 monclient: _renew_subs 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcde37fe640 4 set_mon_vals no callback set 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcdf348e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.193+0000 7fcdf348e640 1 -- 172.21.15.181:0/327180204 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fcdec1d7e60 con 0x7fcdec0a8340 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.194+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fcde8004190 con 0x7fcdec0a8340 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.194+0000 7fcdf348e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.194+0000 7fcdf348e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.194+0000 7fcdf348e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.194+0000 7fcdf348e640 1 -- 172.21.15.181:0/327180204 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdec050d00 con 0x7fcdec0a8340 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.194+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(77..77 src has 1..77) ==== 3506+0+0 (unknown 1006809061 0 0) 0x7fcde804e160 con 0x7fcdec0a8340 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.195+0000 7fcdf0a29640 10 monclient: get_auth_request con 0x7fcdd00407a0 auth_method 0 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.199+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fcdec050d00 con 0x7fcdec0a8340 2024-09-13T10:32:25.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.199+0000 7fcde1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:25.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.199+0000 7fcde1ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:25.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.439+0000 7fcdf348e640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-13T10:32:25.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.439+0000 7fcdf348e640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-13T10:32:25.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.439+0000 7fcdf348e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:25.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.439+0000 7fcdf348e640 1 -- 172.21.15.181:0/327180204 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fcdec1347a0 con 0x7fcdec0a8340 2024-09-13T10:32:25.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.442+0000 7fcde1ffb640 1 -- 172.21.15.181:0/327180204 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fcdec0a9cb0 con 0x7fcdec0a8340 2024-09-13T10:32:25.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.442+0000 7fcde1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-13T10:32:25.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.442+0000 7fcde1ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:25.446 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.446 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=12,config=2,health=10,kv=11,logm=65} crc {auth=1475582130,config=2586702516,health=3965116828,kv=2388661929,logm=2108857762}) 2024-09-13T10:32:25.446 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=11,kv=11,logm=62} crc {auth=3175234687,config=2586702516,health=1661176277,kv=2809669937,logm=247905725}) 2024-09-13T10:32:25.446 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=12,config=2,health=10,kv=11,logm=65} crc {auth=1475582130,config=2586702516,health=3965116828,kv=2388661929,logm=2108857762}) 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=10,kv=12,logm=64} crc {auth=357249424,config=2586702516,health=3269268947,kv=3467323233,logm=4262184127}) 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=12,config=2,health=10,kv=11,logm=65} crc {auth=1475582130,config=2586702516,health=3965116828,kv=2388661929,logm=2108857762}) 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=14,config=2,health=11,kv=11,logm=62} crc {auth=3175234687,config=2586702516,health=4104172178,kv=2954796944,logm=63532079}) 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=12,config=2,health=10,kv=11,logm=65} crc {auth=1475582130,config=2586702516,health=3965116828,kv=2388661929,logm=2108857762}) 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=13,config=2,health=12,kv=12,logm=61} crc {auth=3334131239,config=2586702516,health=2035631478,kv=952050039,logm=2924781281}) 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=12,config=2,health=10,kv=11,logm=65} crc {auth=1475582130,config=2586702516,health=3965116828,kv=2388661929,logm=2108857762}) 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=13,config=2,health=12,kv=12,logm=61} crc {auth=2718040132,config=2586702516,health=2035631478,kv=3467323233,logm=99144168}) 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.447 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=12,config=2,health=10,kv=11,logm=65} crc {auth=1475582130,config=2586702516,health=3965116828,kv=2388661929,logm=2108857762}) 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=14,config=2,health=10,kv=11,logm=63} crc {auth=3175234687,config=2586702516,health=3244327347,kv=3803733231,logm=3568424781}) 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=12,config=2,health=10,kv=11,logm=65} crc {auth=1475582130,config=2586702516,health=3965116828,kv=2388661929,logm=2108857762}) 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=13,config=2,health=12,kv=12,logm=61} crc {auth=1703436098,config=2586702516,health=2035631478,kv=3467323233,logm=2943768894}) 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=12,config=2,health=10,kv=11,logm=65} crc {auth=1475582130,config=2586702516,health=3965116828,kv=2388661929,logm=2108857762}) 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.442+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=13,config=2,health=12,kv=12,logm=61} crc {auth=1703436098,config=2586702516,health=2035631478,kv=3467323233,logm=2331340063}) 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2992286126}) 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=231919823}) 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2992286126}) 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1545411557}) 2024-09-13T10:32:25.448 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2992286126}) 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2752552994}) 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2992286126}) 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=316169962}) 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2992286126}) 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3494168298}) 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2992286126}) 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3102991445}) 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2992286126}) 2024-09-13T10:32:25.449 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4250251355}) 2024-09-13T10:32:25.450 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.450 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2992286126}) 2024-09-13T10:32:25.450 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.443+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3015934309}) 2024-09-13T10:32:25.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.444+0000 7fcdf348e640 1 -- 172.21.15.181:0/327180204 >> v1:172.21.15.195:6800/1839191919 conn(0x7fcdd00407a0 legacy=0x7fcdd0042c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.444+0000 7fcdf348e640 10 monclient: shutdown 2024-09-13T10:32:25.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.444+0000 7fcdf348e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:25.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.444+0000 7fcdf348e640 1 -- 172.21.15.181:0/327180204 >> v1:172.21.15.181:6791/0 conn(0x7fcdec0a8340 legacy=0x7fcdec12f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:25.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.445+0000 7fcdf348e640 1 -- 172.21.15.181:0/327180204 shutdown_connections 2024-09-13T10:32:25.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.445+0000 7fcdf348e640 1 -- 172.21.15.181:0/327180204 >> 172.21.15.181:0/327180204 conn(0x7fcdec0a6640 msgr2=0x7fcdec0a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:25.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.445+0000 7fcdf348e640 1 -- 172.21.15.181:0/327180204 shutdown_connections 2024-09-13T10:32:25.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:25.445+0000 7fcdf348e640 1 -- 172.21.15.181:0/327180204 wait complete. 2024-09-13T10:32:25.453 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.453 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2383360013}) 2024-09-13T10:32:25.453 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2178794936}) 2024-09-13T10:32:25.453 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.453 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2383360013}) 2024-09-13T10:32:25.453 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2495854576}) 2024-09-13T10:32:25.453 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.453 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2383360013}) 2024-09-13T10:32:25.453 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3149513287}) 2024-09-13T10:32:25.453 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2383360013}) 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4176783995}) 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2383360013}) 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3007123688}) 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2383360013}) 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=829097636}) 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2383360013}) 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1577787315}) 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2383360013}) 2024-09-13T10:32:25.454 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.445+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1949281635}) 2024-09-13T10:32:25.458 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-13T10:32:25.463 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1198432516}) 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3067664176}) 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1198432516}) 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4028522946}) 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1198432516}) 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1647553866}) 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1198432516}) 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2492507586}) 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.464 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1198432516}) 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3750537854}) 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1198432516}) 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=980359240}) 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1198432516}) 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=109877052}) 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1198432516}) 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2906380200}) 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1610804521}) 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3764247140}) 2024-09-13T10:32:25.465 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.458+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1610804521}) 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2265416055}) 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1610804521}) 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1112608476}) 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1610804521}) 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1144805556}) 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1610804521}) 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3895641722}) 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1610804521}) 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3937101984}) 2024-09-13T10:32:25.466 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1610804521}) 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=185858939}) 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1610804521}) 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.459+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1155707494}) 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4166410061}) 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4289621957}) 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4166410061}) 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2233625609}) 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4166410061}) 2024-09-13T10:32:25.467 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1637930927}) 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4166410061}) 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1898669242}) 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4166410061}) 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2263485339}) 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4166410061}) 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3867397274}) 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4166410061}) 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2151520037}) 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.468 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4166410061}) 2024-09-13T10:32:25.469 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.460+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=23325214}) 2024-09-13T10:32:25.472 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.472 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3447906308}) 2024-09-13T10:32:25.472 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=720302480}) 2024-09-13T10:32:25.473 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.473 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3447906308}) 2024-09-13T10:32:25.473 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1159855925}) 2024-09-13T10:32:25.473 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.473 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3447906308}) 2024-09-13T10:32:25.473 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2334819175}) 2024-09-13T10:32:25.473 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.473 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3447906308}) 2024-09-13T10:32:25.473 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1190363197}) 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3447906308}) 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3297381976}) 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3447906308}) 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1936950405}) 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3447906308}) 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=296696239}) 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.461+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3447906308}) 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.462+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2077354569}) 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.474 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2272004031}) 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978389145}) 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2272004031}) 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=418661946}) 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2272004031}) 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2949748097}) 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2272004031}) 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1620231130}) 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2272004031}) 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4278304341}) 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.475 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2272004031}) 2024-09-13T10:32:25.476 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3047606457}) 2024-09-13T10:32:25.476 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.476 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2272004031}) 2024-09-13T10:32:25.476 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4236400089}) 2024-09-13T10:32:25.476 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.476 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2272004031}) 2024-09-13T10:32:25.476 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.463+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3637049658}) 2024-09-13T10:32:25.485 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.485 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3506256232}) 2024-09-13T10:32:25.485 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3932278613}) 2024-09-13T10:32:25.485 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.485 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3506256232}) 2024-09-13T10:32:25.485 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3365889676}) 2024-09-13T10:32:25.485 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.485 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3506256232}) 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3113298246}) 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3506256232}) 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=199674899}) 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3506256232}) 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3978821799}) 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3506256232}) 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3731693598}) 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3506256232}) 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=177641506}) 2024-09-13T10:32:25.486 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3506256232}) 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.473+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3730399517}) 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1330651588}) 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128297981}) 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1330651588}) 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3232272053}) 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1330651588}) 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=587275976}) 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1330651588}) 2024-09-13T10:32:25.487 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1818036521}) 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1330651588}) 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4230426959}) 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1330651588}) 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3625889929}) 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1330651588}) 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1716834161}) 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1330651588}) 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.474+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=797934335}) 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.488 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=40,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=4} crc {logm=3377328042,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2249177302,mon_config_key=2130642564,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=2484882496}) 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=38,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=4} crc {logm=954496962,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3887420027,mon_config_key=1611854553,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=899763694}) 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=40,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=4} crc {logm=3377328042,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2249177302,mon_config_key=2130642564,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=2484882496}) 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=37,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=7} crc {logm=652570874,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3737991733,mon_config_key=4256284388,monmap=2763160955,nvmeofgw=598337686,osd_metadata=3276613974,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=827834810}) 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=40,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=4} crc {logm=3377328042,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2249177302,mon_config_key=2130642564,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=2484882496}) 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=37,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=12,mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=9} crc {logm=276091551,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgrstat=2007774259,mon_config_key=490752937,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=3226525952}) 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=40,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=4} crc {logm=3377328042,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2249177302,mon_config_key=2130642564,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=2484882496}) 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=38,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=6} crc {logm=783410819,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1908307796,mon_config_key=2664392931,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=1341287927}) 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=40,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=4} crc {logm=3377328042,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2249177302,mon_config_key=2130642564,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=2484882496}) 2024-09-13T10:32:25.489 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=39,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=3} crc {logm=2173085077,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3887420027,mon_config_key=4256284388,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=2716035223}) 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=40,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=4} crc {logm=3377328042,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2249177302,mon_config_key=2130642564,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=2484882496}) 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=40,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=17,monmap=2,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=6} crc {logm=3377328042,mdsmap=3140514009,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3737991733,mon_config_key=4256284388,monmap=3140514009,nvmeofgw=3140514009,osd_metadata=1311189451,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=1341287927}) 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=40,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=4} crc {logm=3377328042,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2249177302,mon_config_key=2130642564,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=2484882496}) 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=38,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=6} crc {logm=2601901306,mdsmap=2874252693,mgr=2017258178,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3887420027,mon_config_key=4256284388,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=3823785925,osdmap=1341287927}) 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=40,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=4} crc {logm=3377328042,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2249177302,mon_config_key=2130642564,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=2484882496}) 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.476+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=39,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=7} crc {logm=1181215852,mdsmap=2874252693,mgr=2682226838,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2249177302,mon_config_key=669862725,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1741557421,osd_snap=4133920409,osdmap=827834810}) 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=240571596}) 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=509434650}) 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.490 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=240571596}) 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1359326113}) 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=240571596}) 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=95564248}) 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=240571596}) 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=2087605739}) 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=240571596}) 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=1074554015}) 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=240571596}) 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=893910809}) 2024-09-13T10:32:25.491 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=240571596}) 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3475003524}) 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=240571596}) 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.478+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=1655519239}) 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.480+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.480+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=21} crc {osdmap=4283121113}) 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=24} crc {osdmap=1110942314}) 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=21} crc {osdmap=4283121113}) 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=25} crc {osdmap=3889022581}) 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=21} crc {osdmap=4283121113}) 2024-09-13T10:32:25.492 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=24} crc {osdmap=230328872}) 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=21} crc {osdmap=4283121113}) 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=23} crc {osdmap=379951560}) 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=21} crc {osdmap=4283121113}) 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=24} crc {osdmap=2138297387}) 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=21} crc {osdmap=4283121113}) 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=24} crc {osdmap=2931628205}) 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=21} crc {osdmap=4283121113}) 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=23} crc {osdmap=3374959211}) 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:32:25.493 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=21} crc {osdmap=4283121113}) 2024-09-13T10:32:25.494 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:32:25.481+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=25} crc {osdmap=340107885}) 2024-09-13T10:32:26.459 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:32:26.459 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:32:26.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.560+0000 7f01c975d640 10 monclient: get_monmap_and_config 2024-09-13T10:32:26.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.560+0000 7f01c975d640 10 monclient: build_initial_monmap 2024-09-13T10:32:26.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.560+0000 7f01c975d640 10 monclient: monmap: 2024-09-13T10:32:26.563 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:26.563 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:26.563 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:26.562062+0000 2024-09-13T10:32:26.563 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:26.562062+0000 2024-09-13T10:32:26.563 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:26.563 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:26.563 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:26.563 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:26.563 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:26.564 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:26.564 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:26.564 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:26.564 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:26.564 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:26.564 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:26.564 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 1 Processor -- start 2024-09-13T10:32:26.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 1 -- start start 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 10 monclient: init 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 10 monclient: _add_conns ranks=[0,4,2,8,7,5,3,1,6] 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 10 monclient(hunting): picked mon.noname-a con 0x7f01c40a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 10 monclient(hunting): picked mon.noname-c con 0x7f01c40a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 10 monclient(hunting): picked mon.noname-b con 0x7f01c413f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c40a5fe0 con 0x7f01c40a66d0 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c40a8080 con 0x7f01c413f9a0 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c40a42c0 con 0x7f01c40a6ab0 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c975d640 10 monclient(hunting): authenticate will time out at 886.067714s 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c2ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f01c40a66d0 0x7f01c40a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53044/0 (socket says 172.21.15.181:53044) 2024-09-13T10:32:26.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c2ffd640 1 -- 172.21.15.181:0/2466831716 learned_addr learned my addr 172.21.15.181:0/2466831716 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.561+0000 7f01c37fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f01c413f9a0 0x7f01c4141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:39250/0 (socket says 172.21.15.181:39250) 2024-09-13T10:32:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.563+0000 7f01c2ffd640 1 -- 172.21.15.181:0/2466831716 >> v1:172.21.15.181:6789/0 conn(0x7f01c40a66d0 legacy=0x7f01c40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.564+0000 7f01c37fe640 1 -- 172.21.15.181:0/2466831716 >> v1:172.21.15.181:6790/0 conn(0x7f01c413f9a0 legacy=0x7f01c4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:26.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.564+0000 7f01c27fc640 1 -- 172.21.15.181:0/2466831716 >> v1:172.21.15.181:6791/0 conn(0x7f01c40a6ab0 legacy=0x7f01c40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:26.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 1 -- 172.21.15.181:0/2466831716 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1710179474 0 0) 0x7f01c40a8080 con 0x7f01c413f9a0 2024-09-13T10:32:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 10 monclient(hunting): my global_id is 64559 2024-09-13T10:32:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 1 -- 172.21.15.181:0/2466831716 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01b0003520 con 0x7f01c413f9a0 2024-09-13T10:32:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 1 -- 172.21.15.181:0/2466831716 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4171760263 0 0) 0x7f01b0003520 con 0x7f01c413f9a0 2024-09-13T10:32:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 1 -- 172.21.15.181:0/2466831716 >> v1:172.21.15.181:6791/0 conn(0x7f01c40a6ab0 legacy=0x7f01c40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 1 -- 172.21.15.181:0/2466831716 >> v1:172.21.15.181:6789/0 conn(0x7f01c40a66d0 legacy=0x7f01c40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:32:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 1 monclient: found mon.noname-b 2024-09-13T10:32:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:32:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.574+0000 7f01c1ffb640 1 -- 172.21.15.181:0/2466831716 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c41464e0 con 0x7f01c413f9a0 2024-09-13T10:32:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 10 monclient: _finish_auth 0 2024-09-13T10:32:26.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:32:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 1 -- 172.21.15.181:0/2466831716 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f01bc001e60 con 0x7f01c413f9a0 2024-09-13T10:32:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 10 monclient: dump: 2024-09-13T10:32:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:26.580 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c975d640 5 monclient: authenticate success, global_id 64559 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c975d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 1 -- 172.21.15.181:0/2466831716 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f01bc004b60 con 0x7f01c413f9a0 2024-09-13T10:32:26.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 1 -- 172.21.15.181:0/2466831716 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f01bc0050d0 con 0x7f01c413f9a0 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c975d640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c975d640 4 set_mon_vals no callback set 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.575+0000 7f01c1ffb640 10 monclient: dump: 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:26.582 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.576+0000 7f01c975d640 10 monclient: shutdown 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.576+0000 7f01c975d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.576+0000 7f01c975d640 1 -- 172.21.15.181:0/2466831716 >> v1:172.21.15.181:6790/0 conn(0x7f01c413f9a0 legacy=0x7f01c4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.576+0000 7f01c975d640 1 -- 172.21.15.181:0/2466831716 shutdown_connections 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.576+0000 7f01c975d640 1 -- 172.21.15.181:0/2466831716 >> 172.21.15.181:0/2466831716 conn(0x7f01c40abcd0 msgr2=0x7f01c40ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:26.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.576+0000 7f01c975d640 1 -- 172.21.15.181:0/2466831716 shutdown_connections 2024-09-13T10:32:26.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.576+0000 7f01c975d640 1 -- 172.21.15.181:0/2466831716 wait complete. 2024-09-13T10:32:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.577+0000 7f01c975d640 10 monclient: build_initial_monmap 2024-09-13T10:32:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.577+0000 7f01c975d640 10 monclient: monmap: 2024-09-13T10:32:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:26.586 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.578+0000 7f01c975d640 1 Processor -- start 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.578+0000 7f01c975d640 1 -- start start 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.578+0000 7f01c975d640 10 monclient: init 2024-09-13T10:32:26.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.579+0000 7f01c975d640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.579+0000 7f01c975d640 10 monclient: _add_conns ranks=[5,2,0,3,4,7,1,6,8] 2024-09-13T10:32:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.579+0000 7f01c975d640 10 monclient(hunting): picked mon.noname-h con 0x7f01c40a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.579+0000 7f01c975d640 10 monclient(hunting): picked mon.noname-b con 0x7f01c40a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.579+0000 7f01c2ffd640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f01c40a66d0 0x7f01c41d2610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:42658/0 (socket says 172.21.15.181:42658) 2024-09-13T10:32:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.579+0000 7f01c975d640 10 monclient(hunting): picked mon.noname-a con 0x7f01c413f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.579+0000 7f01c2ffd640 1 -- 172.21.15.181:0/2700349360 learned_addr learned my addr 172.21.15.181:0/2700349360 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.579+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c4074170 con 0x7f01c413f9a0 2024-09-13T10:32:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.579+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c4074450 con 0x7f01c40a6ab0 2024-09-13T10:32:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.579+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c4142db0 con 0x7f01c40a66d0 2024-09-13T10:32:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.579+0000 7f01c975d640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:26.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.579+0000 7f01c975d640 10 monclient(hunting): authenticate will time out at 886.085866s 2024-09-13T10:32:26.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.581+0000 7f01c2ffd640 1 -- 172.21.15.181:0/2700349360 >> v1:172.21.15.195:6791/0 conn(0x7f01c40a66d0 legacy=0x7f01c41d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:26.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.582+0000 7f01c27fc640 1 -- 172.21.15.181:0/2700349360 >> v1:172.21.15.181:6790/0 conn(0x7f01c40a6ab0 legacy=0x7f01c41d2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:26.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.582+0000 7f01c37fe640 1 -- 172.21.15.181:0/2700349360 >> v1:172.21.15.181:6789/0 conn(0x7f01c413f9a0 legacy=0x7f01c41da690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:26.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810255937 0 0) 0x7f01c4074450 con 0x7f01c40a6ab0 2024-09-13T10:32:26.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:26.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:26.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:26.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): my global_id is 64568 2024-09-13T10:32:26.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01a4003550 con 0x7f01c40a6ab0 2024-09-13T10:32:26.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3162108852 0 0) 0x7f01c4142db0 con 0x7f01c40a66d0 2024-09-13T10:32:26.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:26.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): my global_id is 5135 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01c4074450 con 0x7f01c40a66d0 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 135936759 0 0) 0x7f01c4074170 con 0x7f01c413f9a0 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): my global_id is 54936 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01c4142db0 con 0x7f01c413f9a0 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3208122915 0 0) 0x7f01c4142db0 con 0x7f01c413f9a0 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01c4074170 con 0x7f01c413f9a0 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f01bc0020b0 con 0x7f01c413f9a0 2024-09-13T10:32:26.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): dump: 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:26.980 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:26.981 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:26.981 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:26.981 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:26.981 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:26.981 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:26.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:26.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.974+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3714798409 0 0) 0x7f01c4074450 con 0x7f01c40a66d0 2024-09-13T10:32:26.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.975+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01c4142db0 con 0x7f01c40a66d0 2024-09-13T10:32:26.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.975+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1872032716 0 0) 0x7f01a4003550 con 0x7f01c40a6ab0 2024-09-13T10:32:26.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.975+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01c4074450 con 0x7f01c40a6ab0 2024-09-13T10:32:26.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.975+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f01b40047e0 con 0x7f01c40a66d0 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.975+0000 7f01bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.975+0000 7f01bb7fe640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.975+0000 7f01bb7fe640 10 monclient(hunting): dump: 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:26.982 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:26.983 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:26.983 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:26.983 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:26.983 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:26.983 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:26.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.975+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f01ac001c10 con 0x7f01c40a6ab0 2024-09-13T10:32:26.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.975+0000 7f01bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:26.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.975+0000 7f01bb7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:26.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.975+0000 7f01bb7fe640 10 monclient(hunting): dump: 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:26.984 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:26.985 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:26.985 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:26.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2898424436 0 0) 0x7f01c4074170 con 0x7f01c413f9a0 2024-09-13T10:32:26.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 >> v1:172.21.15.195:6791/0 conn(0x7f01c40a66d0 legacy=0x7f01c41d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:26.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 >> v1:172.21.15.181:6790/0 conn(0x7f01c40a6ab0 legacy=0x7f01c41d2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:26.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:32:26.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 1 monclient: found mon.a 2024-09-13T10:32:26.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:26.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:26.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c4068a50 con 0x7f01c413f9a0 2024-09-13T10:32:26.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 10 monclient: _finish_auth 0 2024-09-13T10:32:26.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:32:26.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:26.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01c975d640 5 monclient: authenticate success, global_id 54936 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01c975d640 10 monclient: _renew_subs 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01c975d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f01c4139070 con 0x7f01c413f9a0 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01c975d640 10 monclient: _renew_subs 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01c975d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f01c4073e90 con 0x7f01c413f9a0 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f01bc005300 con 0x7f01c413f9a0 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f01bc0057f0 con 0x7f01c413f9a0 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01bb7fe640 10 monclient: dump: 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:26.988 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:26.989 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:26.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.981+0000 7f01c17fa640 4 set_mon_vals no callback set 2024-09-13T10:32:26.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.982+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f01bc011e70 con 0x7f01c413f9a0 2024-09-13T10:32:26.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.982+0000 7f01c975d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:26.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.982+0000 7f01c975d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:26.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.982+0000 7f01c975d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:26.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.982+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(78..78 src has 1..78) ==== 3898+0+0 (unknown 1885467272 0 0) 0x7f01bc04e3e0 con 0x7f01c413f9a0 2024-09-13T10:32:26.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.982+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c40a3240 con 0x7f01c413f9a0 2024-09-13T10:32:26.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.982+0000 7f01c2ffd640 10 monclient: get_auth_request con 0x7f01a4040770 auth_method 0 2024-09-13T10:32:26.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.987+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f01bc0178d0 con 0x7f01c413f9a0 2024-09-13T10:32:26.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.987+0000 7f01bb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:26.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:26.987+0000 7f01bb7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.231+0000 7f01c975d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:32:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.231+0000 7f01c975d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:32:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.231+0000 7f01c975d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.231+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f01c4069af0 con 0x7f01c413f9a0 2024-09-13T10:32:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.232+0000 7f01bb7fe640 1 -- 172.21.15.181:0/2700349360 <== mon.0 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 2692996842) 0x7f01bc0171d0 con 0x7f01c413f9a0 2024-09-13T10:32:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.232+0000 7f01bb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:32:27.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.232+0000 7f01bb7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:27.235 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":48,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:32:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.234+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 >> v1:172.21.15.195:6800/1839191919 conn(0x7f01a4040770 legacy=0x7f01a4042c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.234+0000 7f01c975d640 10 monclient: shutdown 2024-09-13T10:32:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.234+0000 7f01c975d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.234+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 >> v1:172.21.15.181:6789/0 conn(0x7f01c413f9a0 legacy=0x7f01c41da690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.234+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 shutdown_connections 2024-09-13T10:32:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.234+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 >> 172.21.15.181:0/2700349360 conn(0x7f01c40abcd0 msgr2=0x7f01c40a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.234+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 shutdown_connections 2024-09-13T10:32:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.234+0000 7f01c975d640 1 -- 172.21.15.181:0/2700349360 wait complete. 2024-09-13T10:32:27.247 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:32:27.247 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T10:32:27.247 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:32:27.247 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:32:27.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.343+0000 7f4cfbe9c640 10 monclient: get_monmap_and_config 2024-09-13T10:32:27.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.343+0000 7f4cfbe9c640 10 monclient: build_initial_monmap 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.343+0000 7f4cfbe9c640 10 monclient: monmap: 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:27.344889+0000 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:27.344889+0000 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:27.347 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.343+0000 7f4cfbe9c640 1 Processor -- start 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfbe9c640 1 -- start start 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfbe9c640 10 monclient: init 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfbe9c640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfbe9c640 10 monclient: _add_conns ranks=[1,3,6,0,5,2,4,8,7] 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfbe9c640 10 monclient(hunting): picked mon.noname-f con 0x7f4cf40a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfbe9c640 10 monclient(hunting): picked mon.noname-g con 0x7f4cf40a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfbe9c640 10 monclient(hunting): picked mon.noname-d con 0x7f4cf413f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfbe9c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf40a5fe0 con 0x7f4cf40a66d0 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfbe9c640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf40a8080 con 0x7f4cf40a6ab0 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfbe9c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf40a42c0 con 0x7f4cf413f9a0 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfbe9c640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfbe9c640 10 monclient(hunting): authenticate will time out at 886.850594s 2024-09-13T10:32:27.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfa439640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f4cf413f9a0 0x7f4cf4141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46482/0 (socket says 172.21.15.181:46482) 2024-09-13T10:32:27.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.344+0000 7f4cfa439640 1 -- 172.21.15.181:0/1876021263 learned_addr learned my addr 172.21.15.181:0/1876021263 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.346+0000 7f4cfa439640 1 -- 172.21.15.181:0/1876021263 >> v1:172.21.15.181:6792/0 conn(0x7f4cf413f9a0 legacy=0x7f4cf4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 1 -- 172.21.15.181:0/1876021263 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610173692 0 0) 0x7f4cf40a42c0 con 0x7f4cf413f9a0 2024-09-13T10:32:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient(hunting): my global_id is 5010 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 1 -- 172.21.15.181:0/1876021263 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ce0003520 con 0x7f4cf413f9a0 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf9437640 1 -- 172.21.15.181:0/1876021263 >> v1:172.21.15.195:6790/0 conn(0x7f4cf40a6ab0 legacy=0x7f4cf40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf9c38640 1 -- 172.21.15.181:0/1876021263 >> v1:172.21.15.195:6789/0 conn(0x7f4cf40a66d0 legacy=0x7f4cf40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 1 -- 172.21.15.181:0/1876021263 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3882847085 0 0) 0x7f4ce0003520 con 0x7f4cf413f9a0 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 1 -- 172.21.15.181:0/1876021263 >> v1:172.21.15.195:6790/0 conn(0x7f4cf40a6ab0 legacy=0x7f4cf40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 1 -- 172.21.15.181:0/1876021263 >> v1:172.21.15.195:6789/0 conn(0x7f4cf40a66d0 legacy=0x7f4cf40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient: _finish_hunting 0 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 1 monclient: found mon.noname-d 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 1 -- 172.21.15.181:0/1876021263 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf41464e0 con 0x7f4cf413f9a0 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient: _finish_auth 0 2024-09-13T10:32:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient: _check_auth_tickets 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 1 -- 172.21.15.181:0/1876021263 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4cec001e50 con 0x7f4cf413f9a0 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient: dump: 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.355 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.355 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.355 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.355 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.355 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.355 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.355 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.355 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cfbe9c640 5 monclient: authenticate success, global_id 5010 2024-09-13T10:32:27.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cfbe9c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 1 -- 172.21.15.181:0/1876021263 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4cec004c20 con 0x7f4cf413f9a0 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cfbe9c640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 1 -- 172.21.15.181:0/1876021263 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4cec005150 con 0x7f4cf413f9a0 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cfbe9c640 4 set_mon_vals no callback set 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cf8c36640 10 monclient: dump: 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cfbe9c640 10 monclient: shutdown 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cfbe9c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1876021263 >> v1:172.21.15.181:6792/0 conn(0x7f4cf413f9a0 legacy=0x7f4cf4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1876021263 shutdown_connections 2024-09-13T10:32:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.347+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1876021263 >> 172.21.15.181:0/1876021263 conn(0x7f4cf40abcd0 msgr2=0x7f4cf40ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.348+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1876021263 shutdown_connections 2024-09-13T10:32:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.348+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1876021263 wait complete. 2024-09-13T10:32:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.348+0000 7f4cfbe9c640 10 monclient: build_initial_monmap 2024-09-13T10:32:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.348+0000 7f4cfbe9c640 10 monclient: monmap: 2024-09-13T10:32:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.348+0000 7f4cfbe9c640 1 Processor -- start 2024-09-13T10:32:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.348+0000 7f4cfbe9c640 1 -- start start 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.348+0000 7f4cfbe9c640 10 monclient: init 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.349+0000 7f4cfbe9c640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.349+0000 7f4cfbe9c640 10 monclient: _add_conns ranks=[1,5,8,3,4,7,2,0,6] 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.349+0000 7f4cfbe9c640 10 monclient(hunting): picked mon.noname-f con 0x7f4cf40a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.349+0000 7f4cfbe9c640 10 monclient(hunting): picked mon.noname-h con 0x7f4cf40a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.349+0000 7f4cfbe9c640 10 monclient(hunting): picked mon.noname-e con 0x7f4cf413f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.349+0000 7f4cfbe9c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf413cf60 con 0x7f4cf40a66d0 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.349+0000 7f4cfbe9c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf4068a50 con 0x7f4cf40a6ab0 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.349+0000 7f4cfbe9c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf413ea20 con 0x7f4cf413f9a0 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.349+0000 7f4cfbe9c640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.349+0000 7f4cfbe9c640 10 monclient(hunting): authenticate will time out at 886.855373s 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.349+0000 7f4cfa439640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f4cf413f9a0 0x7f4cf41d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40448/0 (socket says 172.21.15.181:40448) 2024-09-13T10:32:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.349+0000 7f4cfa439640 1 -- 172.21.15.181:0/1303591738 learned_addr learned my addr 172.21.15.181:0/1303591738 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:27.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4cfa439640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.181:6793/0 conn(0x7f4cf413f9a0 legacy=0x7f4cf41d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4cf9c38640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.195:6789/0 conn(0x7f4cf40a66d0 legacy=0x7f4cf41ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3887756907 0 0) 0x7f4cf413ea20 con 0x7f4cf413f9a0 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): my global_id is 74240 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4cf9437640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.195:6791/0 conn(0x7f4cf40a6ab0 legacy=0x7f4cf41d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cd8003520 con 0x7f4cf413f9a0 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2662253249 0 0) 0x7f4cf413cf60 con 0x7f4cf40a66d0 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): my global_id is 55180 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf413ea20 con 0x7f4cf40a66d0 2024-09-13T10:32:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255349675 0 0) 0x7f4cf4068a50 con 0x7f4cf40a6ab0 2024-09-13T10:32:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): my global_id is 5144 2024-09-13T10:32:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf413cf60 con 0x7f4cf40a6ab0 2024-09-13T10:32:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3665401880 0 0) 0x7f4cd8003520 con 0x7f4cf413f9a0 2024-09-13T10:32:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4cf4068a50 con 0x7f4cf413f9a0 2024-09-13T10:32:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4cec0020a0 con 0x7f4cf413f9a0 2024-09-13T10:32:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): dump: 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.351+0000 7f4ce67fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 868780893 0 0) 0x7f4cf4068a50 con 0x7f4cf413f9a0 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.195:6791/0 conn(0x7f4cf40a6ab0 legacy=0x7f4cf41d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.195:6789/0 conn(0x7f4cf40a66d0 legacy=0x7f4cf41ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 1 monclient: found mon.e 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf40a2960 con 0x7f4cf413f9a0 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 10 monclient: _finish_auth 0 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4cfbe9c640 5 monclient: authenticate success, global_id 74240 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4cfbe9c640 10 monclient: _renew_subs 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4cfbe9c640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf4137600 con 0x7f4cf413f9a0 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4cfbe9c640 10 monclient: _renew_subs 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4cfbe9c640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f4cf413c550 con 0x7f4cf413f9a0 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4cec004c20 con 0x7f4cf413f9a0 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4cec005700 con 0x7f4cf413f9a0 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce7fff640 4 set_mon_vals no callback set 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.352+0000 7f4ce67fc640 10 monclient: dump: 2024-09-13T10:32:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.371 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.353+0000 7f4cfbe9c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.353+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4cdc0065c0 con 0x7f4cdc002860 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.353+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4cec011d80 con 0x7f4cf413f9a0 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.353+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(78..78 src has 1..78) ==== 3898+0+0 (unknown 1885467272 0 0) 0x7f4cec04e660 con 0x7f4cf413f9a0 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.353+0000 7f4cf9437640 10 monclient: get_auth_request con 0x7f4cd803fdc0 auth_method 0 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4cf9c38640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.181:6789/0 conn(0x7f4cdc002860 legacy=0x7f4cdc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2478723062 0 0) 0x7f4cdc0065c0 con 0x7f4cdc002860 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 10 monclient(hunting): my global_id is 54945 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf4068a50 con 0x7f4cdc002860 2024-09-13T10:32:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 375305686 0 0) 0x7f4cf4068a50 con 0x7f4cdc002860 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4cdc0065c0 con 0x7f4cdc002860 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ce8001cb0 con 0x7f4cdc002860 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 10 monclient: dump: 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1034886096 0 0) 0x7f4cdc0065c0 con 0x7f4cdc002860 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.355+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4cdc00a160 con 0x7f4cdc002860 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.356+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4ce8006870 con 0x7f4cdc002860 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.356+0000 7f4ce67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.356+0000 7f4ce67fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.356+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.181:6789/0 conn(0x7f4cdc002860 legacy=0x7f4cdc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.356+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.181:6789/0 conn(0x7f4cdc002860 legacy=0x7f4cdc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.362+0000 7f4cfbe9c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.362+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4cdc009e50 con 0x7f4cdc009110 2024-09-13T10:32:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4cf9c38640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.181:6789/0 conn(0x7f4cdc009110 legacy=0x7f4cdc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426736489 0 0) 0x7f4cdc009e50 con 0x7f4cdc009110 2024-09-13T10:32:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4ce67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4ce67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4ce67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4ce67fc640 10 monclient(hunting): my global_id is 54954 2024-09-13T10:32:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cdc0065c0 con 0x7f4cdc009110 2024-09-13T10:32:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3528191643 0 0) 0x7f4cdc0065c0 con 0x7f4cdc009110 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4cdc009e50 con 0x7f4cdc009110 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ce8003e10 con 0x7f4cdc009110 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4ce67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4ce67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.364+0000 7f4ce67fc640 10 monclient: dump: 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1775448326 0 0) 0x7f4cdc009e50 con 0x7f4cdc009110 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4cdc00c3f0 con 0x7f4cdc009110 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 944646596) 0x7f4ce8006a20 con 0x7f4cdc009110 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4ce67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4ce67fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.181:6789/0 conn(0x7f4cdc009110 legacy=0x7f4cdc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4ce67fc640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.181:6789/0 conn(0x7f4cdc009110 legacy=0x7f4cdc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:27.379 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:27.379 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:27.379 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:27.379 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:27.379 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:27.379 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 161798, 2024-09-13T10:32:27.379 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:27.379 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:27.379 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:27.379 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:27.380 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:27.381 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:27.398 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:27.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4cd803fdc0 legacy=0x7f4cd8042280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4cfbe9c640 10 monclient: shutdown 2024-09-13T10:32:27.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4cfbe9c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:27.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1303591738 >> v1:172.21.15.181:6793/0 conn(0x7f4cf413f9a0 legacy=0x7f4cf41d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4cfa439640 1 -- 172.21.15.181:0/1303591738 reap_dead start 2024-09-13T10:32:27.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4cfa439640 1 -- 172.21.15.181:0/1303591738 reap_dead start 2024-09-13T10:32:27.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1303591738 shutdown_connections 2024-09-13T10:32:27.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1303591738 >> 172.21.15.181:0/1303591738 conn(0x7f4cf40abcd0 msgr2=0x7f4cf4137d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:27.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1303591738 shutdown_connections 2024-09-13T10:32:27.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.365+0000 7f4cfbe9c640 1 -- 172.21.15.181:0/1303591738 wait complete. 2024-09-13T10:32:27.401 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:27.401 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:32:27.401 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:32:27.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.496+0000 7f7f56bab640 10 monclient: get_monmap_and_config 2024-09-13T10:32:27.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.496+0000 7f7f56bab640 10 monclient: build_initial_monmap 2024-09-13T10:32:27.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.496+0000 7f7f56bab640 10 monclient: monmap: 2024-09-13T10:32:27.499 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:27.499 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.499 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:27.498267+0000 2024-09-13T10:32:27.499 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:27.498267+0000 2024-09-13T10:32:27.499 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:27.499 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.499 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:27.500 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:27.500 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:27.500 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:27.500 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:27.500 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:27.500 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:27.500 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:27.500 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:27.500 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.497+0000 7f7f56bab640 1 Processor -- start 2024-09-13T10:32:27.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.497+0000 7f7f56bab640 1 -- start start 2024-09-13T10:32:27.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.497+0000 7f7f56bab640 10 monclient: init 2024-09-13T10:32:27.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.497+0000 7f7f56bab640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:27.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.497+0000 7f7f56bab640 10 monclient: _add_conns ranks=[0,1,3,7,4,8,5,6,2] 2024-09-13T10:32:27.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.497+0000 7f7f56bab640 10 monclient(hunting): picked mon.noname-a con 0x7f7f500a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:27.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.497+0000 7f7f56bab640 10 monclient(hunting): picked mon.noname-f con 0x7f7f500a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:27.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.497+0000 7f7f56bab640 10 monclient(hunting): picked mon.noname-g con 0x7f7f5013f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:27.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.497+0000 7f7f56bab640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f500a4bc0 con 0x7f7f500a6640 2024-09-13T10:32:27.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.498+0000 7f7f56bab640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f5013a320 con 0x7f7f500a8340 2024-09-13T10:32:27.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.498+0000 7f7f56bab640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f500a8100 con 0x7f7f5013f750 2024-09-13T10:32:27.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.498+0000 7f7f56bab640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:27.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.498+0000 7f7f56bab640 10 monclient(hunting): authenticate will time out at 887.004042s 2024-09-13T10:32:27.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.498+0000 7f7f54947640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7f500a6640 0x7f7f50139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53062/0 (socket says 172.21.15.181:53062) 2024-09-13T10:32:27.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.498+0000 7f7f54947640 1 -- 172.21.15.181:0/352620633 learned_addr learned my addr 172.21.15.181:0/352620633 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f54947640 1 -- 172.21.15.181:0/352620633 >> v1:172.21.15.181:6789/0 conn(0x7f7f500a6640 legacy=0x7f7f50139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 1 -- 172.21.15.181:0/352620633 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297613400 0 0) 0x7f7f500a4bc0 con 0x7f7f500a6640 2024-09-13T10:32:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient(hunting): my global_id is 54963 2024-09-13T10:32:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 1 -- 172.21.15.181:0/352620633 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f38003520 con 0x7f7f500a6640 2024-09-13T10:32:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f55148640 1 -- 172.21.15.181:0/352620633 >> v1:172.21.15.195:6790/0 conn(0x7f7f5013f750 legacy=0x7f7f50141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f47fff640 1 -- 172.21.15.181:0/352620633 >> v1:172.21.15.195:6789/0 conn(0x7f7f500a8340 legacy=0x7f7f50139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 1 -- 172.21.15.181:0/352620633 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3872252340 0 0) 0x7f7f38003520 con 0x7f7f500a6640 2024-09-13T10:32:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 1 -- 172.21.15.181:0/352620633 >> v1:172.21.15.195:6790/0 conn(0x7f7f5013f750 legacy=0x7f7f50141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 1 -- 172.21.15.181:0/352620633 >> v1:172.21.15.195:6789/0 conn(0x7f7f500a8340 legacy=0x7f7f50139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient: _finish_hunting 0 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 1 monclient: found mon.noname-a 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 1 -- 172.21.15.181:0/352620633 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f500a48e0 con 0x7f7f500a6640 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient: _finish_auth 0 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient: _check_auth_tickets 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 1 -- 172.21.15.181:0/352620633 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f4c001ae0 con 0x7f7f500a6640 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient: dump: 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.508 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f56bab640 5 monclient: authenticate success, global_id 54963 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f56bab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 1 -- 172.21.15.181:0/352620633 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f4c0048a0 con 0x7f7f500a6640 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 1 -- 172.21.15.181:0/352620633 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f4c004dd0 con 0x7f7f500a6640 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f56bab640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f56bab640 4 set_mon_vals no callback set 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.500+0000 7f7f477fe640 10 monclient: dump: 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.501+0000 7f7f56bab640 10 monclient: shutdown 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.501+0000 7f7f56bab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.501+0000 7f7f56bab640 1 -- 172.21.15.181:0/352620633 >> v1:172.21.15.181:6789/0 conn(0x7f7f500a6640 legacy=0x7f7f50139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.501+0000 7f7f56bab640 1 -- 172.21.15.181:0/352620633 shutdown_connections 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.501+0000 7f7f56bab640 1 -- 172.21.15.181:0/352620633 >> 172.21.15.181:0/352620633 conn(0x7f7f50077170 msgr2=0x7f7f500abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.501+0000 7f7f56bab640 1 -- 172.21.15.181:0/352620633 shutdown_connections 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.501+0000 7f7f56bab640 1 -- 172.21.15.181:0/352620633 wait complete. 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.501+0000 7f7f56bab640 10 monclient: build_initial_monmap 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.501+0000 7f7f56bab640 10 monclient: monmap: 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:27.511 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 1 Processor -- start 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 1 -- start start 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 10 monclient: init 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 10 monclient: _add_conns ranks=[7,0,3,6,8,5,1,4,2] 2024-09-13T10:32:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 10 monclient(hunting): picked mon.noname-i con 0x7f7f500a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 10 monclient(hunting): picked mon.noname-a con 0x7f7f5013f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 10 monclient(hunting): picked mon.noname-g con 0x7f7f501420c0 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f500a9c40 con 0x7f7f5013f750 2024-09-13T10:32:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f50142b60 con 0x7f7f501420c0 2024-09-13T10:32:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f5013bdb0 con 0x7f7f500a8340 2024-09-13T10:32:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f56bab640 10 monclient(hunting): authenticate will time out at 887.008912s 2024-09-13T10:32:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f47fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7f5013f750 0x7f7f501d3510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53070/0 (socket says 172.21.15.181:53070) 2024-09-13T10:32:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.502+0000 7f7f47fff640 1 -- 172.21.15.181:0/2598742266 learned_addr learned my addr 172.21.15.181:0/2598742266 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f47fff640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.181:6789/0 conn(0x7f7f5013f750 legacy=0x7f7f501d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509383157 0 0) 0x7f7f500a9c40 con 0x7f7f5013f750 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient(hunting): my global_id is 54972 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f3c003550 con 0x7f7f5013f750 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2884735932 0 0) 0x7f7f3c003550 con 0x7f7f5013f750 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f500a9c40 con 0x7f7f5013f750 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f40003610 con 0x7f7f5013f750 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient(hunting): dump: 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f54947640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.195:6792/0 conn(0x7f7f500a8340 legacy=0x7f7f5012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f55148640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.195:6790/0 conn(0x7f7f501420c0 legacy=0x7f7f501d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 394765332 0 0) 0x7f7f500a9c40 con 0x7f7f5013f750 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.195:6792/0 conn(0x7f7f500a8340 legacy=0x7f7f5012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.195:6790/0 conn(0x7f7f501420c0 legacy=0x7f7f501d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient: _finish_hunting 0 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 1 monclient: found mon.a 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5013baa0 con 0x7f7f5013f750 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient: _finish_auth 0 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient: _check_auth_tickets 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f56bab640 5 monclient: authenticate success, global_id 54972 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f56bab640 10 monclient: _renew_subs 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f56bab640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f56bab640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5013ae50 con 0x7f7f5013f750 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f56bab640 10 monclient: _renew_subs 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f56bab640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f56bab640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7f5012cff0 con 0x7f7f5013f750 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f40003c80 con 0x7f7f5013f750 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f400041b0 con 0x7f7f5013f750 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f46ffd640 4 set_mon_vals no callback set 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.505+0000 7f7f457fa640 10 monclient: dump: 2024-09-13T10:32:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.506+0000 7f7f56bab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.506+0000 7f7f56bab640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7f300065c0 con 0x7f7f30002860 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.506+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7f40011ca0 con 0x7f7f5013f750 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.506+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(78..78 src has 1..78) ==== 3898+0+0 (unknown 1885467272 0 0) 0x7f7f4004e540 con 0x7f7f5013f750 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.507+0000 7f7f55148640 10 monclient: get_auth_request con 0x7f7f3c03fb10 auth_method 0 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.508+0000 7f7f54947640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.181:6790/0 conn(0x7f7f30002860 legacy=0x7f7f30004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.508+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448298221 0 0) 0x7f7f300065c0 con 0x7f7f30002860 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.508+0000 7f7f457fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.508+0000 7f7f457fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.508+0000 7f7f457fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.508+0000 7f7f457fa640 10 monclient(hunting): my global_id is 64577 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.508+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f500a9c40 con 0x7f7f30002860 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2745229273 0 0) 0x7f7f500a9c40 con 0x7f7f30002860 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f300065c0 con 0x7f7f30002860 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f4c004b20 con 0x7f7f30002860 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 10 monclient: dump: 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2153112983 0 0) 0x7f7f300065c0 con 0x7f7f30002860 2024-09-13T10:32:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f3000a160 con 0x7f7f30002860 2024-09-13T10:32:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7f4c001990 con 0x7f7f30002860 2024-09-13T10:32:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.181:6790/0 conn(0x7f7f30002860 legacy=0x7f7f30004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.509+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.181:6790/0 conn(0x7f7f30002860 legacy=0x7f7f30004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:27.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.515+0000 7f7f56bab640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:27.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.515+0000 7f7f56bab640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7f30009e50 con 0x7f7f30009110 2024-09-13T10:32:27.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.517+0000 7f7f54947640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.181:6790/0 conn(0x7f7f30009110 legacy=0x7f7f300095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2016781692 0 0) 0x7f7f30009e50 con 0x7f7f30009110 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 10 monclient(hunting): my global_id is 64586 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f300065c0 con 0x7f7f30009110 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2891636939 0 0) 0x7f7f300065c0 con 0x7f7f30009110 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f30009e50 con 0x7f7f30009110 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f4c005450 con 0x7f7f30009110 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 10 monclient: dump: 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.528 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2053140180 0 0) 0x7f7f30009e50 con 0x7f7f30009110 2024-09-13T10:32:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7f3000c3a0 con 0x7f7f30009110 2024-09-13T10:32:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 3759430844) 0x7f7f4c007d90 con 0x7f7f30009110 2024-09-13T10:32:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.181:6790/0 conn(0x7f7f30009110 legacy=0x7f7f300095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.518+0000 7f7f457fa640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.181:6790/0 conn(0x7f7f30009110 legacy=0x7f7f300095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:27.529 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:27.529 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:27.529 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:27.529 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 73423, 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:27.530 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:27.531 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:27.532 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:27.533 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:27.534 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.536 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.537 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.539 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:27.548 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:27.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.519+0000 7f7f56bab640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7f3c03fb10 legacy=0x7f7f3c041fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.519+0000 7f7f56bab640 10 monclient: shutdown 2024-09-13T10:32:27.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.519+0000 7f7f56bab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:27.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.519+0000 7f7f56bab640 1 -- 172.21.15.181:0/2598742266 >> v1:172.21.15.181:6789/0 conn(0x7f7f5013f750 legacy=0x7f7f501d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.519+0000 7f7f55148640 1 -- 172.21.15.181:0/2598742266 reap_dead start 2024-09-13T10:32:27.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.519+0000 7f7f55148640 1 -- 172.21.15.181:0/2598742266 reap_dead start 2024-09-13T10:32:27.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.519+0000 7f7f56bab640 1 -- 172.21.15.181:0/2598742266 shutdown_connections 2024-09-13T10:32:27.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.519+0000 7f7f56bab640 1 -- 172.21.15.181:0/2598742266 >> 172.21.15.181:0/2598742266 conn(0x7f7f500a6640 msgr2=0x7f7f500a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:27.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.519+0000 7f7f56bab640 1 -- 172.21.15.181:0/2598742266 shutdown_connections 2024-09-13T10:32:27.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.519+0000 7f7f56bab640 1 -- 172.21.15.181:0/2598742266 wait complete. 2024-09-13T10:32:27.550 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:27.551 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:32:27.551 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:32:27.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.657+0000 7f378a375640 10 monclient: get_monmap_and_config 2024-09-13T10:32:27.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.657+0000 7f378a375640 10 monclient: build_initial_monmap 2024-09-13T10:32:27.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.657+0000 7f378a375640 10 monclient: monmap: 2024-09-13T10:32:27.660 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:27.660 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.660 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:27.659374+0000 2024-09-13T10:32:27.660 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:27.659374+0000 2024-09-13T10:32:27.660 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:27.660 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:27.661 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.658+0000 7f378a375640 1 Processor -- start 2024-09-13T10:32:27.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.658+0000 7f378a375640 1 -- start start 2024-09-13T10:32:27.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.658+0000 7f378a375640 10 monclient: init 2024-09-13T10:32:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.659+0000 7f378a375640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.659+0000 7f378a375640 10 monclient: _add_conns ranks=[0,7,6,4,3,1,5,2,8] 2024-09-13T10:32:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.659+0000 7f378a375640 10 monclient(hunting): picked mon.noname-a con 0x7f37840a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.659+0000 7f378a375640 10 monclient(hunting): picked mon.noname-i con 0x7f37840a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.659+0000 7f378a375640 10 monclient(hunting): picked mon.noname-d con 0x7f378413f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.659+0000 7f378a375640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37840a5fe0 con 0x7f37840a66d0 2024-09-13T10:32:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.659+0000 7f378a375640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37840a8080 con 0x7f378413f9a0 2024-09-13T10:32:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.659+0000 7f378a375640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37840a42c0 con 0x7f37840a6ab0 2024-09-13T10:32:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.659+0000 7f378a375640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.659+0000 7f378a375640 10 monclient(hunting): authenticate will time out at 887.165203s 2024-09-13T10:32:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.659+0000 7f3783fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f37840a66d0 0x7f37840a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53082/0 (socket says 172.21.15.181:53082) 2024-09-13T10:32:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.659+0000 7f3783fff640 1 -- 172.21.15.181:0/1188963939 learned_addr learned my addr 172.21.15.181:0/1188963939 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:27.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3783fff640 1 -- 172.21.15.181:0/1188963939 >> v1:172.21.15.181:6789/0 conn(0x7f37840a66d0 legacy=0x7f37840a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3788912640 1 -- 172.21.15.181:0/1188963939 >> v1:172.21.15.181:6792/0 conn(0x7f378413f9a0 legacy=0x7f3784141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f37837fe640 1 -- 172.21.15.181:0/1188963939 >> v1:172.21.15.195:6792/0 conn(0x7f37840a6ab0 legacy=0x7f37840a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 835588091 0 0) 0x7f37840a5fe0 con 0x7f37840a66d0 2024-09-13T10:32:27.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient(hunting): my global_id is 54981 2024-09-13T10:32:27.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f376c003520 con 0x7f37840a66d0 2024-09-13T10:32:27.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1071320913 0 0) 0x7f37840a8080 con 0x7f378413f9a0 2024-09-13T10:32:27.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient(hunting): my global_id is 5019 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37840a5fe0 con 0x7f378413f9a0 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4203944180 0 0) 0x7f37840a42c0 con 0x7f37840a6ab0 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient(hunting): my global_id is 55096 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37840a8080 con 0x7f37840a6ab0 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2234129759 0 0) 0x7f376c003520 con 0x7f37840a66d0 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 >> v1:172.21.15.195:6792/0 conn(0x7f37840a6ab0 legacy=0x7f37840a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 >> v1:172.21.15.181:6792/0 conn(0x7f378413f9a0 legacy=0x7f3784141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 1 monclient: found mon.noname-a 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37841464e0 con 0x7f37840a66d0 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient: _finish_auth 0 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f378a375640 5 monclient: authenticate success, global_id 54981 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3774001ad0 con 0x7f37840a66d0 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f378a375640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f3782ffd640 10 monclient: dump: 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.661+0000 7f378a375640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f37740048a0 con 0x7f37840a66d0 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f3782ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f3782ffd640 1 -- 172.21.15.181:0/1188963939 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3774004dd0 con 0x7f37840a66d0 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f378a375640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f378a375640 4 set_mon_vals no callback set 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f3782ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f3782ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f3782ffd640 10 monclient: dump: 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f378a375640 10 monclient: shutdown 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f378a375640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f378a375640 1 -- 172.21.15.181:0/1188963939 >> v1:172.21.15.181:6789/0 conn(0x7f37840a66d0 legacy=0x7f37840a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f378a375640 1 -- 172.21.15.181:0/1188963939 shutdown_connections 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f378a375640 1 -- 172.21.15.181:0/1188963939 >> 172.21.15.181:0/1188963939 conn(0x7f37840abcd0 msgr2=0x7f37840ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f378a375640 1 -- 172.21.15.181:0/1188963939 shutdown_connections 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.662+0000 7f378a375640 1 -- 172.21.15.181:0/1188963939 wait complete. 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.663+0000 7f378a375640 10 monclient: build_initial_monmap 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.663+0000 7f378a375640 10 monclient: monmap: 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.663+0000 7f378a375640 1 Processor -- start 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.663+0000 7f378a375640 1 -- start start 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.663+0000 7f378a375640 10 monclient: init 2024-09-13T10:32:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.664+0000 7f378a375640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.664+0000 7f378a375640 10 monclient: _add_conns ranks=[5,1,6,0,7,2,4,3,8] 2024-09-13T10:32:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.664+0000 7f378a375640 10 monclient(hunting): picked mon.noname-h con 0x7f37840a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.664+0000 7f378a375640 10 monclient(hunting): picked mon.noname-f con 0x7f37840a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.664+0000 7f378a375640 10 monclient(hunting): picked mon.noname-d con 0x7f378413f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.664+0000 7f378a375640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3784068ca0 con 0x7f37840a6ab0 2024-09-13T10:32:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.664+0000 7f378a375640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378413cf30 con 0x7f37840a66d0 2024-09-13T10:32:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.664+0000 7f378a375640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378413f290 con 0x7f378413f9a0 2024-09-13T10:32:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.664+0000 7f378a375640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.664+0000 7f378a375640 10 monclient(hunting): authenticate will time out at 887.170345s 2024-09-13T10:32:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.664+0000 7f3788912640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f378413f9a0 0x7f37841d6e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46504/0 (socket says 172.21.15.181:46504) 2024-09-13T10:32:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.664+0000 7f3788912640 1 -- 172.21.15.181:0/1492845145 learned_addr learned my addr 172.21.15.181:0/1492845145 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3788912640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.181:6792/0 conn(0x7f378413f9a0 legacy=0x7f37841d6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f37837fe640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.195:6789/0 conn(0x7f37840a6ab0 legacy=0x7f37841d3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3783fff640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.195:6791/0 conn(0x7f37840a66d0 legacy=0x7f37841ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074770271 0 0) 0x7f378413f290 con 0x7f378413f9a0 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 10 monclient(hunting): my global_id is 5028 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3770003520 con 0x7f378413f9a0 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899049451 0 0) 0x7f3784068ca0 con 0x7f37840a6ab0 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 10 monclient(hunting): my global_id is 55198 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f378413f290 con 0x7f37840a6ab0 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1336662541 0 0) 0x7f378413cf30 con 0x7f37840a66d0 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 10 monclient(hunting): my global_id is 5153 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.666+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3784068ca0 con 0x7f37840a66d0 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 446227334 0 0) 0x7f3770003520 con 0x7f378413f9a0 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f378413cf30 con 0x7f378413f9a0 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f377c003990 con 0x7f378413f9a0 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 803037491 0 0) 0x7f378413f290 con 0x7f37840a6ab0 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3770003520 con 0x7f37840a6ab0 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3778001bb0 con 0x7f37840a6ab0 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 396032740 0 0) 0x7f3784068ca0 con 0x7f37840a66d0 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f378413f290 con 0x7f37840a66d0 2024-09-13T10:32:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3774004d90 con 0x7f37840a66d0 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3106639893 0 0) 0x7f378413cf30 con 0x7f378413f9a0 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.195:6791/0 conn(0x7f37840a66d0 legacy=0x7f37841ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.195:6789/0 conn(0x7f37840a6ab0 legacy=0x7f37841d3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 monclient: found mon.d 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378413e9f0 con 0x7f378413f9a0 2024-09-13T10:32:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient: _finish_auth 0 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f378a375640 5 monclient: authenticate success, global_id 5028 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f378a375640 10 monclient: _renew_subs 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f378a375640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f378a375640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f37840a2880 con 0x7f378413f9a0 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f378a375640 10 monclient: _renew_subs 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f378a375640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f378a375640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f378413c450 con 0x7f378413f9a0 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f377c003e50 con 0x7f378413f9a0 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f377c004340 con 0x7f378413f9a0 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f37827fc640 4 set_mon_vals no callback set 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.667+0000 7f3780ff9640 10 monclient: dump: 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.668+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f377c0044e0 con 0x7f378413f9a0 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.668+0000 7f378a375640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.668+0000 7f378a375640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f37640065c0 con 0x7f3764002860 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.668+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(79..79 src has 1..79) ==== 3898+0+0 (unknown 2573287606 0 0) 0x7f377c04e660 con 0x7f378413f9a0 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.668+0000 7f37837fe640 10 monclient: get_auth_request con 0x7f3770040550 auth_method 0 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.670+0000 7f3783fff640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.181:6791/0 conn(0x7f3764002860 legacy=0x7f3764004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.670+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3746118408 0 0) 0x7f37640065c0 con 0x7f3764002860 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.670+0000 7f3780ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.670+0000 7f3780ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.670+0000 7f3780ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.670+0000 7f3780ff9640 10 monclient(hunting): my global_id is 5134 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.670+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f378413cf30 con 0x7f3764002860 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3444328779 0 0) 0x7f378413cf30 con 0x7f3764002860 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f37640065c0 con 0x7f3764002860 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f37740048a0 con 0x7f3764002860 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 10 monclient: dump: 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1137445093 0 0) 0x7f37640065c0 con 0x7f3764002860 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f376400a160 con 0x7f3764002860 2024-09-13T10:32:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3774005450 con 0x7f3764002860 2024-09-13T10:32:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.181:6791/0 conn(0x7f3764002860 legacy=0x7f3764004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.671+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.181:6791/0 conn(0x7f3764002860 legacy=0x7f3764004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:27.692 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:27.692 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36631]: starting. 2024-09-13T10:32:27.693 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36631]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36596 2024-09-13T10:32:27.693 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36631]: created object 0... 2024-09-13T10:32:27.693 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36631]: created object 25... 2024-09-13T10:32:27.693 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36631]: created object 49... 2024-09-13T10:32:27.693 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36631]: finishing. 2024-09-13T10:32:27.693 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36631]: shutting down. 2024-09-13T10:32:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.677+0000 7f378a375640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.678+0000 7f378a375640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3764009e50 con 0x7f3764009110 2024-09-13T10:32:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3783fff640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.181:6791/0 conn(0x7f3764009110 legacy=0x7f37640095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2618567415 0 0) 0x7f3764009e50 con 0x7f3764009110 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 10 monclient(hunting): my global_id is 5143 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37640065c0 con 0x7f3764009110 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1416978930 0 0) 0x7f37640065c0 con 0x7f3764009110 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3764009e50 con 0x7f3764009110 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3774005c10 con 0x7f3764009110 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 10 monclient: dump: 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.696 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.697 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 54477008 0 0) 0x7f3764009e50 con 0x7f3764009110 2024-09-13T10:32:27.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f376400c3a0 con 0x7f3764009110 2024-09-13T10:32:27.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 1718846398) 0x7f3774006020 con 0x7f3764009110 2024-09-13T10:32:27.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:27.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:27.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.680+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.181:6791/0 conn(0x7f3764009110 legacy=0x7f37640095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.681+0000 7f3780ff9640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.181:6791/0 conn(0x7f3764009110 legacy=0x7f37640095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:27.697 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 162130, 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:27.717 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:27.718 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:27.718 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36633]: starting. 2024-09-13T10:32:27.718 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36633]: listing objects. 2024-09-13T10:32:27.719 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36633]: listed object 0... 2024-09-13T10:32:27.719 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36633]: listed object 25... 2024-09-13T10:32:27.719 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36633]: saw 50 objects 2024-09-13T10:32:27.719 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36633]: shutting down. 2024-09-13T10:32:27.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.681+0000 7f378a375640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3770040550 legacy=0x7f3770042a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.681+0000 7f378a375640 10 monclient: shutdown 2024-09-13T10:32:27.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.681+0000 7f378a375640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:27.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.681+0000 7f378a375640 1 -- 172.21.15.181:0/1492845145 >> v1:172.21.15.181:6792/0 conn(0x7f378413f9a0 legacy=0x7f37841d6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.681+0000 7f3788912640 1 -- 172.21.15.181:0/1492845145 reap_dead start 2024-09-13T10:32:27.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.681+0000 7f3788912640 1 -- 172.21.15.181:0/1492845145 reap_dead start 2024-09-13T10:32:27.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.681+0000 7f378a375640 1 -- 172.21.15.181:0/1492845145 shutdown_connections 2024-09-13T10:32:27.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.681+0000 7f378a375640 1 -- 172.21.15.181:0/1492845145 >> 172.21.15.181:0/1492845145 conn(0x7f37840abcd0 msgr2=0x7f37840a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:27.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.681+0000 7f378a375640 1 -- 172.21.15.181:0/1492845145 shutdown_connections 2024-09-13T10:32:27.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.681+0000 7f378a375640 1 -- 172.21.15.181:0/1492845145 wait complete. 2024-09-13T10:32:27.720 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:27.721 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:32:27.721 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:32:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.816+0000 7f4baeef7640 10 monclient: get_monmap_and_config 2024-09-13T10:32:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.816+0000 7f4baeef7640 10 monclient: build_initial_monmap 2024-09-13T10:32:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.816+0000 7f4baeef7640 10 monclient: monmap: 2024-09-13T10:32:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:27.818384+0000 2024-09-13T10:32:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:27.818384+0000 2024-09-13T10:32:27.819 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:27.820 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:27.820 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.817+0000 7f4baeef7640 1 Processor -- start 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.817+0000 7f4baeef7640 1 -- start start 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.817+0000 7f4baeef7640 10 monclient: init 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.818+0000 7f4baeef7640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.818+0000 7f4baeef7640 10 monclient: _add_conns ranks=[5,7,2,8,6,4,1,3,0] 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.818+0000 7f4baeef7640 10 monclient(hunting): picked mon.noname-h con 0x7f4ba80a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.818+0000 7f4baeef7640 10 monclient(hunting): picked mon.noname-i con 0x7f4ba80a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.818+0000 7f4baeef7640 10 monclient(hunting): picked mon.noname-b con 0x7f4ba813f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.818+0000 7f4baeef7640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba80a4bc0 con 0x7f4ba813f750 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.818+0000 7f4baeef7640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba813a320 con 0x7f4ba80a6640 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.818+0000 7f4baeef7640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba80a8100 con 0x7f4ba80a8340 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.818+0000 7f4baeef7640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.818+0000 7f4baeef7640 10 monclient(hunting): authenticate will time out at 887.324230s 2024-09-13T10:32:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.818+0000 7f4bad494640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f4ba813f750 0x7f4ba8141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:39286/0 (socket says 172.21.15.181:39286) 2024-09-13T10:32:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.818+0000 7f4bad494640 1 -- 172.21.15.181:0/508944497 learned_addr learned my addr 172.21.15.181:0/508944497 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4bad494640 1 -- 172.21.15.181:0/508944497 >> v1:172.21.15.181:6790/0 conn(0x7f4ba813f750 legacy=0x7f4ba8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9ffff640 1 -- 172.21.15.181:0/508944497 >> v1:172.21.15.195:6792/0 conn(0x7f4ba80a8340 legacy=0x7f4ba8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4bacc93640 1 -- 172.21.15.181:0/508944497 >> v1:172.21.15.195:6791/0 conn(0x7f4ba80a6640 legacy=0x7f4ba8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703951845 0 0) 0x7f4ba80a4bc0 con 0x7f4ba813f750 2024-09-13T10:32:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient(hunting): my global_id is 64595 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b90003520 con 0x7f4ba813f750 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3813062158 0 0) 0x7f4ba80a8100 con 0x7f4ba80a8340 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient(hunting): my global_id is 55105 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ba80a4bc0 con 0x7f4ba80a8340 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127787885 0 0) 0x7f4ba813a320 con 0x7f4ba80a6640 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient(hunting): my global_id is 5162 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ba80a8100 con 0x7f4ba80a6640 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3548516242 0 0) 0x7f4b90003520 con 0x7f4ba813f750 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 >> v1:172.21.15.195:6792/0 conn(0x7f4ba80a8340 legacy=0x7f4ba8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 >> v1:172.21.15.195:6791/0 conn(0x7f4ba80a6640 legacy=0x7f4ba8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 1 monclient: found mon.noname-b 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba80a48e0 con 0x7f4ba813f750 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:32:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ba0001e60 con 0x7f4ba813f750 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4b9f7fe640 10 monclient: dump: 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4baeef7640 5 monclient: authenticate success, global_id 64595 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.820+0000 7f4baeef7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ba0004c20 con 0x7f4ba813f750 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4b9f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4b9f7fe640 1 -- 172.21.15.181:0/508944497 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ba0005190 con 0x7f4ba813f750 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4baeef7640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4baeef7640 4 set_mon_vals no callback set 2024-09-13T10:32:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4b9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4b9f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4b9f7fe640 10 monclient: dump: 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.831 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4baeef7640 10 monclient: shutdown 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4baeef7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4baeef7640 1 -- 172.21.15.181:0/508944497 >> v1:172.21.15.181:6790/0 conn(0x7f4ba813f750 legacy=0x7f4ba8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4baeef7640 1 -- 172.21.15.181:0/508944497 shutdown_connections 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4baeef7640 1 -- 172.21.15.181:0/508944497 >> 172.21.15.181:0/508944497 conn(0x7f4ba8077170 msgr2=0x7f4ba80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4baeef7640 1 -- 172.21.15.181:0/508944497 shutdown_connections 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.821+0000 7f4baeef7640 1 -- 172.21.15.181:0/508944497 wait complete. 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.822+0000 7f4baeef7640 10 monclient: build_initial_monmap 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.822+0000 7f4baeef7640 10 monclient: monmap: 2024-09-13T10:32:27.832 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:27.833 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.822+0000 7f4baeef7640 1 Processor -- start 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.822+0000 7f4baeef7640 1 -- start start 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.822+0000 7f4baeef7640 10 monclient: init 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4baeef7640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4baeef7640 10 monclient: _add_conns ranks=[4,8,2,6,0,7,5,3,1] 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4baeef7640 10 monclient(hunting): picked mon.noname-c con 0x7f4ba80a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4baeef7640 10 monclient(hunting): picked mon.noname-e con 0x7f4ba813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4baeef7640 10 monclient(hunting): picked mon.noname-b con 0x7f4ba813cdb0 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4baeef7640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba8134d90 con 0x7f4ba813cdb0 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4baeef7640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba813e760 con 0x7f4ba80a8340 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4baeef7640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba8134ab0 con 0x7f4ba813f750 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4baeef7640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4baeef7640 10 monclient(hunting): authenticate will time out at 887.329286s 2024-09-13T10:32:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4bad494640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f4ba813cdb0 0x7f4ba81d6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:39294/0 (socket says 172.21.15.181:39294) 2024-09-13T10:32:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4bacc93640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f4ba80a8340 0x7f4ba812f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:34080/0 (socket says 172.21.15.181:34080) 2024-09-13T10:32:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.823+0000 7f4bad494640 1 -- 172.21.15.181:0/3939829818 learned_addr learned my addr 172.21.15.181:0/3939829818 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:27.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4bacc93640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.181:6791/0 conn(0x7f4ba80a8340 legacy=0x7f4ba812f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4bad494640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.181:6790/0 conn(0x7f4ba813cdb0 legacy=0x7f4ba81d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9ffff640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.181:6793/0 conn(0x7f4ba813f750 legacy=0x7f4ba812fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864857418 0 0) 0x7f4ba813e760 con 0x7f4ba80a8340 2024-09-13T10:32:27.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): my global_id is 5152 2024-09-13T10:32:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b94003550 con 0x7f4ba80a8340 2024-09-13T10:32:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1394841957 0 0) 0x7f4ba8134ab0 con 0x7f4ba813f750 2024-09-13T10:32:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): my global_id is 74249 2024-09-13T10:32:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ba813e760 con 0x7f4ba813f750 2024-09-13T10:32:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552421399 0 0) 0x7f4ba8134d90 con 0x7f4ba813cdb0 2024-09-13T10:32:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): my global_id is 64604 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ba8134ab0 con 0x7f4ba813cdb0 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4200027326 0 0) 0x7f4b94003550 con 0x7f4ba80a8340 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ba8134d90 con 0x7f4ba80a8340 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ba4003610 con 0x7f4ba80a8340 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): dump: 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.825+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2231160986 0 0) 0x7f4ba813e760 con 0x7f4ba813f750 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b94003550 con 0x7f4ba813f750 2024-09-13T10:32:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3037802205 0 0) 0x7f4ba8134ab0 con 0x7f4ba813cdb0 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ba813e760 con 0x7f4ba813cdb0 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b98003610 con 0x7f4ba813f750 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient(hunting): dump: 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ba00020b0 con 0x7f4ba813cdb0 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient(hunting): dump: 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 698660017 0 0) 0x7f4ba8134d90 con 0x7f4ba80a8340 2024-09-13T10:32:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.181:6793/0 conn(0x7f4ba813f750 legacy=0x7f4ba812fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.181:6790/0 conn(0x7f4ba813cdb0 legacy=0x7f4ba81d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 1 monclient: found mon.c 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba813e070 con 0x7f4ba80a8340 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient: _finish_auth 0 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4baeef7640 5 monclient: authenticate success, global_id 5152 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4baeef7640 10 monclient: _renew_subs 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4baeef7640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4baeef7640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba813e2f0 con 0x7f4ba80a8340 2024-09-13T10:32:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4baeef7640 10 monclient: _renew_subs 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4baeef7640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4baeef7640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f4ba81d8040 con 0x7f4ba80a8340 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ba4003b90 con 0x7f4ba80a8340 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ba40040c0 con 0x7f4ba80a8340 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9d7fa640 10 monclient: dump: 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.826+0000 7f4b9effd640 4 set_mon_vals no callback set 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.827+0000 7f4baeef7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.827+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4ba4004260 con 0x7f4ba80a8340 2024-09-13T10:32:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.827+0000 7f4baeef7640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4ba80a9cb0 con 0x7f4ba8077170 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.827+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(79..79 src has 1..79) ==== 3898+0+0 (unknown 2573287606 0 0) 0x7f4ba404e380 con 0x7f4ba80a8340 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.827+0000 7f4bad494640 10 monclient: get_auth_request con 0x7f4b94040910 auth_method 0 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9ffff640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.181:6792/0 conn(0x7f4ba8077170 legacy=0x7f4ba813fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1855158591 0 0) 0x7f4ba80a9cb0 con 0x7f4ba8077170 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 10 monclient(hunting): my global_id is 5037 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ba8134d90 con 0x7f4ba8077170 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2141686094 0 0) 0x7f4ba8134d90 con 0x7f4ba8077170 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ba80a9cb0 con 0x7f4ba8077170 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b98003d20 con 0x7f4ba8077170 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 10 monclient: dump: 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.851 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3925459949 0 0) 0x7f4ba80a9cb0 con 0x7f4ba8077170 2024-09-13T10:32:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.829+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ba813d1c0 con 0x7f4ba8077170 2024-09-13T10:32:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.830+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4b98003ff0 con 0x7f4ba8077170 2024-09-13T10:32:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.830+0000 7f4b9d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.830+0000 7f4b9d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.830+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.181:6792/0 conn(0x7f4ba8077170 legacy=0x7f4ba813fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.830+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.181:6792/0 conn(0x7f4ba8077170 legacy=0x7f4ba813fb30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.836+0000 7f4baeef7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.836+0000 7f4baeef7640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4ba8050c40 con 0x7f4ba8069b40 2024-09-13T10:32:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.838+0000 7f4b9ffff640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.181:6792/0 conn(0x7f4ba8069b40 legacy=0x7f4ba8140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.838+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766962923 0 0) 0x7f4ba8050c40 con 0x7f4ba8069b40 2024-09-13T10:32:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.838+0000 7f4b9d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.838+0000 7f4b9d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.838+0000 7f4b9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.838+0000 7f4b9d7fa640 10 monclient(hunting): my global_id is 5046 2024-09-13T10:32:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.838+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ba80a9cb0 con 0x7f4ba8069b40 2024-09-13T10:32:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.838+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1633699567 0 0) 0x7f4ba80a9cb0 con 0x7f4ba8069b40 2024-09-13T10:32:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ba8050c40 con 0x7f4ba8069b40 2024-09-13T10:32:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b98004420 con 0x7f4ba8069b40 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4b9d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4b9d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4b9d7fa640 10 monclient: dump: 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.854 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.855 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.855 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.855 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.855 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.855 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 188057808 0 0) 0x7f4ba8050c40 con 0x7f4ba8069b40 2024-09-13T10:32:27.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4ba8143260 con 0x7f4ba8069b40 2024-09-13T10:32:27.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 3061195750) 0x7f4b98007bc0 con 0x7f4ba8069b40 2024-09-13T10:32:27.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4b9d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:27.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4b9d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:27.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.181:6792/0 conn(0x7f4ba8069b40 legacy=0x7f4ba8140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4b9d7fa640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.181:6792/0 conn(0x7f4ba8069b40 legacy=0x7f4ba8140240 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:27.856 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 162283, 2024-09-13T10:32:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.871 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:27.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:27.874 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:27.875 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:27.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:27.875 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:27.875 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4baeef7640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4b94040910 legacy=0x7f4b94042dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4baeef7640 10 monclient: shutdown 2024-09-13T10:32:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4baeef7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4baeef7640 1 -- 172.21.15.181:0/3939829818 >> v1:172.21.15.181:6791/0 conn(0x7f4ba80a8340 legacy=0x7f4ba812f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4bad494640 1 -- 172.21.15.181:0/3939829818 reap_dead start 2024-09-13T10:32:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4bad494640 1 -- 172.21.15.181:0/3939829818 reap_dead start 2024-09-13T10:32:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4baeef7640 1 -- 172.21.15.181:0/3939829818 shutdown_connections 2024-09-13T10:32:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4baeef7640 1 -- 172.21.15.181:0/3939829818 >> 172.21.15.181:0/3939829818 conn(0x7f4ba80a6640 msgr2=0x7f4ba80a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4baeef7640 1 -- 172.21.15.181:0/3939829818 shutdown_connections 2024-09-13T10:32:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.839+0000 7f4baeef7640 1 -- 172.21.15.181:0/3939829818 wait complete. 2024-09-13T10:32:27.877 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:27.877 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:32:27.877 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:32:27.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.973+0000 7f44d9db4640 10 monclient: get_monmap_and_config 2024-09-13T10:32:27.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.973+0000 7f44d9db4640 10 monclient: build_initial_monmap 2024-09-13T10:32:27.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.973+0000 7f44d9db4640 10 monclient: monmap: 2024-09-13T10:32:27.976 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:27.976 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.976 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:27.975381+0000 2024-09-13T10:32:27.976 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:27.975381+0000 2024-09-13T10:32:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:27.977 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:27.977 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.974+0000 7f44d9db4640 1 Processor -- start 2024-09-13T10:32:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.974+0000 7f44d9db4640 1 -- start start 2024-09-13T10:32:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.974+0000 7f44d9db4640 10 monclient: init 2024-09-13T10:32:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.975+0000 7f44d9db4640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.975+0000 7f44d9db4640 10 monclient: _add_conns ranks=[5,1,3,0,4,7,6,8,2] 2024-09-13T10:32:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.975+0000 7f44d9db4640 10 monclient(hunting): picked mon.noname-h con 0x7f44d4070b10 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.975+0000 7f44d9db4640 10 monclient(hunting): picked mon.noname-f con 0x7f44d4071600 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.975+0000 7f44d9db4640 10 monclient(hunting): picked mon.noname-g con 0x7f44d413cbe0 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.975+0000 7f44d9db4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d40a1cc0 con 0x7f44d4071600 2024-09-13T10:32:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.975+0000 7f44d9db4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d40722b0 con 0x7f44d413cbe0 2024-09-13T10:32:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.975+0000 7f44d9db4640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d4072590 con 0x7f44d4070b10 2024-09-13T10:32:27.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.975+0000 7f44d9db4640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:27.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.975+0000 7f44d9db4640 10 monclient(hunting): authenticate will time out at 887.481186s 2024-09-13T10:32:27.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.975+0000 7f44d3fff640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f44d413cbe0 0x7f44d413efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:60736/0 (socket says 172.21.15.181:60736) 2024-09-13T10:32:27.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.975+0000 7f44d3fff640 1 -- 172.21.15.181:0/1648644814 learned_addr learned my addr 172.21.15.181:0/1648644814 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.977+0000 7f44d3fff640 1 -- 172.21.15.181:0/1648644814 >> v1:172.21.15.195:6790/0 conn(0x7f44d413cbe0 legacy=0x7f44d413efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.977+0000 7f44d37fe640 1 -- 172.21.15.181:0/1648644814 >> v1:172.21.15.195:6791/0 conn(0x7f44d4070b10 legacy=0x7f44d4070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.977+0000 7f44d2ffd640 1 -- 172.21.15.181:0/1648644814 >> v1:172.21.15.195:6789/0 conn(0x7f44d4071600 legacy=0x7f44d413b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.977+0000 7f44d27fc640 1 -- 172.21.15.181:0/1648644814 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 132740097 0 0) 0x7f44d40722b0 con 0x7f44d413cbe0 2024-09-13T10:32:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.977+0000 7f44d27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.977+0000 7f44d27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.977+0000 7f44d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.977+0000 7f44d27fc640 10 monclient(hunting): my global_id is 5052 2024-09-13T10:32:27.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.977+0000 7f44d27fc640 1 -- 172.21.15.181:0/1648644814 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44bc003520 con 0x7f44d413cbe0 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 1 -- 172.21.15.181:0/1648644814 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3183230503 0 0) 0x7f44bc003520 con 0x7f44d413cbe0 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 1 -- 172.21.15.181:0/1648644814 >> v1:172.21.15.195:6791/0 conn(0x7f44d4070b10 legacy=0x7f44d4070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 1 -- 172.21.15.181:0/1648644814 >> v1:172.21.15.195:6789/0 conn(0x7f44d4071600 legacy=0x7f44d413b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 10 monclient: _finish_hunting 0 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 1 monclient: found mon.noname-g 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 1 -- 172.21.15.181:0/1648644814 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d4072870 con 0x7f44d413cbe0 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 10 monclient: _finish_auth 0 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 10 monclient: _check_auth_tickets 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 1 -- 172.21.15.181:0/1648644814 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44cc001e60 con 0x7f44d413cbe0 2024-09-13T10:32:27.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d9db4640 5 monclient: authenticate success, global_id 5052 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 10 monclient: dump: 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.985 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d9db4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 1 -- 172.21.15.181:0/1648644814 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44cc004c20 con 0x7f44d413cbe0 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 1 -- 172.21.15.181:0/1648644814 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44cc005190 con 0x7f44d413cbe0 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d9db4640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d9db4640 4 set_mon_vals no callback set 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:27.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d27fc640 10 monclient: dump: 2024-09-13T10:32:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:27.987 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d9db4640 10 monclient: shutdown 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d9db4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d9db4640 1 -- 172.21.15.181:0/1648644814 >> v1:172.21.15.195:6790/0 conn(0x7f44d413cbe0 legacy=0x7f44d413efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:27.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d9db4640 1 -- 172.21.15.181:0/1648644814 shutdown_connections 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d9db4640 1 -- 172.21.15.181:0/1648644814 >> 172.21.15.181:0/1648644814 conn(0x7f44d40a45b0 msgr2=0x7f44d40a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d9db4640 1 -- 172.21.15.181:0/1648644814 shutdown_connections 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.978+0000 7f44d9db4640 1 -- 172.21.15.181:0/1648644814 wait complete. 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.979+0000 7f44d9db4640 10 monclient: build_initial_monmap 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.979+0000 7f44d9db4640 10 monclient: monmap: 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:27.989 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.979+0000 7f44d9db4640 1 Processor -- start 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.979+0000 7f44d9db4640 1 -- start start 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.979+0000 7f44d9db4640 10 monclient: init 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.980+0000 7f44d9db4640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.980+0000 7f44d9db4640 10 monclient: _add_conns ranks=[8,7,1,6,2,0,3,4,5] 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.980+0000 7f44d9db4640 10 monclient(hunting): picked mon.noname-e con 0x7f44d4070b10 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:27.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.980+0000 7f44d9db4640 10 monclient(hunting): picked mon.noname-i con 0x7f44d4071600 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:27.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.980+0000 7f44d9db4640 10 monclient(hunting): picked mon.noname-f con 0x7f44d413cbe0 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:27.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.980+0000 7f44d9db4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d4129ca0 con 0x7f44d413cbe0 2024-09-13T10:32:27.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.980+0000 7f44d9db4640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d4129f80 con 0x7f44d4071600 2024-09-13T10:32:27.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.980+0000 7f44d9db4640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d40a2db0 con 0x7f44d4070b10 2024-09-13T10:32:27.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.980+0000 7f44d9db4640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:27.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.980+0000 7f44d9db4640 10 monclient(hunting): authenticate will time out at 887.486486s 2024-09-13T10:32:27.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.980+0000 7f44d37fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f44d4070b10 0x7f44d413b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40464/0 (socket says 172.21.15.181:40464) 2024-09-13T10:32:27.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.980+0000 7f44d37fe640 1 -- 172.21.15.181:0/976125019 learned_addr learned my addr 172.21.15.181:0/976125019 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:27.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.982+0000 7f44d37fe640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.181:6793/0 conn(0x7f44d4070b10 legacy=0x7f44d413b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.982+0000 7f44d2ffd640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.195:6792/0 conn(0x7f44d4071600 legacy=0x7f44d41d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:27.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:27.982+0000 7f44d3fff640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.195:6789/0 conn(0x7f44d413cbe0 legacy=0x7f44d41d68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.375+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1205188389 0 0) 0x7f44d40a2db0 con 0x7f44d4070b10 2024-09-13T10:32:28.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.375+0000 7f44bbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.375+0000 7f44bbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.375+0000 7f44bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.375+0000 7f44bbfff640 10 monclient(hunting): my global_id is 74258 2024-09-13T10:32:28.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.375+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c0003550 con 0x7f44d4070b10 2024-09-13T10:32:28.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2572856288 0 0) 0x7f44c0003550 con 0x7f44d4070b10 2024-09-13T10:32:28.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44d40a2db0 con 0x7f44d4070b10 2024-09-13T10:32:28.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44c4003610 con 0x7f44d4070b10 2024-09-13T10:32:28.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:28.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 10 monclient(hunting): dump: 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.381 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 585678738 0 0) 0x7f44d40a2db0 con 0x7f44d4070b10 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.195:6792/0 conn(0x7f44d4071600 legacy=0x7f44d41d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.195:6789/0 conn(0x7f44d413cbe0 legacy=0x7f44d41d68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 10 monclient: _finish_hunting 0 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 1 monclient: found mon.e 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:28.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d413c830 con 0x7f44d4070b10 2024-09-13T10:32:28.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 10 monclient: _finish_auth 0 2024-09-13T10:32:28.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 10 monclient: _check_auth_tickets 2024-09-13T10:32:28.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:28.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44d9db4640 5 monclient: authenticate success, global_id 74258 2024-09-13T10:32:28.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44d9db4640 10 monclient: _renew_subs 2024-09-13T10:32:28.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44d9db4640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44d9db4640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44d41ced30 con 0x7f44d4070b10 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44d9db4640 10 monclient: _renew_subs 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44d9db4640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44d9db4640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f44d413bf40 con 0x7f44d4070b10 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44c4003bd0 con 0x7f44d4070b10 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44c4004100 con 0x7f44d4070b10 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44d1ffb640 4 set_mon_vals no callback set 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.376+0000 7f44bbfff640 10 monclient: dump: 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.384 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.385 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.385 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.385 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.385 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.385 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.385 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.385 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.385 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.385 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.385 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.385 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.385 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.387 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.377+0000 7f44d9db4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:28.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.377+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f44c40042a0 con 0x7f44d4070b10 2024-09-13T10:32:28.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.377+0000 7f44d9db4640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f44b40065c0 con 0x7f44b4002860 2024-09-13T10:32:28.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.377+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(79..79 src has 1..79) ==== 3898+0+0 (unknown 2573287606 0 0) 0x7f44c404e390 con 0x7f44d4070b10 2024-09-13T10:32:28.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.377+0000 7f44d3fff640 10 monclient: get_auth_request con 0x7f44c003fb60 auth_method 0 2024-09-13T10:32:28.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44d2ffd640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.181:6793/0 conn(0x7f44b4002860 legacy=0x7f44b4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1074191860 0 0) 0x7f44b40065c0 con 0x7f44b4002860 2024-09-13T10:32:28.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 10 monclient(hunting): my global_id is 74267 2024-09-13T10:32:28.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44d40a2db0 con 0x7f44b4002860 2024-09-13T10:32:28.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4216330554 0 0) 0x7f44d40a2db0 con 0x7f44b4002860 2024-09-13T10:32:28.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44b40065c0 con 0x7f44b4002860 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44c8001c20 con 0x7f44b4002860 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 10 monclient: dump: 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.391 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2889735261 0 0) 0x7f44b40065c0 con 0x7f44b4002860 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.379+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44b400a160 con 0x7f44b4002860 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.380+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f44c80057c0 con 0x7f44b4002860 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.380+0000 7f44bbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.380+0000 7f44bbfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.380+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.181:6793/0 conn(0x7f44b4002860 legacy=0x7f44b4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.380+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.181:6793/0 conn(0x7f44b4002860 legacy=0x7f44b4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:28.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.386+0000 7f44d9db4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:28.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.386+0000 7f44d9db4640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f44b4009e70 con 0x7f44b4009130 2024-09-13T10:32:28.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.388+0000 7f44d2ffd640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.181:6793/0 conn(0x7f44b4009130 legacy=0x7f44b40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.388+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437349620 0 0) 0x7f44b4009e70 con 0x7f44b4009130 2024-09-13T10:32:28.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.388+0000 7f44bbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.388+0000 7f44bbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.388+0000 7f44bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.388+0000 7f44bbfff640 10 monclient(hunting): my global_id is 74276 2024-09-13T10:32:28.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.388+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b40065c0 con 0x7f44b4009130 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2196723437 0 0) 0x7f44b40065c0 con 0x7f44b4009130 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44b4009e70 con 0x7f44b4009130 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44c8003d40 con 0x7f44b4009130 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 10 monclient: dump: 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.395 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3509974676 0 0) 0x7f44b4009e70 con 0x7f44b4009130 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f44b400c410 con 0x7f44b4009130 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 1451454028) 0x7f44c8004010 con 0x7f44b4009130 2024-09-13T10:32:28.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:28.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:28.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.181:6793/0 conn(0x7f44b4009130 legacy=0x7f44b40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44bbfff640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.181:6793/0 conn(0x7f44b4009130 legacy=0x7f44b40095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:28.397 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 20435, 2024-09-13T10:32:28.397 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:28.398 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:28.399 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:28.400 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:28.401 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:28.402 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.403 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:28.404 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.405 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.406 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:28.407 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.408 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:28.410 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.411 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.412 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:28.413 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.414 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:28.415 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.416 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:28.416 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:28.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44d9db4640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.195:6800/1839191919 conn(0x7f44c003fb60 legacy=0x7f44c0042020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44d9db4640 10 monclient: shutdown 2024-09-13T10:32:28.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44d9db4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:28.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44d9db4640 1 -- 172.21.15.181:0/976125019 >> v1:172.21.15.181:6793/0 conn(0x7f44d4070b10 legacy=0x7f44d413b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44d3fff640 1 -- 172.21.15.181:0/976125019 reap_dead start 2024-09-13T10:32:28.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44d3fff640 1 -- 172.21.15.181:0/976125019 reap_dead start 2024-09-13T10:32:28.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44d9db4640 1 -- 172.21.15.181:0/976125019 shutdown_connections 2024-09-13T10:32:28.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.389+0000 7f44d9db4640 1 -- 172.21.15.181:0/976125019 >> 172.21.15.181:0/976125019 conn(0x7f44d40a45b0 msgr2=0x7f44d406fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:28.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.390+0000 7f44d9db4640 1 -- 172.21.15.181:0/976125019 shutdown_connections 2024-09-13T10:32:28.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.390+0000 7f44d9db4640 1 -- 172.21.15.181:0/976125019 wait complete. 2024-09-13T10:32:28.419 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:28.419 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:32:28.419 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:32:28.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.515+0000 7feb59c23640 10 monclient: get_monmap_and_config 2024-09-13T10:32:28.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.515+0000 7feb59c23640 10 monclient: build_initial_monmap 2024-09-13T10:32:28.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.515+0000 7feb59c23640 10 monclient: monmap: 2024-09-13T10:32:28.518 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:28.518 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.518 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:28.516715+0000 2024-09-13T10:32:28.518 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:28.516715+0000 2024-09-13T10:32:28.518 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:28.518 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.518 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:28.518 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:28.518 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:28.518 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:28.519 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:28.519 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:28.519 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:28.519 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:28.519 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:28.519 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.515+0000 7feb59c23640 1 Processor -- start 2024-09-13T10:32:28.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.515+0000 7feb59c23640 1 -- start start 2024-09-13T10:32:28.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.515+0000 7feb59c23640 10 monclient: init 2024-09-13T10:32:28.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb59c23640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb59c23640 10 monclient: _add_conns ranks=[0,2,7,5,3,1,6,4,8] 2024-09-13T10:32:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb59c23640 10 monclient(hunting): picked mon.noname-a con 0x7feb540a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb59c23640 10 monclient(hunting): picked mon.noname-b con 0x7feb540a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb59c23640 10 monclient(hunting): picked mon.noname-i con 0x7feb5413f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb59c23640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb540a5fe0 con 0x7feb540a66d0 2024-09-13T10:32:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb59c23640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb540a8080 con 0x7feb540a6ab0 2024-09-13T10:32:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb59c23640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb540a42c0 con 0x7feb5413f9a0 2024-09-13T10:32:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb59c23640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb59c23640 10 monclient(hunting): authenticate will time out at 888.022447s 2024-09-13T10:32:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb4affd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7feb540a6ab0 0x7feb540a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:39296/0 (socket says 172.21.15.181:39296) 2024-09-13T10:32:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb4affd640 1 -- 172.21.15.181:0/2098939444 learned_addr learned my addr 172.21.15.181:0/2098939444 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:28.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.516+0000 7feb537fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7feb540a66d0 0x7feb540a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53098/0 (socket says 172.21.15.181:53098) 2024-09-13T10:32:28.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb537fe640 1 -- 172.21.15.181:0/2098939444 >> v1:172.21.15.181:6789/0 conn(0x7feb540a66d0 legacy=0x7feb540a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb4affd640 1 -- 172.21.15.181:0/2098939444 >> v1:172.21.15.181:6790/0 conn(0x7feb540a6ab0 legacy=0x7feb540a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb52ffd640 1 -- 172.21.15.181:0/2098939444 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023814339 0 0) 0x7feb540a5fe0 con 0x7feb540a66d0 2024-09-13T10:32:28.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb52ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb52ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb52ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb52ffd640 10 monclient(hunting): my global_id is 54990 2024-09-13T10:32:28.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb52ffd640 1 -- 172.21.15.181:0/2098939444 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb40003520 con 0x7feb540a66d0 2024-09-13T10:32:28.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb52ffd640 1 -- 172.21.15.181:0/2098939444 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444611349 0 0) 0x7feb540a8080 con 0x7feb540a6ab0 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb52ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb52ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb52ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb52ffd640 10 monclient(hunting): my global_id is 64613 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.518+0000 7feb52ffd640 1 -- 172.21.15.181:0/2098939444 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb540a5fe0 con 0x7feb540a6ab0 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb53fff640 1 -- 172.21.15.181:0/2098939444 >> v1:172.21.15.195:6792/0 conn(0x7feb5413f9a0 legacy=0x7feb54141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 1 -- 172.21.15.181:0/2098939444 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2004754722 0 0) 0x7feb540a5fe0 con 0x7feb540a6ab0 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 1 -- 172.21.15.181:0/2098939444 >> v1:172.21.15.195:6792/0 conn(0x7feb5413f9a0 legacy=0x7feb54141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 1 -- 172.21.15.181:0/2098939444 >> v1:172.21.15.181:6789/0 conn(0x7feb540a66d0 legacy=0x7feb540a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 1 monclient: found mon.noname-b 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:28.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 1 -- 172.21.15.181:0/2098939444 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb541464e0 con 0x7feb540a6ab0 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 10 monclient: _finish_auth 0 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 1 -- 172.21.15.181:0/2098939444 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb3c001ac0 con 0x7feb540a6ab0 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb59c23640 5 monclient: authenticate success, global_id 64613 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb59c23640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 10 monclient: dump: 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.527 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.528 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb59c23640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 1 -- 172.21.15.181:0/2098939444 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb3c0048a0 con 0x7feb540a6ab0 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 1 -- 172.21.15.181:0/2098939444 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb3c004dd0 con 0x7feb540a6ab0 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb59c23640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb59c23640 4 set_mon_vals no callback set 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb52ffd640 10 monclient: dump: 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.529 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb59c23640 10 monclient: shutdown 2024-09-13T10:32:28.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb59c23640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb59c23640 1 -- 172.21.15.181:0/2098939444 >> v1:172.21.15.181:6790/0 conn(0x7feb540a6ab0 legacy=0x7feb540a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb59c23640 1 -- 172.21.15.181:0/2098939444 shutdown_connections 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb59c23640 1 -- 172.21.15.181:0/2098939444 >> 172.21.15.181:0/2098939444 conn(0x7feb540abcd0 msgr2=0x7feb540ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb59c23640 1 -- 172.21.15.181:0/2098939444 shutdown_connections 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.519+0000 7feb59c23640 1 -- 172.21.15.181:0/2098939444 wait complete. 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.520+0000 7feb59c23640 10 monclient: build_initial_monmap 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.520+0000 7feb59c23640 10 monclient: monmap: 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:28.531 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.520+0000 7feb59c23640 1 Processor -- start 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.520+0000 7feb59c23640 1 -- start start 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.520+0000 7feb59c23640 10 monclient: init 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.521+0000 7feb59c23640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:28.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.521+0000 7feb59c23640 10 monclient: _add_conns ranks=[0,7,8,5,3,6,1,4,2] 2024-09-13T10:32:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.521+0000 7feb59c23640 10 monclient(hunting): picked mon.noname-a con 0x7feb540a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.521+0000 7feb59c23640 10 monclient(hunting): picked mon.noname-i con 0x7feb540a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.521+0000 7feb59c23640 10 monclient(hunting): picked mon.noname-e con 0x7feb5413f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.521+0000 7feb59c23640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5413ef60 con 0x7feb540a66d0 2024-09-13T10:32:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.521+0000 7feb59c23640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5413f240 con 0x7feb540a6ab0 2024-09-13T10:32:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.521+0000 7feb59c23640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb54142db0 con 0x7feb5413f9a0 2024-09-13T10:32:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.521+0000 7feb59c23640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.521+0000 7feb59c23640 10 monclient(hunting): authenticate will time out at 888.027341s 2024-09-13T10:32:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.521+0000 7feb537fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7feb540a66d0 0x7feb5413b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53102/0 (socket says 172.21.15.181:53102) 2024-09-13T10:32:28.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.521+0000 7feb537fe640 1 -- 172.21.15.181:0/3354899133 learned_addr learned my addr 172.21.15.181:0/3354899133 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:28.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.523+0000 7feb537fe640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.181:6789/0 conn(0x7feb540a66d0 legacy=0x7feb5413b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.523+0000 7feb53fff640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.181:6793/0 conn(0x7feb5413f9a0 legacy=0x7feb541d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.523+0000 7feb4affd640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.195:6792/0 conn(0x7feb540a6ab0 legacy=0x7feb5413bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.523+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:32:28.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335171100 0 0) 0x7feb5413ef60 con 0x7feb540a66d0 2024-09-13T10:32:28.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 10 monclient(hunting): my global_id is 54999 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb34003520 con 0x7feb540a66d0 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038703349 0 0) 0x7feb5413f240 con 0x7feb540a6ab0 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 10 monclient(hunting): my global_id is 55132 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb5413ef60 con 0x7feb540a6ab0 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4064300204 0 0) 0x7feb54142db0 con 0x7feb5413f9a0 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 10 monclient(hunting): my global_id is 74285 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.525+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb5413f240 con 0x7feb5413f9a0 2024-09-13T10:32:28.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1374441623 0 0) 0x7feb5413f240 con 0x7feb5413f9a0 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb54142db0 con 0x7feb5413f9a0 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb4c001f20 con 0x7feb5413f9a0 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.540 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1659732777 0 0) 0x7feb34003520 con 0x7feb540a66d0 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb5413f240 con 0x7feb540a66d0 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2709571459 0 0) 0x7feb5413ef60 con 0x7feb540a6ab0 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb34003520 con 0x7feb540a6ab0 2024-09-13T10:32:28.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb440047e0 con 0x7feb540a66d0 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.542 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb3c004d90 con 0x7feb540a6ab0 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.543 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 627655231 0 0) 0x7feb54142db0 con 0x7feb5413f9a0 2024-09-13T10:32:28.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.195:6792/0 conn(0x7feb540a6ab0 legacy=0x7feb5413bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.181:6789/0 conn(0x7feb540a66d0 legacy=0x7feb5413b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 monclient: found mon.e 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb54137600 con 0x7feb5413f9a0 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient: _finish_auth 0 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb59c23640 5 monclient: authenticate success, global_id 74285 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb59c23640 10 monclient: _renew_subs 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb59c23640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:28.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb59c23640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb54068bf0 con 0x7feb5413f9a0 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb59c23640 10 monclient: _renew_subs 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb59c23640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb59c23640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7feb5413c260 con 0x7feb5413f9a0 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb4c003c40 con 0x7feb5413f9a0 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb4c0041b0 con 0x7feb5413f9a0 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb527fc640 4 set_mon_vals no callback set 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.526+0000 7feb50ff9640 10 monclient: dump: 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.546 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.527+0000 7feb59c23640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:28.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.527+0000 7feb59c23640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feb380065c0 con 0x7feb38002860 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.527+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7feb4c004350 con 0x7feb5413f9a0 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.527+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(79..79 src has 1..79) ==== 3898+0+0 (unknown 2573287606 0 0) 0x7feb4c04e400 con 0x7feb5413f9a0 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.527+0000 7feb4affd640 10 monclient: get_auth_request con 0x7feb34040510 auth_method 0 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.529+0000 7feb537fe640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.195:6789/0 conn(0x7feb38002860 legacy=0x7feb38004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 349524566 0 0) 0x7feb380065c0 con 0x7feb38002860 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 10 monclient(hunting): my global_id is 55216 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb54142db0 con 0x7feb38002860 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3662644669 0 0) 0x7feb54142db0 con 0x7feb38002860 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb380065c0 con 0x7feb38002860 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb440052f0 con 0x7feb38002860 2024-09-13T10:32:28.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 10 monclient: dump: 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.549 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.550 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.550 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.550 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.550 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1713580080 0 0) 0x7feb380065c0 con 0x7feb38002860 2024-09-13T10:32:28.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb3800a160 con 0x7feb38002860 2024-09-13T10:32:28.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7feb44007530 con 0x7feb38002860 2024-09-13T10:32:28.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:28.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:28.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.195:6789/0 conn(0x7feb38002860 legacy=0x7feb38004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.530+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.195:6789/0 conn(0x7feb38002860 legacy=0x7feb38004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:28.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.536+0000 7feb59c23640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:28.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.537+0000 7feb59c23640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feb38009e50 con 0x7feb38009110 2024-09-13T10:32:28.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb537fe640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.195:6789/0 conn(0x7feb38009110 legacy=0x7feb380095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2303636658 0 0) 0x7feb38009e50 con 0x7feb38009110 2024-09-13T10:32:28.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb50ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb50ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb50ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb50ff9640 10 monclient(hunting): my global_id is 55225 2024-09-13T10:32:28.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb380065c0 con 0x7feb38009110 2024-09-13T10:32:28.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1024741701 0 0) 0x7feb380065c0 con 0x7feb38009110 2024-09-13T10:32:28.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb38009e50 con 0x7feb38009110 2024-09-13T10:32:28.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb44006da0 con 0x7feb38009110 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb50ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb50ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.539+0000 7feb50ff9640 10 monclient: dump: 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.553 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.554 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.554 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.554 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.554 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.554 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1228971955 0 0) 0x7feb38009e50 con 0x7feb38009110 2024-09-13T10:32:28.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feb3800c3f0 con 0x7feb38009110 2024-09-13T10:32:28.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7893 (unknown 0 0 3147746926) 0x7feb44007040 con 0x7feb38009110 2024-09-13T10:32:28.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb50ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:28.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb50ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:28.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.195:6789/0 conn(0x7feb38009110 legacy=0x7feb380095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb50ff9640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.195:6789/0 conn(0x7feb38009110 legacy=0x7feb380095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 162950, 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:28.555 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:28.556 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:28.557 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:28.558 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:28.559 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.560 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.561 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.563 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.564 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.565 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.566 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.567 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:28.568 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.569 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.570 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:28.571 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:28.572 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.573 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.575 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:28.575 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb59c23640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.195:6800/1839191919 conn(0x7feb34040510 legacy=0x7feb340429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb59c23640 10 monclient: shutdown 2024-09-13T10:32:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb59c23640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb59c23640 1 -- 172.21.15.181:0/3354899133 >> v1:172.21.15.181:6793/0 conn(0x7feb5413f9a0 legacy=0x7feb541d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb53fff640 1 -- 172.21.15.181:0/3354899133 reap_dead start 2024-09-13T10:32:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb53fff640 1 -- 172.21.15.181:0/3354899133 reap_dead start 2024-09-13T10:32:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb59c23640 1 -- 172.21.15.181:0/3354899133 shutdown_connections 2024-09-13T10:32:28.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.540+0000 7feb59c23640 1 -- 172.21.15.181:0/3354899133 >> 172.21.15.181:0/3354899133 conn(0x7feb540abcd0 msgr2=0x7feb54138900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.541+0000 7feb59c23640 1 -- 172.21.15.181:0/3354899133 shutdown_connections 2024-09-13T10:32:28.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.541+0000 7feb59c23640 1 -- 172.21.15.181:0/3354899133 wait complete. 2024-09-13T10:32:28.577 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:28.577 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:32:28.577 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:32:28.588 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:28.588 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36632]: starting. 2024-09-13T10:32:28.588 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36632]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36596 2024-09-13T10:32:28.588 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36632]: shutting down. 2024-09-13T10:32:28.589 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:28.589 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:28.590 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:32:28.592 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:32:28.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.675+0000 7f48dba8e640 10 monclient: get_monmap_and_config 2024-09-13T10:32:28.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.675+0000 7f48dba8e640 10 monclient: build_initial_monmap 2024-09-13T10:32:28.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.675+0000 7f48dba8e640 10 monclient: monmap: 2024-09-13T10:32:28.678 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:28.678 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.678 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:28.677464+0000 2024-09-13T10:32:28.678 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:28.677464+0000 2024-09-13T10:32:28.678 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:28.679 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.679 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:28.679 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:28.679 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:28.679 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:28.679 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:28.679 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:28.679 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:28.679 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:28.679 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:28.679 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.676+0000 7f48dba8e640 1 Processor -- start 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.676+0000 7f48dba8e640 1 -- start start 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.676+0000 7f48dba8e640 10 monclient: init 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48dba8e640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48dba8e640 10 monclient: _add_conns ranks=[6,3,8,4,5,0,7,1,2] 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48dba8e640 10 monclient(hunting): picked mon.noname-d con 0x7f48d40a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48dba8e640 10 monclient(hunting): picked mon.noname-g con 0x7f48d40a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48dba8e640 10 monclient(hunting): picked mon.noname-e con 0x7f48d413f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48dba8e640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d40a4bc0 con 0x7f48d40a8340 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48dba8e640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d413a320 con 0x7f48d40a6640 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48dba8e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d40a8100 con 0x7f48d413f750 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48dba8e640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48dba8e640 10 monclient(hunting): authenticate will time out at 888.183159s 2024-09-13T10:32:28.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48d982a640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f48d40a6640 0x7f48d4139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46528/0 (socket says 172.21.15.181:46528) 2024-09-13T10:32:28.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48d982a640 1 -- 172.21.15.181:0/529179985 learned_addr learned my addr 172.21.15.181:0/529179985 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:28.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.677+0000 7f48da02b640 1 --1- 172.21.15.181:0/529179985 >> v1:172.21.15.181:6793/0 conn(0x7f48d413f750 0x7f48d4141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40490/0 (socket says 172.21.15.181:40490) 2024-09-13T10:32:28.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d982a640 1 -- 172.21.15.181:0/529179985 >> v1:172.21.15.181:6792/0 conn(0x7f48d40a6640 legacy=0x7f48d4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48da02b640 1 -- 172.21.15.181:0/529179985 >> v1:172.21.15.181:6793/0 conn(0x7f48d413f750 legacy=0x7f48d4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 1 -- 172.21.15.181:0/529179985 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3866665235 0 0) 0x7f48d413a320 con 0x7f48d40a6640 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient(hunting): my global_id is 5064 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 1 -- 172.21.15.181:0/529179985 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48bc003520 con 0x7f48d40a6640 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 1 -- 172.21.15.181:0/529179985 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056463080 0 0) 0x7f48d40a8100 con 0x7f48d413f750 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient(hunting): my global_id is 74294 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 1 -- 172.21.15.181:0/529179985 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48d413a320 con 0x7f48d413f750 2024-09-13T10:32:28.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d9029640 1 -- 172.21.15.181:0/529179985 >> v1:172.21.15.195:6790/0 conn(0x7f48d40a8340 legacy=0x7f48d4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 1 -- 172.21.15.181:0/529179985 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3648290602 0 0) 0x7f48d413a320 con 0x7f48d413f750 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 1 -- 172.21.15.181:0/529179985 >> v1:172.21.15.181:6792/0 conn(0x7f48d40a6640 legacy=0x7f48d4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 1 -- 172.21.15.181:0/529179985 >> v1:172.21.15.195:6790/0 conn(0x7f48d40a8340 legacy=0x7f48d4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient: _finish_hunting 0 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 1 monclient: found mon.noname-e 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 1 -- 172.21.15.181:0/529179985 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d40a48e0 con 0x7f48d413f750 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient: _finish_auth 0 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient: _check_auth_tickets 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48dba8e640 5 monclient: authenticate success, global_id 74294 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 1 -- 172.21.15.181:0/529179985 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48c4001dc0 con 0x7f48d413f750 2024-09-13T10:32:28.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48dba8e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48d8828640 10 monclient: dump: 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.688 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.689 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.689 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.689 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.689 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.689 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.689 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.679+0000 7f48dba8e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:28.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48d8828640 1 -- 172.21.15.181:0/529179985 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48c4002090 con 0x7f48d413f750 2024-09-13T10:32:28.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48d8828640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:28.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48d8828640 1 -- 172.21.15.181:0/529179985 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48c4004ea0 con 0x7f48d413f750 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48dba8e640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48dba8e640 4 set_mon_vals no callback set 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48d8828640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48d8828640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48d8828640 10 monclient: dump: 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.690 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48dba8e640 10 monclient: shutdown 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48dba8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48dba8e640 1 -- 172.21.15.181:0/529179985 >> v1:172.21.15.181:6793/0 conn(0x7f48d413f750 legacy=0x7f48d4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48dba8e640 1 -- 172.21.15.181:0/529179985 shutdown_connections 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48dba8e640 1 -- 172.21.15.181:0/529179985 >> 172.21.15.181:0/529179985 conn(0x7f48d4077170 msgr2=0x7f48d40abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:28.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48dba8e640 1 -- 172.21.15.181:0/529179985 shutdown_connections 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.680+0000 7f48dba8e640 1 -- 172.21.15.181:0/529179985 wait complete. 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 10 monclient: build_initial_monmap 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 10 monclient: monmap: 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:28.692 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 1 Processor -- start 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 1 -- start start 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 10 monclient: init 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 10 monclient: _add_conns ranks=[7,8,2,4,0,6,3,1,5] 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 10 monclient(hunting): picked mon.noname-i con 0x7f48d40a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 10 monclient(hunting): picked mon.noname-e con 0x7f48d413f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 10 monclient(hunting): picked mon.noname-b con 0x7f48d40a1bf0 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:28.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d40a1430 con 0x7f48d40a1bf0 2024-09-13T10:32:28.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d41cf160 con 0x7f48d40a8340 2024-09-13T10:32:28.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d4142ef0 con 0x7f48d413f750 2024-09-13T10:32:28.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.681+0000 7f48dba8e640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:28.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.682+0000 7f48dba8e640 10 monclient(hunting): authenticate will time out at 888.188009s 2024-09-13T10:32:28.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.682+0000 7f48d9029640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f48d413f750 0x7f48d41cea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40502/0 (socket says 172.21.15.181:40502) 2024-09-13T10:32:28.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.682+0000 7f48d9029640 1 -- 172.21.15.181:0/3192477848 learned_addr learned my addr 172.21.15.181:0/3192477848 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:28.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d9029640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.181:6793/0 conn(0x7f48d413f750 legacy=0x7f48d41cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48da02b640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.181:6790/0 conn(0x7f48d40a1bf0 legacy=0x7f48d41d6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459591708 0 0) 0x7f48d4142ef0 con 0x7f48d413f750 2024-09-13T10:32:28.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): my global_id is 74303 2024-09-13T10:32:28.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c0003550 con 0x7f48d413f750 2024-09-13T10:32:28.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4204178041 0 0) 0x7f48d40a1430 con 0x7f48d40a1bf0 2024-09-13T10:32:28.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): my global_id is 64631 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48d4142ef0 con 0x7f48d40a1bf0 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d982a640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.195:6792/0 conn(0x7f48d40a8340 legacy=0x7f48d41ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1492578473 0 0) 0x7f48c0003550 con 0x7f48d413f750 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48d40a1430 con 0x7f48d413f750 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48c8003610 con 0x7f48d413f750 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): dump: 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.700 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.701 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3541917363 0 0) 0x7f48d4142ef0 con 0x7f48d40a1bf0 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48c0003550 con 0x7f48d40a1bf0 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3729336411 0 0) 0x7f48d41cf160 con 0x7f48d40a8340 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): my global_id is 55150 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48d4142ef0 con 0x7f48d40a8340 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48c4001e20 con 0x7f48d40a1bf0 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:28.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient(hunting): dump: 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.703 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1140177178 0 0) 0x7f48d40a1430 con 0x7f48d413f750 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.195:6792/0 conn(0x7f48d40a8340 legacy=0x7f48d41ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.181:6790/0 conn(0x7f48d40a1bf0 legacy=0x7f48d41d6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient: _finish_hunting 0 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 monclient: found mon.e 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d40a2910 con 0x7f48d413f750 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient: _finish_auth 0 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient: _check_auth_tickets 2024-09-13T10:32:28.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48dba8e640 5 monclient: authenticate success, global_id 74303 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48dba8e640 10 monclient: _renew_subs 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48dba8e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48dba8e640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f48d40a1150 con 0x7f48d413f750 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48dba8e640 10 monclient: _renew_subs 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48dba8e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48dba8e640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f48d41d7d30 con 0x7f48d413f750 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48c8003bc0 con 0x7f48d413f750 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.684+0000 7f48d27fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.685+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48c80040b0 con 0x7f48d413f750 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.685+0000 7f48d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.685+0000 7f48d27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:28.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.685+0000 7f48d3fff640 4 set_mon_vals no callback set 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.685+0000 7f48d27fc640 10 monclient: dump: 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.706 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.685+0000 7f48dba8e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.685+0000 7f48dba8e640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f48b40065c0 con 0x7f48b4002860 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.685+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f48c8004250 con 0x7f48d413f750 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.686+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(80..80 src has 1..80) ==== 3506+0+0 (unknown 4195445631 0 0) 0x7f48c804e330 con 0x7f48d413f750 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.686+0000 7f48da02b640 10 monclient: get_auth_request con 0x7f48c0040340 auth_method 0 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d982a640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.195:6790/0 conn(0x7f48b4002860 legacy=0x7f48b4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941226394 0 0) 0x7f48b40065c0 con 0x7f48b4002860 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 10 monclient(hunting): my global_id is 5079 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48d40a1430 con 0x7f48b4002860 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1953103704 0 0) 0x7f48d40a1430 con 0x7f48b4002860 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48b40065c0 con 0x7f48b4002860 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48cc0047e0 con 0x7f48b4002860 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 10 monclient: dump: 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.708 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 555021065 0 0) 0x7f48b40065c0 con 0x7f48b4002860 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.688+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48b400a160 con 0x7f48b4002860 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.689+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f48cc0047e0 con 0x7f48b4002860 2024-09-13T10:32:28.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.689+0000 7f48d27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:28.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.689+0000 7f48d27fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:28.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.689+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.195:6790/0 conn(0x7f48b4002860 legacy=0x7f48b4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.689+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.195:6790/0 conn(0x7f48b4002860 legacy=0x7f48b4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:28.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.695+0000 7f48dba8e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:28.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.695+0000 7f48dba8e640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f48b4009e50 con 0x7f48b4009110 2024-09-13T10:32:28.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.697+0000 7f48d982a640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.195:6790/0 conn(0x7f48b4009110 legacy=0x7f48b40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.697+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3718716412 0 0) 0x7f48b4009e50 con 0x7f48b4009110 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.697+0000 7f48d27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.697+0000 7f48d27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.697+0000 7f48d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.697+0000 7f48d27fc640 10 monclient(hunting): my global_id is 5088 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.697+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48b40065c0 con 0x7f48b4009110 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.697+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4280862388 0 0) 0x7f48b40065c0 con 0x7f48b4009110 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.697+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48b4009e50 con 0x7f48b4009110 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.697+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48cc0050d0 con 0x7f48b4009110 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.697+0000 7f48d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48d27fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48d27fc640 10 monclient: dump: 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.712 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.713 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1427038917 0 0) 0x7f48b4009e50 con 0x7f48b4009110 2024-09-13T10:32:28.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f48b400c3f0 con 0x7f48b4009110 2024-09-13T10:32:28.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7561 (unknown 0 0 4206371344) 0x7f48cc007390 con 0x7f48b4009110 2024-09-13T10:32:28.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48d27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:28.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48d27fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:28.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.195:6790/0 conn(0x7f48b4009110 legacy=0x7f48b40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48d27fc640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.195:6790/0 conn(0x7f48b4009110 legacy=0x7f48b40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:28.714 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:28.714 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:28.714 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 163114, 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:28.715 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:28.716 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:28.717 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:28.718 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:28.719 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:28.719 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:28.719 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:28.719 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:28.719 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:28.719 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:28.719 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:28.719 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:28.719 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:28.719 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:28.719 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:28.719 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.720 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.721 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.723 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:28.724 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.725 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.726 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:28.729 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.730 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.732 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:28.733 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:28.734 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.734 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.734 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:28.734 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:28.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48dba8e640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.195:6800/1839191919 conn(0x7f48c0040340 legacy=0x7f48c0042800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48dba8e640 10 monclient: shutdown 2024-09-13T10:32:28.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48dba8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:28.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48dba8e640 1 -- 172.21.15.181:0/3192477848 >> v1:172.21.15.181:6793/0 conn(0x7f48d413f750 legacy=0x7f48d41cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48da02b640 1 -- 172.21.15.181:0/3192477848 reap_dead start 2024-09-13T10:32:28.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48da02b640 1 -- 172.21.15.181:0/3192477848 reap_dead start 2024-09-13T10:32:28.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48dba8e640 1 -- 172.21.15.181:0/3192477848 shutdown_connections 2024-09-13T10:32:28.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48dba8e640 1 -- 172.21.15.181:0/3192477848 >> 172.21.15.181:0/3192477848 conn(0x7f48d40a6640 msgr2=0x7f48d4142200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:28.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48dba8e640 1 -- 172.21.15.181:0/3192477848 shutdown_connections 2024-09-13T10:32:28.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.698+0000 7f48dba8e640 1 -- 172.21.15.181:0/3192477848 wait complete. 2024-09-13T10:32:28.736 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:28.736 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:32:28.736 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:32:28.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.833+0000 7f1a1c790640 10 monclient: get_monmap_and_config 2024-09-13T10:32:28.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.833+0000 7f1a1c790640 10 monclient: build_initial_monmap 2024-09-13T10:32:28.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.833+0000 7f1a1c790640 10 monclient: monmap: 2024-09-13T10:32:28.835 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:28.834811+0000 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:28.834811+0000 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:28.836 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:28.837 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:28.837 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.833+0000 7f1a1c790640 1 Processor -- start 2024-09-13T10:32:28.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.833+0000 7f1a1c790640 1 -- start start 2024-09-13T10:32:28.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.833+0000 7f1a1c790640 10 monclient: init 2024-09-13T10:32:28.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.834+0000 7f1a1c790640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:28.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.834+0000 7f1a1c790640 10 monclient: _add_conns ranks=[5,0,2,6,4,8,3,1,7] 2024-09-13T10:32:28.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.834+0000 7f1a1c790640 10 monclient(hunting): picked mon.noname-h con 0x7f1a14070b30 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:28.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.834+0000 7f1a1c790640 10 monclient(hunting): picked mon.noname-a con 0x7f1a140a4ce0 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:28.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.834+0000 7f1a1c790640 10 monclient(hunting): picked mon.noname-b con 0x7f1a14073920 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:28.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.834+0000 7f1a1c790640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a14073040 con 0x7f1a140a4ce0 2024-09-13T10:32:28.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.834+0000 7f1a1c790640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a140727a0 con 0x7f1a14073920 2024-09-13T10:32:28.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.834+0000 7f1a1c790640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a14072a80 con 0x7f1a14070b30 2024-09-13T10:32:28.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.834+0000 7f1a1c790640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:28.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.834+0000 7f1a1c790640 10 monclient(hunting): authenticate will time out at 888.340513s 2024-09-13T10:32:28.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.834+0000 7f1a19d2b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1a140a4ce0 0x7f1a1413b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53104/0 (socket says 172.21.15.181:53104) 2024-09-13T10:32:28.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.834+0000 7f1a19d2b640 1 -- 172.21.15.181:0/30702494 learned_addr learned my addr 172.21.15.181:0/30702494 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:28.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.836+0000 7f1a1ad2d640 1 -- 172.21.15.181:0/30702494 >> v1:172.21.15.181:6790/0 conn(0x7f1a14073920 legacy=0x7f1a1413ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.836+0000 7f1a19d2b640 1 -- 172.21.15.181:0/30702494 >> v1:172.21.15.181:6789/0 conn(0x7f1a140a4ce0 legacy=0x7f1a1413b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.836+0000 7f1a1a52c640 1 -- 172.21.15.181:0/30702494 >> v1:172.21.15.195:6791/0 conn(0x7f1a14070b30 legacy=0x7f1a14070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2892063282 0 0) 0x7f1a140727a0 con 0x7f1a14073920 2024-09-13T10:32:28.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient(hunting): my global_id is 64640 2024-09-13T10:32:28.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a00003520 con 0x7f1a14073920 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2194007431 0 0) 0x7f1a14073040 con 0x7f1a140a4ce0 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient(hunting): my global_id is 55008 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a140727a0 con 0x7f1a140a4ce0 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876291279 0 0) 0x7f1a14072a80 con 0x7f1a14070b30 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient(hunting): my global_id is 5189 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a14073040 con 0x7f1a14070b30 2024-09-13T10:32:28.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3344864745 0 0) 0x7f1a00003520 con 0x7f1a14073920 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 >> v1:172.21.15.195:6791/0 conn(0x7f1a14070b30 legacy=0x7f1a14070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 >> v1:172.21.15.181:6789/0 conn(0x7f1a140a4ce0 legacy=0x7f1a1413b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient: _finish_hunting 0 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 monclient: found mon.noname-b 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a140a47e0 con 0x7f1a14073920 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient: _finish_auth 0 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient: _check_auth_tickets 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1c790640 5 monclient: authenticate success, global_id 64640 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a0c001eb0 con 0x7f1a14073920 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1c790640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:28.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient: dump: 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.846 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1c790640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a0c003990 con 0x7f1a14073920 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1c790640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 1 -- 172.21.15.181:0/30702494 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a0c003f00 con 0x7f1a14073920 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1c790640 4 set_mon_vals no callback set 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1952a640 10 monclient: dump: 2024-09-13T10:32:28.847 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.848 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1c790640 10 monclient: shutdown 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1c790640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.837+0000 7f1a1c790640 1 -- 172.21.15.181:0/30702494 >> v1:172.21.15.181:6790/0 conn(0x7f1a14073920 legacy=0x7f1a1413ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.838+0000 7f1a1c790640 1 -- 172.21.15.181:0/30702494 shutdown_connections 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.838+0000 7f1a1c790640 1 -- 172.21.15.181:0/30702494 >> 172.21.15.181:0/30702494 conn(0x7f1a1406e8c0 msgr2=0x7f1a1406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.838+0000 7f1a1c790640 1 -- 172.21.15.181:0/30702494 shutdown_connections 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.838+0000 7f1a1c790640 1 -- 172.21.15.181:0/30702494 wait complete. 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.838+0000 7f1a1c790640 10 monclient: build_initial_monmap 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.838+0000 7f1a1c790640 10 monclient: monmap: 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:28.849 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.838+0000 7f1a1c790640 1 Processor -- start 2024-09-13T10:32:28.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.838+0000 7f1a1c790640 1 -- start start 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.838+0000 7f1a1c790640 10 monclient: init 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.839+0000 7f1a1c790640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.839+0000 7f1a1c790640 10 monclient: _add_conns ranks=[5,4,7,1,2,0,8,6,3] 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.839+0000 7f1a1c790640 10 monclient(hunting): picked mon.noname-h con 0x7f1a14070b30 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.839+0000 7f1a1c790640 10 monclient(hunting): picked mon.noname-c con 0x7f1a14073920 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.839+0000 7f1a1c790640 10 monclient(hunting): picked mon.noname-i con 0x7f1a140a4ce0 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.839+0000 7f1a1c790640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a14126160 con 0x7f1a14073920 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.839+0000 7f1a1c790640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a141284c0 con 0x7f1a14070b30 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.839+0000 7f1a1c790640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a14127c20 con 0x7f1a140a4ce0 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.839+0000 7f1a1c790640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.839+0000 7f1a1c790640 10 monclient(hunting): authenticate will time out at 888.345520s 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.839+0000 7f1a19d2b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f1a14073920 0x7f1a141d2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:34088/0 (socket says 172.21.15.181:34088) 2024-09-13T10:32:28.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.839+0000 7f1a19d2b640 1 -- 172.21.15.181:0/199789994 learned_addr learned my addr 172.21.15.181:0/199789994 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:28.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a19d2b640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.181:6791/0 conn(0x7f1a14073920 legacy=0x7f1a141d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a1ad2d640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.195:6792/0 conn(0x7f1a140a4ce0 legacy=0x7f1a141d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a1a52c640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.195:6791/0 conn(0x7f1a14070b30 legacy=0x7f1a14136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228246130 0 0) 0x7f1a14126160 con 0x7f1a14073920 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 10 monclient(hunting): my global_id is 5170 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19f8003520 con 0x7f1a14073920 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268003160 0 0) 0x7f1a14127c20 con 0x7f1a140a4ce0 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 10 monclient(hunting): my global_id is 55159 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a14126160 con 0x7f1a140a4ce0 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706099334 0 0) 0x7f1a141284c0 con 0x7f1a14070b30 2024-09-13T10:32:28.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 10 monclient(hunting): my global_id is 5198 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.841+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a14127c20 con 0x7f1a14070b30 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1478245691 0 0) 0x7f19f8003520 con 0x7f1a14073920 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a141284c0 con 0x7f1a14073920 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a04001d30 con 0x7f1a14073920 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient(hunting): dump: 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.858 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:28.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2760770606 0 0) 0x7f1a14126160 con 0x7f1a140a4ce0 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f19f8003520 con 0x7f1a140a4ce0 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a0c003e80 con 0x7f1a140a4ce0 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient(hunting): dump: 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.860 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1151419906 0 0) 0x7f1a14127c20 con 0x7f1a14070b30 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a14126160 con 0x7f1a14070b30 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a10003610 con 0x7f1a14070b30 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient(hunting): dump: 2024-09-13T10:32:28.861 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.862 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3589302528 0 0) 0x7f1a141284c0 con 0x7f1a14073920 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.195:6792/0 conn(0x7f1a140a4ce0 legacy=0x7f1a141d6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.195:6791/0 conn(0x7f1a14070b30 legacy=0x7f1a14136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 monclient: found mon.c 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a141371b0 con 0x7f1a14073920 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient: _finish_auth 0 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a1c790640 5 monclient: authenticate success, global_id 5170 2024-09-13T10:32:28.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a1c790640 10 monclient: _renew_subs 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a1c790640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a1c790640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1a14126cc0 con 0x7f1a14073920 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a1c790640 10 monclient: _renew_subs 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a1c790640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a1c790640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f1a141ca760 con 0x7f1a14073920 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a04004bc0 con 0x7f1a14073920 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a040050f0 con 0x7f1a14073920 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a18d29640 4 set_mon_vals no callback set 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.842+0000 7f1a0affd640 10 monclient: dump: 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.864 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.865 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.843+0000 7f1a1c790640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.843+0000 7f1a1c790640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f19fc0065c0 con 0x7f19fc002860 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.843+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1a04011770 con 0x7f1a14073920 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.843+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(80..80 src has 1..80) ==== 3506+0+0 (unknown 4195445631 0 0) 0x7f1a0404e210 con 0x7f1a14073920 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.843+0000 7f1a1ad2d640 10 monclient: get_auth_request con 0x7f19f8040710 auth_method 0 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.845+0000 7f1a1a52c640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.195:6791/0 conn(0x7f19fc002860 legacy=0x7f19fc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.845+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 708001700 0 0) 0x7f19fc0065c0 con 0x7f19fc002860 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.845+0000 7f1a0affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.845+0000 7f1a0affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.845+0000 7f1a0affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.845+0000 7f1a0affd640 10 monclient(hunting): my global_id is 5207 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.845+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a141284c0 con 0x7f19fc002860 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3222226654 0 0) 0x7f1a141284c0 con 0x7f19fc002860 2024-09-13T10:32:28.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f19fc0065c0 con 0x7f19fc002860 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a10003df0 con 0x7f19fc002860 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 10 monclient: dump: 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.867 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3910619417 0 0) 0x7f19fc0065c0 con 0x7f19fc002860 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19fc00a160 con 0x7f19fc002860 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1a100040a0 con 0x7f19fc002860 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.195:6791/0 conn(0x7f19fc002860 legacy=0x7f19fc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.846+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.195:6791/0 conn(0x7f19fc002860 legacy=0x7f19fc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:28.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.852+0000 7f1a1c790640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:28.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.852+0000 7f1a1c790640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f19fc009e70 con 0x7f19fc009130 2024-09-13T10:32:28.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a1a52c640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.195:6791/0 conn(0x7f19fc009130 legacy=0x7f19fc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:28.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 208909273 0 0) 0x7f19fc009e70 con 0x7f19fc009130 2024-09-13T10:32:28.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 10 monclient(hunting): my global_id is 5216 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19fc0065c0 con 0x7f19fc009130 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4220464388 0 0) 0x7f19fc0065c0 con 0x7f19fc009130 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f19fc009e70 con 0x7f19fc009130 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a10005b00 con 0x7f19fc009130 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 10 monclient: dump: 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.871 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.855+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3696392506 0 0) 0x7f19fc009e70 con 0x7f19fc009130 2024-09-13T10:32:28.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.856+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f19fc00c3f0 con 0x7f19fc009130 2024-09-13T10:32:28.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.856+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 2540615852) 0x7f1a10005b70 con 0x7f19fc009130 2024-09-13T10:32:28.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.856+0000 7f1a0affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:28.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.856+0000 7f1a0affd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:28.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.856+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.195:6791/0 conn(0x7f19fc009130 legacy=0x7f19fc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.856+0000 7f1a0affd640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.195:6791/0 conn(0x7f19fc009130 legacy=0x7f19fc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:28.873 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:28.873 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:28.873 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:28.873 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:28.873 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 163284, 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:32:28.874 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:28.875 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:28.876 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:28.877 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:28.878 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:28.879 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.880 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:28.882 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:28.883 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:28.884 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:28.886 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.889 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:28.889 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.889 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.889 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:28.889 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:28.889 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.889 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.890 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.891 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:28.892 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.857+0000 7f1a1c790640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.195:6800/1839191919 conn(0x7f19f8040710 legacy=0x7f19f8042bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.857+0000 7f1a1c790640 10 monclient: shutdown 2024-09-13T10:32:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.857+0000 7f1a1c790640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.857+0000 7f1a1c790640 1 -- 172.21.15.181:0/199789994 >> v1:172.21.15.181:6791/0 conn(0x7f1a14073920 legacy=0x7f1a141d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.857+0000 7f1a1ad2d640 1 -- 172.21.15.181:0/199789994 reap_dead start 2024-09-13T10:32:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.857+0000 7f1a1ad2d640 1 -- 172.21.15.181:0/199789994 reap_dead start 2024-09-13T10:32:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.857+0000 7f1a1c790640 1 -- 172.21.15.181:0/199789994 shutdown_connections 2024-09-13T10:32:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.857+0000 7f1a1c790640 1 -- 172.21.15.181:0/199789994 >> 172.21.15.181:0/199789994 conn(0x7f1a1406e8c0 msgr2=0x7f1a140a7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:28.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.857+0000 7f1a1c790640 1 -- 172.21.15.181:0/199789994 shutdown_connections 2024-09-13T10:32:28.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.857+0000 7f1a1c790640 1 -- 172.21.15.181:0/199789994 wait complete. 2024-09-13T10:32:28.895 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:28.895 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:32:28.895 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:32:28.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.991+0000 7f9572423640 10 monclient: get_monmap_and_config 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.991+0000 7f9572423640 10 monclient: build_initial_monmap 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.991+0000 7f9572423640 10 monclient: monmap: 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:28.992877+0000 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:28.992877+0000 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:28.994 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:28.995 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:28.995 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:28.995 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:28.995 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:28.995 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:28.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 1 Processor -- start 2024-09-13T10:32:28.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 1 -- start start 2024-09-13T10:32:28.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 10 monclient: init 2024-09-13T10:32:28.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:28.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 10 monclient: _add_conns ranks=[7,0,4,1,3,5,2,6,8] 2024-09-13T10:32:28.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 10 monclient(hunting): picked mon.noname-i con 0x7f956c0a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:28.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 10 monclient(hunting): picked mon.noname-a con 0x7f956c0a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:28.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 10 monclient(hunting): picked mon.noname-c con 0x7f956c13f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:28.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956c0a4bc0 con 0x7f956c0a8340 2024-09-13T10:32:28.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956c13a320 con 0x7f956c13f750 2024-09-13T10:32:28.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956c0a8100 con 0x7f956c0a6640 2024-09-13T10:32:28.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:28.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f9572423640 10 monclient(hunting): authenticate will time out at 888.498713s 2024-09-13T10:32:28.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f95709c0640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f956c13f750 0x7f956c141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:34102/0 (socket says 172.21.15.181:34102) 2024-09-13T10:32:28.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f95709c0640 1 -- 172.21.15.181:0/3537438387 learned_addr learned my addr 172.21.15.181:0/3537438387 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:28.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.992+0000 7f956b7fe640 1 --1- 172.21.15.181:0/3537438387 >> v1:172.21.15.181:6789/0 conn(0x7f956c0a8340 0x7f956c139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53118/0 (socket says 172.21.15.181:53118) 2024-09-13T10:32:29.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956b7fe640 1 -- 172.21.15.181:0/3537438387 >> v1:172.21.15.181:6789/0 conn(0x7f956c0a8340 legacy=0x7f956c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f95709c0640 1 -- 172.21.15.181:0/3537438387 >> v1:172.21.15.181:6791/0 conn(0x7f956c13f750 legacy=0x7f956c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956bfff640 1 -- 172.21.15.181:0/3537438387 >> v1:172.21.15.195:6792/0 conn(0x7f956c0a6640 legacy=0x7f956c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4062515626 0 0) 0x7f956c0a4bc0 con 0x7f956c0a8340 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient(hunting): my global_id is 55017 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9554003520 con 0x7f956c0a8340 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377067549 0 0) 0x7f956c13a320 con 0x7f956c13f750 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient(hunting): my global_id is 5179 2024-09-13T10:32:29.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f956c0a4bc0 con 0x7f956c13f750 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421128380 0 0) 0x7f956c0a8100 con 0x7f956c0a6640 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient(hunting): my global_id is 55168 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f956c13a320 con 0x7f956c0a6640 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1944674353 0 0) 0x7f956c0a4bc0 con 0x7f956c13f750 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 >> v1:172.21.15.195:6792/0 conn(0x7f956c0a6640 legacy=0x7f956c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 >> v1:172.21.15.181:6789/0 conn(0x7f956c0a8340 legacy=0x7f956c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 monclient: found mon.noname-c 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:32:29.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c0a48e0 con 0x7f956c13f750 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient: _finish_auth 0 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9564001e40 con 0x7f956c13f750 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient: dump: 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:29.003 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f9572423640 5 monclient: authenticate success, global_id 5179 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f9572423640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9564004c20 con 0x7f956c13f750 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 1 -- 172.21.15.181:0/3537438387 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9564005190 con 0x7f956c13f750 2024-09-13T10:32:29.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f9572423640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f9572423640 4 set_mon_vals no callback set 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.995+0000 7f956affd640 10 monclient: dump: 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:29.005 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.996+0000 7f9572423640 10 monclient: shutdown 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.996+0000 7f9572423640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.996+0000 7f9572423640 1 -- 172.21.15.181:0/3537438387 >> v1:172.21.15.181:6791/0 conn(0x7f956c13f750 legacy=0x7f956c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.996+0000 7f9572423640 1 -- 172.21.15.181:0/3537438387 shutdown_connections 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.996+0000 7f9572423640 1 -- 172.21.15.181:0/3537438387 >> 172.21.15.181:0/3537438387 conn(0x7f956c077170 msgr2=0x7f956c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.996+0000 7f9572423640 1 -- 172.21.15.181:0/3537438387 shutdown_connections 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.996+0000 7f9572423640 1 -- 172.21.15.181:0/3537438387 wait complete. 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.996+0000 7f9572423640 10 monclient: build_initial_monmap 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.996+0000 7f9572423640 10 monclient: monmap: 2024-09-13T10:32:29.006 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:29.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 1 Processor -- start 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 1 -- start start 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 10 monclient: init 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 10 monclient: _add_conns ranks=[7,8,1,0,3,5,4,2,6] 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 10 monclient(hunting): picked mon.noname-i con 0x7f956c0a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 10 monclient(hunting): picked mon.noname-e con 0x7f956c13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 10 monclient(hunting): picked mon.noname-f con 0x7f956c13bdd0 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956c13e700 con 0x7f956c13bdd0 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956c0a9f20 con 0x7f956c0a8340 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956c142fd0 con 0x7f956c13f750 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f9572423640 10 monclient(hunting): authenticate will time out at 888.503872s 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f956b7fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f956c13f750 0x7f956c1d3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:40506/0 (socket says 172.21.15.181:40506) 2024-09-13T10:32:29.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:28.997+0000 7f956b7fe640 1 -- 172.21.15.181:0/4005006293 learned_addr learned my addr 172.21.15.181:0/4005006293 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:29.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f956b7fe640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.181:6793/0 conn(0x7f956c13f750 legacy=0x7f956c1d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:29.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f956bfff640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.195:6792/0 conn(0x7f956c0a8340 legacy=0x7f956c12e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:29.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858608772 0 0) 0x7f956c142fd0 con 0x7f956c13f750 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): my global_id is 74312 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9558003550 con 0x7f956c13f750 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f95709c0640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.195:6789/0 conn(0x7f956c13bdd0 legacy=0x7f956c1d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2850884495 0 0) 0x7f956c0a9f20 con 0x7f956c0a8340 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): my global_id is 55177 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f956c142fd0 con 0x7f956c0a8340 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513063939 0 0) 0x7f956c13e700 con 0x7f956c13bdd0 2024-09-13T10:32:29.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): my global_id is 55252 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f956c0a9f20 con 0x7f956c13bdd0 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 949397537 0 0) 0x7f9558003550 con 0x7f956c13f750 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f956c13e700 con 0x7f956c13f750 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9560001a90 con 0x7f956c13f750 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.014 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:29.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 757369750 0 0) 0x7f956c142fd0 con 0x7f956c0a8340 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9558003550 con 0x7f956c0a8340 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f955c003610 con 0x7f956c0a8340 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:29.016 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3525981288 0 0) 0x7f956c0a9f20 con 0x7f956c13bdd0 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f956c142fd0 con 0x7f956c13bdd0 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9564002090 con 0x7f956c13bdd0 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:29.017 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:29.018 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2937398931 0 0) 0x7f956c13e700 con 0x7f956c13f750 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.195:6792/0 conn(0x7f956c0a8340 legacy=0x7f956c12e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.195:6789/0 conn(0x7f956c13bdd0 legacy=0x7f956c1d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 monclient: found mon.e 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c13c680 con 0x7f956c13f750 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient: _finish_auth 0 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9572423640 5 monclient: authenticate success, global_id 74312 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9572423640 10 monclient: _renew_subs 2024-09-13T10:32:29.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9572423640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9572423640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f956c134100 con 0x7f956c13f750 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9572423640 10 monclient: _renew_subs 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9572423640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9572423640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f956c12ee00 con 0x7f956c13f750 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9560004dd0 con 0x7f956c13f750 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f95600052c0 con 0x7f956c13f750 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f956a7fc640 4 set_mon_vals no callback set 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.000+0000 7f9568ff9640 10 monclient: dump: 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:29.020 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.001+0000 7f9572423640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:29.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.001+0000 7f9572423640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f954c0065c0 con 0x7f954c002860 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.001+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9560011940 con 0x7f956c13f750 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.001+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(80..80 src has 1..80) ==== 3506+0+0 (unknown 4195445631 0 0) 0x7f956004e240 con 0x7f956c13f750 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.001+0000 7f95709c0640 10 monclient: get_auth_request con 0x7f9558040540 auth_method 0 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.003+0000 7f956bfff640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.195:6792/0 conn(0x7f954c002860 legacy=0x7f954c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544320799 0 0) 0x7f954c0065c0 con 0x7f954c002860 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 10 monclient(hunting): my global_id is 55186 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f956c13e700 con 0x7f954c002860 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4059334506 0 0) 0x7f956c13e700 con 0x7f954c002860 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f954c0065c0 con 0x7f954c002860 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f955c003e90 con 0x7f954c002860 2024-09-13T10:32:29.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 10 monclient: dump: 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:29.023 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:29.024 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:29.024 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:29.024 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:29.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4034651778 0 0) 0x7f954c0065c0 con 0x7f954c002860 2024-09-13T10:32:29.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f954c00a160 con 0x7f954c002860 2024-09-13T10:32:29.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f955c0040d0 con 0x7f954c002860 2024-09-13T10:32:29.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:29.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:29.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.195:6792/0 conn(0x7f954c002860 legacy=0x7f954c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:29.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.004+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.195:6792/0 conn(0x7f954c002860 legacy=0x7f954c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.010+0000 7f9572423640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.010+0000 7f9572423640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f954c009e50 con 0x7f954c009110 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f956bfff640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.195:6792/0 conn(0x7f954c009110 legacy=0x7f954c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204458950 0 0) 0x7f954c009e50 con 0x7f954c009110 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 10 monclient(hunting): my global_id is 55195 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f954c0065c0 con 0x7f954c009110 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2088289568 0 0) 0x7f954c0065c0 con 0x7f954c009110 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f954c009e50 con 0x7f954c009110 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f955c005b00 con 0x7f954c009110 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:29.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 10 monclient: dump: 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:29.027 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:29.028 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:29.028 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:29.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 121963508 0 0) 0x7f954c009e50 con 0x7f954c009110 2024-09-13T10:32:29.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.013+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f954c00c3f0 con 0x7f954c009110 2024-09-13T10:32:29.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 1043265574) 0x7f955c007e40 con 0x7f954c009110 2024-09-13T10:32:29.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9568ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:29.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9568ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:29.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.195:6792/0 conn(0x7f954c009110 legacy=0x7f954c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:29.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9568ff9640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.195:6792/0 conn(0x7f954c009110 legacy=0x7f954c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:29.028 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:29.028 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:29.028 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 48, 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 163434, 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:29.029 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 6, 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:29.030 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.031 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:29.032 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:29.033 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:29.034 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.035 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:29.036 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:29.037 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:29.039 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:29.040 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.041 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:29.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:29.043 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:29.044 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:29.045 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:29.046 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.046 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:29.046 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:29.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:29.046 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:29.046 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:29.046 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:29.046 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:29.046 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:29.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:29.046 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:29.046 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:29.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9572423640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.195:6800/1839191919 conn(0x7f9558040540 legacy=0x7f9558042a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9572423640 10 monclient: shutdown 2024-09-13T10:32:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9572423640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9572423640 1 -- 172.21.15.181:0/4005006293 >> v1:172.21.15.181:6793/0 conn(0x7f956c13f750 legacy=0x7f956c1d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f95709c0640 1 -- 172.21.15.181:0/4005006293 reap_dead start 2024-09-13T10:32:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f95709c0640 1 -- 172.21.15.181:0/4005006293 reap_dead start 2024-09-13T10:32:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9572423640 1 -- 172.21.15.181:0/4005006293 shutdown_connections 2024-09-13T10:32:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9572423640 1 -- 172.21.15.181:0/4005006293 >> 172.21.15.181:0/4005006293 conn(0x7f956c0a6640 msgr2=0x7f956c0a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9572423640 1 -- 172.21.15.181:0/4005006293 shutdown_connections 2024-09-13T10:32:29.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:29.014+0000 7f9572423640 1 -- 172.21.15.181:0/4005006293 wait complete. 2024-09-13T10:32:29.048 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:32:29.049 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['e'] 2024-09-13T10:32:29.049 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a', 'i'] 2024-09-13T10:32:29.049 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-09-13T10:32:29.049 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-09-13T10:32:29.049 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-09-13T10:32:29.049 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:32:29.060 INFO:tasks.ceph.mon.e:Stopped 2024-09-13T10:32:29.060 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-09-13T10:32:29.060 INFO:tasks.ceph.mon.a:Sent signal 19 2024-09-13T10:32:29.060 INFO:tasks.mon_thrash:Sending STOP to mon i 2024-09-13T10:32:29.060 INFO:tasks.ceph.mon.i:Sent signal 19 2024-09-13T10:32:29.060 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-13T10:32:44.061 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-09-13T10:32:44.062 INFO:tasks.ceph.mon.a:Sent signal 18 2024-09-13T10:32:44.062 INFO:tasks.mon_thrash:Sending CONT to mon i 2024-09-13T10:32:44.063 INFO:tasks.ceph.mon.i:Sent signal 18 2024-09-13T10:32:44.063 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-09-13T10:32:44.063 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:32:44.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.171+0000 7f4be14e6640 10 monclient: get_monmap_and_config 2024-09-13T10:32:44.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.171+0000 7f4be14e6640 10 monclient: build_initial_monmap 2024-09-13T10:32:44.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.171+0000 7f4be14e6640 10 monclient: monmap: 2024-09-13T10:32:44.174 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:44.174 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:44.173428+0000 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:44.173428+0000 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:44.175 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:44.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.172+0000 7f4be14e6640 1 Processor -- start 2024-09-13T10:32:44.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.172+0000 7f4be14e6640 1 -- start start 2024-09-13T10:32:44.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.172+0000 7f4be14e6640 10 monclient: init 2024-09-13T10:32:44.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.172+0000 7f4be14e6640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:44.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.172+0000 7f4be14e6640 10 monclient: _add_conns ranks=[8,3,0,5,4,6,1,2,7] 2024-09-13T10:32:44.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.172+0000 7f4be14e6640 10 monclient(hunting): picked mon.noname-e con 0x7f4bdc0a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:44.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.172+0000 7f4be14e6640 10 monclient(hunting): picked mon.noname-g con 0x7f4bdc0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:44.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.173+0000 7f4be14e6640 10 monclient(hunting): picked mon.noname-a con 0x7f4bdc13f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:44.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.173+0000 7f4be14e6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bdc0a4bc0 con 0x7f4bdc13f750 2024-09-13T10:32:44.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.173+0000 7f4be14e6640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bdc13a320 con 0x7f4bdc0a8340 2024-09-13T10:32:44.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.173+0000 7f4be14e6640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bdc0a8100 con 0x7f4bdc0a6640 2024-09-13T10:32:44.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.173+0000 7f4be14e6640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:44.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.173+0000 7f4be14e6640 10 monclient(hunting): authenticate will time out at 903.679054s 2024-09-13T10:32:44.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.173+0000 7f4bdaffd640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f4bdc0a6640 legacy=0x7f4bdc139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:32:44.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.173+0000 7f4bdb7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4bdc13f750 0x7f4bdc141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:45972/0 (socket says 172.21.15.181:45972) 2024-09-13T10:32:44.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.173+0000 7f4bdb7fe640 1 -- 172.21.15.181:0/1332866847 learned_addr learned my addr 172.21.15.181:0/1332866847 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:44.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.175+0000 7f4bdb7fe640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.181:6789/0 conn(0x7f4bdc13f750 legacy=0x7f4bdc141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:44.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.175+0000 7f4bda7fc640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.195:6790/0 conn(0x7f4bdc0a8340 legacy=0x7f4bdc139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:44.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.374+0000 7f4bdaffd640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.181:6793/0 conn(0x7f4bdc0a6640 legacy=0x7f4bdc139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:32:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:44.775+0000 7f4bdaffd640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.181:6793/0 conn(0x7f4bdc0a6640 legacy=0x7f4bdc139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:32:45.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:45.577+0000 7f4bdaffd640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.181:6793/0 conn(0x7f4bdc0a6640 legacy=0x7f4bdc139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:32:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 10 monclient(hunting): tick 2024-09-13T10:32:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:32:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 1 monclient(hunting): continuing hunt 2024-09-13T10:32:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:32:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.181:6793/0 conn(0x7f4bdc0a6640 legacy=0x7f4bdc139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:32:47.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.195:6790/0 conn(0x7f4bdc0a8340 legacy=0x7f4bdc139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.181:6789/0 conn(0x7f4bdc13f750 legacy=0x7f4bdc141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 10 monclient: _add_conns ranks=[4,5,2,1,6,7] 2024-09-13T10:32:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 10 monclient(hunting): picked mon.noname-c con 0x7f4bc80038c0 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 10 monclient(hunting): picked mon.noname-h con 0x7f4bc8007550 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f4bc800b2a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 1 -- 172.21.15.181:0/1332866847 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bdc0a48e0 con 0x7f4bc800b2a0 2024-09-13T10:32:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 1 -- 172.21.15.181:0/1332866847 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bdc0a8100 con 0x7f4bc80038c0 2024-09-13T10:32:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 1 -- 172.21.15.181:0/1332866847 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc8011110 con 0x7f4bc8007550 2024-09-13T10:32:47.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.173+0000 7f4bd8ff9640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.175+0000 7f4bdb7fe640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.181:6790/0 conn(0x7f4bc800b2a0 legacy=0x7f4bc800d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.175+0000 7f4bdaffd640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.181:6791/0 conn(0x7f4bc80038c0 legacy=0x7f4bc8005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:47.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:47.176+0000 7f4bda7fc640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.195:6791/0 conn(0x7f4bc8007550 legacy=0x7f4bc80099f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bdb7fe640 1 --1- 172.21.15.181:0/1332866847 >> v1:172.21.15.181:6790/0 conn(0x7f4bc800b2a0 0x7f4bc800d760 :-1 s=OPENED pgs=187 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f4bdc0a48e0 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:32:49.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bd9ffb640 1 -- 172.21.15.181:0/1332866847 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256523375 0 0) 0x7f4bdc0a8100 con 0x7f4bc80038c0 2024-09-13T10:32:49.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bd9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bd9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bd9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bd9ffb640 10 monclient(hunting): my global_id is 5188 2024-09-13T10:32:49.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bd9ffb640 1 -- 172.21.15.181:0/1332866847 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bc4003520 con 0x7f4bc80038c0 2024-09-13T10:32:49.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bd9ffb640 1 -- 172.21.15.181:0/1332866847 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1215612611 0 0) 0x7f4bc8011110 con 0x7f4bc8007550 2024-09-13T10:32:49.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bd9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bd9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bd9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bd9ffb640 10 monclient(hunting): my global_id is 5225 2024-09-13T10:32:49.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.096+0000 7f4bd9ffb640 1 -- 172.21.15.181:0/1332866847 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bdc0a8100 con 0x7f4bc8007550 2024-09-13T10:32:49.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 1 -- 172.21.15.181:0/1332866847 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 649812369 0 0) 0x7f4bdc0a8100 con 0x7f4bc8007550 2024-09-13T10:32:49.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.181:6791/0 conn(0x7f4bc80038c0 legacy=0x7f4bc8005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.181:6790/0 conn(0x7f4bc800b2a0 legacy=0x7f4bc800d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:32:49.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 1 monclient: found mon.noname-h 2024-09-13T10:32:49.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:49.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.195:6791/0 2024-09-13T10:32:49.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 1 -- 172.21.15.181:0/1332866847 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc8012470 con 0x7f4bc8007550 2024-09-13T10:32:49.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 10 monclient: _finish_auth 0 2024-09-13T10:32:49.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:32:49.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bdb7fe640 1 -- 172.21.15.181:0/1332866847 reap_dead start 2024-09-13T10:32:49.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:49.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 1 -- 172.21.15.181:0/1332866847 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4bd0001a70 con 0x7f4bc8007550 2024-09-13T10:32:49.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4be14e6640 5 monclient: authenticate success, global_id 5225 2024-09-13T10:32:49.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4be14e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:49.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:32:49.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 10 monclient: dump: 2024-09-13T10:32:49.107 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.107 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.107 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.107 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.107 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.107 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.107 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.107 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.107 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.107 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.107 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4be14e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 1 -- 172.21.15.181:0/1332866847 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360834532 0 0) 0x7f4bdc0a48e0 con 0x7f4bc800b2a0 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 1 -- 172.21.15.181:0/1332866847 <== mon.5 v1:172.21.15.195:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4bd0003610 con 0x7f4bc8007550 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 1 -- 172.21.15.181:0/1332866847 <== mon.5 v1:172.21.15.195:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4bd0001d40 con 0x7f4bc8007550 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4be14e6640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:49.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4be14e6640 4 set_mon_vals no callback set 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.097+0000 7f4bd9ffb640 10 monclient: dump: 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.109 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.110 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.110 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.110 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.110 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.110 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.110 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.098+0000 7f4be14e6640 10 monclient: shutdown 2024-09-13T10:32:49.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.098+0000 7f4be14e6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:49.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.098+0000 7f4be14e6640 1 -- 172.21.15.181:0/1332866847 >> v1:172.21.15.195:6791/0 conn(0x7f4bc8007550 legacy=0x7f4bc80099f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.098+0000 7f4be14e6640 1 -- 172.21.15.181:0/1332866847 shutdown_connections 2024-09-13T10:32:49.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.098+0000 7f4be14e6640 1 -- 172.21.15.181:0/1332866847 >> 172.21.15.181:0/1332866847 conn(0x7f4bdc077170 msgr2=0x7f4bdc0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:49.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.098+0000 7f4be14e6640 1 -- 172.21.15.181:0/1332866847 shutdown_connections 2024-09-13T10:32:49.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.098+0000 7f4be14e6640 1 -- 172.21.15.181:0/1332866847 wait complete. 2024-09-13T10:32:49.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.099+0000 7f4be14e6640 10 monclient: build_initial_monmap 2024-09-13T10:32:49.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.099+0000 7f4be14e6640 10 monclient: monmap: 2024-09-13T10:32:49.111 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:49.111 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:49.111 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:49.112 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:49.112 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:49.112 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:49.112 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:49.112 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:49.112 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:49.113 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:49.113 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:49.113 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:49.113 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:49.113 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:49.113 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:49.114 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.099+0000 7f4be14e6640 1 Processor -- start 2024-09-13T10:32:49.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.099+0000 7f4be14e6640 1 -- start start 2024-09-13T10:32:49.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.099+0000 7f4be14e6640 10 monclient: init 2024-09-13T10:32:49.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.100+0000 7f4be14e6640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:49.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.100+0000 7f4be14e6640 10 monclient: _add_conns ranks=[2,7,3,8,6,0,4,1,5] 2024-09-13T10:32:49.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.100+0000 7f4be14e6640 10 monclient(hunting): picked mon.noname-b con 0x7f4bdc1cdb50 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:49.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.100+0000 7f4be14e6640 10 monclient(hunting): picked mon.noname-i con 0x7f4bdc1d0ec0 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:49.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.100+0000 7f4be14e6640 10 monclient(hunting): picked mon.noname-g con 0x7f4bdc1d49d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:49.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.100+0000 7f4be14e6640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bdc13e7d0 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.100+0000 7f4be14e6640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bdc124130 con 0x7f4bdc1d49d0 2024-09-13T10:32:49.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.100+0000 7f4be14e6640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bdc0aa120 con 0x7f4bdc1d0ec0 2024-09-13T10:32:49.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.100+0000 7f4be14e6640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:49.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.100+0000 7f4be14e6640 10 monclient(hunting): authenticate will time out at 908.606588s 2024-09-13T10:32:49.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.100+0000 7f4bdaffd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f4bdc1cdb50 0x7f4bdc138770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:36652/0 (socket says 172.21.15.181:36652) 2024-09-13T10:32:49.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.100+0000 7f4bdaffd640 1 -- 172.21.15.181:0/3323539901 learned_addr learned my addr 172.21.15.181:0/3323539901 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:49.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.102+0000 7f4bdaffd640 1 -- 172.21.15.181:0/3323539901 >> v1:172.21.15.181:6790/0 conn(0x7f4bdc1cdb50 legacy=0x7f4bdc138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.102+0000 7f4bda7fc640 1 -- 172.21.15.181:0/3323539901 >> v1:172.21.15.195:6792/0 conn(0x7f4bdc1d0ec0 legacy=0x7f4bdc1d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.103+0000 7f4bdb7fe640 1 -- 172.21.15.181:0/3323539901 >> v1:172.21.15.195:6790/0 conn(0x7f4bdc1d49d0 legacy=0x7f4bdc1d6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.108+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2850077289 0 0) 0x7f4bcc004060 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.108+0000 7f4bc37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.108+0000 7f4bc37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.108+0000 7f4bc37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.108+0000 7f4bc37fe640 10 monclient(hunting): my global_id is 64658 2024-09-13T10:32:49.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.108+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bc8010800 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.108+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2819073003 0 0) 0x7f4bdc0aa120 con 0x7f4bdc1d0ec0 2024-09-13T10:32:49.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.108+0000 7f4bc37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.108+0000 7f4bc37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.108+0000 7f4bc37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.108+0000 7f4bc37fe640 10 monclient(hunting): my global_id is 55204 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.108+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bcc004060 con 0x7f4bdc1d0ec0 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1048523981 0 0) 0x7f4bc8010800 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4bdc0aa120 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4bcc004b80 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient(hunting): dump: 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.122 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1393263745 0 0) 0x7f4bcc004060 con 0x7f4bdc1d0ec0 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4bc8010800 con 0x7f4bdc1d0ec0 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004179117 0 0) 0x7f4bdc124130 con 0x7f4bdc1d49d0 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient(hunting): my global_id is 5097 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bcc004060 con 0x7f4bdc1d49d0 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4bd0003b00 con 0x7f4bdc1d0ec0 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient(hunting): dump: 2024-09-13T10:32:49.124 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.125 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.125 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.125 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.125 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.125 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.125 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.125 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.125 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.125 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.125 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.125 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.125 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4176119239 0 0) 0x7f4bdc0aa120 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 >> v1:172.21.15.195:6792/0 conn(0x7f4bdc1d0ec0 legacy=0x7f4bdc1d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 >> v1:172.21.15.195:6790/0 conn(0x7f4bdc1d49d0 legacy=0x7f4bdc1d6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient: _finish_hunting 0 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 monclient: found mon.b 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bdc122b20 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient: _finish_auth 0 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient: _check_auth_tickets 2024-09-13T10:32:49.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4be14e6640 5 monclient: authenticate success, global_id 64658 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4be14e6640 10 monclient: _renew_subs 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4be14e6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4be14e6640 1 -- 172.21.15.181:0/3323539901 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4bdc0a2710 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4be14e6640 10 monclient: _renew_subs 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4be14e6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4be14e6640 1 -- 172.21.15.181:0/3323539901 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4bdc138e80 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4bcc004fd0 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4bcc005500 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:49.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bd97fa640 4 set_mon_vals no callback set 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.109+0000 7f4bc37fe640 10 monclient: dump: 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.128 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.110+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4bcc0057a0 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.110+0000 7f4be14e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.110+0000 7f4be14e6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.110+0000 7f4be14e6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.110+0000 7f4be14e6640 1 -- 172.21.15.181:0/3323539901 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bbc005080 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.110+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(80..80 src has 1..80) ==== 3506+0+0 (unknown 4195445631 0 0) 0x7f4bcc04e5e0 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.111+0000 7f4bda7fc640 10 monclient: get_auth_request con 0x7f4bc8041220 auth_method 0 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.115+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f4bdc13e7d0 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.115+0000 7f4bc37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:49.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.115+0000 7f4bc37fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:49.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.366+0000 7f4be14e6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:32:49.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.366+0000 7f4be14e6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:32:49.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.366+0000 7f4be14e6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:49.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.366+0000 7f4be14e6640 1 -- 172.21.15.181:0/3323539901 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4bbc005370 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.367+0000 7f4bc37fe640 1 -- 172.21.15.181:0/3323539901 <== mon.2 v1:172.21.15.181:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2738 (unknown 254746657 0 2576686315) 0x7f4bcc017c50 con 0x7f4bdc1cdb50 2024-09-13T10:32:49.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.367+0000 7f4bc37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:32:49.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.367+0000 7f4bc37fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:49.371 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":68,"quorum":[0,1,2,3,4,5,6,7],"quorum_names":["a","f","b","g","c","h","d","i"],"quorum_leader_name":"g","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:32:49.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.369+0000 7f4be14e6640 1 -- 172.21.15.181:0/3323539901 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4bc8041220 legacy=0x7f4bc80436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.369+0000 7f4be14e6640 10 monclient: shutdown 2024-09-13T10:32:49.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.369+0000 7f4be14e6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:49.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.369+0000 7f4be14e6640 1 -- 172.21.15.181:0/3323539901 >> v1:172.21.15.181:6790/0 conn(0x7f4bdc1cdb50 legacy=0x7f4bdc138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.369+0000 7f4be14e6640 1 -- 172.21.15.181:0/3323539901 shutdown_connections 2024-09-13T10:32:49.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.369+0000 7f4be14e6640 1 -- 172.21.15.181:0/3323539901 >> 172.21.15.181:0/3323539901 conn(0x7f4bc8007550 msgr2=0x7f4bdc0aa670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:49.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.369+0000 7f4be14e6640 1 -- 172.21.15.181:0/3323539901 shutdown_connections 2024-09-13T10:32:49.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.369+0000 7f4be14e6640 1 -- 172.21.15.181:0/3323539901 wait complete. 2024-09-13T10:32:49.383 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-09-13T10:32:49.383 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-09-13T10:32:49.384 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:32:49.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.480+0000 7f63faa3c640 10 monclient: get_monmap_and_config 2024-09-13T10:32:49.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.480+0000 7f63faa3c640 10 monclient: build_initial_monmap 2024-09-13T10:32:49.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.480+0000 7f63faa3c640 10 monclient: monmap: 2024-09-13T10:32:49.484 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:49.484 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.484 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:49.481982+0000 2024-09-13T10:32:49.484 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:49.481982+0000 2024-09-13T10:32:49.484 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:49.484 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.484 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:49.485 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:49.485 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:49.485 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:49.485 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:49.485 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:49.485 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:49.485 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:49.486 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:49.486 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 1 Processor -- start 2024-09-13T10:32:49.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 1 -- start start 2024-09-13T10:32:49.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 10 monclient: init 2024-09-13T10:32:49.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:49.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 10 monclient: _add_conns ranks=[8,2,5,4,1,7,3,6,0] 2024-09-13T10:32:49.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 10 monclient(hunting): picked mon.noname-e con 0x7f63f40a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:49.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 10 monclient(hunting): picked mon.noname-b con 0x7f63f40a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:49.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 10 monclient(hunting): picked mon.noname-h con 0x7f63f413f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:49.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63f40a4bc0 con 0x7f63f40a8340 2024-09-13T10:32:49.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63f413a320 con 0x7f63f413f750 2024-09-13T10:32:49.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63f40a8100 con 0x7f63f40a6640 2024-09-13T10:32:49.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63faa3c640 10 monclient(hunting): authenticate will time out at 908.987709s 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63f3fff640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f63f40a6640 legacy=0x7f63f4139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63f37fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f63f40a8340 0x7f63f4139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:36656/0 (socket says 172.21.15.181:36656) 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.481+0000 7f63f37fe640 1 -- 172.21.15.181:0/758132734 learned_addr learned my addr 172.21.15.181:0/758132734 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.483+0000 7f63f37fe640 1 -- 172.21.15.181:0/758132734 >> v1:172.21.15.181:6790/0 conn(0x7f63f40a8340 legacy=0x7f63f4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 1 -- 172.21.15.181:0/758132734 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288894453 0 0) 0x7f63f40a4bc0 con 0x7f63f40a8340 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient(hunting): my global_id is 64667 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 1 -- 172.21.15.181:0/758132734 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63dc003520 con 0x7f63f40a8340 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f8fd9640 1 -- 172.21.15.181:0/758132734 >> v1:172.21.15.195:6791/0 conn(0x7f63f413f750 legacy=0x7f63f4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 1 -- 172.21.15.181:0/758132734 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3762984609 0 0) 0x7f63dc003520 con 0x7f63f40a8340 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 1 -- 172.21.15.181:0/758132734 >> v1:172.21.15.181:6793/0 conn(0x7f63f40a6640 legacy=0x7f63f4139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 1 -- 172.21.15.181:0/758132734 >> v1:172.21.15.195:6791/0 conn(0x7f63f413f750 legacy=0x7f63f4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 1 monclient: found mon.noname-b 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 1 -- 172.21.15.181:0/758132734 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f40a48e0 con 0x7f63f40a8340 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient: _finish_auth 0 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63faa3c640 5 monclient: authenticate success, global_id 64667 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63faa3c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 1 -- 172.21.15.181:0/758132734 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63e8001ae0 con 0x7f63f40a8340 2024-09-13T10:32:49.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient: dump: 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.503 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63faa3c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 1 -- 172.21.15.181:0/758132734 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63e80048a0 con 0x7f63f40a8340 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63faa3c640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 1 -- 172.21.15.181:0/758132734 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63e8004e10 con 0x7f63f40a8340 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63faa3c640 4 set_mon_vals no callback set 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:49.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63f2ffd640 10 monclient: dump: 2024-09-13T10:32:49.505 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.505 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.505 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.505 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.505 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.505 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.505 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.505 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.505 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.505 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63faa3c640 10 monclient: shutdown 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63faa3c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.484+0000 7f63faa3c640 1 -- 172.21.15.181:0/758132734 >> v1:172.21.15.181:6790/0 conn(0x7f63f40a8340 legacy=0x7f63f4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.485+0000 7f63faa3c640 1 -- 172.21.15.181:0/758132734 shutdown_connections 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.485+0000 7f63faa3c640 1 -- 172.21.15.181:0/758132734 >> 172.21.15.181:0/758132734 conn(0x7f63f4077170 msgr2=0x7f63f40abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.485+0000 7f63faa3c640 1 -- 172.21.15.181:0/758132734 shutdown_connections 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.485+0000 7f63faa3c640 1 -- 172.21.15.181:0/758132734 wait complete. 2024-09-13T10:32:49.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.485+0000 7f63faa3c640 10 monclient: build_initial_monmap 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.485+0000 7f63faa3c640 10 monclient: monmap: 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:49.507 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.485+0000 7f63faa3c640 1 Processor -- start 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63faa3c640 1 -- start start 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63faa3c640 10 monclient: init 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63faa3c640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63faa3c640 10 monclient: _add_conns ranks=[1,6,2,0,3,8,4,5,7] 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63faa3c640 10 monclient(hunting): picked mon.noname-f con 0x7f63f40a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63faa3c640 10 monclient(hunting): picked mon.noname-d con 0x7f63f413f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63faa3c640 10 monclient(hunting): picked mon.noname-b con 0x7f63f41d4730 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:49.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63faa3c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63f4142e40 con 0x7f63f40a8340 2024-09-13T10:32:49.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63faa3c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63f40a11a0 con 0x7f63f41d4730 2024-09-13T10:32:49.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63faa3c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63f40a1480 con 0x7f63f413f750 2024-09-13T10:32:49.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63faa3c640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:49.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63faa3c640 10 monclient(hunting): authenticate will time out at 908.992552s 2024-09-13T10:32:49.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63f8fd9640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f63f41d4730 0x7f63f41d6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:36664/0 (socket says 172.21.15.181:36664) 2024-09-13T10:32:49.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63f8fd9640 1 -- 172.21.15.181:0/2592097565 learned_addr learned my addr 172.21.15.181:0/2592097565 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:49.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.486+0000 7f63f37fe640 1 --1- 172.21.15.181:0/2592097565 >> v1:172.21.15.181:6792/0 conn(0x7f63f413f750 0x7f63f4138c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54006/0 (socket says 172.21.15.181:54006) 2024-09-13T10:32:49.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.488+0000 7f63f8fd9640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.181:6790/0 conn(0x7f63f41d4730 legacy=0x7f63f41d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.488+0000 7f63f37fe640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.181:6792/0 conn(0x7f63f413f750 legacy=0x7f63f4138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327432651 0 0) 0x7f63f40a11a0 con 0x7f63f41d4730 2024-09-13T10:32:49.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f3fff640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.195:6789/0 conn(0x7f63f40a8340 legacy=0x7f63f41384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): my global_id is 64676 2024-09-13T10:32:49.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63e0003550 con 0x7f63f41d4730 2024-09-13T10:32:49.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 191546936 0 0) 0x7f63f40a1480 con 0x7f63f413f750 2024-09-13T10:32:49.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): my global_id is 5073 2024-09-13T10:32:49.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63f40a11a0 con 0x7f63f413f750 2024-09-13T10:32:49.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 162168382 0 0) 0x7f63e4003d30 con 0x7f63f40a8340 2024-09-13T10:32:49.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): my global_id is 55261 2024-09-13T10:32:49.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63f40a1480 con 0x7f63f40a8340 2024-09-13T10:32:49.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1901283826 0 0) 0x7f63e0003550 con 0x7f63f41d4730 2024-09-13T10:32:49.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63e4003d30 con 0x7f63f41d4730 2024-09-13T10:32:49.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63ec0020b0 con 0x7f63f41d4730 2024-09-13T10:32:49.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:49.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:49.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:49.513 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.514 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.514 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.514 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.514 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.514 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.514 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.514 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.514 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.514 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.514 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.514 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.515 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.515 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.515 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.515 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:49.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 546939130 0 0) 0x7f63f40a11a0 con 0x7f63f413f750 2024-09-13T10:32:49.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63e0003550 con 0x7f63f413f750 2024-09-13T10:32:49.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63e8004d90 con 0x7f63f413f750 2024-09-13T10:32:49.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:49.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:49.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient(hunting): dump: 2024-09-13T10:32:49.515 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.516 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.516 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.516 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.516 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.516 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.516 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.516 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.516 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.516 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.516 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.516 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.517 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.517 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.517 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.517 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3482423840 0 0) 0x7f63e4003d30 con 0x7f63f41d4730 2024-09-13T10:32:49.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.181:6792/0 conn(0x7f63f413f750 legacy=0x7f63f4138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.195:6789/0 conn(0x7f63f40a8340 legacy=0x7f63f41384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:32:49.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 monclient: found mon.b 2024-09-13T10:32:49.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:49.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:49.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f4139310 con 0x7f63f41d4730 2024-09-13T10:32:49.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient: _finish_auth 0 2024-09-13T10:32:49.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:32:49.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:49.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63faa3c640 5 monclient: authenticate success, global_id 64676 2024-09-13T10:32:49.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63faa3c640 10 monclient: _renew_subs 2024-09-13T10:32:49.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63faa3c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:49.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63faa3c640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63f409fc80 con 0x7f63f41d4730 2024-09-13T10:32:49.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63faa3c640 10 monclient: _renew_subs 2024-09-13T10:32:49.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63faa3c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:32:49.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63faa3c640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f63f409f120 con 0x7f63f41d4730 2024-09-13T10:32:49.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63ec003db0 con 0x7f63f41d4730 2024-09-13T10:32:49.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:49.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63ec0042e0 con 0x7f63f41d4730 2024-09-13T10:32:49.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f27fc640 4 set_mon_vals no callback set 2024-09-13T10:32:49.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:49.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.489+0000 7f63f0ff9640 10 monclient: dump: 2024-09-13T10:32:49.521 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.521 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.521 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.521 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.490+0000 7f63faa3c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.490+0000 7f63faa3c640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f63d40065c0 con 0x7f63d4002860 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.490+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f63ec004480 con 0x7f63f41d4730 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.490+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(81..81 src has 1..81) ==== 3898+0+0 (unknown 372994745 0 0) 0x7f63ec04e620 con 0x7f63f41d4730 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.491+0000 7f63f37fe640 10 monclient: get_auth_request con 0x7f63e0040290 auth_method 0 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.492+0000 7f63f3fff640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.181:6789/0 conn(0x7f63d4002860 legacy=0x7f63d4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.492+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365530710 0 0) 0x7f63d40065c0 con 0x7f63d4002860 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.492+0000 7f63f0ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.492+0000 7f63f0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.492+0000 7f63f0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.492+0000 7f63f0ff9640 10 monclient(hunting): my global_id is 55026 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.492+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63e4003d30 con 0x7f63d4002860 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2175676771 0 0) 0x7f63e4003d30 con 0x7f63d4002860 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63d40065c0 con 0x7f63d4002860 2024-09-13T10:32:49.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63e4004f80 con 0x7f63d4002860 2024-09-13T10:32:49.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:49.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 10 monclient: dump: 2024-09-13T10:32:49.524 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.524 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.524 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.524 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.524 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.524 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.524 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.524 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2535668336 0 0) 0x7f63d40065c0 con 0x7f63d4002860 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63d400a160 con 0x7f63d4002860 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f63e40072e0 con 0x7f63d4002860 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.181:6789/0 conn(0x7f63d4002860 legacy=0x7f63d4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.493+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.181:6789/0 conn(0x7f63d4002860 legacy=0x7f63d4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:49.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.499+0000 7f63faa3c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:49.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.499+0000 7f63faa3c640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f63d4009e50 con 0x7f63d4009110 2024-09-13T10:32:49.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.501+0000 7f63f3fff640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.181:6789/0 conn(0x7f63d4009110 legacy=0x7f63d40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1108907524 0 0) 0x7f63d4009e50 con 0x7f63d4009110 2024-09-13T10:32:49.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 10 monclient(hunting): my global_id is 55035 2024-09-13T10:32:49.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63d40065c0 con 0x7f63d4009110 2024-09-13T10:32:49.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1006046812 0 0) 0x7f63d40065c0 con 0x7f63d4009110 2024-09-13T10:32:49.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63d4009e50 con 0x7f63d4009110 2024-09-13T10:32:49.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63e4005950 con 0x7f63d4009110 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 10 monclient: dump: 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.529 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.530 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.530 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.530 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.530 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.530 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4015191402 0 0) 0x7f63d4009e50 con 0x7f63d4009110 2024-09-13T10:32:49.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63d400c3f0 con 0x7f63d4009110 2024-09-13T10:32:49.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7715 (unknown 0 0 3951045861) 0x7f63e4006e60 con 0x7f63d4009110 2024-09-13T10:32:49.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:49.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:49.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.181:6789/0 conn(0x7f63d4009110 legacy=0x7f63d40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f0ff9640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.181:6789/0 conn(0x7f63d4009110 legacy=0x7f63d40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:49.531 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:49.531 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:49.531 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:49.531 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:49.531 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 68, 2024-09-13T10:32:49.531 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 183935, 2024-09-13T10:32:49.531 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:49.532 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:49.533 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.534 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:49.535 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:49.536 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.537 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.538 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.540 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:49.540 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:49.540 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.540 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.540 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.540 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:49.540 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.540 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.540 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.540 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:49.541 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.542 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:49.544 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.545 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.547 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.548 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.549 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:49.550 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:49.550 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:49.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.550 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.550 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:49.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.550 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:49.550 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:49.550 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:49.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.550 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.551 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:49.551 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:49.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63faa3c640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.195:6800/1839191919 conn(0x7f63e0040290 legacy=0x7f63e0042750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63faa3c640 10 monclient: shutdown 2024-09-13T10:32:49.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63faa3c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:49.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63faa3c640 1 -- 172.21.15.181:0/2592097565 >> v1:172.21.15.181:6790/0 conn(0x7f63f41d4730 legacy=0x7f63f41d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f8fd9640 1 -- 172.21.15.181:0/2592097565 reap_dead start 2024-09-13T10:32:49.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.502+0000 7f63f8fd9640 1 -- 172.21.15.181:0/2592097565 reap_dead start 2024-09-13T10:32:49.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.503+0000 7f63faa3c640 1 -- 172.21.15.181:0/2592097565 shutdown_connections 2024-09-13T10:32:49.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.503+0000 7f63faa3c640 1 -- 172.21.15.181:0/2592097565 >> 172.21.15.181:0/2592097565 conn(0x7f63f40a6640 msgr2=0x7f63f4141dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:49.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.503+0000 7f63faa3c640 1 -- 172.21.15.181:0/2592097565 shutdown_connections 2024-09-13T10:32:49.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.503+0000 7f63faa3c640 1 -- 172.21.15.181:0/2592097565 wait complete. 2024-09-13T10:32:49.553 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:32:49.553 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-09-13T10:32:49.553 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:32:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.650+0000 7f44b7657640 10 monclient: get_monmap_and_config 2024-09-13T10:32:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.650+0000 7f44b7657640 10 monclient: build_initial_monmap 2024-09-13T10:32:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.650+0000 7f44b7657640 10 monclient: monmap: 2024-09-13T10:32:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:49.652057+0000 2024-09-13T10:32:49.654 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:49.652057+0000 2024-09-13T10:32:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:49.655 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 1 Processor -- start 2024-09-13T10:32:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 1 -- start start 2024-09-13T10:32:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 10 monclient: init 2024-09-13T10:32:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 10 monclient: _add_conns ranks=[7,3,8,2,4,6,5,1,0] 2024-09-13T10:32:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 10 monclient(hunting): picked mon.noname-i con 0x7f44b00a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 10 monclient(hunting): picked mon.noname-g con 0x7f44b00a71c0 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 10 monclient(hunting): picked mon.noname-e con 0x7f44b00a5430 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b00a4390 con 0x7f44b00a71c0 2024-09-13T10:32:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b00a8380 con 0x7f44b00a66d0 2024-09-13T10:32:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b00a32f0 con 0x7f44b00a5430 2024-09-13T10:32:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b7657640 10 monclient(hunting): authenticate will time out at 909.157735s 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b5bf4640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f44b00a5430 legacy=0x7f44b01465d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b53f3640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f44b00a66d0 0x7f44b00a6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:48936/0 (socket says 172.21.15.181:48936) 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b4bf2640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f44b00a71c0 0x7f44b0142ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:38356/0 (socket says 172.21.15.181:38356) 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.651+0000 7f44b53f3640 1 -- 172.21.15.181:0/3954929436 learned_addr learned my addr 172.21.15.181:0/3954929436 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44b53f3640 1 -- 172.21.15.181:0/3954929436 >> v1:172.21.15.195:6792/0 conn(0x7f44b00a66d0 legacy=0x7f44b00a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44b4bf2640 1 -- 172.21.15.181:0/3954929436 >> v1:172.21.15.195:6790/0 conn(0x7f44b00a71c0 legacy=0x7f44b0142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 1 -- 172.21.15.181:0/3954929436 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2573698606 0 0) 0x7f44b00a8380 con 0x7f44b00a66d0 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient(hunting): my global_id is 55213 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 1 -- 172.21.15.181:0/3954929436 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f449c003520 con 0x7f44b00a66d0 2024-09-13T10:32:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 1 -- 172.21.15.181:0/3954929436 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194005357 0 0) 0x7f44b00a4390 con 0x7f44b00a71c0 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient(hunting): my global_id is 5106 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 1 -- 172.21.15.181:0/3954929436 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b00a8380 con 0x7f44b00a71c0 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 1 -- 172.21.15.181:0/3954929436 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1244464626 0 0) 0x7f44b00a8380 con 0x7f44b00a71c0 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 1 -- 172.21.15.181:0/3954929436 >> v1:172.21.15.181:6793/0 conn(0x7f44b00a5430 legacy=0x7f44b01465d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 1 -- 172.21.15.181:0/3954929436 >> v1:172.21.15.195:6792/0 conn(0x7f44b00a66d0 legacy=0x7f44b00a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient: _finish_hunting 0 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 1 monclient: found mon.noname-g 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 1 -- 172.21.15.181:0/3954929436 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b00a4c30 con 0x7f44b00a71c0 2024-09-13T10:32:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient: _finish_auth 0 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient: _check_auth_tickets 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 1 -- 172.21.15.181:0/3954929436 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44a0001b00 con 0x7f44b00a71c0 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient: dump: 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44b7657640 5 monclient: authenticate success, global_id 5106 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44b7657640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 1 -- 172.21.15.181:0/3954929436 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44a0001ca0 con 0x7f44b00a71c0 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44b7657640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44b7657640 4 set_mon_vals no callback set 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 1 -- 172.21.15.181:0/3954929436 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44a0004b20 con 0x7f44b00a71c0 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.654+0000 7f44a7fff640 10 monclient: dump: 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.655+0000 7f44b7657640 10 monclient: shutdown 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.655+0000 7f44b7657640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.655+0000 7f44b7657640 1 -- 172.21.15.181:0/3954929436 >> v1:172.21.15.195:6790/0 conn(0x7f44b00a71c0 legacy=0x7f44b0142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.655+0000 7f44b7657640 1 -- 172.21.15.181:0/3954929436 shutdown_connections 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.655+0000 7f44b7657640 1 -- 172.21.15.181:0/3954929436 >> 172.21.15.181:0/3954929436 conn(0x7f44b00abcd0 msgr2=0x7f44b00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.655+0000 7f44b7657640 1 -- 172.21.15.181:0/3954929436 shutdown_connections 2024-09-13T10:32:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.655+0000 7f44b7657640 1 -- 172.21.15.181:0/3954929436 wait complete. 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.655+0000 7f44b7657640 10 monclient: build_initial_monmap 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.655+0000 7f44b7657640 10 monclient: monmap: 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:49.667 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:49.667 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:49.667 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:49.667 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:49.667 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 1 Processor -- start 2024-09-13T10:32:49.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 1 -- start start 2024-09-13T10:32:49.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 10 monclient: init 2024-09-13T10:32:49.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 10 monclient: _add_conns ranks=[7,5,3,0,4,2,6,8,1] 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 10 monclient(hunting): picked mon.noname-i con 0x7f44b00a5430 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 10 monclient(hunting): picked mon.noname-h con 0x7f44b00a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 10 monclient(hunting): picked mon.noname-g con 0x7f44b00a71c0 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b012e7f0 con 0x7f44b00a71c0 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b012ead0 con 0x7f44b00a66d0 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b012d2d0 con 0x7f44b00a5430 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.656+0000 7f44b7657640 10 monclient(hunting): authenticate will time out at 909.162877s 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.657+0000 7f44b53f3640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f44b00a5430 0x7f44b013e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:48940/0 (socket says 172.21.15.181:48940) 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.657+0000 7f44b53f3640 1 -- 172.21.15.181:0/935749901 learned_addr learned my addr 172.21.15.181:0/935749901 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44b53f3640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.195:6792/0 conn(0x7f44b00a5430 legacy=0x7f44b013e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44b5bf4640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.195:6790/0 conn(0x7f44b00a71c0 legacy=0x7f44b01da980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44b4bf2640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.195:6791/0 conn(0x7f44b00a66d0 legacy=0x7f44b01d7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3310077309 0 0) 0x7f44b012d2d0 con 0x7f44b00a5430 2024-09-13T10:32:49.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): my global_id is 55222 2024-09-13T10:32:49.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4494003550 con 0x7f44b00a5430 2024-09-13T10:32:49.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3097567312 0 0) 0x7f44b012e7f0 con 0x7f44b00a71c0 2024-09-13T10:32:49.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): my global_id is 5115 2024-09-13T10:32:49.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b012d2d0 con 0x7f44b00a71c0 2024-09-13T10:32:49.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935091350 0 0) 0x7f44b012ead0 con 0x7f44b00a66d0 2024-09-13T10:32:49.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): my global_id is 5243 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b012e7f0 con 0x7f44b00a66d0 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 585669735 0 0) 0x7f4494003550 con 0x7f44b00a5430 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44b012ead0 con 0x7f44b00a5430 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44ac001a60 con 0x7f44b00a5430 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): dump: 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.677 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:49.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4292716833 0 0) 0x7f44b012d2d0 con 0x7f44b00a71c0 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4494003550 con 0x7f44b00a71c0 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44a8004850 con 0x7f44b00a71c0 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 10 monclient(hunting): dump: 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.679 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.659+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2900343239 0 0) 0x7f44b012e7f0 con 0x7f44b00a66d0 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44b012d2d0 con 0x7f44b00a66d0 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44a0001320 con 0x7f44b00a66d0 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:49.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 10 monclient(hunting): dump: 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.681 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2085993395 0 0) 0x7f44b012ead0 con 0x7f44b00a5430 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.195:6791/0 conn(0x7f44b00a66d0 legacy=0x7f44b01d7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.195:6790/0 conn(0x7f44b00a71c0 legacy=0x7f44b01da980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 1 monclient: found mon.i 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b00a9090 con 0x7f44b00a5430 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 10 monclient: _finish_auth 0 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:49.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44b7657640 5 monclient: authenticate success, global_id 55222 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44b7657640 10 monclient: _renew_subs 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44b7657640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44b7657640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44b012c770 con 0x7f44b00a5430 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44ac004dd0 con 0x7f44b00a5430 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44ac0052c0 con 0x7f44b00a5430 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a5ffb640 10 monclient: dump: 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.683 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44a77fe640 4 set_mon_vals no callback set 2024-09-13T10:32:49.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44b7657640 10 monclient: _renew_subs 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44b7657640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.660+0000 7f44b7657640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f44b01d2160 con 0x7f44b00a5430 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.661+0000 7f44b7657640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.661+0000 7f44b7657640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f44b012e380 con 0x7f44b002e370 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.661+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f44ac0119c0 con 0x7f44b00a5430 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.661+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(81..81 src has 1..81) ==== 3898+0+0 (unknown 372994745 0 0) 0x7f44ac04e4d0 con 0x7f44b00a5430 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.661+0000 7f44b5bf4640 10 monclient: get_auth_request con 0x7f4494040660 auth_method 0 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44b4bf2640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.181:6790/0 conn(0x7f44b002e370 legacy=0x7f44b0063ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3453637847 0 0) 0x7f44b012e380 con 0x7f44b002e370 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 10 monclient(hunting): my global_id is 64685 2024-09-13T10:32:49.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b012ead0 con 0x7f44b002e370 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1518631983 0 0) 0x7f44b012ead0 con 0x7f44b002e370 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44b012e380 con 0x7f44b002e370 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44a0004e60 con 0x7f44b002e370 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 10 monclient: dump: 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.686 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3469136569 0 0) 0x7f44b012e380 con 0x7f44b002e370 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.663+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44b002e750 con 0x7f44b002e370 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.664+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f44a00062d0 con 0x7f44b002e370 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.664+0000 7f44a5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.664+0000 7f44a5ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:49.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.664+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.181:6790/0 conn(0x7f44b002e370 legacy=0x7f44b0063ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.664+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.181:6790/0 conn(0x7f44b002e370 legacy=0x7f44b0063ab0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:49.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.670+0000 7f44b7657640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:49.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.670+0000 7f44b7657640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f44b00a3d30 con 0x7f44b013e7f0 2024-09-13T10:32:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44b4bf2640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.181:6790/0 conn(0x7f44b013e7f0 legacy=0x7f44b009ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4082470547 0 0) 0x7f44b00a3d30 con 0x7f44b013e7f0 2024-09-13T10:32:49.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 10 monclient(hunting): my global_id is 64694 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b012e380 con 0x7f44b013e7f0 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1841691965 0 0) 0x7f44b012e380 con 0x7f44b013e7f0 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44b00a3d30 con 0x7f44b013e7f0 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f44a0005410 con 0x7f44b013e7f0 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 10 monclient: dump: 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.690 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1073910521 0 0) 0x7f44b00a3d30 con 0x7f44b013e7f0 2024-09-13T10:32:49.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.672+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f44b009f190 con 0x7f44b013e7f0 2024-09-13T10:32:49.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7547 (unknown 0 0 1250602686) 0x7f44a0005840 con 0x7f44b013e7f0 2024-09-13T10:32:49.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44a5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:49.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44a5ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:49.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.181:6790/0 conn(0x7f44b013e7f0 legacy=0x7f44b009ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44a5ffb640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.181:6790/0 conn(0x7f44b013e7f0 legacy=0x7f44b009ea80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:49.692 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:49.692 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:49.692 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:49.693 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:49.693 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 68, 2024-09-13T10:32:49.693 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 95577, 2024-09-13T10:32:49.693 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:49.693 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:49.693 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:49.693 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:49.693 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:49.693 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:49.693 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:49.693 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:49.693 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:32:49.694 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.694 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:32:49.694 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:49.694 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:49.694 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:49.694 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:49.694 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:49.694 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:49.694 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:49.695 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:49.697 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:49.697 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:49.697 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:49.698 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:49.698 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:49.698 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:49.698 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:49.698 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:49.698 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.699 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:49.699 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:49.699 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:49.699 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:49.699 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:49.699 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:49.699 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:49.699 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:49.699 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:49.699 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:49.699 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:49.699 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:49.700 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:49.700 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:49.700 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:49.700 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:49.700 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:49.700 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:49.700 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:49.700 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:49.700 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:49.700 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:49.700 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:49.701 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:49.701 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:49.701 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:49.701 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:49.701 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:49.701 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.701 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:49.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.701 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:49.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.701 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:49.702 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:49.702 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.702 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.702 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.702 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:49.702 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.702 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.702 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:49.703 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:49.703 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.703 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.703 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.703 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:49.703 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:49.703 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.704 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:49.704 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.704 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:49.704 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:49.704 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.704 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.705 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.705 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:49.705 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:49.705 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.705 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.705 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.705 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:49.705 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.706 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.706 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:49.706 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:49.706 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.706 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.706 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.706 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:49.706 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:49.706 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.707 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:49.707 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.707 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.707 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:49.708 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:49.708 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.708 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.708 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.709 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:49.709 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:49.709 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.709 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:49.711 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.711 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.711 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:49.711 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:49.712 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.712 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.712 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.713 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:49.713 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:49.713 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.713 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:49.714 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.714 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.714 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:49.715 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:49.715 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.715 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.715 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.716 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:49.716 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:49.716 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.716 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:49.717 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:49.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:49.719 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.719 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.719 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.720 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:49.720 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:49.720 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.720 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:49.721 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.721 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.721 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:49.722 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:49.722 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.722 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.722 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.723 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:49.723 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:49.723 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.724 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:49.724 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.724 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:49.725 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:49.725 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.725 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.725 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.725 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.726 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.726 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:49.726 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:49.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.726 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:49.727 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:49.727 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:49.727 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.727 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.727 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:49.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.728 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:49.728 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:49.728 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:49.728 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.728 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.729 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:49.729 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:49.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44b7657640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4494040660 legacy=0x7f4494042b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44b7657640 10 monclient: shutdown 2024-09-13T10:32:49.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44b7657640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:49.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44b7657640 1 -- 172.21.15.181:0/935749901 >> v1:172.21.15.195:6792/0 conn(0x7f44b00a5430 legacy=0x7f44b013e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44b5bf4640 1 -- 172.21.15.181:0/935749901 reap_dead start 2024-09-13T10:32:49.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44b5bf4640 1 -- 172.21.15.181:0/935749901 reap_dead start 2024-09-13T10:32:49.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44b7657640 1 -- 172.21.15.181:0/935749901 shutdown_connections 2024-09-13T10:32:49.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44b7657640 1 -- 172.21.15.181:0/935749901 >> 172.21.15.181:0/935749901 conn(0x7f44b00abcd0 msgr2=0x7f44b00ab280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:49.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44b7657640 1 -- 172.21.15.181:0/935749901 shutdown_connections 2024-09-13T10:32:49.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.673+0000 7f44b7657640 1 -- 172.21.15.181:0/935749901 wait complete. 2024-09-13T10:32:49.734 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:32:49.734 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-09-13T10:32:49.734 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:32:49.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.830+0000 7f135dff8640 10 monclient: get_monmap_and_config 2024-09-13T10:32:49.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.830+0000 7f135dff8640 10 monclient: build_initial_monmap 2024-09-13T10:32:49.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.830+0000 7f135dff8640 10 monclient: monmap: 2024-09-13T10:32:49.834 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:49.834 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.834 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:49.832547+0000 2024-09-13T10:32:49.834 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:49.832547+0000 2024-09-13T10:32:49.835 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:49.835 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.835 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:49.835 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:49.835 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:49.835 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:49.835 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:49.835 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:49.835 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:49.835 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:49.835 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:49.835 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.831+0000 7f135dff8640 1 Processor -- start 2024-09-13T10:32:49.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.831+0000 7f135dff8640 1 -- start start 2024-09-13T10:32:49.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.831+0000 7f135dff8640 10 monclient: init 2024-09-13T10:32:49.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.832+0000 7f135dff8640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:49.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.832+0000 7f135dff8640 10 monclient: _add_conns ranks=[7,4,6,0,3,5,8,1,2] 2024-09-13T10:32:49.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.832+0000 7f135dff8640 10 monclient(hunting): picked mon.noname-i con 0x7f13580a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:49.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.832+0000 7f135dff8640 10 monclient(hunting): picked mon.noname-c con 0x7f13580a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:49.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.832+0000 7f135dff8640 10 monclient(hunting): picked mon.noname-d con 0x7f135813f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:49.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.832+0000 7f135dff8640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13580a5fe0 con 0x7f13580a6ab0 2024-09-13T10:32:49.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.832+0000 7f135dff8640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13580a8080 con 0x7f135813f9a0 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.832+0000 7f135dff8640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13580a42c0 con 0x7f13580a66d0 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.832+0000 7f135dff8640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.832+0000 7f135dff8640 10 monclient(hunting): authenticate will time out at 909.338263s 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.832+0000 7f1357fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f135813f9a0 0x7f1358141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54008/0 (socket says 172.21.15.181:54008) 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.832+0000 7f1357fff640 1 -- 172.21.15.181:0/1543514004 learned_addr learned my addr 172.21.15.181:0/1543514004 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f1357fff640 1 -- 172.21.15.181:0/1543514004 >> v1:172.21.15.181:6792/0 conn(0x7f135813f9a0 legacy=0x7f1358141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f1356ffd640 1 -- 172.21.15.181:0/1543514004 >> v1:172.21.15.181:6791/0 conn(0x7f13580a6ab0 legacy=0x7f13580a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13577fe640 1 -- 172.21.15.181:0/1543514004 >> v1:172.21.15.195:6792/0 conn(0x7f13580a66d0 legacy=0x7f13580a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864874451 0 0) 0x7f13580a8080 con 0x7f135813f9a0 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13567fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13567fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13567fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13567fc640 10 monclient(hunting): my global_id is 5082 2024-09-13T10:32:49.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1340003520 con 0x7f135813f9a0 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083496016 0 0) 0x7f13580a5fe0 con 0x7f13580a6ab0 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13567fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13567fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13567fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13567fc640 10 monclient(hunting): my global_id is 5197 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.834+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13580a8080 con 0x7f13580a6ab0 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3130577564 0 0) 0x7f13580a42c0 con 0x7f13580a66d0 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient(hunting): my global_id is 55231 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13580a5fe0 con 0x7f13580a66d0 2024-09-13T10:32:49.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3083027979 0 0) 0x7f13580a8080 con 0x7f13580a6ab0 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 >> v1:172.21.15.195:6792/0 conn(0x7f13580a66d0 legacy=0x7f13580a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 >> v1:172.21.15.181:6792/0 conn(0x7f135813f9a0 legacy=0x7f1358141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient: _finish_hunting 0 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 1 monclient: found mon.noname-c 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13581464e0 con 0x7f13580a6ab0 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient: _finish_auth 0 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient: _check_auth_tickets 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f134c001e20 con 0x7f13580a6ab0 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:32:49.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient: dump: 2024-09-13T10:32:49.844 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.844 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.844 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.844 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.844 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.844 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.844 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.844 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.844 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.844 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f135dff8640 5 monclient: authenticate success, global_id 5197 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f135dff8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f134c002070 con 0x7f13580a6ab0 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 1 -- 172.21.15.181:0/1543514004 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f134c003cd0 con 0x7f13580a6ab0 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:49.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f13567fc640 10 monclient: dump: 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.846 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f135dff8640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f135dff8640 4 set_mon_vals no callback set 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f135dff8640 10 monclient: shutdown 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f135dff8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f135dff8640 1 -- 172.21.15.181:0/1543514004 >> v1:172.21.15.181:6791/0 conn(0x7f13580a6ab0 legacy=0x7f13580a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f135dff8640 1 -- 172.21.15.181:0/1543514004 shutdown_connections 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f135dff8640 1 -- 172.21.15.181:0/1543514004 >> 172.21.15.181:0/1543514004 conn(0x7f13580abcd0 msgr2=0x7f13580ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f135dff8640 1 -- 172.21.15.181:0/1543514004 shutdown_connections 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.835+0000 7f135dff8640 1 -- 172.21.15.181:0/1543514004 wait complete. 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.836+0000 7f135dff8640 10 monclient: build_initial_monmap 2024-09-13T10:32:49.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.836+0000 7f135dff8640 10 monclient: monmap: 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:49.848 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.836+0000 7f135dff8640 1 Processor -- start 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.836+0000 7f135dff8640 1 -- start start 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.836+0000 7f135dff8640 10 monclient: init 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.837+0000 7f135dff8640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.837+0000 7f135dff8640 10 monclient: _add_conns ranks=[3,0,1,2,7,5,4,6,8] 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.837+0000 7f135dff8640 10 monclient(hunting): picked mon.noname-g con 0x7f13580a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.837+0000 7f135dff8640 10 monclient(hunting): picked mon.noname-a con 0x7f13580a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.837+0000 7f135dff8640 10 monclient(hunting): picked mon.noname-f con 0x7f135813f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.837+0000 7f135dff8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f135813d630 con 0x7f13580a6ab0 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.837+0000 7f135dff8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1358068780 con 0x7f135813f9a0 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.837+0000 7f135dff8640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f135813ecf0 con 0x7f13580a66d0 2024-09-13T10:32:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.837+0000 7f135dff8640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:49.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.837+0000 7f135dff8640 10 monclient(hunting): authenticate will time out at 909.343325s 2024-09-13T10:32:49.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.837+0000 7f1356ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f13580a6ab0 0x7f135813be10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:45988/0 (socket says 172.21.15.181:45988) 2024-09-13T10:32:49.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.837+0000 7f1356ffd640 1 -- 172.21.15.181:0/1608277540 learned_addr learned my addr 172.21.15.181:0/1608277540 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:49.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f1356ffd640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.181:6789/0 conn(0x7f13580a6ab0 legacy=0x7f135813be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f13577fe640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.195:6790/0 conn(0x7f13580a66d0 legacy=0x7f135813b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f1357fff640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.195:6789/0 conn(0x7f135813f9a0 legacy=0x7f13581d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331438494 0 0) 0x7f135813d630 con 0x7f13580a6ab0 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): my global_id is 55044 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1344003520 con 0x7f13580a6ab0 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 457074088 0 0) 0x7f135813ecf0 con 0x7f13580a66d0 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): my global_id is 5124 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f135813d630 con 0x7f13580a66d0 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2438775062 0 0) 0x7f13500015e0 con 0x7f135813f9a0 2024-09-13T10:32:49.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): my global_id is 55270 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f135813ecf0 con 0x7f135813f9a0 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2917860761 0 0) 0x7f1344003520 con 0x7f13580a6ab0 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13500015e0 con 0x7f13580a6ab0 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f134c003cd0 con 0x7f13580a6ab0 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): dump: 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.857 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.839+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 844281835 0 0) 0x7f135813d630 con 0x7f13580a66d0 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1344003520 con 0x7f13580a66d0 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1348003610 con 0x7f13580a66d0 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient(hunting): dump: 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1130879119 0 0) 0x7f135813ecf0 con 0x7f135813f9a0 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f135813d630 con 0x7f135813f9a0 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1350001d30 con 0x7f135813f9a0 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient(hunting): dump: 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1568214712 0 0) 0x7f13500015e0 con 0x7f13580a6ab0 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.195:6790/0 conn(0x7f13580a66d0 legacy=0x7f135813b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.195:6789/0 conn(0x7f135813f9a0 legacy=0x7f13581d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 1 monclient: found mon.a 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1358137600 con 0x7f13580a6ab0 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient: _finish_auth 0 2024-09-13T10:32:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f135dff8640 5 monclient: authenticate success, global_id 55044 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f135dff8640 10 monclient: _renew_subs 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f135dff8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f135dff8640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1358142db0 con 0x7f13580a6ab0 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f135dff8640 10 monclient: _renew_subs 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f135dff8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f135dff8640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f135813ea10 con 0x7f13580a6ab0 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f134c0042c0 con 0x7f13580a6ab0 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f134c005b40 con 0x7f13580a6ab0 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f1355ffb640 4 set_mon_vals no callback set 2024-09-13T10:32:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.840+0000 7f133ffff640 10 monclient: dump: 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.841+0000 7f135dff8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.841+0000 7f135dff8640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f13380065c0 con 0x7f1338002860 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.841+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f134c0121c0 con 0x7f13580a6ab0 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.841+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(81..81 src has 1..81) ==== 3898+0+0 (unknown 372994745 0 0) 0x7f134c04e730 con 0x7f13580a6ab0 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.841+0000 7f1357fff640 10 monclient: get_auth_request con 0x7f13440406d0 auth_method 0 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f13577fe640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.181:6791/0 conn(0x7f1338002860 legacy=0x7f1338004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2902328054 0 0) 0x7f13380065c0 con 0x7f1338002860 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 10 monclient(hunting): my global_id is 5206 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13500015e0 con 0x7f1338002860 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2952254745 0 0) 0x7f13500015e0 con 0x7f1338002860 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13380065c0 con 0x7f1338002860 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1348003e90 con 0x7f1338002860 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 10 monclient: dump: 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.866 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 529131936 0 0) 0x7f13380065c0 con 0x7f1338002860 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.843+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f133800a160 con 0x7f1338002860 2024-09-13T10:32:49.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.844+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1348004180 con 0x7f1338002860 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.844+0000 7f133ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.844+0000 7f133ffff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.844+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.181:6791/0 conn(0x7f1338002860 legacy=0x7f1338004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.844+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.181:6791/0 conn(0x7f1338002860 legacy=0x7f1338004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.850+0000 7f135dff8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.850+0000 7f135dff8640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1338009e50 con 0x7f1338009110 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f13577fe640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.181:6791/0 conn(0x7f1338009110 legacy=0x7f13380095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970362444 0 0) 0x7f1338009e50 con 0x7f1338009110 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f133ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f133ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f133ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f133ffff640 10 monclient(hunting): my global_id is 5215 2024-09-13T10:32:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13380065c0 con 0x7f1338009110 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2477946324 0 0) 0x7f13380065c0 con 0x7f1338009110 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1338009e50 con 0x7f1338009110 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1348005b00 con 0x7f1338009110 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f133ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f133ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.852+0000 7f133ffff640 10 monclient: dump: 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2716774736 0 0) 0x7f1338009e50 con 0x7f1338009110 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f133800c3a0 con 0x7f1338009110 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7715 (unknown 0 0 3563060191) 0x7f1348006f30 con 0x7f1338009110 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f133ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f133ffff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:49.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.181:6791/0 conn(0x7f1338009110 legacy=0x7f13380095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f133ffff640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.181:6791/0 conn(0x7f1338009110 legacy=0x7f13380095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:49.871 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 68, 2024-09-13T10:32:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 184303, 2024-09-13T10:32:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:32:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.893 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:49.893 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:49.893 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:49.894 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.894 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:49.894 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:49.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:49.894 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:49.894 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:49.894 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:49.894 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:49.894 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:49.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:49.894 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:49.894 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:49.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f135dff8640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.195:6800/1839191919 conn(0x7f13440406d0 legacy=0x7f1344042b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f135dff8640 10 monclient: shutdown 2024-09-13T10:32:49.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f135dff8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:49.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f135dff8640 1 -- 172.21.15.181:0/1608277540 >> v1:172.21.15.181:6789/0 conn(0x7f13580a6ab0 legacy=0x7f135813be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:49.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f1357fff640 1 -- 172.21.15.181:0/1608277540 reap_dead start 2024-09-13T10:32:49.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f1357fff640 1 -- 172.21.15.181:0/1608277540 reap_dead start 2024-09-13T10:32:49.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f135dff8640 1 -- 172.21.15.181:0/1608277540 shutdown_connections 2024-09-13T10:32:49.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f135dff8640 1 -- 172.21.15.181:0/1608277540 >> 172.21.15.181:0/1608277540 conn(0x7f13580abcd0 msgr2=0x7f13580a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:49.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f135dff8640 1 -- 172.21.15.181:0/1608277540 shutdown_connections 2024-09-13T10:32:49.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.853+0000 7f135dff8640 1 -- 172.21.15.181:0/1608277540 wait complete. 2024-09-13T10:32:49.897 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:32:49.897 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-09-13T10:32:49.897 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:32:49.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.992+0000 7fa9eaa40640 10 monclient: get_monmap_and_config 2024-09-13T10:32:49.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.992+0000 7fa9eaa40640 10 monclient: build_initial_monmap 2024-09-13T10:32:49.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.992+0000 7fa9eaa40640 10 monclient: monmap: 2024-09-13T10:32:49.995 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:49.995 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:49.995 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:49.994564+0000 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:49.994564+0000 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:49.996 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:49.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.993+0000 7fa9eaa40640 1 Processor -- start 2024-09-13T10:32:49.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.993+0000 7fa9eaa40640 1 -- start start 2024-09-13T10:32:49.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.993+0000 7fa9eaa40640 10 monclient: init 2024-09-13T10:32:49.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9eaa40640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:49.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9eaa40640 10 monclient: _add_conns ranks=[5,2,6,4,1,3,8,0,7] 2024-09-13T10:32:49.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9eaa40640 10 monclient(hunting): picked mon.noname-h con 0x7fa9e40a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:49.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9eaa40640 10 monclient(hunting): picked mon.noname-b con 0x7fa9e40a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:49.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9eaa40640 10 monclient(hunting): picked mon.noname-d con 0x7fa9e413f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:49.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9eaa40640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9e40a4bc0 con 0x7fa9e40a8340 2024-09-13T10:32:49.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9eaa40640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9e413a320 con 0x7fa9e40a6640 2024-09-13T10:32:49.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9eaa40640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9e40a8100 con 0x7fa9e413f750 2024-09-13T10:32:49.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9eaa40640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:49.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9eaa40640 10 monclient(hunting): authenticate will time out at 909.500443s 2024-09-13T10:32:49.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9dbfff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fa9e40a8340 0x7fa9e4139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:36702/0 (socket says 172.21.15.181:36702) 2024-09-13T10:32:49.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9e8fdd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fa9e413f750 0x7fa9e4141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54012/0 (socket says 172.21.15.181:54012) 2024-09-13T10:32:49.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.994+0000 7fa9dbfff640 1 -- 172.21.15.181:0/1799705493 learned_addr learned my addr 172.21.15.181:0/1799705493 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:50.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.996+0000 7fa9e8fdd640 1 -- 172.21.15.181:0/1799705493 >> v1:172.21.15.181:6792/0 conn(0x7fa9e413f750 legacy=0x7fa9e4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.996+0000 7fa9dbfff640 1 -- 172.21.15.181:0/1799705493 >> v1:172.21.15.181:6790/0 conn(0x7fa9e40a8340 legacy=0x7fa9e4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.996+0000 7fa9e3fff640 1 -- 172.21.15.181:0/1799705493 >> v1:172.21.15.195:6791/0 conn(0x7fa9e40a6640 legacy=0x7fa9e4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1425043064 0 0) 0x7fa9e40a8100 con 0x7fa9e413f750 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient(hunting): my global_id is 5091 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9d0003520 con 0x7fa9e413f750 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192664169 0 0) 0x7fa9e40a4bc0 con 0x7fa9e40a8340 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient(hunting): my global_id is 64703 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9e40a8100 con 0x7fa9e40a8340 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537275903 0 0) 0x7fa9e413a320 con 0x7fa9e40a6640 2024-09-13T10:32:50.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient(hunting): my global_id is 5252 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9e40a4bc0 con 0x7fa9e40a6640 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2334982283 0 0) 0x7fa9d0003520 con 0x7fa9e413f750 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 >> v1:172.21.15.195:6791/0 conn(0x7fa9e40a6640 legacy=0x7fa9e4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 >> v1:172.21.15.181:6790/0 conn(0x7fa9e40a8340 legacy=0x7fa9e4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient: _finish_hunting 0 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 monclient: found mon.noname-d 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e40a48e0 con 0x7fa9e413f750 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient: _finish_auth 0 2024-09-13T10:32:50.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient: _check_auth_tickets 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa9dc001e60 con 0x7fa9e413f750 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient: dump: 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.005 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.006 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.006 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.006 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.006 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.006 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.006 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.006 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9eaa40640 5 monclient: authenticate success, global_id 5091 2024-09-13T10:32:50.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9eaa40640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:50.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9dc004b60 con 0x7fa9e413f750 2024-09-13T10:32:50.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:50.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9eaa40640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 1 -- 172.21.15.181:0/1799705493 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa9dc0050d0 con 0x7fa9e413f750 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9eaa40640 4 set_mon_vals no callback set 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.997+0000 7fa9e37fe640 10 monclient: dump: 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.007 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.998+0000 7fa9eaa40640 10 monclient: shutdown 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.998+0000 7fa9eaa40640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.998+0000 7fa9eaa40640 1 -- 172.21.15.181:0/1799705493 >> v1:172.21.15.181:6792/0 conn(0x7fa9e413f750 legacy=0x7fa9e4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.998+0000 7fa9eaa40640 1 -- 172.21.15.181:0/1799705493 shutdown_connections 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.998+0000 7fa9eaa40640 1 -- 172.21.15.181:0/1799705493 >> 172.21.15.181:0/1799705493 conn(0x7fa9e4077170 msgr2=0x7fa9e40abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.998+0000 7fa9eaa40640 1 -- 172.21.15.181:0/1799705493 shutdown_connections 2024-09-13T10:32:50.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.998+0000 7fa9eaa40640 1 -- 172.21.15.181:0/1799705493 wait complete. 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.998+0000 7fa9eaa40640 10 monclient: build_initial_monmap 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.998+0000 7fa9eaa40640 10 monclient: monmap: 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:50.009 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 1 Processor -- start 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 1 -- start start 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 10 monclient: init 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 10 monclient: _add_conns ranks=[4,3,6,8,2,5,1,0,7] 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 10 monclient(hunting): picked mon.noname-c con 0x7fa9e40a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 10 monclient(hunting): picked mon.noname-g con 0x7fa9e413f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 10 monclient(hunting): picked mon.noname-d con 0x7fa9e409f780 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:50.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9e40a2880 con 0x7fa9e413f750 2024-09-13T10:32:50.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9e40a09c0 con 0x7fa9e40a8340 2024-09-13T10:32:50.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9e40a0ca0 con 0x7fa9e409f780 2024-09-13T10:32:50.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:50.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9eaa40640 10 monclient(hunting): authenticate will time out at 909.505611s 2024-09-13T10:32:50.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9e3fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fa9e40a8340 0x7fa9e409d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35482/0 (socket says 172.21.15.181:35482) 2024-09-13T10:32:50.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9e3fff640 1 -- 172.21.15.181:0/2826006038 learned_addr learned my addr 172.21.15.181:0/2826006038 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:50.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:49.999+0000 7fa9e8fdd640 1 --1- 172.21.15.181:0/2826006038 >> v1:172.21.15.181:6792/0 conn(0x7fa9e409f780 0x7fa9e41d6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54018/0 (socket says 172.21.15.181:54018) 2024-09-13T10:32:50.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.001+0000 7fa9e3fff640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.181:6791/0 conn(0x7fa9e40a8340 legacy=0x7fa9e409d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.001+0000 7fa9e8fdd640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.181:6792/0 conn(0x7fa9e409f780 legacy=0x7fa9e41d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.001+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1134976147 0 0) 0x7fa9e40a0ca0 con 0x7fa9e409f780 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): my global_id is 5100 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9c4003550 con 0x7fa9e409f780 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374813862 0 0) 0x7fa9e40a09c0 con 0x7fa9e40a8340 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9dbfff640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.195:6790/0 conn(0x7fa9e413f750 legacy=0x7fa9e409d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): my global_id is 5224 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9e40a0ca0 con 0x7fa9e40a8340 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3037684933 0 0) 0x7fa9c4003550 con 0x7fa9e409f780 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa9e40a09c0 con 0x7fa9e409f780 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa9dc0020b0 con 0x7fa9e409f780 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): dump: 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.017 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 677013604 0 0) 0x7fa9e40a0ca0 con 0x7fa9e40a8340 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa9c4003550 con 0x7fa9e40a8340 2024-09-13T10:32:50.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1740762410 0 0) 0x7fa9cc001580 con 0x7fa9e413f750 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): my global_id is 5133 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9e40a0ca0 con 0x7fa9e413f750 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa9d4003610 con 0x7fa9e40a8340 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient(hunting): dump: 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.019 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3890521707 0 0) 0x7fa9e40a09c0 con 0x7fa9e409f780 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.181:6791/0 conn(0x7fa9e40a8340 legacy=0x7fa9e409d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.195:6790/0 conn(0x7fa9e413f750 legacy=0x7fa9e409d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient: _finish_hunting 0 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 monclient: found mon.d 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e40a0110 con 0x7fa9e409f780 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient: _finish_auth 0 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient: _check_auth_tickets 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9eaa40640 5 monclient: authenticate success, global_id 5100 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3144268495 0 0) 0x7fa9c4003550 con 0x7fa9e40a8340 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9eaa40640 10 monclient: _renew_subs 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9eaa40640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:32:50.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9eaa40640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e409ec20 con 0x7fa9e409f780 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9eaa40640 10 monclient: _renew_subs 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9eaa40640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9eaa40640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fa9e40a0f80 con 0x7fa9e409f780 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9dc005300 con 0x7fa9e409f780 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa9dc0057f0 con 0x7fa9e409f780 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e2ffd640 4 set_mon_vals no callback set 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.002+0000 7fa9e17fa640 10 monclient: dump: 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.022 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.023 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.003+0000 7fa9eaa40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.003+0000 7fa9eaa40640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa9c80065c0 con 0x7fa9c8002860 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.003+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa9dc011e70 con 0x7fa9e409f780 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.003+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(81..81 src has 1..81) ==== 3898+0+0 (unknown 372994745 0 0) 0x7fa9dc04e3b0 con 0x7fa9e409f780 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.003+0000 7fa9dbfff640 10 monclient: get_auth_request con 0x7fa9c4040500 auth_method 0 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e3fff640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.181:6792/0 conn(0x7fa9c8002860 legacy=0x7fa9c8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 758822445 0 0) 0x7fa9c80065c0 con 0x7fa9c8002860 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 10 monclient(hunting): my global_id is 5109 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9c4003550 con 0x7fa9c8002860 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 953658878 0 0) 0x7fa9c4003550 con 0x7fa9c8002860 2024-09-13T10:32:50.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa9c80065c0 con 0x7fa9c8002860 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa9d4004180 con 0x7fa9c8002860 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 10 monclient: dump: 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.025 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2912652114 0 0) 0x7fa9c80065c0 con 0x7fa9c8002860 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.005+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9c800a160 con 0x7fa9c8002860 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.006+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa9d4004430 con 0x7fa9c8002860 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.006+0000 7fa9e17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.006+0000 7fa9e17fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.006+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.181:6792/0 conn(0x7fa9c8002860 legacy=0x7fa9c8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.006+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.181:6792/0 conn(0x7fa9c8002860 legacy=0x7fa9c8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:50.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.012+0000 7fa9eaa40640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:50.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.012+0000 7fa9eaa40640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa9c8009e70 con 0x7fa9c8009130 2024-09-13T10:32:50.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e3fff640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.181:6792/0 conn(0x7fa9c8009130 legacy=0x7fa9c80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1741263704 0 0) 0x7fa9c8009e70 con 0x7fa9c8009130 2024-09-13T10:32:50.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 10 monclient(hunting): my global_id is 5118 2024-09-13T10:32:50.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9c80065c0 con 0x7fa9c8009130 2024-09-13T10:32:50.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2055406630 0 0) 0x7fa9c80065c0 con 0x7fa9c8009130 2024-09-13T10:32:50.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa9c8009e70 con 0x7fa9c8009130 2024-09-13T10:32:50.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa9d4005cf0 con 0x7fa9c8009130 2024-09-13T10:32:50.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:50.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 10 monclient: dump: 2024-09-13T10:32:50.029 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.029 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.029 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2736808418 0 0) 0x7fa9c8009e70 con 0x7fa9c8009130 2024-09-13T10:32:50.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.014+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa9c800c410 con 0x7fa9c8009130 2024-09-13T10:32:50.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7548 (unknown 0 0 4012621189) 0x7fa9d4007ff0 con 0x7fa9c8009130 2024-09-13T10:32:50.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9e17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:50.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9e17fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:50.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.181:6792/0 conn(0x7fa9c8009130 legacy=0x7fa9c80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9e17fa640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.181:6792/0 conn(0x7fa9c8009130 legacy=0x7fa9c80095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:50.031 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:50.031 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:50.031 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:50.031 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 68, 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 184459, 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:32:50.032 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:50.034 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:50.035 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:50.036 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.037 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.038 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.039 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.040 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.041 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:50.042 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:50.044 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:50.045 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.045 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.045 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.045 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:50.045 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:50.045 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.045 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.045 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:50.046 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.047 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.048 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:50.049 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.050 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.050 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:50.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.050 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:50.050 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:50.050 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:50.050 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.050 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.050 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:50.050 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:50.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9eaa40640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa9c4040500 legacy=0x7fa9c40429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9eaa40640 10 monclient: shutdown 2024-09-13T10:32:50.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9eaa40640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:50.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9eaa40640 1 -- 172.21.15.181:0/2826006038 >> v1:172.21.15.181:6792/0 conn(0x7fa9e409f780 legacy=0x7fa9e41d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9e8fdd640 1 -- 172.21.15.181:0/2826006038 reap_dead start 2024-09-13T10:32:50.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9e8fdd640 1 -- 172.21.15.181:0/2826006038 reap_dead start 2024-09-13T10:32:50.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9eaa40640 1 -- 172.21.15.181:0/2826006038 shutdown_connections 2024-09-13T10:32:50.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9eaa40640 1 -- 172.21.15.181:0/2826006038 >> 172.21.15.181:0/2826006038 conn(0x7fa9e40a6640 msgr2=0x7fa9e40ab2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:50.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9eaa40640 1 -- 172.21.15.181:0/2826006038 shutdown_connections 2024-09-13T10:32:50.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.015+0000 7fa9eaa40640 1 -- 172.21.15.181:0/2826006038 wait complete. 2024-09-13T10:32:50.052 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:32:50.053 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-09-13T10:32:50.053 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:32:50.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.151+0000 7f2993c86640 10 monclient: get_monmap_and_config 2024-09-13T10:32:50.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.151+0000 7f2993c86640 10 monclient: build_initial_monmap 2024-09-13T10:32:50.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.151+0000 7f2993c86640 10 monclient: monmap: 2024-09-13T10:32:50.154 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:50.154 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.154 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:50.153137+0000 2024-09-13T10:32:50.154 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:50.153137+0000 2024-09-13T10:32:50.154 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:50.154 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.155 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:50.155 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:50.155 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:50.155 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:50.155 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:50.155 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:50.155 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:50.155 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:50.155 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:50.155 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 1 Processor -- start 2024-09-13T10:32:50.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 1 -- start start 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 10 monclient: init 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 10 monclient: _add_conns ranks=[0,3,8,6,2,7,4,5,1] 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 10 monclient(hunting): picked mon.noname-a con 0x7f298c0a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 10 monclient(hunting): picked mon.noname-g con 0x7f298c0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 10 monclient(hunting): picked mon.noname-e con 0x7f298c13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f298c0a4bc0 con 0x7f298c0a6640 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f298c13a320 con 0x7f298c0a8340 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f298c0a8100 con 0x7f298c13f750 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2993c86640 10 monclient(hunting): authenticate will time out at 909.658875s 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2992223640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f298c13f750 legacy=0x7f298c141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2991a22640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f298c0a6640 0x7f298c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:46000/0 (socket says 172.21.15.181:46000) 2024-09-13T10:32:50.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.152+0000 7f2991a22640 1 -- 172.21.15.181:0/3691204833 learned_addr learned my addr 172.21.15.181:0/3691204833 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:50.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2991a22640 1 -- 172.21.15.181:0/3691204833 >> v1:172.21.15.181:6789/0 conn(0x7f298c0a6640 legacy=0x7f298c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 1 -- 172.21.15.181:0/3691204833 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966482929 0 0) 0x7f298c0a4bc0 con 0x7f298c0a6640 2024-09-13T10:32:50.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient(hunting): my global_id is 55053 2024-09-13T10:32:50.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 1 -- 172.21.15.181:0/3691204833 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2978003520 con 0x7f298c0a6640 2024-09-13T10:32:50.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2991221640 1 -- 172.21.15.181:0/3691204833 >> v1:172.21.15.195:6790/0 conn(0x7f298c0a8340 legacy=0x7f298c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 1 -- 172.21.15.181:0/3691204833 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1852261934 0 0) 0x7f2978003520 con 0x7f298c0a6640 2024-09-13T10:32:50.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 1 -- 172.21.15.181:0/3691204833 >> v1:172.21.15.181:6793/0 conn(0x7f298c13f750 legacy=0x7f298c141b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:32:50.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 1 -- 172.21.15.181:0/3691204833 >> v1:172.21.15.195:6790/0 conn(0x7f298c0a8340 legacy=0x7f298c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient: _finish_hunting 0 2024-09-13T10:32:50.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 1 monclient: found mon.noname-a 2024-09-13T10:32:50.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:50.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:32:50.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 1 -- 172.21.15.181:0/3691204833 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c0a48e0 con 0x7f298c0a6640 2024-09-13T10:32:50.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient: _finish_auth 0 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient: _check_auth_tickets 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2993c86640 5 monclient: authenticate success, global_id 55053 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 1 -- 172.21.15.181:0/3691204833 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2988001ae0 con 0x7f298c0a6640 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2993c86640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient: dump: 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.163 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.164 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.164 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.164 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.164 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.164 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.164 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.164 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.164 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.164 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2993c86640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 1 -- 172.21.15.181:0/3691204833 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f29880048a0 con 0x7f298c0a6640 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 1 -- 172.21.15.181:0/3691204833 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2988004e10 con 0x7f298c0a6640 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2990a20640 10 monclient: dump: 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.165 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2993c86640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.155+0000 7f2993c86640 4 set_mon_vals no callback set 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.156+0000 7f2993c86640 10 monclient: shutdown 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.156+0000 7f2993c86640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.156+0000 7f2993c86640 1 -- 172.21.15.181:0/3691204833 >> v1:172.21.15.181:6789/0 conn(0x7f298c0a6640 legacy=0x7f298c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.156+0000 7f2993c86640 1 -- 172.21.15.181:0/3691204833 shutdown_connections 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.156+0000 7f2993c86640 1 -- 172.21.15.181:0/3691204833 >> 172.21.15.181:0/3691204833 conn(0x7f298c077170 msgr2=0x7f298c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.156+0000 7f2993c86640 1 -- 172.21.15.181:0/3691204833 shutdown_connections 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.156+0000 7f2993c86640 1 -- 172.21.15.181:0/3691204833 wait complete. 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.156+0000 7f2993c86640 10 monclient: build_initial_monmap 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.156+0000 7f2993c86640 10 monclient: monmap: 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:50.167 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 1 Processor -- start 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 1 -- start start 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 10 monclient: init 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 10 monclient: _add_conns ranks=[4,1,6,7,8,3,2,5,0] 2024-09-13T10:32:50.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 10 monclient(hunting): picked mon.noname-c con 0x7f298c0a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:50.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 10 monclient(hunting): picked mon.noname-f con 0x7f298c13f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:50.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 10 monclient(hunting): picked mon.noname-d con 0x7f298c0a0a40 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:50.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f298c09fee0 con 0x7f298c13f750 2024-09-13T10:32:50.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f298c09f210 con 0x7f298c0a8340 2024-09-13T10:32:50.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f298c0a0e80 con 0x7f298c0a0a40 2024-09-13T10:32:50.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:50.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2993c86640 10 monclient(hunting): authenticate will time out at 909.663696s 2024-09-13T10:32:50.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2991a22640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f298c0a8340 0x7f298c09e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35494/0 (socket says 172.21.15.181:35494) 2024-09-13T10:32:50.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.157+0000 7f2991a22640 1 -- 172.21.15.181:0/3898048492 learned_addr learned my addr 172.21.15.181:0/3898048492 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.159+0000 7f2991a22640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.181:6791/0 conn(0x7f298c0a8340 legacy=0x7f298c09e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.159+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.159+0000 7f2992223640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.181:6792/0 conn(0x7f298c0a0a40 legacy=0x7f298c1da7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.160+0000 7f2991221640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.195:6789/0 conn(0x7f298c13f750 legacy=0x7f298c09eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.161+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908457282 0 0) 0x7f298c09f210 con 0x7f298c0a8340 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.161+0000 7f29827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.161+0000 7f29827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.161+0000 7f29827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.161+0000 7f29827fc640 10 monclient(hunting): my global_id is 5233 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.161+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2970003520 con 0x7f298c0a8340 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.161+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1281987858 0 0) 0x7f298c0a0e80 con 0x7f298c0a0a40 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.161+0000 7f29827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.161+0000 7f29827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.161+0000 7f29827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.161+0000 7f29827fc640 10 monclient(hunting): my global_id is 5127 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.162+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f298c09f210 con 0x7f298c0a0a40 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.164+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4073489489 0 0) 0x7f298c09fee0 con 0x7f298c13f750 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.164+0000 7f29827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.164+0000 7f29827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.164+0000 7f29827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.164+0000 7f29827fc640 10 monclient(hunting): my global_id is 55279 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.164+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f298c0a0e80 con 0x7f298c13f750 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.165+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3507544939 0 0) 0x7f298c0a0e80 con 0x7f298c13f750 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.165+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f298c09fee0 con 0x7f298c13f750 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.165+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f297c003610 con 0x7f298c13f750 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.165+0000 7f29827fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:50.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.165+0000 7f29827fc640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.165+0000 7f29827fc640 10 monclient(hunting): dump: 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.174 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.174 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.174 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.174 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.165+0000 7f29827fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:50.265 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36702]: starting. 2024-09-13T10:32:50.265 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36702]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36701 2024-09-13T10:32:50.265 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36702]: created object 0... 2024-09-13T10:32:50.265 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36702]: created object 25... 2024-09-13T10:32:50.265 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36702]: created object 49... 2024-09-13T10:32:50.265 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36702]: finishing. 2024-09-13T10:32:50.265 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36702]: shutting down. 2024-09-13T10:32:50.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.504+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1272041463 0 0) 0x7f298c09fee0 con 0x7f298c13f750 2024-09-13T10:32:50.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.504+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.181:6792/0 conn(0x7f298c0a0a40 legacy=0x7f298c1da7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.504+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.181:6791/0 conn(0x7f298c0a8340 legacy=0x7f298c09e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.504+0000 7f29827fc640 10 monclient: _finish_hunting 0 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.504+0000 7f29827fc640 1 monclient: found mon.f 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f29827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f29827fc640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c0a19a0 con 0x7f298c13f750 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f29827fc640 10 monclient: _finish_auth 0 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f29827fc640 10 monclient: _check_auth_tickets 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f29827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f2993c86640 5 monclient: authenticate success, global_id 55279 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f2993c86640 10 monclient: _renew_subs 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f2993c86640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f2993c86640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f298c0a1c80 con 0x7f298c13f750 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f2993c86640 10 monclient: _renew_subs 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f2993c86640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:32:50.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f2993c86640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f298c1dbf10 con 0x7f298c13f750 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f297c003b10 con 0x7f298c13f750 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f29827fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f2983fff640 4 set_mon_vals no callback set 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f297c004040 con 0x7f298c13f750 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f29827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f29827fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.505+0000 7f29827fc640 10 monclient: dump: 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.511 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.506+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f297c0042e0 con 0x7f298c13f750 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.506+0000 7f2993c86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.506+0000 7f2993c86640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f29740065c0 con 0x7f2974002860 2024-09-13T10:32:50.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.506+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(82..82 src has 1..82) ==== 3898+0+0 (unknown 685167114 0 0) 0x7f297c04e200 con 0x7f298c13f750 2024-09-13T10:32:50.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.506+0000 7f2992223640 10 monclient: get_auth_request con 0x7f297003fb20 auth_method 0 2024-09-13T10:32:50.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.508+0000 7f2991a22640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.195:6789/0 conn(0x7f2974002860 legacy=0x7f2974004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.508+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1960888545 0 0) 0x7f29740065c0 con 0x7f2974002860 2024-09-13T10:32:50.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.508+0000 7f29827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.508+0000 7f29827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.508+0000 7f29827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.508+0000 7f29827fc640 10 monclient(hunting): my global_id is 55288 2024-09-13T10:32:50.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.508+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f298c09fee0 con 0x7f2974002860 2024-09-13T10:32:50.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2727983743 0 0) 0x7f298c09fee0 con 0x7f2974002860 2024-09-13T10:32:50.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29740065c0 con 0x7f2974002860 2024-09-13T10:32:50.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f29880048a0 con 0x7f2974002860 2024-09-13T10:32:50.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 10 monclient: dump: 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.516 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.517 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.517 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.517 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.517 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 588858342 0 0) 0x7f29740065c0 con 0x7f2974002860 2024-09-13T10:32:50.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f297400a160 con 0x7f2974002860 2024-09-13T10:32:50.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2988004ae0 con 0x7f2974002860 2024-09-13T10:32:50.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:50.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:50.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.195:6789/0 conn(0x7f2974002860 legacy=0x7f2974004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.509+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.195:6789/0 conn(0x7f2974002860 legacy=0x7f2974004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:50.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.515+0000 7f2993c86640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:50.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.515+0000 7f2993c86640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2974009e70 con 0x7f2974009130 2024-09-13T10:32:50.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f2991a22640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.195:6789/0 conn(0x7f2974009130 legacy=0x7f29740095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004388863 0 0) 0x7f2974009e70 con 0x7f2974009130 2024-09-13T10:32:50.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 10 monclient(hunting): my global_id is 55297 2024-09-13T10:32:50.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29740065c0 con 0x7f2974009130 2024-09-13T10:32:50.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4088422940 0 0) 0x7f29740065c0 con 0x7f2974009130 2024-09-13T10:32:50.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2974009e70 con 0x7f2974009130 2024-09-13T10:32:50.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2988005490 con 0x7f2974009130 2024-09-13T10:32:50.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 10 monclient: dump: 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.523 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.524 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.524 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.524 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.524 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.524 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2842609615 0 0) 0x7f2974009e70 con 0x7f2974009130 2024-09-13T10:32:50.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.518+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f297400c410 con 0x7f2974009130 2024-09-13T10:32:50.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7882 (unknown 0 0 990451329) 0x7f2988008600 con 0x7f2974009130 2024-09-13T10:32:50.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f29827fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:50.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f29827fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:50.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.195:6789/0 conn(0x7f2974009130 legacy=0x7f29740095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f29827fc640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.195:6789/0 conn(0x7f2974009130 legacy=0x7f29740095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:50.525 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 68, 2024-09-13T10:32:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 184928, 2024-09-13T10:32:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:32:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:32:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:50.546 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:50.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f2993c86640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.195:6800/1839191919 conn(0x7f297003fb20 legacy=0x7f2970041fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f2993c86640 10 monclient: shutdown 2024-09-13T10:32:50.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f2993c86640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:50.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f2993c86640 1 -- 172.21.15.181:0/3898048492 >> v1:172.21.15.195:6789/0 conn(0x7f298c13f750 legacy=0x7f298c09eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f2992223640 1 -- 172.21.15.181:0/3898048492 reap_dead start 2024-09-13T10:32:50.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f2992223640 1 -- 172.21.15.181:0/3898048492 reap_dead start 2024-09-13T10:32:50.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f2993c86640 1 -- 172.21.15.181:0/3898048492 shutdown_connections 2024-09-13T10:32:50.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f2993c86640 1 -- 172.21.15.181:0/3898048492 >> 172.21.15.181:0/3898048492 conn(0x7f298c0a6640 msgr2=0x7f298c0ab330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:50.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f2993c86640 1 -- 172.21.15.181:0/3898048492 shutdown_connections 2024-09-13T10:32:50.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.519+0000 7f2993c86640 1 -- 172.21.15.181:0/3898048492 wait complete. 2024-09-13T10:32:50.549 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:32:50.549 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-09-13T10:32:50.549 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:32:50.611 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36703]: starting. 2024-09-13T10:32:50.611 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36703]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36701 2024-09-13T10:32:50.611 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36703]: shutting down. 2024-09-13T10:32:50.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.651+0000 7f6fe993a640 10 monclient: get_monmap_and_config 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.651+0000 7f6fe993a640 10 monclient: build_initial_monmap 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.651+0000 7f6fe993a640 10 monclient: monmap: 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:50.652989+0000 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:50.652989+0000 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:50.654 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:50.655 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:50.655 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.651+0000 7f6fe993a640 1 Processor -- start 2024-09-13T10:32:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.651+0000 7f6fe993a640 1 -- start start 2024-09-13T10:32:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.651+0000 7f6fe993a640 10 monclient: init 2024-09-13T10:32:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.652+0000 7f6fe993a640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:50.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.652+0000 7f6fe993a640 10 monclient: _add_conns ranks=[2,5,7,3,6,1,4,8,0] 2024-09-13T10:32:50.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.652+0000 7f6fe993a640 10 monclient(hunting): picked mon.noname-b con 0x7f6fe40a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:50.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.652+0000 7f6fe993a640 10 monclient(hunting): picked mon.noname-h con 0x7f6fe40a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:50.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.652+0000 7f6fe993a640 10 monclient(hunting): picked mon.noname-i con 0x7f6fe413f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:50.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.652+0000 7f6fe993a640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe40a5fe0 con 0x7f6fe40a66d0 2024-09-13T10:32:50.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.652+0000 7f6fe993a640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe40a8080 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.652+0000 7f6fe993a640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe40a42c0 con 0x7f6fe413f9a0 2024-09-13T10:32:50.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.652+0000 7f6fe993a640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:50.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.652+0000 7f6fe993a640 10 monclient(hunting): authenticate will time out at 910.158510s 2024-09-13T10:32:50.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.652+0000 7f6fe2ffd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f6fe40a66d0 0x7f6fe40a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:36718/0 (socket says 172.21.15.181:36718) 2024-09-13T10:32:50.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.652+0000 7f6fe2ffd640 1 -- 172.21.15.181:0/3951983554 learned_addr learned my addr 172.21.15.181:0/3951983554 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:50.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.654+0000 7f6fe2ffd640 1 -- 172.21.15.181:0/3951983554 >> v1:172.21.15.181:6790/0 conn(0x7f6fe40a66d0 legacy=0x7f6fe40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe27fc640 1 -- 172.21.15.181:0/3951983554 >> v1:172.21.15.195:6791/0 conn(0x7f6fe40a6ab0 legacy=0x7f6fe40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe37fe640 1 -- 172.21.15.181:0/3951983554 >> v1:172.21.15.195:6792/0 conn(0x7f6fe413f9a0 legacy=0x7f6fe4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3010692617 0 0) 0x7f6fe40a5fe0 con 0x7f6fe40a66d0 2024-09-13T10:32:50.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient(hunting): my global_id is 64721 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fcc003520 con 0x7f6fe40a66d0 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4023461452 0 0) 0x7f6fe40a8080 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient(hunting): my global_id is 5270 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fe40a5fe0 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4293168520 0 0) 0x7f6fe40a42c0 con 0x7f6fe413f9a0 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient(hunting): my global_id is 55249 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fe40a8080 con 0x7f6fe413f9a0 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1107141654 0 0) 0x7f6fcc003520 con 0x7f6fe40a66d0 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 >> v1:172.21.15.195:6792/0 conn(0x7f6fe413f9a0 legacy=0x7f6fe4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 >> v1:172.21.15.195:6791/0 conn(0x7f6fe40a6ab0 legacy=0x7f6fe40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 monclient: found mon.noname-b 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe41464e0 con 0x7f6fe40a66d0 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient: _finish_auth 0 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:50.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fd4001ad0 con 0x7f6fe40a66d0 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient: dump: 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.664 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.665 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.665 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.665 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.665 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.665 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.665 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe993a640 5 monclient: authenticate success, global_id 64721 2024-09-13T10:32:50.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe993a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:50.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fd40048a0 con 0x7f6fe40a66d0 2024-09-13T10:32:50.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:50.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 1 -- 172.21.15.181:0/3951983554 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fd4004e10 con 0x7f6fe40a66d0 2024-09-13T10:32:50.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe993a640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe993a640 4 set_mon_vals no callback set 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe1ffb640 10 monclient: dump: 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.666 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe993a640 10 monclient: shutdown 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe993a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe993a640 1 -- 172.21.15.181:0/3951983554 >> v1:172.21.15.181:6790/0 conn(0x7f6fe40a66d0 legacy=0x7f6fe40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe993a640 1 -- 172.21.15.181:0/3951983554 shutdown_connections 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.655+0000 7f6fe993a640 1 -- 172.21.15.181:0/3951983554 >> 172.21.15.181:0/3951983554 conn(0x7f6fe40abcd0 msgr2=0x7f6fe40ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.656+0000 7f6fe993a640 1 -- 172.21.15.181:0/3951983554 shutdown_connections 2024-09-13T10:32:50.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.656+0000 7f6fe993a640 1 -- 172.21.15.181:0/3951983554 wait complete. 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.656+0000 7f6fe993a640 10 monclient: build_initial_monmap 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.656+0000 7f6fe993a640 10 monclient: monmap: 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:50.668 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.656+0000 7f6fe993a640 1 Processor -- start 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe993a640 1 -- start start 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe993a640 10 monclient: init 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe993a640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe993a640 10 monclient: _add_conns ranks=[0,6,5,1,2,4,7,3,8] 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe993a640 10 monclient(hunting): picked mon.noname-a con 0x7f6fe40a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe993a640 10 monclient(hunting): picked mon.noname-d con 0x7f6fe40a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:32:50.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe993a640 10 monclient(hunting): picked mon.noname-h con 0x7f6fe413f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:50.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe993a640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe40a2a90 con 0x7f6fe40a66d0 2024-09-13T10:32:50.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe993a640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe41cf210 con 0x7f6fe413f9a0 2024-09-13T10:32:50.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe993a640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe413ce80 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe993a640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:50.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe993a640 10 monclient(hunting): authenticate will time out at 910.163498s 2024-09-13T10:32:50.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe2ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6fe40a66d0 0x7f6fe41ce3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:46002/0 (socket says 172.21.15.181:46002) 2024-09-13T10:32:50.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe2ffd640 1 -- 172.21.15.181:0/2782199640 learned_addr learned my addr 172.21.15.181:0/2782199640 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:50.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.657+0000 7f6fe27fc640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f6fe40a6ab0 0x7f6fe41ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54056/0 (socket says 172.21.15.181:54056) 2024-09-13T10:32:50.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fe2ffd640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.181:6789/0 conn(0x7f6fe40a66d0 legacy=0x7f6fe41ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fe27fc640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.181:6792/0 conn(0x7f6fe40a6ab0 legacy=0x7f6fe41ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fe37fe640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.195:6791/0 conn(0x7f6fe413f9a0 legacy=0x7f6fe41d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2689000965 0 0) 0x7f6fe413ce80 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fcbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fcbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fcbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fcbfff640 10 monclient(hunting): my global_id is 5163 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd0003520 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3545013541 0 0) 0x7f6fe40a2a90 con 0x7f6fe40a66d0 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fcbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fcbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fcbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fcbfff640 10 monclient(hunting): my global_id is 55062 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.659+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fe413ce80 con 0x7f6fe40a66d0 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314383298 0 0) 0x7f6fe41cf210 con 0x7f6fe413f9a0 2024-09-13T10:32:50.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient(hunting): my global_id is 5279 2024-09-13T10:32:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fe40a2a90 con 0x7f6fe413f9a0 2024-09-13T10:32:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1443900759 0 0) 0x7f6fd0003520 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fe41cf210 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fd8003610 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:32:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient(hunting): dump: 2024-09-13T10:32:50.677 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.678 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.679 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.679 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.679 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.679 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.679 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:50.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 753804939 0 0) 0x7f6fe413ce80 con 0x7f6fe40a66d0 2024-09-13T10:32:50.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fd0003520 con 0x7f6fe40a66d0 2024-09-13T10:32:50.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fd4004d90 con 0x7f6fe40a66d0 2024-09-13T10:32:50.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:50.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:50.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient(hunting): dump: 2024-09-13T10:32:50.680 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.680 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.680 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.681 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.682 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3616428344 0 0) 0x7f6fe41cf210 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.195:6791/0 conn(0x7f6fe413f9a0 legacy=0x7f6fe41d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.181:6789/0 conn(0x7f6fe40a66d0 legacy=0x7f6fe41ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient: _finish_hunting 0 2024-09-13T10:32:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 monclient: found mon.d 2024-09-13T10:32:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:32:50.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe4068960 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient: _finish_auth 0 2024-09-13T10:32:50.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient: _check_auth_tickets 2024-09-13T10:32:50.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:50.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fe993a640 5 monclient: authenticate success, global_id 5163 2024-09-13T10:32:50.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fe993a640 10 monclient: _renew_subs 2024-09-13T10:32:50.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fe993a640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:32:50.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fe993a640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe413e370 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fe993a640 10 monclient: _renew_subs 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fe993a640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fe993a640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f6fe413f690 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fd8003b20 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fd8004090 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fe17fa640 4 set_mon_vals no callback set 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.660+0000 7f6fcbfff640 10 monclient: dump: 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.684 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.661+0000 7f6fe993a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.661+0000 7f6fe993a640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6fc40065c0 con 0x7f6fc4002860 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.661+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6fd8004330 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.661+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(83..83 src has 1..83) ==== 3506+0+0 (unknown 1943073602 0 0) 0x7f6fd804e1c0 con 0x7f6fe40a6ab0 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.661+0000 7f6fe37fe640 10 monclient: get_auth_request con 0x7f6fd003fff0 auth_method 0 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.663+0000 7f6fe2ffd640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.195:6790/0 conn(0x7f6fc4002860 legacy=0x7f6fc4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.663+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3515603214 0 0) 0x7f6fc40065c0 con 0x7f6fc4002860 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.663+0000 7f6fcbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.663+0000 7f6fcbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.663+0000 7f6fcbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.663+0000 7f6fcbfff640 10 monclient(hunting): my global_id is 5160 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.663+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fe41cf210 con 0x7f6fc4002860 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 286531124 0 0) 0x7f6fe41cf210 con 0x7f6fc4002860 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fc40065c0 con 0x7f6fc4002860 2024-09-13T10:32:50.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fd40048a0 con 0x7f6fc4002860 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 10 monclient: dump: 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.687 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.688 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.688 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.688 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.688 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.688 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3921543134 0 0) 0x7f6fc40065c0 con 0x7f6fc4002860 2024-09-13T10:32:50.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fc400a160 con 0x7f6fc4002860 2024-09-13T10:32:50.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6fd4005490 con 0x7f6fc4002860 2024-09-13T10:32:50.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:50.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:50.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.195:6790/0 conn(0x7f6fc4002860 legacy=0x7f6fc4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.664+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.195:6790/0 conn(0x7f6fc4002860 legacy=0x7f6fc4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:50.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.670+0000 7f6fe993a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:50.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.670+0000 7f6fe993a640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6fc4009e70 con 0x7f6fc4009130 2024-09-13T10:32:50.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.673+0000 7f6fe2ffd640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.195:6790/0 conn(0x7f6fc4009130 legacy=0x7f6fc40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.673+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51889926 0 0) 0x7f6fc4009e70 con 0x7f6fc4009130 2024-09-13T10:32:50.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.673+0000 7f6fcbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.673+0000 7f6fcbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.673+0000 7f6fcbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.673+0000 7f6fcbfff640 10 monclient(hunting): my global_id is 5169 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.673+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fc40065c0 con 0x7f6fc4009130 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.673+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 449680887 0 0) 0x7f6fc40065c0 con 0x7f6fc4009130 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.674+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fc4009e70 con 0x7f6fc4009130 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.674+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6fd4005bb0 con 0x7f6fc4009130 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.674+0000 7f6fcbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.674+0000 7f6fcbfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.674+0000 7f6fcbfff640 10 monclient: dump: 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.691 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.674+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1873246757 0 0) 0x7f6fc4009e70 con 0x7f6fc4009130 2024-09-13T10:32:50.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.674+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6fc400c410 con 0x7f6fc4009130 2024-09-13T10:32:50.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.674+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7550 (unknown 0 0 795445423) 0x7f6fd4007e50 con 0x7f6fc4009130 2024-09-13T10:32:50.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.674+0000 7f6fcbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:50.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.674+0000 7f6fcbfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:50.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.674+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.195:6790/0 conn(0x7f6fc4009130 legacy=0x7f6fc40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.674+0000 7f6fcbfff640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.195:6790/0 conn(0x7f6fc4009130 legacy=0x7f6fc40095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:50.696 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:50.696 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:50.696 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:50.696 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:32:50.696 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 68, 2024-09-13T10:32:50.696 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 185090, 2024-09-13T10:32:50.696 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:50.696 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:50.697 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:50.698 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:50.698 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:50.698 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:50.698 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:50.698 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:50.698 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:50.698 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:50.698 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:50.698 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:50.698 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:50.699 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:50.700 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:50.701 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.702 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.703 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.704 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.706 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:50.706 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:50.706 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.706 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.706 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.706 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:50.706 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:50.706 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.706 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.707 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:50.708 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.709 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.711 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.712 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:50.714 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:50.715 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:50.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.675+0000 7f6fe993a640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6fd003fff0 legacy=0x7f6fd00424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.675+0000 7f6fe993a640 10 monclient: shutdown 2024-09-13T10:32:50.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.675+0000 7f6fe993a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:50.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.675+0000 7f6fe993a640 1 -- 172.21.15.181:0/2782199640 >> v1:172.21.15.181:6792/0 conn(0x7f6fe40a6ab0 legacy=0x7f6fe41ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.675+0000 7f6fe37fe640 1 -- 172.21.15.181:0/2782199640 reap_dead start 2024-09-13T10:32:50.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.675+0000 7f6fe37fe640 1 -- 172.21.15.181:0/2782199640 reap_dead start 2024-09-13T10:32:50.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.675+0000 7f6fe993a640 1 -- 172.21.15.181:0/2782199640 shutdown_connections 2024-09-13T10:32:50.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.675+0000 7f6fe993a640 1 -- 172.21.15.181:0/2782199640 >> 172.21.15.181:0/2782199640 conn(0x7f6fe40abcd0 msgr2=0x7f6fe40a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.675+0000 7f6fe993a640 1 -- 172.21.15.181:0/2782199640 shutdown_connections 2024-09-13T10:32:50.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.675+0000 7f6fe993a640 1 -- 172.21.15.181:0/2782199640 wait complete. 2024-09-13T10:32:50.718 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:32:50.718 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-09-13T10:32:50.718 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:32:50.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.812+0000 7f431c756640 10 monclient: get_monmap_and_config 2024-09-13T10:32:50.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.812+0000 7f431c756640 10 monclient: build_initial_monmap 2024-09-13T10:32:50.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.813+0000 7f431c756640 10 monclient: monmap: 2024-09-13T10:32:50.815 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:50.815 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.815 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:50.814587+0000 2024-09-13T10:32:50.815 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:50.814587+0000 2024-09-13T10:32:50.816 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:50.816 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.816 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:50.816 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:50.816 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:50.816 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:50.816 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:50.816 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:50.816 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:50.816 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:50.816 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:50.816 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.813+0000 7f431c756640 1 Processor -- start 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.813+0000 7f431c756640 1 -- start start 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.813+0000 7f431c756640 10 monclient: init 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f431c756640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f431c756640 10 monclient: _add_conns ranks=[2,0,8,6,5,4,7,3,1] 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f431c756640 10 monclient(hunting): picked mon.noname-b con 0x7f43140a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f431c756640 10 monclient(hunting): picked mon.noname-a con 0x7f43140a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f431c756640 10 monclient(hunting): picked mon.noname-e con 0x7f431413f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f431c756640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140a4bc0 con 0x7f43140a8340 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f431c756640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431413a320 con 0x7f43140a6640 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f431c756640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140a8100 con 0x7f431413f750 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f431c756640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:50.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f431c756640 10 monclient(hunting): authenticate will time out at 910.320331s 2024-09-13T10:32:50.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f431acf3640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f431413f750 legacy=0x7f4314141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:32:50.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f4319cf1640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f43140a8340 0x7f4314139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:46014/0 (socket says 172.21.15.181:46014) 2024-09-13T10:32:50.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f4319cf1640 1 -- 172.21.15.181:0/1682372566 learned_addr learned my addr 172.21.15.181:0/1682372566 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:50.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.814+0000 7f431a4f2640 1 --1- 172.21.15.181:0/1682372566 >> v1:172.21.15.181:6790/0 conn(0x7f43140a6640 0x7f4314139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:36734/0 (socket says 172.21.15.181:36734) 2024-09-13T10:32:50.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f4319cf1640 1 -- 172.21.15.181:0/1682372566 >> v1:172.21.15.181:6789/0 conn(0x7f43140a8340 legacy=0x7f4314139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f431a4f2640 1 -- 172.21.15.181:0/1682372566 >> v1:172.21.15.181:6790/0 conn(0x7f43140a6640 legacy=0x7f4314139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f43194f0640 1 -- 172.21.15.181:0/1682372566 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2218131616 0 0) 0x7f431413a320 con 0x7f43140a6640 2024-09-13T10:32:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f43194f0640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f43194f0640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f43194f0640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f43194f0640 10 monclient(hunting): my global_id is 64730 2024-09-13T10:32:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f43194f0640 1 -- 172.21.15.181:0/1682372566 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4300003520 con 0x7f43140a6640 2024-09-13T10:32:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f43194f0640 1 -- 172.21.15.181:0/1682372566 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2682313474 0 0) 0x7f43140a4bc0 con 0x7f43140a8340 2024-09-13T10:32:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f43194f0640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f43194f0640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f43194f0640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f43194f0640 10 monclient(hunting): my global_id is 55071 2024-09-13T10:32:50.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.816+0000 7f43194f0640 1 -- 172.21.15.181:0/1682372566 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f431413a320 con 0x7f43140a8340 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 1 -- 172.21.15.181:0/1682372566 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1793802308 0 0) 0x7f431413a320 con 0x7f43140a8340 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 1 -- 172.21.15.181:0/1682372566 >> v1:172.21.15.181:6793/0 conn(0x7f431413f750 legacy=0x7f4314141b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 1 -- 172.21.15.181:0/1682372566 >> v1:172.21.15.181:6790/0 conn(0x7f43140a6640 legacy=0x7f4314139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 10 monclient: _finish_hunting 0 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 1 monclient: found mon.noname-a 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 1 -- 172.21.15.181:0/1682372566 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43140a48e0 con 0x7f43140a8340 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 10 monclient: _finish_auth 0 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 10 monclient: _check_auth_tickets 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f431c756640 5 monclient: authenticate success, global_id 55071 2024-09-13T10:32:50.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 1 -- 172.21.15.181:0/1682372566 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4304001a40 con 0x7f43140a8340 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f431c756640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 10 monclient: dump: 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.829 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f431c756640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 1 -- 172.21.15.181:0/1682372566 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4304001d10 con 0x7f43140a8340 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f431c756640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 1 -- 172.21.15.181:0/1682372566 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4304004be0 con 0x7f43140a8340 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f431c756640 4 set_mon_vals no callback set 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f43194f0640 10 monclient: dump: 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.831 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f431c756640 10 monclient: shutdown 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f431c756640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f431c756640 1 -- 172.21.15.181:0/1682372566 >> v1:172.21.15.181:6789/0 conn(0x7f43140a8340 legacy=0x7f4314139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f431c756640 1 -- 172.21.15.181:0/1682372566 shutdown_connections 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f431c756640 1 -- 172.21.15.181:0/1682372566 >> 172.21.15.181:0/1682372566 conn(0x7f4314077170 msgr2=0x7f43140abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f431c756640 1 -- 172.21.15.181:0/1682372566 shutdown_connections 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.817+0000 7f431c756640 1 -- 172.21.15.181:0/1682372566 wait complete. 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.818+0000 7f431c756640 10 monclient: build_initial_monmap 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.818+0000 7f431c756640 10 monclient: monmap: 2024-09-13T10:32:50.832 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:50.833 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.818+0000 7f431c756640 1 Processor -- start 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.818+0000 7f431c756640 1 -- start start 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.818+0000 7f431c756640 10 monclient: init 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.819+0000 7f431c756640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.819+0000 7f431c756640 10 monclient: _add_conns ranks=[7,1,4,0,3,2,8,5,6] 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.819+0000 7f431c756640 10 monclient(hunting): picked mon.noname-i con 0x7f43140a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.819+0000 7f431c756640 10 monclient(hunting): picked mon.noname-f con 0x7f431413f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.819+0000 7f431c756640 10 monclient(hunting): picked mon.noname-c con 0x7f43141d3cb0 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.819+0000 7f431c756640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140aa170 con 0x7f431413f750 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.819+0000 7f431c756640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140a0b80 con 0x7f43141d3cb0 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.819+0000 7f431c756640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140a0e60 con 0x7f43140a8340 2024-09-13T10:32:50.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.819+0000 7f431c756640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.819+0000 7f431c756640 10 monclient(hunting): authenticate will time out at 910.325191s 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.819+0000 7f431acf3640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f43141d3cb0 0x7f43141d60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35506/0 (socket says 172.21.15.181:35506) 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.819+0000 7f431acf3640 1 -- 172.21.15.181:0/442468167 learned_addr learned my addr 172.21.15.181:0/442468167 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f431acf3640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.181:6791/0 conn(0x7f43141d3cb0 legacy=0x7f43141d60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2744123345 0 0) 0x7f43140a0b80 con 0x7f43141d3cb0 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): my global_id is 5251 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42f8003550 con 0x7f43141d3cb0 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f431a4f2640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.195:6792/0 conn(0x7f43140a8340 legacy=0x7f43141ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f4319cf1640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.195:6789/0 conn(0x7f431413f750 legacy=0x7f43141cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 480361816 0 0) 0x7f42f8003550 con 0x7f43141d3cb0 2024-09-13T10:32:50.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43140a0b80 con 0x7f43141d3cb0 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f430c0048c0 con 0x7f43141d3cb0 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): dump: 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.836 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 39099766 0 0) 0x7f43140a0e60 con 0x7f43140a8340 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): my global_id is 55258 2024-09-13T10:32:50.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42f8003550 con 0x7f43140a8340 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 562565764 0 0) 0x7f43140a48e0 con 0x7f431413f750 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient(hunting): my global_id is 55333 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43140a0e60 con 0x7f431413f750 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2708891970 0 0) 0x7f43140a0b80 con 0x7f43141d3cb0 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.195:6792/0 conn(0x7f43140a8340 legacy=0x7f43141ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.195:6789/0 conn(0x7f431413f750 legacy=0x7f43141cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient: _finish_hunting 0 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 monclient: found mon.c 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43141cb220 con 0x7f43141d3cb0 2024-09-13T10:32:50.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient: _finish_auth 0 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 10 monclient: _check_auth_tickets 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f430affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f431c756640 5 monclient: authenticate success, global_id 5251 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f431c756640 10 monclient: _renew_subs 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f431c756640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.821+0000 7f431c756640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f43140a9c40 con 0x7f43141d3cb0 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f431c756640 10 monclient: _renew_subs 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f431c756640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f431c756640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f43140a08a0 con 0x7f43141d3cb0 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f430c004bd0 con 0x7f43141d3cb0 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f430affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f430c005140 con 0x7f43141d3cb0 2024-09-13T10:32:50.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f430affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f4318cef640 4 set_mon_vals no callback set 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f430affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f430affd640 10 monclient: dump: 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.840 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.841 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.841 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.841 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.841 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.841 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f431c756640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:50.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f431c756640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f42fc0065c0 con 0x7f42fc002860 2024-09-13T10:32:50.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.822+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f430c0052e0 con 0x7f43141d3cb0 2024-09-13T10:32:50.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.823+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(83..83 src has 1..83) ==== 3506+0+0 (unknown 1943073602 0 0) 0x7f430c04e550 con 0x7f43141d3cb0 2024-09-13T10:32:50.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.823+0000 7f4319cf1640 10 monclient: get_auth_request con 0x7f42f803fd90 auth_method 0 2024-09-13T10:32:50.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f431a4f2640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.195:6791/0 conn(0x7f42fc002860 legacy=0x7f42fc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802204052 0 0) 0x7f42fc0065c0 con 0x7f42fc002860 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 10 monclient(hunting): my global_id is 5288 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43140a0b80 con 0x7f42fc002860 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 507375962 0 0) 0x7f43140a0b80 con 0x7f42fc002860 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42fc0065c0 con 0x7f42fc002860 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f43100047e0 con 0x7f42fc002860 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 10 monclient: dump: 2024-09-13T10:32:50.844 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.845 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.845 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.845 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.845 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.845 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.845 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.845 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.845 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.845 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.845 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.845 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.845 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 900596982 0 0) 0x7f42fc0065c0 con 0x7f42fc002860 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42fc00a160 con 0x7f42fc002860 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f43100049a0 con 0x7f42fc002860 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.195:6791/0 conn(0x7f42fc002860 legacy=0x7f42fc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.825+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.195:6791/0 conn(0x7f42fc002860 legacy=0x7f42fc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.831+0000 7f431c756640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.831+0000 7f431c756640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f42fc009e70 con 0x7f42fc009130 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f431a4f2640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.195:6791/0 conn(0x7f42fc009130 legacy=0x7f42fc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307423415 0 0) 0x7f42fc009e70 con 0x7f42fc009130 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f430affd640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f430affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f430affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f430affd640 10 monclient(hunting): my global_id is 5297 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42fc0065c0 con 0x7f42fc009130 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4092554715 0 0) 0x7f42fc0065c0 con 0x7f42fc009130 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42fc009e70 con 0x7f42fc009130 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4310005140 con 0x7f42fc009130 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f430affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f430affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.834+0000 7f430affd640 10 monclient: dump: 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.847 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3536861954 0 0) 0x7f42fc009e70 con 0x7f42fc009130 2024-09-13T10:32:50.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f42fc00c410 con 0x7f42fc009130 2024-09-13T10:32:50.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7548 (unknown 0 0 1707189589) 0x7f43100073e0 con 0x7f42fc009130 2024-09-13T10:32:50.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f430affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:50.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f430affd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:50.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.195:6791/0 conn(0x7f42fc009130 legacy=0x7f42fc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f430affd640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.195:6791/0 conn(0x7f42fc009130 legacy=0x7f42fc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:50.849 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:50.849 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:50.849 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:50.849 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 68, 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 185264, 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.850 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:50.851 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:50.852 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:50.853 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:50.854 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.855 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.856 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.857 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.858 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.859 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.860 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.861 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.862 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:50.863 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:50.864 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:50.867 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.868 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:50.868 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:50.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:50.868 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:50.868 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:50.868 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:50.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:50.868 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:50.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:50.868 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:50.868 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:50.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f431c756640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.195:6800/1839191919 conn(0x7f42f803fd90 legacy=0x7f42f8042250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f431c756640 10 monclient: shutdown 2024-09-13T10:32:50.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f431c756640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:50.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f431c756640 1 -- 172.21.15.181:0/442468167 >> v1:172.21.15.181:6791/0 conn(0x7f43141d3cb0 legacy=0x7f43141d60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f431acf3640 1 -- 172.21.15.181:0/442468167 reap_dead start 2024-09-13T10:32:50.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f431acf3640 1 -- 172.21.15.181:0/442468167 reap_dead start 2024-09-13T10:32:50.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f431c756640 1 -- 172.21.15.181:0/442468167 shutdown_connections 2024-09-13T10:32:50.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f431c756640 1 -- 172.21.15.181:0/442468167 >> 172.21.15.181:0/442468167 conn(0x7f43140a6640 msgr2=0x7f4314141dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:50.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f431c756640 1 -- 172.21.15.181:0/442468167 shutdown_connections 2024-09-13T10:32:50.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.835+0000 7f431c756640 1 -- 172.21.15.181:0/442468167 wait complete. 2024-09-13T10:32:50.871 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:32:50.871 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-09-13T10:32:50.871 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:32:50.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.970+0000 7ff9e57cd640 10 monclient: get_monmap_and_config 2024-09-13T10:32:50.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.970+0000 7ff9e57cd640 10 monclient: build_initial_monmap 2024-09-13T10:32:50.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.970+0000 7ff9e57cd640 10 monclient: monmap: 2024-09-13T10:32:50.973 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:50.973 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.973 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:32:50.971877+0000 2024-09-13T10:32:50.973 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:32:50.971877+0000 2024-09-13T10:32:50.973 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:50.973 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.973 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:50.974 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:50.974 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:50.974 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:50.974 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:50.974 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:50.974 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:50.974 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:50.974 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:50.974 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.970+0000 7ff9e57cd640 1 Processor -- start 2024-09-13T10:32:50.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.970+0000 7ff9e57cd640 1 -- start start 2024-09-13T10:32:50.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.970+0000 7ff9e57cd640 10 monclient: init 2024-09-13T10:32:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.971+0000 7ff9e57cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.971+0000 7ff9e57cd640 10 monclient: _add_conns ranks=[7,4,3,5,0,8,1,6,2] 2024-09-13T10:32:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.971+0000 7ff9e57cd640 10 monclient(hunting): picked mon.noname-i con 0x7ff9e00a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:32:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.971+0000 7ff9e57cd640 10 monclient(hunting): picked mon.noname-c con 0x7ff9e00a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.971+0000 7ff9e57cd640 10 monclient(hunting): picked mon.noname-g con 0x7ff9e013f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:32:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.971+0000 7ff9e57cd640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e00a5fe0 con 0x7ff9e013f9a0 2024-09-13T10:32:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.971+0000 7ff9e57cd640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e00a8080 con 0x7ff9e00a6ab0 2024-09-13T10:32:50.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.971+0000 7ff9e57cd640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e00a42c0 con 0x7ff9e00a66d0 2024-09-13T10:32:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.971+0000 7ff9e57cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.971+0000 7ff9e57cd640 10 monclient(hunting): authenticate will time out at 910.477444s 2024-09-13T10:32:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.971+0000 7ff9de7fc640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ff9e00a6ab0 0x7ff9e00a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35508/0 (socket says 172.21.15.181:35508) 2024-09-13T10:32:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.971+0000 7ff9de7fc640 1 -- 172.21.15.181:0/1522827453 learned_addr learned my addr 172.21.15.181:0/1522827453 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.973+0000 7ff9de7fc640 1 -- 172.21.15.181:0/1522827453 >> v1:172.21.15.181:6791/0 conn(0x7ff9e00a6ab0 legacy=0x7ff9e00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.973+0000 7ff9df7fe640 1 -- 172.21.15.181:0/1522827453 >> v1:172.21.15.195:6790/0 conn(0x7ff9e013f9a0 legacy=0x7ff9e0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.973+0000 7ff9deffd640 1 -- 172.21.15.181:0/1522827453 >> v1:172.21.15.195:6792/0 conn(0x7ff9e00a66d0 legacy=0x7ff9e00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 1 -- 172.21.15.181:0/1522827453 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475412775 0 0) 0x7ff9e00a8080 con 0x7ff9e00a6ab0 2024-09-13T10:32:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient(hunting): my global_id is 5260 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 1 -- 172.21.15.181:0/1522827453 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9c8003520 con 0x7ff9e00a6ab0 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 1 -- 172.21.15.181:0/1522827453 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2601321857 0 0) 0x7ff9c8003520 con 0x7ff9e00a6ab0 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 1 -- 172.21.15.181:0/1522827453 >> v1:172.21.15.195:6792/0 conn(0x7ff9e00a66d0 legacy=0x7ff9e00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 1 -- 172.21.15.181:0/1522827453 >> v1:172.21.15.195:6790/0 conn(0x7ff9e013f9a0 legacy=0x7ff9e0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient: _finish_hunting 0 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 1 monclient: found mon.noname-c 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 1 -- 172.21.15.181:0/1522827453 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e01464e0 con 0x7ff9e00a6ab0 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient: _finish_auth 0 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient: _check_auth_tickets 2024-09-13T10:32:50.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 1 -- 172.21.15.181:0/1522827453 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9d4001ae0 con 0x7ff9e00a6ab0 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9e57cd640 5 monclient: authenticate success, global_id 5260 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9e57cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient: dump: 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.981 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9e57cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 1 -- 172.21.15.181:0/1522827453 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9d40048a0 con 0x7ff9e00a6ab0 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 1 -- 172.21.15.181:0/1522827453 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9d4004e10 con 0x7ff9e00a6ab0 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9e57cd640 10 monclient: get_monmap_and_config success 2024-09-13T10:32:50.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9e57cd640 4 set_mon_vals no callback set 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9ddffb640 10 monclient: dump: 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.983 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9e57cd640 10 monclient: shutdown 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9e57cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1522827453 >> v1:172.21.15.181:6791/0 conn(0x7ff9e00a6ab0 legacy=0x7ff9e00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1522827453 shutdown_connections 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1522827453 >> 172.21.15.181:0/1522827453 conn(0x7ff9e00abcd0 msgr2=0x7ff9e00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.974+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1522827453 shutdown_connections 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.975+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1522827453 wait complete. 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.975+0000 7ff9e57cd640 10 monclient: build_initial_monmap 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.975+0000 7ff9e57cd640 10 monclient: monmap: 2024-09-13T10:32:50.984 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:32:50.985 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:32:50.986 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 1 Processor -- start 2024-09-13T10:32:50.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 1 -- start start 2024-09-13T10:32:50.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 10 monclient: init 2024-09-13T10:32:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:32:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 10 monclient: _add_conns ranks=[4,8,5,7,3,6,1,0,2] 2024-09-13T10:32:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 10 monclient(hunting): picked mon.noname-c con 0x7ff9e00a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:32:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 10 monclient(hunting): picked mon.noname-e con 0x7ff9e00a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:32:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 10 monclient(hunting): picked mon.noname-h con 0x7ff9e013f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:32:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e013f3d0 con 0x7ff9e00a66d0 2024-09-13T10:32:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e013d070 con 0x7ff9e013f9a0 2024-09-13T10:32:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9de7fc640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7ff9e00a6ab0 legacy=0x7ff9e013c020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:32:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e013eb30 con 0x7ff9e00a6ab0 2024-09-13T10:32:50.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9e57cd640 10 monclient(hunting): authenticate will time out at 910.482618s 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9c77fe640 1 -- DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9deffd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ff9e00a66d0 0x7ff9e013b910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35522/0 (socket says 172.21.15.181:35522) 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.976+0000 7ff9deffd640 1 -- 172.21.15.181:0/1584574257 learned_addr learned my addr 172.21.15.181:0/1584574257 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.978+0000 7ff9deffd640 1 -- 172.21.15.181:0/1584574257 >> v1:172.21.15.181:6791/0 conn(0x7ff9e00a66d0 legacy=0x7ff9e013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.978+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4130563720 0 0) 0x7ff9e013f3d0 con 0x7ff9e00a66d0 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): my global_id is 5269 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9df7fe640 1 -- 172.21.15.181:0/1584574257 >> v1:172.21.15.195:6791/0 conn(0x7ff9e013f9a0 legacy=0x7ff9e01d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9cc003520 con 0x7ff9e00a66d0 2024-09-13T10:32:50.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1736968914 0 0) 0x7ff9e013d070 con 0x7ff9e013f9a0 2024-09-13T10:32:50.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:50.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:50.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:50.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): my global_id is 5306 2024-09-13T10:32:50.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e013f3d0 con 0x7ff9e013f9a0 2024-09-13T10:32:50.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9deffd640 1 --1- 172.21.15.181:0/1584574257 >> v1:172.21.15.181:6791/0 conn(0x7ff9e00a66d0 0x7ff9e013b910 :-1 s=OPENED pgs=267 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7ff9cc003520 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:32:50.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3307213348 0 0) 0x7ff9cc003520 con 0x7ff9e00a66d0 2024-09-13T10:32:50.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9e013d070 con 0x7ff9e00a66d0 2024-09-13T10:32:50.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9d0003990 con 0x7ff9e00a66d0 2024-09-13T10:32:50.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:50.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): dump: 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.994 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2236885766 0 0) 0x7ff9e013f3d0 con 0x7ff9e013f9a0 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9cc003520 con 0x7ff9e013f9a0 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9d8001c80 con 0x7ff9e013f9a0 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient(hunting): dump: 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.995 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1978521660 0 0) 0x7ff9cc003520 con 0x7ff9e013f9a0 2024-09-13T10:32:50.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 >> v1:172.21.15.181:6793/0 conn(0x7ff9e00a6ab0 legacy=0x7ff9e013c020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:32:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 >> v1:172.21.15.181:6791/0 conn(0x7ff9e00a66d0 legacy=0x7ff9e013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient: _finish_hunting 0 2024-09-13T10:32:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 monclient: found mon.h 2024-09-13T10:32:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:32:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:32:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e013ee10 con 0x7ff9e013f9a0 2024-09-13T10:32:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient: _finish_auth 0 2024-09-13T10:32:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient: _check_auth_tickets 2024-09-13T10:32:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:32:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1821093826 0 0) 0x7ff9e013d070 con 0x7ff9e00a66d0 2024-09-13T10:32:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9e57cd640 5 monclient: authenticate success, global_id 5306 2024-09-13T10:32:50.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9e57cd640 10 monclient: _renew_subs 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9e57cd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e00a2a80 con 0x7ff9e013f9a0 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9e57cd640 10 monclient: _renew_subs 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9e57cd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7ff9e013c730 con 0x7ff9e013f9a0 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9d80038c0 con 0x7ff9e013f9a0 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9d8003df0 con 0x7ff9e013f9a0 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9dd7fa640 4 set_mon_vals no callback set 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.979+0000 7ff9c77fe640 10 monclient: dump: 2024-09-13T10:32:50.998 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:50.999 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.980+0000 7ff9e57cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.980+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff9c00065c0 con 0x7ff9c0002860 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.980+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff9d8004010 con 0x7ff9e013f9a0 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.981+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(83..83 src has 1..83) ==== 3506+0+0 (unknown 1943073602 0 0) 0x7ff9d804e090 con 0x7ff9e013f9a0 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.981+0000 7ff9de7fc640 10 monclient: get_auth_request con 0x7ff9cc03ff90 auth_method 0 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.982+0000 7ff9deffd640 1 -- 172.21.15.181:0/1584574257 >> v1:172.21.15.195:6792/0 conn(0x7ff9c0002860 legacy=0x7ff9c0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479795348 0 0) 0x7ff9c00065c0 con 0x7ff9c0002860 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:51.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 10 monclient(hunting): my global_id is 55276 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e013d070 con 0x7ff9c0002860 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2969014388 0 0) 0x7ff9e013d070 con 0x7ff9c0002860 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9c00065c0 con 0x7ff9c0002860 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9d00044e0 con 0x7ff9c0002860 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 10 monclient: dump: 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:51.001 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3521877638 0 0) 0x7ff9c00065c0 con 0x7ff9c0002860 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9c000a160 con 0x7ff9c0002860 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff9d0004570 con 0x7ff9c0002860 2024-09-13T10:32:51.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:32:51.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:32:51.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 >> v1:172.21.15.195:6792/0 conn(0x7ff9c0002860 legacy=0x7ff9c0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:51.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.983+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 >> v1:172.21.15.195:6792/0 conn(0x7ff9c0002860 legacy=0x7ff9c0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:51.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.989+0000 7ff9e57cd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:32:51.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.989+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff9c0009e50 con 0x7ff9c0009110 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9deffd640 1 -- 172.21.15.181:0/1584574257 >> v1:172.21.15.195:6792/0 conn(0x7ff9c0009110 legacy=0x7ff9c00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610550509 0 0) 0x7ff9c0009e50 con 0x7ff9c0009110 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9c77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9c77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9c77fe640 10 monclient(hunting): my global_id is 55285 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9c00065c0 con 0x7ff9c0009110 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2002618441 0 0) 0x7ff9c00065c0 con 0x7ff9c0009110 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9c0009e50 con 0x7ff9c0009110 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9d0006180 con 0x7ff9c0009110 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9c77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9c77fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:32:51.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.992+0000 7ff9c77fe640 10 monclient: dump: 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:32:51.006 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:32:51.007 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:32:51.007 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:32:51.007 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:32:51.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4057138942 0 0) 0x7ff9c0009e50 con 0x7ff9c0009110 2024-09-13T10:32:51.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff9c000c3f0 con 0x7ff9c0009110 2024-09-13T10:32:51.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7715 (unknown 0 0 577677546) 0x7ff9d0008420 con 0x7ff9c0009110 2024-09-13T10:32:51.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9c77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:32:51.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9c77fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:32:51.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 >> v1:172.21.15.195:6792/0 conn(0x7ff9c0009110 legacy=0x7ff9c00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:51.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9c77fe640 1 -- 172.21.15.181:0/1584574257 >> v1:172.21.15.195:6792/0 conn(0x7ff9c0009110 legacy=0x7ff9c00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:32:51.007 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:32:51.008 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:51.008 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:51.008 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:32:51.008 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 68, 2024-09-13T10:32:51.008 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 185414, 2024-09-13T10:32:51.008 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:32:51.008 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:32:51.008 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:32:51.008 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:32:51.008 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:32:51.008 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:32:51.008 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:51.009 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:51.010 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:51.011 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:32:51.012 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:32:51.013 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:51.014 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.015 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:32:51.016 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:51.017 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:32:51.019 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.020 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.021 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:32:51.022 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:51.023 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.024 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.025 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:32:51.026 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:32:51.027 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:32:51.027 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:32:51.027 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:32:51.027 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:32:51.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:32:51.027 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:32:51.027 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:32:51.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1584574257 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff9cc03ff90 legacy=0x7ff9cc042450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:51.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9e57cd640 10 monclient: shutdown 2024-09-13T10:32:51.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9e57cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:32:51.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1584574257 >> v1:172.21.15.195:6791/0 conn(0x7ff9e013f9a0 legacy=0x7ff9e01d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:32:51.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9df7fe640 1 -- 172.21.15.181:0/1584574257 reap_dead start 2024-09-13T10:32:51.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9df7fe640 1 -- 172.21.15.181:0/1584574257 reap_dead start 2024-09-13T10:32:51.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1584574257 shutdown_connections 2024-09-13T10:32:51.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1584574257 >> 172.21.15.181:0/1584574257 conn(0x7ff9e00abcd0 msgr2=0x7ff9e00a8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:32:51.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1584574257 shutdown_connections 2024-09-13T10:32:51.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:32:50.993+0000 7ff9e57cd640 1 -- 172.21.15.181:0/1584574257 wait complete. 2024-09-13T10:32:51.029 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:32:51.030 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T10:32:52.713 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:52.713 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36742]: starting. 2024-09-13T10:32:52.714 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36742]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36701 2024-09-13T10:32:52.714 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36742]: created object 0... 2024-09-13T10:32:52.714 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36742]: created object 25... 2024-09-13T10:32:52.714 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36742]: created object 49... 2024-09-13T10:32:52.714 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36742]: finishing. 2024-09-13T10:32:52.714 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36742]: shutting down. 2024-09-13T10:32:52.751 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:52.751 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36744]: starting. 2024-09-13T10:32:52.751 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36744]: listing objects. 2024-09-13T10:32:52.751 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36744]: listed object 0... 2024-09-13T10:32:52.751 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36744]: listed object 25... 2024-09-13T10:32:52.751 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36744]: saw 50 objects 2024-09-13T10:32:52.751 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36744]: shutting down. 2024-09-13T10:32:53.624 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:53.625 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36743]: starting. 2024-09-13T10:32:53.625 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36743]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36701 2024-09-13T10:32:53.625 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36743]: shutting down. 2024-09-13T10:32:53.626 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:53.626 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:53.626 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:32:53.629 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:32:55.729 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36813]: starting. 2024-09-13T10:32:55.729 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36813]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36812 2024-09-13T10:32:55.729 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36813]: created object 0... 2024-09-13T10:32:55.729 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36813]: created object 25... 2024-09-13T10:32:55.729 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36813]: created object 49... 2024-09-13T10:32:55.729 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36813]: finishing. 2024-09-13T10:32:55.729 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36813]: shutting down. 2024-09-13T10:32:56.659 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36814]: starting. 2024-09-13T10:32:56.659 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36814]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36812 2024-09-13T10:32:56.659 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36814]: shutting down. 2024-09-13T10:32:58.959 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:58.959 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36849]: starting. 2024-09-13T10:32:58.959 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36849]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36812 2024-09-13T10:32:58.959 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36849]: created object 0... 2024-09-13T10:32:58.959 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36849]: created object 25... 2024-09-13T10:32:58.960 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36849]: created object 49... 2024-09-13T10:32:58.960 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36849]: finishing. 2024-09-13T10:32:58.960 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36849]: shutting down. 2024-09-13T10:32:58.997 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:58.997 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36851]: starting. 2024-09-13T10:32:58.997 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36851]: listing objects. 2024-09-13T10:32:58.997 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36851]: listed object 0... 2024-09-13T10:32:58.997 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36851]: listed object 25... 2024-09-13T10:32:58.997 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36851]: saw 50 objects 2024-09-13T10:32:58.997 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36851]: shutting down. 2024-09-13T10:32:59.848 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:59.848 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36850]: starting. 2024-09-13T10:32:59.848 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36850]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36812 2024-09-13T10:32:59.848 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36850]: shutting down. 2024-09-13T10:32:59.849 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:59.849 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:32:59.849 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:32:59.852 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:33:01.714 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36920]: starting. 2024-09-13T10:33:01.715 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36920]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36919 2024-09-13T10:33:01.715 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36920]: created object 0... 2024-09-13T10:33:01.715 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36920]: created object 25... 2024-09-13T10:33:01.715 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36920]: created object 49... 2024-09-13T10:33:01.715 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36920]: finishing. 2024-09-13T10:33:01.715 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[36920]: shutting down. 2024-09-13T10:33:02.623 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36921]: starting. 2024-09-13T10:33:02.623 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36921]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36919 2024-09-13T10:33:02.623 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[36921]: shutting down. 2024-09-13T10:33:04.939 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:04.939 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36956]: starting. 2024-09-13T10:33:04.939 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36956]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-36919 2024-09-13T10:33:04.939 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36956]: created object 0... 2024-09-13T10:33:04.939 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36956]: created object 25... 2024-09-13T10:33:04.939 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36956]: created object 49... 2024-09-13T10:33:04.939 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36956]: finishing. 2024-09-13T10:33:04.940 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[36956]: shutting down. 2024-09-13T10:33:04.975 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:04.975 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36958]: starting. 2024-09-13T10:33:04.976 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36958]: listing objects. 2024-09-13T10:33:04.976 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36958]: listed object 0... 2024-09-13T10:33:04.976 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36958]: listed object 25... 2024-09-13T10:33:04.976 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36958]: saw 50 objects 2024-09-13T10:33:04.976 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[36958]: shutting down. 2024-09-13T10:33:05.850 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:05.850 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36957]: starting. 2024-09-13T10:33:05.850 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36957]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-36919 2024-09-13T10:33:05.850 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[36957]: shutting down. 2024-09-13T10:33:05.852 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:05.852 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:05.852 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:33:05.855 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:33:07.968 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37027]: starting. 2024-09-13T10:33:07.968 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37027]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37026 2024-09-13T10:33:07.968 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37027]: created object 0... 2024-09-13T10:33:07.968 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37027]: created object 25... 2024-09-13T10:33:07.968 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37027]: created object 49... 2024-09-13T10:33:07.968 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37027]: finishing. 2024-09-13T10:33:07.968 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37027]: shutting down. 2024-09-13T10:33:09.278 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37028]: starting. 2024-09-13T10:33:09.278 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37028]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37026 2024-09-13T10:33:09.278 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37028]: shutting down. 2024-09-13T10:33:10.949 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:10.949 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37063]: starting. 2024-09-13T10:33:10.949 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37063]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37026 2024-09-13T10:33:10.949 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37063]: created object 0... 2024-09-13T10:33:10.949 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37063]: created object 25... 2024-09-13T10:33:10.949 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37063]: created object 49... 2024-09-13T10:33:10.949 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37063]: finishing. 2024-09-13T10:33:10.949 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37063]: shutting down. 2024-09-13T10:33:10.985 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:10.986 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37065]: starting. 2024-09-13T10:33:10.986 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37065]: listing objects. 2024-09-13T10:33:10.986 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37065]: listed object 0... 2024-09-13T10:33:10.986 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37065]: listed object 25... 2024-09-13T10:33:10.986 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37065]: saw 50 objects 2024-09-13T10:33:10.986 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37065]: shutting down. 2024-09-13T10:33:11.030 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-09-13T10:33:11.031 INFO:tasks.ceph.mon.e:Restarting daemon 2024-09-13T10:33:11.031 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-09-13T10:33:11.033 INFO:tasks.ceph.mon.e:Started 2024-09-13T10:33:11.033 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-09-13T10:33:11.034 INFO:tasks.ceph.mon.a:Sent signal 19 2024-09-13T10:33:11.034 INFO:tasks.mon_thrash:Sending STOP to mon i 2024-09-13T10:33:11.034 INFO:tasks.ceph.mon.i:Sent signal 19 2024-09-13T10:33:11.034 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-13T10:33:17.139 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:17.139 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37064]: starting. 2024-09-13T10:33:17.139 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37064]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37026 2024-09-13T10:33:17.139 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37064]: shutting down. 2024-09-13T10:33:17.140 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:17.140 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:17.140 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:33:17.143 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:33:26.034 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-09-13T10:33:26.035 INFO:tasks.ceph.mon.a:Sent signal 18 2024-09-13T10:33:26.035 INFO:tasks.mon_thrash:Sending CONT to mon i 2024-09-13T10:33:26.035 INFO:tasks.ceph.mon.i:Sent signal 18 2024-09-13T10:33:26.035 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:33:26.036 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:33:26.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.143+0000 7efd28cf7640 10 monclient: get_monmap_and_config 2024-09-13T10:33:26.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.143+0000 7efd28cf7640 10 monclient: build_initial_monmap 2024-09-13T10:33:26.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.143+0000 7efd28cf7640 10 monclient: monmap: 2024-09-13T10:33:26.146 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:26.146 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.146 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:26.145197+0000 2024-09-13T10:33:26.146 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:26.145197+0000 2024-09-13T10:33:26.146 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:26.147 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.147 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:26.147 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:26.147 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:26.147 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:26.147 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:26.147 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:26.147 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:26.147 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:26.147 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:26.147 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 1 Processor -- start 2024-09-13T10:33:26.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 1 -- start start 2024-09-13T10:33:26.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 10 monclient: init 2024-09-13T10:33:26.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:26.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 10 monclient: _add_conns ranks=[8,7,5,2,0,3,1,6,4] 2024-09-13T10:33:26.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 10 monclient(hunting): picked mon.noname-e con 0x7efd240a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:26.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 10 monclient(hunting): picked mon.noname-i con 0x7efd240a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:26.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 10 monclient(hunting): picked mon.noname-h con 0x7efd2413f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:26.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd240a4bc0 con 0x7efd2413f750 2024-09-13T10:33:26.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2413a320 con 0x7efd240a8340 2024-09-13T10:33:26.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd240a8100 con 0x7efd240a6640 2024-09-13T10:33:26.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:26.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.144+0000 7efd28cf7640 10 monclient(hunting): authenticate will time out at 945.650980s 2024-09-13T10:33:26.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.145+0000 7efd2259c640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7efd240a6640 0x7efd24139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:37576/0 (socket says 172.21.15.181:37576) 2024-09-13T10:33:26.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.145+0000 7efd2259c640 1 -- 172.21.15.181:0/3874559597 learned_addr learned my addr 172.21.15.181:0/3874559597 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:26.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd2259c640 1 -- 172.21.15.181:0/3874559597 >> v1:172.21.15.181:6793/0 conn(0x7efd240a6640 legacy=0x7efd24139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd1bfff640 1 -- 172.21.15.181:0/3874559597 >> v1:172.21.15.195:6792/0 conn(0x7efd240a8340 legacy=0x7efd24139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236770497 0 0) 0x7efd240a8100 con 0x7efd240a6640 2024-09-13T10:33:26.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd22d9d640 1 -- 172.21.15.181:0/3874559597 >> v1:172.21.15.195:6791/0 conn(0x7efd2413f750 legacy=0x7efd24141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient(hunting): my global_id is 84113 2024-09-13T10:33:26.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd10003520 con 0x7efd240a6640 2024-09-13T10:33:26.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3268113385 0 0) 0x7efd2413a320 con 0x7efd240a8340 2024-09-13T10:33:26.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient(hunting): my global_id is 55375 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd240a8100 con 0x7efd240a8340 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1222352476 0 0) 0x7efd240a4bc0 con 0x7efd2413f750 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient(hunting): my global_id is 5378 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd2413a320 con 0x7efd2413f750 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3812028704 0 0) 0x7efd10003520 con 0x7efd240a6640 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 >> v1:172.21.15.195:6792/0 conn(0x7efd240a8340 legacy=0x7efd24139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 >> v1:172.21.15.195:6791/0 conn(0x7efd2413f750 legacy=0x7efd24141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:33:26.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 monclient: found mon.noname-e 2024-09-13T10:33:26.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:26.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:33:26.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd240a48e0 con 0x7efd240a6640 2024-09-13T10:33:26.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient: _finish_auth 0 2024-09-13T10:33:26.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:33:26.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:26.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd14001ae0 con 0x7efd240a6640 2024-09-13T10:33:26.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd28cf7640 5 monclient: authenticate success, global_id 84113 2024-09-13T10:33:26.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd28cf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:26.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient: dump: 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.161 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd28cf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efd140048a0 con 0x7efd240a6640 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 1 -- 172.21.15.181:0/3874559597 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd14004e10 con 0x7efd240a6640 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd28cf7640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd28cf7640 4 set_mon_vals no callback set 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.147+0000 7efd21d9b640 10 monclient: dump: 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.162 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.148+0000 7efd28cf7640 10 monclient: shutdown 2024-09-13T10:33:26.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.148+0000 7efd28cf7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:26.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.148+0000 7efd28cf7640 1 -- 172.21.15.181:0/3874559597 >> v1:172.21.15.181:6793/0 conn(0x7efd240a6640 legacy=0x7efd24139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.148+0000 7efd28cf7640 1 -- 172.21.15.181:0/3874559597 shutdown_connections 2024-09-13T10:33:26.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.148+0000 7efd28cf7640 1 -- 172.21.15.181:0/3874559597 >> 172.21.15.181:0/3874559597 conn(0x7efd24077170 msgr2=0x7efd240abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:26.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.148+0000 7efd28cf7640 1 -- 172.21.15.181:0/3874559597 shutdown_connections 2024-09-13T10:33:26.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.148+0000 7efd28cf7640 1 -- 172.21.15.181:0/3874559597 wait complete. 2024-09-13T10:33:26.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.148+0000 7efd28cf7640 10 monclient: build_initial_monmap 2024-09-13T10:33:26.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.148+0000 7efd28cf7640 10 monclient: monmap: 2024-09-13T10:33:26.164 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:26.164 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:26.164 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:26.164 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 1 Processor -- start 2024-09-13T10:33:26.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 1 -- start start 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 10 monclient: init 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 10 monclient: _add_conns ranks=[5,7,1,8,0,3,2,6,4] 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 10 monclient(hunting): picked mon.noname-h con 0x7efd240a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 10 monclient(hunting): picked mon.noname-i con 0x7efd2413f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 10 monclient(hunting): picked mon.noname-f con 0x7efd24142070 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2413ccc0 con 0x7efd24142070 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2413c700 con 0x7efd240a8340 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2413c9e0 con 0x7efd2413f750 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd28cf7640 10 monclient(hunting): authenticate will time out at 945.655868s 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd1bfff640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7efd2413f750 0x7efd241d3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:52404/0 (socket says 172.21.15.181:52404) 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd22d9d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7efd24142070 0x7efd241d6a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:55106/0 (socket says 172.21.15.181:55106) 2024-09-13T10:33:26.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd1bfff640 1 -- 172.21.15.181:0/308877847 learned_addr learned my addr 172.21.15.181:0/308877847 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.149+0000 7efd2259c640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7efd240a8340 0x7efd2413e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:56870/0 (socket says 172.21.15.181:56870) 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd22d9d640 1 -- 172.21.15.181:0/308877847 >> v1:172.21.15.195:6789/0 conn(0x7efd24142070 legacy=0x7efd241d6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1bfff640 1 -- 172.21.15.181:0/308877847 >> v1:172.21.15.195:6792/0 conn(0x7efd2413f750 legacy=0x7efd241d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd2259c640 1 -- 172.21.15.181:0/308877847 >> v1:172.21.15.195:6791/0 conn(0x7efd240a8340 legacy=0x7efd2413e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958032787 0 0) 0x7efd2413c9e0 con 0x7efd2413f750 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): my global_id is 55384 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd04003550 con 0x7efd2413f750 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3277891214 0 0) 0x7efd2413ccc0 con 0x7efd24142070 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): my global_id is 55432 2024-09-13T10:33:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd2413c9e0 con 0x7efd24142070 2024-09-13T10:33:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3010592488 0 0) 0x7efd2413c700 con 0x7efd240a8340 2024-09-13T10:33:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): my global_id is 5387 2024-09-13T10:33:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd2413ccc0 con 0x7efd240a8340 2024-09-13T10:33:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2432841527 0 0) 0x7efd04003550 con 0x7efd2413f750 2024-09-13T10:33:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd2413c700 con 0x7efd2413f750 2024-09-13T10:33:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd0c003610 con 0x7efd2413f750 2024-09-13T10:33:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:33:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): dump: 2024-09-13T10:33:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.169 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:26.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2585791088 0 0) 0x7efd2413c9e0 con 0x7efd24142070 2024-09-13T10:33:26.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd04003550 con 0x7efd24142070 2024-09-13T10:33:26.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 149805236 0 0) 0x7efd2413ccc0 con 0x7efd240a8340 2024-09-13T10:33:26.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd2413c9e0 con 0x7efd240a8340 2024-09-13T10:33:26.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd1c002070 con 0x7efd24142070 2024-09-13T10:33:26.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:26.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:33:26.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): dump: 2024-09-13T10:33:26.171 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.171 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.171 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.171 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.171 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd14004d90 con 0x7efd240a8340 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:26.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient(hunting): dump: 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.173 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.174 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.174 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.174 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2011393568 0 0) 0x7efd2413c700 con 0x7efd2413f750 2024-09-13T10:33:26.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 >> v1:172.21.15.195:6791/0 conn(0x7efd240a8340 legacy=0x7efd2413e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 >> v1:172.21.15.195:6789/0 conn(0x7efd24142070 legacy=0x7efd241d6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:26.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 monclient: found mon.i 2024-09-13T10:33:26.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:26.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:33:26.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2413d6a0 con 0x7efd2413f750 2024-09-13T10:33:26.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient: _finish_auth 0 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd1affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd28cf7640 5 monclient: authenticate success, global_id 55384 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd28cf7640 10 monclient: _renew_subs 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd28cf7640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd28cf7640 1 -- 172.21.15.181:0/308877847 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efd24142720 con 0x7efd2413f750 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd28cf7640 10 monclient: _renew_subs 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd28cf7640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.152+0000 7efd28cf7640 1 -- 172.21.15.181:0/308877847 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7efd241d8150 con 0x7efd2413f750 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.153+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efd0c003b20 con 0x7efd2413f750 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.153+0000 7efd1affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.153+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd0c004010 con 0x7efd2413f750 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.153+0000 7efd1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.153+0000 7efd1affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.153+0000 7efd2159a640 4 set_mon_vals no callback set 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.153+0000 7efd1affd640 10 monclient: dump: 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.176 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.177 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.177 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.177 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.177 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.153+0000 7efd28cf7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:26.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.153+0000 7efd28cf7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:26.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.153+0000 7efd28cf7640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:33:26.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.153+0000 7efd28cf7640 1 -- 172.21.15.181:0/308877847 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd08005080 con 0x7efd2413f750 2024-09-13T10:33:26.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.153+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7efd0c0042e0 con 0x7efd2413f750 2024-09-13T10:33:26.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.154+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(109..109 src has 1..109) ==== 3898+0+0 (unknown 224616534 0 0) 0x7efd0c04e410 con 0x7efd2413f750 2024-09-13T10:33:26.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.154+0000 7efd2259c640 10 monclient: get_auth_request con 0x7efd040404e0 auth_method 0 2024-09-13T10:33:26.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.158+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.7 v1:172.21.15.195:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7efd0c0178a0 con 0x7efd2413f750 2024-09-13T10:33:26.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.158+0000 7efd1affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:26.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.158+0000 7efd1affd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:26.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.399+0000 7efd28cf7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:33:26.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.399+0000 7efd28cf7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:33:26.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.399+0000 7efd28cf7640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:33:26.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.399+0000 7efd28cf7640 1 -- 172.21.15.181:0/308877847 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efd08005370 con 0x7efd2413f750 2024-09-13T10:33:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.400+0000 7efd1affd640 1 -- 172.21.15.181:0/308877847 <== mon.7 v1:172.21.15.195:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 2598664434) 0x7efd0c0171a0 con 0x7efd2413f750 2024-09-13T10:33:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.400+0000 7efd1affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:33:26.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.400+0000 7efd1affd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:26.403 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":72,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:33:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.402+0000 7efd28cf7640 1 -- 172.21.15.181:0/308877847 >> v1:172.21.15.195:6800/1839191919 conn(0x7efd040404e0 legacy=0x7efd040429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.402+0000 7efd28cf7640 10 monclient: shutdown 2024-09-13T10:33:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.402+0000 7efd28cf7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.402+0000 7efd28cf7640 1 -- 172.21.15.181:0/308877847 >> v1:172.21.15.195:6792/0 conn(0x7efd2413f750 legacy=0x7efd241d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.402+0000 7efd28cf7640 1 -- 172.21.15.181:0/308877847 shutdown_connections 2024-09-13T10:33:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.402+0000 7efd28cf7640 1 -- 172.21.15.181:0/308877847 >> 172.21.15.181:0/308877847 conn(0x7efd240a6640 msgr2=0x7efd240a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.402+0000 7efd28cf7640 1 -- 172.21.15.181:0/308877847 shutdown_connections 2024-09-13T10:33:26.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.402+0000 7efd28cf7640 1 -- 172.21.15.181:0/308877847 wait complete. 2024-09-13T10:33:26.416 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:33:26.416 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:33:26.416 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:33:26.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.512+0000 7ff5a5240640 10 monclient: get_monmap_and_config 2024-09-13T10:33:26.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.512+0000 7ff5a5240640 10 monclient: build_initial_monmap 2024-09-13T10:33:26.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.512+0000 7ff5a5240640 10 monclient: monmap: 2024-09-13T10:33:26.515 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:26.515 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.515 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:26.514343+0000 2024-09-13T10:33:26.515 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:26.514343+0000 2024-09-13T10:33:26.515 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:26.516 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.516 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:26.516 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:26.516 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:26.516 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:26.516 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:26.516 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:26.516 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:26.516 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:26.516 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:26.516 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.513+0000 7ff5a5240640 1 Processor -- start 2024-09-13T10:33:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.513+0000 7ff5a5240640 1 -- start start 2024-09-13T10:33:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.513+0000 7ff5a5240640 10 monclient: init 2024-09-13T10:33:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.513+0000 7ff5a5240640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.513+0000 7ff5a5240640 10 monclient: _add_conns ranks=[5,4,1,6,2,3,0,8,7] 2024-09-13T10:33:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.513+0000 7ff5a5240640 10 monclient(hunting): picked mon.noname-h con 0x7ff5a00a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.513+0000 7ff5a5240640 10 monclient(hunting): picked mon.noname-c con 0x7ff5a00a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.514+0000 7ff5a5240640 10 monclient(hunting): picked mon.noname-f con 0x7ff5a013f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.514+0000 7ff5a5240640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a00a4bc0 con 0x7ff5a013f750 2024-09-13T10:33:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.514+0000 7ff5a5240640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a013a320 con 0x7ff5a00a8340 2024-09-13T10:33:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.514+0000 7ff5a5240640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a00a8100 con 0x7ff5a00a6640 2024-09-13T10:33:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.514+0000 7ff5a5240640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.514+0000 7ff5a5240640 10 monclient(hunting): authenticate will time out at 946.020078s 2024-09-13T10:33:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.514+0000 7ff59659c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ff5a00a8340 0x7ff5a0139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47632/0 (socket says 172.21.15.181:47632) 2024-09-13T10:33:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.514+0000 7ff59659c640 1 -- 172.21.15.181:0/2840208782 learned_addr learned my addr 172.21.15.181:0/2840208782 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59659c640 1 -- 172.21.15.181:0/2840208782 >> v1:172.21.15.181:6791/0 conn(0x7ff5a00a8340 legacy=0x7ff5a0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59f59e640 1 -- 172.21.15.181:0/2840208782 >> v1:172.21.15.195:6789/0 conn(0x7ff5a013f750 legacy=0x7ff5a0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59ed9d640 1 -- 172.21.15.181:0/2840208782 >> v1:172.21.15.195:6791/0 conn(0x7ff5a00a6640 legacy=0x7ff5a0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1801796117 0 0) 0x7ff5a013a320 con 0x7ff5a00a8340 2024-09-13T10:33:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient(hunting): my global_id is 5377 2024-09-13T10:33:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff58c003520 con 0x7ff5a00a8340 2024-09-13T10:33:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 377263595 0 0) 0x7ff5a00a4bc0 con 0x7ff5a013f750 2024-09-13T10:33:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient(hunting): my global_id is 55441 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a013a320 con 0x7ff5a013f750 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615997565 0 0) 0x7ff5a00a8100 con 0x7ff5a00a6640 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient(hunting): my global_id is 5396 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a00a4bc0 con 0x7ff5a00a6640 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2697289834 0 0) 0x7ff58c003520 con 0x7ff5a00a8340 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 >> v1:172.21.15.195:6791/0 conn(0x7ff5a00a6640 legacy=0x7ff5a0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 >> v1:172.21.15.195:6789/0 conn(0x7ff5a013f750 legacy=0x7ff5a0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient: _finish_hunting 0 2024-09-13T10:33:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 1 monclient: found mon.noname-c 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a00a48e0 con 0x7ff5a00a8340 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient: _finish_auth 0 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 10 monclient: _check_auth_tickets 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.516+0000 7ff59e59c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff588001ae0 con 0x7ff5a00a8340 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff5a5240640 5 monclient: authenticate success, global_id 5377 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff5a5240640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff59e59c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff59e59c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff59e59c640 10 monclient: dump: 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff5a5240640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5880048a0 con 0x7ff5a00a8340 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff59e59c640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff59e59c640 1 -- 172.21.15.181:0/2840208782 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff588004e10 con 0x7ff5a00a8340 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff5a5240640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff5a5240640 4 set_mon_vals no callback set 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff59e59c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff59e59c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff59e59c640 10 monclient: dump: 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff5a5240640 10 monclient: shutdown 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff5a5240640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff5a5240640 1 -- 172.21.15.181:0/2840208782 >> v1:172.21.15.181:6791/0 conn(0x7ff5a00a8340 legacy=0x7ff5a0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff5a5240640 1 -- 172.21.15.181:0/2840208782 shutdown_connections 2024-09-13T10:33:26.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff5a5240640 1 -- 172.21.15.181:0/2840208782 >> 172.21.15.181:0/2840208782 conn(0x7ff5a0077170 msgr2=0x7ff5a00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:26.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff5a5240640 1 -- 172.21.15.181:0/2840208782 shutdown_connections 2024-09-13T10:33:26.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.517+0000 7ff5a5240640 1 -- 172.21.15.181:0/2840208782 wait complete. 2024-09-13T10:33:26.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.518+0000 7ff5a5240640 10 monclient: build_initial_monmap 2024-09-13T10:33:26.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.518+0000 7ff5a5240640 10 monclient: monmap: 2024-09-13T10:33:26.529 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:26.529 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:26.529 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:26.529 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.518+0000 7ff5a5240640 1 Processor -- start 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.518+0000 7ff5a5240640 1 -- start start 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.518+0000 7ff5a5240640 10 monclient: init 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.519+0000 7ff5a5240640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.519+0000 7ff5a5240640 10 monclient: _add_conns ranks=[1,0,5,8,3,6,2,7,4] 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.519+0000 7ff5a5240640 10 monclient(hunting): picked mon.noname-f con 0x7ff5a00a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.519+0000 7ff5a5240640 10 monclient(hunting): picked mon.noname-a con 0x7ff5a013f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.519+0000 7ff5a5240640 10 monclient(hunting): picked mon.noname-h con 0x7ff5a013e520 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.519+0000 7ff5a5240640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a013c4a0 con 0x7ff5a013f750 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.519+0000 7ff5a5240640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a013d000 con 0x7ff5a00a8340 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.519+0000 7ff5a5240640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a013df60 con 0x7ff5a013e520 2024-09-13T10:33:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.519+0000 7ff5a5240640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:26.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.519+0000 7ff5a5240640 10 monclient(hunting): authenticate will time out at 946.025358s 2024-09-13T10:33:26.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.519+0000 7ff59659c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff5a013f750 0x7ff5a01d3510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60536/0 (socket says 172.21.15.181:60536) 2024-09-13T10:33:26.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.519+0000 7ff59659c640 1 -- 172.21.15.181:0/3200165233 learned_addr learned my addr 172.21.15.181:0/3200165233 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:26.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff59659c640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.181:6789/0 conn(0x7ff5a013f750 legacy=0x7ff5a01d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff59f59e640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.195:6791/0 conn(0x7ff5a013e520 legacy=0x7ff5a01d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff59ed9d640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.195:6789/0 conn(0x7ff5a00a8340 legacy=0x7ff5a012e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874411528 0 0) 0x7ff5a013c4a0 con 0x7ff5a013f750 2024-09-13T10:33:26.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 10 monclient(hunting): my global_id is 55143 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff580003550 con 0x7ff5a013f750 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2405415204 0 0) 0x7ff580003550 con 0x7ff5a013f750 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5a013c4a0 con 0x7ff5a013f750 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff588004d90 con 0x7ff5a013f750 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 10 monclient(hunting): dump: 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.540 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.521+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1067701567 0 0) 0x7ff5a013df60 con 0x7ff5a013e520 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient(hunting): my global_id is 5405 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff580003550 con 0x7ff5a013e520 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776882890 0 0) 0x7ff5a013d000 con 0x7ff5a00a8340 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient(hunting): my global_id is 55450 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a013df60 con 0x7ff5a00a8340 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 578288012 0 0) 0x7ff5a013c4a0 con 0x7ff5a013f750 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.195:6791/0 conn(0x7ff5a013e520 legacy=0x7ff5a01d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.195:6789/0 conn(0x7ff5a00a8340 legacy=0x7ff5a012e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient: _finish_hunting 0 2024-09-13T10:33:26.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 1 monclient: found mon.a 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a013e240 con 0x7ff5a013f750 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient: _finish_auth 0 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient: _check_auth_tickets 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff5a5240640 5 monclient: authenticate success, global_id 55143 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff5a5240640 10 monclient: _renew_subs 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff5a5240640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff5a5240640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a013bac0 con 0x7ff5a013f750 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff5a5240640 10 monclient: _renew_subs 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff5a5240640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff5a5240640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff5a012ee30 con 0x7ff5a013f750 2024-09-13T10:33:26.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff588001d30 con 0x7ff5a013f750 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff5880048a0 con 0x7ff5a013f750 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff59dd9b640 4 set_mon_vals no callback set 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.522+0000 7ff597fff640 10 monclient: dump: 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.544 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.523+0000 7ff5a5240640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.523+0000 7ff5a5240640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff5840065c0 con 0x7ff584002860 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.523+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff588011c20 con 0x7ff5a013f750 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.523+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(109..109 src has 1..109) ==== 3898+0+0 (unknown 224616534 0 0) 0x7ff58804e450 con 0x7ff5a013f750 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.523+0000 7ff59f59e640 10 monclient: get_auth_request con 0x7ff58003fee0 auth_method 0 2024-09-13T10:33:26.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff59ed9d640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.181:6789/0 conn(0x7ff584002860 legacy=0x7ff584004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818680480 0 0) 0x7ff5840065c0 con 0x7ff584002860 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff597fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff597fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff597fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff597fff640 10 monclient(hunting): my global_id is 55152 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a013c4a0 con 0x7ff584002860 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1923365686 0 0) 0x7ff5a013c4a0 con 0x7ff584002860 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5840065c0 con 0x7ff584002860 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff590001ca0 con 0x7ff584002860 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff597fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff597fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.525+0000 7ff597fff640 10 monclient: dump: 2024-09-13T10:33:26.546 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.547 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.526+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3316720279 0 0) 0x7ff5840065c0 con 0x7ff584002860 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.526+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff58400a160 con 0x7ff584002860 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.526+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff5900057c0 con 0x7ff584002860 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.526+0000 7ff597fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.526+0000 7ff597fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.526+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.181:6789/0 conn(0x7ff584002860 legacy=0x7ff584004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.526+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.181:6789/0 conn(0x7ff584002860 legacy=0x7ff584004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.532+0000 7ff5a5240640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.532+0000 7ff5a5240640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff584009e50 con 0x7ff584009110 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.534+0000 7ff59ed9d640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.181:6789/0 conn(0x7ff584009110 legacy=0x7ff5840095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.534+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158719110 0 0) 0x7ff584009e50 con 0x7ff584009110 2024-09-13T10:33:26.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.534+0000 7ff597fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.534+0000 7ff597fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.534+0000 7ff597fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.534+0000 7ff597fff640 10 monclient(hunting): my global_id is 55161 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.534+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5840065c0 con 0x7ff584009110 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3244848283 0 0) 0x7ff5840065c0 con 0x7ff584009110 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff584009e50 con 0x7ff584009110 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff590003d00 con 0x7ff584009110 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 10 monclient: dump: 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.549 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3508674844 0 0) 0x7ff584009e50 con 0x7ff584009110 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff58400c3a0 con 0x7ff584009110 2024-09-13T10:33:26.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 1555777205) 0x7ff590005a30 con 0x7ff584009110 2024-09-13T10:33:26.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:26.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:26.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.181:6789/0 conn(0x7ff584009110 legacy=0x7ff5840095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff597fff640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.181:6789/0 conn(0x7ff584009110 legacy=0x7ff5840095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:26.551 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 220968, 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:26.553 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:26.554 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:26.555 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:26.556 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:26.559 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:26.561 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:26.563 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:26.565 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.566 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.568 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:26.569 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:26.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.571 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.572 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.574 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:26.574 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:26.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff5a5240640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff58003fee0 legacy=0x7ff5800423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff5a5240640 10 monclient: shutdown 2024-09-13T10:33:26.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff5a5240640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:26.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff5a5240640 1 -- 172.21.15.181:0/3200165233 >> v1:172.21.15.181:6789/0 conn(0x7ff5a013f750 legacy=0x7ff5a01d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff59f59e640 1 -- 172.21.15.181:0/3200165233 reap_dead start 2024-09-13T10:33:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff5a5240640 1 -- 172.21.15.181:0/3200165233 shutdown_connections 2024-09-13T10:33:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.535+0000 7ff5a5240640 1 -- 172.21.15.181:0/3200165233 >> 172.21.15.181:0/3200165233 conn(0x7ff5a00a6640 msgr2=0x7ff5a00a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.536+0000 7ff5a5240640 1 -- 172.21.15.181:0/3200165233 shutdown_connections 2024-09-13T10:33:26.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.536+0000 7ff5a5240640 1 -- 172.21.15.181:0/3200165233 wait complete. 2024-09-13T10:33:26.577 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:26.577 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:33:26.578 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:33:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.682+0000 7fd02535d640 10 monclient: get_monmap_and_config 2024-09-13T10:33:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.682+0000 7fd02535d640 10 monclient: build_initial_monmap 2024-09-13T10:33:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.682+0000 7fd02535d640 10 monclient: monmap: 2024-09-13T10:33:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:26.683735+0000 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:26.683735+0000 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:26.686 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.682+0000 7fd02535d640 1 Processor -- start 2024-09-13T10:33:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.682+0000 7fd02535d640 1 -- start start 2024-09-13T10:33:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.682+0000 7fd02535d640 10 monclient: init 2024-09-13T10:33:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.683+0000 7fd02535d640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.683+0000 7fd02535d640 10 monclient: _add_conns ranks=[7,6,1,0,8,2,3,4,5] 2024-09-13T10:33:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.683+0000 7fd02535d640 10 monclient(hunting): picked mon.noname-i con 0x7fd0200a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.683+0000 7fd02535d640 10 monclient(hunting): picked mon.noname-d con 0x7fd0200a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.683+0000 7fd02535d640 10 monclient(hunting): picked mon.noname-f con 0x7fd02013f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.683+0000 7fd02535d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0200a5fe0 con 0x7fd02013f9a0 2024-09-13T10:33:26.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.683+0000 7fd02535d640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0200a8080 con 0x7fd0200a6ab0 2024-09-13T10:33:26.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.683+0000 7fd02535d640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0200a42c0 con 0x7fd0200a66d0 2024-09-13T10:33:26.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.683+0000 7fd02535d640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:26.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.683+0000 7fd02535d640 10 monclient(hunting): authenticate will time out at 946.189287s 2024-09-13T10:33:26.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.683+0000 7fd0167fc640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fd0200a6ab0 0x7fd0200a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54172/0 (socket says 172.21.15.181:54172) 2024-09-13T10:33:26.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.683+0000 7fd0167fc640 1 -- 172.21.15.181:0/3531654727 learned_addr learned my addr 172.21.15.181:0/3531654727 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:26.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.685+0000 7fd0167fc640 1 -- 172.21.15.181:0/3531654727 >> v1:172.21.15.181:6792/0 conn(0x7fd0200a6ab0 legacy=0x7fd0200a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.685+0000 7fd01f7fe640 1 -- 172.21.15.181:0/3531654727 >> v1:172.21.15.195:6789/0 conn(0x7fd02013f9a0 legacy=0x7fd020141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.685+0000 7fd01effd640 1 -- 172.21.15.181:0/3531654727 >> v1:172.21.15.195:6792/0 conn(0x7fd0200a66d0 legacy=0x7fd0200a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.685+0000 7fd01e7fc640 1 -- 172.21.15.181:0/3531654727 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335491218 0 0) 0x7fd0200a8080 con 0x7fd0200a6ab0 2024-09-13T10:33:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.685+0000 7fd01e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.685+0000 7fd01e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.685+0000 7fd01e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.685+0000 7fd01e7fc640 10 monclient(hunting): my global_id is 5244 2024-09-13T10:33:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.685+0000 7fd01e7fc640 1 -- 172.21.15.181:0/3531654727 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd00c003520 con 0x7fd0200a6ab0 2024-09-13T10:33:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 1 -- 172.21.15.181:0/3531654727 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189100749 0 0) 0x7fd0200a5fe0 con 0x7fd02013f9a0 2024-09-13T10:33:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient(hunting): my global_id is 55459 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 1 -- 172.21.15.181:0/3531654727 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0200a8080 con 0x7fd02013f9a0 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 1 -- 172.21.15.181:0/3531654727 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1653301819 0 0) 0x7fd00c003520 con 0x7fd0200a6ab0 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 1 -- 172.21.15.181:0/3531654727 >> v1:172.21.15.195:6792/0 conn(0x7fd0200a66d0 legacy=0x7fd0200a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 1 -- 172.21.15.181:0/3531654727 >> v1:172.21.15.195:6789/0 conn(0x7fd02013f9a0 legacy=0x7fd020141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 1 monclient: found mon.noname-d 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 1 -- 172.21.15.181:0/3531654727 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0201464e0 con 0x7fd0200a6ab0 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient: _finish_auth 0 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:26.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 1 -- 172.21.15.181:0/3531654727 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd008001ae0 con 0x7fd0200a6ab0 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient: dump: 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.694 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd02535d640 5 monclient: authenticate success, global_id 5244 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd02535d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 1 -- 172.21.15.181:0/3531654727 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0080048a0 con 0x7fd0200a6ab0 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd02535d640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 1 -- 172.21.15.181:0/3531654727 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd008004e50 con 0x7fd0200a6ab0 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd02535d640 4 set_mon_vals no callback set 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd01e7fc640 10 monclient: dump: 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.696 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd02535d640 10 monclient: shutdown 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd02535d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd02535d640 1 -- 172.21.15.181:0/3531654727 >> v1:172.21.15.181:6792/0 conn(0x7fd0200a6ab0 legacy=0x7fd0200a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd02535d640 1 -- 172.21.15.181:0/3531654727 shutdown_connections 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd02535d640 1 -- 172.21.15.181:0/3531654727 >> 172.21.15.181:0/3531654727 conn(0x7fd0200abcd0 msgr2=0x7fd0200ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd02535d640 1 -- 172.21.15.181:0/3531654727 shutdown_connections 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.686+0000 7fd02535d640 1 -- 172.21.15.181:0/3531654727 wait complete. 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.687+0000 7fd02535d640 10 monclient: build_initial_monmap 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.687+0000 7fd02535d640 10 monclient: monmap: 2024-09-13T10:33:26.697 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:26.698 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.687+0000 7fd02535d640 1 Processor -- start 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.687+0000 7fd02535d640 1 -- start start 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.687+0000 7fd02535d640 10 monclient: init 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.688+0000 7fd02535d640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.688+0000 7fd02535d640 10 monclient: _add_conns ranks=[7,4,2,5,0,1,8,3,6] 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.688+0000 7fd02535d640 10 monclient(hunting): picked mon.noname-i con 0x7fd0200a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.688+0000 7fd02535d640 10 monclient(hunting): picked mon.noname-c con 0x7fd0200a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.688+0000 7fd02535d640 10 monclient(hunting): picked mon.noname-b con 0x7fd02013f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.688+0000 7fd02535d640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd02013ce40 con 0x7fd02013f9a0 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.688+0000 7fd02535d640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0200a27f0 con 0x7fd0200a6ab0 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.688+0000 7fd02535d640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd02013e900 con 0x7fd0200a66d0 2024-09-13T10:33:26.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.688+0000 7fd02535d640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:26.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.688+0000 7fd02535d640 10 monclient(hunting): authenticate will time out at 946.194385s 2024-09-13T10:33:26.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.688+0000 7fd0167fc640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fd0200a6ab0 0x7fd0201d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47642/0 (socket says 172.21.15.181:47642) 2024-09-13T10:33:26.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.688+0000 7fd0167fc640 1 -- 172.21.15.181:0/1134132357 learned_addr learned my addr 172.21.15.181:0/1134132357 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd0167fc640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6791/0 conn(0x7fd0200a6ab0 legacy=0x7fd0201d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd01f7fe640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd02013f9a0 legacy=0x7fd0201d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd01effd640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.195:6792/0 conn(0x7fd0200a66d0 legacy=0x7fd0201ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1871793952 0 0) 0x7fd0200a27f0 con 0x7fd0200a6ab0 2024-09-13T10:33:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 10 monclient(hunting): my global_id is 5386 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd000003520 con 0x7fd0200a6ab0 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836117791 0 0) 0x7fd02013e900 con 0x7fd0200a66d0 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 10 monclient(hunting): my global_id is 55402 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0200a27f0 con 0x7fd0200a66d0 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451047692 0 0) 0x7fd02013ce40 con 0x7fd02013f9a0 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 10 monclient(hunting): my global_id is 64847 2024-09-13T10:33:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd02013e900 con 0x7fd02013f9a0 2024-09-13T10:33:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.690+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 682288068 0 0) 0x7fd000003520 con 0x7fd0200a6ab0 2024-09-13T10:33:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd02013ce40 con 0x7fd0200a6ab0 2024-09-13T10:33:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd008004e50 con 0x7fd0200a6ab0 2024-09-13T10:33:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient(hunting): dump: 2024-09-13T10:33:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.709 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3331458715 0 0) 0x7fd0200a27f0 con 0x7fd0200a66d0 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd000003520 con 0x7fd0200a66d0 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2020180211 0 0) 0x7fd02013e900 con 0x7fd02013f9a0 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0200a27f0 con 0x7fd02013f9a0 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd010001d20 con 0x7fd0200a66d0 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient(hunting): dump: 2024-09-13T10:33:26.710 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.711 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd018002040 con 0x7fd02013f9a0 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient(hunting): dump: 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.712 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1099297527 0 0) 0x7fd02013ce40 con 0x7fd0200a6ab0 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.195:6792/0 conn(0x7fd0200a66d0 legacy=0x7fd0201ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd02013f9a0 legacy=0x7fd0201d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient: _finish_hunting 0 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 monclient: found mon.c 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:26.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd020142db0 con 0x7fd0200a6ab0 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient: _finish_auth 0 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient: _check_auth_tickets 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd02535d640 5 monclient: authenticate success, global_id 5386 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd02535d640 10 monclient: _renew_subs 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd02535d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd02535d640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd0201374e0 con 0x7fd0200a6ab0 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd02535d640 10 monclient: _renew_subs 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd02535d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd02535d640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd02013c360 con 0x7fd0200a6ab0 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd008001d30 con 0x7fd0200a6ab0 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:26.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd008001b00 con 0x7fd0200a6ab0 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd01dffb640 4 set_mon_vals no callback set 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.691+0000 7fd017fff640 10 monclient: dump: 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.715 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.692+0000 7fd02535d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.692+0000 7fd02535d640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd0040065c0 con 0x7fd004002860 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.692+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fd008011c60 con 0x7fd0200a6ab0 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.692+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(110..110 src has 1..110) ==== 3898+0+0 (unknown 864993509 0 0) 0x7fd00804e5e0 con 0x7fd0200a6ab0 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.692+0000 7fd01f7fe640 10 monclient: get_auth_request con 0x7fd0000405d0 auth_method 0 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd01effd640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd004002860 legacy=0x7fd004004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289675558 0 0) 0x7fd0040065c0 con 0x7fd004002860 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 10 monclient(hunting): my global_id is 64856 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd02013ce40 con 0x7fd004002860 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1539601551 0 0) 0x7fd02013ce40 con 0x7fd004002860 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0040065c0 con 0x7fd004002860 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd010003bb0 con 0x7fd004002860 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 10 monclient: dump: 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.717 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.718 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd01effd640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd004002860 legacy=0x7fd004004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd01effd640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd004002860 legacy=0x7fd004004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd01effd640 1 --1- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd004002860 0x7fd004004d00 :-1 s=OPENED pgs=222 cs=1 l=1).handle_message read tag failed 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd01effd640 1 --1- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd004002860 0x7fd004004d00 :-1 s=OPENED pgs=222 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd004002860 legacy=0x7fd004004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd004002860 legacy=0x7fd004004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.694+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd02013ce40 con 0x7fd000048d40 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd01effd640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd000048d40 legacy=0x7fd0000477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392667452 0 0) 0x7fd02013ce40 con 0x7fd000048d40 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 10 monclient(hunting): my global_id is 64865 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd02013e900 con 0x7fd000048d40 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1213478620 0 0) 0x7fd02013e900 con 0x7fd000048d40 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd02013ce40 con 0x7fd000048d40 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd0100042b0 con 0x7fd000048d40 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 10 monclient: dump: 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.720 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1276736468 0 0) 0x7fd02013ce40 con 0x7fd000048d40 2024-09-13T10:33:26.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd000048980 con 0x7fd000048d40 2024-09-13T10:33:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd010005830 con 0x7fd000048d40 2024-09-13T10:33:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd000048d40 legacy=0x7fd0000477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.697+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd000048d40 legacy=0x7fd0000477b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.703+0000 7fd02535d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:26.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.703+0000 7fd02535d640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd004009d80 con 0x7fd004009140 2024-09-13T10:33:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd01effd640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd004009140 legacy=0x7fd004009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 93804568 0 0) 0x7fd004009d80 con 0x7fd004009140 2024-09-13T10:33:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 10 monclient(hunting): my global_id is 64874 2024-09-13T10:33:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd02013ce40 con 0x7fd004009140 2024-09-13T10:33:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2154390721 0 0) 0x7fd02013ce40 con 0x7fd004009140 2024-09-13T10:33:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd004009d80 con 0x7fd004009140 2024-09-13T10:33:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd010005f10 con 0x7fd004009140 2024-09-13T10:33:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 10 monclient: dump: 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.725 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.726 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2903848288 0 0) 0x7fd004009d80 con 0x7fd004009140 2024-09-13T10:33:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd00400c350 con 0x7fd004009140 2024-09-13T10:33:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 3083065559) 0x7fd010008210 con 0x7fd004009140 2024-09-13T10:33:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd004009140 legacy=0x7fd004009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd017fff640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6790/0 conn(0x7fd004009140 legacy=0x7fd004009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:26.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.706+0000 7fd01f7fe640 1 -- 172.21.15.181:0/1134132357 reap_dead start 2024-09-13T10:33:26.726 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:26.727 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:26.727 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:26.727 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:26.727 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:26.727 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 132611, 2024-09-13T10:33:26.727 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:26.727 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:26.727 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:26.727 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:26.727 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:26.727 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:26.727 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:26.728 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:26.729 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:26.730 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:26.731 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.732 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.733 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.735 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:26.746 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.707+0000 7fd02535d640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.195:6800/1839191919 conn(0x7fd0000405d0 legacy=0x7fd000042a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.707+0000 7fd02535d640 10 monclient: shutdown 2024-09-13T10:33:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.707+0000 7fd02535d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.707+0000 7fd02535d640 1 -- 172.21.15.181:0/1134132357 >> v1:172.21.15.181:6791/0 conn(0x7fd0200a6ab0 legacy=0x7fd0201d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.707+0000 7fd02535d640 1 -- 172.21.15.181:0/1134132357 shutdown_connections 2024-09-13T10:33:26.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.707+0000 7fd02535d640 1 -- 172.21.15.181:0/1134132357 >> 172.21.15.181:0/1134132357 conn(0x7fd0200abcd0 msgr2=0x7fd0200a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.707+0000 7fd02535d640 1 -- 172.21.15.181:0/1134132357 shutdown_connections 2024-09-13T10:33:26.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.707+0000 7fd02535d640 1 -- 172.21.15.181:0/1134132357 wait complete. 2024-09-13T10:33:26.748 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:26.748 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:33:26.748 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:33:26.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.844+0000 7f0c100fe640 10 monclient: get_monmap_and_config 2024-09-13T10:33:26.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.844+0000 7f0c100fe640 10 monclient: build_initial_monmap 2024-09-13T10:33:26.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.844+0000 7f0c100fe640 10 monclient: monmap: 2024-09-13T10:33:26.848 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:26.848 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.848 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:26.846463+0000 2024-09-13T10:33:26.848 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:26.846463+0000 2024-09-13T10:33:26.849 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:26.849 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.849 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:26.849 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:26.849 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:26.849 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:26.849 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:26.850 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:26.850 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:26.850 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:26.850 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:26.850 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.845+0000 7f0c100fe640 1 Processor -- start 2024-09-13T10:33:26.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.845+0000 7f0c100fe640 1 -- start start 2024-09-13T10:33:26.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.845+0000 7f0c100fe640 10 monclient: init 2024-09-13T10:33:26.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.846+0000 7f0c100fe640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:26.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.846+0000 7f0c100fe640 10 monclient: _add_conns ranks=[5,7,4,3,6,0,2,1,8] 2024-09-13T10:33:26.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.846+0000 7f0c100fe640 10 monclient(hunting): picked mon.noname-h con 0x7f0c080a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:26.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.846+0000 7f0c100fe640 10 monclient(hunting): picked mon.noname-i con 0x7f0c080a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:26.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.846+0000 7f0c100fe640 10 monclient(hunting): picked mon.noname-c con 0x7f0c0813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:26.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.846+0000 7f0c100fe640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c080a4bc0 con 0x7f0c0813f750 2024-09-13T10:33:26.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.846+0000 7f0c100fe640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c0813a320 con 0x7f0c080a6640 2024-09-13T10:33:26.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.846+0000 7f0c100fe640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c080a8100 con 0x7f0c080a8340 2024-09-13T10:33:26.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.846+0000 7f0c100fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:26.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.846+0000 7f0c100fe640 10 monclient(hunting): authenticate will time out at 946.352134s 2024-09-13T10:33:26.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.846+0000 7f0c0e69b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f0c0813f750 0x7f0c08141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47658/0 (socket says 172.21.15.181:47658) 2024-09-13T10:33:26.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.846+0000 7f0c0e69b640 1 -- 172.21.15.181:0/3447196956 learned_addr learned my addr 172.21.15.181:0/3447196956 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:26.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0e69b640 1 -- 172.21.15.181:0/3447196956 >> v1:172.21.15.181:6791/0 conn(0x7f0c0813f750 legacy=0x7f0c08141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0de9a640 1 -- 172.21.15.181:0/3447196956 >> v1:172.21.15.195:6791/0 conn(0x7f0c080a6640 legacy=0x7f0c08139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0d699640 1 -- 172.21.15.181:0/3447196956 >> v1:172.21.15.195:6792/0 conn(0x7f0c080a8340 legacy=0x7f0c08139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3847283278 0 0) 0x7f0c080a4bc0 con 0x7f0c0813f750 2024-09-13T10:33:26.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient(hunting): my global_id is 5395 2024-09-13T10:33:26.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bf4003520 con 0x7f0c0813f750 2024-09-13T10:33:26.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722976556 0 0) 0x7f0c080a8100 con 0x7f0c080a8340 2024-09-13T10:33:26.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient(hunting): my global_id is 55411 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c080a4bc0 con 0x7f0c080a8340 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352963491 0 0) 0x7f0c0813a320 con 0x7f0c080a6640 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient(hunting): my global_id is 5414 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c080a8100 con 0x7f0c080a6640 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3530171701 0 0) 0x7f0bf4003520 con 0x7f0c0813f750 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 >> v1:172.21.15.195:6792/0 conn(0x7f0c080a8340 legacy=0x7f0c08139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 >> v1:172.21.15.195:6791/0 conn(0x7f0c080a6640 legacy=0x7f0c08139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient: _finish_hunting 0 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 monclient: found mon.noname-c 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c080a48e0 con 0x7f0c0813f750 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient: _finish_auth 0 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient: _check_auth_tickets 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c00001e60 con 0x7f0c0813f750 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c100fe640 5 monclient: authenticate success, global_id 5395 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c100fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient: dump: 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.869 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.870 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.870 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.870 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c100fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:26.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c00004c20 con 0x7f0c0813f750 2024-09-13T10:33:26.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:26.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c100fe640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:26.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 1 -- 172.21.15.181:0/3447196956 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c00005190 con 0x7f0c0813f750 2024-09-13T10:33:26.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c100fe640 4 set_mon_vals no callback set 2024-09-13T10:33:26.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:26.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.848+0000 7f0c0ce98640 10 monclient: dump: 2024-09-13T10:33:26.871 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.871 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.871 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.871 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.871 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.872 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.872 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.872 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.872 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.872 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.872 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.873 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.873 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.873 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.873 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.873 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.849+0000 7f0c100fe640 10 monclient: shutdown 2024-09-13T10:33:26.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.849+0000 7f0c100fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:26.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.849+0000 7f0c100fe640 1 -- 172.21.15.181:0/3447196956 >> v1:172.21.15.181:6791/0 conn(0x7f0c0813f750 legacy=0x7f0c08141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.849+0000 7f0c100fe640 1 -- 172.21.15.181:0/3447196956 shutdown_connections 2024-09-13T10:33:26.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.849+0000 7f0c100fe640 1 -- 172.21.15.181:0/3447196956 >> 172.21.15.181:0/3447196956 conn(0x7f0c08077170 msgr2=0x7f0c080abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:26.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.849+0000 7f0c100fe640 1 -- 172.21.15.181:0/3447196956 shutdown_connections 2024-09-13T10:33:26.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.849+0000 7f0c100fe640 1 -- 172.21.15.181:0/3447196956 wait complete. 2024-09-13T10:33:26.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 10 monclient: build_initial_monmap 2024-09-13T10:33:26.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 10 monclient: monmap: 2024-09-13T10:33:26.875 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:26.875 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:26.875 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:26.875 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:26.876 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:26.876 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:26.876 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:26.876 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:26.876 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:26.876 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:26.876 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:26.876 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:26.876 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:26.877 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:26.877 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:26.877 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 1 Processor -- start 2024-09-13T10:33:26.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 1 -- start start 2024-09-13T10:33:26.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 10 monclient: init 2024-09-13T10:33:26.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:26.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 10 monclient: _add_conns ranks=[1,0,6,3,4,7,5,8,2] 2024-09-13T10:33:26.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 10 monclient(hunting): picked mon.noname-f con 0x7f0c080a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:26.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 10 monclient(hunting): picked mon.noname-a con 0x7f0c0813f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:26.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 10 monclient(hunting): picked mon.noname-d con 0x7f0c0813cdb0 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:26.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c08134d90 con 0x7f0c0813f750 2024-09-13T10:33:26.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c0813e760 con 0x7f0c080a8340 2024-09-13T10:33:26.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c08134ab0 con 0x7f0c0813cdb0 2024-09-13T10:33:26.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:26.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.850+0000 7f0c100fe640 10 monclient(hunting): authenticate will time out at 946.356964s 2024-09-13T10:33:26.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.851+0000 7f0c0e69b640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f0c0813cdb0 0x7f0c081d6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54176/0 (socket says 172.21.15.181:54176) 2024-09-13T10:33:26.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.851+0000 7f0c0e69b640 1 -- 172.21.15.181:0/1257773650 learned_addr learned my addr 172.21.15.181:0/1257773650 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:26.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0c0e69b640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.181:6792/0 conn(0x7f0c0813cdb0 legacy=0x7f0c081d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0c0d699640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.181:6789/0 conn(0x7f0c0813f750 legacy=0x7f0c0812fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0c0de9a640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.195:6789/0 conn(0x7f0c080a8340 legacy=0x7f0c0812f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 234419270 0 0) 0x7f0c08134ab0 con 0x7f0c0813cdb0 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): my global_id is 5253 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bec003550 con 0x7f0c0813cdb0 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150223733 0 0) 0x7f0c08134d90 con 0x7f0c0813f750 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): my global_id is 55170 2024-09-13T10:33:26.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c08134ab0 con 0x7f0c0813f750 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768249859 0 0) 0x7f0c0813e760 con 0x7f0c080a8340 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): my global_id is 55468 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c08134d90 con 0x7f0c080a8340 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 266510243 0 0) 0x7f0c08134ab0 con 0x7f0c0813f750 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c0813e760 con 0x7f0c0813f750 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0bf8001d40 con 0x7f0c0813f750 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): dump: 2024-09-13T10:33:26.880 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.881 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.882 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:26.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3548744596 0 0) 0x7f0bec003550 con 0x7f0c0813cdb0 2024-09-13T10:33:26.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c08134ab0 con 0x7f0c0813cdb0 2024-09-13T10:33:26.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c000020b0 con 0x7f0c0813cdb0 2024-09-13T10:33:26.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:26.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:26.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): dump: 2024-09-13T10:33:26.883 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.883 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.883 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.883 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.883 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.883 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.883 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.883 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.883 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.884 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.884 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.884 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.884 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.884 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.884 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.884 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 543280695 0 0) 0x7f0c08134d90 con 0x7f0c080a8340 2024-09-13T10:33:26.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0bec003550 con 0x7f0c080a8340 2024-09-13T10:33:26.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c04003610 con 0x7f0c080a8340 2024-09-13T10:33:26.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:26.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:33:26.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient(hunting): dump: 2024-09-13T10:33:26.885 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.885 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.885 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.885 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.885 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.885 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.885 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.885 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.886 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.886 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.886 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.886 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.886 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.886 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.887 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.887 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1554777222 0 0) 0x7f0c0813e760 con 0x7f0c0813f750 2024-09-13T10:33:26.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.181:6792/0 conn(0x7f0c0813cdb0 legacy=0x7f0c081d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.195:6789/0 conn(0x7f0c080a8340 legacy=0x7f0c0812f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:33:26.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 monclient: found mon.a 2024-09-13T10:33:26.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:26.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:26.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0813e070 con 0x7f0c0813f750 2024-09-13T10:33:26.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient: _finish_auth 0 2024-09-13T10:33:26.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:33:26.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:26.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0c100fe640 5 monclient: authenticate success, global_id 55170 2024-09-13T10:33:26.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0c100fe640 10 monclient: _renew_subs 2024-09-13T10:33:26.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0c100fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:26.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0c100fe640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0c0813e2f0 con 0x7f0c0813f750 2024-09-13T10:33:26.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0c100fe640 10 monclient: _renew_subs 2024-09-13T10:33:26.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0c100fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:26.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0c100fe640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0c081d8040 con 0x7f0c0813f750 2024-09-13T10:33:26.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0bf8003a00 con 0x7f0c0813f750 2024-09-13T10:33:26.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:26.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0bf8003f30 con 0x7f0c0813f750 2024-09-13T10:33:26.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.853+0000 7f0bfffff640 4 set_mon_vals no callback set 2024-09-13T10:33:26.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.854+0000 7f0bfe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:26.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.854+0000 7f0bfe7fc640 10 monclient: dump: 2024-09-13T10:33:26.891 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.891 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.892 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.892 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.892 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.892 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.892 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.892 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.893 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.893 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.893 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.893 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.893 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.893 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.893 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.893 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.854+0000 7f0c100fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:26.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.854+0000 7f0c100fe640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0bf00065c0 con 0x7f0bf0002860 2024-09-13T10:33:26.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.854+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0bf8004200 con 0x7f0c0813f750 2024-09-13T10:33:26.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.854+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(110..110 src has 1..110) ==== 3898+0+0 (unknown 864993509 0 0) 0x7f0bf804e2e0 con 0x7f0c0813f750 2024-09-13T10:33:26.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.855+0000 7f0c0e69b640 10 monclient: get_auth_request con 0x7f0bec040680 auth_method 0 2024-09-13T10:33:26.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.856+0000 7f0c0de9a640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.181:6791/0 conn(0x7f0bf0002860 legacy=0x7f0bf0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.856+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3892896912 0 0) 0x7f0bf00065c0 con 0x7f0bf0002860 2024-09-13T10:33:26.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.856+0000 7f0bfe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.856+0000 7f0bfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.856+0000 7f0bfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.856+0000 7f0bfe7fc640 10 monclient(hunting): my global_id is 5404 2024-09-13T10:33:26.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.856+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c0813e760 con 0x7f0bf0002860 2024-09-13T10:33:26.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3363033089 0 0) 0x7f0c0813e760 con 0x7f0bf0002860 2024-09-13T10:33:26.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0bf00065c0 con 0x7f0bf0002860 2024-09-13T10:33:26.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c04003e90 con 0x7f0bf0002860 2024-09-13T10:33:26.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:26.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 10 monclient: dump: 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.896 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.897 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.897 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.897 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1857741800 0 0) 0x7f0bf00065c0 con 0x7f0bf0002860 2024-09-13T10:33:26.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bf000a160 con 0x7f0bf0002860 2024-09-13T10:33:26.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0c040040d0 con 0x7f0bf0002860 2024-09-13T10:33:26.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:26.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:26.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.181:6791/0 conn(0x7f0bf0002860 legacy=0x7f0bf0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.857+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.181:6791/0 conn(0x7f0bf0002860 legacy=0x7f0bf0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:26.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.863+0000 7f0c100fe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:26.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.863+0000 7f0c100fe640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0bf0009e50 con 0x7f0bf0009110 2024-09-13T10:33:26.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0c0de9a640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.181:6791/0 conn(0x7f0bf0009110 legacy=0x7f0bf00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:26.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889294617 0 0) 0x7f0bf0009e50 con 0x7f0bf0009110 2024-09-13T10:33:26.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:26.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:26.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:26.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 10 monclient(hunting): my global_id is 5413 2024-09-13T10:33:26.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bf00065c0 con 0x7f0bf0009110 2024-09-13T10:33:26.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2375271289 0 0) 0x7f0bf00065c0 con 0x7f0bf0009110 2024-09-13T10:33:26.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0bf0009e50 con 0x7f0bf0009110 2024-09-13T10:33:26.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c04005b00 con 0x7f0bf0009110 2024-09-13T10:33:26.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:26.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:26.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 10 monclient: dump: 2024-09-13T10:33:26.900 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:26.900 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:26.900 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.901 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:26.901 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:26.901 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:26.901 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:26.901 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:26.901 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:26.902 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:26.902 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:26.902 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:26.902 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:26.902 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:26.902 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:26.903 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:26.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2220447895 0 0) 0x7f0bf0009e50 con 0x7f0bf0009110 2024-09-13T10:33:26.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0bf000c3a0 con 0x7f0bf0009110 2024-09-13T10:33:26.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 3220226788) 0x7f0c04007e40 con 0x7f0bf0009110 2024-09-13T10:33:26.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:26.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:26.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.181:6791/0 conn(0x7f0bf0009110 legacy=0x7f0bf00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.866+0000 7f0bfe7fc640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.181:6791/0 conn(0x7f0bf0009110 legacy=0x7f0bf00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:26.904 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:26.904 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:26.904 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:26.904 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:26.904 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:26.904 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 221316, 2024-09-13T10:33:26.904 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:26.904 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:26.904 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:26.905 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:26.905 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:26.905 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:26.905 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:26.905 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:26.905 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:26.905 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:26.905 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.905 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:33:26.905 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:26.905 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:26.905 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:26.906 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.908 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:26.908 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:26.908 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:26.908 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:26.908 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:26.908 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:26.908 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:26.908 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:26.908 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:26.908 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:26.909 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:26.909 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:26.909 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:26.909 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:26.909 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:26.909 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:26.909 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:26.909 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:26.909 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:26.909 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.910 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:26.911 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:26.911 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.911 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.911 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.911 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:26.911 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.911 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.911 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.912 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:26.912 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:26.912 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.912 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.912 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.912 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:26.912 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:26.912 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.912 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:26.915 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.916 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.916 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.916 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:26.916 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:26.916 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.916 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.916 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:26.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:26.918 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.919 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.919 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:26.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:26.919 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.919 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.919 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:26.922 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:26.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:26.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:26.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.923 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:26.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:26.923 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:26.923 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.923 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:26.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:26.924 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:26.924 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:26.924 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:26.924 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.924 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.924 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:26.924 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:26.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.924 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:26.925 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:26.925 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:26.925 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.925 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.925 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:33:26.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.925 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:26.925 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:26.925 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:26.925 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.925 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:26.925 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:26.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:26.926 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:26.926 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:26.926 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:26.926 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:26.926 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:26.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:26.926 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:26.926 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:26.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.867+0000 7f0c100fe640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0bec040680 legacy=0x7f0bec042b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.867+0000 7f0c100fe640 10 monclient: shutdown 2024-09-13T10:33:26.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.867+0000 7f0c100fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:26.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.867+0000 7f0c100fe640 1 -- 172.21.15.181:0/1257773650 >> v1:172.21.15.181:6789/0 conn(0x7f0c0813f750 legacy=0x7f0c0812fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:26.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.867+0000 7f0c0e69b640 1 -- 172.21.15.181:0/1257773650 reap_dead start 2024-09-13T10:33:26.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.867+0000 7f0c0e69b640 1 -- 172.21.15.181:0/1257773650 reap_dead start 2024-09-13T10:33:26.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.867+0000 7f0c100fe640 1 -- 172.21.15.181:0/1257773650 shutdown_connections 2024-09-13T10:33:26.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.867+0000 7f0c100fe640 1 -- 172.21.15.181:0/1257773650 >> 172.21.15.181:0/1257773650 conn(0x7f0c080a6640 msgr2=0x7f0c080a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:26.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.867+0000 7f0c100fe640 1 -- 172.21.15.181:0/1257773650 shutdown_connections 2024-09-13T10:33:26.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:26.867+0000 7f0c100fe640 1 -- 172.21.15.181:0/1257773650 wait complete. 2024-09-13T10:33:26.929 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:26.929 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:33:26.929 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:33:27.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.025+0000 7fc3ca9e2640 10 monclient: get_monmap_and_config 2024-09-13T10:33:27.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.025+0000 7fc3ca9e2640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.025+0000 7fc3ca9e2640 10 monclient: monmap: 2024-09-13T10:33:27.029 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.029 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.029 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:27.027400+0000 2024-09-13T10:33:27.029 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:27.027400+0000 2024-09-13T10:33:27.029 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:27.030 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.030 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:27.030 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:27.030 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:27.030 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:27.030 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:27.031 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:27.031 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:27.031 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:27.031 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:27.031 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.026+0000 7fc3ca9e2640 1 Processor -- start 2024-09-13T10:33:27.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.026+0000 7fc3ca9e2640 1 -- start start 2024-09-13T10:33:27.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.026+0000 7fc3ca9e2640 10 monclient: init 2024-09-13T10:33:27.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3ca9e2640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:27.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3ca9e2640 10 monclient: _add_conns ranks=[6,4,8,3,7,0,2,5,1] 2024-09-13T10:33:27.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3ca9e2640 10 monclient(hunting): picked mon.noname-d con 0x7fc3c40a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:27.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3ca9e2640 10 monclient(hunting): picked mon.noname-c con 0x7fc3c40a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:27.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3ca9e2640 10 monclient(hunting): picked mon.noname-e con 0x7fc3c413f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3ca9e2640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c40a4bc0 con 0x7fc3c40a8340 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3ca9e2640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c413a320 con 0x7fc3c40a6640 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3ca9e2640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c40a8100 con 0x7fc3c413f750 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3ca9e2640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3ca9e2640 10 monclient(hunting): authenticate will time out at 946.533294s 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3c3fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fc3c40a6640 0x7fc3c4139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54180/0 (socket says 172.21.15.181:54180) 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3c3fff640 1 -- 172.21.15.181:0/3064106647 learned_addr learned my addr 172.21.15.181:0/3064106647 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.027+0000 7fc3c8f7f640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fc3c413f750 0x7fc3c4141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:37578/0 (socket says 172.21.15.181:37578) 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c8f7f640 1 -- 172.21.15.181:0/3064106647 >> v1:172.21.15.181:6793/0 conn(0x7fc3c413f750 legacy=0x7fc3c4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3bbfff640 1 -- 172.21.15.181:0/3064106647 >> v1:172.21.15.181:6791/0 conn(0x7fc3c40a8340 legacy=0x7fc3c4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c3fff640 1 -- 172.21.15.181:0/3064106647 >> v1:172.21.15.181:6792/0 conn(0x7fc3c40a6640 legacy=0x7fc3c4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65299999 0 0) 0x7fc3c40a8100 con 0x7fc3c413f750 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 10 monclient(hunting): my global_id is 84122 2024-09-13T10:33:27.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3b0003520 con 0x7fc3c413f750 2024-09-13T10:33:27.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001891168 0 0) 0x7fc3c40a4bc0 con 0x7fc3c40a8340 2024-09-13T10:33:27.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 10 monclient(hunting): my global_id is 5422 2024-09-13T10:33:27.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c40a8100 con 0x7fc3c40a8340 2024-09-13T10:33:27.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346572647 0 0) 0x7fc3c413a320 con 0x7fc3c40a6640 2024-09-13T10:33:27.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 10 monclient(hunting): my global_id is 5262 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.029+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c40a4bc0 con 0x7fc3c40a6640 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4191315463 0 0) 0x7fc3b0003520 con 0x7fc3c413f750 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 >> v1:172.21.15.181:6792/0 conn(0x7fc3c40a6640 legacy=0x7fc3c4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 >> v1:172.21.15.181:6791/0 conn(0x7fc3c40a8340 legacy=0x7fc3c4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 10 monclient: _finish_hunting 0 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 1 monclient: found mon.noname-e 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c40a48e0 con 0x7fc3c413f750 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 10 monclient: _finish_auth 0 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 10 monclient: _check_auth_tickets 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:27.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3bc001e60 con 0x7fc3c413f750 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 10 monclient: dump: 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.046 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3ca9e2640 5 monclient: authenticate success, global_id 84122 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3ca9e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3bc004b60 con 0x7fc3c413f750 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3ca9e2640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 1 -- 172.21.15.181:0/3064106647 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3bc005050 con 0x7fc3c413f750 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3ca9e2640 4 set_mon_vals no callback set 2024-09-13T10:33:27.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3c37fe640 10 monclient: dump: 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.048 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.049 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.049 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.049 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.049 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3ca9e2640 10 monclient: shutdown 2024-09-13T10:33:27.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3ca9e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:27.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/3064106647 >> v1:172.21.15.181:6793/0 conn(0x7fc3c413f750 legacy=0x7fc3c4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/3064106647 shutdown_connections 2024-09-13T10:33:27.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/3064106647 >> 172.21.15.181:0/3064106647 conn(0x7fc3c4077170 msgr2=0x7fc3c40abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:27.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/3064106647 shutdown_connections 2024-09-13T10:33:27.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.030+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/3064106647 wait complete. 2024-09-13T10:33:27.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.031+0000 7fc3ca9e2640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.031+0000 7fc3ca9e2640 10 monclient: monmap: 2024-09-13T10:33:27.050 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.050 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:27.050 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:27.050 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:27.050 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:27.050 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:27.050 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:27.050 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:27.050 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:27.050 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:27.050 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.031+0000 7fc3ca9e2640 1 Processor -- start 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.031+0000 7fc3ca9e2640 1 -- start start 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.031+0000 7fc3ca9e2640 10 monclient: init 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.032+0000 7fc3ca9e2640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.032+0000 7fc3ca9e2640 10 monclient: _add_conns ranks=[5,1,4,2,3,6,7,8,0] 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.032+0000 7fc3ca9e2640 10 monclient(hunting): picked mon.noname-h con 0x7fc3c40a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.032+0000 7fc3ca9e2640 10 monclient(hunting): picked mon.noname-f con 0x7fc3c413f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:27.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.032+0000 7fc3ca9e2640 10 monclient(hunting): picked mon.noname-c con 0x7fc3c41d4520 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.032+0000 7fc3ca9e2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c40a0fa0 con 0x7fc3c413f750 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.032+0000 7fc3ca9e2640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c409e280 con 0x7fc3c41d4520 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.032+0000 7fc3ca9e2640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c40a1730 con 0x7fc3c40a8340 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.032+0000 7fc3ca9e2640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.032+0000 7fc3ca9e2640 10 monclient(hunting): authenticate will time out at 946.538140s 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.032+0000 7fc3c8f7f640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fc3c41d4520 0x7fc3c41d6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47712/0 (socket says 172.21.15.181:47712) 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.032+0000 7fc3c8f7f640 1 -- 172.21.15.181:0/2580277560 learned_addr learned my addr 172.21.15.181:0/2580277560 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c8f7f640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.181:6791/0 conn(0x7fc3c41d4520 legacy=0x7fc3c41d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294931858 0 0) 0x7fc3c409e280 con 0x7fc3c41d4520 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient(hunting): my global_id is 5431 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3a4003550 con 0x7fc3c41d4520 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3bbfff640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.195:6789/0 conn(0x7fc3c413f750 legacy=0x7fc3c409db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c3fff640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.195:6791/0 conn(0x7fc3c40a8340 legacy=0x7fc3c409d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1560375360 0 0) 0x7fc3a4003550 con 0x7fc3c41d4520 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3c409e280 con 0x7fc3c41d4520 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3bc0020b0 con 0x7fc3c41d4520 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient(hunting): dump: 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.053 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3177173488 0 0) 0x7fc3c409e280 con 0x7fc3c41d4520 2024-09-13T10:33:27.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.195:6791/0 conn(0x7fc3c40a8340 legacy=0x7fc3c409d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.195:6789/0 conn(0x7fc3c413f750 legacy=0x7fc3c409db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient: _finish_hunting 0 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 1 monclient: found mon.c 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c40a1280 con 0x7fc3c41d4520 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient: _finish_auth 0 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient: _check_auth_tickets 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3ca9e2640 5 monclient: authenticate success, global_id 5431 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3ca9e2640 10 monclient: _renew_subs 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3ca9e2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:27.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c40aa170 con 0x7fc3c41d4520 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3ca9e2640 10 monclient: _renew_subs 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3ca9e2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3c40a0cc0 con 0x7fc3c41d4520 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3bc005300 con 0x7fc3c41d4520 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3bc005870 con 0x7fc3c41d4520 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.034+0000 7fc3c2ffd640 4 set_mon_vals no callback set 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.035+0000 7fc3c17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.035+0000 7fc3c17fa640 10 monclient: dump: 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.056 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.057 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.057 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.057 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.057 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.057 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.057 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.057 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.057 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.035+0000 7fc3ca9e2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.036+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3a80065c0 con 0x7fc3a8002860 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.036+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fc3bc005ac0 con 0x7fc3c41d4520 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.036+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(110..110 src has 1..110) ==== 3898+0+0 (unknown 864993509 0 0) 0x7fc3bc04e7a0 con 0x7fc3c41d4520 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.036+0000 7fc3bbfff640 10 monclient: get_auth_request con 0x7fc3a403fc60 auth_method 0 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c3fff640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.181:6792/0 conn(0x7fc3a8002860 legacy=0x7fc3a8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3048631821 0 0) 0x7fc3a80065c0 con 0x7fc3a8002860 2024-09-13T10:33:27.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 10 monclient(hunting): my global_id is 5271 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c409e280 con 0x7fc3a8002860 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1270785074 0 0) 0x7fc3c409e280 con 0x7fc3a8002860 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3a80065c0 con 0x7fc3a8002860 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3b4001320 con 0x7fc3a8002860 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 10 monclient: dump: 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.059 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.060 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4022255110 0 0) 0x7fc3a80065c0 con 0x7fc3a8002860 2024-09-13T10:33:27.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.038+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3a800a160 con 0x7fc3a8002860 2024-09-13T10:33:27.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.039+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc3b4004910 con 0x7fc3a8002860 2024-09-13T10:33:27.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.039+0000 7fc3c17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:27.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.039+0000 7fc3c17fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:27.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.039+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.181:6792/0 conn(0x7fc3a8002860 legacy=0x7fc3a8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.039+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.181:6792/0 conn(0x7fc3a8002860 legacy=0x7fc3a8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:27.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.045+0000 7fc3ca9e2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:27.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.045+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3a8009e70 con 0x7fc3a8009130 2024-09-13T10:33:27.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c3fff640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.181:6792/0 conn(0x7fc3a8009130 legacy=0x7fc3a80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229644021 0 0) 0x7fc3a8009e70 con 0x7fc3a8009130 2024-09-13T10:33:27.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 10 monclient(hunting): my global_id is 5280 2024-09-13T10:33:27.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3a80065c0 con 0x7fc3a8009130 2024-09-13T10:33:27.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1736595381 0 0) 0x7fc3a80065c0 con 0x7fc3a8009130 2024-09-13T10:33:27.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3a8009e70 con 0x7fc3a8009130 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc3b4005030 con 0x7fc3a8009130 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 10 monclient: dump: 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.064 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1584569994 0 0) 0x7fc3a8009e70 con 0x7fc3a8009130 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.047+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc3a800c3f0 con 0x7fc3a8009130 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 880098801) 0x7fc3b4007390 con 0x7fc3a8009130 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3c17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3c17fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.181:6792/0 conn(0x7fc3a8009130 legacy=0x7fc3a80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3c17fa640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.181:6792/0 conn(0x7fc3a8009130 legacy=0x7fc3a80095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:27.066 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 221491, 2024-09-13T10:33:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:27.066 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:27.067 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:27.068 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.069 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.072 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.073 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:27.076 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:27.077 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:27.081 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.082 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.083 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:27.083 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:27.083 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.083 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:27.083 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.083 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.083 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:27.084 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:27.084 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.084 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.084 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.084 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:27.084 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:27.084 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.085 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:27.085 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.085 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.085 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:27.085 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:27.085 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.085 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.085 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:27.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.087 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.087 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.087 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:27.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.087 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.087 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:27.087 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:27.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.195:6800/1839191919 conn(0x7fc3a403fc60 legacy=0x7fc3a4042120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3ca9e2640 10 monclient: shutdown 2024-09-13T10:33:27.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3ca9e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:27.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/2580277560 >> v1:172.21.15.181:6791/0 conn(0x7fc3c41d4520 legacy=0x7fc3c41d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3c8f7f640 1 -- 172.21.15.181:0/2580277560 reap_dead start 2024-09-13T10:33:27.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3c8f7f640 1 -- 172.21.15.181:0/2580277560 reap_dead start 2024-09-13T10:33:27.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/2580277560 shutdown_connections 2024-09-13T10:33:27.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/2580277560 >> 172.21.15.181:0/2580277560 conn(0x7fc3c40a6640 msgr2=0x7fc3c4141cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:27.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/2580277560 shutdown_connections 2024-09-13T10:33:27.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.048+0000 7fc3ca9e2640 1 -- 172.21.15.181:0/2580277560 wait complete. 2024-09-13T10:33:27.090 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:27.090 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:33:27.090 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:33:27.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.185+0000 7f9dd810e640 10 monclient: get_monmap_and_config 2024-09-13T10:33:27.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.185+0000 7f9dd810e640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.185+0000 7f9dd810e640 10 monclient: monmap: 2024-09-13T10:33:27.189 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.189 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.189 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:27.187539+0000 2024-09-13T10:33:27.189 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:27.187539+0000 2024-09-13T10:33:27.189 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:27.189 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.189 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:27.189 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:27.189 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:27.190 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:27.190 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:27.190 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:27.190 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:27.190 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:27.190 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:27.190 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.186+0000 7f9dd810e640 1 Processor -- start 2024-09-13T10:33:27.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.186+0000 7f9dd810e640 1 -- start start 2024-09-13T10:33:27.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.186+0000 7f9dd810e640 10 monclient: init 2024-09-13T10:33:27.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.187+0000 7f9dd810e640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:27.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.187+0000 7f9dd810e640 10 monclient: _add_conns ranks=[4,0,5,7,2,8,3,1,6] 2024-09-13T10:33:27.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.187+0000 7f9dd810e640 10 monclient(hunting): picked mon.noname-c con 0x7f9dd00a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:27.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.187+0000 7f9dd810e640 10 monclient(hunting): picked mon.noname-a con 0x7f9dd00a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:27.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.187+0000 7f9dd810e640 10 monclient(hunting): picked mon.noname-h con 0x7f9dd013f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:27.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.187+0000 7f9dd810e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd00a4bc0 con 0x7f9dd00a8340 2024-09-13T10:33:27.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.187+0000 7f9dd810e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd013a320 con 0x7f9dd00a6640 2024-09-13T10:33:27.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.187+0000 7f9dd810e640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd00a8100 con 0x7f9dd013f750 2024-09-13T10:33:27.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.187+0000 7f9dd810e640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:27.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.187+0000 7f9dd810e640 10 monclient(hunting): authenticate will time out at 946.693474s 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.187+0000 7f9dd5eaa640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f9dd00a6640 0x7f9dd0139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47726/0 (socket says 172.21.15.181:47726) 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.187+0000 7f9dd5eaa640 1 -- 172.21.15.181:0/4117301517 learned_addr learned my addr 172.21.15.181:0/4117301517 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.189+0000 7f9dd5eaa640 1 -- 172.21.15.181:0/4117301517 >> v1:172.21.15.181:6791/0 conn(0x7f9dd00a6640 legacy=0x7f9dd0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.189+0000 7f9dd56a9640 1 -- 172.21.15.181:0/4117301517 >> v1:172.21.15.181:6789/0 conn(0x7f9dd00a8340 legacy=0x7f9dd0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.189+0000 7f9dd66ab640 1 -- 172.21.15.181:0/4117301517 >> v1:172.21.15.195:6791/0 conn(0x7f9dd013f750 legacy=0x7f9dd0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.189+0000 7f9dd4ea8640 1 -- 172.21.15.181:0/4117301517 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3268074534 0 0) 0x7f9dd013a320 con 0x7f9dd00a6640 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.189+0000 7f9dd4ea8640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.189+0000 7f9dd4ea8640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.189+0000 7f9dd4ea8640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.189+0000 7f9dd4ea8640 10 monclient(hunting): my global_id is 5440 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 1 -- 172.21.15.181:0/4117301517 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dbc003520 con 0x7f9dd00a6640 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 1 -- 172.21.15.181:0/4117301517 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4106906422 0 0) 0x7f9dd00a4bc0 con 0x7f9dd00a8340 2024-09-13T10:33:27.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient(hunting): my global_id is 55179 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 1 -- 172.21.15.181:0/4117301517 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dd013a320 con 0x7f9dd00a8340 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 1 -- 172.21.15.181:0/4117301517 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2662450819 0 0) 0x7f9dbc003520 con 0x7f9dd00a6640 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 1 -- 172.21.15.181:0/4117301517 >> v1:172.21.15.195:6791/0 conn(0x7f9dd013f750 legacy=0x7f9dd0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 1 -- 172.21.15.181:0/4117301517 >> v1:172.21.15.181:6789/0 conn(0x7f9dd00a8340 legacy=0x7f9dd0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient: _finish_hunting 0 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 1 monclient: found mon.noname-c 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 1 -- 172.21.15.181:0/4117301517 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd00a48e0 con 0x7f9dd00a6640 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient: _finish_auth 0 2024-09-13T10:33:27.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient: _check_auth_tickets 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd810e640 5 monclient: authenticate success, global_id 5440 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 1 -- 172.21.15.181:0/4117301517 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9dcc001ae0 con 0x7f9dd00a6640 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd810e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient: dump: 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.198 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd810e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 1 -- 172.21.15.181:0/4117301517 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9dcc0048a0 con 0x7f9dd00a6640 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 1 -- 172.21.15.181:0/4117301517 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9dcc004e10 con 0x7f9dd00a6640 2024-09-13T10:33:27.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd810e640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd810e640 4 set_mon_vals no callback set 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd4ea8640 10 monclient: dump: 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.200 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd810e640 10 monclient: shutdown 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd810e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd810e640 1 -- 172.21.15.181:0/4117301517 >> v1:172.21.15.181:6791/0 conn(0x7f9dd00a6640 legacy=0x7f9dd0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd810e640 1 -- 172.21.15.181:0/4117301517 shutdown_connections 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.190+0000 7f9dd810e640 1 -- 172.21.15.181:0/4117301517 >> 172.21.15.181:0/4117301517 conn(0x7f9dd0077170 msgr2=0x7f9dd00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.191+0000 7f9dd810e640 1 -- 172.21.15.181:0/4117301517 shutdown_connections 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.191+0000 7f9dd810e640 1 -- 172.21.15.181:0/4117301517 wait complete. 2024-09-13T10:33:27.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.191+0000 7f9dd810e640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.191+0000 7f9dd810e640 10 monclient: monmap: 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.191+0000 7f9dd810e640 1 Processor -- start 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.191+0000 7f9dd810e640 1 -- start start 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.191+0000 7f9dd810e640 10 monclient: init 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.192+0000 7f9dd810e640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.192+0000 7f9dd810e640 10 monclient: _add_conns ranks=[1,7,2,5,8,6,3,0,4] 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.192+0000 7f9dd810e640 10 monclient(hunting): picked mon.noname-f con 0x7f9dd00a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.192+0000 7f9dd810e640 10 monclient(hunting): picked mon.noname-i con 0x7f9dd013f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.192+0000 7f9dd810e640 10 monclient(hunting): picked mon.noname-b con 0x7f9dd01d4310 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.192+0000 7f9dd810e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd00a15b0 con 0x7f9dd00a8340 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.192+0000 7f9dd810e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd00a0320 con 0x7f9dd01d4310 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.192+0000 7f9dd810e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd009e1a0 con 0x7f9dd013f750 2024-09-13T10:33:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.192+0000 7f9dd810e640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:27.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.192+0000 7f9dd810e640 10 monclient(hunting): authenticate will time out at 946.698420s 2024-09-13T10:33:27.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.192+0000 7f9dd66ab640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f9dd01d4310 0x7f9dd01d6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:43080/0 (socket says 172.21.15.181:43080) 2024-09-13T10:33:27.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.192+0000 7f9dd66ab640 1 -- 172.21.15.181:0/2753163164 learned_addr learned my addr 172.21.15.181:0/2753163164 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:27.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.194+0000 7f9dd66ab640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.181:6790/0 conn(0x7f9dd01d4310 legacy=0x7f9dd01d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.194+0000 7f9dd5eaa640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.195:6789/0 conn(0x7f9dd00a8340 legacy=0x7f9dd009d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.194+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 394713403 0 0) 0x7f9dd00a0320 con 0x7f9dd01d4310 2024-09-13T10:33:27.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.194+0000 7f9dc67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.194+0000 7f9dc67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.194+0000 7f9dc67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.194+0000 7f9dc67fc640 10 monclient(hunting): my global_id is 64883 2024-09-13T10:33:27.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.194+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9db4003520 con 0x7f9dd01d4310 2024-09-13T10:33:27.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.194+0000 7f9dd56a9640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.195:6792/0 conn(0x7f9dd013f750 legacy=0x7f9dd009da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3513040828 0 0) 0x7f9db4003520 con 0x7f9dd01d4310 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9dd00a0320 con 0x7f9dd01d4310 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3119886465 0 0) 0x7f9dd00a48e0 con 0x7f9dd00a8340 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient(hunting): my global_id is 55486 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9db4003520 con 0x7f9dd00a8340 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9dc80020b0 con 0x7f9dd01d4310 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient(hunting): dump: 2024-09-13T10:33:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3394053972 0 0) 0x7f9dd009e1a0 con 0x7f9dd013f750 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient(hunting): my global_id is 55420 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dd00a48e0 con 0x7f9dd013f750 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 519789332 0 0) 0x7f9dd00a0320 con 0x7f9dd01d4310 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.195:6792/0 conn(0x7f9dd013f750 legacy=0x7f9dd009da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.195:6789/0 conn(0x7f9dd00a8340 legacy=0x7f9dd009d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 monclient: found mon.b 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd00a0eb0 con 0x7f9dd01d4310 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient: _finish_auth 0 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dd810e640 5 monclient: authenticate success, global_id 64883 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dd810e640 10 monclient: _renew_subs 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dd810e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dd810e640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd00a1190 con 0x7f9dd01d4310 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dd810e640 10 monclient: _renew_subs 2024-09-13T10:33:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dd810e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dd810e640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9dd009fc30 con 0x7f9dd01d4310 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9dc8003990 con 0x7f9dd01d4310 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9dc80041c0 con 0x7f9dd01d4310 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc7fff640 4 set_mon_vals no callback set 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.195+0000 7f9dc67fc640 10 monclient: dump: 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.196+0000 7f9dd810e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.196+0000 7f9dd810e640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9db80065c0 con 0x7f9db8002860 2024-09-13T10:33:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.196+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9dc8004490 con 0x7f9dd01d4310 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.196+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(110..110 src has 1..110) ==== 3898+0+0 (unknown 864993509 0 0) 0x7f9dc804e6d0 con 0x7f9dd01d4310 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.196+0000 7f9dd56a9640 10 monclient: get_auth_request con 0x7f9db403fe50 auth_method 0 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dd5eaa640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.181:6793/0 conn(0x7f9db8002860 legacy=0x7f9db8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687402645 0 0) 0x7f9db80065c0 con 0x7f9db8002860 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 10 monclient(hunting): my global_id is 84131 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dd00a0320 con 0x7f9db8002860 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2003013263 0 0) 0x7f9dd00a0320 con 0x7f9db8002860 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9db80065c0 con 0x7f9db8002860 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9dcc004be0 con 0x7f9db8002860 2024-09-13T10:33:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 10 monclient: dump: 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2298660412 0 0) 0x7f9db80065c0 con 0x7f9db8002860 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.198+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9db800a160 con 0x7f9db8002860 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.199+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9dcc001990 con 0x7f9db8002860 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.199+0000 7f9dc67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.199+0000 7f9dc67fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.199+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.181:6793/0 conn(0x7f9db8002860 legacy=0x7f9db8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.199+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.181:6793/0 conn(0x7f9db8002860 legacy=0x7f9db8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.205+0000 7f9dd810e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:27.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.205+0000 7f9dd810e640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9db8009e70 con 0x7f9db8009130 2024-09-13T10:33:27.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dd5eaa640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.181:6793/0 conn(0x7f9db8009130 legacy=0x7f9db80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4135014511 0 0) 0x7f9db8009e70 con 0x7f9db8009130 2024-09-13T10:33:27.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 10 monclient(hunting): my global_id is 84140 2024-09-13T10:33:27.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9db80065c0 con 0x7f9db8009130 2024-09-13T10:33:27.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3722034966 0 0) 0x7f9db80065c0 con 0x7f9db8009130 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9db8009e70 con 0x7f9db8009130 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9dcc004f10 con 0x7f9db8009130 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 10 monclient: dump: 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.220 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2637238928 0 0) 0x7f9db8009e70 con 0x7f9db8009130 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.207+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9db800c410 con 0x7f9db8009130 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 3349043151) 0x7f9dcc007d90 con 0x7f9db8009130 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dc67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dc67fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.181:6793/0 conn(0x7f9db8009130 legacy=0x7f9db80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dc67fc640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.181:6793/0 conn(0x7f9db8009130 legacy=0x7f9db80095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:27.222 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:27.222 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:27.222 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:27.222 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:27.222 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:27.222 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 16096, 2024-09-13T10:33:27.222 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:27.222 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:27.222 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:27.223 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:27.224 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.225 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.225 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.225 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.225 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.225 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.225 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.225 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.225 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.225 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:27.226 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.227 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.229 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.230 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.232 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:27.232 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:27.232 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.232 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.232 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.233 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:27.233 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:27.233 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.233 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.233 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.233 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:27.233 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.233 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.233 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.234 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:27.235 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.236 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.237 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.237 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:27.237 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:27.237 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.237 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:27.237 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:27.242 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:27.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dd810e640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.195:6800/1839191919 conn(0x7f9db403fe50 legacy=0x7f9db4042310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dd810e640 10 monclient: shutdown 2024-09-13T10:33:27.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dd810e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:27.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dd810e640 1 -- 172.21.15.181:0/2753163164 >> v1:172.21.15.181:6790/0 conn(0x7f9dd01d4310 legacy=0x7f9dd01d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dd66ab640 1 -- 172.21.15.181:0/2753163164 reap_dead start 2024-09-13T10:33:27.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dd66ab640 1 -- 172.21.15.181:0/2753163164 reap_dead start 2024-09-13T10:33:27.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dd810e640 1 -- 172.21.15.181:0/2753163164 shutdown_connections 2024-09-13T10:33:27.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dd810e640 1 -- 172.21.15.181:0/2753163164 >> 172.21.15.181:0/2753163164 conn(0x7f9dd00a6640 msgr2=0x7f9dd0141f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:27.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dd810e640 1 -- 172.21.15.181:0/2753163164 shutdown_connections 2024-09-13T10:33:27.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.208+0000 7f9dd810e640 1 -- 172.21.15.181:0/2753163164 wait complete. 2024-09-13T10:33:27.245 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:27.245 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:33:27.245 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:33:27.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.341+0000 7f0911009640 10 monclient: get_monmap_and_config 2024-09-13T10:33:27.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.341+0000 7f0911009640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.341+0000 7f0911009640 10 monclient: monmap: 2024-09-13T10:33:27.344 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.344 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.344 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:27.343203+0000 2024-09-13T10:33:27.344 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:27.343203+0000 2024-09-13T10:33:27.344 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:27.344 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.344 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:27.345 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:27.345 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:27.345 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:27.345 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:27.345 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:27.345 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:27.345 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:27.345 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:27.345 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 1 Processor -- start 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 1 -- start start 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 10 monclient: init 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 10 monclient: _add_conns ranks=[0,3,6,5,4,2,8,7,1] 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 10 monclient(hunting): picked mon.noname-a con 0x7f090c0a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 10 monclient(hunting): picked mon.noname-g con 0x7f090c0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 10 monclient(hunting): picked mon.noname-d con 0x7f090c13f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f090c0a4bc0 con 0x7f090c0a6640 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f090c13a320 con 0x7f090c0a8340 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f090c0a8100 con 0x7f090c13f750 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f0911009640 10 monclient(hunting): authenticate will time out at 946.848794s 2024-09-13T10:33:27.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f090ad9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f090c0a6640 0x7f090c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60576/0 (socket says 172.21.15.181:60576) 2024-09-13T10:33:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f090b59e640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f090c13f750 0x7f090c141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54208/0 (socket says 172.21.15.181:54208) 2024-09-13T10:33:27.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.342+0000 7f090ad9d640 1 -- 172.21.15.181:0/778896804 learned_addr learned my addr 172.21.15.181:0/778896804 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:27.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090b59e640 1 -- 172.21.15.181:0/778896804 >> v1:172.21.15.181:6792/0 conn(0x7f090c13f750 legacy=0x7f090c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090ad9d640 1 -- 172.21.15.181:0/778896804 >> v1:172.21.15.181:6789/0 conn(0x7f090c0a6640 legacy=0x7f090c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 1 -- 172.21.15.181:0/778896804 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335919465 0 0) 0x7f090c0a8100 con 0x7f090c13f750 2024-09-13T10:33:27.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient(hunting): my global_id is 5289 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 1 -- 172.21.15.181:0/778896804 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08f8003520 con 0x7f090c13f750 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 1 -- 172.21.15.181:0/778896804 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439272221 0 0) 0x7f090c0a4bc0 con 0x7f090c0a6640 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient(hunting): my global_id is 55188 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 1 -- 172.21.15.181:0/778896804 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f090c0a8100 con 0x7f090c0a6640 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090259c640 1 -- 172.21.15.181:0/778896804 >> v1:172.21.15.195:6790/0 conn(0x7f090c0a8340 legacy=0x7f090c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 1 -- 172.21.15.181:0/778896804 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 766216368 0 0) 0x7f090c0a8100 con 0x7f090c0a6640 2024-09-13T10:33:27.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 1 -- 172.21.15.181:0/778896804 >> v1:172.21.15.181:6792/0 conn(0x7f090c13f750 legacy=0x7f090c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 1 -- 172.21.15.181:0/778896804 >> v1:172.21.15.195:6790/0 conn(0x7f090c0a8340 legacy=0x7f090c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient: _finish_hunting 0 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 1 monclient: found mon.noname-a 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 1 -- 172.21.15.181:0/778896804 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090c0a48e0 con 0x7f090c0a6640 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient: _finish_auth 0 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient: _check_auth_tickets 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 1 -- 172.21.15.181:0/778896804 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08fc001ac0 con 0x7f090c0a6640 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient: dump: 2024-09-13T10:33:27.353 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.354 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.356 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f0911009640 5 monclient: authenticate success, global_id 55188 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f0911009640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 1 -- 172.21.15.181:0/778896804 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f08fc0048a0 con 0x7f090c0a6640 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 1 -- 172.21.15.181:0/778896804 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08fc004dd0 con 0x7f090c0a6640 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f0911009640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f0911009640 4 set_mon_vals no callback set 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.345+0000 7f090a59c640 10 monclient: dump: 2024-09-13T10:33:27.357 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.358 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.346+0000 7f0911009640 10 monclient: shutdown 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.346+0000 7f0911009640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.346+0000 7f0911009640 1 -- 172.21.15.181:0/778896804 >> v1:172.21.15.181:6789/0 conn(0x7f090c0a6640 legacy=0x7f090c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.346+0000 7f0911009640 1 -- 172.21.15.181:0/778896804 shutdown_connections 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.346+0000 7f0911009640 1 -- 172.21.15.181:0/778896804 >> 172.21.15.181:0/778896804 conn(0x7f090c077170 msgr2=0x7f090c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.346+0000 7f0911009640 1 -- 172.21.15.181:0/778896804 shutdown_connections 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.346+0000 7f0911009640 1 -- 172.21.15.181:0/778896804 wait complete. 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.346+0000 7f0911009640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.346+0000 7f0911009640 10 monclient: monmap: 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 1 Processor -- start 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 1 -- start start 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 10 monclient: init 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 10 monclient: _add_conns ranks=[4,8,3,5,1,6,2,0,7] 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 10 monclient(hunting): picked mon.noname-c con 0x7f090c0a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 10 monclient(hunting): picked mon.noname-e con 0x7f090c13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 10 monclient(hunting): picked mon.noname-g con 0x7f090c1d4520 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f090c0a0f50 con 0x7f090c1d4520 2024-09-13T10:33:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f090c09e370 con 0x7f090c0a8340 2024-09-13T10:33:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f090c0a1230 con 0x7f090c13f750 2024-09-13T10:33:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f0911009640 10 monclient(hunting): authenticate will time out at 946.853895s 2024-09-13T10:33:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f090ad9d640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f090c0a8340 0x7f090c09d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47732/0 (socket says 172.21.15.181:47732) 2024-09-13T10:33:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f090259c640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f090c13f750 0x7f090c09dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:37600/0 (socket says 172.21.15.181:37600) 2024-09-13T10:33:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.347+0000 7f090ad9d640 1 -- 172.21.15.181:0/2215969061 learned_addr learned my addr 172.21.15.181:0/2215969061 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f090ad9d640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.181:6791/0 conn(0x7f090c0a8340 legacy=0x7f090c09d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f090259c640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.181:6793/0 conn(0x7f090c13f750 legacy=0x7f090c09dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793859439 0 0) 0x7f090c09e370 con 0x7f090c0a8340 2024-09-13T10:33:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): my global_id is 5449 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08ec003550 con 0x7f090c0a8340 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3187524495 0 0) 0x7f090c0a1230 con 0x7f090c13f750 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): my global_id is 84149 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f090c09e370 con 0x7f090c13f750 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f090b59e640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.195:6790/0 conn(0x7f090c1d4520 legacy=0x7f090c1d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3894978829 0 0) 0x7f08ec003550 con 0x7f090c0a8340 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f090c0a1230 con 0x7f090c0a8340 2024-09-13T10:33:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08fc004d90 con 0x7f090c0a8340 2024-09-13T10:33:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): dump: 2024-09-13T10:33:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3495584231 0 0) 0x7f090c09e370 con 0x7f090c13f750 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08ec003550 con 0x7f090c13f750 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08f4003610 con 0x7f090c13f750 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): dump: 2024-09-13T10:33:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.373 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2844431897 0 0) 0x7f090c0a0f50 con 0x7f090c1d4520 2024-09-13T10:33:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient(hunting): my global_id is 5286 2024-09-13T10:33:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f090c09e370 con 0x7f090c1d4520 2024-09-13T10:33:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1706127360 0 0) 0x7f090c0a1230 con 0x7f090c0a8340 2024-09-13T10:33:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.181:6793/0 conn(0x7f090c13f750 legacy=0x7f090c09dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.195:6790/0 conn(0x7f090c1d4520 legacy=0x7f090c1d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient: _finish_hunting 0 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 monclient: found mon.c 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090c0a9cd0 con 0x7f090c0a8340 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient: _finish_auth 0 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient: _check_auth_tickets 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0911009640 5 monclient: authenticate success, global_id 5449 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0911009640 10 monclient: _renew_subs 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0911009640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0911009640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f090c142dd0 con 0x7f090c0a8340 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0911009640 10 monclient: _renew_subs 2024-09-13T10:33:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0911009640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0911009640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f090c09eed0 con 0x7f090c0a8340 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f08fc0048a0 con 0x7f090c0a8340 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08fc001ae0 con 0x7f090c0a8340 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0909d9b640 4 set_mon_vals no callback set 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.350+0000 7f0903fff640 10 monclient: dump: 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.375 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.351+0000 7f0911009640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.351+0000 7f0911009640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f08f00065c0 con 0x7f08f0002860 2024-09-13T10:33:27.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.351+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f08fc011be0 con 0x7f090c0a8340 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.351+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(110..110 src has 1..110) ==== 3898+0+0 (unknown 864993509 0 0) 0x7f08fc04e350 con 0x7f090c0a8340 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.352+0000 7f090b59e640 10 monclient: get_auth_request con 0x7f08ec040230 auth_method 0 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.353+0000 7f090259c640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.195:6789/0 conn(0x7f08f0002860 legacy=0x7f08f0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 936105299 0 0) 0x7f08f00065c0 con 0x7f08f0002860 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 10 monclient(hunting): my global_id is 55495 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f090c0a1230 con 0x7f08f0002860 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2610105551 0 0) 0x7f090c0a1230 con 0x7f08f0002860 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08f00065c0 con 0x7f08f0002860 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08f4003e50 con 0x7f08f0002860 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 10 monclient: dump: 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 323592176 0 0) 0x7f08f00065c0 con 0x7f08f0002860 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08f000a160 con 0x7f08f0002860 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f08f4004100 con 0x7f08f0002860 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.195:6789/0 conn(0x7f08f0002860 legacy=0x7f08f0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.354+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.195:6789/0 conn(0x7f08f0002860 legacy=0x7f08f0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.360+0000 7f0911009640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.360+0000 7f0911009640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f08f0009e50 con 0x7f08f0009110 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.363+0000 7f090259c640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.195:6789/0 conn(0x7f08f0009110 legacy=0x7f08f00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.363+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310005970 0 0) 0x7f08f0009e50 con 0x7f08f0009110 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.363+0000 7f0903fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.363+0000 7f0903fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.363+0000 7f0903fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.363+0000 7f0903fff640 10 monclient(hunting): my global_id is 55504 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.363+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08f00065c0 con 0x7f08f0009110 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2196070423 0 0) 0x7f08f00065c0 con 0x7f08f0009110 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08f0009e50 con 0x7f08f0009110 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08f4005b00 con 0x7f08f0009110 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 10 monclient: dump: 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 358317253 0 0) 0x7f08f0009e50 con 0x7f08f0009110 2024-09-13T10:33:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f08f000c3a0 con 0x7f08f0009110 2024-09-13T10:33:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7893 (unknown 0 0 3561424875) 0x7f08f4007090 con 0x7f08f0009110 2024-09-13T10:33:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.195:6789/0 conn(0x7f08f0009110 legacy=0x7f08f00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.364+0000 7f0903fff640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.195:6789/0 conn(0x7f08f0009110 legacy=0x7f08f00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:27.382 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:27.382 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 221774, 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:27.383 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.384 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.385 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:27.386 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:27.387 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.388 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:27.403 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:27.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.365+0000 7f0911009640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.195:6800/1839191919 conn(0x7f08ec040230 legacy=0x7f08ec0426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.365+0000 7f0911009640 10 monclient: shutdown 2024-09-13T10:33:27.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.365+0000 7f0911009640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:27.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.365+0000 7f0911009640 1 -- 172.21.15.181:0/2215969061 >> v1:172.21.15.181:6791/0 conn(0x7f090c0a8340 legacy=0x7f090c09d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.365+0000 7f090b59e640 1 -- 172.21.15.181:0/2215969061 reap_dead start 2024-09-13T10:33:27.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.365+0000 7f090b59e640 1 -- 172.21.15.181:0/2215969061 reap_dead start 2024-09-13T10:33:27.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.365+0000 7f0911009640 1 -- 172.21.15.181:0/2215969061 shutdown_connections 2024-09-13T10:33:27.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.365+0000 7f0911009640 1 -- 172.21.15.181:0/2215969061 >> 172.21.15.181:0/2215969061 conn(0x7f090c0a6640 msgr2=0x7f090c13ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:27.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.365+0000 7f0911009640 1 -- 172.21.15.181:0/2215969061 shutdown_connections 2024-09-13T10:33:27.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.365+0000 7f0911009640 1 -- 172.21.15.181:0/2215969061 wait complete. 2024-09-13T10:33:27.406 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:27.406 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:33:27.406 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:33:27.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.502+0000 7f232743c640 10 monclient: get_monmap_and_config 2024-09-13T10:33:27.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.502+0000 7f232743c640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.502+0000 7f232743c640 10 monclient: monmap: 2024-09-13T10:33:27.505 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.505 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.505 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:27.503958+0000 2024-09-13T10:33:27.505 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:27.503958+0000 2024-09-13T10:33:27.505 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:27.505 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.505 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:27.506 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:27.506 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.502+0000 7f232743c640 1 Processor -- start 2024-09-13T10:33:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f232743c640 1 -- start start 2024-09-13T10:33:27.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f232743c640 10 monclient: init 2024-09-13T10:33:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f232743c640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f232743c640 10 monclient: _add_conns ranks=[5,3,8,2,6,0,4,7,1] 2024-09-13T10:33:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f232743c640 10 monclient(hunting): picked mon.noname-h con 0x7f23200a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f232743c640 10 monclient(hunting): picked mon.noname-g con 0x7f23200a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f232743c640 10 monclient(hunting): picked mon.noname-e con 0x7f232013f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f232743c640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23200a4bc0 con 0x7f23200a8340 2024-09-13T10:33:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f232743c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f232013a320 con 0x7f23200a6640 2024-09-13T10:33:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f232743c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23200a8100 con 0x7f232013f750 2024-09-13T10:33:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f232743c640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:27.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f232743c640 10 monclient(hunting): authenticate will time out at 947.009729s 2024-09-13T10:33:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f23259d9640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f232013f750 0x7f2320141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:37612/0 (socket says 172.21.15.181:37612) 2024-09-13T10:33:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.503+0000 7f23259d9640 1 -- 172.21.15.181:0/4141943611 learned_addr learned my addr 172.21.15.181:0/4141943611 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:27.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f23259d9640 1 -- 172.21.15.181:0/4141943611 >> v1:172.21.15.181:6793/0 conn(0x7f232013f750 legacy=0x7f2320141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230355262 0 0) 0x7f23200a8100 con 0x7f232013f750 2024-09-13T10:33:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient(hunting): my global_id is 84158 2024-09-13T10:33:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f23251d8640 1 -- 172.21.15.181:0/4141943611 >> v1:172.21.15.195:6791/0 conn(0x7f23200a6640 legacy=0x7f2320139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2308003520 con 0x7f232013f750 2024-09-13T10:33:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f23249d7640 1 -- 172.21.15.181:0/4141943611 >> v1:172.21.15.195:6790/0 conn(0x7f23200a8340 legacy=0x7f2320139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727307662 0 0) 0x7f232013a320 con 0x7f23200a6640 2024-09-13T10:33:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient(hunting): my global_id is 5441 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23200a8100 con 0x7f23200a6640 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4177733778 0 0) 0x7f23200a4bc0 con 0x7f23200a8340 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient(hunting): my global_id is 5295 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f232013a320 con 0x7f23200a8340 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2260216471 0 0) 0x7f2308003520 con 0x7f232013f750 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 >> v1:172.21.15.195:6791/0 conn(0x7f23200a6640 legacy=0x7f2320139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 >> v1:172.21.15.195:6790/0 conn(0x7f23200a8340 legacy=0x7f2320139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 monclient: found mon.noname-e 2024-09-13T10:33:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23200a48e0 con 0x7f232013f750 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient: _finish_auth 0 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f232743c640 5 monclient: authenticate success, global_id 84158 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2310001ae0 con 0x7f232013f750 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f232743c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient: dump: 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f232743c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2310001d30 con 0x7f232013f750 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f232743c640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 1 -- 172.21.15.181:0/4141943611 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2310004be0 con 0x7f232013f750 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f232743c640 4 set_mon_vals no callback set 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.506+0000 7f231ffff640 10 monclient: dump: 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.522 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.507+0000 7f232743c640 10 monclient: shutdown 2024-09-13T10:33:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.507+0000 7f232743c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.507+0000 7f232743c640 1 -- 172.21.15.181:0/4141943611 >> v1:172.21.15.181:6793/0 conn(0x7f232013f750 legacy=0x7f2320141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.507+0000 7f232743c640 1 -- 172.21.15.181:0/4141943611 shutdown_connections 2024-09-13T10:33:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.507+0000 7f232743c640 1 -- 172.21.15.181:0/4141943611 >> 172.21.15.181:0/4141943611 conn(0x7f2320077170 msgr2=0x7f23200abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.507+0000 7f232743c640 1 -- 172.21.15.181:0/4141943611 shutdown_connections 2024-09-13T10:33:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.507+0000 7f232743c640 1 -- 172.21.15.181:0/4141943611 wait complete. 2024-09-13T10:33:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.507+0000 7f232743c640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.507+0000 7f232743c640 10 monclient: monmap: 2024-09-13T10:33:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:27.524 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 1 Processor -- start 2024-09-13T10:33:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 1 -- start start 2024-09-13T10:33:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 10 monclient: init 2024-09-13T10:33:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 10 monclient: _add_conns ranks=[2,7,4,3,5,8,6,1,0] 2024-09-13T10:33:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 10 monclient(hunting): picked mon.noname-b con 0x7f23200a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 10 monclient(hunting): picked mon.noname-i con 0x7f232013f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 10 monclient(hunting): picked mon.noname-c con 0x7f232013e4d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f232013c0e0 con 0x7f23200a8340 2024-09-13T10:33:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f232013c3c0 con 0x7f232013e4d0 2024-09-13T10:33:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f232013c6a0 con 0x7f232013f750 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f232743c640 10 monclient(hunting): authenticate will time out at 947.014657s 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f23251d8640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f23200a8340 0x7f232013ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:43082/0 (socket says 172.21.15.181:43082) 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.508+0000 7f23251d8640 1 -- 172.21.15.181:0/1183591551 learned_addr learned my addr 172.21.15.181:0/1183591551 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.510+0000 7f23259d9640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.181:6791/0 conn(0x7f232013e4d0 legacy=0x7f23201d6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.510+0000 7f23251d8640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.181:6790/0 conn(0x7f23200a8340 legacy=0x7f232013ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.510+0000 7f23249d7640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.195:6792/0 conn(0x7f232013f750 legacy=0x7f23201d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.510+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 464497467 0 0) 0x7f232013c3c0 con 0x7f232013e4d0 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): my global_id is 5458 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f230c003550 con 0x7f232013e4d0 2024-09-13T10:33:27.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 552811457 0 0) 0x7f232013c0e0 con 0x7f23200a8340 2024-09-13T10:33:27.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): my global_id is 64892 2024-09-13T10:33:27.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f232013c3c0 con 0x7f23200a8340 2024-09-13T10:33:27.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2774146165 0 0) 0x7f232013c3c0 con 0x7f23200a8340 2024-09-13T10:33:27.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f232013c0e0 con 0x7f23200a8340 2024-09-13T10:33:27.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2318003610 con 0x7f23200a8340 2024-09-13T10:33:27.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:33:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): dump: 2024-09-13T10:33:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4175424350 0 0) 0x7f232013c6a0 con 0x7f232013f750 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): my global_id is 55429 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f232013c3c0 con 0x7f232013f750 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3086846659 0 0) 0x7f230c003550 con 0x7f232013e4d0 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f232013c6a0 con 0x7f232013e4d0 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2310001b00 con 0x7f232013e4d0 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient(hunting): dump: 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1971151221 0 0) 0x7f232013c0e0 con 0x7f23200a8340 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.195:6792/0 conn(0x7f232013f750 legacy=0x7f23201d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.181:6791/0 conn(0x7f232013e4d0 legacy=0x7f23201d6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient: _finish_hunting 0 2024-09-13T10:33:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 monclient: found mon.b 2024-09-13T10:33:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:33:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232013d1a0 con 0x7f23200a8340 2024-09-13T10:33:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient: _finish_auth 0 2024-09-13T10:33:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient: _check_auth_tickets 2024-09-13T10:33:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f232743c640 5 monclient: authenticate success, global_id 64892 2024-09-13T10:33:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f232743c640 10 monclient: _renew_subs 2024-09-13T10:33:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f232743c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:33:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f232743c640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f232013a660 con 0x7f23200a8340 2024-09-13T10:33:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2318003bd0 con 0x7f23200a8340 2024-09-13T10:33:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2318004100 con 0x7f23200a8340 2024-09-13T10:33:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231dffb640 10 monclient: dump: 2024-09-13T10:33:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.533 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f232743c640 10 monclient: _renew_subs 2024-09-13T10:33:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f231f7fe640 4 set_mon_vals no callback set 2024-09-13T10:33:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f232743c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:33:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.511+0000 7f232743c640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f23201d8150 con 0x7f23200a8340 2024-09-13T10:33:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.512+0000 7f232743c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.512+0000 7f232743c640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f23200a5ca0 con 0x7f2320077170 2024-09-13T10:33:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.512+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f23180042a0 con 0x7f23200a8340 2024-09-13T10:33:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.513+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(110..110 src has 1..110) ==== 3898+0+0 (unknown 864993509 0 0) 0x7f231804e480 con 0x7f23200a8340 2024-09-13T10:33:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.513+0000 7f23259d9640 10 monclient: get_auth_request con 0x7f230c0402e0 auth_method 0 2024-09-13T10:33:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f23249d7640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.195:6790/0 conn(0x7f2320077170 legacy=0x7f232012d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 770452538 0 0) 0x7f232013c3c0 con 0x7f2320077170 2024-09-13T10:33:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 10 monclient(hunting): my global_id is 5304 2024-09-13T10:33:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f232013c0e0 con 0x7f2320077170 2024-09-13T10:33:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1120816661 0 0) 0x7f232013c0e0 con 0x7f2320077170 2024-09-13T10:33:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f232013c3c0 con 0x7f2320077170 2024-09-13T10:33:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2314001f50 con 0x7f2320077170 2024-09-13T10:33:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:33:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 10 monclient: dump: 2024-09-13T10:33:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.540 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4070206214 0 0) 0x7f232013c3c0 con 0x7f2320077170 2024-09-13T10:33:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.515+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f232013b360 con 0x7f2320077170 2024-09-13T10:33:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.516+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2314006b70 con 0x7f2320077170 2024-09-13T10:33:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.516+0000 7f231dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.516+0000 7f231dffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.516+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.195:6790/0 conn(0x7f2320077170 legacy=0x7f232012d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.516+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.195:6790/0 conn(0x7f2320077170 legacy=0x7f232012d540 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:27.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.522+0000 7f232743c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:27.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.522+0000 7f232743c640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f23200ac9e0 con 0x7f2320069b40 2024-09-13T10:33:27.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.524+0000 7f23249d7640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.195:6790/0 conn(0x7f2320069b40 legacy=0x7f232012dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.524+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757699541 0 0) 0x7f232013a320 con 0x7f2320069b40 2024-09-13T10:33:27.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.524+0000 7f231dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.524+0000 7f231dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.524+0000 7f231dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.524+0000 7f231dffb640 10 monclient(hunting): my global_id is 5313 2024-09-13T10:33:27.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.524+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f232013c3c0 con 0x7f2320069b40 2024-09-13T10:33:27.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2540118118 0 0) 0x7f232013c3c0 con 0x7f2320069b40 2024-09-13T10:33:27.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f232013a320 con 0x7f2320069b40 2024-09-13T10:33:27.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f23140040c0 con 0x7f2320069b40 2024-09-13T10:33:27.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:33:27.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 10 monclient: dump: 2024-09-13T10:33:27.542 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.542 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.542 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.542 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.542 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.542 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.543 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.543 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.543 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.543 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.543 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.543 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.543 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.543 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.543 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.543 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2563837709 0 0) 0x7f232013a320 con 0x7f2320069b40 2024-09-13T10:33:27.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f232013c8c0 con 0x7f2320069b40 2024-09-13T10:33:27.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7561 (unknown 0 0 3881199400) 0x7f2314004360 con 0x7f2320069b40 2024-09-13T10:33:27.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:27.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:27.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.195:6790/0 conn(0x7f2320069b40 legacy=0x7f232012dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f231dffb640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.195:6790/0 conn(0x7f2320069b40 legacy=0x7f232012dc50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:27.544 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:33:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 221941, 2024-09-13T10:33:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:33:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.560 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:27.560 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:27.560 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.561 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:27.562 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.563 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.564 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.565 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.567 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:27.567 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:27.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f232743c640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.195:6800/1839191919 conn(0x7f230c0402e0 legacy=0x7f230c0427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f232743c640 10 monclient: shutdown 2024-09-13T10:33:27.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f232743c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:27.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f232743c640 1 -- 172.21.15.181:0/1183591551 >> v1:172.21.15.181:6790/0 conn(0x7f23200a8340 legacy=0x7f232013ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.525+0000 7f23259d9640 1 -- 172.21.15.181:0/1183591551 reap_dead start 2024-09-13T10:33:27.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.526+0000 7f23259d9640 1 -- 172.21.15.181:0/1183591551 reap_dead start 2024-09-13T10:33:27.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.526+0000 7f232743c640 1 -- 172.21.15.181:0/1183591551 shutdown_connections 2024-09-13T10:33:27.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.526+0000 7f232743c640 1 -- 172.21.15.181:0/1183591551 >> 172.21.15.181:0/1183591551 conn(0x7f23200a6640 msgr2=0x7f23200a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:27.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.526+0000 7f232743c640 1 -- 172.21.15.181:0/1183591551 shutdown_connections 2024-09-13T10:33:27.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.526+0000 7f232743c640 1 -- 172.21.15.181:0/1183591551 wait complete. 2024-09-13T10:33:27.569 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:27.569 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:33:27.570 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:33:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.673+0000 7f9c6063c640 10 monclient: get_monmap_and_config 2024-09-13T10:33:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.673+0000 7f9c6063c640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.673+0000 7f9c6063c640 10 monclient: monmap: 2024-09-13T10:33:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:27.675051+0000 2024-09-13T10:33:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:27.675051+0000 2024-09-13T10:33:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:27.677 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:27.677 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:27.677 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:27.677 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:27.677 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:27.677 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 1 Processor -- start 2024-09-13T10:33:27.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 1 -- start start 2024-09-13T10:33:27.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 10 monclient: init 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 10 monclient: _add_conns ranks=[7,6,0,2,4,1,8,5,3] 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 10 monclient(hunting): picked mon.noname-i con 0x7f9c580a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 10 monclient(hunting): picked mon.noname-d con 0x7f9c580a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 10 monclient(hunting): picked mon.noname-a con 0x7f9c5813f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c580a4bc0 con 0x7f9c5813f750 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c5813a320 con 0x7f9c580a8340 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c580a8100 con 0x7f9c580a6640 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c6063c640 10 monclient(hunting): authenticate will time out at 947.180769s 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c5dbd7640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f9c580a8340 0x7f9c58139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54220/0 (socket says 172.21.15.181:54220) 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c5ebd9640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f9c5813f750 0x7f9c58141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60582/0 (socket says 172.21.15.181:60582) 2024-09-13T10:33:27.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.674+0000 7f9c5dbd7640 1 -- 172.21.15.181:0/2745096326 learned_addr learned my addr 172.21.15.181:0/2745096326 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5ebd9640 1 -- 172.21.15.181:0/2745096326 >> v1:172.21.15.181:6789/0 conn(0x7f9c5813f750 legacy=0x7f9c58141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5dbd7640 1 -- 172.21.15.181:0/2745096326 >> v1:172.21.15.181:6792/0 conn(0x7f9c580a8340 legacy=0x7f9c58139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5e3d8640 1 -- 172.21.15.181:0/2745096326 >> v1:172.21.15.195:6792/0 conn(0x7f9c580a6640 legacy=0x7f9c58139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 253718061 0 0) 0x7f9c580a4bc0 con 0x7f9c5813f750 2024-09-13T10:33:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient(hunting): my global_id is 55197 2024-09-13T10:33:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c44003520 con 0x7f9c5813f750 2024-09-13T10:33:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675544076 0 0) 0x7f9c5813a320 con 0x7f9c580a8340 2024-09-13T10:33:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient(hunting): my global_id is 5298 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c580a4bc0 con 0x7f9c580a8340 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240913741 0 0) 0x7f9c580a8100 con 0x7f9c580a6640 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient(hunting): my global_id is 55438 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c5813a320 con 0x7f9c580a6640 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3295710371 0 0) 0x7f9c44003520 con 0x7f9c5813f750 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 >> v1:172.21.15.195:6792/0 conn(0x7f9c580a6640 legacy=0x7f9c58139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 >> v1:172.21.15.181:6792/0 conn(0x7f9c580a8340 legacy=0x7f9c58139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient: _finish_hunting 0 2024-09-13T10:33:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 monclient: found mon.noname-a 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c580a48e0 con 0x7f9c5813f750 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient: _finish_auth 0 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient: _check_auth_tickets 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9c50001e60 con 0x7f9c5813f750 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient: dump: 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c6063c640 5 monclient: authenticate success, global_id 55197 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c6063c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c50004b60 con 0x7f9c5813f750 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 1 -- 172.21.15.181:0/2745096326 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9c50005110 con 0x7f9c5813f750 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c5d3d6640 10 monclient: dump: 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c6063c640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.677+0000 7f9c6063c640 4 set_mon_vals no callback set 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.678+0000 7f9c6063c640 10 monclient: shutdown 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.678+0000 7f9c6063c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.678+0000 7f9c6063c640 1 -- 172.21.15.181:0/2745096326 >> v1:172.21.15.181:6789/0 conn(0x7f9c5813f750 legacy=0x7f9c58141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.678+0000 7f9c6063c640 1 -- 172.21.15.181:0/2745096326 shutdown_connections 2024-09-13T10:33:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.678+0000 7f9c6063c640 1 -- 172.21.15.181:0/2745096326 >> 172.21.15.181:0/2745096326 conn(0x7f9c58077170 msgr2=0x7f9c580abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.678+0000 7f9c6063c640 1 -- 172.21.15.181:0/2745096326 shutdown_connections 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.678+0000 7f9c6063c640 1 -- 172.21.15.181:0/2745096326 wait complete. 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 10 monclient: monmap: 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 1 Processor -- start 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 1 -- start start 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 10 monclient: init 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 10 monclient: _add_conns ranks=[5,2,0,7,6,4,1,8,3] 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 10 monclient(hunting): picked mon.noname-h con 0x7f9c580a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 10 monclient(hunting): picked mon.noname-b con 0x7f9c5813f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:27.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 10 monclient(hunting): picked mon.noname-a con 0x7f9c5809fa00 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c580a0c40 con 0x7f9c5809fa00 2024-09-13T10:33:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c580a0f20 con 0x7f9c5813f750 2024-09-13T10:33:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c581cf0f0 con 0x7f9c580a8340 2024-09-13T10:33:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.679+0000 7f9c6063c640 10 monclient(hunting): authenticate will time out at 947.185983s 2024-09-13T10:33:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.680+0000 7f9c5ebd9640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f9c5809fa00 0x7f9c581d6530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60584/0 (socket says 172.21.15.181:60584) 2024-09-13T10:33:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.680+0000 7f9c5ebd9640 1 -- 172.21.15.181:0/1233888597 learned_addr learned my addr 172.21.15.181:0/1233888597 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:27.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c5ebd9640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.181:6789/0 conn(0x7f9c5809fa00 legacy=0x7f9c581d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c5dbd7640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.181:6790/0 conn(0x7f9c5813f750 legacy=0x7f9c581ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c5e3d8640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.195:6791/0 conn(0x7f9c580a8340 legacy=0x7f9c581ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044672802 0 0) 0x7f9c580a0c40 con 0x7f9c5809fa00 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): my global_id is 55206 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c3c003550 con 0x7f9c5809fa00 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610180297 0 0) 0x7f9c580a0f20 con 0x7f9c5813f750 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): my global_id is 64901 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c580a0c40 con 0x7f9c5813f750 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201123677 0 0) 0x7f9c581cf0f0 con 0x7f9c580a8340 2024-09-13T10:33:27.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): my global_id is 5450 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c580a0f20 con 0x7f9c580a8340 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3818760683 0 0) 0x7f9c3c003550 con 0x7f9c5809fa00 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c581cf0f0 con 0x7f9c5809fa00 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9c500020b0 con 0x7f9c5809fa00 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): dump: 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.699 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3143117100 0 0) 0x7f9c580a0c40 con 0x7f9c5813f750 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c3c003550 con 0x7f9c5813f750 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9c480047e0 con 0x7f9c5813f750 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): dump: 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.701 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2952570232 0 0) 0x7f9c580a0f20 con 0x7f9c580a8340 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c580a0c40 con 0x7f9c580a8340 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9c54001350 con 0x7f9c580a8340 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:27.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient(hunting): dump: 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.703 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3097945651 0 0) 0x7f9c581cf0f0 con 0x7f9c5809fa00 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.195:6791/0 conn(0x7f9c580a8340 legacy=0x7f9c581ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.181:6790/0 conn(0x7f9c5813f750 legacy=0x7f9c581ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 monclient: found mon.a 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c580a0390 con 0x7f9c5809fa00 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient: _finish_auth 0 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:27.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c6063c640 5 monclient: authenticate success, global_id 55206 2024-09-13T10:33:27.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c6063c640 10 monclient: _renew_subs 2024-09-13T10:33:27.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c6063c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:27.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c6063c640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5809eea0 con 0x7f9c5809fa00 2024-09-13T10:33:27.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c6063c640 10 monclient: _renew_subs 2024-09-13T10:33:27.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c6063c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:27.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c6063c640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9c581d7c50 con 0x7f9c5809fa00 2024-09-13T10:33:27.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c50005300 con 0x7f9c5809fa00 2024-09-13T10:33:27.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:27.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9c500057f0 con 0x7f9c5809fa00 2024-09-13T10:33:27.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.683+0000 7f9c4effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:27.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.682+0000 7f9c5cbd5640 4 set_mon_vals no callback set 2024-09-13T10:33:27.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.683+0000 7f9c4effd640 10 monclient: dump: 2024-09-13T10:33:27.706 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.706 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.706 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.706 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.706 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.706 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.706 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.706 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.706 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.706 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.707 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.707 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.707 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.707 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.707 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.707 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.683+0000 7f9c6063c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:27.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.683+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9c50005990 con 0x7f9c5809fa00 2024-09-13T10:33:27.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.683+0000 7f9c6063c640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9c580a9c20 con 0x7f9c58077170 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.684+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(111..111 src has 1..111) ==== 3898+0+0 (unknown 3666768603 0 0) 0x7f9c5004e680 con 0x7f9c5809fa00 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.684+0000 7f9c5dbd7640 10 monclient: get_auth_request con 0x7f9c3c0406b0 auth_method 0 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.685+0000 7f9c5e3d8640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.195:6791/0 conn(0x7f9c58077170 legacy=0x7f9c5813a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412100355 0 0) 0x7f9c580a9c20 con 0x7f9c58077170 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 10 monclient(hunting): my global_id is 5459 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c581cf0f0 con 0x7f9c58077170 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2356820526 0 0) 0x7f9c581cf0f0 con 0x7f9c58077170 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c580a9c20 con 0x7f9c58077170 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9c54003cc0 con 0x7f9c58077170 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 10 monclient: dump: 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.709 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.710 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.710 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.710 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2169294921 0 0) 0x7f9c580a9c20 con 0x7f9c58077170 2024-09-13T10:33:27.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c5806e060 con 0x7f9c58077170 2024-09-13T10:33:27.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9c54004010 con 0x7f9c58077170 2024-09-13T10:33:27.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:27.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:27.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.195:6791/0 conn(0x7f9c58077170 legacy=0x7f9c5813a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.686+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.195:6791/0 conn(0x7f9c58077170 legacy=0x7f9c5813a4a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:27.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.693+0000 7f9c6063c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:27.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.693+0000 7f9c6063c640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9c58142c30 con 0x7f9c58069b40 2024-09-13T10:33:27.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.695+0000 7f9c5e3d8640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.195:6791/0 conn(0x7f9c58069b40 legacy=0x7f9c5813abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.695+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834417689 0 0) 0x7f9c58142c30 con 0x7f9c58069b40 2024-09-13T10:33:27.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.695+0000 7f9c4effd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.695+0000 7f9c4effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.695+0000 7f9c4effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.695+0000 7f9c4effd640 10 monclient(hunting): my global_id is 5468 2024-09-13T10:33:27.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.695+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c580a9c20 con 0x7f9c58069b40 2024-09-13T10:33:27.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2861213884 0 0) 0x7f9c580a9c20 con 0x7f9c58069b40 2024-09-13T10:33:27.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c58142c30 con 0x7f9c58069b40 2024-09-13T10:33:27.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9c54004440 con 0x7f9c58069b40 2024-09-13T10:33:27.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:27.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 10 monclient: dump: 2024-09-13T10:33:27.713 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.713 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.713 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.713 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.713 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.713 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.713 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.713 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.713 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.713 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1715635826 0 0) 0x7f9c58142c30 con 0x7f9c58069b40 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9c581431e0 con 0x7f9c58069b40 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 541515850) 0x7f9c54007bc0 con 0x7f9c58069b40 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.195:6791/0 conn(0x7f9c58069b40 legacy=0x7f9c5813abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.696+0000 7f9c4effd640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.195:6791/0 conn(0x7f9c58069b40 legacy=0x7f9c5813abb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:27.715 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 222125, 2024-09-13T10:33:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:27.715 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.716 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:27.717 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:27.718 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:27.719 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.720 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.721 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:27.724 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.725 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:27.728 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.731 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:27.732 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:27.732 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.732 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.732 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.732 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:27.732 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.732 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.732 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.733 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.734 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:27.734 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.734 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.734 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:27.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.734 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.734 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.734 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:33:27.734 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.734 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.735 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:27.735 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:27.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.697+0000 7f9c6063c640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.195:6800/1839191919 conn(0x7f9c3c0406b0 legacy=0x7f9c3c042b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.697+0000 7f9c6063c640 10 monclient: shutdown 2024-09-13T10:33:27.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.697+0000 7f9c6063c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:27.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.697+0000 7f9c6063c640 1 -- 172.21.15.181:0/1233888597 >> v1:172.21.15.181:6789/0 conn(0x7f9c5809fa00 legacy=0x7f9c581d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.697+0000 7f9c5ebd9640 1 -- 172.21.15.181:0/1233888597 reap_dead start 2024-09-13T10:33:27.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.697+0000 7f9c5ebd9640 1 -- 172.21.15.181:0/1233888597 reap_dead start 2024-09-13T10:33:27.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.697+0000 7f9c6063c640 1 -- 172.21.15.181:0/1233888597 shutdown_connections 2024-09-13T10:33:27.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.697+0000 7f9c6063c640 1 -- 172.21.15.181:0/1233888597 >> 172.21.15.181:0/1233888597 conn(0x7f9c580a6640 msgr2=0x7f9c58141ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:27.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.697+0000 7f9c6063c640 1 -- 172.21.15.181:0/1233888597 shutdown_connections 2024-09-13T10:33:27.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.697+0000 7f9c6063c640 1 -- 172.21.15.181:0/1233888597 wait complete. 2024-09-13T10:33:27.737 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:27.737 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:33:27.738 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:33:27.739 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37134]: starting. 2024-09-13T10:33:27.739 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37134]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37133 2024-09-13T10:33:27.739 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37134]: created object 0... 2024-09-13T10:33:27.739 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37134]: created object 25... 2024-09-13T10:33:27.739 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37134]: created object 49... 2024-09-13T10:33:27.739 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37134]: finishing. 2024-09-13T10:33:27.739 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37134]: shutting down. 2024-09-13T10:33:27.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.835+0000 7f613920f640 10 monclient: get_monmap_and_config 2024-09-13T10:33:27.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.835+0000 7f613920f640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.835+0000 7f613920f640 10 monclient: monmap: 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:27.836743+0000 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:27.836743+0000 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:27.838 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:27.839 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:27.839 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:27.839 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:27.839 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.835+0000 7f613920f640 1 Processor -- start 2024-09-13T10:33:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.835+0000 7f613920f640 1 -- start start 2024-09-13T10:33:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.835+0000 7f613920f640 10 monclient: init 2024-09-13T10:33:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f613920f640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f613920f640 10 monclient: _add_conns ranks=[4,6,3,0,5,7,1,8,2] 2024-09-13T10:33:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f613920f640 10 monclient(hunting): picked mon.noname-c con 0x7f61340a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f613920f640 10 monclient(hunting): picked mon.noname-d con 0x7f61340a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f613920f640 10 monclient(hunting): picked mon.noname-g con 0x7f613413f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f613920f640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61340a5fe0 con 0x7f613413f9a0 2024-09-13T10:33:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f613920f640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61340a8080 con 0x7f61340a66d0 2024-09-13T10:33:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f613920f640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61340a42c0 con 0x7f61340a6ab0 2024-09-13T10:33:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f613920f640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f613920f640 10 monclient(hunting): authenticate will time out at 947.342236s 2024-09-13T10:33:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f612a59c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f61340a6ab0 0x7f61340a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54226/0 (socket says 172.21.15.181:54226) 2024-09-13T10:33:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f6132d9d640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f61340a66d0 0x7f61340a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47754/0 (socket says 172.21.15.181:47754) 2024-09-13T10:33:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.836+0000 7f612a59c640 1 -- 172.21.15.181:0/2925649028 learned_addr learned my addr 172.21.15.181:0/2925649028 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f6132d9d640 1 -- 172.21.15.181:0/2925649028 >> v1:172.21.15.181:6791/0 conn(0x7f61340a66d0 legacy=0x7f61340a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f612a59c640 1 -- 172.21.15.181:0/2925649028 >> v1:172.21.15.181:6792/0 conn(0x7f61340a6ab0 legacy=0x7f61340a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613359e640 1 -- 172.21.15.181:0/2925649028 >> v1:172.21.15.195:6790/0 conn(0x7f613413f9a0 legacy=0x7f6134141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112913012 0 0) 0x7f61340a8080 con 0x7f61340a66d0 2024-09-13T10:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 10 monclient(hunting): my global_id is 5467 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6120003520 con 0x7f61340a66d0 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3485101461 0 0) 0x7f61340a42c0 con 0x7f61340a6ab0 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 10 monclient(hunting): my global_id is 5307 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61340a8080 con 0x7f61340a6ab0 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1684289222 0 0) 0x7f61340a5fe0 con 0x7f613413f9a0 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 10 monclient(hunting): my global_id is 5322 2024-09-13T10:33:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61340a42c0 con 0x7f613413f9a0 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.838+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1268699170 0 0) 0x7f61340a8080 con 0x7f61340a6ab0 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 >> v1:172.21.15.181:6791/0 conn(0x7f61340a66d0 legacy=0x7f61340a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 >> v1:172.21.15.195:6790/0 conn(0x7f613413f9a0 legacy=0x7f6134141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 10 monclient: _finish_hunting 0 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 1 monclient: found mon.noname-d 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61341464e0 con 0x7f61340a6ab0 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 10 monclient: _finish_auth 0 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 10 monclient: _check_auth_tickets 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f611c001a50 con 0x7f61340a6ab0 2024-09-13T10:33:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 10 monclient: dump: 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.848 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.849 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613920f640 5 monclient: authenticate success, global_id 5307 2024-09-13T10:33:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613920f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f611c001d20 con 0x7f61340a6ab0 2024-09-13T10:33:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 1 -- 172.21.15.181:0/2925649028 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f611c004be0 con 0x7f61340a6ab0 2024-09-13T10:33:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613920f640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613920f640 4 set_mon_vals no callback set 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613259c640 10 monclient: dump: 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613920f640 10 monclient: shutdown 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613920f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613920f640 1 -- 172.21.15.181:0/2925649028 >> v1:172.21.15.181:6792/0 conn(0x7f61340a6ab0 legacy=0x7f61340a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613920f640 1 -- 172.21.15.181:0/2925649028 shutdown_connections 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613920f640 1 -- 172.21.15.181:0/2925649028 >> 172.21.15.181:0/2925649028 conn(0x7f61340abcd0 msgr2=0x7f61340ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613920f640 1 -- 172.21.15.181:0/2925649028 shutdown_connections 2024-09-13T10:33:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.839+0000 7f613920f640 1 -- 172.21.15.181:0/2925649028 wait complete. 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.840+0000 7f613920f640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.840+0000 7f613920f640 10 monclient: monmap: 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:27.852 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:27.853 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.840+0000 7f613920f640 1 Processor -- start 2024-09-13T10:33:27.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f613920f640 1 -- start start 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f613920f640 10 monclient: init 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f613920f640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f613920f640 10 monclient: _add_conns ranks=[6,2,4,5,3,7,0,1,8] 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f613920f640 10 monclient(hunting): picked mon.noname-d con 0x7f61340a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f613920f640 10 monclient(hunting): picked mon.noname-b con 0x7f61340a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f613920f640 10 monclient(hunting): picked mon.noname-c con 0x7f613413f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f613920f640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613413dbe0 con 0x7f61340a6ab0 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f613920f640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613413e770 con 0x7f613413f9a0 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f613920f640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613413ea50 con 0x7f61340a66d0 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f613920f640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f613920f640 10 monclient(hunting): authenticate will time out at 947.347615s 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f6132d9d640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f61340a66d0 0x7f613413b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54234/0 (socket says 172.21.15.181:54234) 2024-09-13T10:33:27.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.841+0000 7f6132d9d640 1 -- 172.21.15.181:0/2056184974 learned_addr learned my addr 172.21.15.181:0/2056184974 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:27.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.843+0000 7f613359e640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.181:6791/0 conn(0x7f613413f9a0 legacy=0x7f61341d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.843+0000 7f6132d9d640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.181:6792/0 conn(0x7f61340a66d0 legacy=0x7f613413b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.843+0000 7f612a59c640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.181:6790/0 conn(0x7f61340a6ab0 legacy=0x7f613413bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.843+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676228880 0 0) 0x7f613413e770 con 0x7f613413f9a0 2024-09-13T10:33:27.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.843+0000 7f612bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.843+0000 7f612bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.843+0000 7f612bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.843+0000 7f612bfff640 10 monclient(hunting): my global_id is 5476 2024-09-13T10:33:27.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6114003520 con 0x7f613413f9a0 2024-09-13T10:33:27.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806567335 0 0) 0x7f613413ea50 con 0x7f61340a66d0 2024-09-13T10:33:27.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): my global_id is 5316 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613413e770 con 0x7f61340a66d0 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051116163 0 0) 0x7f613413dbe0 con 0x7f61340a6ab0 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): my global_id is 64910 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613413ea50 con 0x7f61340a6ab0 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1161635701 0 0) 0x7f6114003520 con 0x7f613413f9a0 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f613413dbe0 con 0x7f613413f9a0 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2142027843 0 0) 0x7f613413e770 con 0x7f61340a66d0 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6114003520 con 0x7f61340a66d0 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6124001a10 con 0x7f61340a66d0 2024-09-13T10:33:27.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): dump: 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.864 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.865 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.865 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.865 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.865 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.865 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:27.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3141405888 0 0) 0x7f613413ea50 con 0x7f61340a6ab0 2024-09-13T10:33:27.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f613413e770 con 0x7f61340a6ab0 2024-09-13T10:33:27.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f612c003990 con 0x7f613413f9a0 2024-09-13T10:33:27.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:27.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:27.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): dump: 2024-09-13T10:33:27.866 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.866 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.866 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.866 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.866 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.866 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.866 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.866 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.866 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f611c004b20 con 0x7f61340a6ab0 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient(hunting): dump: 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.867 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.868 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.868 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.868 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.868 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.868 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.868 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.869 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.869 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.869 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.869 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.869 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.869 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.869 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1126228290 0 0) 0x7f613413dbe0 con 0x7f613413f9a0 2024-09-13T10:33:27.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.181:6792/0 conn(0x7f61340a66d0 legacy=0x7f613413b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.181:6790/0 conn(0x7f61340a6ab0 legacy=0x7f613413bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 monclient: found mon.c 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613413ed30 con 0x7f613413f9a0 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient: _finish_auth 0 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f613920f640 5 monclient: authenticate success, global_id 5476 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f613920f640 10 monclient: _renew_subs 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f613920f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f613920f640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f61340a2930 con 0x7f613413f9a0 2024-09-13T10:33:27.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f613920f640 10 monclient: _renew_subs 2024-09-13T10:33:27.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f613920f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:27.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f613920f640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f613413d470 con 0x7f613413f9a0 2024-09-13T10:33:27.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f612c003ea0 con 0x7f613413f9a0 2024-09-13T10:33:27.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:27.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f612c004410 con 0x7f613413f9a0 2024-09-13T10:33:27.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:27.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f612bfff640 10 monclient: dump: 2024-09-13T10:33:27.871 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.844+0000 7f6131d9b640 4 set_mon_vals no callback set 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.845+0000 7f613920f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.845+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f612c012020 con 0x7f613413f9a0 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.845+0000 7f613920f640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f61340a3240 con 0x7f613413fd80 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.845+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(111..111 src has 1..111) ==== 3898+0+0 (unknown 3666768603 0 0) 0x7f612c04e570 con 0x7f613413f9a0 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.845+0000 7f612a59c640 10 monclient: get_auth_request con 0x7f6114040490 auth_method 0 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.847+0000 7f6132d9d640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.195:6792/0 conn(0x7f613413fd80 legacy=0x7f6134140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.847+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029344277 0 0) 0x7f61340a3240 con 0x7f613413fd80 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 10 monclient(hunting): my global_id is 55447 2024-09-13T10:33:27.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613413dbe0 con 0x7f613413fd80 2024-09-13T10:33:27.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1374876205 0 0) 0x7f613413dbe0 con 0x7f613413fd80 2024-09-13T10:33:27.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61340a3240 con 0x7f613413fd80 2024-09-13T10:33:27.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6124005300 con 0x7f613413fd80 2024-09-13T10:33:27.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:27.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 10 monclient: dump: 2024-09-13T10:33:27.875 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.875 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.875 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.875 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.875 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.875 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.875 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.875 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.875 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.875 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.875 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.876 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4274246871 0 0) 0x7f61340a3240 con 0x7f613413fd80 2024-09-13T10:33:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61340008d0 con 0x7f613413fd80 2024-09-13T10:33:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f61240075c0 con 0x7f613413fd80 2024-09-13T10:33:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:27.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.195:6792/0 conn(0x7f613413fd80 legacy=0x7f6134140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.848+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.195:6792/0 conn(0x7f613413fd80 legacy=0x7f6134140160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.854+0000 7f613920f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.854+0000 7f613920f640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f61340a4bd0 con 0x7f6134140870 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f6132d9d640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.195:6792/0 conn(0x7f6134140870 legacy=0x7f61341dbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 653137259 0 0) 0x7f61340a4bd0 con 0x7f6134140870 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 10 monclient(hunting): my global_id is 55456 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61340a3240 con 0x7f6134140870 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2554646158 0 0) 0x7f61340a3240 con 0x7f6134140870 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61340a4bd0 con 0x7f6134140870 2024-09-13T10:33:27.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6124006ef0 con 0x7f6134140870 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 10 monclient: dump: 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:27.878 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2396012737 0 0) 0x7f61340a4bd0 con 0x7f6134140870 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.857+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6134069af0 con 0x7f6134140870 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 1835582769) 0x7f6124007200 con 0x7f6134140870 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f612bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f612bfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.195:6792/0 conn(0x7f6134140870 legacy=0x7f61341dbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f612bfff640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.195:6792/0 conn(0x7f6134140870 legacy=0x7f61341dbb80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:27.880 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:27.880 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:27.880 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:27.880 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:27.880 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:27.880 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 222278, 2024-09-13T10:33:27.880 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:27.880 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:27.880 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:27.881 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:27.881 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:27.881 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:27.881 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:27.881 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:27.881 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:27.881 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:27.881 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.881 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:33:27.881 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:27.881 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:27.882 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:27.884 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:27.885 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.886 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.887 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.888 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.889 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:27.890 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.891 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:27.893 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.894 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:27.895 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:27.896 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.897 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:27.898 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:27.899 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:27.899 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:27.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:27.899 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:27.899 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:27.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f613920f640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6114040490 legacy=0x7f6114042950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f613920f640 10 monclient: shutdown 2024-09-13T10:33:27.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f613920f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:27.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f613920f640 1 -- 172.21.15.181:0/2056184974 >> v1:172.21.15.181:6791/0 conn(0x7f613413f9a0 legacy=0x7f61341d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:27.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f613359e640 1 -- 172.21.15.181:0/2056184974 reap_dead start 2024-09-13T10:33:27.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f613359e640 1 -- 172.21.15.181:0/2056184974 reap_dead start 2024-09-13T10:33:27.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f613920f640 1 -- 172.21.15.181:0/2056184974 shutdown_connections 2024-09-13T10:33:27.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.858+0000 7f613920f640 1 -- 172.21.15.181:0/2056184974 >> 172.21.15.181:0/2056184974 conn(0x7f61340abcd0 msgr2=0x7f61340ab3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:27.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.859+0000 7f613920f640 1 -- 172.21.15.181:0/2056184974 shutdown_connections 2024-09-13T10:33:27.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.859+0000 7f613920f640 1 -- 172.21.15.181:0/2056184974 wait complete. 2024-09-13T10:33:27.901 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:27.901 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T10:33:27.901 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T10:33:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.996+0000 7fb69cf64640 10 monclient: get_monmap_and_config 2024-09-13T10:33:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.996+0000 7fb69cf64640 10 monclient: build_initial_monmap 2024-09-13T10:33:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.996+0000 7fb69cf64640 10 monclient: monmap: 2024-09-13T10:33:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:27.999 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:27.998223+0000 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:27.998223+0000 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:28.000 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:28.001 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 1 Processor -- start 2024-09-13T10:33:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 1 -- start start 2024-09-13T10:33:28.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 10 monclient: init 2024-09-13T10:33:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 10 monclient: _add_conns ranks=[8,6,0,4,2,3,7,1,5] 2024-09-13T10:33:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 10 monclient(hunting): picked mon.noname-e con 0x7fb6980a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:28.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 10 monclient(hunting): picked mon.noname-d con 0x7fb6980a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 10 monclient(hunting): picked mon.noname-a con 0x7fb69813f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6980a4bc0 con 0x7fb69813f750 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69813a320 con 0x7fb6980a8340 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6980a8100 con 0x7fb6980a6640 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69cf64640 10 monclient(hunting): authenticate will time out at 947.503853s 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb696d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb69813f750 0x7fb698141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60592/0 (socket says 172.21.15.181:60592) 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb696d9d640 1 -- 172.21.15.181:0/3013105004 learned_addr learned my addr 172.21.15.181:0/3013105004 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb69659c640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fb6980a6640 0x7fb698139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:37628/0 (socket says 172.21.15.181:37628) 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:27.997+0000 7fb695d9b640 1 --1- 172.21.15.181:0/3013105004 >> v1:172.21.15.181:6792/0 conn(0x7fb6980a8340 0x7fb698139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54238/0 (socket says 172.21.15.181:54238) 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69659c640 1 -- 172.21.15.181:0/3013105004 >> v1:172.21.15.181:6793/0 conn(0x7fb6980a6640 legacy=0x7fb698139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb696d9d640 1 -- 172.21.15.181:0/3013105004 >> v1:172.21.15.181:6789/0 conn(0x7fb69813f750 legacy=0x7fb698141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:28.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb695d9b640 1 -- 172.21.15.181:0/3013105004 >> v1:172.21.15.181:6792/0 conn(0x7fb6980a8340 legacy=0x7fb698139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2914806501 0 0) 0x7fb6980a4bc0 con 0x7fb69813f750 2024-09-13T10:33:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient(hunting): _negotiate 2024-09-13T10:33:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient(hunting): my global_id is 55215 2024-09-13T10:33:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb680003520 con 0x7fb69813f750 2024-09-13T10:33:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033771160 0 0) 0x7fb6980a8100 con 0x7fb6980a6640 2024-09-13T10:33:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient(hunting): _negotiate 2024-09-13T10:33:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient(hunting): my global_id is 84167 2024-09-13T10:33:28.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6980a4bc0 con 0x7fb6980a6640 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2573702049 0 0) 0x7fb69813a320 con 0x7fb6980a8340 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient(hunting): _negotiate 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient(hunting): my global_id is 5325 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6980a8100 con 0x7fb6980a8340 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1058061428 0 0) 0x7fb680003520 con 0x7fb69813f750 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 >> v1:172.21.15.181:6793/0 conn(0x7fb6980a6640 legacy=0x7fb698139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 >> v1:172.21.15.181:6792/0 conn(0x7fb6980a8340 legacy=0x7fb698139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient: _finish_hunting 0 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 monclient: found mon.noname-a 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:28.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6980a48e0 con 0x7fb69813f750 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient: _finish_auth 0 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient: _check_auth_tickets 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69cf64640 5 monclient: authenticate success, global_id 55215 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb690001e60 con 0x7fb69813f750 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69cf64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient: dump: 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:28.009 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69cf64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb690004c20 con 0x7fb69813f750 2024-09-13T10:33:28.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 1 -- 172.21.15.181:0/3013105004 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb690005190 con 0x7fb69813f750 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69559a640 10 monclient: dump: 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:28.011 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69cf64640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.000+0000 7fb69cf64640 4 set_mon_vals no callback set 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.001+0000 7fb69cf64640 10 monclient: shutdown 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.001+0000 7fb69cf64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.001+0000 7fb69cf64640 1 -- 172.21.15.181:0/3013105004 >> v1:172.21.15.181:6789/0 conn(0x7fb69813f750 legacy=0x7fb698141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.001+0000 7fb69cf64640 1 -- 172.21.15.181:0/3013105004 shutdown_connections 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.001+0000 7fb69cf64640 1 -- 172.21.15.181:0/3013105004 >> 172.21.15.181:0/3013105004 conn(0x7fb698077170 msgr2=0x7fb6980abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:28.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.001+0000 7fb69cf64640 1 -- 172.21.15.181:0/3013105004 shutdown_connections 2024-09-13T10:33:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.001+0000 7fb69cf64640 1 -- 172.21.15.181:0/3013105004 wait complete. 2024-09-13T10:33:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 10 monclient: build_initial_monmap 2024-09-13T10:33:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 10 monclient: monmap: 2024-09-13T10:33:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:28.013 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 1 Processor -- start 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 1 -- start start 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 10 monclient: init 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 10 monclient: _add_conns ranks=[5,8,0,7,2,3,4,1,6] 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 10 monclient(hunting): picked mon.noname-h con 0x7fb6980a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:28.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 10 monclient(hunting): picked mon.noname-e con 0x7fb69813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 10 monclient(hunting): picked mon.noname-a con 0x7fb6981d4730 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6980a1600 con 0x7fb6981d4730 2024-09-13T10:33:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb698139310 con 0x7fb6980a8340 2024-09-13T10:33:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6980a9c40 con 0x7fb69813f750 2024-09-13T10:33:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.002+0000 7fb69cf64640 10 monclient(hunting): authenticate will time out at 947.508984s 2024-09-13T10:33:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.003+0000 7fb695d9b640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fb69813f750 0x7fb698138c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:37632/0 (socket says 172.21.15.181:37632) 2024-09-13T10:33:28.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.003+0000 7fb695d9b640 1 -- 172.21.15.181:0/3814816527 learned_addr learned my addr 172.21.15.181:0/3814816527 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:28.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb695d9b640 1 -- 172.21.15.181:0/3814816527 >> v1:172.21.15.181:6793/0 conn(0x7fb69813f750 legacy=0x7fb698138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb696d9d640 1 -- 172.21.15.181:0/3814816527 >> v1:172.21.15.181:6789/0 conn(0x7fb6981d4730 legacy=0x7fb6981d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb69659c640 1 -- 172.21.15.181:0/3814816527 >> v1:172.21.15.195:6791/0 conn(0x7fb6980a8340 legacy=0x7fb6981384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 111938092 0 0) 0x7fb6980a9c40 con 0x7fb69813f750 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): my global_id is 84176 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb678003550 con 0x7fb69813f750 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3716562033 0 0) 0x7fb6980a1600 con 0x7fb6981d4730 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:28.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): my global_id is 55224 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6980a9c40 con 0x7fb6981d4730 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3754812490 0 0) 0x7fb698139310 con 0x7fb6980a8340 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): my global_id is 5477 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6980a1600 con 0x7fb6980a8340 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3084638113 0 0) 0x7fb678003550 con 0x7fb69813f750 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb698139310 con 0x7fb69813f750 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb68c0019a0 con 0x7fb69813f750 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:33:28.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): dump: 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:28.021 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1294066726 0 0) 0x7fb6980a9c40 con 0x7fb6981d4730 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb678003550 con 0x7fb6981d4730 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2686529238 0 0) 0x7fb6980a1600 con 0x7fb6980a8340 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6980a9c40 con 0x7fb6980a8340 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb6900020b0 con 0x7fb6981d4730 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): dump: 2024-09-13T10:33:28.022 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:28.023 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb6880047e0 con 0x7fb6980a8340 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 10 monclient(hunting): dump: 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:28.024 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.005+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3760626614 0 0) 0x7fb698139310 con 0x7fb69813f750 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 >> v1:172.21.15.195:6791/0 conn(0x7fb6980a8340 legacy=0x7fb6981384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 >> v1:172.21.15.181:6789/0 conn(0x7fb6981d4730 legacy=0x7fb6981d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 1 monclient: found mon.e 2024-09-13T10:33:28.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69809f2a0 con 0x7fb69813f750 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 10 monclient: _finish_auth 0 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb69cf64640 5 monclient: authenticate success, global_id 84176 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb69cf64640 10 monclient: _renew_subs 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb69cf64640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb69cf64640 1 -- 172.21.15.181:0/3814816527 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb69809fe00 con 0x7fb69813f750 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb69cf64640 10 monclient: _renew_subs 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb69cf64640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb69cf64640 1 -- 172.21.15.181:0/3814816527 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6981d8240 con 0x7fb69813f750 2024-09-13T10:33:28.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb68c004dd0 con 0x7fb69813f750 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb68c0052c0 con 0x7fb69813f750 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb694d99640 4 set_mon_vals no callback set 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 10 monclient: dump: 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:28.027 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb68c011940 con 0x7fb69813f750 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb69cf64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb69cf64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.006+0000 7fb69cf64640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.007+0000 7fb69cf64640 1 -- 172.21.15.181:0/3814816527 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67c005080 con 0x7fb69813f750 2024-09-13T10:33:28.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.007+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(111..111 src has 1..111) ==== 3898+0+0 (unknown 3666768603 0 0) 0x7fb68c04e4c0 con 0x7fb69813f750 2024-09-13T10:33:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.007+0000 7fb69659c640 10 monclient: get_auth_request con 0x7fb678040610 auth_method 0 2024-09-13T10:33:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.011+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fb68c017950 con 0x7fb69813f750 2024-09-13T10:33:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.011+0000 7fb686ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:28.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.011+0000 7fb686ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:28.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.258+0000 7fb69cf64640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-13T10:33:28.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.258+0000 7fb69cf64640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-13T10:33:28.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.258+0000 7fb69cf64640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:33:28.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.258+0000 7fb69cf64640 1 -- 172.21.15.181:0/3814816527 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb67c005c40 con 0x7fb69813f750 2024-09-13T10:33:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.269+0000 7fb686ffd640 1 -- 172.21.15.181:0/3814816527 <== mon.8 v1:172.21.15.181:6793/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fb68c017250 con 0x7fb69813f750 2024-09-13T10:33:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.269+0000 7fb686ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-13T10:33:28.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.269+0000 7fb686ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:28.274 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.274 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=14,config=1,health=12,kv=12,logm=61} crc {auth=1814802580,config=1747058506,health=1505955886,kv=3467323233,logm=3271753767}) 2024-09-13T10:33:28.274 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=12,kv=12,logm=62} crc {auth=1261955242,config=2586702516,health=1505955886,kv=3467323233,logm=1859971597}) 2024-09-13T10:33:28.274 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.274 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=14,config=1,health=12,kv=12,logm=61} crc {auth=1814802580,config=1747058506,health=1505955886,kv=3467323233,logm=3271753767}) 2024-09-13T10:33:28.274 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=14,config=2,health=11,kv=11,logm=62} crc {auth=690357850,config=2586702516,health=1225755523,kv=760235678,logm=1798424869}) 2024-09-13T10:33:28.274 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.274 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=14,config=1,health=12,kv=12,logm=61} crc {auth=1814802580,config=1747058506,health=1505955886,kv=3467323233,logm=3271753767}) 2024-09-13T10:33:28.274 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=13,config=1,health=11,kv=12,logm=63} crc {auth=641114634,config=1228700967,health=2216882020,kv=3467323233,logm=2191531268}) 2024-09-13T10:33:28.274 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.274 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=14,config=1,health=12,kv=12,logm=61} crc {auth=1814802580,config=1747058506,health=1505955886,kv=3467323233,logm=3271753767}) 2024-09-13T10:33:28.274 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=12,config=2,health=11,kv=12,logm=63} crc {auth=1427106184,config=2586702516,health=2080718997,kv=3467323233,logm=1397002073}) 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=14,config=1,health=12,kv=12,logm=61} crc {auth=1814802580,config=1747058506,health=1505955886,kv=3467323233,logm=3271753767}) 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=12,config=2,health=12,kv=11,logm=63} crc {auth=3729356609,config=2586702516,health=1505955886,kv=1054420120,logm=1362957011}) 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=14,config=1,health=12,kv=12,logm=61} crc {auth=1814802580,config=1747058506,health=1505955886,kv=3467323233,logm=3271753767}) 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=14,config=2,health=11,kv=11,logm=62} crc {auth=4028456433,config=2586702516,health=1254398424,kv=775579436,logm=3890775758}) 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=14,config=1,health=12,kv=12,logm=61} crc {auth=1814802580,config=1747058506,health=1505955886,kv=3467323233,logm=3271753767}) 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=12,config=1,health=11,kv=11,logm=65} crc {auth=717183336,config=1228700967,health=2080718997,kv=3759619045,logm=964235716}) 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=14,config=1,health=12,kv=12,logm=61} crc {auth=1814802580,config=1747058506,health=1505955886,kv=3467323233,logm=3271753767}) 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.270+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=13,config=1,health=11,kv=12,logm=63} crc {auth=3055320142,config=1228700968,health=2197450772,kv=3467323233,logm=1454789353}) 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.275 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1849484432}) 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2978767276}) 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1849484432}) 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3404384511}) 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1849484432}) 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1118714015}) 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1849484432}) 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3385236750}) 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1849484432}) 2024-09-13T10:33:28.276 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2537394224}) 2024-09-13T10:33:28.277 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.277 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1849484432}) 2024-09-13T10:33:28.277 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=359946239}) 2024-09-13T10:33:28.277 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.277 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1849484432}) 2024-09-13T10:33:28.277 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3054976695}) 2024-09-13T10:33:28.277 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.277 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1849484432}) 2024-09-13T10:33:28.277 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.272+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4169423471}) 2024-09-13T10:33:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.272+0000 7fb69cf64640 1 -- 172.21.15.181:0/3814816527 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb678040610 legacy=0x7fb678042ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.272+0000 7fb69cf64640 10 monclient: shutdown 2024-09-13T10:33:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.272+0000 7fb69cf64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.272+0000 7fb69cf64640 1 -- 172.21.15.181:0/3814816527 >> v1:172.21.15.181:6793/0 conn(0x7fb69813f750 legacy=0x7fb698138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.272+0000 7fb69cf64640 1 -- 172.21.15.181:0/3814816527 shutdown_connections 2024-09-13T10:33:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.272+0000 7fb69cf64640 1 -- 172.21.15.181:0/3814816527 >> 172.21.15.181:0/3814816527 conn(0x7fb6980a6640 msgr2=0x7fb698141e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.272+0000 7fb69cf64640 1 -- 172.21.15.181:0/3814816527 shutdown_connections 2024-09-13T10:33:28.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:28.272+0000 7fb69cf64640 1 -- 172.21.15.181:0/3814816527 wait complete. 2024-09-13T10:33:28.287 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.287 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=138530962}) 2024-09-13T10:33:28.287 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=981724627}) 2024-09-13T10:33:28.287 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.287 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=138530962}) 2024-09-13T10:33:28.287 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1512378859}) 2024-09-13T10:33:28.287 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.287 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=138530962}) 2024-09-13T10:33:28.287 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=73385535}) 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=138530962}) 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2383070766}) 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=138530962}) 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2870729043}) 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=138530962}) 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1700211807}) 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=138530962}) 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=925443542}) 2024-09-13T10:33:28.288 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=138530962}) 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.273+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2833730645}) 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3424591691}) 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=361327919}) 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3424591691}) 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=98346523}) 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3424591691}) 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2063669028}) 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.289 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3424591691}) 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=739535603}) 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.274+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3424591691}) 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=922010972}) 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3424591691}) 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1035589304}) 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3424591691}) 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3186481930}) 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3424591691}) 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1308899832}) 2024-09-13T10:33:28.290 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3133955568}) 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114104619}) 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3133955568}) 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3101495596}) 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3133955568}) 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1415895768}) 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3133955568}) 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4247459820}) 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3133955568}) 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=242149338}) 2024-09-13T10:33:28.291 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3133955568}) 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=560915319}) 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3133955568}) 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1262907390}) 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3133955568}) 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2071404252}) 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1284217874}) 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1867399573}) 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.292 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1284217874}) 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=942144535}) 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1284217874}) 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1310707528}) 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1284217874}) 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=940955240}) 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1284217874}) 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1488331794}) 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1284217874}) 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3123822475}) 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.293 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1284217874}) 2024-09-13T10:33:28.294 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=925500703}) 2024-09-13T10:33:28.294 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.294 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1284217874}) 2024-09-13T10:33:28.294 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.277+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1635160268}) 2024-09-13T10:33:28.295 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-13T10:33:28.318 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.318 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1722533751}) 2024-09-13T10:33:28.318 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3197406777}) 2024-09-13T10:33:28.318 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.318 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1722533751}) 2024-09-13T10:33:28.318 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3182550314}) 2024-09-13T10:33:28.318 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.318 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1722533751}) 2024-09-13T10:33:28.318 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3355746824}) 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1722533751}) 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1016808661}) 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1722533751}) 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2911839160}) 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1722533751}) 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=294017643}) 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1722533751}) 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=440454342}) 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.319 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1722533751}) 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.287+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4285582056}) 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2671449840}) 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=42850977}) 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2671449840}) 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4031861638}) 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2671449840}) 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3887221618}) 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2671449840}) 2024-09-13T10:33:28.320 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1551189928}) 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2671449840}) 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=324723321}) 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2671449840}) 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3678050469}) 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2671449840}) 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1968604346}) 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2671449840}) 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.289+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2898855669}) 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.321 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3691146919}) 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1316541026}) 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3691146919}) 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=694948957}) 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3691146919}) 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3128738142}) 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3691146919}) 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3313999392}) 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3691146919}) 2024-09-13T10:33:28.322 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3213507447}) 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3691146919}) 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=551690982}) 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3691146919}) 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3087628125}) 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3691146919}) 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.290+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1518794515}) 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2108552903}) 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017481710}) 2024-09-13T10:33:28.323 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2108552903}) 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2202970666}) 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2108552903}) 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4257233122}) 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2108552903}) 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2158574342}) 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2108552903}) 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3826441648}) 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.324 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2108552903}) 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=289168847}) 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2108552903}) 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3076748058}) 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.291+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2108552903}) 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.292+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2396359121}) 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1516002779}) 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1182786374}) 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1516002779}) 2024-09-13T10:33:28.325 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2591272140}) 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1516002779}) 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=945476860}) 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1516002779}) 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1776773963}) 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1516002779}) 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4156128149}) 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1516002779}) 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2904834660}) 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.326 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1516002779}) 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=268055938}) 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1516002779}) 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3888346744}) 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607569356}) 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2085772958}) 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607569356}) 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2436365775}) 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607569356}) 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1153505716}) 2024-09-13T10:33:28.327 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.328 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607569356}) 2024-09-13T10:33:28.328 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2831541812}) 2024-09-13T10:33:28.328 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.328 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607569356}) 2024-09-13T10:33:28.328 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3422506942}) 2024-09-13T10:33:28.328 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.328 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607569356}) 2024-09-13T10:33:28.328 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3624510108}) 2024-09-13T10:33:28.328 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607569356}) 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2142548431}) 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607569356}) 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.294+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2504289629}) 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3004071310}) 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4043931135}) 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3004071310}) 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2621392976}) 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3004071310}) 2024-09-13T10:33:28.329 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3831671623}) 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3004071310}) 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2349869937}) 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3004071310}) 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=166244497}) 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3004071310}) 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2873697756}) 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3004071310}) 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1543219243}) 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.330 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3004071310}) 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1714619029}) 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=387293408}) 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544184726}) 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=387293408}) 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=647900743}) 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=387293408}) 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2260569777}) 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=387293408}) 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2145385859}) 2024-09-13T10:33:28.331 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=387293408}) 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4214551656}) 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=387293408}) 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4037896047}) 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=387293408}) 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2783821680}) 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=387293408}) 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.305+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2465793312}) 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=485571142}) 2024-09-13T10:33:28.332 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2401873908}) 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=485571142}) 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1375227154}) 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=485571142}) 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1826751623}) 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=485571142}) 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=876324166}) 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=485571142}) 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3520781933}) 2024-09-13T10:33:28.333 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=485571142}) 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3655803324}) 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=485571142}) 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4034182185}) 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=485571142}) 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.307+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1452482361}) 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2} crc {logm=857270951,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=4256284388,monmap=2232244610}) 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=60,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17} crc {logm=4027097593,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=4256284388}) 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2} crc {logm=857270951,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=4256284388,monmap=2232244610}) 2024-09-13T10:33:28.334 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=60,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2} crc {logm=1449304262,mdsmap=3985170090,mgr=1389828352,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=4256284388,monmap=2232244610}) 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2} crc {logm=857270951,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=4256284388,monmap=2232244610}) 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=58,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3} crc {logm=1949504178,mdsmap=2874252693,mgr=2682226838,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1004859482,mon_config_key=1596651407,monmap=2763160955,nvmeofgw=598337686}) 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2} crc {logm=857270951,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=4256284388,monmap=2232244610}) 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2} crc {logm=2851809104,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=4256284388,monmap=2232244610}) 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2} crc {logm=857270951,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=4256284388,monmap=2232244610}) 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=57,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3} crc {logm=4068135042,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=4256284388,monmap=2763160955}) 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2} crc {logm=857270951,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=4256284388,monmap=2232244610}) 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.308+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=61,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3} crc {logm=1725066230,mdsmap=2874252693,mgr=2682226838,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1069625679,mon_config_key=2739026255,monmap=2763160955}) 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.309+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.335 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.309+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2} crc {logm=857270951,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=4256284388,monmap=2232244610}) 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.309+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=62,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=15} crc {logm=2234033919,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=1319045557}) 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.309+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.309+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2} crc {logm=857270951,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3018803948,mon_config_key=4256284388,monmap=2232244610}) 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.309+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=58,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,nvmeofgw=2} crc {logm=3962080008,mdsmap=2874252693,mgr=1942657901,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1313470068,mon_config_key=1382017330,monmap=2763160955,nvmeofgw=1596038039}) 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=3467205466}) 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=88} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=786132628,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=1849444593}) 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=3467205466}) 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=1185386852}) 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=3467205466}) 2024-09-13T10:33:28.336 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=1074266155}) 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=3467205466}) 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {monmap=1,nvmeofgw=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=89} crc {monmap=1228700967,nvmeofgw=3140514009,osd_metadata=2327124118,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=3031545424}) 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=3467205466}) 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=1254456010}) 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=3467205466}) 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=3517459731}) 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=3467205466}) 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=774880669}) 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.337 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=87} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=4133920409,osdmap=3467205466}) 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.310+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {monmap=1,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=88} crc {monmap=1228700967,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1594251184,osd_snap=1914091868,osdmap=2054760919}) 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=88} crc {osdmap=4038697485}) 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=89} crc {osdmap=2429802768}) 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=88} crc {osdmap=4038697485}) 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=91} crc {osdmap=1337094023}) 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=88} crc {osdmap=4038697485}) 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=85} crc {osdmap=2899415566}) 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=88} crc {osdmap=4038697485}) 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=88} crc {osdmap=2008913969}) 2024-09-13T10:33:28.338 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=88} crc {osdmap=4038697485}) 2024-09-13T10:33:28.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=90} crc {osdmap=1226499275}) 2024-09-13T10:33:28.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=88} crc {osdmap=4038697485}) 2024-09-13T10:33:28.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=90} crc {osdmap=2200443157}) 2024-09-13T10:33:28.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=88} crc {osdmap=4038697485}) 2024-09-13T10:33:28.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=90} crc {osdmap=2225649177}) 2024-09-13T10:33:28.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:33:28.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=88} crc {osdmap=4038697485}) 2024-09-13T10:33:28.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:33:28.314+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=93} crc {osdmap=2543329264}) 2024-09-13T10:33:28.669 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37135]: starting. 2024-09-13T10:33:28.669 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37135]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37133 2024-09-13T10:33:28.669 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37135]: shutting down. 2024-09-13T10:33:29.296 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:33:29.297 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:33:29.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.394+0000 7f178a726640 10 monclient: get_monmap_and_config 2024-09-13T10:33:29.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.394+0000 7f178a726640 10 monclient: build_initial_monmap 2024-09-13T10:33:29.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.394+0000 7f178a726640 10 monclient: monmap: 2024-09-13T10:33:29.397 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:29.397 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:29.395891+0000 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:29.395891+0000 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:29.398 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:29.399 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 1 Processor -- start 2024-09-13T10:33:29.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 1 -- start start 2024-09-13T10:33:29.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 10 monclient: init 2024-09-13T10:33:29.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:29.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 10 monclient: _add_conns ranks=[6,1,3,7,8,0,2,4,5] 2024-09-13T10:33:29.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 10 monclient(hunting): picked mon.noname-d con 0x7f17840a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:29.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 10 monclient(hunting): picked mon.noname-f con 0x7f17840a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:29.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 10 monclient(hunting): picked mon.noname-g con 0x7f178413f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:29.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17840a5fe0 con 0x7f17840a6ab0 2024-09-13T10:33:29.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17840a8080 con 0x7f178413f9a0 2024-09-13T10:33:29.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17840a42c0 con 0x7f17840a66d0 2024-09-13T10:33:29.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:29.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f178a726640 10 monclient(hunting): authenticate will time out at 948.901621s 2024-09-13T10:33:29.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f1783fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f17840a66d0 0x7f17840a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54244/0 (socket says 172.21.15.181:54244) 2024-09-13T10:33:29.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.395+0000 7f1783fff640 1 -- 172.21.15.181:0/3388113329 learned_addr learned my addr 172.21.15.181:0/3388113329 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:29.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.397+0000 7f1783fff640 1 -- 172.21.15.181:0/3388113329 >> v1:172.21.15.181:6792/0 conn(0x7f17840a66d0 legacy=0x7f17840a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 1 -- 172.21.15.181:0/3388113329 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544828503 0 0) 0x7f17840a42c0 con 0x7f17840a66d0 2024-09-13T10:33:29.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient(hunting): my global_id is 5343 2024-09-13T10:33:29.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 1 -- 172.21.15.181:0/3388113329 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1770003520 con 0x7f17840a66d0 2024-09-13T10:33:29.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1788cc3640 1 -- 172.21.15.181:0/3388113329 >> v1:172.21.15.195:6790/0 conn(0x7f178413f9a0 legacy=0x7f1784141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f17837fe640 1 -- 172.21.15.181:0/3388113329 >> v1:172.21.15.195:6789/0 conn(0x7f17840a6ab0 legacy=0x7f17840a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 1 -- 172.21.15.181:0/3388113329 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1760903623 0 0) 0x7f1770003520 con 0x7f17840a66d0 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 1 -- 172.21.15.181:0/3388113329 >> v1:172.21.15.195:6790/0 conn(0x7f178413f9a0 legacy=0x7f1784141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 1 -- 172.21.15.181:0/3388113329 >> v1:172.21.15.195:6789/0 conn(0x7f17840a6ab0 legacy=0x7f17840a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 1 monclient: found mon.noname-d 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 1 -- 172.21.15.181:0/3388113329 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17841464e0 con 0x7f17840a66d0 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient: _finish_auth 0 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:29.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f178a726640 5 monclient: authenticate success, global_id 5343 2024-09-13T10:33:29.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 1 -- 172.21.15.181:0/3388113329 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1774001ad0 con 0x7f17840a66d0 2024-09-13T10:33:29.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:29.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient: dump: 2024-09-13T10:33:29.406 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.406 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.406 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.406 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.406 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.406 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.406 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.407 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.407 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.407 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.407 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.407 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.407 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.407 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.407 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f178a726640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 1 -- 172.21.15.181:0/3388113329 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f17740048a0 con 0x7f17840a66d0 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f178a726640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 1 -- 172.21.15.181:0/3388113329 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1774004dd0 con 0x7f17840a66d0 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f178a726640 4 set_mon_vals no callback set 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f1782ffd640 10 monclient: dump: 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.408 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f178a726640 10 monclient: shutdown 2024-09-13T10:33:29.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f178a726640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f178a726640 1 -- 172.21.15.181:0/3388113329 >> v1:172.21.15.181:6792/0 conn(0x7f17840a66d0 legacy=0x7f17840a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f178a726640 1 -- 172.21.15.181:0/3388113329 shutdown_connections 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.398+0000 7f178a726640 1 -- 172.21.15.181:0/3388113329 >> 172.21.15.181:0/3388113329 conn(0x7f17840abcd0 msgr2=0x7f17840ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.399+0000 7f178a726640 1 -- 172.21.15.181:0/3388113329 shutdown_connections 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.399+0000 7f178a726640 1 -- 172.21.15.181:0/3388113329 wait complete. 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.399+0000 7f178a726640 10 monclient: build_initial_monmap 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.399+0000 7f178a726640 10 monclient: monmap: 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:29.410 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.399+0000 7f178a726640 1 Processor -- start 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f178a726640 1 -- start start 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f178a726640 10 monclient: init 2024-09-13T10:33:29.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f178a726640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f178a726640 10 monclient: _add_conns ranks=[5,3,0,1,8,7,4,2,6] 2024-09-13T10:33:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f178a726640 10 monclient(hunting): picked mon.noname-h con 0x7f17840a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f178a726640 10 monclient(hunting): picked mon.noname-g con 0x7f17840a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f178a726640 10 monclient(hunting): picked mon.noname-a con 0x7f178413f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f178a726640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17840a2810 con 0x7f178413f9a0 2024-09-13T10:33:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f178a726640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f178413f590 con 0x7f17840a6ab0 2024-09-13T10:33:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f178a726640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17840688a0 con 0x7f17840a66d0 2024-09-13T10:33:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f178a726640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f178a726640 10 monclient(hunting): authenticate will time out at 948.906524s 2024-09-13T10:33:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f1788cc3640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f178413f9a0 0x7f17841d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60620/0 (socket says 172.21.15.181:60620) 2024-09-13T10:33:29.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.400+0000 7f1788cc3640 1 -- 172.21.15.181:0/3275058064 learned_addr learned my addr 172.21.15.181:0/3275058064 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:29.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.402+0000 7f1788cc3640 1 -- 172.21.15.181:0/3275058064 >> v1:172.21.15.181:6789/0 conn(0x7f178413f9a0 legacy=0x7f17841d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.402+0000 7f17837fe640 1 -- 172.21.15.181:0/3275058064 >> v1:172.21.15.195:6790/0 conn(0x7f17840a6ab0 legacy=0x7f17841d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.402+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708306523 0 0) 0x7f17840a2810 con 0x7f178413f9a0 2024-09-13T10:33:29.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.402+0000 7f1780ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.402+0000 7f1780ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.402+0000 7f1780ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.402+0000 7f1780ff9640 10 monclient(hunting): my global_id is 55269 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.402+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1764003550 con 0x7f178413f9a0 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.402+0000 7f1783fff640 1 -- 172.21.15.181:0/3275058064 >> v1:172.21.15.195:6791/0 conn(0x7f17840a66d0 legacy=0x7f17841ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2979835897 0 0) 0x7f17840a5fe0 con 0x7f17840a6ab0 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): my global_id is 5349 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17840a2810 con 0x7f17840a6ab0 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1788cc3640 1 --1- 172.21.15.181:0/3275058064 >> v1:172.21.15.181:6789/0 conn(0x7f178413f9a0 0x7f17841d6d60 :-1 s=OPENED pgs=312 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f1764003550 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528471420 0 0) 0x7f17840688a0 con 0x7f17840a66d0 2024-09-13T10:33:29.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): my global_id is 5504 2024-09-13T10:33:29.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17840a5fe0 con 0x7f17840a66d0 2024-09-13T10:33:29.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3452347936 0 0) 0x7f1764003550 con 0x7f178413f9a0 2024-09-13T10:33:29.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f17840688a0 con 0x7f178413f9a0 2024-09-13T10:33:29.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f177c003990 con 0x7f178413f9a0 2024-09-13T10:33:29.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:29.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): dump: 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.419 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3767508705 0 0) 0x7f17840a2810 con 0x7f17840a6ab0 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1764003550 con 0x7f17840a6ab0 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f176c001bd0 con 0x7f17840a6ab0 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): dump: 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.420 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.421 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.422 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3734871109 0 0) 0x7f17840a5fe0 con 0x7f17840a66d0 2024-09-13T10:33:29.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f17840a2810 con 0x7f17840a66d0 2024-09-13T10:33:29.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1774004d90 con 0x7f17840a66d0 2024-09-13T10:33:29.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:29.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:29.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient(hunting): dump: 2024-09-13T10:33:29.422 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.422 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.422 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.422 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.422 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2134782606 0 0) 0x7f1764003550 con 0x7f17840a6ab0 2024-09-13T10:33:29.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 >> v1:172.21.15.195:6791/0 conn(0x7f17840a66d0 legacy=0x7f17841ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 >> v1:172.21.15.181:6789/0 conn(0x7f178413f9a0 legacy=0x7f17841d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 monclient: found mon.g 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178413ce10 con 0x7f17840a6ab0 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient: _finish_auth 0 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f178a726640 5 monclient: authenticate success, global_id 5349 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1090914059 0 0) 0x7f17840688a0 con 0x7f178413f9a0 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f178a726640 10 monclient: _renew_subs 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f178a726640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:33:29.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f178a726640 1 -- 172.21.15.181:0/3275058064 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f178413f170 con 0x7f17840a6ab0 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f178a726640 10 monclient: _renew_subs 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f178a726640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f178a726640 1 -- 172.21.15.181:0/3275058064 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f178413e580 con 0x7f17840a6ab0 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f176c0038c0 con 0x7f17840a6ab0 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f176c003db0 con 0x7f17840a6ab0 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f17827fc640 4 set_mon_vals no callback set 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.403+0000 7f1780ff9640 10 monclient: dump: 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.425 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.404+0000 7f178a726640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:29.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.404+0000 7f178a726640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:29.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.404+0000 7f178a726640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:33:29.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.404+0000 7f178a726640 1 -- 172.21.15.181:0/3275058064 --> v1:172.21.15.195:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1768005080 con 0x7f17840a6ab0 2024-09-13T10:33:29.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.404+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f176c003f50 con 0x7f17840a6ab0 2024-09-13T10:33:29.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.404+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(112..112 src has 1..112) ==== 3506+0+0 (unknown 666717423 0 0) 0x7f176c04df20 con 0x7f17840a6ab0 2024-09-13T10:33:29.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.405+0000 7f1783fff640 10 monclient: get_auth_request con 0x7f1764040450 auth_method 0 2024-09-13T10:33:29.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.410+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.3 v1:172.21.15.195:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f178413f590 con 0x7f17840a6ab0 2024-09-13T10:33:29.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.410+0000 7f1780ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:29.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.410+0000 7f1780ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:29.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.651+0000 7f178a726640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:33:29.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.651+0000 7f178a726640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:33:29.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.651+0000 7f178a726640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:33:29.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.651+0000 7f178a726640 1 -- 172.21.15.181:0/3275058064 --> v1:172.21.15.195:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1768005370 con 0x7f17840a6ab0 2024-09-13T10:33:29.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.653+0000 7f1780ff9640 1 -- 172.21.15.181:0/3275058064 <== mon.3 v1:172.21.15.195:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 3260733122) 0x7f176c017590 con 0x7f17840a6ab0 2024-09-13T10:33:29.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.653+0000 7f1780ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:33:29.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.653+0000 7f1780ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:29.656 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":72,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":3,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:33:29.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.657+0000 7f178a726640 1 -- 172.21.15.181:0/3275058064 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1764040450 legacy=0x7f1764042910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.657+0000 7f178a726640 10 monclient: shutdown 2024-09-13T10:33:29.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.657+0000 7f178a726640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:29.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.657+0000 7f178a726640 1 -- 172.21.15.181:0/3275058064 >> v1:172.21.15.195:6790/0 conn(0x7f17840a6ab0 legacy=0x7f17841d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.657+0000 7f178a726640 1 -- 172.21.15.181:0/3275058064 shutdown_connections 2024-09-13T10:33:29.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.657+0000 7f178a726640 1 -- 172.21.15.181:0/3275058064 >> 172.21.15.181:0/3275058064 conn(0x7f17840abcd0 msgr2=0x7f17840a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:29.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.657+0000 7f178a726640 1 -- 172.21.15.181:0/3275058064 shutdown_connections 2024-09-13T10:33:29.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.657+0000 7f178a726640 1 -- 172.21.15.181:0/3275058064 wait complete. 2024-09-13T10:33:29.672 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:33:29.672 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T10:33:29.672 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:33:29.673 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:33:29.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.768+0000 7fc9a249c640 10 monclient: get_monmap_and_config 2024-09-13T10:33:29.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.768+0000 7fc9a249c640 10 monclient: build_initial_monmap 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.768+0000 7fc9a249c640 10 monclient: monmap: 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:29.769695+0000 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:29.769695+0000 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:29.771 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:29.772 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:29.772 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:29.772 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.768+0000 7fc9a249c640 1 Processor -- start 2024-09-13T10:33:29.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc9a249c640 1 -- start start 2024-09-13T10:33:29.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc9a249c640 10 monclient: init 2024-09-13T10:33:29.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc9a249c640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:29.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc9a249c640 10 monclient: _add_conns ranks=[8,6,3,1,4,5,7,2,0] 2024-09-13T10:33:29.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc9a249c640 10 monclient(hunting): picked mon.noname-e con 0x7fc99c0a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:29.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc9a249c640 10 monclient(hunting): picked mon.noname-d con 0x7fc99c0a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:29.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc9a249c640 10 monclient(hunting): picked mon.noname-g con 0x7fc99c13f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:29.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc9a249c640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99c0a4bc0 con 0x7fc99c13f750 2024-09-13T10:33:29.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc9a249c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99c13a320 con 0x7fc99c0a8340 2024-09-13T10:33:29.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc9a249c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99c0a8100 con 0x7fc99c0a6640 2024-09-13T10:33:29.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc9a249c640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:29.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc9a249c640 10 monclient(hunting): authenticate will time out at 949.275550s 2024-09-13T10:33:29.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc99bfff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fc99c0a6640 0x7fc99c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:37638/0 (socket says 172.21.15.181:37638) 2024-09-13T10:33:29.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc993fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fc99c0a8340 0x7fc99c139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54254/0 (socket says 172.21.15.181:54254) 2024-09-13T10:33:29.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.769+0000 7fc99bfff640 1 -- 172.21.15.181:0/1131902346 learned_addr learned my addr 172.21.15.181:0/1131902346 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:29.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.771+0000 7fc99bfff640 1 -- 172.21.15.181:0/1131902346 >> v1:172.21.15.181:6793/0 conn(0x7fc99c0a6640 legacy=0x7fc99c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.771+0000 7fc993fff640 1 -- 172.21.15.181:0/1131902346 >> v1:172.21.15.181:6792/0 conn(0x7fc99c0a8340 legacy=0x7fc99c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.771+0000 7fc99b7fe640 1 -- 172.21.15.181:0/1131902346 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 341102639 0 0) 0x7fc99c0a8100 con 0x7fc99c0a6640 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.771+0000 7fc99b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.771+0000 7fc99b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.771+0000 7fc99b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.771+0000 7fc99b7fe640 10 monclient(hunting): my global_id is 84203 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 1 -- 172.21.15.181:0/1131902346 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc988003520 con 0x7fc99c0a6640 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 1 -- 172.21.15.181:0/1131902346 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 386006890 0 0) 0x7fc99c13a320 con 0x7fc99c0a8340 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient(hunting): my global_id is 5352 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 1 -- 172.21.15.181:0/1131902346 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc99c0a8100 con 0x7fc99c0a8340 2024-09-13T10:33:29.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 1 -- 172.21.15.181:0/1131902346 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 985804940 0 0) 0x7fc988003520 con 0x7fc99c0a6640 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 1 -- 172.21.15.181:0/1131902346 >> v1:172.21.15.181:6792/0 conn(0x7fc99c0a8340 legacy=0x7fc99c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 1 -- 172.21.15.181:0/1131902346 >> v1:172.21.15.195:6790/0 conn(0x7fc99c13f750 legacy=0x7fc99c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc9a0a39640 1 -- 172.21.15.181:0/1131902346 >> v1:172.21.15.195:6790/0 conn(0x7fc99c13f750 legacy=0x7fc99c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 1 monclient: found mon.noname-e 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 1 -- 172.21.15.181:0/1131902346 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99c0a48e0 con 0x7fc99c0a6640 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 1 -- 172.21.15.181:0/1131902346 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc98c001ae0 con 0x7fc99c0a6640 2024-09-13T10:33:29.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient: dump: 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.780 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc9a249c640 5 monclient: authenticate success, global_id 84203 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc9a249c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 1 -- 172.21.15.181:0/1131902346 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc98c0048a0 con 0x7fc99c0a6640 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 1 -- 172.21.15.181:0/1131902346 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc98c004e10 con 0x7fc99c0a6640 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc9a249c640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc9a249c640 4 set_mon_vals no callback set 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:29.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc99b7fe640 10 monclient: dump: 2024-09-13T10:33:29.782 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.782 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.782 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.782 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.782 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.782 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.782 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc9a249c640 10 monclient: shutdown 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc9a249c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc9a249c640 1 -- 172.21.15.181:0/1131902346 >> v1:172.21.15.181:6793/0 conn(0x7fc99c0a6640 legacy=0x7fc99c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc9a249c640 1 -- 172.21.15.181:0/1131902346 shutdown_connections 2024-09-13T10:33:29.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc9a249c640 1 -- 172.21.15.181:0/1131902346 >> 172.21.15.181:0/1131902346 conn(0x7fc99c077170 msgr2=0x7fc99c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.772+0000 7fc9a249c640 1 -- 172.21.15.181:0/1131902346 shutdown_connections 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.773+0000 7fc9a249c640 1 -- 172.21.15.181:0/1131902346 wait complete. 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.773+0000 7fc9a249c640 10 monclient: build_initial_monmap 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.773+0000 7fc9a249c640 10 monclient: monmap: 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:29.784 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:29.785 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:29.785 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:29.785 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:29.785 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:29.785 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:29.785 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.773+0000 7fc9a249c640 1 Processor -- start 2024-09-13T10:33:29.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.773+0000 7fc9a249c640 1 -- start start 2024-09-13T10:33:29.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.773+0000 7fc9a249c640 10 monclient: init 2024-09-13T10:33:29.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.774+0000 7fc9a249c640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:29.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.774+0000 7fc9a249c640 10 monclient: _add_conns ranks=[6,5,3,0,2,8,4,7,1] 2024-09-13T10:33:29.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.774+0000 7fc9a249c640 10 monclient(hunting): picked mon.noname-d con 0x7fc99c0a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:29.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.774+0000 7fc9a249c640 10 monclient(hunting): picked mon.noname-h con 0x7fc99c13f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:29.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.774+0000 7fc9a249c640 10 monclient(hunting): picked mon.noname-g con 0x7fc99c1422f0 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:29.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.774+0000 7fc9a249c640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99c0a9c40 con 0x7fc99c1422f0 2024-09-13T10:33:29.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.774+0000 7fc9a249c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99c13bc90 con 0x7fc99c13f750 2024-09-13T10:33:29.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.774+0000 7fc9a249c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99c13c7f0 con 0x7fc99c0a8340 2024-09-13T10:33:29.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.774+0000 7fc9a249c640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:29.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.774+0000 7fc9a249c640 10 monclient(hunting): authenticate will time out at 949.280354s 2024-09-13T10:33:29.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.774+0000 7fc99bfff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fc99c0a8340 0x7fc99c12c6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54258/0 (socket says 172.21.15.181:54258) 2024-09-13T10:33:29.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.774+0000 7fc99bfff640 1 -- 172.21.15.181:0/2238099052 learned_addr learned my addr 172.21.15.181:0/2238099052 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:29.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc99bfff640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.181:6792/0 conn(0x7fc99c0a8340 legacy=0x7fc99c12c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9a0a39640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.195:6790/0 conn(0x7fc99c1422f0 legacy=0x7fc99c1d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc993fff640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.195:6791/0 conn(0x7fc99c13f750 legacy=0x7fc99c1d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277667526 0 0) 0x7fc99c13c7f0 con 0x7fc99c0a8340 2024-09-13T10:33:29.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 10 monclient(hunting): my global_id is 5361 2024-09-13T10:33:29.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc97c003550 con 0x7fc99c0a8340 2024-09-13T10:33:29.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128574885 0 0) 0x7fc99c0a9c40 con 0x7fc99c1422f0 2024-09-13T10:33:29.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 10 monclient(hunting): my global_id is 5358 2024-09-13T10:33:29.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc99c13c7f0 con 0x7fc99c1422f0 2024-09-13T10:33:29.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614000672 0 0) 0x7fc99c13bc90 con 0x7fc99c13f750 2024-09-13T10:33:29.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 10 monclient(hunting): my global_id is 5513 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.776+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc99c0a9c40 con 0x7fc99c13f750 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4014374509 0 0) 0x7fc97c003550 con 0x7fc99c0a8340 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc99c13bc90 con 0x7fc99c0a8340 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc98c004d90 con 0x7fc99c0a8340 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient(hunting): dump: 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.793 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2880596412 0 0) 0x7fc99c13c7f0 con 0x7fc99c1422f0 2024-09-13T10:33:29.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc97c003550 con 0x7fc99c1422f0 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 566363723 0 0) 0x7fc99c0a9c40 con 0x7fc99c13f750 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc99c13c7f0 con 0x7fc99c13f750 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc984001cf0 con 0x7fc99c13f750 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient(hunting): dump: 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.795 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 401950612 0 0) 0x7fc99c13bc90 con 0x7fc99c0a8340 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.195:6791/0 conn(0x7fc99c13f750 legacy=0x7fc99c1d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.195:6790/0 conn(0x7fc99c1422f0 legacy=0x7fc99c1d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient: _finish_hunting 0 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 monclient: found mon.d 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99c0aa0a0 con 0x7fc99c0a8340 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient: _finish_auth 0 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient: _check_auth_tickets 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9a249c640 5 monclient: authenticate success, global_id 5361 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9a249c640 10 monclient: _renew_subs 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9a249c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9a249c640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc99c13a4a0 con 0x7fc99c0a8340 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9a249c640 10 monclient: _renew_subs 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9a249c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:29.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9a249c640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc99c12cfc0 con 0x7fc99c0a8340 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc98c001a80 con 0x7fc99c0a8340 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc98c005740 con 0x7fc99c0a8340 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc99affd640 4 set_mon_vals no callback set 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.777+0000 7fc9997fa640 10 monclient: dump: 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.778+0000 7fc9a249c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.778+0000 7fc9a249c640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc9800065c0 con 0x7fc980002860 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.778+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fc98c011dc0 con 0x7fc99c0a8340 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.778+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(113..113 src has 1..113) ==== 3898+0+0 (unknown 1439973588 0 0) 0x7fc98c04e3b0 con 0x7fc99c0a8340 2024-09-13T10:33:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.778+0000 7fc9a0a39640 10 monclient: get_auth_request con 0x7fc97c040620 auth_method 0 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc993fff640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.181:6789/0 conn(0x7fc980002860 legacy=0x7fc980004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 453724060 0 0) 0x7fc9800065c0 con 0x7fc980002860 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 10 monclient(hunting): my global_id is 55278 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc99c13bc90 con 0x7fc980002860 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2694211679 0 0) 0x7fc99c13bc90 con 0x7fc980002860 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc9800065c0 con 0x7fc980002860 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc984004d10 con 0x7fc980002860 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:29.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 10 monclient: dump: 2024-09-13T10:33:29.801 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.804 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.804 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.804 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 845676379 0 0) 0x7fc9800065c0 con 0x7fc980002860 2024-09-13T10:33:29.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.780+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc98000a160 con 0x7fc980002860 2024-09-13T10:33:29.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.781+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc984007050 con 0x7fc980002860 2024-09-13T10:33:29.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.781+0000 7fc9997fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:29.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.781+0000 7fc9997fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:29.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.781+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.181:6789/0 conn(0x7fc980002860 legacy=0x7fc980004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.781+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.181:6789/0 conn(0x7fc980002860 legacy=0x7fc980004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:29.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.787+0000 7fc9a249c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:29.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.787+0000 7fc9a249c640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc980009e50 con 0x7fc980009110 2024-09-13T10:33:29.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.789+0000 7fc993fff640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.181:6789/0 conn(0x7fc980009110 legacy=0x7fc9800095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.789+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1091676304 0 0) 0x7fc980009e50 con 0x7fc980009110 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.789+0000 7fc9997fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.789+0000 7fc9997fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.789+0000 7fc9997fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.789+0000 7fc9997fa640 10 monclient(hunting): my global_id is 55287 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.789+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9800065c0 con 0x7fc980009110 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.789+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 337689236 0 0) 0x7fc9800065c0 con 0x7fc980009110 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc980009e50 con 0x7fc980009110 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc9840056f0 con 0x7fc980009110 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9997fa640 10 monclient: dump: 2024-09-13T10:33:29.808 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.809 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.810 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 766186062 0 0) 0x7fc980009e50 con 0x7fc980009110 2024-09-13T10:33:29.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc98000c3a0 con 0x7fc980009110 2024-09-13T10:33:29.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 3347518559) 0x7fc98400a070 con 0x7fc980009110 2024-09-13T10:33:29.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9997fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:29.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9997fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:29.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.181:6789/0 conn(0x7fc980009110 legacy=0x7fc9800095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9997fa640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.181:6789/0 conn(0x7fc980009110 legacy=0x7fc9800095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:29.810 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:29.810 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 224223, 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:29.811 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:29.812 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:29.813 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:29.814 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:29.815 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.816 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:29.817 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.818 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.820 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:29.820 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.820 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.820 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:29.820 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:29.820 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.820 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.820 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:29.821 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:29.822 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:29.825 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.826 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.828 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:29.829 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:33:29.830 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.830 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:29.830 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:29.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.830 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:29.830 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:29.830 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:33:29.830 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.830 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.830 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:29.830 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:29.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9a249c640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.195:6800/1839191919 conn(0x7fc97c040620 legacy=0x7fc97c042ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9a249c640 10 monclient: shutdown 2024-09-13T10:33:29.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9a249c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:29.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9a249c640 1 -- 172.21.15.181:0/2238099052 >> v1:172.21.15.181:6792/0 conn(0x7fc99c0a8340 legacy=0x7fc99c12c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9a0a39640 1 -- 172.21.15.181:0/2238099052 reap_dead start 2024-09-13T10:33:29.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9a0a39640 1 -- 172.21.15.181:0/2238099052 reap_dead start 2024-09-13T10:33:29.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9a249c640 1 -- 172.21.15.181:0/2238099052 shutdown_connections 2024-09-13T10:33:29.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9a249c640 1 -- 172.21.15.181:0/2238099052 >> 172.21.15.181:0/2238099052 conn(0x7fc99c0a6640 msgr2=0x7fc99c0a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:29.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9a249c640 1 -- 172.21.15.181:0/2238099052 shutdown_connections 2024-09-13T10:33:29.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.790+0000 7fc9a249c640 1 -- 172.21.15.181:0/2238099052 wait complete. 2024-09-13T10:33:29.833 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:29.833 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:33:29.833 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:33:29.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.929+0000 7f6aadc09640 10 monclient: get_monmap_and_config 2024-09-13T10:33:29.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.929+0000 7f6aadc09640 10 monclient: build_initial_monmap 2024-09-13T10:33:29.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.929+0000 7f6aadc09640 10 monclient: monmap: 2024-09-13T10:33:29.932 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:29.932 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.932 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:29.931003+0000 2024-09-13T10:33:29.932 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:29.931003+0000 2024-09-13T10:33:29.932 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:29.933 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.933 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:29.933 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:29.933 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:29.933 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:29.933 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:29.933 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:29.933 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:29.933 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:29.933 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:29.933 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 1 Processor -- start 2024-09-13T10:33:29.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 1 -- start start 2024-09-13T10:33:29.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 10 monclient: init 2024-09-13T10:33:29.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:29.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 10 monclient: _add_conns ranks=[6,5,8,4,3,7,2,1,0] 2024-09-13T10:33:29.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 10 monclient(hunting): picked mon.noname-d con 0x7f6aa80a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:29.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 10 monclient(hunting): picked mon.noname-h con 0x7f6aa80a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:29.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 10 monclient(hunting): picked mon.noname-e con 0x7f6aa813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:29.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa80a4bc0 con 0x7f6aa80a8340 2024-09-13T10:33:29.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa813a320 con 0x7f6aa80a6640 2024-09-13T10:33:29.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa80a8100 con 0x7f6aa813f750 2024-09-13T10:33:29.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:29.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aadc09640 10 monclient(hunting): authenticate will time out at 949.436924s 2024-09-13T10:33:29.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aa77fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f6aa80a6640 0x7f6aa8139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54264/0 (socket says 172.21.15.181:54264) 2024-09-13T10:33:29.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aa77fe640 1 -- 172.21.15.181:0/559996617 learned_addr learned my addr 172.21.15.181:0/559996617 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:29.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.930+0000 7f6aa7fff640 1 --1- 172.21.15.181:0/559996617 >> v1:172.21.15.181:6793/0 conn(0x7f6aa813f750 0x7f6aa8141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:37650/0 (socket says 172.21.15.181:37650) 2024-09-13T10:33:29.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa77fe640 1 -- 172.21.15.181:0/559996617 >> v1:172.21.15.181:6792/0 conn(0x7f6aa80a6640 legacy=0x7f6aa8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa7fff640 1 -- 172.21.15.181:0/559996617 >> v1:172.21.15.181:6793/0 conn(0x7f6aa813f750 legacy=0x7f6aa8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 1 -- 172.21.15.181:0/559996617 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479692144 0 0) 0x7f6aa80a8100 con 0x7f6aa813f750 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient(hunting): my global_id is 84212 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 1 -- 172.21.15.181:0/559996617 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a94003520 con 0x7f6aa813f750 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa6ffd640 1 -- 172.21.15.181:0/559996617 >> v1:172.21.15.195:6791/0 conn(0x7f6aa80a8340 legacy=0x7f6aa8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 1 -- 172.21.15.181:0/559996617 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3653250642 0 0) 0x7f6a94003520 con 0x7f6aa813f750 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 1 -- 172.21.15.181:0/559996617 >> v1:172.21.15.181:6792/0 conn(0x7f6aa80a6640 legacy=0x7f6aa8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 1 -- 172.21.15.181:0/559996617 >> v1:172.21.15.195:6791/0 conn(0x7f6aa80a8340 legacy=0x7f6aa8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 1 monclient: found mon.noname-e 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:29.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 1 -- 172.21.15.181:0/559996617 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa80a48e0 con 0x7f6aa813f750 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient: _finish_auth 0 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aadc09640 5 monclient: authenticate success, global_id 84212 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 1 -- 172.21.15.181:0/559996617 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6aa0001e60 con 0x7f6aa813f750 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aadc09640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient: dump: 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.942 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aadc09640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 1 -- 172.21.15.181:0/559996617 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6aa0004b60 con 0x7f6aa813f750 2024-09-13T10:33:29.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 1 -- 172.21.15.181:0/559996617 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6aa0005090 con 0x7f6aa813f750 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aadc09640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aadc09640 4 set_mon_vals no callback set 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.933+0000 7f6aa67fc640 10 monclient: dump: 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.944 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.934+0000 7f6aadc09640 10 monclient: shutdown 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.934+0000 7f6aadc09640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.934+0000 7f6aadc09640 1 -- 172.21.15.181:0/559996617 >> v1:172.21.15.181:6793/0 conn(0x7f6aa813f750 legacy=0x7f6aa8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.934+0000 7f6aadc09640 1 -- 172.21.15.181:0/559996617 shutdown_connections 2024-09-13T10:33:29.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.934+0000 7f6aadc09640 1 -- 172.21.15.181:0/559996617 >> 172.21.15.181:0/559996617 conn(0x7f6aa8077170 msgr2=0x7f6aa80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.934+0000 7f6aadc09640 1 -- 172.21.15.181:0/559996617 shutdown_connections 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.934+0000 7f6aadc09640 1 -- 172.21.15.181:0/559996617 wait complete. 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.934+0000 7f6aadc09640 10 monclient: build_initial_monmap 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.934+0000 7f6aadc09640 10 monclient: monmap: 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:29.946 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 1 Processor -- start 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 1 -- start start 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 10 monclient: init 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 10 monclient: _add_conns ranks=[6,2,8,3,5,4,1,0,7] 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 10 monclient(hunting): picked mon.noname-d con 0x7f6aa80a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:29.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 10 monclient(hunting): picked mon.noname-b con 0x7f6aa813f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:29.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 10 monclient(hunting): picked mon.noname-e con 0x7f6aa8142190 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:29.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa8142b20 con 0x7f6aa813f750 2024-09-13T10:33:29.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa813c540 con 0x7f6aa80a8340 2024-09-13T10:33:29.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa80aa030 con 0x7f6aa8142190 2024-09-13T10:33:29.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:29.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aadc09640 10 monclient(hunting): authenticate will time out at 949.441708s 2024-09-13T10:33:29.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aa77fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f6aa80a8340 0x7f6aa81ce650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54276/0 (socket says 172.21.15.181:54276) 2024-09-13T10:33:29.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.935+0000 7f6aa77fe640 1 -- 172.21.15.181:0/2149521375 learned_addr learned my addr 172.21.15.181:0/2149521375 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:29.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.937+0000 7f6aa77fe640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.181:6792/0 conn(0x7f6aa80a8340 legacy=0x7f6aa81ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.937+0000 7f6aa6ffd640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.181:6790/0 conn(0x7f6aa813f750 legacy=0x7f6aa81d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.937+0000 7f6aa7fff640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.181:6793/0 conn(0x7f6aa8142190 legacy=0x7f6aa81d6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2834673779 0 0) 0x7f6aa813c540 con 0x7f6aa80a8340 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): my global_id is 5370 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a88003550 con 0x7f6aa80a8340 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1821948408 0 0) 0x7f6aa8142b20 con 0x7f6aa813f750 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): my global_id is 64928 2024-09-13T10:33:29.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa813c540 con 0x7f6aa813f750 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1222619938 0 0) 0x7f6aa80aa030 con 0x7f6aa8142190 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): my global_id is 84221 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa8142b20 con 0x7f6aa8142190 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 40745412 0 0) 0x7f6a88003550 con 0x7f6aa80a8340 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6aa80aa030 con 0x7f6aa80a8340 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6a98001d40 con 0x7f6aa80a8340 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): dump: 2024-09-13T10:33:29.955 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.956 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 813753043 0 0) 0x7f6aa813c540 con 0x7f6aa813f750 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a88003550 con 0x7f6aa813f750 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 171311906 0 0) 0x7f6aa8142b20 con 0x7f6aa8142190 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6aa813c540 con 0x7f6aa8142190 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6a90003610 con 0x7f6aa813f750 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): dump: 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.957 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.958 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.958 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.958 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.958 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.958 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.958 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.958 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.958 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.958 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.958 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.958 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.958 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6aa00016a0 con 0x7f6aa8142190 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient(hunting): dump: 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.959 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1767836024 0 0) 0x7f6aa80aa030 con 0x7f6aa80a8340 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.181:6793/0 conn(0x7f6aa8142190 legacy=0x7f6aa81d6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.181:6790/0 conn(0x7f6aa813f750 legacy=0x7f6aa81d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 monclient: found mon.d 2024-09-13T10:33:29.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:29.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:29.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa80a9c40 con 0x7f6aa80a8340 2024-09-13T10:33:29.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient: _finish_auth 0 2024-09-13T10:33:29.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:33:29.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:29.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6aadc09640 5 monclient: authenticate success, global_id 5370 2024-09-13T10:33:29.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6aadc09640 10 monclient: _renew_subs 2024-09-13T10:33:29.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6aadc09640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:29.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6aadc09640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa813c260 con 0x7f6aa80a8340 2024-09-13T10:33:29.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6aadc09640 10 monclient: _renew_subs 2024-09-13T10:33:29.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6aadc09640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:29.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6aadc09640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f6aa81ced60 con 0x7f6aa80a8340 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6a98004c10 con 0x7f6aa80a8340 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6a98005180 con 0x7f6aa80a8340 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6aa5ffb640 4 set_mon_vals no callback set 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.938+0000 7f6a9ffff640 10 monclient: dump: 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.962 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.939+0000 7f6aadc09640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.939+0000 7f6aadc09640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6a8c0065c0 con 0x7f6a8c002860 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.939+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6a98005450 con 0x7f6aa80a8340 2024-09-13T10:33:29.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.939+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(113..113 src has 1..113) ==== 3898+0+0 (unknown 1439973588 0 0) 0x7f6a9804e460 con 0x7f6aa80a8340 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.940+0000 7f6aa7fff640 10 monclient: get_auth_request con 0x7f6a88040680 auth_method 0 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6aa6ffd640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.181:6790/0 conn(0x7f6a8c002860 legacy=0x7f6a8c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1538997421 0 0) 0x7f6a8c0065c0 con 0x7f6a8c002860 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6a9ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6a9ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6a9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6a9ffff640 10 monclient(hunting): my global_id is 64937 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa80aa030 con 0x7f6a8c002860 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2405552989 0 0) 0x7f6aa80aa030 con 0x7f6a8c002860 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a8c0065c0 con 0x7f6a8c002860 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6a90003e50 con 0x7f6a8c002860 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6a9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6a9ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.941+0000 7f6a9ffff640 10 monclient: dump: 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.965 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.942+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1132459180 0 0) 0x7f6a8c0065c0 con 0x7f6a8c002860 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.942+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a8c00a160 con 0x7f6a8c002860 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.942+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6a90004120 con 0x7f6a8c002860 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.942+0000 7f6a9ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.942+0000 7f6a9ffff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.942+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.181:6790/0 conn(0x7f6a8c002860 legacy=0x7f6a8c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.942+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.181:6790/0 conn(0x7f6a8c002860 legacy=0x7f6a8c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.948+0000 7f6aadc09640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.948+0000 7f6aadc09640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6a8c009e70 con 0x7f6a8c009130 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.950+0000 7f6aa6ffd640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.181:6790/0 conn(0x7f6a8c009130 legacy=0x7f6a8c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:29.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.950+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731825970 0 0) 0x7f6a8c009e70 con 0x7f6a8c009130 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.950+0000 7f6a9ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.950+0000 7f6a9ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.950+0000 7f6a9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.950+0000 7f6a9ffff640 10 monclient(hunting): my global_id is 64946 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.950+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a8c0065c0 con 0x7f6a8c009130 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2037551866 0 0) 0x7f6a8c0065c0 con 0x7f6a8c009130 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a8c009e70 con 0x7f6a8c009130 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6a90005b00 con 0x7f6a8c009130 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 10 monclient: dump: 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:29.967 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:29.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 534635908 0 0) 0x7f6a8c009e70 con 0x7f6a8c009130 2024-09-13T10:33:29.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6a8c00c3f0 con 0x7f6a8c009130 2024-09-13T10:33:29.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 1534415614) 0x7f6a90007d90 con 0x7f6a8c009130 2024-09-13T10:33:29.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:29.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:29.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.181:6790/0 conn(0x7f6a8c009130 legacy=0x7f6a8c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6a9ffff640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.181:6790/0 conn(0x7f6a8c009130 legacy=0x7f6a8c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:29.969 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:29.969 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:29.969 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 135856, 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:29.970 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:29.971 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:29.972 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:29.973 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:29.974 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:29.975 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.976 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.978 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:29.979 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.980 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.980 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.980 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:29.980 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.980 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.980 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.980 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:29.980 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:29.980 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.980 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.982 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:29.983 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.984 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.986 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:29.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:29.987 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:29.987 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.987 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:29.987 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:29.987 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:29.987 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:29.987 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:29.987 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.987 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.988 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:29.988 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:29.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.988 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:29.988 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:29.988 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:29.988 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.988 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:29.988 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:29.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:29.989 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:29.989 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:29.989 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:29.989 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:29.989 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:29.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:29.989 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:29.989 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:29.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6aadc09640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6a88040680 legacy=0x7f6a88042b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6aadc09640 10 monclient: shutdown 2024-09-13T10:33:29.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6aadc09640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:29.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6aadc09640 1 -- 172.21.15.181:0/2149521375 >> v1:172.21.15.181:6792/0 conn(0x7f6aa80a8340 legacy=0x7f6aa81ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:29.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6aa7fff640 1 -- 172.21.15.181:0/2149521375 reap_dead start 2024-09-13T10:33:29.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6aa7fff640 1 -- 172.21.15.181:0/2149521375 reap_dead start 2024-09-13T10:33:29.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6aadc09640 1 -- 172.21.15.181:0/2149521375 shutdown_connections 2024-09-13T10:33:29.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6aadc09640 1 -- 172.21.15.181:0/2149521375 >> 172.21.15.181:0/2149521375 conn(0x7f6aa80a6640 msgr2=0x7f6aa80a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:29.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6aadc09640 1 -- 172.21.15.181:0/2149521375 shutdown_connections 2024-09-13T10:33:29.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:29.951+0000 7f6aadc09640 1 -- 172.21.15.181:0/2149521375 wait complete. 2024-09-13T10:33:29.992 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:29.992 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:33:29.992 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:33:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.089+0000 7f0934b17640 10 monclient: get_monmap_and_config 2024-09-13T10:33:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.089+0000 7f0934b17640 10 monclient: build_initial_monmap 2024-09-13T10:33:30.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.089+0000 7f0934b17640 10 monclient: monmap: 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:30.090723+0000 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:30.090723+0000 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:30.092 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:30.093 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:30.093 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.089+0000 7f0934b17640 1 Processor -- start 2024-09-13T10:33:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.089+0000 7f0934b17640 1 -- start start 2024-09-13T10:33:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.089+0000 7f0934b17640 10 monclient: init 2024-09-13T10:33:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.090+0000 7f0934b17640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.090+0000 7f0934b17640 10 monclient: _add_conns ranks=[2,1,6,3,8,7,0,5,4] 2024-09-13T10:33:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.090+0000 7f0934b17640 10 monclient(hunting): picked mon.noname-b con 0x7f09300a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.090+0000 7f0934b17640 10 monclient(hunting): picked mon.noname-f con 0x7f09300a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:30.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.090+0000 7f0934b17640 10 monclient(hunting): picked mon.noname-d con 0x7f093013f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:30.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.090+0000 7f0934b17640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09300a5fe0 con 0x7f09300a6ab0 2024-09-13T10:33:30.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.090+0000 7f0934b17640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09300a8080 con 0x7f09300a66d0 2024-09-13T10:33:30.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.090+0000 7f0934b17640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09300a42c0 con 0x7f093013f9a0 2024-09-13T10:33:30.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.090+0000 7f0934b17640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:30.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.090+0000 7f0934b17640 10 monclient(hunting): authenticate will time out at 949.596370s 2024-09-13T10:33:30.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.090+0000 7f092e59c640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f09300a66d0 0x7f09300a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:43154/0 (socket says 172.21.15.181:43154) 2024-09-13T10:33:30.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.090+0000 7f092e59c640 1 -- 172.21.15.181:0/373827848 learned_addr learned my addr 172.21.15.181:0/373827848 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092e59c640 1 -- 172.21.15.181:0/373827848 >> v1:172.21.15.181:6790/0 conn(0x7f09300a66d0 legacy=0x7f09300a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092ed9d640 1 -- 172.21.15.181:0/373827848 >> v1:172.21.15.181:6792/0 conn(0x7f093013f9a0 legacy=0x7f0930141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092d59a640 1 -- 172.21.15.181:0/373827848 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 48790572 0 0) 0x7f09300a8080 con 0x7f09300a66d0 2024-09-13T10:33:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092d59a640 10 monclient(hunting): my global_id is 64955 2024-09-13T10:33:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092d59a640 1 -- 172.21.15.181:0/373827848 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0918003520 con 0x7f09300a66d0 2024-09-13T10:33:30.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092d59a640 1 -- 172.21.15.181:0/373827848 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4143915990 0 0) 0x7f09300a42c0 con 0x7f093013f9a0 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092d59a640 10 monclient(hunting): my global_id is 5379 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092d59a640 1 -- 172.21.15.181:0/373827848 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09300a8080 con 0x7f093013f9a0 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.092+0000 7f092dd9b640 1 -- 172.21.15.181:0/373827848 >> v1:172.21.15.195:6789/0 conn(0x7f09300a6ab0 legacy=0x7f09300a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 1 -- 172.21.15.181:0/373827848 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 169229541 0 0) 0x7f0918003520 con 0x7f09300a66d0 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 1 -- 172.21.15.181:0/373827848 >> v1:172.21.15.181:6792/0 conn(0x7f093013f9a0 legacy=0x7f0930141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 1 -- 172.21.15.181:0/373827848 >> v1:172.21.15.195:6789/0 conn(0x7f09300a6ab0 legacy=0x7f09300a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 10 monclient: _finish_hunting 0 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 1 monclient: found mon.noname-b 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:30.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 1 -- 172.21.15.181:0/373827848 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09301464e0 con 0x7f09300a66d0 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 10 monclient: _finish_auth 0 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 10 monclient: _check_auth_tickets 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f0934b17640 5 monclient: authenticate success, global_id 64955 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f0934b17640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 1 -- 172.21.15.181:0/373827848 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0928001ba0 con 0x7f09300a66d0 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 10 monclient: dump: 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.101 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f0934b17640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 1 -- 172.21.15.181:0/373827848 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09280048a0 con 0x7f09300a66d0 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 1 -- 172.21.15.181:0/373827848 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0928004e10 con 0x7f09300a66d0 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f0934b17640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f0934b17640 4 set_mon_vals no callback set 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f092d59a640 10 monclient: dump: 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.103 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f0934b17640 10 monclient: shutdown 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f0934b17640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f0934b17640 1 -- 172.21.15.181:0/373827848 >> v1:172.21.15.181:6790/0 conn(0x7f09300a66d0 legacy=0x7f09300a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f0934b17640 1 -- 172.21.15.181:0/373827848 shutdown_connections 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f0934b17640 1 -- 172.21.15.181:0/373827848 >> 172.21.15.181:0/373827848 conn(0x7f09300abcd0 msgr2=0x7f09300ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f0934b17640 1 -- 172.21.15.181:0/373827848 shutdown_connections 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.093+0000 7f0934b17640 1 -- 172.21.15.181:0/373827848 wait complete. 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.094+0000 7f0934b17640 10 monclient: build_initial_monmap 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.094+0000 7f0934b17640 10 monclient: monmap: 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:30.105 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.094+0000 7f0934b17640 1 Processor -- start 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.094+0000 7f0934b17640 1 -- start start 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.094+0000 7f0934b17640 10 monclient: init 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.095+0000 7f0934b17640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.095+0000 7f0934b17640 10 monclient: _add_conns ranks=[6,8,3,0,4,7,5,2,1] 2024-09-13T10:33:30.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.095+0000 7f0934b17640 10 monclient(hunting): picked mon.noname-d con 0x7f09300a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:30.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.095+0000 7f0934b17640 10 monclient(hunting): picked mon.noname-e con 0x7f09300a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:30.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.095+0000 7f0934b17640 10 monclient(hunting): picked mon.noname-g con 0x7f093013f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:30.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.095+0000 7f0934b17640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f093013e220 con 0x7f093013f9a0 2024-09-13T10:33:30.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.095+0000 7f0934b17640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0930068bd0 con 0x7f09300a66d0 2024-09-13T10:33:30.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.095+0000 7f0934b17640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f093013c1d0 con 0x7f09300a6ab0 2024-09-13T10:33:30.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.095+0000 7f0934b17640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:30.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.095+0000 7f0934b17640 10 monclient(hunting): authenticate will time out at 949.601435s 2024-09-13T10:33:30.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.095+0000 7f092e59c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f09300a66d0 0x7f093013b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54288/0 (socket says 172.21.15.181:54288) 2024-09-13T10:33:30.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.095+0000 7f092e59c640 1 -- 172.21.15.181:0/4124719565 learned_addr learned my addr 172.21.15.181:0/4124719565 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:30.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f092e59c640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.181:6792/0 conn(0x7f09300a66d0 legacy=0x7f093013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f092dd9b640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.181:6793/0 conn(0x7f09300a6ab0 legacy=0x7f093013bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f092ed9d640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.195:6790/0 conn(0x7f093013f9a0 legacy=0x7f09301d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404502402 0 0) 0x7f0930068bd0 con 0x7f09300a66d0 2024-09-13T10:33:30.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): my global_id is 5388 2024-09-13T10:33:30.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0910003520 con 0x7f09300a66d0 2024-09-13T10:33:30.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183287276 0 0) 0x7f093013c1d0 con 0x7f09300a6ab0 2024-09-13T10:33:30.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): my global_id is 84230 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0930068bd0 con 0x7f09300a6ab0 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4213064524 0 0) 0x7f093013e220 con 0x7f093013f9a0 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): my global_id is 5367 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f093013c1d0 con 0x7f093013f9a0 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2364629815 0 0) 0x7f0910003520 con 0x7f09300a66d0 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f093013e220 con 0x7f09300a66d0 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0928001b60 con 0x7f09300a66d0 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:30.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.097+0000 7f091effd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient(hunting): dump: 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.114 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4139122414 0 0) 0x7f0930068bd0 con 0x7f09300a6ab0 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0910003520 con 0x7f09300a6ab0 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0924001ce0 con 0x7f09300a6ab0 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient(hunting): dump: 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.115 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4151372036 0 0) 0x7f093013e220 con 0x7f09300a66d0 2024-09-13T10:33:30.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.181:6793/0 conn(0x7f09300a6ab0 legacy=0x7f093013bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.195:6790/0 conn(0x7f093013f9a0 legacy=0x7f09301d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 1 monclient: found mon.d 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093013cd30 con 0x7f09300a66d0 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient: _finish_auth 0 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f0934b17640 5 monclient: authenticate success, global_id 5388 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f0934b17640 10 monclient: _renew_subs 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f0934b17640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f0934b17640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f093013f090 con 0x7f09300a66d0 2024-09-13T10:33:30.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f0934b17640 10 monclient: _renew_subs 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f0934b17640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f0934b17640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f09301374e0 con 0x7f09300a66d0 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0928001320 con 0x7f09300a66d0 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f09280057f0 con 0x7f09300a66d0 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f092cd99640 4 set_mon_vals no callback set 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.098+0000 7f091effd640 10 monclient: dump: 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.118 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.099+0000 7f0934b17640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.099+0000 7f0934b17640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f09140065c0 con 0x7f0914002860 2024-09-13T10:33:30.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.099+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0928011e70 con 0x7f09300a66d0 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.099+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(113..113 src has 1..113) ==== 3898+0+0 (unknown 1439973588 0 0) 0x7f092804e4f0 con 0x7f09300a66d0 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.099+0000 7f092ed9d640 10 monclient: get_auth_request con 0x7f0910040180 auth_method 0 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f092dd9b640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.181:6791/0 conn(0x7f0914002860 legacy=0x7f0914004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754482475 0 0) 0x7f09140065c0 con 0x7f0914002860 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 10 monclient(hunting): my global_id is 5494 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f093013e220 con 0x7f0914002860 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2184288068 0 0) 0x7f093013e220 con 0x7f0914002860 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09140065c0 con 0x7f0914002860 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0924003d10 con 0x7f0914002860 2024-09-13T10:33:30.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 10 monclient: dump: 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.121 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 563410492 0 0) 0x7f09140065c0 con 0x7f0914002860 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.101+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f091400a160 con 0x7f0914002860 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.102+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0924003fc0 con 0x7f0914002860 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.102+0000 7f091effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.102+0000 7f091effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.102+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.181:6791/0 conn(0x7f0914002860 legacy=0x7f0914004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.102+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.181:6791/0 conn(0x7f0914002860 legacy=0x7f0914004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.108+0000 7f0934b17640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:30.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.108+0000 7f0934b17640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0914009e50 con 0x7f0914009110 2024-09-13T10:33:30.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f092dd9b640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.181:6791/0 conn(0x7f0914009110 legacy=0x7f09140095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099234831 0 0) 0x7f0914009e50 con 0x7f0914009110 2024-09-13T10:33:30.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f091effd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f091effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f091effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f091effd640 10 monclient(hunting): my global_id is 5503 2024-09-13T10:33:30.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09140065c0 con 0x7f0914009110 2024-09-13T10:33:30.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1204181671 0 0) 0x7f09140065c0 con 0x7f0914009110 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0914009e50 con 0x7f0914009110 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0924004470 con 0x7f0914009110 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f091effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f091effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.110+0000 7f091effd640 10 monclient: dump: 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.125 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2512109221 0 0) 0x7f0914009e50 con 0x7f0914009110 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f091400c3a0 con 0x7f0914009110 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 84411979) 0x7f0924007b80 con 0x7f0914009110 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f091effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f091effd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:30.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.181:6791/0 conn(0x7f0914009110 legacy=0x7f09140095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f091effd640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.181:6791/0 conn(0x7f0914009110 legacy=0x7f09140095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:30.127 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 224561, 2024-09-13T10:33:30.127 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:30.128 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:30.129 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:30.130 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:30.131 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:30.132 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.133 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.134 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.135 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.136 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:30.139 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.140 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.143 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:30.144 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:30.145 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.146 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.147 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:30.147 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:30.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f0934b17640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0910040180 legacy=0x7f0910042640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f0934b17640 10 monclient: shutdown 2024-09-13T10:33:30.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f0934b17640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:30.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f0934b17640 1 -- 172.21.15.181:0/4124719565 >> v1:172.21.15.181:6792/0 conn(0x7f09300a66d0 legacy=0x7f093013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f092ed9d640 1 -- 172.21.15.181:0/4124719565 reap_dead start 2024-09-13T10:33:30.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f092ed9d640 1 -- 172.21.15.181:0/4124719565 reap_dead start 2024-09-13T10:33:30.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f0934b17640 1 -- 172.21.15.181:0/4124719565 shutdown_connections 2024-09-13T10:33:30.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f0934b17640 1 -- 172.21.15.181:0/4124719565 >> 172.21.15.181:0/4124719565 conn(0x7f09300abcd0 msgr2=0x7f09300a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:30.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f0934b17640 1 -- 172.21.15.181:0/4124719565 shutdown_connections 2024-09-13T10:33:30.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.111+0000 7f0934b17640 1 -- 172.21.15.181:0/4124719565 wait complete. 2024-09-13T10:33:30.150 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:30.150 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:33:30.150 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:33:30.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.246+0000 7fccc1324640 10 monclient: get_monmap_and_config 2024-09-13T10:33:30.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.246+0000 7fccc1324640 10 monclient: build_initial_monmap 2024-09-13T10:33:30.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.246+0000 7fccc1324640 10 monclient: monmap: 2024-09-13T10:33:30.249 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:30.249 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.249 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:30.248354+0000 2024-09-13T10:33:30.249 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:30.248354+0000 2024-09-13T10:33:30.249 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:30.250 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.250 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:30.250 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:30.250 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:30.250 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:30.250 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:30.250 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:30.250 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:30.250 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:30.250 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:30.250 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 1 Processor -- start 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 1 -- start start 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 10 monclient: init 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 10 monclient: _add_conns ranks=[2,1,4,3,0,6,7,5,8] 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 10 monclient(hunting): picked mon.noname-b con 0x7fccbc0a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 10 monclient(hunting): picked mon.noname-f con 0x7fccbc0a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 10 monclient(hunting): picked mon.noname-c con 0x7fccbc13f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccbc0a5fe0 con 0x7fccbc0a6ab0 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccbc0a8080 con 0x7fccbc0a66d0 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccbc0a42c0 con 0x7fccbc13f9a0 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccc1324640 10 monclient(hunting): authenticate will time out at 949.753903s 2024-09-13T10:33:30.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.247+0000 7fccbaffd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fccbc0a66d0 0x7fccbc0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:43170/0 (socket says 172.21.15.181:43170) 2024-09-13T10:33:30.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.248+0000 7fccbaffd640 1 -- 172.21.15.181:0/3712973991 learned_addr learned my addr 172.21.15.181:0/3712973991 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:30.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccbb7fe640 1 -- 172.21.15.181:0/3712973991 >> v1:172.21.15.181:6791/0 conn(0x7fccbc13f9a0 legacy=0x7fccbc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccbaffd640 1 -- 172.21.15.181:0/3712973991 >> v1:172.21.15.181:6790/0 conn(0x7fccbc0a66d0 legacy=0x7fccbc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 1 -- 172.21.15.181:0/3712973991 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3774756412 0 0) 0x7fccbc0a42c0 con 0x7fccbc13f9a0 2024-09-13T10:33:30.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient(hunting): my global_id is 5512 2024-09-13T10:33:30.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 1 -- 172.21.15.181:0/3712973991 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcca4003520 con 0x7fccbc13f9a0 2024-09-13T10:33:30.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 1 -- 172.21.15.181:0/3712973991 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 855702511 0 0) 0x7fccbc0a8080 con 0x7fccbc0a66d0 2024-09-13T10:33:30.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient(hunting): my global_id is 64964 2024-09-13T10:33:30.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 1 -- 172.21.15.181:0/3712973991 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccbc0a42c0 con 0x7fccbc0a66d0 2024-09-13T10:33:30.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccba7fc640 1 -- 172.21.15.181:0/3712973991 >> v1:172.21.15.195:6789/0 conn(0x7fccbc0a6ab0 legacy=0x7fccbc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 1 -- 172.21.15.181:0/3712973991 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3185258424 0 0) 0x7fcca4003520 con 0x7fccbc13f9a0 2024-09-13T10:33:30.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 1 -- 172.21.15.181:0/3712973991 >> v1:172.21.15.181:6790/0 conn(0x7fccbc0a66d0 legacy=0x7fccbc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 1 -- 172.21.15.181:0/3712973991 >> v1:172.21.15.195:6789/0 conn(0x7fccbc0a6ab0 legacy=0x7fccbc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:33:30.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 1 monclient: found mon.noname-c 2024-09-13T10:33:30.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:30.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:33:30.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 1 -- 172.21.15.181:0/3712973991 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccbc1464e0 con 0x7fccbc13f9a0 2024-09-13T10:33:30.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient: _finish_auth 0 2024-09-13T10:33:30.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:33:30.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:30.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 1 -- 172.21.15.181:0/3712973991 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fccac001ea0 con 0x7fccbc13f9a0 2024-09-13T10:33:30.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccc1324640 5 monclient: authenticate success, global_id 5512 2024-09-13T10:33:30.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccc1324640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:30.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:30.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient: dump: 2024-09-13T10:33:30.259 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.259 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.259 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.259 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.259 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.259 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccc1324640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 1 -- 172.21.15.181:0/3712973991 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fccac003990 con 0x7fccbc13f9a0 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:30.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccc1324640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 1 -- 172.21.15.181:0/3712973991 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fccac003f00 con 0x7fccbc13f9a0 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccc1324640 4 set_mon_vals no callback set 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.250+0000 7fccb9ffb640 10 monclient: dump: 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.261 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.251+0000 7fccc1324640 10 monclient: shutdown 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.251+0000 7fccc1324640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.251+0000 7fccc1324640 1 -- 172.21.15.181:0/3712973991 >> v1:172.21.15.181:6791/0 conn(0x7fccbc13f9a0 legacy=0x7fccbc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.251+0000 7fccc1324640 1 -- 172.21.15.181:0/3712973991 shutdown_connections 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.251+0000 7fccc1324640 1 -- 172.21.15.181:0/3712973991 >> 172.21.15.181:0/3712973991 conn(0x7fccbc0abcd0 msgr2=0x7fccbc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.251+0000 7fccc1324640 1 -- 172.21.15.181:0/3712973991 shutdown_connections 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.251+0000 7fccc1324640 1 -- 172.21.15.181:0/3712973991 wait complete. 2024-09-13T10:33:30.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.251+0000 7fccc1324640 10 monclient: build_initial_monmap 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.251+0000 7fccc1324640 10 monclient: monmap: 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:30.263 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 1 Processor -- start 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 1 -- start start 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 10 monclient: init 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 10 monclient: _add_conns ranks=[0,1,6,8,7,3,2,4,5] 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 10 monclient(hunting): picked mon.noname-a con 0x7fccbc0a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 10 monclient(hunting): picked mon.noname-f con 0x7fccbc0a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 10 monclient(hunting): picked mon.noname-d con 0x7fccbc13f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccbc13e2e0 con 0x7fccbc0a66d0 2024-09-13T10:33:30.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccbc068680 con 0x7fccbc0a6ab0 2024-09-13T10:33:30.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccbc13c150 con 0x7fccbc13f9a0 2024-09-13T10:33:30.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:30.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccc1324640 10 monclient(hunting): authenticate will time out at 949.758768s 2024-09-13T10:33:30.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccbaffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fccbc0a66d0 0x7fccbc13b330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60638/0 (socket says 172.21.15.181:60638) 2024-09-13T10:33:30.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccbaffd640 1 -- 172.21.15.181:0/3659461473 learned_addr learned my addr 172.21.15.181:0/3659461473 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:30.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.252+0000 7fccbb7fe640 1 --1- 172.21.15.181:0/3659461473 >> v1:172.21.15.181:6792/0 conn(0x7fccbc13f9a0 0x7fccbc1d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54294/0 (socket says 172.21.15.181:54294) 2024-09-13T10:33:30.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.254+0000 7fccbb7fe640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.181:6792/0 conn(0x7fccbc13f9a0 legacy=0x7fccbc1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fccbaffd640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.181:6789/0 conn(0x7fccbc0a66d0 legacy=0x7fccbc13b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426413352 0 0) 0x7fccbc13c150 con 0x7fccbc13f9a0 2024-09-13T10:33:30.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): my global_id is 5397 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcca8003520 con 0x7fccbc13f9a0 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fccba7fc640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.195:6789/0 conn(0x7fccbc0a6ab0 legacy=0x7fccbc13ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204429611 0 0) 0x7fccbc13e2e0 con 0x7fccbc0a66d0 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): my global_id is 55296 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccbc13c150 con 0x7fccbc0a66d0 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 642224367 0 0) 0x7fccbc068680 con 0x7fccbc0a6ab0 2024-09-13T10:33:30.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): my global_id is 55549 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccbc13e2e0 con 0x7fccbc0a6ab0 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1692640964 0 0) 0x7fcca8003520 con 0x7fccbc13f9a0 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fccbc068680 con 0x7fccbc13f9a0 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fccac003e80 con 0x7fccbc13f9a0 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): dump: 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.271 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:30.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2111293728 0 0) 0x7fccbc13c150 con 0x7fccbc0a66d0 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcca8003520 con 0x7fccbc0a66d0 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fccb40047e0 con 0x7fccbc0a66d0 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient(hunting): dump: 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.273 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3562720251 0 0) 0x7fccbc068680 con 0x7fccbc13f9a0 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.195:6789/0 conn(0x7fccbc0a6ab0 legacy=0x7fccbc13ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.181:6789/0 conn(0x7fccbc0a66d0 legacy=0x7fccbc13b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient: _finish_hunting 0 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 monclient: found mon.d 2024-09-13T10:33:30.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccbc13cdf0 con 0x7fccbc13f9a0 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient: _finish_auth 0 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient: _check_auth_tickets 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fccc1324640 5 monclient: authenticate success, global_id 5397 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fccc1324640 10 monclient: _renew_subs 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fccc1324640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fccc1324640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fccbc13f150 con 0x7fccbc13f9a0 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fccc1324640 10 monclient: _renew_subs 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fccc1324640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fccc1324640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fccbc1374e0 con 0x7fccbc13f9a0 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fccac001e40 con 0x7fccbc13f9a0 2024-09-13T10:33:30.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fccac004690 con 0x7fccbc13f9a0 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fcca37fe640 10 monclient: dump: 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.276 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.255+0000 7fccb97fa640 4 set_mon_vals no callback set 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.256+0000 7fccc1324640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.256+0000 7fccc1324640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fccbc0a3240 con 0x7fccbc13f570 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.256+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fccac012020 con 0x7fccbc13f9a0 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.256+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(113..113 src has 1..113) ==== 3898+0+0 (unknown 1439973588 0 0) 0x7fccac04e5a0 con 0x7fccbc13f9a0 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.257+0000 7fccba7fc640 10 monclient: get_auth_request con 0x7fcca8040230 auth_method 0 2024-09-13T10:33:30.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.258+0000 7fccbaffd640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.181:6792/0 conn(0x7fccbc13f570 legacy=0x7fccbc13fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.258+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827558468 0 0) 0x7fccbc0a3240 con 0x7fccbc13f570 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.258+0000 7fcca37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.258+0000 7fcca37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.258+0000 7fcca37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.258+0000 7fcca37fe640 10 monclient(hunting): my global_id is 5406 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.258+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccbc068680 con 0x7fccbc13f570 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2443668611 0 0) 0x7fccbc068680 con 0x7fccbc13f570 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fccbc0a3240 con 0x7fccbc13f570 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fccb4004f30 con 0x7fccbc13f570 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 10 monclient: dump: 2024-09-13T10:33:30.278 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.279 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.280 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3836034082 0 0) 0x7fccbc0a3240 con 0x7fccbc13f570 2024-09-13T10:33:30.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccbc0008d0 con 0x7fccbc13f570 2024-09-13T10:33:30.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fccb4006510 con 0x7fccbc13f570 2024-09-13T10:33:30.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:30.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:30.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.181:6792/0 conn(0x7fccbc13f570 legacy=0x7fccbc13fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.259+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.181:6792/0 conn(0x7fccbc13f570 legacy=0x7fccbc13fd80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:30.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.265+0000 7fccc1324640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:30.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.265+0000 7fccc1324640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fccbc1436c0 con 0x7fccbc02e200 2024-09-13T10:33:30.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.267+0000 7fccbaffd640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.181:6792/0 conn(0x7fccbc02e200 legacy=0x7fccbc140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.267+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1930892189 0 0) 0x7fccbc1436c0 con 0x7fccbc02e200 2024-09-13T10:33:30.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.267+0000 7fcca37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.267+0000 7fcca37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.267+0000 7fcca37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.267+0000 7fcca37fe640 10 monclient(hunting): my global_id is 5415 2024-09-13T10:33:30.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.267+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccbc0a3240 con 0x7fccbc02e200 2024-09-13T10:33:30.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3018436741 0 0) 0x7fccbc0a3240 con 0x7fccbc02e200 2024-09-13T10:33:30.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fccbc1436c0 con 0x7fccbc02e200 2024-09-13T10:33:30.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fccb40054e0 con 0x7fccbc02e200 2024-09-13T10:33:30.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:30.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 10 monclient: dump: 2024-09-13T10:33:30.283 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.283 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.283 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.283 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.283 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1396363620 0 0) 0x7fccbc1436c0 con 0x7fccbc02e200 2024-09-13T10:33:30.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fccbc02e5e0 con 0x7fccbc02e200 2024-09-13T10:33:30.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 3813903278) 0x7fccb4006760 con 0x7fccbc02e200 2024-09-13T10:33:30.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:30.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:30.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.181:6792/0 conn(0x7fccbc02e200 legacy=0x7fccbc140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fcca37fe640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.181:6792/0 conn(0x7fccbc02e200 legacy=0x7fccbc140490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:30.285 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:30.285 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:30.285 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:30.285 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:30.285 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 224712, 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:33:30.286 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:30.287 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:30.288 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:30.289 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:30.290 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:30.291 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:30.291 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:30.291 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.291 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:30.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.291 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:30.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.291 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:30.291 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:30.291 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.291 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.293 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:30.294 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:30.295 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:30.297 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:30.298 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.299 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:30.301 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.302 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:30.303 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:30.304 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:30.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fccc1324640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.195:6800/1839191919 conn(0x7fcca8040230 legacy=0x7fcca80426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fccc1324640 10 monclient: shutdown 2024-09-13T10:33:30.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fccc1324640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:30.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fccc1324640 1 -- 172.21.15.181:0/3659461473 >> v1:172.21.15.181:6792/0 conn(0x7fccbc13f9a0 legacy=0x7fccbc1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fccbb7fe640 1 -- 172.21.15.181:0/3659461473 reap_dead start 2024-09-13T10:33:30.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fccbb7fe640 1 -- 172.21.15.181:0/3659461473 reap_dead start 2024-09-13T10:33:30.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fccc1324640 1 -- 172.21.15.181:0/3659461473 shutdown_connections 2024-09-13T10:33:30.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.268+0000 7fccc1324640 1 -- 172.21.15.181:0/3659461473 >> 172.21.15.181:0/3659461473 conn(0x7fccbc0abcd0 msgr2=0x7fccbc0a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:30.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.269+0000 7fccc1324640 1 -- 172.21.15.181:0/3659461473 shutdown_connections 2024-09-13T10:33:30.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.269+0000 7fccc1324640 1 -- 172.21.15.181:0/3659461473 wait complete. 2024-09-13T10:33:30.307 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:30.307 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:33:30.307 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:33:30.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.403+0000 7f99c5aa9640 10 monclient: get_monmap_and_config 2024-09-13T10:33:30.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.403+0000 7f99c5aa9640 10 monclient: build_initial_monmap 2024-09-13T10:33:30.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.403+0000 7f99c5aa9640 10 monclient: monmap: 2024-09-13T10:33:30.406 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:30.406 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.406 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:30.405387+0000 2024-09-13T10:33:30.406 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:30.405387+0000 2024-09-13T10:33:30.406 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:30.407 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.407 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:30.407 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:30.407 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:30.407 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:30.407 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:30.407 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:30.407 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:30.407 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:30.407 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:30.407 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.404+0000 7f99c5aa9640 1 Processor -- start 2024-09-13T10:33:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.404+0000 7f99c5aa9640 1 -- start start 2024-09-13T10:33:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.404+0000 7f99c5aa9640 10 monclient: init 2024-09-13T10:33:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.404+0000 7f99c5aa9640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.405+0000 7f99c5aa9640 10 monclient: _add_conns ranks=[3,6,7,2,4,8,0,1,5] 2024-09-13T10:33:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.405+0000 7f99c5aa9640 10 monclient(hunting): picked mon.noname-g con 0x7f99c00a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.405+0000 7f99c5aa9640 10 monclient(hunting): picked mon.noname-d con 0x7f99c00a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.405+0000 7f99c5aa9640 10 monclient(hunting): picked mon.noname-i con 0x7f99c013f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.405+0000 7f99c5aa9640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99c00a4bc0 con 0x7f99c00a6640 2024-09-13T10:33:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.405+0000 7f99c5aa9640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99c013a320 con 0x7f99c00a8340 2024-09-13T10:33:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.405+0000 7f99c5aa9640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99c00a8100 con 0x7f99c013f750 2024-09-13T10:33:30.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.405+0000 7f99c5aa9640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:30.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.405+0000 7f99c5aa9640 10 monclient(hunting): authenticate will time out at 949.911112s 2024-09-13T10:33:30.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.405+0000 7f99beffd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f99c00a8340 0x7f99c0139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54312/0 (socket says 172.21.15.181:54312) 2024-09-13T10:33:30.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.405+0000 7f99beffd640 1 -- 172.21.15.181:0/2359260356 learned_addr learned my addr 172.21.15.181:0/2359260356 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:30.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99beffd640 1 -- 172.21.15.181:0/2359260356 >> v1:172.21.15.181:6792/0 conn(0x7f99c00a8340 legacy=0x7f99c0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 1 -- 172.21.15.181:0/2359260356 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 898458322 0 0) 0x7f99c013a320 con 0x7f99c00a8340 2024-09-13T10:33:30.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient(hunting): my global_id is 5424 2024-09-13T10:33:30.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 1 -- 172.21.15.181:0/2359260356 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99a8003520 con 0x7f99c00a8340 2024-09-13T10:33:30.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99bf7fe640 1 -- 172.21.15.181:0/2359260356 >> v1:172.21.15.195:6790/0 conn(0x7f99c00a6640 legacy=0x7f99c0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99bffff640 1 -- 172.21.15.181:0/2359260356 >> v1:172.21.15.195:6792/0 conn(0x7f99c013f750 legacy=0x7f99c0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 1 -- 172.21.15.181:0/2359260356 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4192310380 0 0) 0x7f99a8003520 con 0x7f99c00a8340 2024-09-13T10:33:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 1 -- 172.21.15.181:0/2359260356 >> v1:172.21.15.195:6792/0 conn(0x7f99c013f750 legacy=0x7f99c0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 1 -- 172.21.15.181:0/2359260356 >> v1:172.21.15.195:6790/0 conn(0x7f99c00a6640 legacy=0x7f99c0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:33:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 1 monclient: found mon.noname-d 2024-09-13T10:33:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:33:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 1 -- 172.21.15.181:0/2359260356 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c00a48e0 con 0x7f99c00a8340 2024-09-13T10:33:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient: _finish_auth 0 2024-09-13T10:33:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:33:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:30.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99c5aa9640 5 monclient: authenticate success, global_id 5424 2024-09-13T10:33:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99c5aa9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 1 -- 172.21.15.181:0/2359260356 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f99b4001ae0 con 0x7f99c00a8340 2024-09-13T10:33:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient: dump: 2024-09-13T10:33:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.416 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99c5aa9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 1 -- 172.21.15.181:0/2359260356 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f99b40048a0 con 0x7f99c00a8340 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:30.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 1 -- 172.21.15.181:0/2359260356 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f99b4004e10 con 0x7f99c00a8340 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99c5aa9640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99c5aa9640 4 set_mon_vals no callback set 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.407+0000 7f99be7fc640 10 monclient: dump: 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.418 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.419 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.419 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.419 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.419 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.419 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.419 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.419 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.408+0000 7f99c5aa9640 10 monclient: shutdown 2024-09-13T10:33:30.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.408+0000 7f99c5aa9640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:30.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.408+0000 7f99c5aa9640 1 -- 172.21.15.181:0/2359260356 >> v1:172.21.15.181:6792/0 conn(0x7f99c00a8340 legacy=0x7f99c0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.408+0000 7f99c5aa9640 1 -- 172.21.15.181:0/2359260356 shutdown_connections 2024-09-13T10:33:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.408+0000 7f99c5aa9640 1 -- 172.21.15.181:0/2359260356 >> 172.21.15.181:0/2359260356 conn(0x7f99c0077170 msgr2=0x7f99c00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.408+0000 7f99c5aa9640 1 -- 172.21.15.181:0/2359260356 shutdown_connections 2024-09-13T10:33:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.408+0000 7f99c5aa9640 1 -- 172.21.15.181:0/2359260356 wait complete. 2024-09-13T10:33:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.408+0000 7f99c5aa9640 10 monclient: build_initial_monmap 2024-09-13T10:33:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.408+0000 7f99c5aa9640 10 monclient: monmap: 2024-09-13T10:33:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:30.420 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:30.421 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 1 Processor -- start 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 1 -- start start 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 10 monclient: init 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 10 monclient: _add_conns ranks=[5,7,4,6,8,1,3,2,0] 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 10 monclient(hunting): picked mon.noname-h con 0x7f99c00a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 10 monclient(hunting): picked mon.noname-i con 0x7f99c013f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 10 monclient(hunting): picked mon.noname-c con 0x7f99c01353b0 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99c013ce60 con 0x7f99c01353b0 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99c01349d0 con 0x7f99c00a8340 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99c0134cb0 con 0x7f99c013f750 2024-09-13T10:33:30.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:30.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99c5aa9640 10 monclient(hunting): authenticate will time out at 949.915902s 2024-09-13T10:33:30.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99bffff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f99c01353b0 0x7f99c013c750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47796/0 (socket says 172.21.15.181:47796) 2024-09-13T10:33:30.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.409+0000 7f99bffff640 1 -- 172.21.15.181:0/4088200833 learned_addr learned my addr 172.21.15.181:0/4088200833 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:30.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99bffff640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.181:6791/0 conn(0x7f99c01353b0 legacy=0x7f99c013c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99bf7fe640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.195:6791/0 conn(0x7f99c00a8340 legacy=0x7f99c013e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99beffd640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.195:6792/0 conn(0x7f99c013f750 legacy=0x7f99c013c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1975172665 0 0) 0x7f99c013ce60 con 0x7f99c01353b0 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): my global_id is 5521 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99ac003520 con 0x7f99c01353b0 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729637169 0 0) 0x7f99c0134cb0 con 0x7f99c013f750 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): my global_id is 55483 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99c013ce60 con 0x7f99c013f750 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834946826 0 0) 0x7f99c01349d0 con 0x7f99c00a8340 2024-09-13T10:33:30.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): my global_id is 5522 2024-09-13T10:33:30.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99c0134cb0 con 0x7f99c00a8340 2024-09-13T10:33:30.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3441406093 0 0) 0x7f99ac003520 con 0x7f99c01353b0 2024-09-13T10:33:30.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99c01349d0 con 0x7f99c01353b0 2024-09-13T10:33:30.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f99b8002020 con 0x7f99c01353b0 2024-09-13T10:33:30.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:30.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:30.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): dump: 2024-09-13T10:33:30.431 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.431 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.431 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.431 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.431 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.431 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.432 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.432 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.432 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.432 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.432 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.432 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.432 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.432 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.432 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.432 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:30.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2492118597 0 0) 0x7f99c01349d0 con 0x7f99c01353b0 2024-09-13T10:33:30.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.195:6792/0 conn(0x7f99c013f750 legacy=0x7f99c013c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.195:6791/0 conn(0x7f99c00a8340 legacy=0x7f99c013e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient: _finish_hunting 0 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 monclient: found mon.c 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c0134f90 con 0x7f99c01353b0 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient: _finish_auth 0 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient: _check_auth_tickets 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99c5aa9640 5 monclient: authenticate success, global_id 5521 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99c5aa9640 10 monclient: _renew_subs 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99c5aa9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99c5aa9640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f99c01d7750 con 0x7f99c01353b0 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99c5aa9640 10 monclient: _renew_subs 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99c5aa9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:30.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99c5aa9640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f99c01d7b00 con 0x7f99c01353b0 2024-09-13T10:33:30.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f99b8003c40 con 0x7f99c01353b0 2024-09-13T10:33:30.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:30.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f99b8004170 con 0x7f99c01353b0 2024-09-13T10:33:30.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99bdffb640 4 set_mon_vals no callback set 2024-09-13T10:33:30.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:30.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.412+0000 7f99a7fff640 10 monclient: dump: 2024-09-13T10:33:30.487 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.487 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.487 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.488 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.488 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.488 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.488 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.488 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.488 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.488 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.488 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.488 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.488 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.488 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.488 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.413+0000 7f99c5aa9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.413+0000 7f99c5aa9640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f99a00065c0 con 0x7f99a0002860 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.413+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f99b80043c0 con 0x7f99c01353b0 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.413+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(113..113 src has 1..113) ==== 3898+0+0 (unknown 1439973588 0 0) 0x7f99b804e630 con 0x7f99c01353b0 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.414+0000 7f99beffd640 10 monclient: get_auth_request con 0x7f99ac03fd60 auth_method 0 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.415+0000 7f99bf7fe640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.181:6793/0 conn(0x7f99a0002860 legacy=0x7f99a0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.415+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88385930 0 0) 0x7f99a00065c0 con 0x7f99a0002860 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.415+0000 7f99a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.415+0000 7f99a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.415+0000 7f99a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.415+0000 7f99a7fff640 10 monclient(hunting): my global_id is 84239 2024-09-13T10:33:30.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.415+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99c01349d0 con 0x7f99a0002860 2024-09-13T10:33:30.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2835549856 0 0) 0x7f99c01349d0 con 0x7f99a0002860 2024-09-13T10:33:30.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99a00065c0 con 0x7f99a0002860 2024-09-13T10:33:30.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f99b0001ce0 con 0x7f99a0002860 2024-09-13T10:33:30.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:30.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 10 monclient: dump: 2024-09-13T10:33:30.490 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.490 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.490 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1974237944 0 0) 0x7f99a00065c0 con 0x7f99a0002860 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99a000a160 con 0x7f99a0002860 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f99b00057c0 con 0x7f99a0002860 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.181:6793/0 conn(0x7f99a0002860 legacy=0x7f99a0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.416+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.181:6793/0 conn(0x7f99a0002860 legacy=0x7f99a0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.422+0000 7f99c5aa9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.422+0000 7f99c5aa9640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f99a0009e50 con 0x7f99a0009110 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.424+0000 7f99bf7fe640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.181:6793/0 conn(0x7f99a0009110 legacy=0x7f99a00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2011181946 0 0) 0x7f99a0009e50 con 0x7f99a0009110 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 10 monclient(hunting): my global_id is 84248 2024-09-13T10:33:30.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99a00065c0 con 0x7f99a0009110 2024-09-13T10:33:30.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1560423170 0 0) 0x7f99a00065c0 con 0x7f99a0009110 2024-09-13T10:33:30.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99a0009e50 con 0x7f99a0009110 2024-09-13T10:33:30.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f99b0003e20 con 0x7f99a0009110 2024-09-13T10:33:30.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:30.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 10 monclient: dump: 2024-09-13T10:33:30.493 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.493 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.494 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1184871561 0 0) 0x7f99a0009e50 con 0x7f99a0009110 2024-09-13T10:33:30.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f99a000c3f0 con 0x7f99a0009110 2024-09-13T10:33:30.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 2204732777) 0x7f99b0004040 con 0x7f99a0009110 2024-09-13T10:33:30.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:30.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:30.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.181:6793/0 conn(0x7f99a0009110 legacy=0x7f99a00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.425+0000 7f99a7fff640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.181:6793/0 conn(0x7f99a0009110 legacy=0x7f99a00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:30.496 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:30.496 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:30.496 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:30.496 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:30.496 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:30.496 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 19314, 2024-09-13T10:33:30.496 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:30.496 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:30.496 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:30.497 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:30.498 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:30.499 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:30.500 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:30.501 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:30.502 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.502 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:30.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.502 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:30.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.502 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:30.502 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:30.502 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.502 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.502 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.502 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:30.503 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.503 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.503 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.504 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:30.504 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:30.504 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.504 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.504 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.504 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:30.504 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:30.504 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.505 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.506 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:30.507 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:30.508 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.509 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.509 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.509 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:30.509 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.509 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.509 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.509 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:30.509 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:30.509 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.510 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.511 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.512 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:30.512 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.512 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.512 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.512 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:30.512 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:30.512 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.512 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.512 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.513 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:30.513 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:30.513 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.513 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.514 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.514 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:30.514 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.514 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.514 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.514 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.516 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.517 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.518 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:30.518 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:30.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.426+0000 7f99c5aa9640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.195:6800/1839191919 conn(0x7f99ac03fd60 legacy=0x7f99ac042220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.426+0000 7f99c5aa9640 10 monclient: shutdown 2024-09-13T10:33:30.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.426+0000 7f99c5aa9640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:30.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.426+0000 7f99c5aa9640 1 -- 172.21.15.181:0/4088200833 >> v1:172.21.15.181:6791/0 conn(0x7f99c01353b0 legacy=0x7f99c013c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.426+0000 7f99bffff640 1 -- 172.21.15.181:0/4088200833 reap_dead start 2024-09-13T10:33:30.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.426+0000 7f99bffff640 1 -- 172.21.15.181:0/4088200833 reap_dead start 2024-09-13T10:33:30.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.426+0000 7f99c5aa9640 1 -- 172.21.15.181:0/4088200833 shutdown_connections 2024-09-13T10:33:30.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.426+0000 7f99c5aa9640 1 -- 172.21.15.181:0/4088200833 >> 172.21.15.181:0/4088200833 conn(0x7f99c00a6640 msgr2=0x7f99c00a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:30.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.426+0000 7f99c5aa9640 1 -- 172.21.15.181:0/4088200833 shutdown_connections 2024-09-13T10:33:30.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.426+0000 7f99c5aa9640 1 -- 172.21.15.181:0/4088200833 wait complete. 2024-09-13T10:33:30.520 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:30.520 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:33:30.520 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:33:30.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.616+0000 7f9be1f44640 10 monclient: get_monmap_and_config 2024-09-13T10:33:30.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.616+0000 7f9be1f44640 10 monclient: build_initial_monmap 2024-09-13T10:33:30.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.616+0000 7f9be1f44640 10 monclient: monmap: 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:30.617802+0000 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:30.617802+0000 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:30.622 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.616+0000 7f9be1f44640 1 Processor -- start 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9be1f44640 1 -- start start 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9be1f44640 10 monclient: init 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9be1f44640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9be1f44640 10 monclient: _add_conns ranks=[7,2,8,3,1,0,6,5,4] 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9be1f44640 10 monclient(hunting): picked mon.noname-i con 0x7f9bdc0a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9be1f44640 10 monclient(hunting): picked mon.noname-b con 0x7f9bdc0a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9be1f44640 10 monclient(hunting): picked mon.noname-e con 0x7f9bdc13f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9be1f44640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bdc0a5fe0 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9be1f44640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bdc0a8080 con 0x7f9bdc0a66d0 2024-09-13T10:33:30.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9be1f44640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bdc0a42c0 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9be1f44640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:30.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9be1f44640 10 monclient(hunting): authenticate will time out at 950.123536s 2024-09-13T10:33:30.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9bd2ffd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f9bdc0a6ab0 0x7f9bdc0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:43174/0 (socket says 172.21.15.181:43174) 2024-09-13T10:33:30.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9bdbfff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f9bdc13f9a0 0x7f9bdc141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:37706/0 (socket says 172.21.15.181:37706) 2024-09-13T10:33:30.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.617+0000 7f9bd2ffd640 1 -- 172.21.15.181:0/4025403452 learned_addr learned my addr 172.21.15.181:0/4025403452 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:30.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.619+0000 7f9bdbfff640 1 -- 172.21.15.181:0/4025403452 >> v1:172.21.15.181:6793/0 conn(0x7f9bdc13f9a0 legacy=0x7f9bdc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.619+0000 7f9bd2ffd640 1 -- 172.21.15.181:0/4025403452 >> v1:172.21.15.181:6790/0 conn(0x7f9bdc0a6ab0 legacy=0x7f9bdc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.619+0000 7f9bdb7fe640 1 -- 172.21.15.181:0/4025403452 >> v1:172.21.15.195:6792/0 conn(0x7f9bdc0a66d0 legacy=0x7f9bdc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4204611503 0 0) 0x7f9bdc0a42c0 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient(hunting): my global_id is 84257 2024-09-13T10:33:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bc8003520 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317132183 0 0) 0x7f9bdc0a5fe0 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient(hunting): my global_id is 64973 2024-09-13T10:33:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bdc0a42c0 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983254949 0 0) 0x7f9bdc0a8080 con 0x7f9bdc0a66d0 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient(hunting): my global_id is 55492 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bdc0a5fe0 con 0x7f9bdc0a66d0 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1496912376 0 0) 0x7f9bc8003520 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 >> v1:172.21.15.195:6792/0 conn(0x7f9bdc0a66d0 legacy=0x7f9bdc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 >> v1:172.21.15.181:6790/0 conn(0x7f9bdc0a6ab0 legacy=0x7f9bdc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 monclient: found mon.noname-e 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:33:30.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc1464e0 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient: _finish_auth 0 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bd4001e50 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9be1f44640 5 monclient: authenticate success, global_id 84257 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient: dump: 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.634 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9be1f44640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9bd4004b60 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:30.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 1 -- 172.21.15.181:0/4025403452 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bd4005090 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9bdaffd640 10 monclient: dump: 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.636 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9be1f44640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9be1f44640 4 set_mon_vals no callback set 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9be1f44640 10 monclient: shutdown 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9be1f44640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.620+0000 7f9be1f44640 1 -- 172.21.15.181:0/4025403452 >> v1:172.21.15.181:6793/0 conn(0x7f9bdc13f9a0 legacy=0x7f9bdc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.621+0000 7f9be1f44640 1 -- 172.21.15.181:0/4025403452 shutdown_connections 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.621+0000 7f9be1f44640 1 -- 172.21.15.181:0/4025403452 >> 172.21.15.181:0/4025403452 conn(0x7f9bdc0abcd0 msgr2=0x7f9bdc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.621+0000 7f9be1f44640 1 -- 172.21.15.181:0/4025403452 shutdown_connections 2024-09-13T10:33:30.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.621+0000 7f9be1f44640 1 -- 172.21.15.181:0/4025403452 wait complete. 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.621+0000 7f9be1f44640 10 monclient: build_initial_monmap 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.621+0000 7f9be1f44640 10 monclient: monmap: 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:30.638 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:30.639 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:30.639 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:30.639 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:30.639 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.621+0000 7f9be1f44640 1 Processor -- start 2024-09-13T10:33:30.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9be1f44640 1 -- start start 2024-09-13T10:33:30.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9be1f44640 10 monclient: init 2024-09-13T10:33:30.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9be1f44640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9be1f44640 10 monclient: _add_conns ranks=[4,8,2,3,1,5,6,7,0] 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9be1f44640 10 monclient(hunting): picked mon.noname-c con 0x7f9bdc0a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9be1f44640 10 monclient(hunting): picked mon.noname-e con 0x7f9bdc0a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9be1f44640 10 monclient(hunting): picked mon.noname-b con 0x7f9bdc13f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9be1f44640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bdc13cd40 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9be1f44640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bdc068680 con 0x7f9bdc0a66d0 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9be1f44640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bdc13dce0 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9be1f44640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9be1f44640 10 monclient(hunting): authenticate will time out at 950.128594s 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9bd2ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f9bdc0a6ab0 0x7f9bdc1d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:37718/0 (socket says 172.21.15.181:37718) 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9bd2ffd640 1 -- 172.21.15.181:0/52015741 learned_addr learned my addr 172.21.15.181:0/52015741 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9bdb7fe640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.181:6791/0 conn(0x7f9bdc0a66d0 legacy=0x7f9bdc1ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T10:33:30.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9bdb7fe640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.181:6791/0 conn(0x7f9bdc0a66d0 legacy=0x7f9bdc1ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9bdb7fe640 1 --1- 172.21.15.181:0/52015741 >> v1:172.21.15.181:6791/0 conn(0x7f9bdc0a66d0 0x7f9bdc1ce660 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9bdb7fe640 1 --1- 172.21.15.181:0/52015741 >> v1:172.21.15.181:6791/0 conn(0x7f9bdc0a66d0 0x7f9bdc1ce660 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.622+0000 7f9bd8ff9640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.181:6791/0 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd2ffd640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.181:6793/0 conn(0x7f9bdc0a6ab0 legacy=0x7f9bdc1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bdbfff640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.181:6790/0 conn(0x7f9bdc13f9a0 legacy=0x7f9bdc1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1351692901 0 0) 0x7f9bdc13dce0 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd8ff9640 10 monclient(hunting): my global_id is 84266 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bbc003520 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1878425473 0 0) 0x7f9bdc13cd40 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd8ff9640 10 monclient(hunting): my global_id is 64982 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.624+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bdc13dce0 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3400704742 0 0) 0x7f9bbc003520 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bdc13cd40 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bc40047e0 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient(hunting): dump: 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.642 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:30.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3444033030 0 0) 0x7f9bdc13dce0 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bbc003520 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bd40020a0 con 0x7f9bdc13f9a0 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient(hunting): dump: 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.644 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1622278522 0 0) 0x7f9bdc13cd40 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.181:6791/0 conn(0x7f9bdc0a66d0 legacy=0x7f9bdc1ce660 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.181:6790/0 conn(0x7f9bdc13f9a0 legacy=0x7f9bdc1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:33:30.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 monclient: found mon.e 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc13e800 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient: _finish_auth 0 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9be1f44640 5 monclient: authenticate success, global_id 84266 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9be1f44640 10 monclient: _renew_subs 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9be1f44640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9be1f44640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9bdc1374e0 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9be1f44640 10 monclient: _renew_subs 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9be1f44640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9be1f44640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f9bdc13c2a0 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9bc4004c30 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bc40051a0 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bda7fc640 4 set_mon_vals no callback set 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.625+0000 7f9bd8ff9640 10 monclient: dump: 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.647 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.626+0000 7f9be1f44640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.626+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9bc4005340 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.626+0000 7f9be1f44640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9bc00065c0 con 0x7f9bc0002860 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.626+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(113..113 src has 1..113) ==== 3898+0+0 (unknown 1439973588 0 0) 0x7f9bc404e3c0 con 0x7f9bdc0a6ab0 2024-09-13T10:33:30.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.626+0000 7f9bdbfff640 10 monclient: get_auth_request con 0x7f9bbc040100 auth_method 0 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.628+0000 7f9bdb7fe640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.195:6789/0 conn(0x7f9bc0002860 legacy=0x7f9bc0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.628+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149161586 0 0) 0x7f9bc00065c0 con 0x7f9bc0002860 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.628+0000 7f9bd8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.628+0000 7f9bd8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.628+0000 7f9bd8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.628+0000 7f9bd8ff9640 10 monclient(hunting): my global_id is 55558 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.628+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bdc13cd40 con 0x7f9bc0002860 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 325520388 0 0) 0x7f9bdc13cd40 con 0x7f9bc0002860 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bc00065c0 con 0x7f9bc0002860 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bcc003610 con 0x7f9bc0002860 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:33:30.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 10 monclient: dump: 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.650 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.651 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.651 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 394553181 0 0) 0x7f9bc00065c0 con 0x7f9bc0002860 2024-09-13T10:33:30.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9bc000a160 con 0x7f9bc0002860 2024-09-13T10:33:30.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9bcc0057c0 con 0x7f9bc0002860 2024-09-13T10:33:30.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:30.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:30.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.195:6789/0 conn(0x7f9bc0002860 legacy=0x7f9bc0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.629+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.195:6789/0 conn(0x7f9bc0002860 legacy=0x7f9bc0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:30.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.635+0000 7f9be1f44640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.635+0000 7f9be1f44640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9bc0009e50 con 0x7f9bc0009110 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bdb7fe640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.195:6789/0 conn(0x7f9bc0009110 legacy=0x7f9bc00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 117746251 0 0) 0x7f9bc0009e50 con 0x7f9bc0009110 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bd8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bd8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bd8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bd8ff9640 10 monclient(hunting): my global_id is 55567 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bc00065c0 con 0x7f9bc0009110 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 822178890 0 0) 0x7f9bc00065c0 con 0x7f9bc0009110 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bc0009e50 con 0x7f9bc0009110 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bcc003e60 con 0x7f9bc0009110 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bd8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bd8ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:33:30.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.638+0000 7f9bd8ff9640 10 monclient: dump: 2024-09-13T10:33:30.655 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.655 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.655 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.655 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.655 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.655 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.655 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.655 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.655 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.656 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.656 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.656 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.656 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.656 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.656 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.656 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2072609950 0 0) 0x7f9bc0009e50 con 0x7f9bc0009110 2024-09-13T10:33:30.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9bc000c3f0 con 0x7f9bc0009110 2024-09-13T10:33:30.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7893 (unknown 0 0 3680560021) 0x7f9bcc004040 con 0x7f9bc0009110 2024-09-13T10:33:30.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9bd8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:30.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9bd8ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:30.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.195:6789/0 conn(0x7f9bc0009110 legacy=0x7f9bc00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9bd8ff9640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.195:6789/0 conn(0x7f9bc0009110 legacy=0x7f9bc00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:30.657 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:30.657 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:30.657 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:30.657 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:30.657 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:30.657 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 225049, 2024-09-13T10:33:30.657 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:30.657 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:30.658 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:30.659 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.661 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:30.661 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:30.661 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:30.661 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:30.661 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:30.661 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:30.661 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:30.661 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:30.661 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:30.661 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:30.661 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:30.661 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:30.662 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.663 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:30.664 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.665 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.667 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:30.668 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.669 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.670 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.671 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:30.672 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.674 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:30.675 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:30.676 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:30.677 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.677 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:30.677 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:33:30.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:30.677 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:30.677 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:30.677 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:30.677 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:30.677 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:30.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:30.677 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:30.677 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:30.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9be1f44640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.195:6800/1839191919 conn(0x7f9bbc040100 legacy=0x7f9bbc0425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9be1f44640 10 monclient: shutdown 2024-09-13T10:33:30.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9be1f44640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:30.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9be1f44640 1 -- 172.21.15.181:0/52015741 >> v1:172.21.15.181:6793/0 conn(0x7f9bdc0a6ab0 legacy=0x7f9bdc1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9bdbfff640 1 -- 172.21.15.181:0/52015741 reap_dead start 2024-09-13T10:33:30.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9bdbfff640 1 -- 172.21.15.181:0/52015741 reap_dead start 2024-09-13T10:33:30.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9be1f44640 1 -- 172.21.15.181:0/52015741 shutdown_connections 2024-09-13T10:33:30.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.639+0000 7f9be1f44640 1 -- 172.21.15.181:0/52015741 >> 172.21.15.181:0/52015741 conn(0x7f9bdc0abcd0 msgr2=0x7f9bdc0a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:30.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.640+0000 7f9be1f44640 1 -- 172.21.15.181:0/52015741 shutdown_connections 2024-09-13T10:33:30.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.640+0000 7f9be1f44640 1 -- 172.21.15.181:0/52015741 wait complete. 2024-09-13T10:33:30.680 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:30.680 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:33:30.680 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:33:30.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.775+0000 7fd776f90640 10 monclient: get_monmap_and_config 2024-09-13T10:33:30.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.775+0000 7fd776f90640 10 monclient: build_initial_monmap 2024-09-13T10:33:30.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.776+0000 7fd776f90640 10 monclient: monmap: 2024-09-13T10:33:30.778 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:30.778 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:30.777584+0000 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:30.777584+0000 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:30.779 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:30.780 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.776+0000 7fd776f90640 1 Processor -- start 2024-09-13T10:33:30.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.776+0000 7fd776f90640 1 -- start start 2024-09-13T10:33:30.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.776+0000 7fd776f90640 10 monclient: init 2024-09-13T10:33:30.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd776f90640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:30.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd776f90640 10 monclient: _add_conns ranks=[6,4,2,0,7,5,8,1,3] 2024-09-13T10:33:30.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd776f90640 10 monclient(hunting): picked mon.noname-d con 0x7fd770139040 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:30.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd776f90640 10 monclient(hunting): picked mon.noname-c con 0x7fd77009cd50 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:30.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd776f90640 10 monclient(hunting): picked mon.noname-b con 0x7fd77013fae0 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:30.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd776f90640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77009dbb0 con 0x7fd77013fae0 2024-09-13T10:33:30.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd776f90640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77009de90 con 0x7fd77009cd50 2024-09-13T10:33:30.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd776f90640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77009e170 con 0x7fd770139040 2024-09-13T10:33:30.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd776f90640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:30.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd776f90640 10 monclient(hunting): authenticate will time out at 950.283205s 2024-09-13T10:33:30.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd77552d640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fd77013fae0 0x7fd770141ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:43196/0 (socket says 172.21.15.181:43196) 2024-09-13T10:33:30.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd774d2c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fd770139040 0x7fd7700a58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54326/0 (socket says 172.21.15.181:54326) 2024-09-13T10:33:30.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.777+0000 7fd77552d640 1 -- 172.21.15.181:0/302220389 learned_addr learned my addr 172.21.15.181:0/302220389 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:30.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.779+0000 7fd76ffff640 1 -- 172.21.15.181:0/302220389 >> v1:172.21.15.181:6791/0 conn(0x7fd77009cd50 legacy=0x7fd77013e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.779+0000 7fd77552d640 1 -- 172.21.15.181:0/302220389 >> v1:172.21.15.181:6790/0 conn(0x7fd77013fae0 legacy=0x7fd770141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.779+0000 7fd774d2c640 1 -- 172.21.15.181:0/302220389 >> v1:172.21.15.181:6792/0 conn(0x7fd770139040 legacy=0x7fd7700a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 1 -- 172.21.15.181:0/302220389 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200615169 0 0) 0x7fd77009dbb0 con 0x7fd77013fae0 2024-09-13T10:33:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient(hunting): my global_id is 64991 2024-09-13T10:33:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 1 -- 172.21.15.181:0/302220389 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd760003520 con 0x7fd77013fae0 2024-09-13T10:33:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 1 -- 172.21.15.181:0/302220389 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3289646639 0 0) 0x7fd77009e170 con 0x7fd770139040 2024-09-13T10:33:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient(hunting): my global_id is 5433 2024-09-13T10:33:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 1 -- 172.21.15.181:0/302220389 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd77009dbb0 con 0x7fd770139040 2024-09-13T10:33:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 1 -- 172.21.15.181:0/302220389 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 141925732 0 0) 0x7fd760003520 con 0x7fd77013fae0 2024-09-13T10:33:30.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 1 -- 172.21.15.181:0/302220389 >> v1:172.21.15.181:6792/0 conn(0x7fd770139040 legacy=0x7fd7700a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 1 -- 172.21.15.181:0/302220389 >> v1:172.21.15.181:6791/0 conn(0x7fd77009cd50 legacy=0x7fd77013e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 1 monclient: found mon.noname-b 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 1 -- 172.21.15.181:0/302220389 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7700a5ff0 con 0x7fd77013fae0 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 1 -- 172.21.15.181:0/302220389 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd768001e60 con 0x7fd77013fae0 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient: dump: 2024-09-13T10:33:30.849 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.850 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.850 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.850 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.850 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.850 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.850 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.850 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.850 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.850 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.850 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd776f90640 5 monclient: authenticate success, global_id 64991 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd776f90640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 1 -- 172.21.15.181:0/302220389 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd768004c20 con 0x7fd77013fae0 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 1 -- 172.21.15.181:0/302220389 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd768005190 con 0x7fd77013fae0 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd76f7fe640 10 monclient: dump: 2024-09-13T10:33:30.851 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:30.852 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:30.852 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.852 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:30.852 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:30.852 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:30.852 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:30.852 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:30.852 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:30.852 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:30.852 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd776f90640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.843+0000 7fd776f90640 4 set_mon_vals no callback set 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.844+0000 7fd776f90640 10 monclient: shutdown 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.844+0000 7fd776f90640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.844+0000 7fd776f90640 1 -- 172.21.15.181:0/302220389 >> v1:172.21.15.181:6790/0 conn(0x7fd77013fae0 legacy=0x7fd770141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.844+0000 7fd776f90640 1 -- 172.21.15.181:0/302220389 shutdown_connections 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.844+0000 7fd776f90640 1 -- 172.21.15.181:0/302220389 >> 172.21.15.181:0/302220389 conn(0x7fd770077120 msgr2=0x7fd7700abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:30.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.844+0000 7fd776f90640 1 -- 172.21.15.181:0/302220389 shutdown_connections 2024-09-13T10:33:30.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.844+0000 7fd776f90640 1 -- 172.21.15.181:0/302220389 wait complete. 2024-09-13T10:33:30.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.845+0000 7fd776f90640 10 monclient: build_initial_monmap 2024-09-13T10:33:30.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.845+0000 7fd776f90640 10 monclient: monmap: 2024-09-13T10:33:30.854 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:30.854 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:30.854 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:30.854 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:30.854 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:30.854 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:30.855 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:30.855 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:30.855 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:30.855 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:30.855 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:30.855 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:30.855 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:30.855 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:30.855 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:30.855 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:30.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.845+0000 7fd776f90640 1 Processor -- start 2024-09-13T10:33:30.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.845+0000 7fd776f90640 1 -- start start 2024-09-13T10:33:30.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.845+0000 7fd776f90640 10 monclient: init 2024-09-13T10:33:30.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.846+0000 7fd776f90640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:30.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.846+0000 7fd776f90640 10 monclient: _add_conns ranks=[5,1,2,8,7,4,3,6,0] 2024-09-13T10:33:30.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.846+0000 7fd776f90640 10 monclient(hunting): picked mon.noname-h con 0x7fd77009cd50 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:30.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.846+0000 7fd776f90640 10 monclient(hunting): picked mon.noname-f con 0x7fd770139040 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:30.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.846+0000 7fd776f90640 10 monclient(hunting): picked mon.noname-b con 0x7fd77013fae0 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:30.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.846+0000 7fd776f90640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77013e890 con 0x7fd770139040 2024-09-13T10:33:30.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.846+0000 7fd776f90640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77013c530 con 0x7fd77013fae0 2024-09-13T10:33:30.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.846+0000 7fd776f90640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77013dff0 con 0x7fd77009cd50 2024-09-13T10:33:30.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.846+0000 7fd776f90640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:30.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.846+0000 7fd776f90640 10 monclient(hunting): authenticate will time out at 950.352308s 2024-09-13T10:33:30.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.846+0000 7fd77552d640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fd77013fae0 0x7fd7701d66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:43200/0 (socket says 172.21.15.181:43200) 2024-09-13T10:33:30.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.846+0000 7fd77552d640 1 -- 172.21.15.181:0/1442307285 learned_addr learned my addr 172.21.15.181:0/1442307285 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:30.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.848+0000 7fd77552d640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.181:6790/0 conn(0x7fd77013fae0 legacy=0x7fd7701d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.848+0000 7fd76ffff640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.195:6789/0 conn(0x7fd770139040 legacy=0x7fd77013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.848+0000 7fd774d2c640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.195:6791/0 conn(0x7fd77009cd50 legacy=0x7fd77013ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:30.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:30.848+0000 7fd774d2c640 1 --1- 172.21.15.181:0/1442307285 >> v1:172.21.15.195:6791/0 conn(0x7fd77009cd50 0x7fd77013ad00 :-1 s=OPENED pgs=297 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fd77013dff0 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:33:31.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.291+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1542596645 0 0) 0x7fd77013e890 con 0x7fd770139040 2024-09-13T10:33:31.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.291+0000 7fd76d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.291+0000 7fd76d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.291+0000 7fd76d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.291+0000 7fd76d7fa640 10 monclient(hunting): my global_id is 55576 2024-09-13T10:33:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.291+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd754003520 con 0x7fd770139040 2024-09-13T10:33:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.291+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1503491125 0 0) 0x7fd77013c530 con 0x7fd77013fae0 2024-09-13T10:33:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.291+0000 7fd76d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.291+0000 7fd76d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.291+0000 7fd76d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.291+0000 7fd76d7fa640 10 monclient(hunting): my global_id is 65000 2024-09-13T10:33:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.291+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd77013e890 con 0x7fd77013fae0 2024-09-13T10:33:31.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1574779563 0 0) 0x7fd77013e890 con 0x7fd77013fae0 2024-09-13T10:33:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd77013c530 con 0x7fd77013fae0 2024-09-13T10:33:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd7680020b0 con 0x7fd77013fae0 2024-09-13T10:33:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:33:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 10 monclient(hunting): dump: 2024-09-13T10:33:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.298 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.299 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:31.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2469502588 0 0) 0x7fd77013c530 con 0x7fd77013fae0 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.195:6791/0 conn(0x7fd77009cd50 legacy=0x7fd77013ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.195:6789/0 conn(0x7fd770139040 legacy=0x7fd77013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 1 monclient: found mon.b 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77013e2d0 con 0x7fd77013fae0 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 10 monclient: _finish_auth 0 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd76d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd776f90640 5 monclient: authenticate success, global_id 65000 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd776f90640 10 monclient: _renew_subs 2024-09-13T10:33:31.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd776f90640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:33:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd776f90640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd77013dc30 con 0x7fd77013fae0 2024-09-13T10:33:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd776f90640 10 monclient: _renew_subs 2024-09-13T10:33:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.292+0000 7fd776f90640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:33:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.293+0000 7fd776f90640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd77013ee90 con 0x7fd77013fae0 2024-09-13T10:33:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.293+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7680053c0 con 0x7fd77013fae0 2024-09-13T10:33:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.293+0000 7fd76d7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.293+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd768001e80 con 0x7fd77013fae0 2024-09-13T10:33:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.293+0000 7fd76d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.293+0000 7fd76d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.293+0000 7fd76d7fa640 10 monclient: dump: 2024-09-13T10:33:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.301 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.302 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.303 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.303 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.303 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.294+0000 7fd76effd640 4 set_mon_vals no callback set 2024-09-13T10:33:31.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.294+0000 7fd776f90640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.295+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fd768011d90 con 0x7fd77013fae0 2024-09-13T10:33:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.295+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(114..114 src has 1..114) ==== 3898+0+0 (unknown 1798955111 0 0) 0x7fd76804e590 con 0x7fd77013fae0 2024-09-13T10:33:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.296+0000 7fd776f90640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd7700008d0 con 0x7fd77013bc40 2024-09-13T10:33:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.296+0000 7fd774d2c640 10 monclient: get_auth_request con 0x7fd75403fb30 auth_method 0 2024-09-13T10:33:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.299+0000 7fd76ffff640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.195:6790/0 conn(0x7fd77013bc40 legacy=0x7fd7700a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.300+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189525117 0 0) 0x7fd7700008d0 con 0x7fd77013bc40 2024-09-13T10:33:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.301+0000 7fd76d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.301+0000 7fd76d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.301+0000 7fd76d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.301+0000 7fd76d7fa640 10 monclient(hunting): my global_id is 5385 2024-09-13T10:33:31.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.301+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd77013c530 con 0x7fd77013bc40 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.302+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2176696333 0 0) 0x7fd77013c530 con 0x7fd77013bc40 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.302+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd7700008d0 con 0x7fd77013bc40 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.302+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd75c003c10 con 0x7fd77013bc40 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.302+0000 7fd76d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.302+0000 7fd76d7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.302+0000 7fd76d7fa640 10 monclient: dump: 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.306 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.307 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.302+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1784120818 0 0) 0x7fd7700008d0 con 0x7fd77013bc40 2024-09-13T10:33:31.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.302+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7701435f0 con 0x7fd77013bc40 2024-09-13T10:33:31.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.303+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd75c004000 con 0x7fd77013bc40 2024-09-13T10:33:31.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.303+0000 7fd76d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:31.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.303+0000 7fd76d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:31.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.303+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.195:6790/0 conn(0x7fd77013bc40 legacy=0x7fd7700a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.303+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.195:6790/0 conn(0x7fd77013bc40 legacy=0x7fd7700a9ad0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:31.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.310+0000 7fd776f90640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:31.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.310+0000 7fd776f90640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd77002e5e0 con 0x7fd77002e200 2024-09-13T10:33:31.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76ffff640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.195:6790/0 conn(0x7fd77002e200 legacy=0x7fd7700aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857271918 0 0) 0x7fd77002e5e0 con 0x7fd77002e200 2024-09-13T10:33:31.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76d7fa640 10 monclient(hunting): my global_id is 5394 2024-09-13T10:33:31.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7700008d0 con 0x7fd77002e200 2024-09-13T10:33:31.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 735543281 0 0) 0x7fd7700008d0 con 0x7fd77002e200 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd77002e5e0 con 0x7fd77002e200 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd75c005b00 con 0x7fd77002e200 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76d7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.312+0000 7fd76d7fa640 10 monclient: dump: 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.317 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.318 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.318 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.318 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.318 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.318 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.318 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.318 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.318 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4000388845 0 0) 0x7fd77002e5e0 con 0x7fd77002e200 2024-09-13T10:33:31.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd7700aa8f0 con 0x7fd77002e200 2024-09-13T10:33:31.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7561 (unknown 0 0 2938079667) 0x7fd75c007da0 con 0x7fd77002e200 2024-09-13T10:33:31.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd76d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:31.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd76d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:31.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.195:6790/0 conn(0x7fd77002e200 legacy=0x7fd7700aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd76d7fa640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.195:6790/0 conn(0x7fd77002e200 legacy=0x7fd7700aa1e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:31.319 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:31.319 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:31.319 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:31.319 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:33:31.319 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:31.319 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 225729, 2024-09-13T10:33:31.320 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:31.320 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:31.320 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:31.320 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:31.320 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:31.320 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:31.320 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:31.320 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:31.320 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:31.320 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:31.320 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.320 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:31.321 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:31.322 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:31.322 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.322 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:31.322 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:31.322 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:31.322 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:31.322 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:31.322 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:31.322 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:31.322 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:31.322 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:31.322 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:31.323 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:31.323 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:31.323 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:31.323 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.323 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:31.323 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:31.323 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:31.323 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:31.323 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:31.323 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:31.324 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:31.325 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:31.325 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:31.325 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:31.325 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:31.325 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:31.325 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:31.325 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:31.325 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:31.325 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:31.325 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.325 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:31.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.327 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:31.328 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.328 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.328 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.328 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:31.328 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:31.328 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.328 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.328 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.328 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.329 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.330 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.330 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:31.330 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:31.330 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.330 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.330 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.330 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:31.330 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.330 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.332 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:31.333 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:31.333 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.333 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.333 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.333 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:31.333 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.333 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.333 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.333 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:31.333 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.334 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.335 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.336 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:31.338 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:31.339 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.339 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:31.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.339 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:31.339 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:31.339 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:31.339 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.339 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.339 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:31.339 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:31.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd776f90640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.195:6800/1839191919 conn(0x7fd75403fb30 legacy=0x7fd754041ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd776f90640 10 monclient: shutdown 2024-09-13T10:33:31.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd776f90640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:31.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd776f90640 1 -- 172.21.15.181:0/1442307285 >> v1:172.21.15.181:6790/0 conn(0x7fd77013fae0 legacy=0x7fd7701d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd77552d640 1 -- 172.21.15.181:0/1442307285 reap_dead start 2024-09-13T10:33:31.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.313+0000 7fd77552d640 1 -- 172.21.15.181:0/1442307285 reap_dead start 2024-09-13T10:33:31.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.314+0000 7fd776f90640 1 -- 172.21.15.181:0/1442307285 shutdown_connections 2024-09-13T10:33:31.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.314+0000 7fd776f90640 1 -- 172.21.15.181:0/1442307285 >> 172.21.15.181:0/1442307285 conn(0x7fd770077120 msgr2=0x7fd770137a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:31.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.314+0000 7fd776f90640 1 -- 172.21.15.181:0/1442307285 shutdown_connections 2024-09-13T10:33:31.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.314+0000 7fd776f90640 1 -- 172.21.15.181:0/1442307285 wait complete. 2024-09-13T10:33:31.342 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:31.342 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:33:31.342 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:33:31.401 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:31.401 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37170]: starting. 2024-09-13T10:33:31.401 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37170]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37133 2024-09-13T10:33:31.401 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37170]: created object 0... 2024-09-13T10:33:31.402 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37170]: created object 25... 2024-09-13T10:33:31.402 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37170]: created object 49... 2024-09-13T10:33:31.402 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37170]: finishing. 2024-09-13T10:33:31.402 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37170]: shutting down. 2024-09-13T10:33:31.440 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:31.440 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37172]: starting. 2024-09-13T10:33:31.440 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37172]: listing objects. 2024-09-13T10:33:31.441 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37172]: listed object 0... 2024-09-13T10:33:31.441 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37172]: listed object 25... 2024-09-13T10:33:31.441 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37172]: saw 50 objects 2024-09-13T10:33:31.441 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37172]: shutting down. 2024-09-13T10:33:31.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.442+0000 7f0807e08640 10 monclient: get_monmap_and_config 2024-09-13T10:33:31.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.442+0000 7f0807e08640 10 monclient: build_initial_monmap 2024-09-13T10:33:31.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.442+0000 7f0807e08640 10 monclient: monmap: 2024-09-13T10:33:31.445 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:31.445 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.445 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:31.443882+0000 2024-09-13T10:33:31.445 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:31.443882+0000 2024-09-13T10:33:31.445 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:31.445 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.445 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:31.445 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:31.445 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:31.446 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:31.446 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:31.446 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:31.446 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:31.446 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:31.446 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:31.446 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.442+0000 7f0807e08640 1 Processor -- start 2024-09-13T10:33:31.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0807e08640 1 -- start start 2024-09-13T10:33:31.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0807e08640 10 monclient: init 2024-09-13T10:33:31.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0807e08640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:31.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0807e08640 10 monclient: _add_conns ranks=[4,6,1,7,5,3,8,2,0] 2024-09-13T10:33:31.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0807e08640 10 monclient(hunting): picked mon.noname-c con 0x7f08000a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:31.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0807e08640 10 monclient(hunting): picked mon.noname-d con 0x7f08000a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:31.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0807e08640 10 monclient(hunting): picked mon.noname-f con 0x7f080013f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:31.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0807e08640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08000a5fe0 con 0x7f080013f9a0 2024-09-13T10:33:31.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0807e08640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08000a8080 con 0x7f08000a66d0 2024-09-13T10:33:31.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0807e08640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08000a42c0 con 0x7f08000a6ab0 2024-09-13T10:33:31.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0807e08640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:31.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0807e08640 10 monclient(hunting): authenticate will time out at 950.949629s 2024-09-13T10:33:31.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0805ba4640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f08000a66d0 0x7f08000a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47824/0 (socket says 172.21.15.181:47824) 2024-09-13T10:33:31.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f08053a3640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f08000a6ab0 0x7f08000a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54342/0 (socket says 172.21.15.181:54342) 2024-09-13T10:33:31.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.443+0000 7f0805ba4640 1 -- 172.21.15.181:0/3629277572 learned_addr learned my addr 172.21.15.181:0/3629277572 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:31.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.445+0000 7f0805ba4640 1 -- 172.21.15.181:0/3629277572 >> v1:172.21.15.181:6791/0 conn(0x7f08000a66d0 legacy=0x7f08000a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.445+0000 7f08053a3640 1 -- 172.21.15.181:0/3629277572 >> v1:172.21.15.181:6792/0 conn(0x7f08000a6ab0 legacy=0x7f08000a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f08063a5640 1 -- 172.21.15.181:0/3629277572 >> v1:172.21.15.195:6789/0 conn(0x7f080013f9a0 legacy=0x7f0800141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466498038 0 0) 0x7f08000a8080 con 0x7f08000a66d0 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient(hunting): my global_id is 5530 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07ec003520 con 0x7f08000a66d0 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520203249 0 0) 0x7f08000a42c0 con 0x7f08000a6ab0 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient(hunting): my global_id is 5442 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08000a8080 con 0x7f08000a6ab0 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843239992 0 0) 0x7f08000a5fe0 con 0x7f080013f9a0 2024-09-13T10:33:31.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient(hunting): my global_id is 55585 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08000a42c0 con 0x7f080013f9a0 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3492535911 0 0) 0x7f07ec003520 con 0x7f08000a66d0 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 >> v1:172.21.15.181:6792/0 conn(0x7f08000a6ab0 legacy=0x7f08000a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 >> v1:172.21.15.195:6789/0 conn(0x7f080013f9a0 legacy=0x7f0800141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient: _finish_hunting 0 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 monclient: found mon.noname-c 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08001464e0 con 0x7f08000a66d0 2024-09-13T10:33:31.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient: _finish_auth 0 2024-09-13T10:33:31.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient: _check_auth_tickets 2024-09-13T10:33:31.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:31.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f07fc001ae0 con 0x7f08000a66d0 2024-09-13T10:33:31.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0807e08640 5 monclient: authenticate success, global_id 5530 2024-09-13T10:33:31.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0807e08640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:31.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:31.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:31.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient: dump: 2024-09-13T10:33:31.462 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.462 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.462 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.462 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.463 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.463 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.463 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.463 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.463 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.463 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.463 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.463 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.463 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.463 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0807e08640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0805ba4640 1 --1- 172.21.15.181:0/3629277572 >> v1:172.21.15.181:6791/0 conn(0x7f08000a66d0 0x7f08000a53b0 :-1 s=OPENED pgs=313 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f07fc0048a0 config(0 keys) 2024-09-13T10:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f07fc0048a0 con 0x7f08000a66d0 2024-09-13T10:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0804ba2640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0807e08640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.446+0000 7f0807e08640 4 set_mon_vals no callback set 2024-09-13T10:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.447+0000 7f0807e08640 10 monclient: shutdown 2024-09-13T10:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.447+0000 7f0807e08640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.447+0000 7f0807e08640 1 -- 172.21.15.181:0/3629277572 >> v1:172.21.15.181:6791/0 conn(0x7f08000a66d0 legacy=0x7f08000a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.447+0000 7f0804ba2640 1 -- 172.21.15.181:0/3629277572 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f07fc004e10 con 0x7f08000a66d0 2024-09-13T10:33:31.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.447+0000 7f0804ba2640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:33:31.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.447+0000 7f0807e08640 1 -- 172.21.15.181:0/3629277572 shutdown_connections 2024-09-13T10:33:31.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.447+0000 7f0807e08640 1 -- 172.21.15.181:0/3629277572 >> 172.21.15.181:0/3629277572 conn(0x7f08000abcd0 msgr2=0x7f08000ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:31.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.447+0000 7f0807e08640 1 -- 172.21.15.181:0/3629277572 shutdown_connections 2024-09-13T10:33:31.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.447+0000 7f0807e08640 1 -- 172.21.15.181:0/3629277572 wait complete. 2024-09-13T10:33:31.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.447+0000 7f0807e08640 10 monclient: build_initial_monmap 2024-09-13T10:33:31.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.447+0000 7f0807e08640 10 monclient: monmap: 2024-09-13T10:33:31.465 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:31.465 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:31.465 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:31.465 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:31.465 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:31.466 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:31.466 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:31.466 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:31.466 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:31.466 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:31.466 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:31.466 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:31.467 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:31.467 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:31.467 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:31.467 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 1 Processor -- start 2024-09-13T10:33:31.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 1 -- start start 2024-09-13T10:33:31.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 10 monclient: init 2024-09-13T10:33:31.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:31.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 10 monclient: _add_conns ranks=[3,2,6,0,4,7,5,1,8] 2024-09-13T10:33:31.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 10 monclient(hunting): picked mon.noname-g con 0x7f08000a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:31.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 10 monclient(hunting): picked mon.noname-b con 0x7f08000a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:31.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 10 monclient(hunting): picked mon.noname-d con 0x7f080013f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:31.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0800143040 con 0x7f08000a6ab0 2024-09-13T10:33:31.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08000a28e0 con 0x7f08000a66d0 2024-09-13T10:33:31.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f080013ee90 con 0x7f080013f9a0 2024-09-13T10:33:31.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:31.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f0807e08640 10 monclient(hunting): authenticate will time out at 950.954763s 2024-09-13T10:33:31.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f08053a3640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f08000a6ab0 0x7f08001d38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:43208/0 (socket says 172.21.15.181:43208) 2024-09-13T10:33:31.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.448+0000 7f08053a3640 1 -- 172.21.15.181:0/1797509626 learned_addr learned my addr 172.21.15.181:0/1797509626 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:31.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.450+0000 7f08063a5640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.181:6792/0 conn(0x7f080013f9a0 legacy=0x7f08001d6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.450+0000 7f08053a3640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.181:6790/0 conn(0x7f08000a6ab0 legacy=0x7f08001d38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f0805ba4640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.195:6790/0 conn(0x7f08000a66d0 legacy=0x7f0800136730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2660982324 0 0) 0x7f080013ee90 con 0x7f080013f9a0 2024-09-13T10:33:31.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): my global_id is 5451 2024-09-13T10:33:31.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07e4003520 con 0x7f080013f9a0 2024-09-13T10:33:31.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522771924 0 0) 0x7f0800143040 con 0x7f08000a6ab0 2024-09-13T10:33:31.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): my global_id is 65009 2024-09-13T10:33:31.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f080013ee90 con 0x7f08000a6ab0 2024-09-13T10:33:31.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517401566 0 0) 0x7f08000a28e0 con 0x7f08000a66d0 2024-09-13T10:33:31.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): my global_id is 5403 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0800143040 con 0x7f08000a66d0 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2566697405 0 0) 0x7f07e4003520 con 0x7f080013f9a0 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08000a28e0 con 0x7f080013f9a0 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f07f8002060 con 0x7f080013f9a0 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): dump: 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.471 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.472 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.472 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.472 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.472 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.472 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.472 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.472 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.472 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.472 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.472 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1115223561 0 0) 0x7f080013ee90 con 0x7f08000a6ab0 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07e4003520 con 0x7f08000a6ab0 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f07f0001c10 con 0x7f08000a6ab0 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): dump: 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.473 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 109190529 0 0) 0x7f0800143040 con 0x7f08000a66d0 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f080013ee90 con 0x7f08000a66d0 2024-09-13T10:33:31.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f07fc004e10 con 0x7f08000a66d0 2024-09-13T10:33:31.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:31.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:33:31.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient(hunting): dump: 2024-09-13T10:33:31.475 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.475 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.475 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.475 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.475 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.475 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.475 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.475 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.475 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.476 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.476 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.476 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.476 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.476 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.476 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.476 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1349871530 0 0) 0x7f08000a28e0 con 0x7f080013f9a0 2024-09-13T10:33:31.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.195:6790/0 conn(0x7f08000a66d0 legacy=0x7f0800136730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.181:6790/0 conn(0x7f08000a6ab0 legacy=0x7f08001d38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 monclient: found mon.d 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080013f170 con 0x7f080013f9a0 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient: _finish_auth 0 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f0807e08640 5 monclient: authenticate success, global_id 5451 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f0807e08640 10 monclient: _renew_subs 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f0807e08640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f0807e08640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0800068da0 con 0x7f080013f9a0 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f0807e08640 10 monclient: _renew_subs 2024-09-13T10:33:31.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f0807e08640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f0807e08640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f080013df30 con 0x7f080013f9a0 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f07f8003d50 con 0x7f080013f9a0 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f07f8004280 con 0x7f080013f9a0 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f7fff640 4 set_mon_vals no callback set 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.451+0000 7f07f67fc640 10 monclient: dump: 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.478 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.452+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f07f8004420 con 0x7f080013f9a0 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.452+0000 7f0807e08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:31.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.452+0000 7f0807e08640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f07e80065c0 con 0x7f07e8002860 2024-09-13T10:33:31.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.452+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(114..114 src has 1..114) ==== 3898+0+0 (unknown 1798955111 0 0) 0x7f07f804e5e0 con 0x7f080013f9a0 2024-09-13T10:33:31.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.452+0000 7f08053a3640 10 monclient: get_auth_request con 0x7f07e40404c0 auth_method 0 2024-09-13T10:33:31.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.454+0000 7f0805ba4640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.195:6791/0 conn(0x7f07e8002860 legacy=0x7f07e8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1390917917 0 0) 0x7f07e80065c0 con 0x7f07e8002860 2024-09-13T10:33:31.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 10 monclient(hunting): my global_id is 5540 2024-09-13T10:33:31.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08000a28e0 con 0x7f07e8002860 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1371239461 0 0) 0x7f08000a28e0 con 0x7f07e8002860 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07e80065c0 con 0x7f07e8002860 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f07fc001580 con 0x7f07e8002860 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 10 monclient: dump: 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.481 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1550193951 0 0) 0x7f07e80065c0 con 0x7f07e8002860 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07e800a160 con 0x7f07e8002860 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f07fc001a80 con 0x7f07e8002860 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:31.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:31.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.195:6791/0 conn(0x7f07e8002860 legacy=0x7f07e8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.455+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.195:6791/0 conn(0x7f07e8002860 legacy=0x7f07e8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:31.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.461+0000 7f0807e08640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:31.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.461+0000 7f0807e08640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f07e8009e70 con 0x7f07e8009130 2024-09-13T10:33:31.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f0805ba4640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.195:6791/0 conn(0x7f07e8009130 legacy=0x7f07e80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000411055 0 0) 0x7f07e8009e70 con 0x7f07e8009130 2024-09-13T10:33:31.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 10 monclient(hunting): my global_id is 5549 2024-09-13T10:33:31.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07e80065c0 con 0x7f07e8009130 2024-09-13T10:33:31.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 823957638 0 0) 0x7f07e80065c0 con 0x7f07e8009130 2024-09-13T10:33:31.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07e8009e70 con 0x7f07e8009130 2024-09-13T10:33:31.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f07fc005a80 con 0x7f07e8009130 2024-09-13T10:33:31.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:31.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:31.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 10 monclient: dump: 2024-09-13T10:33:31.486 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.486 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.486 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.486 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.486 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.486 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.486 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.486 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.486 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.486 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.486 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.487 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.487 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.487 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.487 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.487 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2356272280 0 0) 0x7f07e8009e70 con 0x7f07e8009130 2024-09-13T10:33:31.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.464+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f07e800c410 con 0x7f07e8009130 2024-09-13T10:33:31.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 632371917) 0x7f07fc006ef0 con 0x7f07e8009130 2024-09-13T10:33:31.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f07f67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:31.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f07f67fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:31.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.195:6791/0 conn(0x7f07e8009130 legacy=0x7f07e80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f07f67fc640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.195:6791/0 conn(0x7f07e8009130 legacy=0x7f07e80095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:31.488 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:31.488 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:31.488 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:31.488 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:31.488 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:31.488 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 225893, 2024-09-13T10:33:31.488 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:31.489 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:31.489 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:31.489 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:31.489 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:31.489 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:31.489 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:31.489 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:31.489 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:31.489 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:31.489 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.489 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:33:31.489 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:31.490 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:31.490 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:31.490 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:31.490 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:31.490 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:31.490 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:31.490 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:31.490 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:31.490 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:31.490 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:31.490 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:31.490 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:31.491 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:31.492 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:31.493 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:31.493 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:31.493 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:31.493 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:31.493 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:31.493 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:31.493 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:31.493 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:31.493 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:31.493 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:31.493 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:31.493 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.494 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:31.495 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:31.495 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.495 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.495 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.495 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:31.495 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.495 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.495 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.495 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:31.495 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.496 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.497 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.497 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:31.497 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:31.497 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.497 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.497 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.497 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:31.497 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:31.497 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.498 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.499 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:31.500 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:31.500 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.500 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.500 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.500 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:31.500 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:31.500 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.500 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.501 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.501 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:31.501 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.501 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.501 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.501 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:31.501 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:31.501 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.501 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.501 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.502 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:31.503 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.504 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.504 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.504 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:31.504 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:31.504 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.504 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.504 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.504 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.505 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.506 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:31.507 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:31.508 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:31.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f0807e08640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.195:6800/1839191919 conn(0x7f07e40404c0 legacy=0x7f07e4042980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f0807e08640 10 monclient: shutdown 2024-09-13T10:33:31.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f0807e08640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:31.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f0807e08640 1 -- 172.21.15.181:0/1797509626 >> v1:172.21.15.181:6792/0 conn(0x7f080013f9a0 legacy=0x7f08001d6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f08063a5640 1 -- 172.21.15.181:0/1797509626 reap_dead start 2024-09-13T10:33:31.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f08063a5640 1 -- 172.21.15.181:0/1797509626 reap_dead start 2024-09-13T10:33:31.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f0807e08640 1 -- 172.21.15.181:0/1797509626 shutdown_connections 2024-09-13T10:33:31.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f0807e08640 1 -- 172.21.15.181:0/1797509626 >> 172.21.15.181:0/1797509626 conn(0x7f08000abcd0 msgr2=0x7f0800137bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:31.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f0807e08640 1 -- 172.21.15.181:0/1797509626 shutdown_connections 2024-09-13T10:33:31.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.465+0000 7f0807e08640 1 -- 172.21.15.181:0/1797509626 wait complete. 2024-09-13T10:33:31.511 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:31.511 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:33:31.511 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:33:31.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.606+0000 7fa1934a2640 10 monclient: get_monmap_and_config 2024-09-13T10:33:31.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.606+0000 7fa1934a2640 10 monclient: build_initial_monmap 2024-09-13T10:33:31.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.606+0000 7fa1934a2640 10 monclient: monmap: 2024-09-13T10:33:31.609 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:31.608362+0000 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:31.608362+0000 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:31.610 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:31.611 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:31.611 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.607+0000 7fa1934a2640 1 Processor -- start 2024-09-13T10:33:31.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.607+0000 7fa1934a2640 1 -- start start 2024-09-13T10:33:31.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.607+0000 7fa1934a2640 10 monclient: init 2024-09-13T10:33:31.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.607+0000 7fa1934a2640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:31.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.607+0000 7fa1934a2640 10 monclient: _add_conns ranks=[3,1,4,5,7,8,6,0,2] 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.607+0000 7fa1934a2640 10 monclient(hunting): picked mon.noname-g con 0x7fa18c0a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.608+0000 7fa1934a2640 10 monclient(hunting): picked mon.noname-f con 0x7fa18c0a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.608+0000 7fa1934a2640 10 monclient(hunting): picked mon.noname-c con 0x7fa18c13f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.608+0000 7fa1934a2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18c0a4bc0 con 0x7fa18c0a8340 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.608+0000 7fa1934a2640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18c13a320 con 0x7fa18c0a6640 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.608+0000 7fa1934a2640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18c0a8100 con 0x7fa18c13f750 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.608+0000 7fa1934a2640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.608+0000 7fa1934a2640 10 monclient(hunting): authenticate will time out at 951.114102s 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.608+0000 7fa191a3f640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fa18c13f750 0x7fa18c141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47826/0 (socket says 172.21.15.181:47826) 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.608+0000 7fa191a3f640 1 -- 172.21.15.181:0/3959170838 learned_addr learned my addr 172.21.15.181:0/3959170838 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa191a3f640 1 -- 172.21.15.181:0/3959170838 >> v1:172.21.15.181:6791/0 conn(0x7fa18c13f750 legacy=0x7fa18c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 1 -- 172.21.15.181:0/3959170838 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1142977309 0 0) 0x7fa18c0a8100 con 0x7fa18c13f750 2024-09-13T10:33:31.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient(hunting): my global_id is 5539 2024-09-13T10:33:31.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 1 -- 172.21.15.181:0/3959170838 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa178003520 con 0x7fa18c13f750 2024-09-13T10:33:31.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa19123e640 1 -- 172.21.15.181:0/3959170838 >> v1:172.21.15.195:6790/0 conn(0x7fa18c0a6640 legacy=0x7fa18c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa190a3d640 1 -- 172.21.15.181:0/3959170838 >> v1:172.21.15.195:6789/0 conn(0x7fa18c0a8340 legacy=0x7fa18c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 1 -- 172.21.15.181:0/3959170838 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2075421074 0 0) 0x7fa178003520 con 0x7fa18c13f750 2024-09-13T10:33:31.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 1 -- 172.21.15.181:0/3959170838 >> v1:172.21.15.195:6790/0 conn(0x7fa18c0a6640 legacy=0x7fa18c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 1 -- 172.21.15.181:0/3959170838 >> v1:172.21.15.195:6789/0 conn(0x7fa18c0a8340 legacy=0x7fa18c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient: _finish_hunting 0 2024-09-13T10:33:31.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 1 monclient: found mon.noname-c 2024-09-13T10:33:31.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:31.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:33:31.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 1 -- 172.21.15.181:0/3959170838 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c0a48e0 con 0x7fa18c13f750 2024-09-13T10:33:31.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient: _finish_auth 0 2024-09-13T10:33:31.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient: _check_auth_tickets 2024-09-13T10:33:31.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:31.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa1934a2640 5 monclient: authenticate success, global_id 5539 2024-09-13T10:33:31.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa1934a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:31.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 1 -- 172.21.15.181:0/3959170838 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa184001e60 con 0x7fa18c13f750 2024-09-13T10:33:31.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:31.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:31.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient: dump: 2024-09-13T10:33:31.621 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.621 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.621 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.621 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.621 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.621 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.621 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.621 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.621 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.622 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.622 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.622 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.622 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.622 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.622 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.622 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa1934a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:31.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 1 -- 172.21.15.181:0/3959170838 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa184004c20 con 0x7fa18c13f750 2024-09-13T10:33:31.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:31.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 1 -- 172.21.15.181:0/3959170838 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa184005150 con 0x7fa18c13f750 2024-09-13T10:33:31.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa1934a2640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:31.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa1934a2640 4 set_mon_vals no callback set 2024-09-13T10:33:31.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:31.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:31.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.610+0000 7fa183fff640 10 monclient: dump: 2024-09-13T10:33:31.623 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.623 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.623 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.623 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.623 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.623 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.623 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.611+0000 7fa1934a2640 10 monclient: shutdown 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.611+0000 7fa1934a2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.611+0000 7fa1934a2640 1 -- 172.21.15.181:0/3959170838 >> v1:172.21.15.181:6791/0 conn(0x7fa18c13f750 legacy=0x7fa18c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.611+0000 7fa1934a2640 1 -- 172.21.15.181:0/3959170838 shutdown_connections 2024-09-13T10:33:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.611+0000 7fa1934a2640 1 -- 172.21.15.181:0/3959170838 >> 172.21.15.181:0/3959170838 conn(0x7fa18c077170 msgr2=0x7fa18c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.611+0000 7fa1934a2640 1 -- 172.21.15.181:0/3959170838 shutdown_connections 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.611+0000 7fa1934a2640 1 -- 172.21.15.181:0/3959170838 wait complete. 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.611+0000 7fa1934a2640 10 monclient: build_initial_monmap 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.611+0000 7fa1934a2640 10 monclient: monmap: 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:31.625 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:31.626 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:31.626 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:31.626 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:31.626 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:31.626 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:31.626 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 1 Processor -- start 2024-09-13T10:33:31.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 1 -- start start 2024-09-13T10:33:31.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 10 monclient: init 2024-09-13T10:33:31.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:31.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 10 monclient: _add_conns ranks=[7,4,1,3,6,2,8,0,5] 2024-09-13T10:33:31.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 10 monclient(hunting): picked mon.noname-i con 0x7fa18c0a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:31.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 10 monclient(hunting): picked mon.noname-c con 0x7fa18c13f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:31.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 10 monclient(hunting): picked mon.noname-f con 0x7fa18c142190 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:31.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18c142b20 con 0x7fa18c142190 2024-09-13T10:33:31.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18c13c540 con 0x7fa18c13f750 2024-09-13T10:33:31.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18c0aa030 con 0x7fa18c0a8340 2024-09-13T10:33:31.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:31.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa1934a2640 10 monclient(hunting): authenticate will time out at 951.118866s 2024-09-13T10:33:31.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa190a3d640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fa18c13f750 0x7fa18c1d3660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47838/0 (socket says 172.21.15.181:47838) 2024-09-13T10:33:31.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.612+0000 7fa190a3d640 1 -- 172.21.15.181:0/441911877 learned_addr learned my addr 172.21.15.181:0/441911877 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:31.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa190a3d640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.181:6791/0 conn(0x7fa18c13f750 legacy=0x7fa18c1d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289797350 0 0) 0x7fa18c13c540 con 0x7fa18c13f750 2024-09-13T10:33:31.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): my global_id is 5548 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa170003550 con 0x7fa18c13f750 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa191a3f640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.195:6789/0 conn(0x7fa18c142190 legacy=0x7fa18c1d6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa19123e640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.195:6792/0 conn(0x7fa18c0a8340 legacy=0x7fa18c1ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 800792199 0 0) 0x7fa170003550 con 0x7fa18c13f750 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa18c13c540 con 0x7fa18c13f750 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa17c003610 con 0x7fa18c13f750 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): dump: 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.634 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578577629 0 0) 0x7fa18c142b20 con 0x7fa18c142190 2024-09-13T10:33:31.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): my global_id is 55603 2024-09-13T10:33:31.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa170003550 con 0x7fa18c142190 2024-09-13T10:33:31.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046710717 0 0) 0x7fa18c0aa030 con 0x7fa18c0a8340 2024-09-13T10:33:31.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient(hunting): my global_id is 55501 2024-09-13T10:33:31.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa18c142b20 con 0x7fa18c0a8340 2024-09-13T10:33:31.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1027399751 0 0) 0x7fa18c13c540 con 0x7fa18c13f750 2024-09-13T10:33:31.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.195:6792/0 conn(0x7fa18c0a8340 legacy=0x7fa18c1ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.195:6789/0 conn(0x7fa18c142190 legacy=0x7fa18c1d6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 monclient: found mon.c 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c0a9c40 con 0x7fa18c13f750 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient: _finish_auth 0 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa1934a2640 5 monclient: authenticate success, global_id 5548 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa1934a2640 10 monclient: _renew_subs 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa1934a2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:31.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa1934a2640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa18c13c260 con 0x7fa18c13f750 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa17c003bd0 con 0x7fa18c13f750 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa17c004100 con 0x7fa18c13f750 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa181ffb640 10 monclient: dump: 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.638 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa1837fe640 4 set_mon_vals no callback set 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa1934a2640 10 monclient: _renew_subs 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa1934a2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.615+0000 7fa1934a2640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa18c1ced60 con 0x7fa18c13f750 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.616+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa17c0042a0 con 0x7fa18c13f750 2024-09-13T10:33:31.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.616+0000 7fa1934a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:31.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.616+0000 7fa1934a2640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa18c143260 con 0x7fa18c077170 2024-09-13T10:33:31.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.616+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(114..114 src has 1..114) ==== 3898+0+0 (unknown 1798955111 0 0) 0x7fa17c04e3d0 con 0x7fa18c13f750 2024-09-13T10:33:31.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.616+0000 7fa191a3f640 10 monclient: get_auth_request con 0x7fa17003fce0 auth_method 0 2024-09-13T10:33:31.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa19123e640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.195:6792/0 conn(0x7fa18c077170 legacy=0x7fa18c130a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 135208084 0 0) 0x7fa18c143260 con 0x7fa18c077170 2024-09-13T10:33:31.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 10 monclient(hunting): my global_id is 55510 2024-09-13T10:33:31.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa18c13c540 con 0x7fa18c077170 2024-09-13T10:33:31.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3176327434 0 0) 0x7fa18c13c540 con 0x7fa18c077170 2024-09-13T10:33:31.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa18c143260 con 0x7fa18c077170 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa188001d30 con 0x7fa18c077170 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 10 monclient: dump: 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.641 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1880040469 0 0) 0x7fa18c143260 con 0x7fa18c077170 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa18c1cf050 con 0x7fa18c077170 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa1880068b0 con 0x7fa18c077170 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:31.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.195:6792/0 conn(0x7fa18c077170 legacy=0x7fa18c130a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.619+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.195:6792/0 conn(0x7fa18c077170 legacy=0x7fa18c130a30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.625+0000 7fa1934a2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.625+0000 7fa1934a2640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa18c131850 con 0x7fa18c069b40 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa19123e640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.195:6792/0 conn(0x7fa18c069b40 legacy=0x7fa18c131140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 943093727 0 0) 0x7fa18c131850 con 0x7fa18c069b40 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 10 monclient(hunting): my global_id is 55519 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa18c143260 con 0x7fa18c069b40 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3523910001 0 0) 0x7fa18c143260 con 0x7fa18c069b40 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa18c131850 con 0x7fa18c069b40 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa188003f70 con 0x7fa18c069b40 2024-09-13T10:33:31.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 10 monclient: dump: 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:31.644 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:31.645 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:31.645 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:31.645 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:31.645 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:31.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1822891126 0 0) 0x7fa18c131850 con 0x7fa18c069b40 2024-09-13T10:33:31.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.628+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa18c1cf200 con 0x7fa18c069b40 2024-09-13T10:33:31.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 2107643735) 0x7fa1880042e0 con 0x7fa18c069b40 2024-09-13T10:33:31.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa181ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:31.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa181ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:31.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.195:6792/0 conn(0x7fa18c069b40 legacy=0x7fa18c131140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa181ffb640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.195:6792/0 conn(0x7fa18c069b40 legacy=0x7fa18c131140 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:31.649 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:31.649 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:31.649 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:31.649 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:31.649 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 72, 2024-09-13T10:33:31.649 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 226049, 2024-09-13T10:33:31.649 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:31.649 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:31.649 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:31.649 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:33:31.649 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:31.650 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:31.650 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:31.650 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:31.650 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:31.650 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:31.650 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.650 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:33:31.650 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:31.650 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:31.650 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:31.650 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:31.650 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:31.651 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:31.651 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:31.651 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:31.651 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:31.651 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:31.651 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:31.651 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:31.651 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:31.651 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:31.651 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.651 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:31.651 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:31.652 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.653 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:31.653 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:31.653 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:31.653 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:31.653 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:31.653 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:31.653 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:31.654 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:31.654 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:31.654 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:31.654 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:31.654 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:31.654 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:31.654 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:31.654 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:31.654 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:31.654 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:31.654 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:31.654 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:31.655 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:31.655 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:31.655 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:31.655 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:31.655 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:31.655 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:31.655 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:31.655 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:31.655 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:31.655 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.655 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:31.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.657 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:31.658 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.658 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.658 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.658 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:31.658 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:31.658 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.660 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:31.662 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:31.663 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.663 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.663 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.663 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:31.663 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:31.663 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.663 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.663 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.663 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:31.664 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.665 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.666 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:31.667 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.668 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:31.669 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.670 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:31.670 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:31.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:31.670 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:31.670 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:31.670 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:31.670 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:31.670 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:31.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:31.670 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:31.670 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:31.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa1934a2640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa17003fce0 legacy=0x7fa1700421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa1934a2640 10 monclient: shutdown 2024-09-13T10:33:31.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa1934a2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:31.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa1934a2640 1 -- 172.21.15.181:0/441911877 >> v1:172.21.15.181:6791/0 conn(0x7fa18c13f750 legacy=0x7fa18c1d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:31.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa191a3f640 1 -- 172.21.15.181:0/441911877 reap_dead start 2024-09-13T10:33:31.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa191a3f640 1 -- 172.21.15.181:0/441911877 reap_dead start 2024-09-13T10:33:31.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa1934a2640 1 -- 172.21.15.181:0/441911877 shutdown_connections 2024-09-13T10:33:31.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa1934a2640 1 -- 172.21.15.181:0/441911877 >> 172.21.15.181:0/441911877 conn(0x7fa18c0a6640 msgr2=0x7fa18c0a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:31.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa1934a2640 1 -- 172.21.15.181:0/441911877 shutdown_connections 2024-09-13T10:33:31.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:31.629+0000 7fa1934a2640 1 -- 172.21.15.181:0/441911877 wait complete. 2024-09-13T10:33:31.673 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:33:31.673 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-13T10:33:31.673 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['e', 'h'] 2024-09-13T10:33:31.673 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-13T10:33:31.673 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-13T10:33:31.673 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T10:33:31.673 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:33:31.684 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T10:33:31.684 INFO:tasks.mon_thrash:Sending STOP to mon e 2024-09-13T10:33:31.684 INFO:tasks.ceph.mon.e:Sent signal 19 2024-09-13T10:33:31.685 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-09-13T10:33:31.685 INFO:tasks.ceph.mon.h:Sent signal 19 2024-09-13T10:33:31.685 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-13T10:33:46.685 INFO:tasks.mon_thrash:Sending CONT to mon e 2024-09-13T10:33:46.686 INFO:tasks.ceph.mon.e:Sent signal 18 2024-09-13T10:33:46.686 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-09-13T10:33:46.687 INFO:tasks.ceph.mon.h:Sent signal 18 2024-09-13T10:33:46.687 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-09-13T10:33:46.687 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:33:46.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.792+0000 7f3719d64640 10 monclient: get_monmap_and_config 2024-09-13T10:33:46.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.792+0000 7f3719d64640 10 monclient: build_initial_monmap 2024-09-13T10:33:46.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.792+0000 7f3719d64640 10 monclient: monmap: 2024-09-13T10:33:46.799 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:46.799 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:46.799 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:46.794174+0000 2024-09-13T10:33:46.799 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:46.794174+0000 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.793+0000 7f3719d64640 1 Processor -- start 2024-09-13T10:33:46.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.793+0000 7f3719d64640 1 -- start start 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.793+0000 7f3719d64640 10 monclient: init 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f3719d64640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f3719d64640 10 monclient: _add_conns ranks=[2,7,1,4,8,5,0,3,6] 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f3719d64640 10 monclient(hunting): picked mon.noname-b con 0x7f37140a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f3719d64640 10 monclient(hunting): picked mon.noname-i con 0x7f37140a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f3719d64640 10 monclient(hunting): picked mon.noname-f con 0x7f371413f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f3719d64640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37140a4bc0 con 0x7f371413f750 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f3719d64640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371413a320 con 0x7f37140a6640 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f3719d64640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37140a8100 con 0x7f37140a8340 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f3719d64640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f3719d64640 10 monclient(hunting): authenticate will time out at 966.300149s 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f37137fe640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f37140a6640 legacy=0x7f3714139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f3713fff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f371413f750 0x7f3714141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:38718/0 (socket says 172.21.15.181:38718) 2024-09-13T10:33:46.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.794+0000 7f3713fff640 1 -- 172.21.15.181:0/755352651 learned_addr learned my addr 172.21.15.181:0/755352651 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:46.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.796+0000 7f3713fff640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.195:6789/0 conn(0x7f371413f750 legacy=0x7f3714141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:46.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.796+0000 7f370bfff640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.195:6792/0 conn(0x7f37140a8340 legacy=0x7f3714139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:46.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:46.995+0000 7f37137fe640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.181:6790/0 conn(0x7f37140a6640 legacy=0x7f3714139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:47.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:47.396+0000 7f37137fe640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.181:6790/0 conn(0x7f37140a6640 legacy=0x7f3714139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:48.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:48.198+0000 7f37137fe640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.181:6790/0 conn(0x7f37140a6640 legacy=0x7f3714139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:49.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 10 monclient(hunting): tick 2024-09-13T10:33:49.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:33:49.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 1 monclient(hunting): continuing hunt 2024-09-13T10:33:49.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:33:49.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.195:6792/0 conn(0x7f37140a8340 legacy=0x7f3714139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:49.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.181:6790/0 conn(0x7f37140a6640 legacy=0x7f3714139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:33:49.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.195:6789/0 conn(0x7f371413f750 legacy=0x7f3714141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:49.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 10 monclient: _add_conns ranks=[6,3,5,4,0,8] 2024-09-13T10:33:49.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 10 monclient(hunting): picked mon.noname-d con 0x7f36f40038c0 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:49.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 10 monclient(hunting): picked mon.noname-g con 0x7f36f4007550 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:49.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 10 monclient(hunting): picked mon.noname-h con 0x7f36f400b2c0 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:49.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 1 -- 172.21.15.181:0/755352651 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37140a48e0 con 0x7f36f4007550 2024-09-13T10:33:49.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 1 -- 172.21.15.181:0/755352651 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371413a320 con 0x7f36f400b2c0 2024-09-13T10:33:49.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 1 -- 172.21.15.181:0/755352651 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f4011110 con 0x7f36f40038c0 2024-09-13T10:33:49.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.794+0000 7f3711ffb640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:49.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.796+0000 7f37137fe640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.181:6792/0 conn(0x7f36f40038c0 legacy=0x7f36f4005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:49.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.796+0000 7f370bfff640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.195:6790/0 conn(0x7f36f4007550 legacy=0x7f36f4009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:49.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:49.796+0000 7f3713fff640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.195:6791/0 conn(0x7f36f400b2c0 legacy=0x7f36f400d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:51.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.303+0000 7f3712ffd640 1 -- 172.21.15.181:0/755352651 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1633956699 0 0) 0x7f36f4011110 con 0x7f36f40038c0 2024-09-13T10:33:51.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.303+0000 7f3712ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.303+0000 7f3712ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.303+0000 7f3712ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.303+0000 7f3712ffd640 10 monclient(hunting): my global_id is 5460 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 1 -- 172.21.15.181:0/755352651 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3700003520 con 0x7f36f40038c0 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 1 -- 172.21.15.181:0/755352651 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812163477 0 0) 0x7f371413a320 con 0x7f36f400b2c0 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient(hunting): my global_id is 5558 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 1 -- 172.21.15.181:0/755352651 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36f4011110 con 0x7f36f400b2c0 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 1 -- 172.21.15.181:0/755352651 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4020918565 0 0) 0x7f3700003520 con 0x7f36f40038c0 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.195:6791/0 conn(0x7f36f400b2c0 legacy=0x7f36f400d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:51.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.195:6790/0 conn(0x7f36f4007550 legacy=0x7f36f4009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 1 monclient: found mon.noname-d 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 1 -- 172.21.15.181:0/755352651 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f4012470 con 0x7f36f40038c0 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3713fff640 1 -- 172.21.15.181:0/755352651 reap_dead start 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient: _finish_auth 0 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 1 -- 172.21.15.181:0/755352651 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3704004640 con 0x7f36f40038c0 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3719d64640 5 monclient: authenticate success, global_id 5460 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3719d64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:51.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient: dump: 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:51.311 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3719d64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 1 -- 172.21.15.181:0/755352651 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f37040048e0 con 0x7f36f40038c0 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 1 -- 172.21.15.181:0/755352651 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3704004e10 con 0x7f36f40038c0 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3719d64640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3719d64640 4 set_mon_vals no callback set 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:51.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.304+0000 7f3712ffd640 10 monclient: dump: 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:51.313 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.305+0000 7f3719d64640 10 monclient: shutdown 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.305+0000 7f3719d64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.305+0000 7f3719d64640 1 -- 172.21.15.181:0/755352651 >> v1:172.21.15.181:6792/0 conn(0x7f36f40038c0 legacy=0x7f36f4005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.305+0000 7f3719d64640 1 -- 172.21.15.181:0/755352651 shutdown_connections 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.305+0000 7f3719d64640 1 -- 172.21.15.181:0/755352651 >> 172.21.15.181:0/755352651 conn(0x7f3714077170 msgr2=0x7f37140abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.305+0000 7f3719d64640 1 -- 172.21.15.181:0/755352651 shutdown_connections 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.305+0000 7f3719d64640 1 -- 172.21.15.181:0/755352651 wait complete. 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.306+0000 7f3719d64640 10 monclient: build_initial_monmap 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.306+0000 7f3719d64640 10 monclient: monmap: 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:51.314 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:51.315 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:51.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.306+0000 7f3719d64640 1 Processor -- start 2024-09-13T10:33:51.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.306+0000 7f3719d64640 1 -- start start 2024-09-13T10:33:51.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.306+0000 7f3719d64640 10 monclient: init 2024-09-13T10:33:51.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f3719d64640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:51.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f3719d64640 10 monclient: _add_conns ranks=[2,8,1,0,6,7,4,5,3] 2024-09-13T10:33:51.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f3719d64640 10 monclient(hunting): picked mon.noname-b con 0x7f37141cdf10 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:51.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f3719d64640 10 monclient(hunting): picked mon.noname-e con 0x7f37140a1680 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f3719d64640 10 monclient(hunting): picked mon.noname-f con 0x7f37141d4950 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f37137fe640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f37141cdf10 legacy=0x7f3714136bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f3719d64640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371413f250 con 0x7f37141d4950 2024-09-13T10:33:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f3719d64640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3714122570 con 0x7f37141cdf10 2024-09-13T10:33:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f3719d64640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37141372e0 con 0x7f37140a1680 2024-09-13T10:33:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f3719d64640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f3719d64640 10 monclient(hunting): authenticate will time out at 970.813504s 2024-09-13T10:33:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f370bfff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f37140a1680 0x7f37141d3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:44116/0 (socket says 172.21.15.181:44116) 2024-09-13T10:33:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.307+0000 7f370bfff640 1 -- 172.21.15.181:0/4215320395 learned_addr learned my addr 172.21.15.181:0/4215320395 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.309+0000 7f370bfff640 1 -- 172.21.15.181:0/4215320395 >> v1:172.21.15.181:6793/0 conn(0x7f37140a1680 legacy=0x7f37141d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:51.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.309+0000 7f3713fff640 1 -- 172.21.15.181:0/4215320395 >> v1:172.21.15.195:6789/0 conn(0x7f37141d4950 legacy=0x7f37141d6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:51.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.508+0000 7f37137fe640 1 -- 172.21.15.181:0/4215320395 >> v1:172.21.15.181:6790/0 conn(0x7f37141cdf10 legacy=0x7f3714136bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:51.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 411525263 0 0) 0x7f371413f250 con 0x7f37141d4950 2024-09-13T10:33:51.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:51.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:51.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:51.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 10 monclient(hunting): my global_id is 55612 2024-09-13T10:33:51.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36f400f0f0 con 0x7f37141d4950 2024-09-13T10:33:51.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2886200281 0 0) 0x7f36f400f0f0 con 0x7f37141d4950 2024-09-13T10:33:51.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f371413f250 con 0x7f37141d4950 2024-09-13T10:33:51.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f370c001e80 con 0x7f37141d4950 2024-09-13T10:33:51.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:51.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:33:51.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 10 monclient(hunting): dump: 2024-09-13T10:33:51.852 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:51.852 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:51.852 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:51.852 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:51.852 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:51.852 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.846+0000 7f3710ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1052771485 0 0) 0x7f371413f250 con 0x7f37141d4950 2024-09-13T10:33:51.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 >> v1:172.21.15.181:6793/0 conn(0x7f37140a1680 legacy=0x7f37141d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:51.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 >> v1:172.21.15.181:6790/0 conn(0x7f37141cdf10 legacy=0x7f3714136bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:33:51.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:33:51.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 1 monclient: found mon.f 2024-09-13T10:33:51.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:51.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:33:51.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37141db490 con 0x7f37141d4950 2024-09-13T10:33:51.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 10 monclient: _finish_auth 0 2024-09-13T10:33:51.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:33:51.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:51.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3719d64640 5 monclient: authenticate success, global_id 55612 2024-09-13T10:33:51.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3719d64640 10 monclient: _renew_subs 2024-09-13T10:33:51.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3719d64640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3719d64640 1 -- 172.21.15.181:0/4215320395 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f37141d8460 con 0x7f37141d4950 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3719d64640 10 monclient: _renew_subs 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f370c004e10 con 0x7f37141d4950 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3719d64640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3719d64640 1 -- 172.21.15.181:0/4215320395 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f37141d8980 con 0x7f37141d4950 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f370c005300 con 0x7f37141d4950 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f37127fc640 4 set_mon_vals no callback set 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.847+0000 7f3710ff9640 10 monclient: dump: 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:51.855 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:51.856 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:51.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.848+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f370c011980 con 0x7f37141d4950 2024-09-13T10:33:51.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.848+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(114..114 src has 1..114) ==== 3898+0+0 (unknown 1798955111 0 0) 0x7f370c04e230 con 0x7f37141d4950 2024-09-13T10:33:51.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.848+0000 7f37137fe640 10 monclient: get_auth_request con 0x7f36f40411e0 auth_method 0 2024-09-13T10:33:51.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.848+0000 7f3719d64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:51.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.848+0000 7f3719d64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:51.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.848+0000 7f3719d64640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:33:51.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.848+0000 7f3719d64640 1 -- 172.21.15.181:0/4215320395 --> v1:172.21.15.195:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37141ce900 con 0x7f37141d4950 2024-09-13T10:33:51.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.853+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 <== mon.1 v1:172.21.15.195:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f370c017660 con 0x7f37141d4950 2024-09-13T10:33:51.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.853+0000 7f3710ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:51.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:51.853+0000 7f3710ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:52.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.098+0000 7f3719d64640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:33:52.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.098+0000 7f3719d64640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:33:52.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.098+0000 7f3719d64640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:33:52.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.098+0000 7f3719d64640 1 -- 172.21.15.181:0/4215320395 --> v1:172.21.15.195:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3714139500 con 0x7f37141d4950 2024-09-13T10:33:52.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.099+0000 7f3710ff9640 1 -- 172.21.15.181:0/4215320395 <== mon.1 v1:172.21.15.195:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2732 (unknown 254746657 0 1240016369) 0x7f370c016f60 con 0x7f37141d4950 2024-09-13T10:33:52.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.099+0000 7f3710ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:33:52.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.099+0000 7f3710ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:52.102 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":78,"quorum":[0,1,3,4,5,6,7],"quorum_names":["a","f","g","c","h","d","i"],"quorum_leader_name":"g","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:33:52.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.101+0000 7f3719d64640 1 -- 172.21.15.181:0/4215320395 >> v1:172.21.15.195:6800/1839191919 conn(0x7f36f40411e0 legacy=0x7f36f40436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:52.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.101+0000 7f3719d64640 10 monclient: shutdown 2024-09-13T10:33:52.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.101+0000 7f3719d64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:52.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.101+0000 7f3719d64640 1 -- 172.21.15.181:0/4215320395 >> v1:172.21.15.195:6789/0 conn(0x7f37141d4950 legacy=0x7f37141d6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:52.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.101+0000 7f3719d64640 1 -- 172.21.15.181:0/4215320395 shutdown_connections 2024-09-13T10:33:52.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.101+0000 7f3719d64640 1 -- 172.21.15.181:0/4215320395 >> 172.21.15.181:0/4215320395 conn(0x7f36f40038c0 msgr2=0x7f37140a6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:52.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.101+0000 7f3719d64640 1 -- 172.21.15.181:0/4215320395 shutdown_connections 2024-09-13T10:33:52.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:52.101+0000 7f3719d64640 1 -- 172.21.15.181:0/4215320395 wait complete. 2024-09-13T10:33:52.330 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:52.331 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37171]: starting. 2024-09-13T10:33:52.331 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37171]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37133 2024-09-13T10:33:52.331 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37171]: shutting down. 2024-09-13T10:33:52.331 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:52.332 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:33:52.332 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:33:52.334 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:33:55.115 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:33:55.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.220+0000 7fe4d875d640 10 monclient: get_monmap_and_config 2024-09-13T10:33:55.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.220+0000 7fe4d875d640 10 monclient: build_initial_monmap 2024-09-13T10:33:55.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.220+0000 7fe4d875d640 10 monclient: monmap: 2024-09-13T10:33:55.223 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:55.223 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:55.223 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:55.222503+0000 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:55.222503+0000 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:55.224 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:55.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.221+0000 7fe4d875d640 1 Processor -- start 2024-09-13T10:33:55.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.221+0000 7fe4d875d640 1 -- start start 2024-09-13T10:33:55.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.221+0000 7fe4d875d640 10 monclient: init 2024-09-13T10:33:55.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d875d640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:55.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d875d640 10 monclient: _add_conns ranks=[1,5,3,2,6,0,7,4,8] 2024-09-13T10:33:55.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d875d640 10 monclient(hunting): picked mon.noname-f con 0x7fe4d00a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:55.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d875d640 10 monclient(hunting): picked mon.noname-h con 0x7fe4d00a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:55.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d875d640 10 monclient(hunting): picked mon.noname-g con 0x7fe4d013f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:55.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d875d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d00a4bc0 con 0x7fe4d00a6640 2024-09-13T10:33:55.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d875d640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d013a320 con 0x7fe4d013f750 2024-09-13T10:33:55.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d875d640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d00a8100 con 0x7fe4d00a8340 2024-09-13T10:33:55.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d875d640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:55.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d875d640 10 monclient(hunting): authenticate will time out at 974.728337s 2024-09-13T10:33:55.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d64f9640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe4d00a6640 0x7fe4d0139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:48006/0 (socket says 172.21.15.181:48006) 2024-09-13T10:33:55.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d6cfa640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7fe4d013f750 0x7fe4d0141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:34068/0 (socket says 172.21.15.181:34068) 2024-09-13T10:33:55.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d64f9640 1 -- 172.21.15.181:0/3592994217 learned_addr learned my addr 172.21.15.181:0/3592994217 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:55.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.222+0000 7fe4d5cf8640 1 --1- 172.21.15.181:0/3592994217 >> v1:172.21.15.195:6791/0 conn(0x7fe4d00a8340 0x7fe4d0139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:37014/0 (socket says 172.21.15.181:37014) 2024-09-13T10:33:55.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.224+0000 7fe4d6cfa640 1 -- 172.21.15.181:0/3592994217 >> v1:172.21.15.195:6790/0 conn(0x7fe4d013f750 legacy=0x7fe4d0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:55.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.224+0000 7fe4d64f9640 1 -- 172.21.15.181:0/3592994217 >> v1:172.21.15.195:6789/0 conn(0x7fe4d00a6640 legacy=0x7fe4d0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:55.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:55.224+0000 7fe4d5cf8640 1 -- 172.21.15.181:0/3592994217 >> v1:172.21.15.195:6791/0 conn(0x7fe4d00a8340 legacy=0x7fe4d0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:57.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 1 -- 172.21.15.181:0/3592994217 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3467232775 0 0) 0x7fe4d00a8100 con 0x7fe4d00a8340 2024-09-13T10:33:57.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient(hunting): _negotiate 2024-09-13T10:33:57.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:57.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:57.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient(hunting): my global_id is 5567 2024-09-13T10:33:57.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 1 -- 172.21.15.181:0/3592994217 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4b8003520 con 0x7fe4d00a8340 2024-09-13T10:33:57.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 1 -- 172.21.15.181:0/3592994217 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481619633 0 0) 0x7fe4d00a4bc0 con 0x7fe4d00a6640 2024-09-13T10:33:57.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient(hunting): _negotiate 2024-09-13T10:33:57.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:57.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:57.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient(hunting): my global_id is 55621 2024-09-13T10:33:57.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 1 -- 172.21.15.181:0/3592994217 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4d00a8100 con 0x7fe4d00a6640 2024-09-13T10:33:57.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 1 -- 172.21.15.181:0/3592994217 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3980962288 0 0) 0x7fe4b8003520 con 0x7fe4d00a8340 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 1 -- 172.21.15.181:0/3592994217 >> v1:172.21.15.195:6790/0 conn(0x7fe4d013f750 legacy=0x7fe4d0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 1 -- 172.21.15.181:0/3592994217 >> v1:172.21.15.195:6789/0 conn(0x7fe4d00a6640 legacy=0x7fe4d0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient: _finish_hunting 0 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 1 monclient: found mon.noname-h 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.195:6791/0 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 1 -- 172.21.15.181:0/3592994217 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d00a48e0 con 0x7fe4d00a8340 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient: _finish_auth 0 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient: _check_auth_tickets 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 1 -- 172.21.15.181:0/3592994217 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe4c4001ae0 con 0x7fe4d00a8340 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.699+0000 7fe4d54f7640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.700+0000 7fe4d54f7640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:33:57.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.700+0000 7fe4d54f7640 10 monclient: dump: 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:57.706 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.700+0000 7fe4d875d640 5 monclient: authenticate success, global_id 5567 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.700+0000 7fe4d875d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.700+0000 7fe4d54f7640 1 -- 172.21.15.181:0/3592994217 <== mon.5 v1:172.21.15.195:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4c40047e0 con 0x7fe4d00a8340 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.700+0000 7fe4d54f7640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.700+0000 7fe4d54f7640 1 -- 172.21.15.181:0/3592994217 <== mon.5 v1:172.21.15.195:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe4c4004d50 con 0x7fe4d00a8340 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.700+0000 7fe4d875d640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.700+0000 7fe4d875d640 4 set_mon_vals no callback set 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.700+0000 7fe4d54f7640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.700+0000 7fe4d54f7640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.700+0000 7fe4d54f7640 10 monclient: dump: 2024-09-13T10:33:57.707 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:57.708 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:57.709 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.701+0000 7fe4d875d640 10 monclient: shutdown 2024-09-13T10:33:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.701+0000 7fe4d875d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.701+0000 7fe4d875d640 1 -- 172.21.15.181:0/3592994217 >> v1:172.21.15.195:6791/0 conn(0x7fe4d00a8340 legacy=0x7fe4d0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.701+0000 7fe4d875d640 1 -- 172.21.15.181:0/3592994217 shutdown_connections 2024-09-13T10:33:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.701+0000 7fe4d875d640 1 -- 172.21.15.181:0/3592994217 >> 172.21.15.181:0/3592994217 conn(0x7fe4d0077170 msgr2=0x7fe4d00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.701+0000 7fe4d875d640 1 -- 172.21.15.181:0/3592994217 shutdown_connections 2024-09-13T10:33:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.701+0000 7fe4d875d640 1 -- 172.21.15.181:0/3592994217 wait complete. 2024-09-13T10:33:57.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.702+0000 7fe4d875d640 10 monclient: build_initial_monmap 2024-09-13T10:33:57.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.702+0000 7fe4d875d640 10 monclient: monmap: 2024-09-13T10:33:57.711 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:57.711 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:57.711 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:57.711 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:57.711 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.702+0000 7fe4d875d640 1 Processor -- start 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.702+0000 7fe4d875d640 1 -- start start 2024-09-13T10:33:57.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.702+0000 7fe4d875d640 10 monclient: init 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d875d640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d875d640 10 monclient: _add_conns ranks=[2,3,5,0,4,8,1,7,6] 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d875d640 10 monclient(hunting): picked mon.noname-b con 0x7fe4d00a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d875d640 10 monclient(hunting): picked mon.noname-g con 0x7fe4d013f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d875d640 10 monclient(hunting): picked mon.noname-h con 0x7fe4d01d4a20 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d875d640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d01420d0 con 0x7fe4d00a8340 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d875d640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d013c420 con 0x7fe4d013f750 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d875d640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d013c700 con 0x7fe4d01d4a20 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d875d640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d64f9640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fe4d00a8340 legacy=0x7fe4d013e190 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d875d640 10 monclient(hunting): authenticate will time out at 977.209415s 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d6cfa640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7fe4d01d4a20 0x7fe4d01d6e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:37026/0 (socket says 172.21.15.181:37026) 2024-09-13T10:33:57.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.703+0000 7fe4d6cfa640 1 -- 172.21.15.181:0/3585261728 learned_addr learned my addr 172.21.15.181:0/3585261728 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:57.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.705+0000 7fe4d6cfa640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.195:6791/0 conn(0x7fe4d01d4a20 legacy=0x7fe4d01d6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:57.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.706+0000 7fe4d5cf8640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.195:6790/0 conn(0x7fe4d013f750 legacy=0x7fe4d01d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:57.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.711+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664680020 0 0) 0x7fe4d013c700 con 0x7fe4d01d4a20 2024-09-13T10:33:57.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.711+0000 7fe4ceffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:57.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.711+0000 7fe4ceffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:57.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.711+0000 7fe4ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:57.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.711+0000 7fe4ceffd640 10 monclient(hunting): my global_id is 5576 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.711+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4bc003550 con 0x7fe4d01d4a20 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 509930639 0 0) 0x7fe4bc003550 con 0x7fe4d01d4a20 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4d013c700 con 0x7fe4d01d4a20 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe4c8001ce0 con 0x7fe4d01d4a20 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 10 monclient(hunting): dump: 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:57.717 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4d6cfa640 1 --1- 172.21.15.181:0/3585261728 >> v1:172.21.15.195:6791/0 conn(0x7fe4d01d4a20 0x7fe4d01d6e10 :-1 s=OPENED pgs=312 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fe4d013c700 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1856191685 0 0) 0x7fe4d013c420 con 0x7fe4d013f750 2024-09-13T10:33:57.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 10 monclient(hunting): my global_id is 5439 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4bc003550 con 0x7fe4d013f750 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 127438705 0 0) 0x7fe4bc003550 con 0x7fe4d013f750 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4d013c420 con 0x7fe4d013f750 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.712+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe4c4004cd0 con 0x7fe4d013f750 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 10 monclient(hunting): dump: 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:57.719 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1416239917 0 0) 0x7fe4d013c420 con 0x7fe4d013f750 2024-09-13T10:33:57.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.195:6791/0 conn(0x7fe4d01d4a20 legacy=0x7fe4d01d6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.181:6790/0 conn(0x7fe4d00a8340 legacy=0x7fe4d013e190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 1 monclient: found mon.g 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d013c9e0 con 0x7fe4d013f750 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 10 monclient: _finish_auth 0 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4d875d640 5 monclient: authenticate success, global_id 5439 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 844862858 0 0) 0x7fe4d013c700 con 0x7fe4d01d4a20 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4d875d640 10 monclient: _renew_subs 2024-09-13T10:33:57.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4d875d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4d875d640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d013d6a0 con 0x7fe4d013f750 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4d875d640 10 monclient: _renew_subs 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4d875d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4d875d640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe4d013b500 con 0x7fe4d013f750 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4c4001d30 con 0x7fe4d013f750 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe4c4001b00 con 0x7fe4d013f750 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4d4cf6640 4 set_mon_vals no callback set 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.713+0000 7fe4ceffd640 10 monclient: dump: 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:57.722 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:57.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.714+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe4c4011b60 con 0x7fe4d013f750 2024-09-13T10:33:57.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.714+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(115..115 src has 1..115) ==== 3506+0+0 (unknown 2927416530 0 0) 0x7fe4c404e100 con 0x7fe4d013f750 2024-09-13T10:33:57.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.714+0000 7fe4d875d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:57.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.714+0000 7fe4d875d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:57.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.714+0000 7fe4d875d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:33:57.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.714+0000 7fe4d875d640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.195:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b0005080 con 0x7fe4d013f750 2024-09-13T10:33:57.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.715+0000 7fe4d64f9640 10 monclient: get_auth_request con 0x7fe4bc03ff70 auth_method 0 2024-09-13T10:33:57.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.720+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.3 v1:172.21.15.195:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fe4c401b7c0 con 0x7fe4d013f750 2024-09-13T10:33:57.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.720+0000 7fe4ceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:57.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.720+0000 7fe4ceffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:57.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.965+0000 7fe4d875d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:33:57.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4d875d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:33:57.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4d875d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:33:57.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4d875d640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.195:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe4b0005370 con 0x7fe4d013f750 2024-09-13T10:33:57.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4d5cf8640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.195:6790/0 conn(0x7fe4d013f750 legacy=0x7fe4d01d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-13T10:33:57.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4d5cf8640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.195:6790/0 conn(0x7fe4d013f750 legacy=0x7fe4d01d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4d5cf8640 1 --1- 172.21.15.181:0/3585261728 >> v1:172.21.15.195:6790/0 conn(0x7fe4d013f750 0x7fe4d01d3300 :-1 s=OPENED pgs=308 cs=1 l=1).handle_message read tag failed 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4d5cf8640 1 --1- 172.21.15.181:0/3585261728 >> v1:172.21.15.195:6790/0 conn(0x7fe4d013f750 0x7fe4d01d3300 :-1 s=OPENED pgs=308 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4ceffd640 10 monclient: ms_handle_reset current mon v1:172.21.15.195:6790/0 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4ceffd640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.195:6790/0 conn(0x7fe4d013f750 legacy=0x7fe4d01d3300 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4ceffd640 10 monclient: _add_conns ranks=[2,1,6,8,7,0,5,4,3] 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4ceffd640 10 monclient(hunting): picked mon.b con 0x7fe4d00a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4ceffd640 10 monclient(hunting): picked mon.f con 0x7fe4bc04a1f0 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4ceffd640 10 monclient(hunting): picked mon.d con 0x7fe4bc04e290 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe4d013c700 con 0x7fe4bc04a1f0 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe4d013c420 con 0x7fe4d00a8340 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe4d01420d0 con 0x7fe4bc04e290 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4ceffd640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:57.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.966+0000 7fe4d5cf8640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.181:6790/0 conn(0x7fe4d00a8340 legacy=0x7fe4bc0488a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:57.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.968+0000 7fe4d64f9640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.181:6792/0 conn(0x7fe4bc04e290 legacy=0x7fe4bc050750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:57.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:57.968+0000 7fe4d6cfa640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.195:6789/0 conn(0x7fe4bc04a1f0 legacy=0x7fe4bc04c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.044+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3395188482 0 0) 0x7fe4d01420d0 con 0x7fe4bc04e290 2024-09-13T10:33:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.044+0000 7fe4ceffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.044+0000 7fe4ceffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.044+0000 7fe4ceffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-13T10:33:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.044+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.181:6792/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fe4bc0523e0 con 0x7fe4bc04e290 2024-09-13T10:33:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 1062892558 0 0) 0x7fe4bc0523e0 con 0x7fe4bc04e290 2024-09-13T10:33:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.181:6790/0 conn(0x7fe4d00a8340 legacy=0x7fe4bc0488a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:33:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.195:6789/0 conn(0x7fe4bc04a1f0 legacy=0x7fe4bc04c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 1 monclient: found mon.d 2024-09-13T10:33:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7fe4bc003550 con 0x7fe4bc04e290 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe4d013c420 con 0x7fe4bc04e290 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 10 monclient: _finish_auth 0 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe4c0005c50 con 0x7fe4bc04e290 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 10 monclient: dump: 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.052 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4c0005c50 con 0x7fe4bc04e290 2024-09-13T10:33:58.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4ceffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:58.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.045+0000 7fe4d4cf6640 4 set_mon_vals no callback set 2024-09-13T10:33:58.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.046+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe4c0005ef0 con 0x7fe4bc04e290 2024-09-13T10:33:58.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.046+0000 7fe4ceffd640 1 -- 172.21.15.181:0/3585261728 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2738 (unknown 254746657 0 2451291361) 0x7fe4c004fb00 con 0x7fe4bc04e290 2024-09-13T10:33:58.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.046+0000 7fe4ceffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:33:58.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.046+0000 7fe4ceffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:58.053 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":80,"quorum":[0,1,3,4,5,6,7,8],"quorum_names":["a","f","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:33:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.050+0000 7fe4d875d640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.195:6800/1839191919 conn(0x7fe4bc03ff70 legacy=0x7fe4bc042430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.050+0000 7fe4d875d640 10 monclient: shutdown 2024-09-13T10:33:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.050+0000 7fe4d875d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.050+0000 7fe4d875d640 1 -- 172.21.15.181:0/3585261728 >> v1:172.21.15.181:6792/0 conn(0x7fe4bc04e290 legacy=0x7fe4bc050750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.050+0000 7fe4d6cfa640 1 -- 172.21.15.181:0/3585261728 reap_dead start 2024-09-13T10:33:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.050+0000 7fe4d6cfa640 1 -- 172.21.15.181:0/3585261728 reap_dead start 2024-09-13T10:33:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.050+0000 7fe4d875d640 1 -- 172.21.15.181:0/3585261728 shutdown_connections 2024-09-13T10:33:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.050+0000 7fe4d875d640 1 -- 172.21.15.181:0/3585261728 >> 172.21.15.181:0/3585261728 conn(0x7fe4d00a6640 msgr2=0x7fe4d00a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.050+0000 7fe4d875d640 1 -- 172.21.15.181:0/3585261728 shutdown_connections 2024-09-13T10:33:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.050+0000 7fe4d875d640 1 -- 172.21.15.181:0/3585261728 wait complete. 2024-09-13T10:33:58.064 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-09-13T10:33:58.064 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-09-13T10:33:58.064 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:33:58.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.160+0000 7f00e9671640 10 monclient: get_monmap_and_config 2024-09-13T10:33:58.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.160+0000 7f00e9671640 10 monclient: build_initial_monmap 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.160+0000 7f00e9671640 10 monclient: monmap: 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:58.161699+0000 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:58.161699+0000 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:58.163 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:58.164 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:58.164 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:58.164 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.160+0000 7f00e9671640 1 Processor -- start 2024-09-13T10:33:58.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.160+0000 7f00e9671640 1 -- start start 2024-09-13T10:33:58.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.160+0000 7f00e9671640 10 monclient: init 2024-09-13T10:33:58.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e9671640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:58.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e9671640 10 monclient: _add_conns ranks=[0,8,2,3,6,7,1,4,5] 2024-09-13T10:33:58.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e9671640 10 monclient(hunting): picked mon.noname-a con 0x7f00e40a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:58.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e9671640 10 monclient(hunting): picked mon.noname-e con 0x7f00e40a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:58.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e9671640 10 monclient(hunting): picked mon.noname-b con 0x7f00e413f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:58.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e9671640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e40a5fe0 con 0x7f00e40a66d0 2024-09-13T10:33:58.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e9671640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e40a8080 con 0x7f00e413f9a0 2024-09-13T10:33:58.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e9671640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e40a42c0 con 0x7f00e40a6ab0 2024-09-13T10:33:58.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e9671640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:58.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e9671640 10 monclient(hunting): authenticate will time out at 977.667283s 2024-09-13T10:33:58.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e37fe640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f00e413f9a0 legacy=0x7f00e4141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e27fc640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f00e40a6ab0 0x7f00e40a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:58832/0 (socket says 172.21.15.181:58832) 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.161+0000 7f00e27fc640 1 -- 172.21.15.181:0/4086032640 learned_addr learned my addr 172.21.15.181:0/4086032640 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.163+0000 7f00e27fc640 1 -- 172.21.15.181:0/4086032640 >> v1:172.21.15.181:6793/0 conn(0x7f00e40a6ab0 legacy=0x7f00e40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.163+0000 7f00e2ffd640 1 -- 172.21.15.181:0/4086032640 >> v1:172.21.15.181:6789/0 conn(0x7f00e40a66d0 legacy=0x7f00e40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.163+0000 7f00e1ffb640 1 -- 172.21.15.181:0/4086032640 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560561222 0 0) 0x7f00e40a5fe0 con 0x7f00e40a66d0 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.163+0000 7f00e1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.163+0000 7f00e1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.163+0000 7f00e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.163+0000 7f00e1ffb640 10 monclient(hunting): my global_id is 55332 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.163+0000 7f00e1ffb640 1 -- 172.21.15.181:0/4086032640 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00cc003520 con 0x7f00e40a66d0 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 1 -- 172.21.15.181:0/4086032640 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3518412870 0 0) 0x7f00cc003520 con 0x7f00e40a66d0 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 1 -- 172.21.15.181:0/4086032640 >> v1:172.21.15.181:6793/0 conn(0x7f00e40a6ab0 legacy=0x7f00e40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 1 -- 172.21.15.181:0/4086032640 >> v1:172.21.15.181:6790/0 conn(0x7f00e413f9a0 legacy=0x7f00e4141d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 1 monclient: found mon.noname-a 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 1 -- 172.21.15.181:0/4086032640 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e41464e0 con 0x7f00e40a66d0 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 10 monclient: _finish_auth 0 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e9671640 5 monclient: authenticate success, global_id 55332 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 1 -- 172.21.15.181:0/4086032640 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f00d4001ea0 con 0x7f00e40a66d0 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e9671640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:33:58.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 10 monclient: dump: 2024-09-13T10:33:58.173 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.173 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.173 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.173 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.173 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.173 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.173 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.173 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.173 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.174 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.174 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.174 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.174 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.174 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.174 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.174 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e9671640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:58.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 1 -- 172.21.15.181:0/4086032640 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f00d4003990 con 0x7f00e40a66d0 2024-09-13T10:33:58.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:58.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 1 -- 172.21.15.181:0/4086032640 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f00d4003f00 con 0x7f00e40a66d0 2024-09-13T10:33:58.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e9671640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:58.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e9671640 4 set_mon_vals no callback set 2024-09-13T10:33:58.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:58.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:58.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e1ffb640 10 monclient: dump: 2024-09-13T10:33:58.175 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.175 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.175 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.175 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.175 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.175 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.175 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.176 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.176 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.176 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.176 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.176 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.176 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.176 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.176 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.176 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e9671640 10 monclient: shutdown 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e9671640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e9671640 1 -- 172.21.15.181:0/4086032640 >> v1:172.21.15.181:6789/0 conn(0x7f00e40a66d0 legacy=0x7f00e40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e9671640 1 -- 172.21.15.181:0/4086032640 shutdown_connections 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e9671640 1 -- 172.21.15.181:0/4086032640 >> 172.21.15.181:0/4086032640 conn(0x7f00e40abcd0 msgr2=0x7f00e40ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e9671640 1 -- 172.21.15.181:0/4086032640 shutdown_connections 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.164+0000 7f00e9671640 1 -- 172.21.15.181:0/4086032640 wait complete. 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.165+0000 7f00e9671640 10 monclient: build_initial_monmap 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.165+0000 7f00e9671640 10 monclient: monmap: 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.165+0000 7f00e9671640 1 Processor -- start 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.165+0000 7f00e9671640 1 -- start start 2024-09-13T10:33:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.165+0000 7f00e9671640 10 monclient: init 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e9671640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e9671640 10 monclient: _add_conns ranks=[7,2,4,6,8,3,1,0,5] 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e9671640 10 monclient(hunting): picked mon.noname-i con 0x7f00e40a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e9671640 10 monclient(hunting): picked mon.noname-b con 0x7f00e40a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e9671640 10 monclient(hunting): picked mon.noname-c con 0x7f00e413f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e9671640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e40687f0 con 0x7f00e40a6ab0 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e9671640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e4142e80 con 0x7f00e413f9a0 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e27fc640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f00e40a6ab0 legacy=0x7f00e413bca0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e9671640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e413cd80 con 0x7f00e40a66d0 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e9671640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e9671640 10 monclient(hunting): authenticate will time out at 977.672302s 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e37fe640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f00e413f9a0 0x7f00e41d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:44078/0 (socket says 172.21.15.181:44078) 2024-09-13T10:33:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.166+0000 7f00e37fe640 1 -- 172.21.15.181:0/910964560 learned_addr learned my addr 172.21.15.181:0/910964560 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:58.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.168+0000 7f00e37fe640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.181:6791/0 conn(0x7f00e413f9a0 legacy=0x7f00e41d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.168+0000 7f00e2ffd640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.195:6792/0 conn(0x7f00e40a66d0 legacy=0x7f00e413b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.367+0000 7f00e27fc640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.181:6790/0 conn(0x7f00e40a6ab0 legacy=0x7f00e413bca0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:58.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.724+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502245840 0 0) 0x7f00e4142e80 con 0x7f00e413f9a0 2024-09-13T10:33:58.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.724+0000 7f00cb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.724+0000 7f00cb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.724+0000 7f00cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:58.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.724+0000 7f00cb7fe640 10 monclient(hunting): my global_id is 5584 2024-09-13T10:33:58.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.724+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00d0003520 con 0x7f00e413f9a0 2024-09-13T10:33:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.724+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1419640312 0 0) 0x7f00e413cd80 con 0x7f00e40a66d0 2024-09-13T10:33:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 10 monclient(hunting): my global_id is 55537 2024-09-13T10:33:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00e4142e80 con 0x7f00e40a66d0 2024-09-13T10:33:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3267782188 0 0) 0x7f00d0003520 con 0x7f00e413f9a0 2024-09-13T10:33:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00e413cd80 con 0x7f00e413f9a0 2024-09-13T10:33:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f00dc004500 con 0x7f00e413f9a0 2024-09-13T10:33:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:58.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 10 monclient(hunting): dump: 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.730 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3972761473 0 0) 0x7f00e4142e80 con 0x7f00e40a66d0 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00d0003520 con 0x7f00e40a66d0 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f00d4003e80 con 0x7f00e40a66d0 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.725+0000 7f00cb7fe640 10 monclient(hunting): dump: 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.731 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.732 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.732 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.732 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.732 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.732 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.732 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.732 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.732 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.732 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.732 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.732 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1303669457 0 0) 0x7f00d0003520 con 0x7f00e40a66d0 2024-09-13T10:33:58.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.181:6791/0 conn(0x7f00e413f9a0 legacy=0x7f00e41d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.181:6790/0 conn(0x7f00e40a6ab0 legacy=0x7f00e413bca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:33:58.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00cb7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:33:58.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00cb7fe640 1 monclient: found mon.i 2024-09-13T10:33:58.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:58.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00cb7fe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:33:58.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e413ee00 con 0x7f00e40a66d0 2024-09-13T10:33:58.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00cb7fe640 10 monclient: _finish_auth 0 2024-09-13T10:33:58.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00cb7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:33:58.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:58.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00e9671640 5 monclient: authenticate success, global_id 55537 2024-09-13T10:33:58.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00e9671640 10 monclient: _renew_subs 2024-09-13T10:33:58.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00e9671640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:33:58.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.728+0000 7f00e9671640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f00e413f0e0 con 0x7f00e40a66d0 2024-09-13T10:33:58.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.729+0000 7f00e9671640 10 monclient: _renew_subs 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.729+0000 7f00e9671640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.729+0000 7f00e9671640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f00e41374e0 con 0x7f00e40a66d0 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.729+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f00d40016d0 con 0x7f00e40a66d0 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.729+0000 7f00cb7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.729+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f00d4001ec0 con 0x7f00e40a66d0 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.729+0000 7f00cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.729+0000 7f00cb7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.729+0000 7f00cb7fe640 10 monclient: dump: 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.736 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.737 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.737 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.737 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.737 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.737 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.737 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.737 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.737 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.737 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.737 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.729+0000 7f00e17fa640 4 set_mon_vals no callback set 2024-09-13T10:33:58.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.729+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f00d4012020 con 0x7f00e40a66d0 2024-09-13T10:33:58.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.730+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(116..116 src has 1..116) ==== 3898+0+0 (unknown 383951105 0 0) 0x7f00d404e570 con 0x7f00e40a66d0 2024-09-13T10:33:58.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.730+0000 7f00e9671640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:58.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.730+0000 7f00e9671640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f00e40a3240 con 0x7f00e413c3b0 2024-09-13T10:33:58.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.730+0000 7f00e27fc640 10 monclient: get_auth_request con 0x7f00d0040020 auth_method 0 2024-09-13T10:33:58.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00e37fe640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.181:6789/0 conn(0x7f00e413c3b0 legacy=0x7f00e413fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1211510361 0 0) 0x7f00e40a3240 con 0x7f00e413c3b0 2024-09-13T10:33:58.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00cb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00cb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00cb7fe640 10 monclient(hunting): my global_id is 55341 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00d0003520 con 0x7f00e413c3b0 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 493117206 0 0) 0x7f00d0003520 con 0x7f00e413c3b0 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00e40a3240 con 0x7f00e413c3b0 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f00dc004e50 con 0x7f00e413c3b0 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.732+0000 7f00cb7fe640 10 monclient: dump: 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.733+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2079493306 0 0) 0x7f00e40a3240 con 0x7f00e413c3b0 2024-09-13T10:33:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.733+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00e40a4910 con 0x7f00e413c3b0 2024-09-13T10:33:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.733+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f00dc0063b0 con 0x7f00e413c3b0 2024-09-13T10:33:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.733+0000 7f00cb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.733+0000 7f00cb7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.733+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.181:6789/0 conn(0x7f00e413c3b0 legacy=0x7f00e413fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.733+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.181:6789/0 conn(0x7f00e413c3b0 legacy=0x7f00e413fd80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.739+0000 7f00e9671640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.739+0000 7f00e9671640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f00e4069af0 con 0x7f00e402e200 2024-09-13T10:33:58.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00e37fe640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.181:6789/0 conn(0x7f00e402e200 legacy=0x7f00e4140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052066328 0 0) 0x7f00e4069af0 con 0x7f00e402e200 2024-09-13T10:33:58.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 10 monclient(hunting): my global_id is 55350 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00e40a3240 con 0x7f00e402e200 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3148174519 0 0) 0x7f00e40a3240 con 0x7f00e402e200 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00e4069af0 con 0x7f00e402e200 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f00dc0053c0 con 0x7f00e402e200 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 10 monclient: dump: 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.746 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2678323442 0 0) 0x7f00e4069af0 con 0x7f00e402e200 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f00e41436c0 con 0x7f00e402e200 2024-09-13T10:33:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7715 (unknown 0 0 4067648208) 0x7f00dc0058b0 con 0x7f00e402e200 2024-09-13T10:33:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.181:6789/0 conn(0x7f00e402e200 legacy=0x7f00e4140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.742+0000 7f00cb7fe640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.181:6789/0 conn(0x7f00e402e200 legacy=0x7f00e4140490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:58.748 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:58.748 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:58.748 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:58.748 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:58.748 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 80, 2024-09-13T10:33:58.748 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 253175, 2024-09-13T10:33:58.749 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:58.749 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:58.749 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:58.749 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:58.749 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:58.749 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:58.749 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:58.749 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:58.749 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:58.750 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:58.751 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:58.752 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:58.752 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:58.752 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.752 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:58.752 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:58.752 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:58.752 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:58.752 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:58.752 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:58.752 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:58.753 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.754 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:58.755 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:58.755 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.755 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.755 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.755 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:58.755 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.755 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.755 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.755 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:58.755 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:58.756 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.756 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.756 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.756 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:58.756 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:58.756 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.756 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:58.758 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:33:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:33:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:58.770 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.743+0000 7f00e9671640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.195:6800/1839191919 conn(0x7f00d0040020 legacy=0x7f00d00424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.743+0000 7f00e9671640 10 monclient: shutdown 2024-09-13T10:33:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.743+0000 7f00e9671640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.743+0000 7f00e9671640 1 -- 172.21.15.181:0/910964560 >> v1:172.21.15.195:6792/0 conn(0x7f00e40a66d0 legacy=0x7f00e413b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.743+0000 7f00e37fe640 1 -- 172.21.15.181:0/910964560 reap_dead start 2024-09-13T10:33:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.743+0000 7f00e37fe640 1 -- 172.21.15.181:0/910964560 reap_dead start 2024-09-13T10:33:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.743+0000 7f00e9671640 1 -- 172.21.15.181:0/910964560 shutdown_connections 2024-09-13T10:33:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.743+0000 7f00e9671640 1 -- 172.21.15.181:0/910964560 >> 172.21.15.181:0/910964560 conn(0x7f00e40abcd0 msgr2=0x7f00e40a8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.743+0000 7f00e9671640 1 -- 172.21.15.181:0/910964560 shutdown_connections 2024-09-13T10:33:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.743+0000 7f00e9671640 1 -- 172.21.15.181:0/910964560 wait complete. 2024-09-13T10:33:58.772 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:33:58.772 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-09-13T10:33:58.773 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:33:58.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.870+0000 7fefd4f45640 10 monclient: get_monmap_and_config 2024-09-13T10:33:58.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.870+0000 7fefd4f45640 10 monclient: build_initial_monmap 2024-09-13T10:33:58.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.870+0000 7fefd4f45640 10 monclient: monmap: 2024-09-13T10:33:58.873 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:58.873 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.873 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:58.872223+0000 2024-09-13T10:33:58.873 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:58.872223+0000 2024-09-13T10:33:58.873 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:58.873 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.873 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:58.874 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:58.874 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:58.874 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:58.874 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:58.874 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:58.874 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:58.874 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:58.874 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:58.874 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 1 Processor -- start 2024-09-13T10:33:58.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 1 -- start start 2024-09-13T10:33:58.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 10 monclient: init 2024-09-13T10:33:58.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:58.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 10 monclient: _add_conns ranks=[6,8,4,2,7,1,3,0,5] 2024-09-13T10:33:58.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 10 monclient(hunting): picked mon.noname-d con 0x7fefd00a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:58.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 10 monclient(hunting): picked mon.noname-e con 0x7fefd00a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:58.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 10 monclient(hunting): picked mon.noname-c con 0x7fefd013f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:58.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd00a4bc0 con 0x7fefd013f750 2024-09-13T10:33:58.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd013a320 con 0x7fefd00a6640 2024-09-13T10:33:58.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd00a8100 con 0x7fefd00a8340 2024-09-13T10:33:58.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:58.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefd4f45640 10 monclient(hunting): authenticate will time out at 978.377857s 2024-09-13T10:33:58.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefcdd9b640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fefd00a8340 0x7fefd0139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:58842/0 (socket says 172.21.15.181:58842) 2024-09-13T10:33:58.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefced9d640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fefd013f750 0x7fefd0141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:44088/0 (socket says 172.21.15.181:44088) 2024-09-13T10:33:58.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefcdd9b640 1 -- 172.21.15.181:0/3770504821 learned_addr learned my addr 172.21.15.181:0/3770504821 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:58.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.871+0000 7fefce59c640 1 --1- 172.21.15.181:0/3770504821 >> v1:172.21.15.181:6792/0 conn(0x7fefd00a6640 0x7fefd0139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:43214/0 (socket says 172.21.15.181:43214) 2024-09-13T10:33:58.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefced9d640 1 -- 172.21.15.181:0/3770504821 >> v1:172.21.15.181:6791/0 conn(0x7fefd013f750 legacy=0x7fefd0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcdd9b640 1 -- 172.21.15.181:0/3770504821 >> v1:172.21.15.181:6793/0 conn(0x7fefd00a8340 legacy=0x7fefd0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefce59c640 1 -- 172.21.15.181:0/3770504821 >> v1:172.21.15.181:6792/0 conn(0x7fefd00a6640 legacy=0x7fefd0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2091045868 0 0) 0x7fefd00a8100 con 0x7fefd00a8340 2024-09-13T10:33:58.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient(hunting): my global_id is 84275 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefb8003520 con 0x7fefd00a8340 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1350863624 0 0) 0x7fefd00a4bc0 con 0x7fefd013f750 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient(hunting): my global_id is 5593 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefd00a8100 con 0x7fefd013f750 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2007886248 0 0) 0x7fefd013a320 con 0x7fefd00a6640 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient(hunting): my global_id is 5478 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefd00a4bc0 con 0x7fefd00a6640 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefced9d640 1 --1- 172.21.15.181:0/3770504821 >> v1:172.21.15.181:6791/0 conn(0x7fefd013f750 0x7fefd0141b40 :-1 s=OPENED pgs=335 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fefc8001dc0 mon_map magic: 0 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 450520329 0 0) 0x7fefb8003520 con 0x7fefd00a8340 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 >> v1:172.21.15.181:6792/0 conn(0x7fefd00a6640 legacy=0x7fefd0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 >> v1:172.21.15.181:6791/0 conn(0x7fefd013f750 legacy=0x7fefd0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient: _finish_hunting 0 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 monclient: found mon.noname-e 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd00a48e0 con 0x7fefd00a8340 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient: _finish_auth 0 2024-09-13T10:33:58.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient: _check_auth_tickets 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fefc4001a10 con 0x7fefd00a8340 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient: dump: 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.883 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefd4f45640 5 monclient: authenticate success, global_id 84275 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fefc8001dc0 con 0x7fefd013f750 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefd4f45640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fefc4001ce0 con 0x7fefd00a8340 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:58.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 1 -- 172.21.15.181:0/3770504821 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fefc4004be0 con 0x7fefd00a8340 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefd4f45640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefd4f45640 4 set_mon_vals no callback set 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.874+0000 7fefcd59a640 10 monclient: dump: 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.885 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.875+0000 7fefd4f45640 10 monclient: shutdown 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.875+0000 7fefd4f45640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.875+0000 7fefd4f45640 1 -- 172.21.15.181:0/3770504821 >> v1:172.21.15.181:6793/0 conn(0x7fefd00a8340 legacy=0x7fefd0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.875+0000 7fefd4f45640 1 -- 172.21.15.181:0/3770504821 shutdown_connections 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.875+0000 7fefd4f45640 1 -- 172.21.15.181:0/3770504821 >> 172.21.15.181:0/3770504821 conn(0x7fefd0077170 msgr2=0x7fefd00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.875+0000 7fefd4f45640 1 -- 172.21.15.181:0/3770504821 shutdown_connections 2024-09-13T10:33:58.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.875+0000 7fefd4f45640 1 -- 172.21.15.181:0/3770504821 wait complete. 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 10 monclient: build_initial_monmap 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 10 monclient: monmap: 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:58.887 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 1 Processor -- start 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 1 -- start start 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 10 monclient: init 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 10 monclient: _add_conns ranks=[6,1,0,5,7,2,3,8,4] 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 10 monclient(hunting): picked mon.noname-d con 0x7fefd00a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 10 monclient(hunting): picked mon.noname-f con 0x7fefd013f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 10 monclient(hunting): picked mon.noname-a con 0x7fefd009f780 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd00a0f80 con 0x7fefd009f780 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd009dfd0 con 0x7fefd013f750 2024-09-13T10:33:58.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd00a9c40 con 0x7fefd00a8340 2024-09-13T10:33:58.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:58.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefd4f45640 10 monclient(hunting): authenticate will time out at 978.382853s 2024-09-13T10:33:58.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefce59c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fefd00a8340 0x7fefd009d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:43216/0 (socket says 172.21.15.181:43216) 2024-09-13T10:33:58.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.876+0000 7fefce59c640 1 -- 172.21.15.181:0/42833573 learned_addr learned my addr 172.21.15.181:0/42833573 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:58.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefced9d640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.181:6789/0 conn(0x7fefd009f780 legacy=0x7fefd01d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefce59c640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.181:6792/0 conn(0x7fefd00a8340 legacy=0x7fefd009d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441653159 0 0) 0x7fefd00a0f80 con 0x7fefd009f780 2024-09-13T10:33:58.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:58.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): my global_id is 55359 2024-09-13T10:33:58.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefb0003550 con 0x7fefd009f780 2024-09-13T10:33:58.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4268755444 0 0) 0x7fefd00a9c40 con 0x7fefd00a8340 2024-09-13T10:33:58.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:58.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): my global_id is 5487 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefd00a0f80 con 0x7fefd00a8340 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefcdd9b640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.195:6789/0 conn(0x7fefd013f750 legacy=0x7fefd009d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3038691604 0 0) 0x7fefd00a0f80 con 0x7fefd00a8340 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefd00a9c40 con 0x7fefd00a8340 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fefc0001920 con 0x7fefd00a8340 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): dump: 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.894 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3547612768 0 0) 0x7fefb0003550 con 0x7fefd009f780 2024-09-13T10:33:58.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefd00a0f80 con 0x7fefd009f780 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fefc8002010 con 0x7fefd009f780 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient(hunting): dump: 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.896 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.897 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.897 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.897 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.897 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.897 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.897 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2071672215 0 0) 0x7fefd00a9c40 con 0x7fefd00a8340 2024-09-13T10:33:58.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.195:6789/0 conn(0x7fefd013f750 legacy=0x7fefd009d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.181:6789/0 conn(0x7fefd009f780 legacy=0x7fefd01d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:58.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 monclient: found mon.d 2024-09-13T10:33:58.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd0142d40 con 0x7fefd00a8340 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient: _finish_auth 0 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefd4f45640 5 monclient: authenticate success, global_id 5487 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefd4f45640 10 monclient: _renew_subs 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefd4f45640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefd4f45640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fefd00a0110 con 0x7fefd00a8340 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefd4f45640 10 monclient: _renew_subs 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefd4f45640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefd4f45640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fefd00a0ca0 con 0x7fefd00a8340 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fefc0004dd0 con 0x7fefd00a8340 2024-09-13T10:33:58.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fefc00052c0 con 0x7fefd00a8340 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefccd99640 4 set_mon_vals no callback set 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.879+0000 7fefbeffd640 10 monclient: dump: 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.899 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.900 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.900 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.900 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.900 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.900 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.900 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.900 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.880+0000 7fefd4f45640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:58.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.880+0000 7fefd4f45640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fefb40065c0 con 0x7fefb4002860 2024-09-13T10:33:58.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.880+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fefc0011940 con 0x7fefd00a8340 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.880+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(116..116 src has 1..116) ==== 3898+0+0 (unknown 383951105 0 0) 0x7fefc004e390 con 0x7fefd00a8340 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.880+0000 7fefced9d640 10 monclient: get_auth_request con 0x7fefb00400d0 auth_method 0 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.882+0000 7fefcdd9b640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.181:6791/0 conn(0x7fefb4002860 legacy=0x7fefb4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.882+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3009051094 0 0) 0x7fefb40065c0 con 0x7fefb4002860 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.882+0000 7fefbeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.882+0000 7fefbeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.882+0000 7fefbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.882+0000 7fefbeffd640 10 monclient(hunting): my global_id is 5602 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.882+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefd00a9c40 con 0x7fefb4002860 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.882+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3298493345 0 0) 0x7fefd00a9c40 con 0x7fefb4002860 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.883+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefb40065c0 con 0x7fefb4002860 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.883+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fefc4004b20 con 0x7fefb4002860 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.883+0000 7fefbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.883+0000 7fefbeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.883+0000 7fefbeffd640 10 monclient: dump: 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.903 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.903 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.903 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.883+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3364269406 0 0) 0x7fefb40065c0 con 0x7fefb4002860 2024-09-13T10:33:58.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.883+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fefb400a160 con 0x7fefb4002860 2024-09-13T10:33:58.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.883+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fefc40014b0 con 0x7fefb4002860 2024-09-13T10:33:58.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.883+0000 7fefbeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:58.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.883+0000 7fefbeffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:58.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.883+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.181:6791/0 conn(0x7fefb4002860 legacy=0x7fefb4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.883+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.181:6791/0 conn(0x7fefb4002860 legacy=0x7fefb4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:58.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.889+0000 7fefd4f45640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:58.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.889+0000 7fefd4f45640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fefb4009e70 con 0x7fefb4009130 2024-09-13T10:33:58.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefcdd9b640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.181:6791/0 conn(0x7fefb4009130 legacy=0x7fefb40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:58.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 439687406 0 0) 0x7fefb4009e70 con 0x7fefb4009130 2024-09-13T10:33:58.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefbeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:58.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefbeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:58.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:58.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefbeffd640 10 monclient(hunting): my global_id is 5611 2024-09-13T10:33:58.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefb40065c0 con 0x7fefb4009130 2024-09-13T10:33:58.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 330459891 0 0) 0x7fefb40065c0 con 0x7fefb4009130 2024-09-13T10:33:58.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefb4009e70 con 0x7fefb4009130 2024-09-13T10:33:58.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fefc40019a0 con 0x7fefb4009130 2024-09-13T10:33:58.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefbeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.891+0000 7fefbeffd640 10 monclient: dump: 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:58.906 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:58.907 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:58.907 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:58.907 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:58.907 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:58.907 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:58.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1363960505 0 0) 0x7fefb4009e70 con 0x7fefb4009130 2024-09-13T10:33:58.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fefb400c410 con 0x7fefb4009130 2024-09-13T10:33:58.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7715 (unknown 0 0 2262270435) 0x7fefc4007380 con 0x7fefb4009130 2024-09-13T10:33:58.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefbeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:58.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefbeffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:58.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.181:6791/0 conn(0x7fefb4009130 legacy=0x7fefb40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefbeffd640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.181:6791/0 conn(0x7fefb4009130 legacy=0x7fefb40095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:58.908 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:58.908 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:58.908 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:58.908 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:58.908 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 80, 2024-09-13T10:33:58.908 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 253342, 2024-09-13T10:33:58.908 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:58.908 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:58.908 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:58.909 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:58.910 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:58.911 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:58.912 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:58.913 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.915 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.916 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.917 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:58.920 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.921 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.923 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.924 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.926 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:58.927 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:58.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:58.927 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:58.927 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:58.927 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:33:58.927 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:58.927 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:58.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:58.927 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:58.927 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefd4f45640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.195:6800/1839191919 conn(0x7fefb00400d0 legacy=0x7fefb0042590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefd4f45640 10 monclient: shutdown 2024-09-13T10:33:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefd4f45640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefd4f45640 1 -- 172.21.15.181:0/42833573 >> v1:172.21.15.181:6792/0 conn(0x7fefd00a8340 legacy=0x7fefd009d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefced9d640 1 -- 172.21.15.181:0/42833573 reap_dead start 2024-09-13T10:33:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefced9d640 1 -- 172.21.15.181:0/42833573 reap_dead start 2024-09-13T10:33:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefd4f45640 1 -- 172.21.15.181:0/42833573 shutdown_connections 2024-09-13T10:33:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefd4f45640 1 -- 172.21.15.181:0/42833573 >> 172.21.15.181:0/42833573 conn(0x7fefd00a6640 msgr2=0x7fefd0141fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefd4f45640 1 -- 172.21.15.181:0/42833573 shutdown_connections 2024-09-13T10:33:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:58.892+0000 7fefd4f45640 1 -- 172.21.15.181:0/42833573 wait complete. 2024-09-13T10:33:58.929 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:33:58.929 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-09-13T10:33:58.930 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:33:59.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.025+0000 7f411577d640 10 monclient: get_monmap_and_config 2024-09-13T10:33:59.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.025+0000 7f411577d640 10 monclient: build_initial_monmap 2024-09-13T10:33:59.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.025+0000 7f411577d640 10 monclient: monmap: 2024-09-13T10:33:59.028 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:59.027520+0000 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:59.027520+0000 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:59.029 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:59.030 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.026+0000 7f411577d640 1 Processor -- start 2024-09-13T10:33:59.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.026+0000 7f411577d640 1 -- start start 2024-09-13T10:33:59.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.026+0000 7f411577d640 10 monclient: init 2024-09-13T10:33:59.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.026+0000 7f411577d640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:59.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.026+0000 7f411577d640 10 monclient: _add_conns ranks=[5,8,6,4,1,7,2,0,3] 2024-09-13T10:33:59.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.026+0000 7f411577d640 10 monclient(hunting): picked mon.noname-h con 0x7f41100a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:59.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.026+0000 7f411577d640 10 monclient(hunting): picked mon.noname-e con 0x7f41100a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:59.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.026+0000 7f411577d640 10 monclient(hunting): picked mon.noname-d con 0x7f411013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:59.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.027+0000 7f411577d640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41100a4bc0 con 0x7f41100a6640 2024-09-13T10:33:59.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.027+0000 7f411577d640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411013a320 con 0x7f411013f750 2024-09-13T10:33:59.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.027+0000 7f411577d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41100a8100 con 0x7f41100a8340 2024-09-13T10:33:59.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.027+0000 7f411577d640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:59.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.027+0000 7f411577d640 10 monclient(hunting): authenticate will time out at 978.533039s 2024-09-13T10:33:59.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.027+0000 7f410e7fc640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f41100a8340 0x7f4110139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:58848/0 (socket says 172.21.15.181:58848) 2024-09-13T10:33:59.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.027+0000 7f410f7fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f411013f750 0x7f4110141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:43222/0 (socket says 172.21.15.181:43222) 2024-09-13T10:33:59.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.027+0000 7f410e7fc640 1 -- 172.21.15.181:0/2172396030 learned_addr learned my addr 172.21.15.181:0/2172396030 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:59.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410e7fc640 1 -- 172.21.15.181:0/2172396030 >> v1:172.21.15.181:6793/0 conn(0x7f41100a8340 legacy=0x7f4110139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410f7fe640 1 -- 172.21.15.181:0/2172396030 >> v1:172.21.15.181:6792/0 conn(0x7f411013f750 legacy=0x7f4110141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 1 -- 172.21.15.181:0/2172396030 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356474781 0 0) 0x7f41100a8100 con 0x7f41100a8340 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient(hunting): my global_id is 84284 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 1 -- 172.21.15.181:0/2172396030 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40f8003520 con 0x7f41100a8340 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 1 -- 172.21.15.181:0/2172396030 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059880607 0 0) 0x7f411013a320 con 0x7f411013f750 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient(hunting): my global_id is 5496 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 1 -- 172.21.15.181:0/2172396030 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41100a8100 con 0x7f411013f750 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410effd640 1 -- 172.21.15.181:0/2172396030 >> v1:172.21.15.195:6791/0 conn(0x7f41100a6640 legacy=0x7f4110139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 1 -- 172.21.15.181:0/2172396030 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3018258272 0 0) 0x7f40f8003520 con 0x7f41100a8340 2024-09-13T10:33:59.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 1 -- 172.21.15.181:0/2172396030 >> v1:172.21.15.181:6792/0 conn(0x7f411013f750 legacy=0x7f4110141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 1 -- 172.21.15.181:0/2172396030 >> v1:172.21.15.195:6791/0 conn(0x7f41100a6640 legacy=0x7f4110139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient: _finish_hunting 0 2024-09-13T10:33:59.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 1 monclient: found mon.noname-e 2024-09-13T10:33:59.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:59.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:33:59.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 1 -- 172.21.15.181:0/2172396030 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41100a48e0 con 0x7f41100a8340 2024-09-13T10:33:59.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient: _finish_auth 0 2024-09-13T10:33:59.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient: _check_auth_tickets 2024-09-13T10:33:59.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f411577d640 5 monclient: authenticate success, global_id 84284 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 1 -- 172.21.15.181:0/2172396030 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4104001e60 con 0x7f41100a8340 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient: dump: 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.038 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f411577d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410e7fc640 1 --1- 172.21.15.181:0/2172396030 >> v1:172.21.15.181:6793/0 conn(0x7f41100a8340 0x7f4110139c10 :-1 s=OPENED pgs=259 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f4104005190 mon_map magic: 0 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 1 -- 172.21.15.181:0/2172396030 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4104004c20 con 0x7f41100a8340 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f410dffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f411577d640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.029+0000 7f411577d640 4 set_mon_vals no callback set 2024-09-13T10:33:59.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.030+0000 7f411577d640 10 monclient: shutdown 2024-09-13T10:33:59.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.030+0000 7f411577d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:59.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.030+0000 7f411577d640 1 -- 172.21.15.181:0/2172396030 >> v1:172.21.15.181:6793/0 conn(0x7f41100a8340 legacy=0x7f4110139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.030+0000 7f410dffb640 1 -- 172.21.15.181:0/2172396030 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4104005190 con 0x7f41100a8340 2024-09-13T10:33:59.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.030+0000 7f410dffb640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:33:59.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.030+0000 7f411577d640 1 -- 172.21.15.181:0/2172396030 shutdown_connections 2024-09-13T10:33:59.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.030+0000 7f411577d640 1 -- 172.21.15.181:0/2172396030 >> 172.21.15.181:0/2172396030 conn(0x7f4110077170 msgr2=0x7f41100abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:59.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.030+0000 7f411577d640 1 -- 172.21.15.181:0/2172396030 shutdown_connections 2024-09-13T10:33:59.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.030+0000 7f411577d640 1 -- 172.21.15.181:0/2172396030 wait complete. 2024-09-13T10:33:59.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.030+0000 7f411577d640 10 monclient: build_initial_monmap 2024-09-13T10:33:59.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.030+0000 7f411577d640 10 monclient: monmap: 2024-09-13T10:33:59.041 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:59.041 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:59.041 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:59.041 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:59.041 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:59.041 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:59.041 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:59.041 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:59.041 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:59.041 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 1 Processor -- start 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 1 -- start start 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 10 monclient: init 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 10 monclient: _add_conns ranks=[5,6,8,4,7,1,2,0,3] 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 10 monclient(hunting): picked mon.noname-h con 0x7f41100a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 10 monclient(hunting): picked mon.noname-d con 0x7f411013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:59.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 10 monclient(hunting): picked mon.noname-e con 0x7f4110135500 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:59.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411013d680 con 0x7f41100a8340 2024-09-13T10:33:59.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41100a9c40 con 0x7f411013f750 2024-09-13T10:33:59.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411013ca80 con 0x7f4110135500 2024-09-13T10:33:59.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:59.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f411577d640 10 monclient(hunting): authenticate will time out at 978.537904s 2024-09-13T10:33:59.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f410e7fc640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f411013f750 0x7f411013c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:43224/0 (socket says 172.21.15.181:43224) 2024-09-13T10:33:59.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.031+0000 7f410e7fc640 1 -- 172.21.15.181:0/1347133352 learned_addr learned my addr 172.21.15.181:0/1347133352 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:59.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f410f7fe640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.181:6793/0 conn(0x7f4110135500 legacy=0x7f41101d6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f410e7fc640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.181:6792/0 conn(0x7f411013f750 legacy=0x7f411013c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671412860 0 0) 0x7f41100a9c40 con 0x7f411013f750 2024-09-13T10:33:59.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): my global_id is 5505 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40fc003550 con 0x7f411013f750 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74395330 0 0) 0x7f411013ca80 con 0x7f4110135500 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): my global_id is 84293 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41100a9c40 con 0x7f4110135500 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f410effd640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.195:6791/0 conn(0x7f41100a8340 legacy=0x7f411013bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1314041602 0 0) 0x7f40fc003550 con 0x7f411013f750 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f411013ca80 con 0x7f411013f750 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4104001de0 con 0x7f411013f750 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): dump: 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.049 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.050 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.050 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.050 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:59.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397957400 0 0) 0x7f411013d680 con 0x7f41100a8340 2024-09-13T10:33:59.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): my global_id is 5594 2024-09-13T10:33:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40fc003550 con 0x7f41100a8340 2024-09-13T10:33:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4105259885 0 0) 0x7f41100a9c40 con 0x7f4110135500 2024-09-13T10:33:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f411013d680 con 0x7f4110135500 2024-09-13T10:33:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4100001d10 con 0x7f4110135500 2024-09-13T10:33:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient(hunting): dump: 2024-09-13T10:33:59.051 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.052 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.052 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.052 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.052 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.052 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.052 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.052 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.052 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.053 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4046329952 0 0) 0x7f411013ca80 con 0x7f411013f750 2024-09-13T10:33:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.181:6793/0 conn(0x7f4110135500 legacy=0x7f41101d6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.195:6791/0 conn(0x7f41100a8340 legacy=0x7f411013bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient: _finish_hunting 0 2024-09-13T10:33:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 monclient: found mon.d 2024-09-13T10:33:59.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4110135000 con 0x7f411013f750 2024-09-13T10:33:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient: _finish_auth 0 2024-09-13T10:33:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient: _check_auth_tickets 2024-09-13T10:33:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f411577d640 5 monclient: authenticate success, global_id 5505 2024-09-13T10:33:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f411577d640 10 monclient: _renew_subs 2024-09-13T10:33:59.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f411577d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f411577d640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4110134760 con 0x7f411013f750 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f411577d640 10 monclient: _renew_subs 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f411577d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f411577d640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f41101d7f80 con 0x7f411013f750 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41040020b0 con 0x7f411013f750 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4104004c20 con 0x7f411013f750 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f410d7fa640 4 set_mon_vals no callback set 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.034+0000 7f40f77fe640 10 monclient: dump: 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.058 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.059 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.060 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.035+0000 7f411577d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:59.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.035+0000 7f411577d640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f40f00065c0 con 0x7f40f0002860 2024-09-13T10:33:59.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.035+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4104011f60 con 0x7f411013f750 2024-09-13T10:33:59.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.035+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(116..116 src has 1..116) ==== 3898+0+0 (unknown 383951105 0 0) 0x7f410404e700 con 0x7f411013f750 2024-09-13T10:33:59.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.035+0000 7f410f7fe640 10 monclient: get_auth_request con 0x7f40fc040470 auth_method 0 2024-09-13T10:33:59.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.037+0000 7f410effd640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.181:6792/0 conn(0x7f40f0002860 legacy=0x7f40f0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.037+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 987058843 0 0) 0x7f40f00065c0 con 0x7f40f0002860 2024-09-13T10:33:59.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.037+0000 7f40f77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.037+0000 7f40f77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.037+0000 7f40f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.037+0000 7f40f77fe640 10 monclient(hunting): my global_id is 5514 2024-09-13T10:33:59.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.037+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f411013ca80 con 0x7f40f0002860 2024-09-13T10:33:59.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.037+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 499966595 0 0) 0x7f411013ca80 con 0x7f40f0002860 2024-09-13T10:33:59.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.038+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f40f00065c0 con 0x7f40f0002860 2024-09-13T10:33:59.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.038+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4108001cb0 con 0x7f40f0002860 2024-09-13T10:33:59.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.038+0000 7f40f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.038+0000 7f40f77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:59.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.038+0000 7f40f77fe640 10 monclient: dump: 2024-09-13T10:33:59.061 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.061 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.061 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.061 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.038+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1696670573 0 0) 0x7f40f00065c0 con 0x7f40f0002860 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.038+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40f000a160 con 0x7f40f0002860 2024-09-13T10:33:59.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.038+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f41080057c0 con 0x7f40f0002860 2024-09-13T10:33:59.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.038+0000 7f40f77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:59.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.038+0000 7f40f77fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:59.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.038+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.181:6792/0 conn(0x7f40f0002860 legacy=0x7f40f0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.038+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.181:6792/0 conn(0x7f40f0002860 legacy=0x7f40f0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:59.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.045+0000 7f411577d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:59.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.045+0000 7f411577d640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f40f000c4f0 con 0x7f40f0009110 2024-09-13T10:33:59.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.047+0000 7f410effd640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.181:6792/0 conn(0x7f40f0009110 legacy=0x7f40f0009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.050+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395002100 0 0) 0x7f40f000c4f0 con 0x7f40f0009110 2024-09-13T10:33:59.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.050+0000 7f40f77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.050+0000 7f40f77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.050+0000 7f40f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.050+0000 7f40f77fe640 10 monclient(hunting): my global_id is 5523 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.050+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40f00065c0 con 0x7f40f0009110 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.050+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1517523176 0 0) 0x7f40f00065c0 con 0x7f40f0009110 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.050+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f40f000c4f0 con 0x7f40f0009110 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.050+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4108003d40 con 0x7f40f0009110 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.050+0000 7f40f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.050+0000 7f40f77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.050+0000 7f40f77fe640 10 monclient: dump: 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.066 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.051+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1010543991 0 0) 0x7f40f000c4f0 con 0x7f40f0009110 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.051+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f40f0009ce0 con 0x7f40f0009110 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.052+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7548 (unknown 0 0 1373607975) 0x7f4108004040 con 0x7f40f0009110 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.052+0000 7f40f77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.052+0000 7f40f77fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:59.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.052+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.181:6792/0 conn(0x7f40f0009110 legacy=0x7f40f0009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.052+0000 7f40f77fe640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.181:6792/0 conn(0x7f40f0009110 legacy=0x7f40f0009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:59.068 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:59.068 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:59.068 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:59.068 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:59.068 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 80, 2024-09-13T10:33:59.068 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 253495, 2024-09-13T10:33:59.068 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:59.068 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.069 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.070 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.071 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.071 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.071 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.071 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.071 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.071 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.071 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.071 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.071 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:59.072 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.073 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.075 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:59.075 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.075 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:59.075 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:59.075 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.075 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.075 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:59.077 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:59.077 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.077 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.077 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.077 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:59.077 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:59.077 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.077 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:59.078 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.079 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.080 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:59.080 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:59.080 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.080 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:59.081 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:59.082 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.082 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:59.082 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.082 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.082 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:59.082 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:59.083 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.083 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.083 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.083 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:59.083 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:59.083 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.083 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:59.084 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.085 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.087 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:59.088 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.053+0000 7f411577d640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.195:6800/1839191919 conn(0x7f40fc040470 legacy=0x7f40fc042930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.053+0000 7f411577d640 10 monclient: shutdown 2024-09-13T10:33:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.053+0000 7f411577d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.053+0000 7f411577d640 1 -- 172.21.15.181:0/1347133352 >> v1:172.21.15.181:6792/0 conn(0x7f411013f750 legacy=0x7f411013c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.053+0000 7f410f7fe640 1 -- 172.21.15.181:0/1347133352 reap_dead start 2024-09-13T10:33:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.053+0000 7f410f7fe640 1 -- 172.21.15.181:0/1347133352 reap_dead start 2024-09-13T10:33:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.053+0000 7f411577d640 1 -- 172.21.15.181:0/1347133352 shutdown_connections 2024-09-13T10:33:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.053+0000 7f411577d640 1 -- 172.21.15.181:0/1347133352 >> 172.21.15.181:0/1347133352 conn(0x7f41100a6640 msgr2=0x7f41100a6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.053+0000 7f411577d640 1 -- 172.21.15.181:0/1347133352 shutdown_connections 2024-09-13T10:33:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.054+0000 7f411577d640 1 -- 172.21.15.181:0/1347133352 wait complete. 2024-09-13T10:33:59.091 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:33:59.091 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-09-13T10:33:59.091 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:33:59.146 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37241]: starting. 2024-09-13T10:33:59.146 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37241]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37240 2024-09-13T10:33:59.146 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37241]: created object 0... 2024-09-13T10:33:59.146 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37241]: created object 25... 2024-09-13T10:33:59.146 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37241]: created object 49... 2024-09-13T10:33:59.146 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37241]: finishing. 2024-09-13T10:33:59.146 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37241]: shutting down. 2024-09-13T10:33:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.190+0000 7f2bce739640 10 monclient: get_monmap_and_config 2024-09-13T10:33:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.190+0000 7f2bce739640 10 monclient: build_initial_monmap 2024-09-13T10:33:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.190+0000 7f2bce739640 10 monclient: monmap: 2024-09-13T10:33:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:59.192354+0000 2024-09-13T10:33:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:59.192354+0000 2024-09-13T10:33:59.193 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:59.194 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:59.194 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.191+0000 7f2bce739640 1 Processor -- start 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.191+0000 7f2bce739640 1 -- start start 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.191+0000 7f2bce739640 10 monclient: init 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.191+0000 7f2bce739640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.191+0000 7f2bce739640 10 monclient: _add_conns ranks=[6,2,7,0,1,8,5,3,4] 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.191+0000 7f2bce739640 10 monclient(hunting): picked mon.noname-d con 0x7f2bc80a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.192+0000 7f2bce739640 10 monclient(hunting): picked mon.noname-b con 0x7f2bc80a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.192+0000 7f2bce739640 10 monclient(hunting): picked mon.noname-i con 0x7f2bc813f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.192+0000 7f2bce739640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc80a4bc0 con 0x7f2bc80a8340 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.192+0000 7f2bce739640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc813a320 con 0x7f2bc80a6640 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.192+0000 7f2bce739640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc80a8100 con 0x7f2bc813f750 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.192+0000 7f2bce739640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.192+0000 7f2bce739640 10 monclient(hunting): authenticate will time out at 978.698057s 2024-09-13T10:33:59.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.192+0000 7f2bc77fe640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f2bc80a8340 legacy=0x7f2bc8139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.192+0000 7f2bc7fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f2bc80a6640 0x7f2bc8139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:43244/0 (socket says 172.21.15.181:43244) 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.192+0000 7f2bc7fff640 1 -- 172.21.15.181:0/22685645 learned_addr learned my addr 172.21.15.181:0/22685645 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc7fff640 1 -- 172.21.15.181:0/22685645 >> v1:172.21.15.181:6792/0 conn(0x7f2bc80a6640 legacy=0x7f2bc8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bcccd6640 1 -- 172.21.15.181:0/22685645 >> v1:172.21.15.195:6792/0 conn(0x7f2bc813f750 legacy=0x7f2bc8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 1 -- 172.21.15.181:0/22685645 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1570147043 0 0) 0x7f2bc813a320 con 0x7f2bc80a6640 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient(hunting): my global_id is 5532 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 1 -- 172.21.15.181:0/22685645 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bb0003520 con 0x7f2bc80a6640 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 1 -- 172.21.15.181:0/22685645 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 726447377 0 0) 0x7f2bc80a8100 con 0x7f2bc813f750 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient(hunting): my global_id is 55546 2024-09-13T10:33:59.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 1 -- 172.21.15.181:0/22685645 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bc813a320 con 0x7f2bc813f750 2024-09-13T10:33:59.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 1 -- 172.21.15.181:0/22685645 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2976082840 0 0) 0x7f2bb0003520 con 0x7f2bc80a6640 2024-09-13T10:33:59.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 1 -- 172.21.15.181:0/22685645 >> v1:172.21.15.195:6792/0 conn(0x7f2bc813f750 legacy=0x7f2bc8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 1 -- 172.21.15.181:0/22685645 >> v1:172.21.15.181:6790/0 conn(0x7f2bc80a8340 legacy=0x7f2bc8139c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:33:59.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:59.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 1 monclient: found mon.noname-d 2024-09-13T10:33:59.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:59.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:33:59.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 1 -- 172.21.15.181:0/22685645 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc80a48e0 con 0x7f2bc80a6640 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bce739640 5 monclient: authenticate success, global_id 5532 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 1 -- 172.21.15.181:0/22685645 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2bb8001ae0 con 0x7f2bc80a6640 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bce739640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.194+0000 7f2bc6ffd640 10 monclient: dump: 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.204 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bce739640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bc6ffd640 1 -- 172.21.15.181:0/22685645 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2bb80048a0 con 0x7f2bc80a6640 2024-09-13T10:33:59.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bc6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bce739640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bc6ffd640 1 -- 172.21.15.181:0/22685645 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2bb8004e10 con 0x7f2bc80a6640 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bce739640 4 set_mon_vals no callback set 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bc6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bc6ffd640 10 monclient: dump: 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.206 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bce739640 10 monclient: shutdown 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bce739640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bce739640 1 -- 172.21.15.181:0/22685645 >> v1:172.21.15.181:6792/0 conn(0x7f2bc80a6640 legacy=0x7f2bc8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bce739640 1 -- 172.21.15.181:0/22685645 shutdown_connections 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bce739640 1 -- 172.21.15.181:0/22685645 >> 172.21.15.181:0/22685645 conn(0x7f2bc8077170 msgr2=0x7f2bc80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:59.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bce739640 1 -- 172.21.15.181:0/22685645 shutdown_connections 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.195+0000 7f2bce739640 1 -- 172.21.15.181:0/22685645 wait complete. 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.196+0000 7f2bce739640 10 monclient: build_initial_monmap 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.196+0000 7f2bce739640 10 monclient: monmap: 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:59.208 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.196+0000 7f2bce739640 1 Processor -- start 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.196+0000 7f2bce739640 1 -- start start 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.196+0000 7f2bce739640 10 monclient: init 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.197+0000 7f2bce739640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.197+0000 7f2bce739640 10 monclient: _add_conns ranks=[0,1,3,5,2,6,7,8,4] 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.197+0000 7f2bce739640 10 monclient(hunting): picked mon.noname-a con 0x7f2bc80a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.197+0000 7f2bce739640 10 monclient(hunting): picked mon.noname-f con 0x7f2bc813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.197+0000 7f2bce739640 10 monclient(hunting): picked mon.noname-g con 0x7f2bc813cd30 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:59.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.197+0000 7f2bce739640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc80a9df0 con 0x7f2bc80a8340 2024-09-13T10:33:59.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.197+0000 7f2bce739640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc8142fb0 con 0x7f2bc813f750 2024-09-13T10:33:59.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.197+0000 7f2bce739640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc8134d00 con 0x7f2bc813cd30 2024-09-13T10:33:59.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.197+0000 7f2bce739640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:59.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.197+0000 7f2bce739640 10 monclient(hunting): authenticate will time out at 978.703161s 2024-09-13T10:33:59.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.197+0000 7f2bc7fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2bc80a8340 0x7f2bc81ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:33600/0 (socket says 172.21.15.181:33600) 2024-09-13T10:33:59.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.197+0000 7f2bc7fff640 1 -- 172.21.15.181:0/3480336681 learned_addr learned my addr 172.21.15.181:0/3480336681 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.199+0000 7f2bc7fff640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.181:6789/0 conn(0x7f2bc80a8340 legacy=0x7f2bc81ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.199+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.199+0000 7f2bcccd6640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.195:6790/0 conn(0x7f2bc813cd30 legacy=0x7f2bc81d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.199+0000 7f2bc77fe640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.195:6789/0 conn(0x7f2bc813f750 legacy=0x7f2bc81d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516310813 0 0) 0x7f2bc80a48e0 con 0x7f2bc80a8340 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): my global_id is 55368 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bb4003550 con 0x7f2bc80a8340 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3953801753 0 0) 0x7f2bbc003d30 con 0x7f2bc813f750 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): my global_id is 55639 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bc80a48e0 con 0x7f2bc813f750 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970104236 0 0) 0x7f2bc8134d00 con 0x7f2bc813cd30 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): my global_id is 5448 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bbc003d30 con 0x7f2bc813cd30 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1046607017 0 0) 0x7f2bb4003550 con 0x7f2bc80a8340 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2bc8134d00 con 0x7f2bc80a8340 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2bb8004d90 con 0x7f2bc80a8340 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:33:59.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): dump: 2024-09-13T10:33:59.216 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.216 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.216 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.216 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.216 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.216 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.216 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.216 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.201+0000 7f2bc4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4237482302 0 0) 0x7f2bc8134d00 con 0x7f2bc80a8340 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.195:6790/0 conn(0x7f2bc813cd30 legacy=0x7f2bc81d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.195:6789/0 conn(0x7f2bc813f750 legacy=0x7f2bc81d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 1 monclient: found mon.a 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc813d5d0 con 0x7f2bc80a8340 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 10 monclient: _finish_auth 0 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bce739640 5 monclient: authenticate success, global_id 55368 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bce739640 10 monclient: _renew_subs 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bce739640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bce739640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc8134a20 con 0x7f2bc80a8340 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bce739640 10 monclient: _renew_subs 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bce739640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:59.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bce739640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2bc81cecb0 con 0x7f2bc80a8340 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2bb8001d30 con 0x7f2bc80a8340 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2bb80048a0 con 0x7f2bc80a8340 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc67fc640 4 set_mon_vals no callback set 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 10 monclient: dump: 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.219 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.202+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2bb8011c20 con 0x7f2bc80a8340 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.203+0000 7f2bce739640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.203+0000 7f2bce739640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2ba80065c0 con 0x7f2ba8002860 2024-09-13T10:33:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.203+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 4293006143 0 0) 0x7f2bb804e4a0 con 0x7f2bc80a8340 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.203+0000 7f2bcccd6640 10 monclient: get_auth_request con 0x7f2bb403faf0 auth_method 0 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc77fe640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.181:6793/0 conn(0x7f2ba8002860 legacy=0x7f2ba8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4248790475 0 0) 0x7f2ba80065c0 con 0x7f2ba8002860 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 10 monclient(hunting): my global_id is 84302 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bc8134d00 con 0x7f2ba8002860 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2023667454 0 0) 0x7f2bc8134d00 con 0x7f2ba8002860 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ba80065c0 con 0x7f2ba8002860 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2bbc004ec0 con 0x7f2ba8002860 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 10 monclient: dump: 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.223 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3772477803 0 0) 0x7f2ba80065c0 con 0x7f2ba8002860 2024-09-13T10:33:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.205+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ba800a160 con 0x7f2ba8002860 2024-09-13T10:33:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.206+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2bbc007200 con 0x7f2ba8002860 2024-09-13T10:33:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.206+0000 7f2bc4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.206+0000 7f2bc4ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.206+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.181:6793/0 conn(0x7f2ba8002860 legacy=0x7f2ba8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.206+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.181:6793/0 conn(0x7f2ba8002860 legacy=0x7f2ba8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:59.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.212+0000 7f2bce739640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:59.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.212+0000 7f2bce739640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2ba8009e70 con 0x7f2ba8009130 2024-09-13T10:33:59.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc77fe640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.181:6793/0 conn(0x7f2ba8009130 legacy=0x7f2ba80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4044513010 0 0) 0x7f2ba8009e70 con 0x7f2ba8009130 2024-09-13T10:33:59.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc4ff9640 10 monclient(hunting): my global_id is 84311 2024-09-13T10:33:59.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ba80065c0 con 0x7f2ba8009130 2024-09-13T10:33:59.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 758993099 0 0) 0x7f2ba80065c0 con 0x7f2ba8009130 2024-09-13T10:33:59.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ba8009e70 con 0x7f2ba8009130 2024-09-13T10:33:59.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2bbc0058a0 con 0x7f2ba8009130 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc4ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.214+0000 7f2bc4ff9640 10 monclient: dump: 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.226 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1513667659 0 0) 0x7f2ba8009e70 con 0x7f2ba8009130 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2ba800c410 con 0x7f2ba8009130 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7547 (unknown 0 0 3482950443) 0x7f2bbc00a170 con 0x7f2ba8009130 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bc4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bc4ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.181:6793/0 conn(0x7f2ba8009130 legacy=0x7f2ba80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bc4ff9640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.181:6793/0 conn(0x7f2ba8009130 legacy=0x7f2ba80095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:59.228 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 80, 2024-09-13T10:33:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 48104, 2024-09-13T10:33:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:59.228 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.229 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:59.230 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:59.232 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.233 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:59.236 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:59.237 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:59.239 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.240 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.244 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.245 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.246 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.247 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:59.247 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:59.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bce739640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.195:6800/1839191919 conn(0x7f2bb403faf0 legacy=0x7f2bb4041fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bce739640 10 monclient: shutdown 2024-09-13T10:33:59.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bce739640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:59.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bce739640 1 -- 172.21.15.181:0/3480336681 >> v1:172.21.15.181:6789/0 conn(0x7f2bc80a8340 legacy=0x7f2bc81ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bcccd6640 1 -- 172.21.15.181:0/3480336681 reap_dead start 2024-09-13T10:33:59.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bcccd6640 1 -- 172.21.15.181:0/3480336681 reap_dead start 2024-09-13T10:33:59.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bce739640 1 -- 172.21.15.181:0/3480336681 shutdown_connections 2024-09-13T10:33:59.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bce739640 1 -- 172.21.15.181:0/3480336681 >> 172.21.15.181:0/3480336681 conn(0x7f2bc80a6640 msgr2=0x7f2bc80a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:59.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bce739640 1 -- 172.21.15.181:0/3480336681 shutdown_connections 2024-09-13T10:33:59.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.215+0000 7f2bce739640 1 -- 172.21.15.181:0/3480336681 wait complete. 2024-09-13T10:33:59.249 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:33:59.250 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-09-13T10:33:59.250 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:33:59.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.346+0000 7f71ec460640 10 monclient: get_monmap_and_config 2024-09-13T10:33:59.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.346+0000 7f71ec460640 10 monclient: build_initial_monmap 2024-09-13T10:33:59.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.346+0000 7f71ec460640 10 monclient: monmap: 2024-09-13T10:33:59.349 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:59.349 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:59.348187+0000 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:59.348187+0000 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:59.350 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:59.351 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 1 Processor -- start 2024-09-13T10:33:59.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 1 -- start start 2024-09-13T10:33:59.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 10 monclient: init 2024-09-13T10:33:59.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:59.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 10 monclient: _add_conns ranks=[3,7,2,4,8,6,1,0,5] 2024-09-13T10:33:59.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 10 monclient(hunting): picked mon.noname-g con 0x7f71e40a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:59.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 10 monclient(hunting): picked mon.noname-i con 0x7f71e40a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:59.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 10 monclient(hunting): picked mon.noname-b con 0x7f71e413f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:59.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e40a4bc0 con 0x7f71e413f750 2024-09-13T10:33:59.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e413a320 con 0x7f71e40a6640 2024-09-13T10:33:59.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e40a8100 con 0x7f71e40a8340 2024-09-13T10:33:59.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:59.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.347+0000 7f71ec460640 10 monclient(hunting): authenticate will time out at 978.853953s 2024-09-13T10:33:59.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.348+0000 7f71ea9fd640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f71e413f750 legacy=0x7f71e4141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:59.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.348+0000 7f71e99fb640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f71e40a8340 0x7f71e4139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:35662/0 (socket says 172.21.15.181:35662) 2024-09-13T10:33:59.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.348+0000 7f71e99fb640 1 -- 172.21.15.181:0/1282742222 learned_addr learned my addr 172.21.15.181:0/1282742222 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:59.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e99fb640 1 -- 172.21.15.181:0/1282742222 >> v1:172.21.15.195:6792/0 conn(0x7f71e40a8340 legacy=0x7f71e4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71ea1fc640 1 -- 172.21.15.181:0/1282742222 >> v1:172.21.15.195:6790/0 conn(0x7f71e40a6640 legacy=0x7f71e4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 1 -- 172.21.15.181:0/1282742222 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1100515363 0 0) 0x7f71e40a8100 con 0x7f71e40a8340 2024-09-13T10:33:59.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient(hunting): my global_id is 55555 2024-09-13T10:33:59.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 1 -- 172.21.15.181:0/1282742222 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d0003520 con 0x7f71e40a8340 2024-09-13T10:33:59.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 1 -- 172.21.15.181:0/1282742222 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345863614 0 0) 0x7f71e413a320 con 0x7f71e40a6640 2024-09-13T10:33:59.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient(hunting): my global_id is 5457 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 1 -- 172.21.15.181:0/1282742222 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71e40a8100 con 0x7f71e40a6640 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 1 -- 172.21.15.181:0/1282742222 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3586349745 0 0) 0x7f71d0003520 con 0x7f71e40a8340 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 1 -- 172.21.15.181:0/1282742222 >> v1:172.21.15.195:6790/0 conn(0x7f71e40a6640 legacy=0x7f71e4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 1 -- 172.21.15.181:0/1282742222 >> v1:172.21.15.181:6790/0 conn(0x7f71e413f750 legacy=0x7f71e4141b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient: _finish_hunting 0 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 1 monclient: found mon.noname-i 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 1 -- 172.21.15.181:0/1282742222 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e40a48e0 con 0x7f71e40a8340 2024-09-13T10:33:59.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient: _finish_auth 0 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient: _check_auth_tickets 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 1 -- 172.21.15.181:0/1282742222 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71e0001ba0 con 0x7f71e40a8340 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient: dump: 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.363 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71ec460640 5 monclient: authenticate success, global_id 55555 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71ec460640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 1 -- 172.21.15.181:0/1282742222 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71e00048a0 con 0x7f71e40a8340 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71ec460640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:59.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71ec460640 4 set_mon_vals no callback set 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 1 -- 172.21.15.181:0/1282742222 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71e0001d40 con 0x7f71e40a8340 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.350+0000 7f71e91fa640 10 monclient: dump: 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.365 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.351+0000 7f71ec460640 10 monclient: shutdown 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.351+0000 7f71ec460640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.351+0000 7f71ec460640 1 -- 172.21.15.181:0/1282742222 >> v1:172.21.15.195:6792/0 conn(0x7f71e40a8340 legacy=0x7f71e4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.351+0000 7f71ec460640 1 -- 172.21.15.181:0/1282742222 shutdown_connections 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.351+0000 7f71ec460640 1 -- 172.21.15.181:0/1282742222 >> 172.21.15.181:0/1282742222 conn(0x7f71e4077170 msgr2=0x7f71e40abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.351+0000 7f71ec460640 1 -- 172.21.15.181:0/1282742222 shutdown_connections 2024-09-13T10:33:59.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.351+0000 7f71ec460640 1 -- 172.21.15.181:0/1282742222 wait complete. 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.351+0000 7f71ec460640 10 monclient: build_initial_monmap 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.351+0000 7f71ec460640 10 monclient: monmap: 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:59.367 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 1 Processor -- start 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 1 -- start start 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 10 monclient: init 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 10 monclient: _add_conns ranks=[5,7,3,0,6,8,2,1,4] 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 10 monclient(hunting): picked mon.noname-h con 0x7f71e40a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 10 monclient(hunting): picked mon.noname-i con 0x7f71e413f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 10 monclient(hunting): picked mon.noname-g con 0x7f71e41d4310 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e40a1150 con 0x7f71e41d4310 2024-09-13T10:33:59.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e4142db0 con 0x7f71e40a8340 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e40a02e0 con 0x7f71e413f750 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71ec460640 10 monclient(hunting): authenticate will time out at 978.858711s 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71e99fb640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f71e413f750 0x7f71e409daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:35668/0 (socket says 172.21.15.181:35668) 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.352+0000 7f71e99fb640 1 -- 172.21.15.181:0/267605787 learned_addr learned my addr 172.21.15.181:0/267605787 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.354+0000 7f71e99fb640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6792/0 conn(0x7f71e413f750 legacy=0x7f71e409daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.354+0000 7f71ea1fc640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6791/0 conn(0x7f71e40a8340 legacy=0x7f71e409d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.354+0000 7f71ea9fd640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6790/0 conn(0x7f71e41d4310 legacy=0x7f71e41d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353860577 0 0) 0x7f71e40a02e0 con 0x7f71e413f750 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71ea9fd640 1 --1- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6790/0 conn(0x7f71e41d4310 0x7f71e41d6700 :-1 s=OPENED pgs=311 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f71e40a1150 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): my global_id is 55564 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71c8003550 con 0x7f71e413f750 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 860540493 0 0) 0x7f71e4142db0 con 0x7f71e40a8340 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): my global_id is 5603 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71e40a02e0 con 0x7f71e40a8340 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1770830732 0 0) 0x7f71c8003550 con 0x7f71e413f750 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71e4142db0 con 0x7f71e413f750 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71e0001b60 con 0x7f71e413f750 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:33:59.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): dump: 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.371 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3421346371 0 0) 0x7f71e40a02e0 con 0x7f71e40a8340 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71c8003550 con 0x7f71e40a8340 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71d4003610 con 0x7f71e40a8340 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient(hunting): dump: 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.372 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 642024047 0 0) 0x7f71e4142db0 con 0x7f71e413f750 2024-09-13T10:33:59.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6791/0 conn(0x7f71e40a8340 legacy=0x7f71e409d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6790/0 conn(0x7f71e41d4310 legacy=0x7f71e41d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 monclient: found mon.i 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e409edf0 con 0x7f71e413f750 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient: _finish_auth 0 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71ec460640 5 monclient: authenticate success, global_id 55564 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1688237832 0 0) 0x7f71e40a1150 con 0x7f71e41d4310 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71ec460640 10 monclient: _renew_subs 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71ec460640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:33:59.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71ec460640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f71e409e1b0 con 0x7f71e413f750 2024-09-13T10:33:59.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:33:59.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71ec460640 10 monclient: _renew_subs 2024-09-13T10:33:59.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71ec460640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:33:59.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71ec460640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f71e409fbf0 con 0x7f71e413f750 2024-09-13T10:33:59.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71e0001320 con 0x7f71e413f750 2024-09-13T10:33:59.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:59.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71e00048a0 con 0x7f71e413f750 2024-09-13T10:33:59.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71e89f9640 4 set_mon_vals no callback set 2024-09-13T10:33:59.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:59.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.355+0000 7f71daffd640 10 monclient: dump: 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.376 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.377 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.356+0000 7f71ec460640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.356+0000 7f71ec460640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f71cc0065c0 con 0x7f71cc002860 2024-09-13T10:33:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.356+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f71e0011a40 con 0x7f71e413f750 2024-09-13T10:33:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.356+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 4293006143 0 0) 0x7f71e004e460 con 0x7f71e413f750 2024-09-13T10:33:59.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.356+0000 7f71ea9fd640 10 monclient: get_auth_request con 0x7f71c8040190 auth_method 0 2024-09-13T10:33:59.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.358+0000 7f71ea1fc640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6789/0 conn(0x7f71cc002860 legacy=0x7f71cc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.358+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3339410583 0 0) 0x7f71cc0065c0 con 0x7f71cc002860 2024-09-13T10:33:59.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.358+0000 7f71daffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.358+0000 7f71daffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.358+0000 7f71daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.358+0000 7f71daffd640 10 monclient(hunting): my global_id is 55648 2024-09-13T10:33:59.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.358+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71e40a1150 con 0x7f71cc002860 2024-09-13T10:33:59.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.358+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2081778391 0 0) 0x7f71e40a1150 con 0x7f71cc002860 2024-09-13T10:33:59.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.359+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71cc0065c0 con 0x7f71cc002860 2024-09-13T10:33:59.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.359+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71d4003e00 con 0x7f71cc002860 2024-09-13T10:33:59.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.359+0000 7f71daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.359+0000 7f71daffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.359+0000 7f71daffd640 10 monclient: dump: 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.381 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.359+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3127303842 0 0) 0x7f71cc0065c0 con 0x7f71cc002860 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.359+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71cc00a160 con 0x7f71cc002860 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.359+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f71d4004150 con 0x7f71cc002860 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.359+0000 7f71daffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.359+0000 7f71daffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.359+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6789/0 conn(0x7f71cc002860 legacy=0x7f71cc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.359+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6789/0 conn(0x7f71cc002860 legacy=0x7f71cc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.365+0000 7f71ec460640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:59.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.365+0000 7f71ec460640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f71cc009e70 con 0x7f71cc009130 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71ea1fc640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6789/0 conn(0x7f71cc009130 legacy=0x7f71cc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987550076 0 0) 0x7f71cc009e70 con 0x7f71cc009130 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 10 monclient(hunting): my global_id is 55657 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71cc0065c0 con 0x7f71cc009130 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3208522175 0 0) 0x7f71cc0065c0 con 0x7f71cc009130 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71cc009e70 con 0x7f71cc009130 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f71d4005b00 con 0x7f71cc009130 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 10 monclient: dump: 2024-09-13T10:33:59.383 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.384 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.385 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 480679707 0 0) 0x7f71cc009e70 con 0x7f71cc009130 2024-09-13T10:33:59.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f71cc00c3f0 con 0x7f71cc009130 2024-09-13T10:33:59.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7882 (unknown 0 0 3248343587) 0x7f71d4006fb0 con 0x7f71cc009130 2024-09-13T10:33:59.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:59.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:59.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6789/0 conn(0x7f71cc009130 legacy=0x7f71cc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.368+0000 7f71daffd640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6789/0 conn(0x7f71cc009130 legacy=0x7f71cc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:59.385 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:59.385 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 80, 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 253777, 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:59.386 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.387 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.388 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:59.389 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.390 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:59.391 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.393 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:59.394 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:59.395 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.397 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:59.398 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:59.399 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.400 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.401 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.402 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:59.403 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.404 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.406 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:59.406 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:59.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.369+0000 7f71ec460640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6800/1839191919 conn(0x7f71c8040190 legacy=0x7f71c8042650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.369+0000 7f71ec460640 10 monclient: shutdown 2024-09-13T10:33:59.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.369+0000 7f71ec460640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:59.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.369+0000 7f71ec460640 1 -- 172.21.15.181:0/267605787 >> v1:172.21.15.195:6792/0 conn(0x7f71e413f750 legacy=0x7f71e409daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.369+0000 7f71ea9fd640 1 -- 172.21.15.181:0/267605787 reap_dead start 2024-09-13T10:33:59.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.369+0000 7f71ea9fd640 1 -- 172.21.15.181:0/267605787 reap_dead start 2024-09-13T10:33:59.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.369+0000 7f71ec460640 1 -- 172.21.15.181:0/267605787 shutdown_connections 2024-09-13T10:33:59.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.369+0000 7f71ec460640 1 -- 172.21.15.181:0/267605787 >> 172.21.15.181:0/267605787 conn(0x7f71e40a6640 msgr2=0x7f71e4141c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:59.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.369+0000 7f71ec460640 1 -- 172.21.15.181:0/267605787 shutdown_connections 2024-09-13T10:33:59.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.369+0000 7f71ec460640 1 -- 172.21.15.181:0/267605787 wait complete. 2024-09-13T10:33:59.408 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:33:59.408 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-09-13T10:33:59.408 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:33:59.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.504+0000 7f4cc1473640 10 monclient: get_monmap_and_config 2024-09-13T10:33:59.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.504+0000 7f4cc1473640 10 monclient: build_initial_monmap 2024-09-13T10:33:59.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.504+0000 7f4cc1473640 10 monclient: monmap: 2024-09-13T10:33:59.507 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:59.507 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.507 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:59.506023+0000 2024-09-13T10:33:59.507 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:59.506023+0000 2024-09-13T10:33:59.507 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:59.507 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.507 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:59.507 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:59.507 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:59.508 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:59.508 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:59.508 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:59.508 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:59.508 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:59.508 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:59.508 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 1 Processor -- start 2024-09-13T10:33:59.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 1 -- start start 2024-09-13T10:33:59.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 10 monclient: init 2024-09-13T10:33:59.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:59.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 10 monclient: _add_conns ranks=[5,4,7,8,1,0,3,2,6] 2024-09-13T10:33:59.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 10 monclient(hunting): picked mon.noname-h con 0x7f4cbc0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:59.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 10 monclient(hunting): picked mon.noname-c con 0x7f4cbc0a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:59.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 10 monclient(hunting): picked mon.noname-i con 0x7f4cbc13f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:59.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cbc0a5fe0 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cbc0a8080 con 0x7f4cbc0a66d0 2024-09-13T10:33:59.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cbc0a42c0 con 0x7f4cbc13f9a0 2024-09-13T10:33:59.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:59.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cc1473640 10 monclient(hunting): authenticate will time out at 979.011868s 2024-09-13T10:33:59.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cb3fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f4cbc0a6ab0 0x7f4cbc0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:44112/0 (socket says 172.21.15.181:44112) 2024-09-13T10:33:59.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.505+0000 7f4cb3fff640 1 -- 172.21.15.181:0/1597808990 learned_addr learned my addr 172.21.15.181:0/1597808990 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:59.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cb3fff640 1 -- 172.21.15.181:0/1597808990 >> v1:172.21.15.181:6791/0 conn(0x7f4cbc0a6ab0 legacy=0x7f4cbc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cbb7fe640 1 -- 172.21.15.181:0/1597808990 >> v1:172.21.15.195:6792/0 conn(0x7f4cbc13f9a0 legacy=0x7f4cbc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cbaffd640 1 -- 172.21.15.181:0/1597808990 >> v1:172.21.15.195:6791/0 conn(0x7f4cbc0a66d0 legacy=0x7f4cbc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697848469 0 0) 0x7f4cbc0a5fe0 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient(hunting): my global_id is 5620 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ca8003520 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1698071502 0 0) 0x7f4cbc0a42c0 con 0x7f4cbc13f9a0 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient(hunting): my global_id is 55573 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cbc0a5fe0 con 0x7f4cbc13f9a0 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051032046 0 0) 0x7f4cbc0a8080 con 0x7f4cbc0a66d0 2024-09-13T10:33:59.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient(hunting): my global_id is 5612 2024-09-13T10:33:59.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cbc0a42c0 con 0x7f4cbc0a66d0 2024-09-13T10:33:59.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3700687880 0 0) 0x7f4ca8003520 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 >> v1:172.21.15.195:6792/0 conn(0x7f4cbc13f9a0 legacy=0x7f4cbc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 >> v1:172.21.15.195:6791/0 conn(0x7f4cbc0a66d0 legacy=0x7f4cbc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:33:59.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 monclient: found mon.noname-c 2024-09-13T10:33:59.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:59.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:33:59.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc1464e0 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient: _finish_auth 0 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ca4001ad0 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient: dump: 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.517 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cc1473640 5 monclient: authenticate success, global_id 5620 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cc1473640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ca40048a0 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cc1473640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 1 -- 172.21.15.181:0/1597808990 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ca4004e10 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cc1473640 4 set_mon_vals no callback set 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.508+0000 7f4cba7fc640 10 monclient: dump: 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.519 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.509+0000 7f4cc1473640 10 monclient: shutdown 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.509+0000 7f4cc1473640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.509+0000 7f4cc1473640 1 -- 172.21.15.181:0/1597808990 >> v1:172.21.15.181:6791/0 conn(0x7f4cbc0a6ab0 legacy=0x7f4cbc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.509+0000 7f4cc1473640 1 -- 172.21.15.181:0/1597808990 shutdown_connections 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.509+0000 7f4cc1473640 1 -- 172.21.15.181:0/1597808990 >> 172.21.15.181:0/1597808990 conn(0x7f4cbc0abcd0 msgr2=0x7f4cbc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.509+0000 7f4cc1473640 1 -- 172.21.15.181:0/1597808990 shutdown_connections 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.509+0000 7f4cc1473640 1 -- 172.21.15.181:0/1597808990 wait complete. 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.509+0000 7f4cc1473640 10 monclient: build_initial_monmap 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.509+0000 7f4cc1473640 10 monclient: monmap: 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:59.521 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 1 Processor -- start 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 1 -- start start 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 10 monclient: init 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 10 monclient: _add_conns ranks=[7,4,0,6,2,1,5,8,3] 2024-09-13T10:33:59.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 10 monclient(hunting): picked mon.noname-i con 0x7f4cbc0a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:59.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 10 monclient(hunting): picked mon.noname-c con 0x7f4cbc0a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:59.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 10 monclient(hunting): picked mon.noname-a con 0x7f4cbc13f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:59.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cbc0a2350 con 0x7f4cbc13f9a0 2024-09-13T10:33:59.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cbc13f310 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cbc13e770 con 0x7f4cbc0a66d0 2024-09-13T10:33:59.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:59.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cc1473640 10 monclient(hunting): authenticate will time out at 979.016718s 2024-09-13T10:33:59.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cb3fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f4cbc0a6ab0 0x7f4cbc13c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:44116/0 (socket says 172.21.15.181:44116) 2024-09-13T10:33:59.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.510+0000 7f4cb3fff640 1 -- 172.21.15.181:0/2922705473 learned_addr learned my addr 172.21.15.181:0/2922705473 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:59.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.512+0000 7f4cb3fff640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.181:6791/0 conn(0x7f4cbc0a6ab0 legacy=0x7f4cbc13c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.512+0000 7f4cbb7fe640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.181:6789/0 conn(0x7f4cbc13f9a0 legacy=0x7f4cbc1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.512+0000 7f4cbaffd640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.195:6792/0 conn(0x7f4cbc0a66d0 legacy=0x7f4cbc13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1129980167 0 0) 0x7f4cbc13f310 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): my global_id is 5629 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c9c003550 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985705342 0 0) 0x7f4cbc0a2350 con 0x7f4cbc13f9a0 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): my global_id is 55377 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cbc13f310 con 0x7f4cbc13f9a0 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371755014 0 0) 0x7f4cbc13e770 con 0x7f4cbc0a66d0 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): my global_id is 55582 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cbc0a2350 con 0x7f4cbc0a66d0 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3961409297 0 0) 0x7f4c9c003550 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4cbc13e770 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ca4004d90 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): dump: 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.530 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3071179 0 0) 0x7f4cbc13f310 con 0x7f4cbc13f9a0 2024-09-13T10:33:59.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c9c003550 con 0x7f4cbc13f9a0 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4cb4002040 con 0x7f4cbc13f9a0 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient(hunting): dump: 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.532 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 746280455 0 0) 0x7f4cbc0a2350 con 0x7f4cbc0a66d0 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4cbc13f310 con 0x7f4cbc0a66d0 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2607090361 0 0) 0x7f4cbc13e770 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.195:6792/0 conn(0x7f4cbc0a66d0 legacy=0x7f4cbc13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.181:6789/0 conn(0x7f4cbc13f9a0 legacy=0x7f4cbc1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient: _finish_hunting 0 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 monclient: found mon.c 2024-09-13T10:33:59.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:59.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:59.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc13cfb0 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient: _finish_auth 0 2024-09-13T10:33:59.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient: _check_auth_tickets 2024-09-13T10:33:59.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:59.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cc1473640 5 monclient: authenticate success, global_id 5629 2024-09-13T10:33:59.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cc1473640 10 monclient: _renew_subs 2024-09-13T10:33:59.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cc1473640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:59.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cc1473640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4cbc13f030 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cc1473640 10 monclient: _renew_subs 2024-09-13T10:33:59.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cc1473640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:33:59.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cc1473640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f4cbc13c990 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ca4001d20 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4ca4005740 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb9ffb640 4 set_mon_vals no callback set 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.513+0000 7f4cb37fe640 10 monclient: dump: 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.535 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.514+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4ca4011dc0 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.514+0000 7f4cc1473640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:59.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.514+0000 7f4cc1473640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4ca00065c0 con 0x7f4ca0002860 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.514+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 4293006143 0 0) 0x7f4ca404e3a0 con 0x7f4cbc0a6ab0 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.514+0000 7f4cbb7fe640 10 monclient: get_auth_request con 0x7f4c9c040380 auth_method 0 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.516+0000 7f4cbaffd640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.195:6790/0 conn(0x7f4ca0002860 legacy=0x7f4ca0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1605696982 0 0) 0x7f4ca00065c0 con 0x7f4ca0002860 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 10 monclient(hunting): my global_id is 5475 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cbc13e770 con 0x7f4ca0002860 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1411979502 0 0) 0x7f4cbc13e770 con 0x7f4ca0002860 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ca00065c0 con 0x7f4ca0002860 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4cac003da0 con 0x7f4ca0002860 2024-09-13T10:33:59.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 10 monclient: dump: 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.538 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 809939322 0 0) 0x7f4ca00065c0 con 0x7f4ca0002860 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ca000a160 con 0x7f4ca0002860 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4cac004050 con 0x7f4ca0002860 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.195:6790/0 conn(0x7f4ca0002860 legacy=0x7f4ca0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.517+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.195:6790/0 conn(0x7f4ca0002860 legacy=0x7f4ca0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.523+0000 7f4cc1473640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:59.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.523+0000 7f4cc1473640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4ca0009e50 con 0x7f4ca0009110 2024-09-13T10:33:59.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cbaffd640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.195:6790/0 conn(0x7f4ca0009110 legacy=0x7f4ca00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686038509 0 0) 0x7f4ca0009e50 con 0x7f4ca0009110 2024-09-13T10:33:59.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 10 monclient(hunting): my global_id is 5484 2024-09-13T10:33:59.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ca00065c0 con 0x7f4ca0009110 2024-09-13T10:33:59.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 818639832 0 0) 0x7f4ca00065c0 con 0x7f4ca0009110 2024-09-13T10:33:59.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ca0009e50 con 0x7f4ca0009110 2024-09-13T10:33:59.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4cac005b00 con 0x7f4ca0009110 2024-09-13T10:33:59.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:33:59.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 10 monclient: dump: 2024-09-13T10:33:59.542 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.542 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.542 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.542 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.543 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.543 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.543 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.543 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.543 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3031112796 0 0) 0x7f4ca0009e50 con 0x7f4ca0009110 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.526+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4ca000c3f0 con 0x7f4ca0009110 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7550 (unknown 0 0 138182111) 0x7f4cac007d90 con 0x7f4ca0009110 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cb37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cb37fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:59.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.195:6790/0 conn(0x7f4ca0009110 legacy=0x7f4ca00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cb37fe640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.195:6790/0 conn(0x7f4ca0009110 legacy=0x7f4ca00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:59.545 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:59.545 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:59.545 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:59.545 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:33:59.545 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 80, 2024-09-13T10:33:59.545 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 253941, 2024-09-13T10:33:59.545 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:59.545 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:59.546 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:59.547 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.548 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:59.549 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.550 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.551 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.551 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:59.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.551 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:59.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.551 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:59.551 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:59.551 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.551 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:59.552 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.552 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.552 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:59.552 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:59.552 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.552 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.552 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.553 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:59.553 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:59.553 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.553 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:59.553 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.553 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.553 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.555 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.556 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:59.559 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.560 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:59.563 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.564 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.565 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:59.565 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:59.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cc1473640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4c9c040380 legacy=0x7f4c9c042840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cc1473640 10 monclient: shutdown 2024-09-13T10:33:59.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cc1473640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:59.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cc1473640 1 -- 172.21.15.181:0/2922705473 >> v1:172.21.15.181:6791/0 conn(0x7f4cbc0a6ab0 legacy=0x7f4cbc13c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cbb7fe640 1 -- 172.21.15.181:0/2922705473 reap_dead start 2024-09-13T10:33:59.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cbb7fe640 1 -- 172.21.15.181:0/2922705473 reap_dead start 2024-09-13T10:33:59.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cc1473640 1 -- 172.21.15.181:0/2922705473 shutdown_connections 2024-09-13T10:33:59.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cc1473640 1 -- 172.21.15.181:0/2922705473 >> 172.21.15.181:0/2922705473 conn(0x7f4cbc0abcd0 msgr2=0x7f4cbc137cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:59.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cc1473640 1 -- 172.21.15.181:0/2922705473 shutdown_connections 2024-09-13T10:33:59.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.527+0000 7f4cc1473640 1 -- 172.21.15.181:0/2922705473 wait complete. 2024-09-13T10:33:59.567 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:33:59.568 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-09-13T10:33:59.568 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:33:59.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.664+0000 7ffbe90b6640 10 monclient: get_monmap_and_config 2024-09-13T10:33:59.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.664+0000 7ffbe90b6640 10 monclient: build_initial_monmap 2024-09-13T10:33:59.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.664+0000 7ffbe90b6640 10 monclient: monmap: 2024-09-13T10:33:59.674 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:59.674 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:59.665862+0000 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:59.665862+0000 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:59.675 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.664+0000 7ffbe90b6640 1 Processor -- start 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.664+0000 7ffbe90b6640 1 -- start start 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.664+0000 7ffbe90b6640 10 monclient: init 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe90b6640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe90b6640 10 monclient: _add_conns ranks=[3,7,5,8,2,4,1,0,6] 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe90b6640 10 monclient(hunting): picked mon.noname-g con 0x7ffbe40a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe90b6640 10 monclient(hunting): picked mon.noname-i con 0x7ffbe40a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe90b6640 10 monclient(hunting): picked mon.noname-h con 0x7ffbe413f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe90b6640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe40a5fe0 con 0x7ffbe40a66d0 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe90b6640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe40a8080 con 0x7ffbe413f9a0 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe90b6640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe40a42c0 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe90b6640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe90b6640 10 monclient(hunting): authenticate will time out at 979.171441s 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe2d9d640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7ffbe40a66d0 0x7ffbe40a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:34132/0 (socket says 172.21.15.181:34132) 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe259c640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7ffbe40a6ab0 0x7ffbe40a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:35694/0 (socket says 172.21.15.181:35694) 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.665+0000 7ffbe2d9d640 1 -- 172.21.15.181:0/3690882248 learned_addr learned my addr 172.21.15.181:0/3690882248 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.667+0000 7ffbe259c640 1 -- 172.21.15.181:0/3690882248 >> v1:172.21.15.195:6792/0 conn(0x7ffbe40a6ab0 legacy=0x7ffbe40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.667+0000 7ffbe359e640 1 -- 172.21.15.181:0/3690882248 >> v1:172.21.15.195:6791/0 conn(0x7ffbe413f9a0 legacy=0x7ffbe4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.667+0000 7ffbe2d9d640 1 -- 172.21.15.181:0/3690882248 >> v1:172.21.15.195:6790/0 conn(0x7ffbe40a66d0 legacy=0x7ffbe40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113906051 0 0) 0x7ffbe40a42c0 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient(hunting): my global_id is 55591 2024-09-13T10:33:59.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbd0003520 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122050380 0 0) 0x7ffbe40a8080 con 0x7ffbe413f9a0 2024-09-13T10:33:59.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient(hunting): my global_id is 5621 2024-09-13T10:33:59.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbe40a42c0 con 0x7ffbe413f9a0 2024-09-13T10:33:59.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609830610 0 0) 0x7ffbe40a5fe0 con 0x7ffbe40a66d0 2024-09-13T10:33:59.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient(hunting): my global_id is 5493 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbe40a8080 con 0x7ffbe40a66d0 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1953384637 0 0) 0x7ffbd0003520 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 >> v1:172.21.15.195:6791/0 conn(0x7ffbe413f9a0 legacy=0x7ffbe4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 >> v1:172.21.15.195:6790/0 conn(0x7ffbe40a66d0 legacy=0x7ffbe40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 monclient: found mon.noname-i 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe41464e0 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient: _finish_auth 0 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:59.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe90b6640 5 monclient: authenticate success, global_id 55591 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe90b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffbcc001b90 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient: dump: 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.680 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.681 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.681 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.681 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.681 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.681 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.681 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.681 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.681 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe90b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:59.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffbcc0047e0 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:59.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe90b6640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe90b6640 4 set_mon_vals no callback set 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 1 -- 172.21.15.181:0/3690882248 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffbcc004dd0 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe1d9b640 10 monclient: dump: 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.682 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe90b6640 10 monclient: shutdown 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe90b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe90b6640 1 -- 172.21.15.181:0/3690882248 >> v1:172.21.15.195:6792/0 conn(0x7ffbe40a6ab0 legacy=0x7ffbe40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe90b6640 1 -- 172.21.15.181:0/3690882248 shutdown_connections 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe90b6640 1 -- 172.21.15.181:0/3690882248 >> 172.21.15.181:0/3690882248 conn(0x7ffbe40abcd0 msgr2=0x7ffbe40ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:59.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe90b6640 1 -- 172.21.15.181:0/3690882248 shutdown_connections 2024-09-13T10:33:59.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.668+0000 7ffbe90b6640 1 -- 172.21.15.181:0/3690882248 wait complete. 2024-09-13T10:33:59.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.669+0000 7ffbe90b6640 10 monclient: build_initial_monmap 2024-09-13T10:33:59.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.669+0000 7ffbe90b6640 10 monclient: monmap: 2024-09-13T10:33:59.684 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:59.684 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:59.684 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:59.684 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:59.684 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:59.684 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 1 Processor -- start 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 1 -- start start 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 10 monclient: init 2024-09-13T10:33:59.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:59.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 10 monclient: _add_conns ranks=[0,1,6,7,3,5,8,2,4] 2024-09-13T10:33:59.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 10 monclient(hunting): picked mon.noname-a con 0x7ffbe40a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:59.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 10 monclient(hunting): picked mon.noname-f con 0x7ffbe40a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:59.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 10 monclient(hunting): picked mon.noname-d con 0x7ffbe413f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:33:59.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe413f0e0 con 0x7ffbe40a66d0 2024-09-13T10:33:59.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe4142d70 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe4143100 con 0x7ffbe413f9a0 2024-09-13T10:33:59.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:59.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe90b6640 10 monclient(hunting): authenticate will time out at 979.176618s 2024-09-13T10:33:59.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe2d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ffbe40a66d0 0x7ffbe413b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:33620/0 (socket says 172.21.15.181:33620) 2024-09-13T10:33:59.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.670+0000 7ffbe2d9d640 1 -- 172.21.15.181:0/2753664872 learned_addr learned my addr 172.21.15.181:0/2753664872 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:59.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.672+0000 7ffbe2d9d640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.181:6789/0 conn(0x7ffbe40a66d0 legacy=0x7ffbe413b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.672+0000 7ffbe359e640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.181:6792/0 conn(0x7ffbe413f9a0 legacy=0x7ffbe41d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.672+0000 7ffbe259c640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.195:6789/0 conn(0x7ffbe40a6ab0 legacy=0x7ffbe413bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.672+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195644729 0 0) 0x7ffbe413f0e0 con 0x7ffbe40a66d0 2024-09-13T10:33:59.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): my global_id is 55386 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbc4003520 con 0x7ffbe40a66d0 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556762546 0 0) 0x7ffbe4143100 con 0x7ffbe413f9a0 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): my global_id is 5541 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbe413f0e0 con 0x7ffbe413f9a0 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2609187214 0 0) 0x7ffbe4142d70 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): my global_id is 55666 2024-09-13T10:33:59.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbe4143100 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 391002432 0 0) 0x7ffbe413f0e0 con 0x7ffbe413f9a0 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffbe4142d70 con 0x7ffbe413f9a0 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffbdc0020b0 con 0x7ffbe413f9a0 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): dump: 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.694 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1966208701 0 0) 0x7ffbc4003520 con 0x7ffbe40a66d0 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffbe413f0e0 con 0x7ffbe40a66d0 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffbd40047e0 con 0x7ffbe40a66d0 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): dump: 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.696 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3521748340 0 0) 0x7ffbe4143100 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffbc4003520 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffbcc001b50 con 0x7ffbe40a6ab0 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient(hunting): dump: 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.697 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2034569498 0 0) 0x7ffbe4142d70 con 0x7ffbe413f9a0 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.195:6789/0 conn(0x7ffbe40a6ab0 legacy=0x7ffbe413bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.181:6789/0 conn(0x7ffbe40a66d0 legacy=0x7ffbe413b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 monclient: found mon.d 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe413e540 con 0x7ffbe413f9a0 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient: _finish_auth 0 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbe90b6640 5 monclient: authenticate success, global_id 5541 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbe90b6640 10 monclient: _renew_subs 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbe90b6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:59.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbe90b6640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe413cd80 con 0x7ffbe413f9a0 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbe90b6640 10 monclient: _renew_subs 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbe90b6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbe90b6640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7ffbe40a2150 con 0x7ffbe413f9a0 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffbdc003c40 con 0x7ffbe413f9a0 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffbdc0041b0 con 0x7ffbe413f9a0 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbe159a640 4 set_mon_vals no callback set 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.673+0000 7ffbdb7fe640 10 monclient: dump: 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.700 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.674+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ffbdc004450 con 0x7ffbe413f9a0 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.674+0000 7ffbe90b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.674+0000 7ffbe90b6640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffbc80065c0 con 0x7ffbc8002860 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.674+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 4293006143 0 0) 0x7ffbdc04e5b0 con 0x7ffbe413f9a0 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.674+0000 7ffbe259c640 10 monclient: get_auth_request con 0x7ffbc4040700 auth_method 0 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbe2d9d640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.195:6791/0 conn(0x7ffbc8002860 legacy=0x7ffbc8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289461862 0 0) 0x7ffbc80065c0 con 0x7ffbc8002860 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 10 monclient(hunting): my global_id is 5630 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbe4142d70 con 0x7ffbc8002860 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 694680942 0 0) 0x7ffbe4142d70 con 0x7ffbc8002860 2024-09-13T10:33:59.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffbc80065c0 con 0x7ffbc8002860 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffbd4005020 con 0x7ffbc8002860 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 10 monclient: dump: 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.703 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4189343176 0 0) 0x7ffbc80065c0 con 0x7ffbc8002860 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffbc800a160 con 0x7ffbc8002860 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ffbd4005330 con 0x7ffbc8002860 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.195:6791/0 conn(0x7ffbc8002860 legacy=0x7ffbc8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.677+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.195:6791/0 conn(0x7ffbc8002860 legacy=0x7ffbc8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.683+0000 7ffbe90b6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.683+0000 7ffbe90b6640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffbc8009e50 con 0x7ffbc8009110 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.686+0000 7ffbe2d9d640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.195:6791/0 conn(0x7ffbc8009110 legacy=0x7ffbc80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.686+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373882320 0 0) 0x7ffbc8009e50 con 0x7ffbc8009110 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.686+0000 7ffbdb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.686+0000 7ffbdb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.686+0000 7ffbdb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.686+0000 7ffbdb7fe640 10 monclient(hunting): my global_id is 5639 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.686+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbc80065c0 con 0x7ffbc8009110 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 755040870 0 0) 0x7ffbc80065c0 con 0x7ffbc8009110 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffbc8009e50 con 0x7ffbc8009110 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffbd4005c10 con 0x7ffbc8009110 2024-09-13T10:33:59.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 10 monclient: dump: 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.706 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.707 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 478263213 0 0) 0x7ffbc8009e50 con 0x7ffbc8009110 2024-09-13T10:33:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffbc800c3f0 con 0x7ffbc8009110 2024-09-13T10:33:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7548 (unknown 0 0 3952557655) 0x7ffbd4007d90 con 0x7ffbc8009110 2024-09-13T10:33:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.195:6791/0 conn(0x7ffbc8009110 legacy=0x7ffbc80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbdb7fe640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.195:6791/0 conn(0x7ffbc8009110 legacy=0x7ffbc80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:59.708 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:59.708 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:59.708 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:59.708 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:59.708 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 80, 2024-09-13T10:33:59.708 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 254115, 2024-09-13T10:33:59.708 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:59.709 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.710 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.711 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:59.712 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.713 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:59.715 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.716 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.718 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.719 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:59.720 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.721 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.723 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.724 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.726 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:59.727 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:59.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbe90b6640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.195:6800/1839191919 conn(0x7ffbc4040700 legacy=0x7ffbc4042bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbe90b6640 10 monclient: shutdown 2024-09-13T10:33:59.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbe90b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:59.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbe90b6640 1 -- 172.21.15.181:0/2753664872 >> v1:172.21.15.181:6792/0 conn(0x7ffbe413f9a0 legacy=0x7ffbe41d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbe359e640 1 -- 172.21.15.181:0/2753664872 reap_dead start 2024-09-13T10:33:59.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbe359e640 1 -- 172.21.15.181:0/2753664872 reap_dead start 2024-09-13T10:33:59.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbe90b6640 1 -- 172.21.15.181:0/2753664872 shutdown_connections 2024-09-13T10:33:59.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.687+0000 7ffbe90b6640 1 -- 172.21.15.181:0/2753664872 >> 172.21.15.181:0/2753664872 conn(0x7ffbe40abcd0 msgr2=0x7ffbe4138f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:59.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.688+0000 7ffbe90b6640 1 -- 172.21.15.181:0/2753664872 shutdown_connections 2024-09-13T10:33:59.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.688+0000 7ffbe90b6640 1 -- 172.21.15.181:0/2753664872 wait complete. 2024-09-13T10:33:59.730 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:33:59.730 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-09-13T10:33:59.730 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:33:59.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.825+0000 7f7d9c7aa640 10 monclient: get_monmap_and_config 2024-09-13T10:33:59.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.825+0000 7f7d9c7aa640 10 monclient: build_initial_monmap 2024-09-13T10:33:59.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.825+0000 7f7d9c7aa640 10 monclient: monmap: 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:33:59.826809+0000 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:33:59.826809+0000 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:59.828 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:59.829 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:59.829 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.825+0000 7f7d9c7aa640 1 Processor -- start 2024-09-13T10:33:59.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.825+0000 7f7d9c7aa640 1 -- start start 2024-09-13T10:33:59.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.825+0000 7f7d9c7aa640 10 monclient: init 2024-09-13T10:33:59.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d9c7aa640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:59.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d9c7aa640 10 monclient: _add_conns ranks=[2,4,3,8,7,5,1,0,6] 2024-09-13T10:33:59.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d9c7aa640 10 monclient(hunting): picked mon.noname-b con 0x7f7d940a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:33:59.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d9c7aa640 10 monclient(hunting): picked mon.noname-c con 0x7f7d940a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:33:59.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d9c7aa640 10 monclient(hunting): picked mon.noname-g con 0x7f7d9413f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:33:59.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d9c7aa640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d940a5fe0 con 0x7f7d940a66d0 2024-09-13T10:33:59.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d9c7aa640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d940a8080 con 0x7f7d9413f9a0 2024-09-13T10:33:59.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d9c7aa640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d940a42c0 con 0x7f7d940a6ab0 2024-09-13T10:33:59.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d9c7aa640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:59.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d9a546640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f7d940a66d0 legacy=0x7f7d940a53b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:33:59.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d9c7aa640 10 monclient(hunting): authenticate will time out at 979.332585s 2024-09-13T10:33:59.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d99d45640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f7d940a6ab0 0x7f7d940a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:44120/0 (socket says 172.21.15.181:44120) 2024-09-13T10:33:59.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.826+0000 7f7d99d45640 1 -- 172.21.15.181:0/2885517034 learned_addr learned my addr 172.21.15.181:0/2885517034 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:59.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.828+0000 7f7d99d45640 1 -- 172.21.15.181:0/2885517034 >> v1:172.21.15.181:6791/0 conn(0x7f7d940a6ab0 legacy=0x7f7d940a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d9ad47640 1 -- 172.21.15.181:0/2885517034 >> v1:172.21.15.195:6790/0 conn(0x7f7d9413f9a0 legacy=0x7f7d94141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 1 -- 172.21.15.181:0/2885517034 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160894098 0 0) 0x7f7d940a42c0 con 0x7f7d940a6ab0 2024-09-13T10:33:59.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient(hunting): my global_id is 5638 2024-09-13T10:33:59.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 1 -- 172.21.15.181:0/2885517034 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d80003520 con 0x7f7d940a6ab0 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 1 -- 172.21.15.181:0/2885517034 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 789126047 0 0) 0x7f7d940a8080 con 0x7f7d9413f9a0 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient(hunting): my global_id is 5502 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 1 -- 172.21.15.181:0/2885517034 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d940a42c0 con 0x7f7d9413f9a0 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 1 -- 172.21.15.181:0/2885517034 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3229719325 0 0) 0x7f7d80003520 con 0x7f7d940a6ab0 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 1 -- 172.21.15.181:0/2885517034 >> v1:172.21.15.195:6790/0 conn(0x7f7d9413f9a0 legacy=0x7f7d94141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 1 -- 172.21.15.181:0/2885517034 >> v1:172.21.15.181:6790/0 conn(0x7f7d940a66d0 legacy=0x7f7d940a53b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient: _finish_hunting 0 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 1 monclient: found mon.noname-c 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:59.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:33:59.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 1 -- 172.21.15.181:0/2885517034 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d941464e0 con 0x7f7d940a6ab0 2024-09-13T10:33:59.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient: _finish_auth 0 2024-09-13T10:33:59.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient: _check_auth_tickets 2024-09-13T10:33:59.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:59.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 1 -- 172.21.15.181:0/2885517034 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d88001ad0 con 0x7f7d940a6ab0 2024-09-13T10:33:59.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:33:59.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient: dump: 2024-09-13T10:33:59.837 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.837 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.837 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.837 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d9c7aa640 5 monclient: authenticate success, global_id 5638 2024-09-13T10:33:59.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d9c7aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 1 -- 172.21.15.181:0/2885517034 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d880048a0 con 0x7f7d940a6ab0 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 1 -- 172.21.15.181:0/2885517034 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d88004e10 con 0x7f7d940a6ab0 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d9c7aa640 10 monclient: get_monmap_and_config success 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d9c7aa640 4 set_mon_vals no callback set 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d99544640 10 monclient: dump: 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.839 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d9c7aa640 10 monclient: shutdown 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d9c7aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:59.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.829+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/2885517034 >> v1:172.21.15.181:6791/0 conn(0x7f7d940a6ab0 legacy=0x7f7d940a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.830+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/2885517034 shutdown_connections 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.830+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/2885517034 >> 172.21.15.181:0/2885517034 conn(0x7f7d940abcd0 msgr2=0x7f7d940ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.830+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/2885517034 shutdown_connections 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.830+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/2885517034 wait complete. 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.830+0000 7f7d9c7aa640 10 monclient: build_initial_monmap 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.830+0000 7f7d9c7aa640 10 monclient: monmap: 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:33:59.841 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 1 Processor -- start 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 1 -- start start 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 10 monclient: init 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 10 monclient: _reopen_session rank -1 2024-09-13T10:33:59.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 10 monclient: _add_conns ranks=[0,8,1,7,5,3,2,6,4] 2024-09-13T10:33:59.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 10 monclient(hunting): picked mon.noname-a con 0x7f7d940a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:33:59.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 10 monclient(hunting): picked mon.noname-e con 0x7f7d940a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:33:59.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 10 monclient(hunting): picked mon.noname-f con 0x7f7d9413f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:33:59.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d940a2810 con 0x7f7d940a66d0 2024-09-13T10:33:59.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9413e8c0 con 0x7f7d9413f9a0 2024-09-13T10:33:59.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d941cf210 con 0x7f7d940a6ab0 2024-09-13T10:33:59.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 10 monclient(hunting): _renew_subs 2024-09-13T10:33:59.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9c7aa640 10 monclient(hunting): authenticate will time out at 979.337592s 2024-09-13T10:33:59.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9a546640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7d940a66d0 0x7f7d941ce3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:33630/0 (socket says 172.21.15.181:33630) 2024-09-13T10:33:59.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.831+0000 7f7d9a546640 1 -- 172.21.15.181:0/1805490042 learned_addr learned my addr 172.21.15.181:0/1805490042 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:33:59.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d9a546640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.181:6789/0 conn(0x7f7d940a66d0 legacy=0x7f7d941ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d99d45640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.181:6793/0 conn(0x7f7d940a6ab0 legacy=0x7f7d941ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837392702 0 0) 0x7f7d940a2810 con 0x7f7d940a66d0 2024-09-13T10:33:59.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d86ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d86ffd640 10 monclient(hunting): my global_id is 55395 2024-09-13T10:33:59.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d78003550 con 0x7f7d940a66d0 2024-09-13T10:33:59.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292653764 0 0) 0x7f7d941cf210 con 0x7f7d940a6ab0 2024-09-13T10:33:59.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d86ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d86ffd640 10 monclient(hunting): my global_id is 84320 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d940a2810 con 0x7f7d940a6ab0 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.833+0000 7f7d9ad47640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.195:6789/0 conn(0x7f7d9413f9a0 legacy=0x7f7d941d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523813128 0 0) 0x7f7d940a42c0 con 0x7f7d9413f9a0 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): my global_id is 55675 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d941cf210 con 0x7f7d9413f9a0 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4200564900 0 0) 0x7f7d78003550 con 0x7f7d940a66d0 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d940a42c0 con 0x7f7d940a66d0 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d90004760 con 0x7f7d940a66d0 2024-09-13T10:33:59.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): dump: 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.850 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2971601035 0 0) 0x7f7d940a2810 con 0x7f7d940a6ab0 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d78003550 con 0x7f7d940a6ab0 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d88004d90 con 0x7f7d940a6ab0 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): dump: 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.851 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.852 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.853 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 613285169 0 0) 0x7f7d941cf210 con 0x7f7d9413f9a0 2024-09-13T10:33:59.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d940a2810 con 0x7f7d9413f9a0 2024-09-13T10:33:59.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d8c002070 con 0x7f7d9413f9a0 2024-09-13T10:33:59.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:33:59.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:33:59.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient(hunting): dump: 2024-09-13T10:33:59.853 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.853 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.853 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.854 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2381129564 0 0) 0x7f7d940a42c0 con 0x7f7d940a66d0 2024-09-13T10:33:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.181:6793/0 conn(0x7f7d940a6ab0 legacy=0x7f7d941ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.195:6789/0 conn(0x7f7d9413f9a0 legacy=0x7f7d941d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:33:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 monclient: found mon.a 2024-09-13T10:33:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:33:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9413ce00 con 0x7f7d940a66d0 2024-09-13T10:33:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient: _finish_auth 0 2024-09-13T10:33:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:33:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:33:59.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d9c7aa640 5 monclient: authenticate success, global_id 55395 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d9c7aa640 10 monclient: _renew_subs 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d9c7aa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7d9413f160 con 0x7f7d940a66d0 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d9c7aa640 10 monclient: _renew_subs 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d9c7aa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7d9413c430 con 0x7f7d940a66d0 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d90004900 con 0x7f7d940a66d0 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d90004e30 con 0x7f7d940a66d0 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d98d43640 4 set_mon_vals no callback set 2024-09-13T10:33:59.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.834+0000 7f7d86ffd640 10 monclient: dump: 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.857 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.835+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7d900050a0 con 0x7f7d940a66d0 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.835+0000 7f7d9c7aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.835+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7d7c0065c0 con 0x7f7d7c002860 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.835+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 4293006143 0 0) 0x7f7d9004e380 con 0x7f7d940a66d0 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.835+0000 7f7d9ad47640 10 monclient: get_auth_request con 0x7f7d78040400 auth_method 0 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.837+0000 7f7d99d45640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.195:6792/0 conn(0x7f7d7c002860 legacy=0x7f7d7c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.837+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2570412128 0 0) 0x7f7d7c0065c0 con 0x7f7d7c002860 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.837+0000 7f7d86ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.837+0000 7f7d86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.837+0000 7f7d86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.837+0000 7f7d86ffd640 10 monclient(hunting): my global_id is 55600 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.837+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d940a42c0 con 0x7f7d7c002860 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 749444333 0 0) 0x7f7d940a42c0 con 0x7f7d7c002860 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d7c0065c0 con 0x7f7d7c002860 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d880048a0 con 0x7f7d7c002860 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 10 monclient: dump: 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.859 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 748760491 0 0) 0x7f7d7c0065c0 con 0x7f7d7c002860 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d7c00a160 con 0x7f7d7c002860 2024-09-13T10:33:59.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7d88001d20 con 0x7f7d7c002860 2024-09-13T10:33:59.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:33:59.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:33:59.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.195:6792/0 conn(0x7f7d7c002860 legacy=0x7f7d7c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.838+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.195:6792/0 conn(0x7f7d7c002860 legacy=0x7f7d7c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:59.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.844+0000 7f7d9c7aa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:33:59.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.844+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7d7c009e70 con 0x7f7d7c009130 2024-09-13T10:33:59.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.846+0000 7f7d99d45640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.195:6792/0 conn(0x7f7d7c009130 legacy=0x7f7d7c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:33:59.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3075656542 0 0) 0x7f7d7c009e70 con 0x7f7d7c009130 2024-09-13T10:33:59.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:33:59.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:33:59.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:33:59.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 10 monclient(hunting): my global_id is 55609 2024-09-13T10:33:59.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d7c0065c0 con 0x7f7d7c009130 2024-09-13T10:33:59.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3705796698 0 0) 0x7f7d7c0065c0 con 0x7f7d7c009130 2024-09-13T10:33:59.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d7c009e70 con 0x7f7d7c009130 2024-09-13T10:33:59.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7d88005f20 con 0x7f7d7c009130 2024-09-13T10:33:59.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:33:59.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 10 monclient: dump: 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:33:59.864 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:33:59.865 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:33:59.865 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:33:59.865 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:33:59.865 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:33:59.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3070985006 0 0) 0x7f7d7c009e70 con 0x7f7d7c009130 2024-09-13T10:33:59.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7d7c00c410 con 0x7f7d7c009130 2024-09-13T10:33:59.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7715 (unknown 0 0 658297866) 0x7f7d88007490 con 0x7f7d7c009130 2024-09-13T10:33:59.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:33:59.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:33:59.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.195:6792/0 conn(0x7f7d7c009130 legacy=0x7f7d7c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d86ffd640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.195:6792/0 conn(0x7f7d7c009130 legacy=0x7f7d7c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:33:59.866 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:33:59.866 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:59.866 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:59.866 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:33:59.866 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 80, 2024-09-13T10:33:59.866 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 254267, 2024-09-13T10:33:59.866 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:33:59.866 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:33:59.866 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:33:59.866 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:33:59.866 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:33:59.866 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.867 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.868 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.869 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.869 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.869 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.869 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.869 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.869 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.869 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.872 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:33:59.873 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:33:59.874 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.875 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:33:59.876 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.876 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.876 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.876 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:33:59.876 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:33:59.876 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.876 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.876 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.876 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:33:59.877 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.878 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:33:59.881 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.882 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.884 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:33:59.885 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.886 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.887 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:33:59.888 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:33:59.889 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:33:59.889 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:33:59.889 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:33:59.889 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:33:59.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:33:59.889 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:33:59.889 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:33:59.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.847+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7d78040400 legacy=0x7f7d780428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.848+0000 7f7d9c7aa640 10 monclient: shutdown 2024-09-13T10:33:59.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.848+0000 7f7d9c7aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:33:59.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.848+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/1805490042 >> v1:172.21.15.181:6789/0 conn(0x7f7d940a66d0 legacy=0x7f7d941ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:33:59.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.848+0000 7f7d9ad47640 1 -- 172.21.15.181:0/1805490042 reap_dead start 2024-09-13T10:33:59.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.848+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/1805490042 shutdown_connections 2024-09-13T10:33:59.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.848+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/1805490042 >> 172.21.15.181:0/1805490042 conn(0x7f7d940abcd0 msgr2=0x7f7d940a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:33:59.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.848+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/1805490042 shutdown_connections 2024-09-13T10:33:59.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:33:59.848+0000 7f7d9c7aa640 1 -- 172.21.15.181:0/1805490042 wait complete. 2024-09-13T10:33:59.891 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:33:59.892 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T10:34:00.054 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37242]: starting. 2024-09-13T10:34:00.054 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37242]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37240 2024-09-13T10:34:00.054 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37242]: shutting down. 2024-09-13T10:34:01.867 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:01.868 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37279]: starting. 2024-09-13T10:34:01.868 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37279]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37240 2024-09-13T10:34:01.868 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37279]: created object 0... 2024-09-13T10:34:01.868 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37279]: created object 25... 2024-09-13T10:34:01.868 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37279]: created object 49... 2024-09-13T10:34:01.868 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37279]: finishing. 2024-09-13T10:34:01.868 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37279]: shutting down. 2024-09-13T10:34:01.903 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:01.904 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37281]: starting. 2024-09-13T10:34:01.904 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37281]: listing objects. 2024-09-13T10:34:01.904 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37281]: listed object 0... 2024-09-13T10:34:01.904 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37281]: listed object 25... 2024-09-13T10:34:01.904 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37281]: saw 50 objects 2024-09-13T10:34:01.904 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37281]: shutting down. 2024-09-13T10:34:02.777 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:02.777 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37280]: starting. 2024-09-13T10:34:02.777 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37280]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37240 2024-09-13T10:34:02.777 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37280]: shutting down. 2024-09-13T10:34:02.778 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:02.778 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:02.778 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:34:02.781 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:34:05.771 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37350]: starting. 2024-09-13T10:34:05.771 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37350]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37349 2024-09-13T10:34:05.771 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37350]: created object 0... 2024-09-13T10:34:05.771 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37350]: created object 25... 2024-09-13T10:34:05.771 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37350]: created object 49... 2024-09-13T10:34:05.771 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37350]: finishing. 2024-09-13T10:34:05.772 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37350]: shutting down. 2024-09-13T10:34:06.687 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37351]: starting. 2024-09-13T10:34:06.687 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37351]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37349 2024-09-13T10:34:06.687 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37351]: shutting down. 2024-09-13T10:34:08.949 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:08.949 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37386]: starting. 2024-09-13T10:34:08.949 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37386]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37349 2024-09-13T10:34:08.950 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37386]: created object 0... 2024-09-13T10:34:08.950 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37386]: created object 25... 2024-09-13T10:34:08.950 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37386]: created object 49... 2024-09-13T10:34:08.950 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37386]: finishing. 2024-09-13T10:34:08.950 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37386]: shutting down. 2024-09-13T10:34:08.987 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:08.987 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37388]: starting. 2024-09-13T10:34:08.987 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37388]: listing objects. 2024-09-13T10:34:08.987 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37388]: listed object 0... 2024-09-13T10:34:08.987 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37388]: listed object 25... 2024-09-13T10:34:08.987 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37388]: saw 50 objects 2024-09-13T10:34:08.987 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37388]: shutting down. 2024-09-13T10:34:09.860 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:09.860 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37387]: starting. 2024-09-13T10:34:09.860 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37387]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37349 2024-09-13T10:34:09.860 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37387]: shutting down. 2024-09-13T10:34:09.862 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:09.862 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:09.862 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:34:09.864 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:34:12.777 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37457]: starting. 2024-09-13T10:34:12.778 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37457]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37456 2024-09-13T10:34:12.778 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37457]: created object 0... 2024-09-13T10:34:12.778 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37457]: created object 25... 2024-09-13T10:34:12.778 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37457]: created object 49... 2024-09-13T10:34:12.778 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37457]: finishing. 2024-09-13T10:34:12.778 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37457]: shutting down. 2024-09-13T10:34:13.684 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37458]: starting. 2024-09-13T10:34:13.684 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37458]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37456 2024-09-13T10:34:13.684 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37458]: shutting down. 2024-09-13T10:34:16.175 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:16.175 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37493]: starting. 2024-09-13T10:34:16.175 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37493]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37456 2024-09-13T10:34:16.175 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37493]: created object 0... 2024-09-13T10:34:16.175 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37493]: created object 25... 2024-09-13T10:34:16.175 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37493]: created object 49... 2024-09-13T10:34:16.176 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37493]: finishing. 2024-09-13T10:34:16.176 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37493]: shutting down. 2024-09-13T10:34:16.212 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:16.212 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37495]: starting. 2024-09-13T10:34:16.212 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37495]: listing objects. 2024-09-13T10:34:16.212 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37495]: listed object 0... 2024-09-13T10:34:16.212 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37495]: listed object 25... 2024-09-13T10:34:16.212 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37495]: saw 50 objects 2024-09-13T10:34:16.212 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37495]: shutting down. 2024-09-13T10:34:17.069 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:17.069 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37494]: starting. 2024-09-13T10:34:17.069 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37494]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37456 2024-09-13T10:34:17.070 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37494]: shutting down. 2024-09-13T10:34:17.072 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:17.072 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:17.072 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:34:17.074 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:34:19.791 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37564]: starting. 2024-09-13T10:34:19.792 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37564]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37563 2024-09-13T10:34:19.792 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37564]: created object 0... 2024-09-13T10:34:19.792 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37564]: created object 25... 2024-09-13T10:34:19.792 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37564]: created object 49... 2024-09-13T10:34:19.792 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37564]: finishing. 2024-09-13T10:34:19.792 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37564]: shutting down. 2024-09-13T10:34:19.892 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-13T10:34:19.892 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T10:34:19.892 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T10:34:19.895 INFO:tasks.ceph.mon.b:Started 2024-09-13T10:34:19.895 INFO:tasks.mon_thrash:Sending STOP to mon e 2024-09-13T10:34:19.895 INFO:tasks.ceph.mon.e:Sent signal 19 2024-09-13T10:34:19.895 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-09-13T10:34:19.896 INFO:tasks.ceph.mon.h:Sent signal 19 2024-09-13T10:34:19.896 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-13T10:34:25.079 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37565]: starting. 2024-09-13T10:34:25.079 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37565]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37563 2024-09-13T10:34:25.079 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37565]: shutting down. 2024-09-13T10:34:26.723 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:26.723 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37600]: starting. 2024-09-13T10:34:26.723 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37600]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37563 2024-09-13T10:34:26.724 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37600]: created object 0... 2024-09-13T10:34:26.724 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37600]: created object 25... 2024-09-13T10:34:26.724 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37600]: created object 49... 2024-09-13T10:34:26.724 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37600]: finishing. 2024-09-13T10:34:26.724 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37600]: shutting down. 2024-09-13T10:34:26.760 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:26.826 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37602]: starting. 2024-09-13T10:34:26.826 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37602]: listing objects. 2024-09-13T10:34:26.826 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37602]: listed object 0... 2024-09-13T10:34:26.826 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37602]: listed object 25... 2024-09-13T10:34:26.827 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37602]: saw 50 objects 2024-09-13T10:34:26.827 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37602]: shutting down. 2024-09-13T10:34:27.632 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:27.632 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37601]: starting. 2024-09-13T10:34:27.632 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37601]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37563 2024-09-13T10:34:27.633 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37601]: shutting down. 2024-09-13T10:34:27.633 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:27.634 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:27.634 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:34:27.636 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:34:29.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37671]: starting. 2024-09-13T10:34:29.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37671]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37670 2024-09-13T10:34:29.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37671]: created object 0... 2024-09-13T10:34:29.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37671]: created object 25... 2024-09-13T10:34:29.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37671]: created object 49... 2024-09-13T10:34:29.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37671]: finishing. 2024-09-13T10:34:29.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37671]: shutting down. 2024-09-13T10:34:30.642 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37672]: starting. 2024-09-13T10:34:30.643 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37672]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37670 2024-09-13T10:34:30.643 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37672]: shutting down. 2024-09-13T10:34:32.801 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:32.801 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37707]: starting. 2024-09-13T10:34:32.801 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37707]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37670 2024-09-13T10:34:32.801 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37707]: created object 0... 2024-09-13T10:34:32.801 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37707]: created object 25... 2024-09-13T10:34:32.801 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37707]: created object 49... 2024-09-13T10:34:32.801 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37707]: finishing. 2024-09-13T10:34:32.801 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37707]: shutting down. 2024-09-13T10:34:32.838 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:32.839 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37709]: starting. 2024-09-13T10:34:32.839 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37709]: listing objects. 2024-09-13T10:34:32.839 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37709]: listed object 0... 2024-09-13T10:34:32.839 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37709]: listed object 25... 2024-09-13T10:34:32.839 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37709]: saw 50 objects 2024-09-13T10:34:32.839 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37709]: shutting down. 2024-09-13T10:34:33.714 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:33.715 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37708]: starting. 2024-09-13T10:34:33.715 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37708]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37670 2024-09-13T10:34:33.715 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37708]: shutting down. 2024-09-13T10:34:33.716 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:33.716 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:33.716 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:34:33.718 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:34:34.897 INFO:tasks.mon_thrash:Sending CONT to mon e 2024-09-13T10:34:34.897 INFO:tasks.ceph.mon.e:Sent signal 18 2024-09-13T10:34:34.897 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-09-13T10:34:34.897 INFO:tasks.ceph.mon.h:Sent signal 18 2024-09-13T10:34:34.898 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:34:34.898 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:34:35.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.010+0000 7f3a0679f640 10 monclient: get_monmap_and_config 2024-09-13T10:34:35.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.010+0000 7f3a0679f640 10 monclient: build_initial_monmap 2024-09-13T10:34:35.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.011+0000 7f3a0679f640 10 monclient: monmap: 2024-09-13T10:34:35.013 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:35.013 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:35.012611+0000 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:35.012611+0000 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:35.014 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:35.015 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.011+0000 7f3a0679f640 1 Processor -- start 2024-09-13T10:34:35.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.011+0000 7f3a0679f640 1 -- start start 2024-09-13T10:34:35.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.011+0000 7f3a0679f640 10 monclient: init 2024-09-13T10:34:35.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a0679f640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:35.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a0679f640 10 monclient: _add_conns ranks=[7,4,6,1,2,0,3,8,5] 2024-09-13T10:34:35.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a0679f640 10 monclient(hunting): picked mon.noname-i con 0x7f3a0009ca60 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:35.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a0679f640 10 monclient(hunting): picked mon.noname-c con 0x7f3a000a5710 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:35.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a0679f640 10 monclient(hunting): picked mon.noname-d con 0x7f3a000a5b30 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:35.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a0679f640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a0009d970 con 0x7f3a000a5710 2024-09-13T10:34:35.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a0679f640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a000a5f90 con 0x7f3a000a5b30 2024-09-13T10:34:35.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a0679f640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a0009dbe0 con 0x7f3a0009ca60 2024-09-13T10:34:35.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a0679f640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:35.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a0679f640 10 monclient(hunting): authenticate will time out at 1014.518443s 2024-09-13T10:34:35.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a05f9e640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f3a000a5b30 0x7f3a001417a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47306/0 (socket says 172.21.15.181:47306) 2024-09-13T10:34:35.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a04f9c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f3a000a5710 0x7f3a0013e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58576/0 (socket says 172.21.15.181:58576) 2024-09-13T10:34:35.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.012+0000 7f3a05f9e640 1 -- 172.21.15.181:0/2940585434 learned_addr learned my addr 172.21.15.181:0/2940585434 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f3a05f9e640 1 -- 172.21.15.181:0/2940585434 >> v1:172.21.15.181:6792/0 conn(0x7f3a000a5b30 legacy=0x7f3a001417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f3a04f9c640 1 -- 172.21.15.181:0/2940585434 >> v1:172.21.15.181:6791/0 conn(0x7f3a000a5710 legacy=0x7f3a0013e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f3a0579d640 1 -- 172.21.15.181:0/2940585434 >> v1:172.21.15.195:6792/0 conn(0x7f3a0009ca60 legacy=0x7f3a00135d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3246656262 0 0) 0x7f39f80017d0 con 0x7f3a000a5b30 2024-09-13T10:34:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 10 monclient(hunting): my global_id is 5667 2024-09-13T10:34:35.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39ec003520 con 0x7f3a000a5b30 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4191869064 0 0) 0x7f3a0009d970 con 0x7f3a000a5710 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 10 monclient(hunting): my global_id is 5773 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39f80017d0 con 0x7f3a000a5710 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737266015 0 0) 0x7f3a0009dbe0 con 0x7f3a0009ca60 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 10 monclient(hunting): my global_id is 55771 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.014+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a0009d970 con 0x7f3a0009ca60 2024-09-13T10:34:35.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3569134184 0 0) 0x7f39f80017d0 con 0x7f3a000a5710 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 >> v1:172.21.15.195:6792/0 conn(0x7f3a0009ca60 legacy=0x7f3a00135d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 >> v1:172.21.15.181:6792/0 conn(0x7f3a000a5b30 legacy=0x7f3a001417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 10 monclient: _finish_hunting 0 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 1 monclient: found mon.noname-c 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0009dec0 con 0x7f3a000a5710 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 10 monclient: _finish_auth 0 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 10 monclient: _check_auth_tickets 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f39f0001ac0 con 0x7f3a000a5710 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 10 monclient: dump: 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.028 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f3a0679f640 5 monclient: authenticate success, global_id 5773 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f3a0679f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f39f00047e0 con 0x7f3a000a5710 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 1 -- 172.21.15.181:0/2940585434 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f39f0004d50 con 0x7f3a000a5710 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f3a0679f640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f3a0679f640 4 set_mon_vals no callback set 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f39f7fff640 10 monclient: dump: 2024-09-13T10:34:35.029 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.030 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.031 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f3a0679f640 10 monclient: shutdown 2024-09-13T10:34:35.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f3a0679f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:35.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f3a0679f640 1 -- 172.21.15.181:0/2940585434 >> v1:172.21.15.181:6791/0 conn(0x7f3a000a5710 legacy=0x7f3a0013e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f3a0679f640 1 -- 172.21.15.181:0/2940585434 shutdown_connections 2024-09-13T10:34:35.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f3a0679f640 1 -- 172.21.15.181:0/2940585434 >> 172.21.15.181:0/2940585434 conn(0x7f3a00076e90 msgr2=0x7f3a000aba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:35.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f3a0679f640 1 -- 172.21.15.181:0/2940585434 shutdown_connections 2024-09-13T10:34:35.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.015+0000 7f3a0679f640 1 -- 172.21.15.181:0/2940585434 wait complete. 2024-09-13T10:34:35.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.016+0000 7f3a0679f640 10 monclient: build_initial_monmap 2024-09-13T10:34:35.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.016+0000 7f3a0679f640 10 monclient: monmap: 2024-09-13T10:34:35.031 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:35.031 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:35.032 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:35.032 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:35.032 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:35.032 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:35.032 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:35.032 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:35.032 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:35.032 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:35.032 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.016+0000 7f3a0679f640 1 Processor -- start 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.016+0000 7f3a0679f640 1 -- start start 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.016+0000 7f3a0679f640 10 monclient: init 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.017+0000 7f3a0679f640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.017+0000 7f3a0679f640 10 monclient: _add_conns ranks=[5,0,1,4,2,8,6,3,7] 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.017+0000 7f3a0679f640 10 monclient(hunting): picked mon.noname-h con 0x7f3a0009ca60 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.017+0000 7f3a0679f640 10 monclient(hunting): picked mon.noname-a con 0x7f3a000a5710 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.017+0000 7f3a0679f640 10 monclient(hunting): picked mon.noname-f con 0x7f3a000a5b30 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:35.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.017+0000 7f3a0679f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a001ce650 con 0x7f3a000a5710 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.017+0000 7f3a0679f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a000a35e0 con 0x7f3a000a5b30 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.017+0000 7f3a0679f640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a000a12a0 con 0x7f3a0009ca60 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.017+0000 7f3a0679f640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.017+0000 7f3a0679f640 10 monclient(hunting): authenticate will time out at 1014.523307s 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.017+0000 7f3a04f9c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f3a000a5710 0x7f3a001d32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35824/0 (socket says 172.21.15.181:35824) 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.017+0000 7f3a04f9c640 1 -- 172.21.15.181:0/4269053777 learned_addr learned my addr 172.21.15.181:0/4269053777 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f3a04f9c640 1 -- 172.21.15.181:0/4269053777 >> v1:172.21.15.181:6789/0 conn(0x7f3a000a5710 legacy=0x7f3a001d32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f3a0579d640 1 -- 172.21.15.181:0/4269053777 >> v1:172.21.15.195:6791/0 conn(0x7f3a0009ca60 legacy=0x7f3a000a4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f3a05f9e640 1 -- 172.21.15.181:0/4269053777 >> v1:172.21.15.195:6789/0 conn(0x7f3a000a5b30 legacy=0x7f3a001d6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822788080 0 0) 0x7f3a0009dec0 con 0x7f3a000a5710 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): my global_id is 55476 2024-09-13T10:34:35.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39e4003520 con 0x7f3a000a5710 2024-09-13T10:34:35.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 706683543 0 0) 0x7f3a000a12a0 con 0x7f3a0009ca60 2024-09-13T10:34:35.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): my global_id is 5711 2024-09-13T10:34:35.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a0009dec0 con 0x7f3a0009ca60 2024-09-13T10:34:35.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68400528 0 0) 0x7f3a000a35e0 con 0x7f3a000a5b30 2024-09-13T10:34:35.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): my global_id is 55819 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a000a12a0 con 0x7f3a000a5b30 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3875551390 0 0) 0x7f39e4003520 con 0x7f3a000a5710 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a000a35e0 con 0x7f3a000a5710 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f39f0004cd0 con 0x7f3a000a5710 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.019+0000 7f39f5ffb640 10 monclient(hunting): dump: 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.036 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 811610798 0 0) 0x7f3a0009dec0 con 0x7f3a0009ca60 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f39e4003520 con 0x7f3a0009ca60 2024-09-13T10:34:35.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2124237594 0 0) 0x7f3a000a12a0 con 0x7f3a000a5b30 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a0009dec0 con 0x7f3a000a5b30 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f39fc003610 con 0x7f3a0009ca60 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient(hunting): dump: 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.038 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f39f8001e90 con 0x7f3a000a5b30 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient(hunting): dump: 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.039 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.040 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3168638885 0 0) 0x7f3a000a35e0 con 0x7f3a000a5710 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 >> v1:172.21.15.195:6791/0 conn(0x7f3a0009ca60 legacy=0x7f3a000a4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 >> v1:172.21.15.195:6789/0 conn(0x7f3a000a5b30 legacy=0x7f3a001d6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 monclient: found mon.a 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a000a1960 con 0x7f3a000a5710 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient: _finish_auth 0 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:35.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f3a0679f640 5 monclient: authenticate success, global_id 55476 2024-09-13T10:34:35.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f3a0679f640 10 monclient: _renew_subs 2024-09-13T10:34:35.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f3a0679f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:35.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f3a0679f640 1 -- 172.21.15.181:0/4269053777 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3a000a2d40 con 0x7f3a000a5710 2024-09-13T10:34:35.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f39f0001ae0 con 0x7f3a000a5710 2024-09-13T10:34:35.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:35.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f39f0005680 con 0x7f3a000a5710 2024-09-13T10:34:35.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:35.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f5ffb640 10 monclient: dump: 2024-09-13T10:34:35.042 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.042 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f3a0679f640 10 monclient: _renew_subs 2024-09-13T10:34:35.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f39f77fe640 4 set_mon_vals no callback set 2024-09-13T10:34:35.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f3a0679f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:35.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.020+0000 7f3a0679f640 1 -- 172.21.15.181:0/4269053777 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3a000a53e0 con 0x7f3a000a5710 2024-09-13T10:34:35.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.021+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f39f0011d00 con 0x7f3a000a5710 2024-09-13T10:34:35.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.021+0000 7f3a0679f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:35.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.021+0000 7f3a0679f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:35.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.021+0000 7f3a0679f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:35.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.021+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(146..146 src has 1..146) ==== 3898+0+0 (unknown 2774010261 0 0) 0x7f39f004e430 con 0x7f3a000a5710 2024-09-13T10:34:35.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.021+0000 7f3a0679f640 1 -- 172.21.15.181:0/4269053777 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a001350d0 con 0x7f3a000a5710 2024-09-13T10:34:35.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.021+0000 7f3a0579d640 10 monclient: get_auth_request con 0x7f39e4040500 auth_method 0 2024-09-13T10:34:35.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.026+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f3a001350d0 con 0x7f3a000a5710 2024-09-13T10:34:35.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.026+0000 7f39f5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:35.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.026+0000 7f39f5ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:35.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.269+0000 7f3a0679f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:34:35.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.269+0000 7f3a0679f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:34:35.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.269+0000 7f3a0679f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:35.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.269+0000 7f3a0679f640 1 -- 172.21.15.181:0/4269053777 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3a00134c70 con 0x7f3a000a5710 2024-09-13T10:34:35.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.270+0000 7f39f5ffb640 1 -- 172.21.15.181:0/4269053777 <== mon.0 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 4168415939) 0x7f3a001ce650 con 0x7f3a000a5710 2024-09-13T10:34:35.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.270+0000 7f39f5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:34:35.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.270+0000 7f39f5ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:35.273 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":84,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:34:35.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.272+0000 7f3a0679f640 1 -- 172.21.15.181:0/4269053777 >> v1:172.21.15.195:6800/1839191919 conn(0x7f39e4040500 legacy=0x7f39e40429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.272+0000 7f3a0679f640 10 monclient: shutdown 2024-09-13T10:34:35.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.272+0000 7f3a0679f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:35.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.272+0000 7f3a0679f640 1 -- 172.21.15.181:0/4269053777 >> v1:172.21.15.181:6789/0 conn(0x7f3a000a5710 legacy=0x7f3a001d32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.272+0000 7f3a0679f640 1 -- 172.21.15.181:0/4269053777 shutdown_connections 2024-09-13T10:34:35.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.272+0000 7f3a0679f640 1 -- 172.21.15.181:0/4269053777 >> 172.21.15.181:0/4269053777 conn(0x7f3a00076e90 msgr2=0x7f3a000a6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:35.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.272+0000 7f3a0679f640 1 -- 172.21.15.181:0/4269053777 shutdown_connections 2024-09-13T10:34:35.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.272+0000 7f3a0679f640 1 -- 172.21.15.181:0/4269053777 wait complete. 2024-09-13T10:34:35.285 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:34:35.285 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:34:35.285 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:34:35.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.380+0000 7f5ac2fd0640 10 monclient: get_monmap_and_config 2024-09-13T10:34:35.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.380+0000 7f5ac2fd0640 10 monclient: build_initial_monmap 2024-09-13T10:34:35.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.380+0000 7f5ac2fd0640 10 monclient: monmap: 2024-09-13T10:34:35.383 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:35.383 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:35.382483+0000 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:35.382483+0000 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:35.384 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.381+0000 7f5ac2fd0640 1 Processor -- start 2024-09-13T10:34:35.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.381+0000 7f5ac2fd0640 1 -- start start 2024-09-13T10:34:35.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.381+0000 7f5ac2fd0640 10 monclient: init 2024-09-13T10:34:35.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.382+0000 7f5ac2fd0640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:35.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.382+0000 7f5ac2fd0640 10 monclient: _add_conns ranks=[3,6,7,0,4,2,8,1,5] 2024-09-13T10:34:35.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.382+0000 7f5ac2fd0640 10 monclient(hunting): picked mon.noname-g con 0x7f5abc0a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:35.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.382+0000 7f5ac2fd0640 10 monclient(hunting): picked mon.noname-d con 0x7f5abc0a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:35.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.382+0000 7f5ac2fd0640 10 monclient(hunting): picked mon.noname-i con 0x7f5abc13f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:35.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.382+0000 7f5ac2fd0640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5abc0a4bc0 con 0x7f5abc0a6640 2024-09-13T10:34:35.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.382+0000 7f5ac2fd0640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5abc13a320 con 0x7f5abc0a8340 2024-09-13T10:34:35.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.382+0000 7f5ac2fd0640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5abc0a8100 con 0x7f5abc13f750 2024-09-13T10:34:35.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.382+0000 7f5ac2fd0640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:35.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.382+0000 7f5ac2fd0640 10 monclient(hunting): authenticate will time out at 1014.888226s 2024-09-13T10:34:35.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.382+0000 7f5abbfff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f5abc0a8340 0x7f5abc139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47314/0 (socket says 172.21.15.181:47314) 2024-09-13T10:34:35.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.382+0000 7f5abbfff640 1 -- 172.21.15.181:0/4182095640 learned_addr learned my addr 172.21.15.181:0/4182095640 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:35.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abbfff640 1 -- 172.21.15.181:0/4182095640 >> v1:172.21.15.181:6792/0 conn(0x7f5abc0a8340 legacy=0x7f5abc139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5ac0d6c640 1 -- 172.21.15.181:0/4182095640 >> v1:172.21.15.195:6790/0 conn(0x7f5abc0a6640 legacy=0x7f5abc139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5ac156d640 1 -- 172.21.15.181:0/4182095640 >> v1:172.21.15.195:6792/0 conn(0x7f5abc13f750 legacy=0x7f5abc141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2363809777 0 0) 0x7f5abc13a320 con 0x7f5abc0a8340 2024-09-13T10:34:35.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient(hunting): my global_id is 5676 2024-09-13T10:34:35.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa4003520 con 0x7f5abc0a8340 2024-09-13T10:34:35.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443075215 0 0) 0x7f5abc0a4bc0 con 0x7f5abc0a6640 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient(hunting): my global_id is 5664 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5abc13a320 con 0x7f5abc0a6640 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1542620233 0 0) 0x7f5abc0a8100 con 0x7f5abc13f750 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient(hunting): my global_id is 55780 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5abc0a4bc0 con 0x7f5abc13f750 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1793610782 0 0) 0x7f5aa4003520 con 0x7f5abc0a8340 2024-09-13T10:34:35.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 >> v1:172.21.15.195:6792/0 conn(0x7f5abc13f750 legacy=0x7f5abc141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 >> v1:172.21.15.195:6790/0 conn(0x7f5abc0a6640 legacy=0x7f5abc139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 1 monclient: found mon.noname-d 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc0a48e0 con 0x7f5abc0a8340 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient: _finish_auth 0 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ab0001f20 con 0x7f5abc0a8340 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5abb7fe640 10 monclient: dump: 2024-09-13T10:34:35.400 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.401 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5ac2fd0640 5 monclient: authenticate success, global_id 5676 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.384+0000 7f5ac2fd0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ab0004c20 con 0x7f5abc0a8340 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5abb7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5abb7fe640 1 -- 172.21.15.181:0/4182095640 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ab0005190 con 0x7f5abc0a8340 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5ac2fd0640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5ac2fd0640 4 set_mon_vals no callback set 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5abb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5abb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5abb7fe640 10 monclient: dump: 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.402 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.403 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5ac2fd0640 10 monclient: shutdown 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5ac2fd0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/4182095640 >> v1:172.21.15.181:6792/0 conn(0x7f5abc0a8340 legacy=0x7f5abc139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/4182095640 shutdown_connections 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/4182095640 >> 172.21.15.181:0/4182095640 conn(0x7f5abc077170 msgr2=0x7f5abc0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/4182095640 shutdown_connections 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.385+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/4182095640 wait complete. 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.386+0000 7f5ac2fd0640 10 monclient: build_initial_monmap 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.386+0000 7f5ac2fd0640 10 monclient: monmap: 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:35.404 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.386+0000 7f5ac2fd0640 1 Processor -- start 2024-09-13T10:34:35.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.386+0000 7f5ac2fd0640 1 -- start start 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.386+0000 7f5ac2fd0640 10 monclient: init 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.387+0000 7f5ac2fd0640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.387+0000 7f5ac2fd0640 10 monclient: _add_conns ranks=[5,6,4,8,1,0,3,7,2] 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.387+0000 7f5ac2fd0640 10 monclient(hunting): picked mon.noname-h con 0x7f5abc0a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.387+0000 7f5ac2fd0640 10 monclient(hunting): picked mon.noname-d con 0x7f5abc13f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.387+0000 7f5ac2fd0640 10 monclient(hunting): picked mon.noname-c con 0x7f5abc135390 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.387+0000 7f5ac2fd0640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5abc134f70 con 0x7f5abc135390 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.387+0000 7f5ac2fd0640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5abc130280 con 0x7f5abc0a8340 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.387+0000 7f5ac2fd0640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5abc1346d0 con 0x7f5abc13f750 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.387+0000 7f5ac2fd0640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.387+0000 7f5ac2fd0640 10 monclient(hunting): authenticate will time out at 1014.893198s 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.387+0000 7f5abbfff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f5abc13f750 0x7f5abc12fb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47318/0 (socket says 172.21.15.181:47318) 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.387+0000 7f5abbfff640 1 -- 172.21.15.181:0/431612318 learned_addr learned my addr 172.21.15.181:0/431612318 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:35.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5abbfff640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.181:6792/0 conn(0x7f5abc13f750 legacy=0x7f5abc12fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ac156d640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.181:6791/0 conn(0x7f5abc135390 legacy=0x7f5abc1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ac0d6c640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.195:6791/0 conn(0x7f5abc0a8340 legacy=0x7f5abc12f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2465017902 0 0) 0x7f5abc1346d0 con 0x7f5abc13f750 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): my global_id is 5685 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa8003520 con 0x7f5abc13f750 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652707510 0 0) 0x7f5abc134f70 con 0x7f5abc135390 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): my global_id is 5782 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5abc1346d0 con 0x7f5abc135390 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2626564050 0 0) 0x7f5abc130280 con 0x7f5abc0a8340 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): my global_id is 5720 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5abc134f70 con 0x7f5abc0a8340 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3545656555 0 0) 0x7f5aa8003520 con 0x7f5abc13f750 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5abc130280 con 0x7f5abc13f750 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ab0001ee0 con 0x7f5abc13f750 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): dump: 2024-09-13T10:34:35.408 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.409 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3818190211 0 0) 0x7f5abc1346d0 con 0x7f5abc135390 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5aa8003520 con 0x7f5abc135390 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 626462644 0 0) 0x7f5abc134f70 con 0x7f5abc0a8340 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5abc1346d0 con 0x7f5abc0a8340 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ab4001d30 con 0x7f5abc135390 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): dump: 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.410 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5aac003610 con 0x7f5abc0a8340 2024-09-13T10:34:35.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.389+0000 7f5ab97fa640 10 monclient(hunting): dump: 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.412 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 824499275 0 0) 0x7f5abc130280 con 0x7f5abc13f750 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.195:6791/0 conn(0x7f5abc0a8340 legacy=0x7f5abc12f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.181:6791/0 conn(0x7f5abc135390 legacy=0x7f5abc1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 10 monclient: _finish_hunting 0 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 1 monclient: found mon.d 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5abc1349b0 con 0x7f5abc13f750 2024-09-13T10:34:35.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 10 monclient: _finish_auth 0 2024-09-13T10:34:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 10 monclient: _check_auth_tickets 2024-09-13T10:34:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3853155971 0 0) 0x7f5aa8003520 con 0x7f5abc135390 2024-09-13T10:34:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:34:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ac2fd0640 5 monclient: authenticate success, global_id 5685 2024-09-13T10:34:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ac2fd0640 10 monclient: _renew_subs 2024-09-13T10:34:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ac2fd0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5abc13d780 con 0x7f5abc13f750 2024-09-13T10:34:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ac2fd0640 10 monclient: _renew_subs 2024-09-13T10:34:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ac2fd0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f5abc13e620 con 0x7f5abc13f750 2024-09-13T10:34:35.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ab0004c20 con 0x7f5abc13f750 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ab0005af0 con 0x7f5abc13f750 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5abaffd640 4 set_mon_vals no callback set 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ab97fa640 10 monclient: dump: 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.415 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.390+0000 7f5ac2fd0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.391+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5a9c0065c0 con 0x7f5a9c002860 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.391+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5ab0012170 con 0x7f5abc13f750 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.391+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(146..146 src has 1..146) ==== 3898+0+0 (unknown 2774010261 0 0) 0x7f5ab004e860 con 0x7f5abc13f750 2024-09-13T10:34:35.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.391+0000 7f5ac156d640 10 monclient: get_auth_request con 0x7f5aa8040680 auth_method 0 2024-09-13T10:34:35.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ac0d6c640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.181:6789/0 conn(0x7f5a9c002860 legacy=0x7f5a9c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 425393894 0 0) 0x7f5a9c0065c0 con 0x7f5a9c002860 2024-09-13T10:34:35.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 10 monclient(hunting): my global_id is 55485 2024-09-13T10:34:35.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa8003520 con 0x7f5a9c002860 2024-09-13T10:34:35.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1857936944 0 0) 0x7f5aa8003520 con 0x7f5a9c002860 2024-09-13T10:34:35.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a9c0065c0 con 0x7f5a9c002860 2024-09-13T10:34:35.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5aac003d60 con 0x7f5a9c002860 2024-09-13T10:34:35.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:35.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 10 monclient: dump: 2024-09-13T10:34:35.418 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.418 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.418 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.418 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.418 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.418 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.418 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.418 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1985714525 0 0) 0x7f5a9c0065c0 con 0x7f5a9c002860 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.393+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a9c00a160 con 0x7f5a9c002860 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.394+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5aac004010 con 0x7f5a9c002860 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.394+0000 7f5ab97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:35.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.394+0000 7f5ab97fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:35.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.394+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.181:6789/0 conn(0x7f5a9c002860 legacy=0x7f5a9c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.394+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.181:6789/0 conn(0x7f5a9c002860 legacy=0x7f5a9c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:35.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.400+0000 7f5ac2fd0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:35.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.400+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5a9c009e70 con 0x7f5a9c009130 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ac0d6c640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.181:6789/0 conn(0x7f5a9c009130 legacy=0x7f5a9c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289790260 0 0) 0x7f5a9c009e70 con 0x7f5a9c009130 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 10 monclient(hunting): my global_id is 55494 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a9c0065c0 con 0x7f5a9c009130 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3216425238 0 0) 0x7f5a9c0065c0 con 0x7f5a9c009130 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a9c009e70 con 0x7f5a9c009130 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5aac0043f0 con 0x7f5a9c009130 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:35.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 10 monclient: dump: 2024-09-13T10:34:35.423 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.423 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.423 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.423 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.423 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.423 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.423 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.423 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.423 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2512544347 0 0) 0x7f5a9c009e70 con 0x7f5a9c009130 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5a9c00c3f0 con 0x7f5a9c009130 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 2468987793) 0x7f5aac007b60 con 0x7f5a9c009130 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:35.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.181:6789/0 conn(0x7f5a9c009130 legacy=0x7f5a9c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.402+0000 7f5ab97fa640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.181:6789/0 conn(0x7f5a9c009130 legacy=0x7f5a9c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:35.425 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:35.425 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:35.425 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:35.425 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:35.425 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:35.425 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 289835, 2024-09-13T10:34:35.425 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:35.425 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:35.425 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:35.426 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:35.427 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:35.429 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:35.430 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.431 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:35.432 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.434 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.435 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:35.438 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.439 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.441 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.442 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.443 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:35.444 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:35.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.403+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5aa8040680 legacy=0x7f5aa8042b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.403+0000 7f5ac2fd0640 10 monclient: shutdown 2024-09-13T10:34:35.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.403+0000 7f5ac2fd0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:35.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.403+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/431612318 >> v1:172.21.15.181:6792/0 conn(0x7f5abc13f750 legacy=0x7f5abc12fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.403+0000 7f5ac156d640 1 -- 172.21.15.181:0/431612318 reap_dead start 2024-09-13T10:34:35.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.403+0000 7f5ac156d640 1 -- 172.21.15.181:0/431612318 reap_dead start 2024-09-13T10:34:35.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.403+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/431612318 shutdown_connections 2024-09-13T10:34:35.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.403+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/431612318 >> 172.21.15.181:0/431612318 conn(0x7f5abc0a6640 msgr2=0x7f5abc0a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:35.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.403+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/431612318 shutdown_connections 2024-09-13T10:34:35.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.403+0000 7f5ac2fd0640 1 -- 172.21.15.181:0/431612318 wait complete. 2024-09-13T10:34:35.447 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:35.447 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:34:35.447 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:34:35.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.543+0000 7f2961b1e640 10 monclient: get_monmap_and_config 2024-09-13T10:34:35.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.543+0000 7f2961b1e640 10 monclient: build_initial_monmap 2024-09-13T10:34:35.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.544+0000 7f2961b1e640 10 monclient: monmap: 2024-09-13T10:34:35.546 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:35.545586+0000 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:35.545586+0000 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:35.547 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:35.548 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.544+0000 7f2961b1e640 1 Processor -- start 2024-09-13T10:34:35.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.544+0000 7f2961b1e640 1 -- start start 2024-09-13T10:34:35.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.544+0000 7f2961b1e640 10 monclient: init 2024-09-13T10:34:35.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.545+0000 7f2961b1e640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:35.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.545+0000 7f2961b1e640 10 monclient: _add_conns ranks=[8,0,3,7,5,2,4,6,1] 2024-09-13T10:34:35.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.545+0000 7f2961b1e640 10 monclient(hunting): picked mon.noname-e con 0x7f295c0a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:35.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.545+0000 7f2961b1e640 10 monclient(hunting): picked mon.noname-a con 0x7f295c0a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:35.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.545+0000 7f2961b1e640 10 monclient(hunting): picked mon.noname-g con 0x7f295c13f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:35.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.545+0000 7f2961b1e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c0a4bc0 con 0x7f295c0a8340 2024-09-13T10:34:35.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.545+0000 7f2961b1e640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c13a320 con 0x7f295c13f750 2024-09-13T10:34:35.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.545+0000 7f2961b1e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c0a8100 con 0x7f295c0a6640 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.545+0000 7f2961b1e640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.545+0000 7f2961b1e640 10 monclient(hunting): authenticate will time out at 1015.051392s 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.545+0000 7f295affd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f295c0a8340 0x7f295c139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35852/0 (socket says 172.21.15.181:35852) 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.545+0000 7f295affd640 1 -- 172.21.15.181:0/2715642681 learned_addr learned my addr 172.21.15.181:0/2715642681 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295b7fe640 1 -- 172.21.15.181:0/2715642681 >> v1:172.21.15.181:6793/0 conn(0x7f295c0a6640 legacy=0x7f295c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295affd640 1 -- 172.21.15.181:0/2715642681 >> v1:172.21.15.181:6789/0 conn(0x7f295c0a8340 legacy=0x7f295c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 1 -- 172.21.15.181:0/2715642681 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398771207 0 0) 0x7f295c0a8100 con 0x7f295c0a6640 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 10 monclient(hunting): my global_id is 84410 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 1 -- 172.21.15.181:0/2715642681 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2944003520 con 0x7f295c0a6640 2024-09-13T10:34:35.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 1 -- 172.21.15.181:0/2715642681 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320279506 0 0) 0x7f295c0a4bc0 con 0x7f295c0a8340 2024-09-13T10:34:35.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 10 monclient(hunting): my global_id is 55503 2024-09-13T10:34:35.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 1 -- 172.21.15.181:0/2715642681 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f295c0a8100 con 0x7f295c0a8340 2024-09-13T10:34:35.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295bfff640 1 -- 172.21.15.181:0/2715642681 >> v1:172.21.15.195:6790/0 conn(0x7f295c13f750 legacy=0x7f295c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.547+0000 7f295a7fc640 1 -- 172.21.15.181:0/2715642681 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 614776480 0 0) 0x7f295c0a8100 con 0x7f295c0a8340 2024-09-13T10:34:35.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 1 -- 172.21.15.181:0/2715642681 >> v1:172.21.15.181:6793/0 conn(0x7f295c0a6640 legacy=0x7f295c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 1 -- 172.21.15.181:0/2715642681 >> v1:172.21.15.195:6790/0 conn(0x7f295c13f750 legacy=0x7f295c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:34:35.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 1 monclient: found mon.noname-a 2024-09-13T10:34:35.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 1 -- 172.21.15.181:0/2715642681 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c0a48e0 con 0x7f295c0a8340 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 1 -- 172.21.15.181:0/2715642681 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2950001ac0 con 0x7f295c0a8340 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f2961b1e640 5 monclient: authenticate success, global_id 55503 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f2961b1e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 10 monclient: dump: 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.555 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.556 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.556 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.556 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.556 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.556 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.556 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.556 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.556 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.556 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.556 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.556 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.556 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f2961b1e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 1 -- 172.21.15.181:0/2715642681 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f29500048a0 con 0x7f295c0a8340 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f2961b1e640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 1 -- 172.21.15.181:0/2715642681 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2950004dd0 con 0x7f295c0a8340 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f2961b1e640 4 set_mon_vals no callback set 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f295a7fc640 10 monclient: dump: 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.557 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.558 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f2961b1e640 10 monclient: shutdown 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f2961b1e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f2961b1e640 1 -- 172.21.15.181:0/2715642681 >> v1:172.21.15.181:6789/0 conn(0x7f295c0a8340 legacy=0x7f295c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f2961b1e640 1 -- 172.21.15.181:0/2715642681 shutdown_connections 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f2961b1e640 1 -- 172.21.15.181:0/2715642681 >> 172.21.15.181:0/2715642681 conn(0x7f295c077170 msgr2=0x7f295c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f2961b1e640 1 -- 172.21.15.181:0/2715642681 shutdown_connections 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.548+0000 7f2961b1e640 1 -- 172.21.15.181:0/2715642681 wait complete. 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.549+0000 7f2961b1e640 10 monclient: build_initial_monmap 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.549+0000 7f2961b1e640 10 monclient: monmap: 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:35.559 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.549+0000 7f2961b1e640 1 Processor -- start 2024-09-13T10:34:35.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.549+0000 7f2961b1e640 1 -- start start 2024-09-13T10:34:35.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.549+0000 7f2961b1e640 10 monclient: init 2024-09-13T10:34:35.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f2961b1e640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:35.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f2961b1e640 10 monclient: _add_conns ranks=[4,3,0,6,7,8,2,1,5] 2024-09-13T10:34:35.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f2961b1e640 10 monclient(hunting): picked mon.noname-c con 0x7f295c0a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:35.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f2961b1e640 10 monclient(hunting): picked mon.noname-g con 0x7f295c13f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:35.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f2961b1e640 10 monclient(hunting): picked mon.noname-a con 0x7f295c1d4310 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:35.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f2961b1e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c134440 con 0x7f295c1d4310 2024-09-13T10:34:35.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f2961b1e640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c134720 con 0x7f295c13f750 2024-09-13T10:34:35.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f2961b1e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c134a00 con 0x7f295c0a8340 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f2961b1e640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f2961b1e640 10 monclient(hunting): authenticate will time out at 1015.056344s 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f295b7fe640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f295c0a8340 0x7f295c13bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58580/0 (socket says 172.21.15.181:58580) 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f295bfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f295c1d4310 0x7f295c1d6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35860/0 (socket says 172.21.15.181:35860) 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.550+0000 7f295b7fe640 1 -- 172.21.15.181:0/880375755 learned_addr learned my addr 172.21.15.181:0/880375755 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f295bfff640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.181:6789/0 conn(0x7f295c1d4310 legacy=0x7f295c1d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f295b7fe640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.181:6791/0 conn(0x7f295c0a8340 legacy=0x7f295c13bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f295affd640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.195:6790/0 conn(0x7f295c13f750 legacy=0x7f295c13c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 17401767 0 0) 0x7f295c134440 con 0x7f295c1d4310 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): my global_id is 55512 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2948003550 con 0x7f295c1d4310 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1581300553 0 0) 0x7f295c134a00 con 0x7f295c0a8340 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): my global_id is 5791 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f295c134440 con 0x7f295c0a8340 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3154918534 0 0) 0x7f2948003550 con 0x7f295c1d4310 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f295c134a00 con 0x7f295c1d4310 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2954002000 con 0x7f295c1d4310 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): dump: 2024-09-13T10:34:35.568 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.569 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4216395812 0 0) 0x7f295c134440 con 0x7f295c0a8340 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2948003550 con 0x7f295c0a8340 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2579576485 0 0) 0x7f295c134720 con 0x7f295c13f750 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): my global_id is 5682 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f295c134440 con 0x7f295c13f750 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f294c003610 con 0x7f295c0a8340 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:35.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.552+0000 7f2943fff640 10 monclient(hunting): dump: 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.571 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3417021881 0 0) 0x7f295c134a00 con 0x7f295c1d4310 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.181:6791/0 conn(0x7f295c0a8340 legacy=0x7f295c13bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.195:6790/0 conn(0x7f295c13f750 legacy=0x7f295c13c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 10 monclient: _finish_hunting 0 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 1 monclient: found mon.a 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c135170 con 0x7f295c1d4310 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 10 monclient: _finish_auth 0 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 10 monclient: _check_auth_tickets 2024-09-13T10:34:35.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2961b1e640 5 monclient: authenticate success, global_id 55512 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2961b1e640 10 monclient: _renew_subs 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2961b1e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2961b1e640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f295c13e3f0 con 0x7f295c1d4310 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2961b1e640 10 monclient: _renew_subs 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2961b1e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2961b1e640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f295c13d780 con 0x7f295c1d4310 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2954003c40 con 0x7f295c1d4310 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2954004170 con 0x7f295c1d4310 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2959ffb640 4 set_mon_vals no callback set 2024-09-13T10:34:35.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2943fff640 10 monclient: dump: 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.574 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2961b1e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.553+0000 7f2961b1e640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f293c0065c0 con 0x7f293c002860 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.554+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f29540043c0 con 0x7f295c1d4310 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.554+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(146..146 src has 1..146) ==== 3898+0+0 (unknown 2774010261 0 0) 0x7f295404e4f0 con 0x7f295c1d4310 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.554+0000 7f295affd640 10 monclient: get_auth_request con 0x7f2948040380 auth_method 0 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f295b7fe640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.181:6790/0 conn(0x7f293c002860 legacy=0x7f293c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4211231043 0 0) 0x7f293c0065c0 con 0x7f293c002860 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 10 monclient(hunting): my global_id is 94133 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f295c134a00 con 0x7f293c002860 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2360772508 0 0) 0x7f295c134a00 con 0x7f293c002860 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f293c0065c0 con 0x7f293c002860 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f294c003e90 con 0x7f293c002860 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 10 monclient: dump: 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.576 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2166087577 0 0) 0x7f293c0065c0 con 0x7f293c002860 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f293c00a160 con 0x7f293c002860 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f294c004140 con 0x7f293c002860 2024-09-13T10:34:35.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:35.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:35.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.181:6790/0 conn(0x7f293c002860 legacy=0x7f293c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.556+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.181:6790/0 conn(0x7f293c002860 legacy=0x7f293c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:35.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.562+0000 7f2961b1e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:35.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.562+0000 7f2961b1e640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f293c009e70 con 0x7f293c009130 2024-09-13T10:34:35.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f295b7fe640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.181:6790/0 conn(0x7f293c009130 legacy=0x7f293c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297141149 0 0) 0x7f293c009e70 con 0x7f293c009130 2024-09-13T10:34:35.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 10 monclient(hunting): my global_id is 94142 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f293c0065c0 con 0x7f293c009130 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4075119232 0 0) 0x7f293c0065c0 con 0x7f293c009130 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f293c009e70 con 0x7f293c009130 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f294c005b00 con 0x7f293c009130 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 10 monclient: dump: 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.580 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 410644887 0 0) 0x7f293c009e70 con 0x7f293c009130 2024-09-13T10:34:35.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.565+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f293c00c410 con 0x7f293c009130 2024-09-13T10:34:35.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 4219595172) 0x7f294c006f70 con 0x7f293c009130 2024-09-13T10:34:35.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2943fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:35.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2943fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:35.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.181:6790/0 conn(0x7f293c009130 legacy=0x7f293c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2943fff640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.181:6790/0 conn(0x7f293c009130 legacy=0x7f293c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:35.582 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:35.582 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:35.582 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 15590, 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:35.583 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:35.584 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:35.585 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:35.585 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:35.585 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:35.585 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.585 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:35.585 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:35.585 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:35.585 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:35.585 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:35.585 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:35.585 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:35.585 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:35.586 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:35.587 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.588 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:35.589 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.590 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:35.593 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:35.594 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:35.595 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.596 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.596 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.596 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:35.596 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.596 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.596 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.596 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.597 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:35.598 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.599 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.600 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:35.600 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:35.600 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.600 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.600 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.600 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:35.600 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.600 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.600 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:35.601 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:35.602 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:35.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2961b1e640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.195:6800/1839191919 conn(0x7f2948040380 legacy=0x7f2948042840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2961b1e640 10 monclient: shutdown 2024-09-13T10:34:35.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2961b1e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:35.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2961b1e640 1 -- 172.21.15.181:0/880375755 >> v1:172.21.15.181:6789/0 conn(0x7f295c1d4310 legacy=0x7f295c1d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f295bfff640 1 -- 172.21.15.181:0/880375755 reap_dead start 2024-09-13T10:34:35.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f295bfff640 1 -- 172.21.15.181:0/880375755 reap_dead start 2024-09-13T10:34:35.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2961b1e640 1 -- 172.21.15.181:0/880375755 shutdown_connections 2024-09-13T10:34:35.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2961b1e640 1 -- 172.21.15.181:0/880375755 >> 172.21.15.181:0/880375755 conn(0x7f295c0a6640 msgr2=0x7f295c0a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:35.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2961b1e640 1 -- 172.21.15.181:0/880375755 shutdown_connections 2024-09-13T10:34:35.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.566+0000 7f2961b1e640 1 -- 172.21.15.181:0/880375755 wait complete. 2024-09-13T10:34:35.605 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:35.605 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:34:35.605 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:34:35.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.721+0000 7fef23631640 10 monclient: get_monmap_and_config 2024-09-13T10:34:35.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.721+0000 7fef23631640 10 monclient: build_initial_monmap 2024-09-13T10:34:35.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.721+0000 7fef23631640 10 monclient: monmap: 2024-09-13T10:34:35.724 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:35.724 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.724 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:35.723299+0000 2024-09-13T10:34:35.724 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:35.723299+0000 2024-09-13T10:34:35.724 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:35.725 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:35.725 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.722+0000 7fef23631640 1 Processor -- start 2024-09-13T10:34:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.722+0000 7fef23631640 1 -- start start 2024-09-13T10:34:35.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.722+0000 7fef23631640 10 monclient: init 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef23631640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef23631640 10 monclient: _add_conns ranks=[1,3,7,6,5,8,4,2,0] 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef23631640 10 monclient(hunting): picked mon.noname-f con 0x7fef1c0a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef23631640 10 monclient(hunting): picked mon.noname-g con 0x7fef1c0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef23631640 10 monclient(hunting): picked mon.noname-i con 0x7fef1c13f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef23631640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c0a4bc0 con 0x7fef1c0a6640 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef23631640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c13a320 con 0x7fef1c0a8340 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef23631640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c0a8100 con 0x7fef1c13f750 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef23631640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef23631640 10 monclient(hunting): authenticate will time out at 1015.229181s 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef213cd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fef1c0a6640 0x7fef1c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:37672/0 (socket says 172.21.15.181:37672) 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef20bcc640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7fef1c0a8340 0x7fef1c139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:34746/0 (socket says 172.21.15.181:34746) 2024-09-13T10:34:35.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.723+0000 7fef213cd640 1 -- 172.21.15.181:0/2568714051 learned_addr learned my addr 172.21.15.181:0/2568714051 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:35.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef20bcc640 1 -- 172.21.15.181:0/2568714051 >> v1:172.21.15.195:6790/0 conn(0x7fef1c0a8340 legacy=0x7fef1c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef213cd640 1 -- 172.21.15.181:0/2568714051 >> v1:172.21.15.195:6789/0 conn(0x7fef1c0a6640 legacy=0x7fef1c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef21bce640 1 -- 172.21.15.181:0/2568714051 >> v1:172.21.15.195:6792/0 conn(0x7fef1c13f750 legacy=0x7fef1c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048513218 0 0) 0x7fef1c0a8100 con 0x7fef1c13f750 2024-09-13T10:34:35.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient(hunting): my global_id is 55789 2024-09-13T10:34:35.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef08003520 con 0x7fef1c13f750 2024-09-13T10:34:35.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097456642 0 0) 0x7fef1c0a4bc0 con 0x7fef1c0a6640 2024-09-13T10:34:35.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient(hunting): my global_id is 55828 2024-09-13T10:34:35.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef1c0a8100 con 0x7fef1c0a6640 2024-09-13T10:34:35.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1583139500 0 0) 0x7fef1c13a320 con 0x7fef1c0a8340 2024-09-13T10:34:35.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient(hunting): my global_id is 5691 2024-09-13T10:34:35.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef1c0a4bc0 con 0x7fef1c0a8340 2024-09-13T10:34:35.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3543877576 0 0) 0x7fef08003520 con 0x7fef1c13f750 2024-09-13T10:34:35.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 >> v1:172.21.15.195:6790/0 conn(0x7fef1c0a8340 legacy=0x7fef1c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 >> v1:172.21.15.195:6789/0 conn(0x7fef1c0a6640 legacy=0x7fef1c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient: _finish_hunting 0 2024-09-13T10:34:35.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 1 monclient: found mon.noname-i 2024-09-13T10:34:35.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:35.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:34:35.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c0a48e0 con 0x7fef1c13f750 2024-09-13T10:34:35.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient: _finish_auth 0 2024-09-13T10:34:35.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient: _check_auth_tickets 2024-09-13T10:34:35.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:35.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fef14001eb0 con 0x7fef1c13f750 2024-09-13T10:34:35.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef23631640 5 monclient: authenticate success, global_id 55789 2024-09-13T10:34:35.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef23631640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:35.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.725+0000 7fef13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef13fff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:34:35.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef13fff640 10 monclient: dump: 2024-09-13T10:34:35.734 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.734 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.734 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.734 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef23631640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:35.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 186216463 0 0) 0x7fef1c0a8100 con 0x7fef1c0a6640 2024-09-13T10:34:35.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef13fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:34:35.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fef18001970 con 0x7fef1c0a6640 2024-09-13T10:34:35.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef13fff640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:34:35.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef14003990 con 0x7fef1c13f750 2024-09-13T10:34:35.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef13fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:35.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef23631640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:35.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef13fff640 1 -- 172.21.15.181:0/2568714051 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fef14003f40 con 0x7fef1c13f750 2024-09-13T10:34:35.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef23631640 4 set_mon_vals no callback set 2024-09-13T10:34:35.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef13fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:35.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef13fff640 10 monclient: dump: 2024-09-13T10:34:35.737 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.737 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.737 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.737 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.737 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.737 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.737 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.737 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.737 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.737 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.737 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef23631640 10 monclient: shutdown 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef23631640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef23631640 1 -- 172.21.15.181:0/2568714051 >> v1:172.21.15.195:6792/0 conn(0x7fef1c13f750 legacy=0x7fef1c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef23631640 1 -- 172.21.15.181:0/2568714051 shutdown_connections 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef23631640 1 -- 172.21.15.181:0/2568714051 >> 172.21.15.181:0/2568714051 conn(0x7fef1c077170 msgr2=0x7fef1c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef23631640 1 -- 172.21.15.181:0/2568714051 shutdown_connections 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.726+0000 7fef23631640 1 -- 172.21.15.181:0/2568714051 wait complete. 2024-09-13T10:34:35.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.727+0000 7fef23631640 10 monclient: build_initial_monmap 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.727+0000 7fef23631640 10 monclient: monmap: 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:35.739 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.727+0000 7fef23631640 1 Processor -- start 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.727+0000 7fef23631640 1 -- start start 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.727+0000 7fef23631640 10 monclient: init 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef23631640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef23631640 10 monclient: _add_conns ranks=[0,8,3,1,6,2,5,7,4] 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef23631640 10 monclient(hunting): picked mon.noname-a con 0x7fef1c0a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef23631640 10 monclient(hunting): picked mon.noname-e con 0x7fef1c13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef23631640 10 monclient(hunting): picked mon.noname-g con 0x7fef1c09f840 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef23631640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c0a1040 con 0x7fef1c0a8340 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef23631640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c142ed0 con 0x7fef1c09f840 2024-09-13T10:34:35.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef23631640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1c0a2a20 con 0x7fef1c13f750 2024-09-13T10:34:35.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef23631640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:35.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef23631640 10 monclient(hunting): authenticate will time out at 1015.234310s 2024-09-13T10:34:35.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef213cd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fef1c0a8340 0x7fef1c09d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35868/0 (socket says 172.21.15.181:35868) 2024-09-13T10:34:35.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef213cd640 1 -- 172.21.15.181:0/1702207956 learned_addr learned my addr 172.21.15.181:0/1702207956 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:35.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.728+0000 7fef20bcc640 1 --1- 172.21.15.181:0/1702207956 >> v1:172.21.15.181:6793/0 conn(0x7fef1c13f750 0x7fef1c09d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50408/0 (socket says 172.21.15.181:50408) 2024-09-13T10:34:35.741 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37778]: starting. 2024-09-13T10:34:35.742 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37778]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37777 2024-09-13T10:34:35.742 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37778]: created object 0... 2024-09-13T10:34:35.742 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37778]: created object 25... 2024-09-13T10:34:35.742 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37778]: created object 49... 2024-09-13T10:34:35.742 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37778]: finishing. 2024-09-13T10:34:35.742 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37778]: shutting down. 2024-09-13T10:34:35.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef213cd640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.181:6789/0 conn(0x7fef1c0a8340 legacy=0x7fef1c09d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef20bcc640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.181:6793/0 conn(0x7fef1c13f750 legacy=0x7fef1c09d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef21bce640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.195:6790/0 conn(0x7fef1c09f840 legacy=0x7fef1c1d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025171290 0 0) 0x7fef1c0a1040 con 0x7fef1c0a8340 2024-09-13T10:34:35.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef11ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef11ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef11ffb640 10 monclient(hunting): my global_id is 55521 2024-09-13T10:34:35.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef00003550 con 0x7fef1c0a8340 2024-09-13T10:34:35.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144804853 0 0) 0x7fef1c0a2a20 con 0x7fef1c13f750 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef11ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef11ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef11ffb640 10 monclient(hunting): my global_id is 84419 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.730+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef1c0a1040 con 0x7fef1c13f750 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2093446855 0 0) 0x7fef1c142ed0 con 0x7fef1c09f840 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): my global_id is 5700 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef1c0a2a20 con 0x7fef1c09f840 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 424192987 0 0) 0x7fef00003550 con 0x7fef1c0a8340 2024-09-13T10:34:35.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef1c142ed0 con 0x7fef1c0a8340 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fef18001d00 con 0x7fef1c0a8340 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): dump: 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.750 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2379733722 0 0) 0x7fef1c0a1040 con 0x7fef1c13f750 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef00003550 con 0x7fef1c13f750 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fef0c001d00 con 0x7fef1c13f750 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:35.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): dump: 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.752 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3756742814 0 0) 0x7fef1c0a2a20 con 0x7fef1c09f840 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef1c0a1040 con 0x7fef1c09f840 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fef14003e80 con 0x7fef1c09f840 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient(hunting): dump: 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.753 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 200374906 0 0) 0x7fef1c142ed0 con 0x7fef1c0a8340 2024-09-13T10:34:35.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.181:6793/0 conn(0x7fef1c13f750 legacy=0x7fef1c09d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.195:6790/0 conn(0x7fef1c09f840 legacy=0x7fef1c1d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:34:35.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 monclient: found mon.a 2024-09-13T10:34:35.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:35.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:35.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c0a01d0 con 0x7fef1c0a8340 2024-09-13T10:34:35.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient: _finish_auth 0 2024-09-13T10:34:35.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:34:35.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:35.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef23631640 5 monclient: authenticate success, global_id 55521 2024-09-13T10:34:35.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef23631640 10 monclient: _renew_subs 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef23631640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef23631640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fef1c09ece0 con 0x7fef1c0a8340 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef18004b10 con 0x7fef1c0a8340 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fef18005000 con 0x7fef1c0a8340 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef11ffb640 10 monclient: dump: 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.756 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef137fe640 4 set_mon_vals no callback set 2024-09-13T10:34:35.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef23631640 10 monclient: _renew_subs 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef23631640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.731+0000 7fef23631640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fef1c0a0d60 con 0x7fef1c0a8340 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.732+0000 7fef23631640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.732+0000 7fef23631640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fef1c143200 con 0x7fef1c077170 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.732+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fef18011680 con 0x7fef1c0a8340 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.732+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(147..147 src has 1..147) ==== 3898+0+0 (unknown 1280883627 0 0) 0x7fef1804e1e0 con 0x7fef1c0a8340 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.732+0000 7fef21bce640 10 monclient: get_auth_request con 0x7fef000405d0 auth_method 0 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.734+0000 7fef20bcc640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.181:6791/0 conn(0x7fef1c077170 legacy=0x7fef1c13a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.734+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034185138 0 0) 0x7fef1c143200 con 0x7fef1c077170 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.734+0000 7fef11ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.734+0000 7fef11ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.734+0000 7fef11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.734+0000 7fef11ffb640 10 monclient(hunting): my global_id is 5800 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.734+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef1c142ed0 con 0x7fef1c077170 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2480759403 0 0) 0x7fef1c142ed0 con 0x7fef1c077170 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef1c143200 con 0x7fef1c077170 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fef0c004e10 con 0x7fef1c077170 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 10 monclient: dump: 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.759 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.760 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.760 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.760 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.760 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.760 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.760 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.760 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.760 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.760 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2440937393 0 0) 0x7fef1c143200 con 0x7fef1c077170 2024-09-13T10:34:35.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef1c0a9e40 con 0x7fef1c077170 2024-09-13T10:34:35.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fef0c007170 con 0x7fef1c077170 2024-09-13T10:34:35.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:35.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:35.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.181:6791/0 conn(0x7fef1c077170 legacy=0x7fef1c13a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.735+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.181:6791/0 conn(0x7fef1c077170 legacy=0x7fef1c13a160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:35.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.741+0000 7fef23631640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:35.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.741+0000 7fef23631640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fef1c13af80 con 0x7fef1c069b40 2024-09-13T10:34:35.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.743+0000 7fef20bcc640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.181:6791/0 conn(0x7fef1c069b40 legacy=0x7fef1c13a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286455362 0 0) 0x7fef1c13af80 con 0x7fef1c069b40 2024-09-13T10:34:35.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 10 monclient(hunting): my global_id is 5809 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef1c143200 con 0x7fef1c069b40 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3464027817 0 0) 0x7fef1c143200 con 0x7fef1c069b40 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef1c13af80 con 0x7fef1c069b40 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fef0c00a480 con 0x7fef1c069b40 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 10 monclient: dump: 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.762 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 961181881 0 0) 0x7fef1c13af80 con 0x7fef1c069b40 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fef1c09fc20 con 0x7fef1c069b40 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 1573831833) 0x7fef0c006bc0 con 0x7fef1c069b40 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:35.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:35.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.181:6791/0 conn(0x7fef1c069b40 legacy=0x7fef1c13a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.744+0000 7fef11ffb640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.181:6791/0 conn(0x7fef1c069b40 legacy=0x7fef1c13a870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:35.764 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 290194, 2024-09-13T10:34:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.772 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:35.772 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:35.772 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.772 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.772 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.772 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:35.772 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.772 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.772 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.772 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:35.773 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:35.773 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.773 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.773 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.773 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:35.773 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:35.773 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.773 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.773 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.774 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:35.775 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.776 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.776 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.776 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:35.776 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:35.776 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.776 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.776 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.776 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:35.776 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:35.777 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:35.778 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.778 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.778 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.778 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:35.778 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.778 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.778 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.778 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:35.778 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:35.778 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.779 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.780 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:35.782 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.783 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:35.784 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.785 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.785 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:35.785 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:35.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.745+0000 7fef23631640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.195:6800/1839191919 conn(0x7fef000405d0 legacy=0x7fef00042a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.745+0000 7fef23631640 10 monclient: shutdown 2024-09-13T10:34:35.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.745+0000 7fef23631640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:35.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.745+0000 7fef23631640 1 -- 172.21.15.181:0/1702207956 >> v1:172.21.15.181:6789/0 conn(0x7fef1c0a8340 legacy=0x7fef1c09d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.745+0000 7fef21bce640 1 -- 172.21.15.181:0/1702207956 reap_dead start 2024-09-13T10:34:35.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.745+0000 7fef21bce640 1 -- 172.21.15.181:0/1702207956 reap_dead start 2024-09-13T10:34:35.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.745+0000 7fef23631640 1 -- 172.21.15.181:0/1702207956 shutdown_connections 2024-09-13T10:34:35.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.745+0000 7fef23631640 1 -- 172.21.15.181:0/1702207956 >> 172.21.15.181:0/1702207956 conn(0x7fef1c0a6640 msgr2=0x7fef1c13ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:35.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.745+0000 7fef23631640 1 -- 172.21.15.181:0/1702207956 shutdown_connections 2024-09-13T10:34:35.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.745+0000 7fef23631640 1 -- 172.21.15.181:0/1702207956 wait complete. 2024-09-13T10:34:35.787 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:35.787 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:34:35.788 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:34:35.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.883+0000 7f0c6a732640 10 monclient: get_monmap_and_config 2024-09-13T10:34:35.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.883+0000 7f0c6a732640 10 monclient: build_initial_monmap 2024-09-13T10:34:35.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.883+0000 7f0c6a732640 10 monclient: monmap: 2024-09-13T10:34:35.886 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:35.886 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.886 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:35.885159+0000 2024-09-13T10:34:35.886 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:35.885159+0000 2024-09-13T10:34:35.886 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:35.887 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.887 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:35.887 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:35.887 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:35.887 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:35.887 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:35.887 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:35.887 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:35.887 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:35.887 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:35.887 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 1 Processor -- start 2024-09-13T10:34:35.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 1 -- start start 2024-09-13T10:34:35.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 10 monclient: init 2024-09-13T10:34:35.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:35.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 10 monclient: _add_conns ranks=[0,7,4,1,2,3,6,8,5] 2024-09-13T10:34:35.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 10 monclient(hunting): picked mon.noname-a con 0x7f0c640a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:35.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 10 monclient(hunting): picked mon.noname-i con 0x7f0c640a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:35.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 10 monclient(hunting): picked mon.noname-c con 0x7f0c6413f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:35.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c640a4bc0 con 0x7f0c640a6640 2024-09-13T10:34:35.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6413a320 con 0x7f0c6413f750 2024-09-13T10:34:35.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c640a8100 con 0x7f0c640a8340 2024-09-13T10:34:35.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:35.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c6a732640 10 monclient(hunting): authenticate will time out at 1015.390835s 2024-09-13T10:34:35.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c68ccf640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f0c6413f750 0x7f0c64141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58602/0 (socket says 172.21.15.181:58602) 2024-09-13T10:34:35.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.884+0000 7f0c68ccf640 1 -- 172.21.15.181:0/2277848106 learned_addr learned my addr 172.21.15.181:0/2277848106 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:35.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c68ccf640 1 -- 172.21.15.181:0/2277848106 >> v1:172.21.15.181:6791/0 conn(0x7f0c6413f750 legacy=0x7f0c64141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c63fff640 1 -- 172.21.15.181:0/2277848106 >> v1:172.21.15.181:6789/0 conn(0x7f0c640a6640 legacy=0x7f0c64139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2162064423 0 0) 0x7f0c6413a320 con 0x7f0c6413f750 2024-09-13T10:34:35.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient(hunting): my global_id is 5818 2024-09-13T10:34:35.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c4c003520 con 0x7f0c6413f750 2024-09-13T10:34:35.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 380350642 0 0) 0x7f0c640a4bc0 con 0x7f0c640a6640 2024-09-13T10:34:35.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient(hunting): my global_id is 55530 2024-09-13T10:34:35.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c637fe640 1 -- 172.21.15.181:0/2277848106 >> v1:172.21.15.195:6792/0 conn(0x7f0c640a8340 legacy=0x7f0c64139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c6413a320 con 0x7f0c640a6640 2024-09-13T10:34:35.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051196315 0 0) 0x7f0c640a8100 con 0x7f0c640a8340 2024-09-13T10:34:35.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient(hunting): my global_id is 55798 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c640a4bc0 con 0x7f0c640a8340 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2001526019 0 0) 0x7f0c4c003520 con 0x7f0c6413f750 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 >> v1:172.21.15.195:6792/0 conn(0x7f0c640a8340 legacy=0x7f0c64139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 >> v1:172.21.15.181:6789/0 conn(0x7f0c640a6640 legacy=0x7f0c64139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 monclient: found mon.noname-c 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c640a48e0 con 0x7f0c6413f750 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient: _finish_auth 0 2024-09-13T10:34:35.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:34:35.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:35.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c6a732640 5 monclient: authenticate success, global_id 5818 2024-09-13T10:34:35.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c6a732640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:35.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c5c001e60 con 0x7f0c6413f750 2024-09-13T10:34:35.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:34:35.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient: dump: 2024-09-13T10:34:35.898 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.898 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.898 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.898 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.898 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c6a732640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c5c0020b0 con 0x7f0c6413f750 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:35.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 1 -- 172.21.15.181:0/2277848106 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c5c004f60 con 0x7f0c6413f750 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c6a732640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c6a732640 4 set_mon_vals no callback set 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.887+0000 7f0c62ffd640 10 monclient: dump: 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.900 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.888+0000 7f0c6a732640 10 monclient: shutdown 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.888+0000 7f0c6a732640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.888+0000 7f0c6a732640 1 -- 172.21.15.181:0/2277848106 >> v1:172.21.15.181:6791/0 conn(0x7f0c6413f750 legacy=0x7f0c64141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.888+0000 7f0c6a732640 1 -- 172.21.15.181:0/2277848106 shutdown_connections 2024-09-13T10:34:35.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.888+0000 7f0c6a732640 1 -- 172.21.15.181:0/2277848106 >> 172.21.15.181:0/2277848106 conn(0x7f0c64077170 msgr2=0x7f0c640abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.888+0000 7f0c6a732640 1 -- 172.21.15.181:0/2277848106 shutdown_connections 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.888+0000 7f0c6a732640 1 -- 172.21.15.181:0/2277848106 wait complete. 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.888+0000 7f0c6a732640 10 monclient: build_initial_monmap 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.888+0000 7f0c6a732640 10 monclient: monmap: 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:35.902 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 1 Processor -- start 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 1 -- start start 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 10 monclient: init 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 10 monclient: _add_conns ranks=[8,4,5,2,3,6,1,0,7] 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 10 monclient(hunting): picked mon.noname-e con 0x7f0c640a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 10 monclient(hunting): picked mon.noname-c con 0x7f0c6413f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 10 monclient(hunting): picked mon.noname-h con 0x7f0c6413cf30 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:35.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6413dea0 con 0x7f0c6413f750 2024-09-13T10:34:35.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c64135050 con 0x7f0c6413cf30 2024-09-13T10:34:35.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6413d7c0 con 0x7f0c640a8340 2024-09-13T10:34:35.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:35.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c6a732640 10 monclient(hunting): authenticate will time out at 1015.395774s 2024-09-13T10:34:35.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c63fff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f0c640a8340 0x7f0c6412f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50422/0 (socket says 172.21.15.181:50422) 2024-09-13T10:34:35.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.889+0000 7f0c63fff640 1 -- 172.21.15.181:0/471202325 learned_addr learned my addr 172.21.15.181:0/471202325 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.891+0000 7f0c637fe640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.181:6791/0 conn(0x7f0c6413f750 legacy=0x7f0c641d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.891+0000 7f0c63fff640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.181:6793/0 conn(0x7f0c640a8340 legacy=0x7f0c6412f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.891+0000 7f0c68ccf640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.195:6791/0 conn(0x7f0c6413cf30 legacy=0x7f0c641d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 782680609 0 0) 0x7f0c6413dea0 con 0x7f0c6413f750 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): my global_id is 5827 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c50003520 con 0x7f0c6413f750 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1989719786 0 0) 0x7f0c6413d7c0 con 0x7f0c640a8340 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): my global_id is 84428 2024-09-13T10:34:35.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c6413dea0 con 0x7f0c640a8340 2024-09-13T10:34:35.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588131137 0 0) 0x7f0c64135050 con 0x7f0c6413cf30 2024-09-13T10:34:35.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): my global_id is 5729 2024-09-13T10:34:35.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c6413d7c0 con 0x7f0c6413cf30 2024-09-13T10:34:35.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3715860744 0 0) 0x7f0c6413dea0 con 0x7f0c640a8340 2024-09-13T10:34:35.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c64135050 con 0x7f0c640a8340 2024-09-13T10:34:35.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c54003610 con 0x7f0c640a8340 2024-09-13T10:34:35.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:34:35.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): dump: 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.913 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2560178087 0 0) 0x7f0c50003520 con 0x7f0c6413f750 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c6413dea0 con 0x7f0c6413f750 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c58001d10 con 0x7f0c6413f750 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): dump: 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.914 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.915 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.915 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.915 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.915 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.915 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.915 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.915 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.915 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.915 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.915 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.915 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.915 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2600152179 0 0) 0x7f0c6413d7c0 con 0x7f0c6413cf30 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c50003520 con 0x7f0c6413cf30 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c5c001e80 con 0x7f0c6413cf30 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient(hunting): dump: 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.916 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3093046568 0 0) 0x7f0c64135050 con 0x7f0c640a8340 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.195:6791/0 conn(0x7f0c6413cf30 legacy=0x7f0c641d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.181:6791/0 conn(0x7f0c6413f750 legacy=0x7f0c641d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 monclient: found mon.e 2024-09-13T10:34:35.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:35.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:35.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c64134d70 con 0x7f0c640a8340 2024-09-13T10:34:35.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient: _finish_auth 0 2024-09-13T10:34:35.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:34:35.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:35.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c6a732640 5 monclient: authenticate success, global_id 84428 2024-09-13T10:34:35.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c6a732640 10 monclient: _renew_subs 2024-09-13T10:34:35.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c6a732640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:35.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c6a732640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6413e4b0 con 0x7f0c640a8340 2024-09-13T10:34:35.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c6a732640 10 monclient: _renew_subs 2024-09-13T10:34:35.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c6a732640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:35.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c6a732640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f0c6412fff0 con 0x7f0c640a8340 2024-09-13T10:34:35.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c54003bd0 con 0x7f0c640a8340 2024-09-13T10:34:35.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:35.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c54004140 con 0x7f0c640a8340 2024-09-13T10:34:35.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c627fc640 4 set_mon_vals no callback set 2024-09-13T10:34:35.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:35.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.892+0000 7f0c60ff9640 10 monclient: dump: 2024-09-13T10:34:35.919 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.919 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.919 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.919 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.920 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.920 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.920 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.920 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.920 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.920 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.920 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.920 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.920 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.920 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.920 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.893+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0c540042e0 con 0x7f0c640a8340 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.893+0000 7f0c6a732640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.893+0000 7f0c6a732640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0c440065c0 con 0x7f0c44002860 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.893+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(147..147 src has 1..147) ==== 3898+0+0 (unknown 1280883627 0 0) 0x7f0c5404e510 con 0x7f0c640a8340 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.893+0000 7f0c68ccf640 10 monclient: get_auth_request con 0x7f0c50040460 auth_method 0 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.895+0000 7f0c637fe640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.181:6792/0 conn(0x7f0c44002860 legacy=0x7f0c44004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.895+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1672042146 0 0) 0x7f0c440065c0 con 0x7f0c44002860 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.895+0000 7f0c60ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.895+0000 7f0c60ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.895+0000 7f0c60ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.895+0000 7f0c60ff9640 10 monclient(hunting): my global_id is 5694 2024-09-13T10:34:35.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.895+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c64135050 con 0x7f0c44002860 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2676174331 0 0) 0x7f0c64135050 con 0x7f0c44002860 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c440065c0 con 0x7f0c44002860 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c58003fc0 con 0x7f0c44002860 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 10 monclient: dump: 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.922 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4217534587 0 0) 0x7f0c440065c0 con 0x7f0c44002860 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c4400a160 con 0x7f0c44002860 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0c580042f0 con 0x7f0c44002860 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:35.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.181:6792/0 conn(0x7f0c44002860 legacy=0x7f0c44004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.896+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.181:6792/0 conn(0x7f0c44002860 legacy=0x7f0c44004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.903+0000 7f0c6a732640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.903+0000 7f0c6a732640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0c44009e50 con 0x7f0c44009110 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.905+0000 7f0c637fe640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.181:6792/0 conn(0x7f0c44009110 legacy=0x7f0c440095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.905+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4167161815 0 0) 0x7f0c44009e50 con 0x7f0c44009110 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.905+0000 7f0c60ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.905+0000 7f0c60ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.905+0000 7f0c60ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.905+0000 7f0c60ff9640 10 monclient(hunting): my global_id is 5703 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.905+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c440065c0 con 0x7f0c44009110 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.905+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2531674177 0 0) 0x7f0c440065c0 con 0x7f0c44009110 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c44009e50 con 0x7f0c44009110 2024-09-13T10:34:35.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c58005cf0 con 0x7f0c44009110 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c60ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c60ff9640 10 monclient: dump: 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:35.925 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:35.926 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:35.926 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:35.926 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:35.926 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:35.926 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:35.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1362847614 0 0) 0x7f0c44009e50 con 0x7f0c44009110 2024-09-13T10:34:35.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0c4400c3a0 con 0x7f0c44009110 2024-09-13T10:34:35.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 3908239807) 0x7f0c580071c0 con 0x7f0c44009110 2024-09-13T10:34:35.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c60ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:35.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c60ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:35.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.181:6792/0 conn(0x7f0c44009110 legacy=0x7f0c440095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c60ff9640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.181:6792/0 conn(0x7f0c44009110 legacy=0x7f0c440095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:35.927 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:35.927 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:35.927 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:35.927 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:35.927 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:35.927 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 290350, 2024-09-13T10:34:35.927 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:35.927 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:35.927 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:35.927 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:35.927 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:35.927 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:34:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:35.928 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:35.929 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:35.930 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:35.931 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:35.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.934 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:35.935 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.936 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.937 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.937 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:35.937 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:35.937 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.937 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.937 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.937 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:35.937 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.937 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.939 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.939 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:35.939 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.939 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.939 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.939 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:35.939 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:35.939 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.939 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.939 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:35.940 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:35.941 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.944 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:35.944 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:35.944 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:35.944 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:35.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.944 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:35.944 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:35.944 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:35.944 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.944 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:35.945 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:35.946 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.946 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:35.946 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:35.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:35.946 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:35.946 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:35.946 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:35.946 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:35.946 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:35.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:35.946 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:35.946 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:35.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c6a732640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0c50040460 legacy=0x7f0c50042920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c6a732640 10 monclient: shutdown 2024-09-13T10:34:35.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c6a732640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:35.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c6a732640 1 -- 172.21.15.181:0/471202325 >> v1:172.21.15.181:6793/0 conn(0x7f0c640a8340 legacy=0x7f0c6412f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:35.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c68ccf640 1 -- 172.21.15.181:0/471202325 reap_dead start 2024-09-13T10:34:35.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c68ccf640 1 -- 172.21.15.181:0/471202325 reap_dead start 2024-09-13T10:34:35.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c6a732640 1 -- 172.21.15.181:0/471202325 shutdown_connections 2024-09-13T10:34:35.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c6a732640 1 -- 172.21.15.181:0/471202325 >> 172.21.15.181:0/471202325 conn(0x7f0c640a6640 msgr2=0x7f0c640a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:35.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c6a732640 1 -- 172.21.15.181:0/471202325 shutdown_connections 2024-09-13T10:34:35.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:35.906+0000 7f0c6a732640 1 -- 172.21.15.181:0/471202325 wait complete. 2024-09-13T10:34:35.949 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:35.949 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:34:35.949 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:34:36.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.046+0000 7f4a1195d640 10 monclient: get_monmap_and_config 2024-09-13T10:34:36.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.046+0000 7f4a1195d640 10 monclient: build_initial_monmap 2024-09-13T10:34:36.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.046+0000 7f4a1195d640 10 monclient: monmap: 2024-09-13T10:34:36.049 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:36.049 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.049 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:36.047842+0000 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:36.047842+0000 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:36.050 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.046+0000 7f4a1195d640 1 Processor -- start 2024-09-13T10:34:36.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a1195d640 1 -- start start 2024-09-13T10:34:36.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a1195d640 10 monclient: init 2024-09-13T10:34:36.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a1195d640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:36.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a1195d640 10 monclient: _add_conns ranks=[5,7,3,8,6,2,4,0,1] 2024-09-13T10:34:36.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a1195d640 10 monclient(hunting): picked mon.noname-h con 0x7f4a0c0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:36.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a1195d640 10 monclient(hunting): picked mon.noname-i con 0x7f4a0c0a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:36.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a1195d640 10 monclient(hunting): picked mon.noname-g con 0x7f4a0c13f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:36.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a1195d640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c0a5fe0 con 0x7f4a0c13f9a0 2024-09-13T10:34:36.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a1195d640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c0a8080 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a1195d640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c0a42c0 con 0x7f4a0c0a6ab0 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a1195d640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a1195d640 10 monclient(hunting): authenticate will time out at 1015.553499s 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a0a7fc640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f4a0c0a6ab0 0x7f4a0c0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:50090/0 (socket says 172.21.15.181:50090) 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a0b7fe640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f4a0c13f9a0 0x7f4a0c141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:34764/0 (socket says 172.21.15.181:34764) 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a0affd640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f4a0c0a66d0 0x7f4a0c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:38682/0 (socket says 172.21.15.181:38682) 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.047+0000 7f4a0a7fc640 1 -- 172.21.15.181:0/1851105939 learned_addr learned my addr 172.21.15.181:0/1851105939 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a0a7fc640 1 -- 172.21.15.181:0/1851105939 >> v1:172.21.15.195:6792/0 conn(0x7f4a0c0a6ab0 legacy=0x7f4a0c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a0affd640 1 -- 172.21.15.181:0/1851105939 >> v1:172.21.15.195:6791/0 conn(0x7f4a0c0a66d0 legacy=0x7f4a0c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a0b7fe640 1 -- 172.21.15.181:0/1851105939 >> v1:172.21.15.195:6790/0 conn(0x7f4a0c13f9a0 legacy=0x7f4a0c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144286535 0 0) 0x7f4a0c0a42c0 con 0x7f4a0c0a6ab0 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 10 monclient(hunting): my global_id is 55807 2024-09-13T10:34:36.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49f4003520 con 0x7f4a0c0a6ab0 2024-09-13T10:34:36.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154848347 0 0) 0x7f4a0c0a8080 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 10 monclient(hunting): my global_id is 5738 2024-09-13T10:34:36.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a0c0a42c0 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1650862891 0 0) 0x7f4a0c0a5fe0 con 0x7f4a0c13f9a0 2024-09-13T10:34:36.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 10 monclient(hunting): my global_id is 5709 2024-09-13T10:34:36.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.049+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a0c0a8080 con 0x7f4a0c13f9a0 2024-09-13T10:34:36.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1844458982 0 0) 0x7f49f4003520 con 0x7f4a0c0a6ab0 2024-09-13T10:34:36.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 >> v1:172.21.15.195:6791/0 conn(0x7f4a0c0a66d0 legacy=0x7f4a0c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 >> v1:172.21.15.195:6790/0 conn(0x7f4a0c13f9a0 legacy=0x7f4a0c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:34:36.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 1 monclient: found mon.noname-i 2024-09-13T10:34:36.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:36.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:34:36.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c1464e0 con 0x7f4a0c0a6ab0 2024-09-13T10:34:36.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 10 monclient: _finish_auth 0 2024-09-13T10:34:36.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:34:36.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:36.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a00001ad0 con 0x7f4a0c0a6ab0 2024-09-13T10:34:36.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:34:36.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 10 monclient: dump: 2024-09-13T10:34:36.060 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.060 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.060 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.060 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.060 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.060 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.060 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a1195d640 5 monclient: authenticate success, global_id 55807 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a1195d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a000048a0 con 0x7f4a0c0a6ab0 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:36.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a1195d640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:36.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a1195d640 4 set_mon_vals no callback set 2024-09-13T10:34:36.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 1 -- 172.21.15.181:0/1851105939 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a00004e10 con 0x7f4a0c0a6ab0 2024-09-13T10:34:36.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:36.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a09ffb640 10 monclient: dump: 2024-09-13T10:34:36.062 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.062 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.062 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.062 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.062 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.062 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a1195d640 10 monclient: shutdown 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a1195d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a1195d640 1 -- 172.21.15.181:0/1851105939 >> v1:172.21.15.195:6792/0 conn(0x7f4a0c0a6ab0 legacy=0x7f4a0c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a1195d640 1 -- 172.21.15.181:0/1851105939 shutdown_connections 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a1195d640 1 -- 172.21.15.181:0/1851105939 >> 172.21.15.181:0/1851105939 conn(0x7f4a0c0abcd0 msgr2=0x7f4a0c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a1195d640 1 -- 172.21.15.181:0/1851105939 shutdown_connections 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.050+0000 7f4a1195d640 1 -- 172.21.15.181:0/1851105939 wait complete. 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.051+0000 7f4a1195d640 10 monclient: build_initial_monmap 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.051+0000 7f4a1195d640 10 monclient: monmap: 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:36.064 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.051+0000 7f4a1195d640 1 Processor -- start 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.051+0000 7f4a1195d640 1 -- start start 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.051+0000 7f4a1195d640 10 monclient: init 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.052+0000 7f4a1195d640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.052+0000 7f4a1195d640 10 monclient: _add_conns ranks=[2,5,4,6,8,7,0,3,1] 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.052+0000 7f4a1195d640 10 monclient(hunting): picked mon.noname-b con 0x7f4a0c0a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:34:36.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.052+0000 7f4a1195d640 10 monclient(hunting): picked mon.noname-h con 0x7f4a0c0a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:36.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.052+0000 7f4a1195d640 10 monclient(hunting): picked mon.noname-c con 0x7f4a0c13f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:36.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.052+0000 7f4a1195d640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c13f410 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.052+0000 7f4a1195d640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c139070 con 0x7f4a0c13f9a0 2024-09-13T10:34:36.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.052+0000 7f4a1195d640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a0c13d0b0 con 0x7f4a0c0a6ab0 2024-09-13T10:34:36.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.052+0000 7f4a1195d640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:36.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.052+0000 7f4a1195d640 10 monclient(hunting): authenticate will time out at 1015.558386s 2024-09-13T10:34:36.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.052+0000 7f4a0affd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f4a0c0a66d0 0x7f4a0c1ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:36612/0 (socket says 172.21.15.181:36612) 2024-09-13T10:34:36.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.052+0000 7f4a0affd640 1 -- 172.21.15.181:0/4126610154 learned_addr learned my addr 172.21.15.181:0/4126610154 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:36.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.054+0000 7f4a0affd640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.181:6790/0 conn(0x7f4a0c0a66d0 legacy=0x7f4a0c1ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.054+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.054+0000 7f4a0b7fe640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.181:6791/0 conn(0x7f4a0c13f9a0 legacy=0x7f4a0c1d6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.054+0000 7f4a0a7fc640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.195:6791/0 conn(0x7f4a0c0a6ab0 legacy=0x7f4a0c1d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148378537 0 0) 0x7f4a0c13f410 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 10 monclient(hunting): my global_id is 94151 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49f8003520 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2114656165 0 0) 0x7f4a0c13d0b0 con 0x7f4a0c0a6ab0 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 10 monclient(hunting): my global_id is 5747 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a0c13f410 con 0x7f4a0c0a6ab0 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 599859571 0 0) 0x7f4a0c139070 con 0x7f4a0c13f9a0 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 10 monclient(hunting): my global_id is 5836 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a0c13d0b0 con 0x7f4a0c13f9a0 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.056+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1053473788 0 0) 0x7f49f8003520 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a0c139070 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3545402988 0 0) 0x7f4a0c13d0b0 con 0x7f4a0c13f9a0 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49f8003520 con 0x7f4a0c13f9a0 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f49fc0047e0 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:36.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:34:36.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient(hunting): dump: 2024-09-13T10:34:36.073 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.073 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.073 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.073 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.073 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.073 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.073 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.073 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.073 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.073 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.074 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.074 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.074 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.074 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.074 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.074 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:36.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a04001fa0 con 0x7f4a0c13f9a0 2024-09-13T10:34:36.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:36.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:36.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient(hunting): dump: 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.075 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2533136286 0 0) 0x7f4a0c139070 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.195:6791/0 conn(0x7f4a0c0a6ab0 legacy=0x7f4a0c1d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.181:6791/0 conn(0x7f4a0c13f9a0 legacy=0x7f4a0c1d6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient: _finish_hunting 0 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 1 monclient: found mon.b 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0c13f130 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient: _finish_auth 0 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient: _check_auth_tickets 2024-09-13T10:34:36.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f4a1195d640 5 monclient: authenticate success, global_id 94151 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f4a1195d640 10 monclient: _renew_subs 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f4a1195d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f4a1195d640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0c13dc10 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f4a1195d640 10 monclient: _renew_subs 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f4a1195d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f4a1195d640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4a0c13c7b0 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f49fc004c70 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f49fc005160 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f4a097fa640 4 set_mon_vals no callback set 2024-09-13T10:34:36.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.057+0000 7f49f3fff640 10 monclient: dump: 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.078 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.058+0000 7f4a1195d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.058+0000 7f4a1195d640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f49ec0065c0 con 0x7f49ec002860 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.058+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f49fc005300 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.058+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(147..147 src has 1..147) ==== 3898+0+0 (unknown 1280883627 0 0) 0x7f49fc04e3a0 con 0x7f4a0c0a66d0 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.058+0000 7f4a0b7fe640 10 monclient: get_auth_request con 0x7f49f8040340 auth_method 0 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f4a0a7fc640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.181:6793/0 conn(0x7f49ec002860 legacy=0x7f49ec004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715604417 0 0) 0x7f49ec0065c0 con 0x7f49ec002860 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 10 monclient(hunting): my global_id is 84437 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a0c139070 con 0x7f49ec002860 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1551547187 0 0) 0x7f4a0c139070 con 0x7f49ec002860 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49ec0065c0 con 0x7f49ec002860 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a000048a0 con 0x7f49ec002860 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 10 monclient: dump: 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.080 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1236908987 0 0) 0x7f49ec0065c0 con 0x7f49ec002860 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.060+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49ec00a160 con 0x7f49ec002860 2024-09-13T10:34:36.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.061+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4a00004930 con 0x7f49ec002860 2024-09-13T10:34:36.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.061+0000 7f49f3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.061+0000 7f49f3fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:36.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.061+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.181:6793/0 conn(0x7f49ec002860 legacy=0x7f49ec004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.061+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.181:6793/0 conn(0x7f49ec002860 legacy=0x7f49ec004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:36.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.067+0000 7f4a1195d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:36.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.067+0000 7f4a1195d640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f49ec009e70 con 0x7f49ec009130 2024-09-13T10:34:36.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.069+0000 7f4a0a7fc640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.181:6793/0 conn(0x7f49ec009130 legacy=0x7f49ec0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1135105495 0 0) 0x7f49ec009e70 con 0x7f49ec009130 2024-09-13T10:34:36.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 10 monclient(hunting): my global_id is 84446 2024-09-13T10:34:36.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49ec0065c0 con 0x7f49ec009130 2024-09-13T10:34:36.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4004147433 0 0) 0x7f49ec0065c0 con 0x7f49ec009130 2024-09-13T10:34:36.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49ec009e70 con 0x7f49ec009130 2024-09-13T10:34:36.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a00005410 con 0x7f49ec009130 2024-09-13T10:34:36.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:36.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 10 monclient: dump: 2024-09-13T10:34:36.084 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.084 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.084 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.084 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3354934718 0 0) 0x7f49ec009e70 con 0x7f49ec009130 2024-09-13T10:34:36.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.071+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f49ec00c410 con 0x7f49ec009130 2024-09-13T10:34:36.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 3644095832) 0x7f4a00007d90 con 0x7f49ec009130 2024-09-13T10:34:36.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f49f3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:36.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f49f3fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:36.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.181:6793/0 conn(0x7f49ec009130 legacy=0x7f49ec0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f49f3fff640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.181:6793/0 conn(0x7f49ec009130 legacy=0x7f49ec0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:36.086 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:36.086 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:36.086 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:36.086 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:36.086 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:36.087 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 84961, 2024-09-13T10:34:36.087 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:36.087 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:36.087 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:36.087 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:36.087 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:36.087 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:36.087 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:36.087 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:36.087 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:36.087 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:36.087 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.088 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:34:36.088 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:36.088 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:36.088 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:36.088 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.088 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.088 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.088 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.088 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.088 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.088 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.088 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.089 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:36.090 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.091 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:36.092 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.093 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.094 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.095 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:36.096 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:36.098 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.099 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.101 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.102 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.103 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.104 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:36.105 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:36.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f4a1195d640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.195:6800/1839191919 conn(0x7f49f8040340 legacy=0x7f49f8042800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f4a1195d640 10 monclient: shutdown 2024-09-13T10:34:36.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f4a1195d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:36.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f4a1195d640 1 -- 172.21.15.181:0/4126610154 >> v1:172.21.15.181:6790/0 conn(0x7f4a0c0a66d0 legacy=0x7f4a0c1ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f4a0b7fe640 1 -- 172.21.15.181:0/4126610154 reap_dead start 2024-09-13T10:34:36.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f4a0b7fe640 1 -- 172.21.15.181:0/4126610154 reap_dead start 2024-09-13T10:34:36.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f4a1195d640 1 -- 172.21.15.181:0/4126610154 shutdown_connections 2024-09-13T10:34:36.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f4a1195d640 1 -- 172.21.15.181:0/4126610154 >> 172.21.15.181:0/4126610154 conn(0x7f4a0c0abcd0 msgr2=0x7f4a0c145ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:36.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f4a1195d640 1 -- 172.21.15.181:0/4126610154 shutdown_connections 2024-09-13T10:34:36.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.072+0000 7f4a1195d640 1 -- 172.21.15.181:0/4126610154 wait complete. 2024-09-13T10:34:36.108 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:36.108 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:34:36.108 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:34:36.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.204+0000 7f0f6113d640 10 monclient: get_monmap_and_config 2024-09-13T10:34:36.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.204+0000 7f0f6113d640 10 monclient: build_initial_monmap 2024-09-13T10:34:36.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.204+0000 7f0f6113d640 10 monclient: monmap: 2024-09-13T10:34:36.206 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:36.207 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.207 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:36.205670+0000 2024-09-13T10:34:36.207 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:36.205670+0000 2024-09-13T10:34:36.207 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:36.207 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.207 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:36.207 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:36.207 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:36.207 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:36.207 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:36.207 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:36.207 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:36.208 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:36.208 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:36.208 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.204+0000 7f0f6113d640 1 Processor -- start 2024-09-13T10:34:36.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.204+0000 7f0f6113d640 1 -- start start 2024-09-13T10:34:36.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.204+0000 7f0f6113d640 10 monclient: init 2024-09-13T10:34:36.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f6113d640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:36.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f6113d640 10 monclient: _add_conns ranks=[0,3,4,7,6,1,8,2,5] 2024-09-13T10:34:36.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f6113d640 10 monclient(hunting): picked mon.noname-a con 0x7f0f5c0a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:36.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f6113d640 10 monclient(hunting): picked mon.noname-g con 0x7f0f5c0a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:36.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f6113d640 10 monclient(hunting): picked mon.noname-c con 0x7f0f5c13f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:36.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f6113d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c0a5fe0 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f6113d640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c0a8080 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f6113d640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c0a42c0 con 0x7f0f5c13f9a0 2024-09-13T10:34:36.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f6113d640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:36.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f6113d640 10 monclient(hunting): authenticate will time out at 1015.711285s 2024-09-13T10:34:36.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f5ad9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0f5c0a66d0 0x7f0f5c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35882/0 (socket says 172.21.15.181:35882) 2024-09-13T10:34:36.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f5ad9d640 1 -- 172.21.15.181:0/2490411600 learned_addr learned my addr 172.21.15.181:0/2490411600 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:36.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f5a59c640 1 -- 172.21.15.181:0/2490411600 >> v1:172.21.15.195:6790/0 conn(0x7f0f5c0a6ab0 legacy=0x7f0f5c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T10:34:36.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f5a59c640 1 -- 172.21.15.181:0/2490411600 >> v1:172.21.15.195:6790/0 conn(0x7f0f5c0a6ab0 legacy=0x7f0f5c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T10:34:36.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.205+0000 7f0f5a59c640 1 --1- 172.21.15.181:0/2490411600 >> v1:172.21.15.195:6790/0 conn(0x7f0f5c0a6ab0 0x7f0f5c0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify read banner and identify addresses failed 2024-09-13T10:34:36.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f5b59e640 1 -- 172.21.15.181:0/2490411600 >> v1:172.21.15.181:6791/0 conn(0x7f0f5c13f9a0 legacy=0x7f0f5c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f5ad9d640 1 -- 172.21.15.181:0/2490411600 >> v1:172.21.15.181:6789/0 conn(0x7f0f5c0a66d0 legacy=0x7f0f5c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f59d9b640 1 -- 172.21.15.181:0/2490411600 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 25651899 0 0) 0x7f0f5c0a42c0 con 0x7f0f5c13f9a0 2024-09-13T10:34:36.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f59d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f59d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f59d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f59d9b640 10 monclient(hunting): my global_id is 5845 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f59d9b640 1 -- 172.21.15.181:0/2490411600 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f44003520 con 0x7f0f5c13f9a0 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f59d9b640 1 -- 172.21.15.181:0/2490411600 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51833826 0 0) 0x7f0f5c0a5fe0 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f59d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f59d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f59d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f59d9b640 10 monclient(hunting): my global_id is 55539 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.207+0000 7f0f59d9b640 1 -- 172.21.15.181:0/2490411600 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f5c0a42c0 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 1 -- 172.21.15.181:0/2490411600 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 330736273 0 0) 0x7f0f5c0a42c0 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 1 -- 172.21.15.181:0/2490411600 >> v1:172.21.15.181:6791/0 conn(0x7f0f5c13f9a0 legacy=0x7f0f5c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 1 -- 172.21.15.181:0/2490411600 >> v1:172.21.15.195:6790/0 conn(0x7f0f5c0a6ab0 legacy=0x7f0f5c0a6ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 1 monclient: found mon.noname-a 2024-09-13T10:34:36.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:36.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:34:36.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 1 -- 172.21.15.181:0/2490411600 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c1464e0 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 10 monclient: _finish_auth 0 2024-09-13T10:34:36.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:34:36.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:36.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 1 -- 172.21.15.181:0/2490411600 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0f4c001a90 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f6113d640 5 monclient: authenticate success, global_id 55539 2024-09-13T10:34:36.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f6113d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:36.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:34:36.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 10 monclient: dump: 2024-09-13T10:34:36.216 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.217 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.217 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.217 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.217 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.217 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.217 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.217 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.217 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.217 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.217 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.217 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f6113d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 1 -- 172.21.15.181:0/2490411600 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f4c0048a0 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f6113d640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 1 -- 172.21.15.181:0/2490411600 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0f4c004d90 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f6113d640 4 set_mon_vals no callback set 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f59d9b640 10 monclient: dump: 2024-09-13T10:34:36.218 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.219 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.220 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f6113d640 10 monclient: shutdown 2024-09-13T10:34:36.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f6113d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:36.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f6113d640 1 -- 172.21.15.181:0/2490411600 >> v1:172.21.15.181:6789/0 conn(0x7f0f5c0a66d0 legacy=0x7f0f5c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f6113d640 1 -- 172.21.15.181:0/2490411600 shutdown_connections 2024-09-13T10:34:36.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f6113d640 1 -- 172.21.15.181:0/2490411600 >> 172.21.15.181:0/2490411600 conn(0x7f0f5c0abcd0 msgr2=0x7f0f5c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:36.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f6113d640 1 -- 172.21.15.181:0/2490411600 shutdown_connections 2024-09-13T10:34:36.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.208+0000 7f0f6113d640 1 -- 172.21.15.181:0/2490411600 wait complete. 2024-09-13T10:34:36.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.209+0000 7f0f6113d640 10 monclient: build_initial_monmap 2024-09-13T10:34:36.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.209+0000 7f0f6113d640 10 monclient: monmap: 2024-09-13T10:34:36.220 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:36.221 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:36.221 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:36.221 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:36.221 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:36.221 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:36.221 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:36.221 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:36.221 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:36.221 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:36.221 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.209+0000 7f0f6113d640 1 Processor -- start 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f6113d640 1 -- start start 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f6113d640 10 monclient: init 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f6113d640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f6113d640 10 monclient: _add_conns ranks=[8,0,1,2,5,3,6,4,7] 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f6113d640 10 monclient(hunting): picked mon.noname-e con 0x7f0f5c0a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f6113d640 10 monclient(hunting): picked mon.noname-a con 0x7f0f5c0a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f6113d640 10 monclient(hunting): picked mon.noname-f con 0x7f0f5c13f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:36.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f6113d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c13db20 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f6113d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c139230 con 0x7f0f5c13f9a0 2024-09-13T10:34:36.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f6113d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c068d40 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f6113d640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:36.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f6113d640 10 monclient(hunting): authenticate will time out at 1015.716543s 2024-09-13T10:34:36.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f5ad9d640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f0f5c0a66d0 0x7f0f5c0a1c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50458/0 (socket says 172.21.15.181:50458) 2024-09-13T10:34:36.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.210+0000 7f0f5ad9d640 1 -- 172.21.15.181:0/224604614 learned_addr learned my addr 172.21.15.181:0/224604614 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:36.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f5a59c640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.181:6789/0 conn(0x7f0f5c0a6ab0 legacy=0x7f0f5c1d3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f5ad9d640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.181:6793/0 conn(0x7f0f5c0a66d0 legacy=0x7f0f5c0a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096061282 0 0) 0x7f0f5c13db20 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 10 monclient(hunting): my global_id is 55548 2024-09-13T10:34:36.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f48003520 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970282281 0 0) 0x7f0f5c068d40 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 10 monclient(hunting): my global_id is 84455 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f5c13db20 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.212+0000 7f0f5b59e640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.195:6789/0 conn(0x7f0f5c13f9a0 legacy=0x7f0f5c1d6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.214+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2721227723 0 0) 0x7f0f48003520 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f5c068d40 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440738921 0 0) 0x7f0f5c139230 con 0x7f0f5c13f9a0 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient(hunting): my global_id is 55837 2024-09-13T10:34:36.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f48003520 con 0x7f0f5c13f9a0 2024-09-13T10:34:36.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2251484564 0 0) 0x7f0f5c13db20 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f5c139230 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0f50001cf0 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:36.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:34:36.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient(hunting): dump: 2024-09-13T10:34:36.229 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.229 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.229 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.230 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.230 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.230 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.230 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.230 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.230 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.230 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.230 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.230 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.230 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.230 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.230 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0f4c004d90 con 0x7f0f5c0a66d0 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient(hunting): dump: 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.231 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 512347218 0 0) 0x7f0f5c068d40 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.181:6793/0 conn(0x7f0f5c0a66d0 legacy=0x7f0f5c0a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.195:6789/0 conn(0x7f0f5c13f9a0 legacy=0x7f0f5c1d6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient: _finish_hunting 0 2024-09-13T10:34:36.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 monclient: found mon.a 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c137820 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient: _finish_auth 0 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient: _check_auth_tickets 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f6113d640 5 monclient: authenticate success, global_id 55548 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f6113d640 10 monclient: _renew_subs 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f6113d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f6113d640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c13efe0 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f6113d640 10 monclient: _renew_subs 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f6113d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f6113d640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0f5c13dda0 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f50004bf0 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0f500050e0 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f5959a640 4 set_mon_vals no callback set 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.215+0000 7f0f437fe640 10 monclient: dump: 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.234 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.216+0000 7f0f6113d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.216+0000 7f0f6113d640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0f3c0065c0 con 0x7f0f3c002860 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.216+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0f50005280 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.216+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(147..147 src has 1..147) ==== 3898+0+0 (unknown 1280883627 0 0) 0x7f0f5004e330 con 0x7f0f5c0a6ab0 2024-09-13T10:34:36.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.216+0000 7f0f5b59e640 10 monclient: get_auth_request con 0x7f0f48040180 auth_method 0 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f5ad9d640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.195:6789/0 conn(0x7f0f3c002860 legacy=0x7f0f3c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3347129885 0 0) 0x7f0f3c0065c0 con 0x7f0f3c002860 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 10 monclient(hunting): my global_id is 55846 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f5c068d40 con 0x7f0f3c002860 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 254290151 0 0) 0x7f0f5c068d40 con 0x7f0f3c002860 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f3c0065c0 con 0x7f0f3c002860 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0f4c004820 con 0x7f0f3c002860 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 10 monclient: dump: 2024-09-13T10:34:36.236 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.237 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.238 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3806501262 0 0) 0x7f0f3c0065c0 con 0x7f0f3c002860 2024-09-13T10:34:36.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.218+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f3c00a160 con 0x7f0f3c002860 2024-09-13T10:34:36.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.219+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0f4c0056c0 con 0x7f0f3c002860 2024-09-13T10:34:36.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.219+0000 7f0f437fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.219+0000 7f0f437fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:36.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.219+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.195:6789/0 conn(0x7f0f3c002860 legacy=0x7f0f3c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.219+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.195:6789/0 conn(0x7f0f3c002860 legacy=0x7f0f3c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:36.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.225+0000 7f0f6113d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:36.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.225+0000 7f0f6113d640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0f3c009e70 con 0x7f0f3c009130 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.227+0000 7f0f5ad9d640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.195:6789/0 conn(0x7f0f3c009130 legacy=0x7f0f3c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.227+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3476956536 0 0) 0x7f0f3c009e70 con 0x7f0f3c009130 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.227+0000 7f0f437fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.227+0000 7f0f437fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.227+0000 7f0f437fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.227+0000 7f0f437fe640 10 monclient(hunting): my global_id is 55855 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.227+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f3c0065c0 con 0x7f0f3c009130 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3880603330 0 0) 0x7f0f3c0065c0 con 0x7f0f3c009130 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f3c009e70 con 0x7f0f3c009130 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0f4c005ef0 con 0x7f0f3c009130 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:34:36.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 10 monclient: dump: 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.241 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.242 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.242 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2796142451 0 0) 0x7f0f3c009e70 con 0x7f0f3c009130 2024-09-13T10:34:36.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0f3c00c410 con 0x7f0f3c009130 2024-09-13T10:34:36.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7893 (unknown 0 0 373622958) 0x7f0f4c007310 con 0x7f0f3c009130 2024-09-13T10:34:36.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:36.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:36.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.195:6789/0 conn(0x7f0f3c009130 legacy=0x7f0f3c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f437fe640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.195:6789/0 conn(0x7f0f3c009130 legacy=0x7f0f3c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:36.242 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:36.242 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 290638, 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:36.243 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.244 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.245 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:36.246 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.247 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:36.248 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.249 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:36.252 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.253 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.254 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.255 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:36.256 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.256 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.256 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:36.256 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:36.256 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.256 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.256 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.256 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:36.257 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.258 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.259 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.260 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.261 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:36.263 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:36.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f6113d640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0f48040180 legacy=0x7f0f48042640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f6113d640 10 monclient: shutdown 2024-09-13T10:34:36.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f6113d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:36.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f6113d640 1 -- 172.21.15.181:0/224604614 >> v1:172.21.15.181:6789/0 conn(0x7f0f5c0a6ab0 legacy=0x7f0f5c1d3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f5b59e640 1 -- 172.21.15.181:0/224604614 reap_dead start 2024-09-13T10:34:36.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f5b59e640 1 -- 172.21.15.181:0/224604614 reap_dead start 2024-09-13T10:34:36.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f6113d640 1 -- 172.21.15.181:0/224604614 shutdown_connections 2024-09-13T10:34:36.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.228+0000 7f0f6113d640 1 -- 172.21.15.181:0/224604614 >> 172.21.15.181:0/224604614 conn(0x7f0f5c0abcd0 msgr2=0x7f0f5c145ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:36.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.229+0000 7f0f6113d640 1 -- 172.21.15.181:0/224604614 shutdown_connections 2024-09-13T10:34:36.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.229+0000 7f0f6113d640 1 -- 172.21.15.181:0/224604614 wait complete. 2024-09-13T10:34:36.265 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:36.265 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:34:36.265 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:34:36.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.361+0000 7f7fbde48640 10 monclient: get_monmap_and_config 2024-09-13T10:34:36.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.361+0000 7f7fbde48640 10 monclient: build_initial_monmap 2024-09-13T10:34:36.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.361+0000 7f7fbde48640 10 monclient: monmap: 2024-09-13T10:34:36.364 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:36.364 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.364 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:36.362804+0000 2024-09-13T10:34:36.364 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:36.362804+0000 2024-09-13T10:34:36.364 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:36.364 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.364 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:36.364 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:36.364 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:36.364 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:36.364 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:36.365 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:36.365 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:36.365 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:36.365 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:36.365 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.361+0000 7f7fbde48640 1 Processor -- start 2024-09-13T10:34:36.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.361+0000 7f7fbde48640 1 -- start start 2024-09-13T10:34:36.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.361+0000 7f7fbde48640 10 monclient: init 2024-09-13T10:34:36.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.362+0000 7f7fbde48640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:36.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.362+0000 7f7fbde48640 10 monclient: _add_conns ranks=[3,1,8,5,4,7,2,6,0] 2024-09-13T10:34:36.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.362+0000 7f7fbde48640 10 monclient(hunting): picked mon.noname-g con 0x7f7fb80a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:36.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.362+0000 7f7fbde48640 10 monclient(hunting): picked mon.noname-f con 0x7f7fb80a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:36.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.362+0000 7f7fbde48640 10 monclient(hunting): picked mon.noname-e con 0x7f7fb813f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:36.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.362+0000 7f7fbde48640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb80a5fe0 con 0x7f7fb80a6ab0 2024-09-13T10:34:36.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.362+0000 7f7fbde48640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb80a8080 con 0x7f7fb80a66d0 2024-09-13T10:34:36.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.362+0000 7f7fbde48640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb80a42c0 con 0x7f7fb813f9a0 2024-09-13T10:34:36.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.362+0000 7f7fbde48640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:36.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.362+0000 7f7fbde48640 10 monclient(hunting): authenticate will time out at 1015.868492s 2024-09-13T10:34:36.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.362+0000 7f7fb7fff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f7fb813f9a0 0x7f7fb8141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50468/0 (socket says 172.21.15.181:50468) 2024-09-13T10:34:36.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.362+0000 7f7fb7fff640 1 -- 172.21.15.181:0/3801587232 learned_addr learned my addr 172.21.15.181:0/3801587232 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:36.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.364+0000 7f7fb7fff640 1 -- 172.21.15.181:0/3801587232 >> v1:172.21.15.181:6793/0 conn(0x7f7fb813f9a0 legacy=0x7f7fb8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.364+0000 7f7fb77fe640 1 -- 172.21.15.181:0/3801587232 >> v1:172.21.15.195:6790/0 conn(0x7f7fb80a66d0 legacy=0x7f7fb80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.364+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2495288175 0 0) 0x7f7fb80a42c0 con 0x7f7fb813f9a0 2024-09-13T10:34:36.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.364+0000 7f7fb67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.364+0000 7f7fb67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.364+0000 7f7fb67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.364+0000 7f7fb67fc640 10 monclient(hunting): my global_id is 84464 2024-09-13T10:34:36.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.364+0000 7f7fb6ffd640 1 -- 172.21.15.181:0/3801587232 >> v1:172.21.15.195:6789/0 conn(0x7f7fb80a6ab0 legacy=0x7f7fb80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.364+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fa4003520 con 0x7f7fb813f9a0 2024-09-13T10:34:36.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2086378583 0 0) 0x7f7fb80a8080 con 0x7f7fb80a66d0 2024-09-13T10:34:36.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient(hunting): my global_id is 5718 2024-09-13T10:34:36.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb80a42c0 con 0x7f7fb80a66d0 2024-09-13T10:34:36.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3248751059 0 0) 0x7f7fb80a5fe0 con 0x7f7fb80a6ab0 2024-09-13T10:34:36.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient(hunting): my global_id is 55864 2024-09-13T10:34:36.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb80a8080 con 0x7f7fb80a6ab0 2024-09-13T10:34:36.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3368043009 0 0) 0x7f7fa4003520 con 0x7f7fb813f9a0 2024-09-13T10:34:36.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 >> v1:172.21.15.195:6790/0 conn(0x7f7fb80a66d0 legacy=0x7f7fb80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 >> v1:172.21.15.195:6789/0 conn(0x7f7fb80a6ab0 legacy=0x7f7fb80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:34:36.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 1 monclient: found mon.noname-e 2024-09-13T10:34:36.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:36.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:34:36.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb81464e0 con 0x7f7fb813f9a0 2024-09-13T10:34:36.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient: _finish_auth 0 2024-09-13T10:34:36.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:34:36.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:36.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7fb0001e50 con 0x7f7fb813f9a0 2024-09-13T10:34:36.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fbde48640 5 monclient: authenticate success, global_id 84464 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fbde48640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient: dump: 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.374 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.375 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.375 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.375 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.375 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.375 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.375 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fbde48640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:36.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7fb0004c20 con 0x7f7fb813f9a0 2024-09-13T10:34:36.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:36.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 1 -- 172.21.15.181:0/3801587232 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7fb0005190 con 0x7f7fb813f9a0 2024-09-13T10:34:36.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fbde48640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:36.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fbde48640 4 set_mon_vals no callback set 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fb67fc640 10 monclient: dump: 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.376 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fbde48640 10 monclient: shutdown 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fbde48640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fbde48640 1 -- 172.21.15.181:0/3801587232 >> v1:172.21.15.181:6793/0 conn(0x7f7fb813f9a0 legacy=0x7f7fb8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fbde48640 1 -- 172.21.15.181:0/3801587232 shutdown_connections 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fbde48640 1 -- 172.21.15.181:0/3801587232 >> 172.21.15.181:0/3801587232 conn(0x7f7fb80abcd0 msgr2=0x7f7fb80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fbde48640 1 -- 172.21.15.181:0/3801587232 shutdown_connections 2024-09-13T10:34:36.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.365+0000 7f7fbde48640 1 -- 172.21.15.181:0/3801587232 wait complete. 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.366+0000 7f7fbde48640 10 monclient: build_initial_monmap 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.366+0000 7f7fbde48640 10 monclient: monmap: 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:36.378 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:36.379 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.366+0000 7f7fbde48640 1 Processor -- start 2024-09-13T10:34:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.366+0000 7f7fbde48640 1 -- start start 2024-09-13T10:34:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.366+0000 7f7fbde48640 10 monclient: init 2024-09-13T10:34:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fbde48640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fbde48640 10 monclient: _add_conns ranks=[2,8,3,4,0,6,7,1,5] 2024-09-13T10:34:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fbde48640 10 monclient(hunting): picked mon.noname-b con 0x7f7fb80a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:34:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fbde48640 10 monclient(hunting): picked mon.noname-e con 0x7f7fb80a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:36.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fbde48640 10 monclient(hunting): picked mon.noname-g con 0x7f7fb813f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fbde48640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb8143170 con 0x7f7fb80a66d0 2024-09-13T10:34:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fbde48640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb8142db0 con 0x7f7fb813f9a0 2024-09-13T10:34:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fbde48640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb813d140 con 0x7f7fb80a6ab0 2024-09-13T10:34:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fbde48640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fbde48640 10 monclient(hunting): authenticate will time out at 1015.873407s 2024-09-13T10:34:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fb6ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f7fb80a6ab0 0x7f7fb81d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50472/0 (socket says 172.21.15.181:50472) 2024-09-13T10:34:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fb77fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f7fb80a66d0 0x7f7fb81ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:36624/0 (socket says 172.21.15.181:36624) 2024-09-13T10:34:36.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.367+0000 7f7fb6ffd640 1 -- 172.21.15.181:0/521928620 learned_addr learned my addr 172.21.15.181:0/521928620 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:36.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7fb77fe640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.181:6790/0 conn(0x7f7fb80a66d0 legacy=0x7f7fb81ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7fb6ffd640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.181:6793/0 conn(0x7f7fb80a6ab0 legacy=0x7f7fb81d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2245445969 0 0) 0x7f7fb8143170 con 0x7f7fb80a66d0 2024-09-13T10:34:36.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 10 monclient(hunting): my global_id is 94160 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f98003520 con 0x7f7fb80a66d0 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4026349597 0 0) 0x7f7fb813d140 con 0x7f7fb80a6ab0 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 10 monclient(hunting): my global_id is 84473 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb8143170 con 0x7f7fb80a6ab0 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7fb7fff640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.195:6790/0 conn(0x7f7fb813f9a0 legacy=0x7f7fb81d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3675427735 0 0) 0x7f7f98003520 con 0x7f7fb80a66d0 2024-09-13T10:34:36.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fb813d140 con 0x7f7fb80a66d0 2024-09-13T10:34:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.369+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7fa0003610 con 0x7f7fb80a66d0 2024-09-13T10:34:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:34:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient(hunting): dump: 2024-09-13T10:34:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.388 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 930475651 0 0) 0x7f7fb8143170 con 0x7f7fb80a6ab0 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f98003520 con 0x7f7fb80a6ab0 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7fa8001d40 con 0x7f7fb80a6ab0 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:36.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient(hunting): dump: 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.390 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3669809290 0 0) 0x7f7fb8142db0 con 0x7f7fb813f9a0 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient(hunting): my global_id is 5727 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb8143170 con 0x7f7fb813f9a0 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1501882286 0 0) 0x7f7fb813d140 con 0x7f7fb80a66d0 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.181:6793/0 conn(0x7f7fb80a6ab0 legacy=0x7f7fb81d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.195:6790/0 conn(0x7f7fb813f9a0 legacy=0x7f7fb81d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient: _finish_hunting 0 2024-09-13T10:34:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 1 monclient: found mon.b 2024-09-13T10:34:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:34:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb813f4a0 con 0x7f7fb80a66d0 2024-09-13T10:34:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient: _finish_auth 0 2024-09-13T10:34:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient: _check_auth_tickets 2024-09-13T10:34:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7fbde48640 5 monclient: authenticate success, global_id 94160 2024-09-13T10:34:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7fbde48640 10 monclient: _renew_subs 2024-09-13T10:34:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7fbde48640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:34:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7fbde48640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb813dca0 con 0x7f7fb80a66d0 2024-09-13T10:34:36.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7fbde48640 10 monclient: _renew_subs 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7fbde48640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7fbde48640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7fb813c820 con 0x7f7fb80a66d0 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7fa0003b80 con 0x7f7fb80a66d0 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7fa0004070 con 0x7f7fb80a66d0 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7fb5ffb640 4 set_mon_vals no callback set 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.370+0000 7f7faffff640 10 monclient: dump: 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.393 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.371+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7fa0004210 con 0x7f7fb80a66d0 2024-09-13T10:34:36.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.371+0000 7f7fbde48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.371+0000 7f7fbde48640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7f9c0065c0 con 0x7f7f9c002860 2024-09-13T10:34:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.371+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(147..147 src has 1..147) ==== 3898+0+0 (unknown 1280883627 0 0) 0x7f7fa004e380 con 0x7f7fb80a66d0 2024-09-13T10:34:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.371+0000 7f7fb7fff640 10 monclient: get_auth_request con 0x7f7f980401f0 auth_method 0 2024-09-13T10:34:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7fb6ffd640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.195:6790/0 conn(0x7f7f9c002860 legacy=0x7f7f9c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3628975119 0 0) 0x7f7f9c0065c0 con 0x7f7f9c002860 2024-09-13T10:34:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 10 monclient(hunting): my global_id is 5736 2024-09-13T10:34:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb813d140 con 0x7f7f9c002860 2024-09-13T10:34:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2142927871 0 0) 0x7f7fb813d140 con 0x7f7f9c002860 2024-09-13T10:34:36.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f9c0065c0 con 0x7f7f9c002860 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7fa8003dd0 con 0x7f7f9c002860 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 10 monclient: dump: 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.396 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.397 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3635489908 0 0) 0x7f7f9c0065c0 con 0x7f7f9c002860 2024-09-13T10:34:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.373+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f9c00a160 con 0x7f7f9c002860 2024-09-13T10:34:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.374+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7fa8004070 con 0x7f7f9c002860 2024-09-13T10:34:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.374+0000 7f7faffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.374+0000 7f7faffff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:36.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.374+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.195:6790/0 conn(0x7f7f9c002860 legacy=0x7f7f9c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.374+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.195:6790/0 conn(0x7f7f9c002860 legacy=0x7f7f9c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.380+0000 7f7fbde48640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.380+0000 7f7fbde48640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7f9c009e70 con 0x7f7f9c009130 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.382+0000 7f7fb6ffd640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.195:6790/0 conn(0x7f7f9c009130 legacy=0x7f7f9c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.382+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966432096 0 0) 0x7f7f9c009e70 con 0x7f7f9c009130 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.382+0000 7f7faffff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.382+0000 7f7faffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.382+0000 7f7faffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.382+0000 7f7faffff640 10 monclient(hunting): my global_id is 5745 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.382+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f9c0065c0 con 0x7f7f9c009130 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4243124197 0 0) 0x7f7f9c0065c0 con 0x7f7f9c009130 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f9c009e70 con 0x7f7f9c009130 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7fa8005b00 con 0x7f7f9c009130 2024-09-13T10:34:36.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 10 monclient: dump: 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.399 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.400 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3377986646 0 0) 0x7f7f9c009e70 con 0x7f7f9c009130 2024-09-13T10:34:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7f9c00c410 con 0x7f7f9c009130 2024-09-13T10:34:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7728 (unknown 0 0 553999998) 0x7f7fa8006f90 con 0x7f7f9c009130 2024-09-13T10:34:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.195:6790/0 conn(0x7f7f9c009130 legacy=0x7f7f9c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7faffff640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.195:6790/0 conn(0x7f7f9c009130 legacy=0x7f7f9c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:36.401 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:36.401 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:36.401 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:36.401 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:34:36.401 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:36.401 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 290799, 2024-09-13T10:34:36.401 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:36.401 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:36.401 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:36.401 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:36.401 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:36.401 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.402 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.403 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.404 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.404 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.404 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.404 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.404 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.404 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.404 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.404 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.404 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.404 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:36.404 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:36.405 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:36.406 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:36.406 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.406 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.406 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.406 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.406 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.406 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.406 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.406 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.406 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.406 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.406 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:36.407 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:36.408 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.410 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.411 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:36.412 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.413 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.413 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.413 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:36.413 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.413 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.413 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.413 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:36.413 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:36.413 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.413 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.415 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:36.416 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.417 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.418 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.419 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:36.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.421 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.421 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.421 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:36.421 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.421 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.421 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:36.421 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:36.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7fbde48640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7f980401f0 legacy=0x7f7f980426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7fbde48640 10 monclient: shutdown 2024-09-13T10:34:36.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7fbde48640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:36.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7fbde48640 1 -- 172.21.15.181:0/521928620 >> v1:172.21.15.181:6790/0 conn(0x7f7fb80a66d0 legacy=0x7f7fb81ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7fb7fff640 1 -- 172.21.15.181:0/521928620 reap_dead start 2024-09-13T10:34:36.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7fb7fff640 1 -- 172.21.15.181:0/521928620 reap_dead start 2024-09-13T10:34:36.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7fbde48640 1 -- 172.21.15.181:0/521928620 shutdown_connections 2024-09-13T10:34:36.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.383+0000 7f7fbde48640 1 -- 172.21.15.181:0/521928620 >> 172.21.15.181:0/521928620 conn(0x7f7fb80abcd0 msgr2=0x7f7fb8138ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:36.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.384+0000 7f7fbde48640 1 -- 172.21.15.181:0/521928620 shutdown_connections 2024-09-13T10:34:36.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.384+0000 7f7fbde48640 1 -- 172.21.15.181:0/521928620 wait complete. 2024-09-13T10:34:36.424 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:36.424 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:34:36.424 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:34:36.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.519+0000 7f2d8cc71640 10 monclient: get_monmap_and_config 2024-09-13T10:34:36.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.519+0000 7f2d8cc71640 10 monclient: build_initial_monmap 2024-09-13T10:34:36.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.519+0000 7f2d8cc71640 10 monclient: monmap: 2024-09-13T10:34:36.522 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:36.522 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.522 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:36.521205+0000 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:36.521205+0000 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:36.523 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 1 Processor -- start 2024-09-13T10:34:36.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 1 -- start start 2024-09-13T10:34:36.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 10 monclient: init 2024-09-13T10:34:36.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:36.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 10 monclient: _add_conns ranks=[7,3,0,8,6,1,4,2,5] 2024-09-13T10:34:36.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 10 monclient(hunting): picked mon.noname-i con 0x7f2d880a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:36.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 10 monclient(hunting): picked mon.noname-g con 0x7f2d880a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:36.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 10 monclient(hunting): picked mon.noname-a con 0x7f2d8813f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:36.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d880a4bc0 con 0x7f2d8813f750 2024-09-13T10:34:36.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d8813a320 con 0x7f2d880a8340 2024-09-13T10:34:36.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d880a8100 con 0x7f2d880a6640 2024-09-13T10:34:36.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:36.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d8cc71640 10 monclient(hunting): authenticate will time out at 1016.026880s 2024-09-13T10:34:36.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d86d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2d8813f750 0x7f2d88141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35890/0 (socket says 172.21.15.181:35890) 2024-09-13T10:34:36.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.520+0000 7f2d86d9d640 1 -- 172.21.15.181:0/505071970 learned_addr learned my addr 172.21.15.181:0/505071970 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:36.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d86d9d640 1 -- 172.21.15.181:0/505071970 >> v1:172.21.15.181:6789/0 conn(0x7f2d8813f750 legacy=0x7f2d88141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d85d9b640 1 -- 172.21.15.181:0/505071970 >> v1:172.21.15.195:6790/0 conn(0x7f2d880a8340 legacy=0x7f2d88139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8659c640 1 -- 172.21.15.181:0/505071970 >> v1:172.21.15.195:6792/0 conn(0x7f2d880a6640 legacy=0x7f2d88139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2112468081 0 0) 0x7f2d880a4bc0 con 0x7f2d8813f750 2024-09-13T10:34:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient(hunting): my global_id is 55557 2024-09-13T10:34:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d70003520 con 0x7f2d8813f750 2024-09-13T10:34:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479748055 0 0) 0x7f2d8813a320 con 0x7f2d880a8340 2024-09-13T10:34:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient(hunting): my global_id is 5754 2024-09-13T10:34:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d880a4bc0 con 0x7f2d880a8340 2024-09-13T10:34:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1075121714 0 0) 0x7f2d880a8100 con 0x7f2d880a6640 2024-09-13T10:34:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient(hunting): my global_id is 55816 2024-09-13T10:34:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d8813a320 con 0x7f2d880a6640 2024-09-13T10:34:36.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 850213069 0 0) 0x7f2d70003520 con 0x7f2d8813f750 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 >> v1:172.21.15.195:6792/0 conn(0x7f2d880a6640 legacy=0x7f2d88139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 >> v1:172.21.15.195:6790/0 conn(0x7f2d880a8340 legacy=0x7f2d88139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient: _finish_hunting 0 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 monclient: found mon.noname-a 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d880a48e0 con 0x7f2d8813f750 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient: _finish_auth 0 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient: _check_auth_tickets 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d80001e60 con 0x7f2d8813f750 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8cc71640 5 monclient: authenticate success, global_id 55557 2024-09-13T10:34:36.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8cc71640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:36.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:34:36.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient: dump: 2024-09-13T10:34:36.538 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.538 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.538 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.538 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.538 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.538 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8cc71640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2d80004c20 con 0x7f2d8813f750 2024-09-13T10:34:36.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:36.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 1 -- 172.21.15.181:0/505071970 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d80005190 con 0x7f2d8813f750 2024-09-13T10:34:36.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8cc71640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:36.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8cc71640 4 set_mon_vals no callback set 2024-09-13T10:34:36.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:36.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.523+0000 7f2d8559a640 10 monclient: dump: 2024-09-13T10:34:36.540 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.540 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.540 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.541 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.541 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.541 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.541 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.541 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.541 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.541 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.541 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.541 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.524+0000 7f2d8cc71640 10 monclient: shutdown 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.524+0000 7f2d8cc71640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.524+0000 7f2d8cc71640 1 -- 172.21.15.181:0/505071970 >> v1:172.21.15.181:6789/0 conn(0x7f2d8813f750 legacy=0x7f2d88141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.524+0000 7f2d8cc71640 1 -- 172.21.15.181:0/505071970 shutdown_connections 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.524+0000 7f2d8cc71640 1 -- 172.21.15.181:0/505071970 >> 172.21.15.181:0/505071970 conn(0x7f2d88077170 msgr2=0x7f2d880abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.524+0000 7f2d8cc71640 1 -- 172.21.15.181:0/505071970 shutdown_connections 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.524+0000 7f2d8cc71640 1 -- 172.21.15.181:0/505071970 wait complete. 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.524+0000 7f2d8cc71640 10 monclient: build_initial_monmap 2024-09-13T10:34:36.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.524+0000 7f2d8cc71640 10 monclient: monmap: 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:36.543 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 1 Processor -- start 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 1 -- start start 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 10 monclient: init 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 10 monclient: _add_conns ranks=[8,2,7,1,4,0,3,6,5] 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 10 monclient(hunting): picked mon.noname-e con 0x7f2d880a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 10 monclient(hunting): picked mon.noname-b con 0x7f2d8813f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 10 monclient(hunting): picked mon.noname-i con 0x7f2d8813caa0 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d8813d540 con 0x7f2d8813f750 2024-09-13T10:34:36.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d8813e760 con 0x7f2d8813caa0 2024-09-13T10:34:36.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d88134d90 con 0x7f2d880a8340 2024-09-13T10:34:36.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:36.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8cc71640 10 monclient(hunting): authenticate will time out at 1016.031864s 2024-09-13T10:34:36.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8659c640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f2d880a8340 0x7f2d881ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50488/0 (socket says 172.21.15.181:50488) 2024-09-13T10:34:36.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.525+0000 7f2d8659c640 1 -- 172.21.15.181:0/193054978 learned_addr learned my addr 172.21.15.181:0/193054978 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:36.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d8659c640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.181:6793/0 conn(0x7f2d880a8340 legacy=0x7f2d881ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d85d9b640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.181:6790/0 conn(0x7f2d8813f750 legacy=0x7f2d881d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2364939326 0 0) 0x7f2d88134d90 con 0x7f2d880a8340 2024-09-13T10:34:36.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): my global_id is 84482 2024-09-13T10:34:36.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d68003550 con 0x7f2d880a8340 2024-09-13T10:34:36.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314608506 0 0) 0x7f2d8813d540 con 0x7f2d8813f750 2024-09-13T10:34:36.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d86d9d640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.195:6792/0 conn(0x7f2d8813caa0 legacy=0x7f2d881d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): my global_id is 94169 2024-09-13T10:34:36.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d88134d90 con 0x7f2d8813f750 2024-09-13T10:34:36.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 566205021 0 0) 0x7f2d68003550 con 0x7f2d880a8340 2024-09-13T10:34:36.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d8813d540 con 0x7f2d880a8340 2024-09-13T10:34:36.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d78003950 con 0x7f2d880a8340 2024-09-13T10:34:36.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:36.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:34:36.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): dump: 2024-09-13T10:34:36.547 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.547 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.547 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.547 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.547 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.547 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.547 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.547 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.547 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.548 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.548 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.548 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.548 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.548 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.548 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.548 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:36.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 587570953 0 0) 0x7f2d88134d90 con 0x7f2d8813f750 2024-09-13T10:34:36.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d68003550 con 0x7f2d8813f750 2024-09-13T10:34:36.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299476476 0 0) 0x7f2d880a48e0 con 0x7f2d8813caa0 2024-09-13T10:34:36.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): my global_id is 55825 2024-09-13T10:34:36.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d88134d90 con 0x7f2d8813caa0 2024-09-13T10:34:36.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d7c003610 con 0x7f2d8813f750 2024-09-13T10:34:36.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:36.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:36.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient(hunting): dump: 2024-09-13T10:34:36.550 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.550 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.550 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.550 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.550 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.551 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.551 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.551 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.551 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.551 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.551 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.551 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.551 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.551 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.551 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.551 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 268403617 0 0) 0x7f2d8813d540 con 0x7f2d880a8340 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.195:6792/0 conn(0x7f2d8813caa0 legacy=0x7f2d881d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.181:6790/0 conn(0x7f2d8813f750 legacy=0x7f2d881d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 monclient: found mon.e 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d880aa0a0 con 0x7f2d880a8340 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient: _finish_auth 0 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d8cc71640 5 monclient: authenticate success, global_id 84482 2024-09-13T10:34:36.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d8cc71640 10 monclient: _renew_subs 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d8cc71640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d8cc71640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2d8813e0a0 con 0x7f2d880a8340 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d8cc71640 10 monclient: _renew_subs 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d8cc71640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d8cc71640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f2d881cee30 con 0x7f2d880a8340 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2d78001ce0 con 0x7f2d880a8340 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d78004160 con 0x7f2d880a8340 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d84d99640 4 set_mon_vals no callback set 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.528+0000 7f2d76ffd640 10 monclient: dump: 2024-09-13T10:34:36.553 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.554 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.555 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.555 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.529+0000 7f2d8cc71640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.529+0000 7f2d8cc71640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2d6c0065c0 con 0x7f2d6c002860 2024-09-13T10:34:36.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.529+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2d78011ca0 con 0x7f2d880a8340 2024-09-13T10:34:36.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.529+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(147..147 src has 1..147) ==== 3898+0+0 (unknown 1280883627 0 0) 0x7f2d7804e4e0 con 0x7f2d880a8340 2024-09-13T10:34:36.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.530+0000 7f2d86d9d640 10 monclient: get_auth_request con 0x7f2d68040340 auth_method 0 2024-09-13T10:34:36.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.531+0000 7f2d85d9b640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.195:6791/0 conn(0x7f2d6c002860 legacy=0x7f2d6c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3618094457 0 0) 0x7f2d6c0065c0 con 0x7f2d6c002860 2024-09-13T10:34:36.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 10 monclient(hunting): my global_id is 5756 2024-09-13T10:34:36.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d8813d540 con 0x7f2d6c002860 2024-09-13T10:34:36.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 123601133 0 0) 0x7f2d8813d540 con 0x7f2d6c002860 2024-09-13T10:34:36.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d6c0065c0 con 0x7f2d6c002860 2024-09-13T10:34:36.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d7c003da0 con 0x7f2d6c002860 2024-09-13T10:34:36.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:34:36.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 10 monclient: dump: 2024-09-13T10:34:36.559 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.559 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.559 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1440070986 0 0) 0x7f2d6c0065c0 con 0x7f2d6c002860 2024-09-13T10:34:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d6c00a160 con 0x7f2d6c002860 2024-09-13T10:34:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2d7c0040d0 con 0x7f2d6c002860 2024-09-13T10:34:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.195:6791/0 conn(0x7f2d6c002860 legacy=0x7f2d6c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.532+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.195:6791/0 conn(0x7f2d6c002860 legacy=0x7f2d6c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.538+0000 7f2d8cc71640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.538+0000 7f2d8cc71640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2d6c009e50 con 0x7f2d6c009110 2024-09-13T10:34:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d85d9b640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.195:6791/0 conn(0x7f2d6c009110 legacy=0x7f2d6c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3866687680 0 0) 0x7f2d6c009e50 con 0x7f2d6c009110 2024-09-13T10:34:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 10 monclient(hunting): my global_id is 5765 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d6c0065c0 con 0x7f2d6c009110 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1339825673 0 0) 0x7f2d6c0065c0 con 0x7f2d6c009110 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d6c009e50 con 0x7f2d6c009110 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2d7c005b80 con 0x7f2d6c009110 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 10 monclient: dump: 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.562 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.563 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.563 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.563 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.563 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.563 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.563 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.563 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.563 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.563 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.563 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.563 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.563 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3413921161 0 0) 0x7f2d6c009e50 con 0x7f2d6c009110 2024-09-13T10:34:36.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.541+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2d6c00c3a0 con 0x7f2d6c009110 2024-09-13T10:34:36.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 697075346) 0x7f2d7c007010 con 0x7f2d6c009110 2024-09-13T10:34:36.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d76ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:36.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d76ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:36.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.195:6791/0 conn(0x7f2d6c009110 legacy=0x7f2d6c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d76ffd640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.195:6791/0 conn(0x7f2d6c009110 legacy=0x7f2d6c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:36.564 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:36.564 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:36.565 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:36.565 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:36.565 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:36.565 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 290970, 2024-09-13T10:34:36.565 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:36.565 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:36.565 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:36.565 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:36.565 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:36.565 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:36.565 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:36.565 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:36.566 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:36.566 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:36.566 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.566 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:34:36.566 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:36.566 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:36.566 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:36.566 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.566 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.566 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.566 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.566 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.567 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:36.568 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:36.569 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.570 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.571 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.572 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:36.572 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:36.572 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.572 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.572 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.572 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:36.572 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:36.573 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.573 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.573 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.573 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:36.573 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.573 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.573 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.573 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:36.573 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:36.573 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.574 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.574 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.574 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:36.574 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:36.574 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.574 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.574 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.574 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:36.574 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.575 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.575 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.575 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:36.575 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:36.575 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.575 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.575 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.576 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:36.576 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:36.576 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.576 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.576 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.576 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:36.576 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.576 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.576 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.577 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:36.577 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:36.577 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.577 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.577 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.577 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:36.578 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:36.578 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.578 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.578 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.578 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:36.578 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.578 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.578 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.578 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:36.579 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:36.579 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.579 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.579 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.579 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:36.579 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:36.579 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.579 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.580 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.580 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:36.580 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.580 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.580 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.580 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:36.580 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:36.581 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.581 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.581 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.581 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:36.581 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:36.581 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.581 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.581 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.581 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:36.582 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.582 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.582 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.582 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:36.582 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:36.582 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.582 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.583 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.583 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:36.583 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:36.583 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.583 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.584 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.584 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:36.584 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.584 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.584 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.584 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:36.584 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:36.584 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.584 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.585 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.586 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:36.586 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:36.586 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.586 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.586 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.586 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.586 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.587 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:36.588 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.588 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.588 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:36.588 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:36.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d8cc71640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.195:6800/1839191919 conn(0x7f2d68040340 legacy=0x7f2d68042800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d8cc71640 10 monclient: shutdown 2024-09-13T10:34:36.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d8cc71640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:36.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d8cc71640 1 -- 172.21.15.181:0/193054978 >> v1:172.21.15.181:6793/0 conn(0x7f2d880a8340 legacy=0x7f2d881ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d86d9d640 1 -- 172.21.15.181:0/193054978 reap_dead start 2024-09-13T10:34:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d86d9d640 1 -- 172.21.15.181:0/193054978 reap_dead start 2024-09-13T10:34:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d8cc71640 1 -- 172.21.15.181:0/193054978 shutdown_connections 2024-09-13T10:34:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d8cc71640 1 -- 172.21.15.181:0/193054978 >> 172.21.15.181:0/193054978 conn(0x7f2d880a6640 msgr2=0x7f2d880a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d8cc71640 1 -- 172.21.15.181:0/193054978 shutdown_connections 2024-09-13T10:34:36.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.542+0000 7f2d8cc71640 1 -- 172.21.15.181:0/193054978 wait complete. 2024-09-13T10:34:36.590 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:36.590 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:34:36.591 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:34:36.630 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37779]: starting. 2024-09-13T10:34:36.631 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37779]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37777 2024-09-13T10:34:36.631 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37779]: shutting down. 2024-09-13T10:34:36.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.691+0000 7fc006ff3640 10 monclient: get_monmap_and_config 2024-09-13T10:34:36.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.691+0000 7fc006ff3640 10 monclient: build_initial_monmap 2024-09-13T10:34:36.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.691+0000 7fc006ff3640 10 monclient: monmap: 2024-09-13T10:34:36.693 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:36.693 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.694 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:36.692671+0000 2024-09-13T10:34:36.694 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:36.692671+0000 2024-09-13T10:34:36.694 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:36.694 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.694 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:36.694 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:36.694 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:36.694 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:36.694 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:36.695 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:36.695 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:36.695 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:36.695 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:36.695 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.691+0000 7fc006ff3640 1 Processor -- start 2024-09-13T10:34:36.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.691+0000 7fc006ff3640 1 -- start start 2024-09-13T10:34:36.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.691+0000 7fc006ff3640 10 monclient: init 2024-09-13T10:34:36.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fc006ff3640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:36.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fc006ff3640 10 monclient: _add_conns ranks=[6,4,2,8,7,0,5,3,1] 2024-09-13T10:34:36.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fc006ff3640 10 monclient(hunting): picked mon.noname-d con 0x7fc0000a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:36.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fc006ff3640 10 monclient(hunting): picked mon.noname-c con 0x7fc0000a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:36.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fc006ff3640 10 monclient(hunting): picked mon.noname-b con 0x7fc00013f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:34:36.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fc006ff3640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0000a5fe0 con 0x7fc00013f9a0 2024-09-13T10:34:36.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fc006ff3640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0000a8080 con 0x7fc0000a6ab0 2024-09-13T10:34:36.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fc006ff3640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0000a42c0 con 0x7fc0000a66d0 2024-09-13T10:34:36.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fc006ff3640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:36.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fc006ff3640 10 monclient(hunting): authenticate will time out at 1016.198296s 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fc004d8f640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fc0000a66d0 0x7fc0000a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47364/0 (socket says 172.21.15.181:47364) 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fc004d8f640 1 -- 172.21.15.181:0/2324318574 learned_addr learned my addr 172.21.15.181:0/2324318574 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.692+0000 7fbff7fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fc0000a6ab0 0x7fc0000a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58638/0 (socket says 172.21.15.181:58638) 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff7fff640 1 -- 172.21.15.181:0/2324318574 >> v1:172.21.15.181:6791/0 conn(0x7fc0000a6ab0 legacy=0x7fc0000a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fc005590640 1 -- 172.21.15.181:0/2324318574 >> v1:172.21.15.181:6790/0 conn(0x7fc00013f9a0 legacy=0x7fc000141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fc004d8f640 1 -- 172.21.15.181:0/2324318574 >> v1:172.21.15.181:6792/0 conn(0x7fc0000a66d0 legacy=0x7fc0000a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760434856 0 0) 0x7fc0000a8080 con 0x7fc0000a6ab0 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 10 monclient(hunting): my global_id is 5863 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfe8003520 con 0x7fc0000a6ab0 2024-09-13T10:34:36.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4079203168 0 0) 0x7fc0000a5fe0 con 0x7fc00013f9a0 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 10 monclient(hunting): my global_id is 94196 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0000a8080 con 0x7fc00013f9a0 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4082976773 0 0) 0x7fc0000a42c0 con 0x7fc0000a66d0 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 10 monclient(hunting): my global_id is 5712 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0000a5fe0 con 0x7fc0000a66d0 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.694+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1310350002 0 0) 0x7fbfe8003520 con 0x7fc0000a6ab0 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 >> v1:172.21.15.181:6792/0 conn(0x7fc0000a66d0 legacy=0x7fc0000a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 >> v1:172.21.15.181:6790/0 conn(0x7fc00013f9a0 legacy=0x7fc000141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 10 monclient: _finish_hunting 0 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 1 monclient: found mon.noname-c 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0001464e0 con 0x7fc0000a6ab0 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 10 monclient: _finish_auth 0 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 10 monclient: _check_auth_tickets 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbff0001ae0 con 0x7fc0000a6ab0 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 10 monclient: dump: 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.704 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.705 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fc006ff3640 5 monclient: authenticate success, global_id 5863 2024-09-13T10:34:36.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fc006ff3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:36.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbff00047e0 con 0x7fc0000a6ab0 2024-09-13T10:34:36.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:36.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fc006ff3640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:36.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 1 -- 172.21.15.181:0/2324318574 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbff0004d90 con 0x7fc0000a6ab0 2024-09-13T10:34:36.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fc006ff3640 4 set_mon_vals no callback set 2024-09-13T10:34:36.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:36.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fbff77fe640 10 monclient: dump: 2024-09-13T10:34:36.707 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.707 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.707 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.707 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.707 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.707 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fc006ff3640 10 monclient: shutdown 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fc006ff3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fc006ff3640 1 -- 172.21.15.181:0/2324318574 >> v1:172.21.15.181:6791/0 conn(0x7fc0000a6ab0 legacy=0x7fc0000a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fc006ff3640 1 -- 172.21.15.181:0/2324318574 shutdown_connections 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fc006ff3640 1 -- 172.21.15.181:0/2324318574 >> 172.21.15.181:0/2324318574 conn(0x7fc0000abcd0 msgr2=0x7fc0000ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fc006ff3640 1 -- 172.21.15.181:0/2324318574 shutdown_connections 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.695+0000 7fc006ff3640 1 -- 172.21.15.181:0/2324318574 wait complete. 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.696+0000 7fc006ff3640 10 monclient: build_initial_monmap 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.696+0000 7fc006ff3640 10 monclient: monmap: 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:36.709 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.696+0000 7fc006ff3640 1 Processor -- start 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.696+0000 7fc006ff3640 1 -- start start 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.696+0000 7fc006ff3640 10 monclient: init 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.697+0000 7fc006ff3640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.697+0000 7fc006ff3640 10 monclient: _add_conns ranks=[6,7,1,2,5,8,4,3,0] 2024-09-13T10:34:36.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.697+0000 7fc006ff3640 10 monclient(hunting): picked mon.noname-d con 0x7fc0000a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:36.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.697+0000 7fc006ff3640 10 monclient(hunting): picked mon.noname-i con 0x7fc0000a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:36.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.697+0000 7fc006ff3640 10 monclient(hunting): picked mon.noname-f con 0x7fc00013f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:36.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.697+0000 7fc006ff3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc00013e830 con 0x7fc00013f9a0 2024-09-13T10:34:36.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.697+0000 7fc006ff3640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc00013cd70 con 0x7fc0000a66d0 2024-09-13T10:34:36.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.697+0000 7fc006ff3640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc000068680 con 0x7fc0000a6ab0 2024-09-13T10:34:36.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.697+0000 7fc006ff3640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:36.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.697+0000 7fc006ff3640 10 monclient(hunting): authenticate will time out at 1016.203333s 2024-09-13T10:34:36.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.697+0000 7fc004d8f640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fc0000a66d0 0x7fc00013b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47372/0 (socket says 172.21.15.181:47372) 2024-09-13T10:34:36.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.697+0000 7fc004d8f640 1 -- 172.21.15.181:0/3654873136 learned_addr learned my addr 172.21.15.181:0/3654873136 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:36.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fc004d8f640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.181:6792/0 conn(0x7fc0000a66d0 legacy=0x7fc00013b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 909292851 0 0) 0x7fc00013cd70 con 0x7fc0000a66d0 2024-09-13T10:34:36.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): my global_id is 5721 2024-09-13T10:34:36.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fc005590640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.195:6789/0 conn(0x7fc00013f9a0 legacy=0x7fc0001d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfec003520 con 0x7fc0000a66d0 2024-09-13T10:34:36.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff7fff640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.195:6792/0 conn(0x7fc0000a6ab0 legacy=0x7fc00013ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3418996932 0 0) 0x7fc000068680 con 0x7fc0000a6ab0 2024-09-13T10:34:36.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): my global_id is 55861 2024-09-13T10:34:36.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc00013cd70 con 0x7fc0000a6ab0 2024-09-13T10:34:36.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567220212 0 0) 0x7fbff8002070 con 0x7fc00013f9a0 2024-09-13T10:34:36.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): my global_id is 55891 2024-09-13T10:34:36.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc000068680 con 0x7fc00013f9a0 2024-09-13T10:34:36.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1722737959 0 0) 0x7fbfec003520 con 0x7fc0000a66d0 2024-09-13T10:34:36.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbff8002070 con 0x7fc0000a66d0 2024-09-13T10:34:36.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbffc001ce0 con 0x7fc0000a66d0 2024-09-13T10:34:36.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:36.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:36.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): dump: 2024-09-13T10:34:36.721 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.721 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.722 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.722 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.722 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.722 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.722 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.723 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.723 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.723 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.723 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.723 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.723 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.724 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.724 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.724 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:36.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 839069425 0 0) 0x7fbff8002070 con 0x7fc0000a66d0 2024-09-13T10:34:36.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.699+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.195:6792/0 conn(0x7fc0000a6ab0 legacy=0x7fc00013ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.195:6789/0 conn(0x7fc00013f9a0 legacy=0x7fc0001d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 10 monclient: _finish_hunting 0 2024-09-13T10:34:36.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 1 monclient: found mon.d 2024-09-13T10:34:36.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:36.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:36.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00013e260 con 0x7fc0000a66d0 2024-09-13T10:34:36.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 10 monclient: _finish_auth 0 2024-09-13T10:34:36.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 10 monclient: _check_auth_tickets 2024-09-13T10:34:36.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:36.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fc006ff3640 5 monclient: authenticate success, global_id 5721 2024-09-13T10:34:36.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fc006ff3640 10 monclient: _renew_subs 2024-09-13T10:34:36.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fc006ff3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:36.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fc006ff3640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc00013c160 con 0x7fc0000a66d0 2024-09-13T10:34:36.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fc006ff3640 10 monclient: _renew_subs 2024-09-13T10:34:36.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fc006ff3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:36.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fc006ff3640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc0001374e0 con 0x7fc0000a66d0 2024-09-13T10:34:36.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbffc004c00 con 0x7fc0000a66d0 2024-09-13T10:34:36.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:36.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbffc0050f0 con 0x7fc0000a66d0 2024-09-13T10:34:36.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff6ffd640 4 set_mon_vals no callback set 2024-09-13T10:34:36.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:36.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fbff57fa640 10 monclient: dump: 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.729 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fc006ff3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.700+0000 7fc006ff3640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbfe00065c0 con 0x7fbfe0002860 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.701+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fbffc005390 con 0x7fc0000a66d0 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.701+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(148..148 src has 1..148) ==== 3506+0+0 (unknown 664064783 0 0) 0x7fbffc04e2a0 con 0x7fc0000a66d0 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.701+0000 7fc005590640 10 monclient: get_auth_request con 0x7fbfec03fa90 auth_method 0 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff7fff640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.195:6792/0 conn(0x7fbfe0002860 legacy=0x7fbfe0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3348499829 0 0) 0x7fbfe00065c0 con 0x7fbfe0002860 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 10 monclient(hunting): my global_id is 55870 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbff8002070 con 0x7fbfe0002860 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3943181720 0 0) 0x7fbff8002070 con 0x7fbfe0002860 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbfe00065c0 con 0x7fbfe0002860 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbff0001d30 con 0x7fbfe0002860 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 10 monclient: dump: 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.731 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2464155498 0 0) 0x7fbfe00065c0 con 0x7fbfe0002860 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.703+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbfe000a160 con 0x7fbfe0002860 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.704+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fbff0005390 con 0x7fbfe0002860 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.704+0000 7fbff57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.704+0000 7fbff57fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.704+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.195:6792/0 conn(0x7fbfe0002860 legacy=0x7fbfe0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.704+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.195:6792/0 conn(0x7fbfe0002860 legacy=0x7fbfe0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.710+0000 7fc006ff3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.710+0000 7fc006ff3640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbfe0009e70 con 0x7fbfe0009130 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff7fff640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.195:6792/0 conn(0x7fbfe0009130 legacy=0x7fbfe00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2844108547 0 0) 0x7fbfe0009e70 con 0x7fbfe0009130 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff57fa640 10 monclient(hunting): my global_id is 55879 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfe00065c0 con 0x7fbfe0009130 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3216466642 0 0) 0x7fbfe00065c0 con 0x7fbfe0009130 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbfe0009e70 con 0x7fbfe0009130 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbff0005b80 con 0x7fbfe0009130 2024-09-13T10:34:36.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff57fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.712+0000 7fbff57fa640 10 monclient: dump: 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.734 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2361048749 0 0) 0x7fbfe0009e70 con 0x7fbfe0009130 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbfe000c410 con 0x7fbfe0009130 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 1078232298) 0x7fbff0008080 con 0x7fbfe0009130 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fbff57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fbff57fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.195:6792/0 conn(0x7fbfe0009130 legacy=0x7fbfe00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fbff57fa640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.195:6792/0 conn(0x7fbfe0009130 legacy=0x7fbfe00095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:36.735 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 291134, 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:36.736 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.737 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.738 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.738 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.738 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.738 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:36.738 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:36.738 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.738 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.738 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.738 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.738 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.738 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.738 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:36.739 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:36.740 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.741 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:36.742 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:36.744 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.745 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.746 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:36.747 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.748 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.748 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.748 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:36.748 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.748 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.748 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.748 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:36.748 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:36.748 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.749 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.750 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:36.751 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:36.752 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:36.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:36.754 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:36.754 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:36.754 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:36.754 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:36.754 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:36.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:36.754 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:36.754 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:36.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fc006ff3640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.195:6800/1839191919 conn(0x7fbfec03fa90 legacy=0x7fbfec041f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fc006ff3640 10 monclient: shutdown 2024-09-13T10:34:36.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fc006ff3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:36.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fc006ff3640 1 -- 172.21.15.181:0/3654873136 >> v1:172.21.15.181:6792/0 conn(0x7fc0000a66d0 legacy=0x7fc00013b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fc005590640 1 -- 172.21.15.181:0/3654873136 reap_dead start 2024-09-13T10:34:36.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fc005590640 1 -- 172.21.15.181:0/3654873136 reap_dead start 2024-09-13T10:34:36.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fc006ff3640 1 -- 172.21.15.181:0/3654873136 shutdown_connections 2024-09-13T10:34:36.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fc006ff3640 1 -- 172.21.15.181:0/3654873136 >> 172.21.15.181:0/3654873136 conn(0x7fc0000abcd0 msgr2=0x7fc0000a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:36.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fc006ff3640 1 -- 172.21.15.181:0/3654873136 shutdown_connections 2024-09-13T10:34:36.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.713+0000 7fc006ff3640 1 -- 172.21.15.181:0/3654873136 wait complete. 2024-09-13T10:34:36.756 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:36.757 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T10:34:36.757 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T10:34:36.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.851+0000 7f96addbb640 10 monclient: get_monmap_and_config 2024-09-13T10:34:36.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.852+0000 7f96addbb640 10 monclient: build_initial_monmap 2024-09-13T10:34:36.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.852+0000 7f96addbb640 10 monclient: monmap: 2024-09-13T10:34:36.854 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:36.854 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:36.853626+0000 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:36.853626+0000 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:36.855 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.852+0000 7f96addbb640 1 Processor -- start 2024-09-13T10:34:36.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.852+0000 7f96addbb640 1 -- start start 2024-09-13T10:34:36.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.852+0000 7f96addbb640 10 monclient: init 2024-09-13T10:34:36.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96addbb640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:36.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96addbb640 10 monclient: _add_conns ranks=[6,0,7,4,8,1,5,2,3] 2024-09-13T10:34:36.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96addbb640 10 monclient(hunting): picked mon.noname-d con 0x7f96a80a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:36.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96addbb640 10 monclient(hunting): picked mon.noname-a con 0x7f96a80a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:36.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96addbb640 10 monclient(hunting): picked mon.noname-i con 0x7f96a813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:36.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96addbb640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a80a5fe0 con 0x7f96a80a6ab0 2024-09-13T10:34:36.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96addbb640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a80a8080 con 0x7f96a80a66d0 2024-09-13T10:34:36.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96addbb640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a80a42c0 con 0x7f96a813f9a0 2024-09-13T10:34:36.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96addbb640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:36.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96addbb640 10 monclient(hunting): authenticate will time out at 1016.359311s 2024-09-13T10:34:36.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96a77fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f96a80a66d0 0x7f96a80a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47376/0 (socket says 172.21.15.181:47376) 2024-09-13T10:34:36.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96a6ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f96a80a6ab0 0x7f96a80a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35900/0 (socket says 172.21.15.181:35900) 2024-09-13T10:34:36.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.853+0000 7f96a77fe640 1 -- 172.21.15.181:0/2187635147 learned_addr learned my addr 172.21.15.181:0/2187635147 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:36.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.855+0000 7f96a77fe640 1 -- 172.21.15.181:0/2187635147 >> v1:172.21.15.181:6792/0 conn(0x7f96a80a66d0 legacy=0x7f96a80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.855+0000 7f96a6ffd640 1 -- 172.21.15.181:0/2187635147 >> v1:172.21.15.181:6789/0 conn(0x7f96a80a6ab0 legacy=0x7f96a80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.855+0000 7f96a7fff640 1 -- 172.21.15.181:0/2187635147 >> v1:172.21.15.195:6792/0 conn(0x7f96a813f9a0 legacy=0x7f96a8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 993087741 0 0) 0x7f96a80a42c0 con 0x7f96a813f9a0 2024-09-13T10:34:36.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient(hunting): my global_id is 55888 2024-09-13T10:34:36.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9694003520 con 0x7f96a813f9a0 2024-09-13T10:34:36.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3366736096 0 0) 0x7f96a80a8080 con 0x7f96a80a66d0 2024-09-13T10:34:36.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient(hunting): my global_id is 5730 2024-09-13T10:34:36.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96a80a42c0 con 0x7f96a80a66d0 2024-09-13T10:34:36.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2281151224 0 0) 0x7f96a80a5fe0 con 0x7f96a80a6ab0 2024-09-13T10:34:36.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient(hunting): my global_id is 55575 2024-09-13T10:34:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96a80a8080 con 0x7f96a80a6ab0 2024-09-13T10:34:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2517161031 0 0) 0x7f9694003520 con 0x7f96a813f9a0 2024-09-13T10:34:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 >> v1:172.21.15.181:6792/0 conn(0x7f96a80a66d0 legacy=0x7f96a80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 >> v1:172.21.15.181:6789/0 conn(0x7f96a80a6ab0 legacy=0x7f96a80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:34:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 monclient: found mon.noname-i 2024-09-13T10:34:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:34:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a81464e0 con 0x7f96a813f9a0 2024-09-13T10:34:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient: _finish_auth 0 2024-09-13T10:34:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:34:36.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f96a0001ea0 con 0x7f96a813f9a0 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96addbb640 5 monclient: authenticate success, global_id 55888 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96addbb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient: dump: 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.865 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96addbb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96a0003990 con 0x7f96a813f9a0 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a7fff640 1 --1- 172.21.15.181:0/2187635147 >> v1:172.21.15.195:6792/0 conn(0x7f96a813f9a0 0x7f96a8141d90 :-1 s=OPENED pgs=351 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f96a0003f40 mon_map magic: 0 2024-09-13T10:34:36.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96addbb640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96addbb640 4 set_mon_vals no callback set 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96addbb640 10 monclient: shutdown 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96addbb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96addbb640 1 -- 172.21.15.181:0/2187635147 >> v1:172.21.15.195:6792/0 conn(0x7f96a813f9a0 legacy=0x7f96a8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 1 -- 172.21.15.181:0/2187635147 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f96a0003f40 con 0x7f96a813f9a0 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96a67fc640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96addbb640 1 -- 172.21.15.181:0/2187635147 shutdown_connections 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.856+0000 7f96addbb640 1 -- 172.21.15.181:0/2187635147 >> 172.21.15.181:0/2187635147 conn(0x7f96a80abcd0 msgr2=0x7f96a80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.857+0000 7f96addbb640 1 -- 172.21.15.181:0/2187635147 shutdown_connections 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.857+0000 7f96addbb640 1 -- 172.21.15.181:0/2187635147 wait complete. 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.857+0000 7f96addbb640 10 monclient: build_initial_monmap 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.857+0000 7f96addbb640 10 monclient: monmap: 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:36.867 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.857+0000 7f96addbb640 1 Processor -- start 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96addbb640 1 -- start start 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96addbb640 10 monclient: init 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96addbb640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96addbb640 10 monclient: _add_conns ranks=[6,3,1,4,8,5,0,2,7] 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96addbb640 10 monclient(hunting): picked mon.noname-d con 0x7f96a80a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96addbb640 10 monclient(hunting): picked mon.noname-g con 0x7f96a80a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96addbb640 10 monclient(hunting): picked mon.noname-f con 0x7f96a813f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96addbb640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a813e2f0 con 0x7f96a813f9a0 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96addbb640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a813ee50 con 0x7f96a80a6ab0 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96addbb640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a81cb8d0 con 0x7f96a80a66d0 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96addbb640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96addbb640 10 monclient(hunting): authenticate will time out at 1016.364619s 2024-09-13T10:34:36.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96a77fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f96a80a66d0 0x7f96a80a1d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47380/0 (socket says 172.21.15.181:47380) 2024-09-13T10:34:36.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.858+0000 7f96a77fe640 1 -- 172.21.15.181:0/2736352423 learned_addr learned my addr 172.21.15.181:0/2736352423 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:36.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.860+0000 7f96a77fe640 1 -- 172.21.15.181:0/2736352423 >> v1:172.21.15.181:6792/0 conn(0x7f96a80a66d0 legacy=0x7f96a80a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.860+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559725588 0 0) 0x7f96a81cb8d0 con 0x7f96a80a66d0 2024-09-13T10:34:36.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.860+0000 7f969ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.860+0000 7f969ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.860+0000 7f969ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.860+0000 7f969ffff640 10 monclient(hunting): my global_id is 5739 2024-09-13T10:34:36.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.860+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9688003520 con 0x7f96a80a66d0 2024-09-13T10:34:36.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f96a7fff640 1 -- 172.21.15.181:0/2736352423 >> v1:172.21.15.195:6789/0 conn(0x7f96a813f9a0 legacy=0x7f96a81d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f96a6ffd640 1 -- 172.21.15.181:0/2736352423 >> v1:172.21.15.195:6790/0 conn(0x7f96a80a6ab0 legacy=0x7f96a81d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3695365541 0 0) 0x7f9688003520 con 0x7f96a80a66d0 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96a81cb8d0 con 0x7f96a80a66d0 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f96980047e0 con 0x7f96a80a66d0 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient(hunting): dump: 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.874 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 845256475 0 0) 0x7f96a813e2f0 con 0x7f96a813f9a0 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient(hunting): my global_id is 55900 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9688003520 con 0x7f96a813f9a0 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1245940208 0 0) 0x7f96a813ee50 con 0x7f96a80a6ab0 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient(hunting): my global_id is 5790 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96a813e2f0 con 0x7f96a80a6ab0 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2237079634 0 0) 0x7f96a81cb8d0 con 0x7f96a80a66d0 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 >> v1:172.21.15.195:6790/0 conn(0x7f96a80a6ab0 legacy=0x7f96a81d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 >> v1:172.21.15.195:6789/0 conn(0x7f96a813f9a0 legacy=0x7f96a81d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 monclient: found mon.d 2024-09-13T10:34:36.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a809cf50 con 0x7f96a80a66d0 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient: _finish_auth 0 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f96addbb640 5 monclient: authenticate success, global_id 5739 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f96addbb640 10 monclient: _renew_subs 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f96addbb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f96addbb640 1 -- 172.21.15.181:0/2736352423 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f96a81cf1c0 con 0x7f96a80a66d0 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f96addbb640 10 monclient: _renew_subs 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f96addbb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f96addbb640 1 -- 172.21.15.181:0/2736352423 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f96a80a2440 con 0x7f96a80a66d0 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9698004d90 con 0x7f96a80a66d0 2024-09-13T10:34:36.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9698005280 con 0x7f96a80a66d0 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f96a5ffb640 4 set_mon_vals no callback set 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.861+0000 7f969ffff640 10 monclient: dump: 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:36.878 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.862+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9698011900 con 0x7f96a80a66d0 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.862+0000 7f96addbb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.862+0000 7f96addbb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.862+0000 7f96addbb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.862+0000 7f96addbb640 1 -- 172.21.15.181:0/2736352423 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968c005080 con 0x7f96a80a66d0 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.862+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(148..148 src has 1..148) ==== 3506+0+0 (unknown 664064783 0 0) 0x7f969804e270 con 0x7f96a80a66d0 2024-09-13T10:34:36.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.862+0000 7f96a6ffd640 10 monclient: get_auth_request con 0x7f968803fd10 auth_method 0 2024-09-13T10:34:36.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.866+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f9698017880 con 0x7f96a80a66d0 2024-09-13T10:34:36.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.866+0000 7f969ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:36.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:36.866+0000 7f969ffff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:37.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.114+0000 7f96addbb640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-13T10:34:37.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.114+0000 7f96addbb640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-13T10:34:37.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.114+0000 7f96addbb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:37.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.114+0000 7f96addbb640 1 -- 172.21.15.181:0/2736352423 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f968c005c40 con 0x7f96a80a66d0 2024-09-13T10:34:37.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.117+0000 7f969ffff640 1 -- 172.21.15.181:0/2736352423 <== mon.6 v1:172.21.15.181:6792/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f9698017180 con 0x7f96a80a66d0 2024-09-13T10:34:37.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.117+0000 7f969ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-13T10:34:37.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.117+0000 7f969ffff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:37.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.119+0000 7f96addbb640 1 -- 172.21.15.181:0/2736352423 >> v1:172.21.15.195:6800/1839191919 conn(0x7f968803fd10 legacy=0x7f96880421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:37.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.119+0000 7f96addbb640 10 monclient: shutdown 2024-09-13T10:34:37.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.119+0000 7f96addbb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:37.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.119+0000 7f96addbb640 1 -- 172.21.15.181:0/2736352423 >> v1:172.21.15.181:6792/0 conn(0x7f96a80a66d0 legacy=0x7f96a80a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:37.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.119+0000 7f96addbb640 1 -- 172.21.15.181:0/2736352423 shutdown_connections 2024-09-13T10:34:37.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.119+0000 7f96addbb640 1 -- 172.21.15.181:0/2736352423 >> 172.21.15.181:0/2736352423 conn(0x7f96a80abcd0 msgr2=0x7f96a81440c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:37.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.119+0000 7f96addbb640 1 -- 172.21.15.181:0/2736352423 shutdown_connections 2024-09-13T10:34:37.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:37.119+0000 7f96addbb640 1 -- 172.21.15.181:0/2736352423 wait complete. 2024-09-13T10:34:37.131 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-13T10:34:37.367 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.367 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=16,config=1,health=12,kv=11,logm=60} crc {auth=3459181139,config=1747058506,health=216965645,kv=3467323233,logm=2345353429}) 2024-09-13T10:34:37.367 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=13,config=2,health=12,kv=12,logm=61} crc {auth=3515358315,config=2586702516,health=216965645,kv=3467323233,logm=802457213}) 2024-09-13T10:34:37.367 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.367 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=16,config=1,health=12,kv=11,logm=60} crc {auth=3459181139,config=1747058506,health=216965645,kv=3467323233,logm=2345353429}) 2024-09-13T10:34:37.367 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=16,config=1,health=12,kv=12,logm=59} crc {auth=3459181139,config=1228700967,health=1489125378,kv=3467323233,logm=2776256116}) 2024-09-13T10:34:37.367 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.367 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=16,config=1,health=12,kv=11,logm=60} crc {auth=3459181139,config=1747058506,health=216965645,kv=3467323233,logm=2345353429}) 2024-09-13T10:34:37.367 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=14,config=2,health=11,kv=12,logm=61} crc {auth=3105956054,config=2586702516,health=1794445819,kv=3467323233,logm=3751270665}) 2024-09-13T10:34:37.367 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.368 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=16,config=1,health=12,kv=11,logm=60} crc {auth=3459181139,config=1747058506,health=216965645,kv=3467323233,logm=2345353429}) 2024-09-13T10:34:37.368 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=13,config=2,health=12,kv=12,logm=61} crc {auth=822207676,config=2586702516,health=216965645,kv=3467323233,logm=1242831277}) 2024-09-13T10:34:37.368 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.368 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=16,config=1,health=12,kv=11,logm=60} crc {auth=3459181139,config=1747058506,health=216965645,kv=3467323233,logm=2345353429}) 2024-09-13T10:34:37.368 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=16,config=2,health=12,kv=11,logm=59} crc {auth=3459181139,config=2586702516,health=216965645,kv=3074811039,logm=2263476035}) 2024-09-13T10:34:37.368 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.368 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=16,config=1,health=12,kv=11,logm=60} crc {auth=3459181139,config=1747058506,health=216965645,kv=3467323233,logm=2345353429}) 2024-09-13T10:34:37.368 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=16,config=1,health=12,kv=11,logm=60} crc {auth=3459181139,config=1228700967,health=216965645,kv=775579436,logm=1475168847}) 2024-09-13T10:34:37.368 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.368 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=16,config=1,health=12,kv=11,logm=60} crc {auth=3459181139,config=1747058506,health=216965645,kv=3467323233,logm=2345353429}) 2024-09-13T10:34:37.368 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=952457606,config=2586702516,health=216965645,kv=3467323233,logm=2251304589}) 2024-09-13T10:34:37.368 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.369 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=16,config=1,health=12,kv=11,logm=60} crc {auth=3459181139,config=1747058506,health=216965645,kv=3467323233,logm=2345353429}) 2024-09-13T10:34:37.369 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.363+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=16,config=2,health=11,kv=12,logm=59} crc {auth=3459181139,config=2586702516,health=1446566741,kv=3467323233,logm=2822401888}) 2024-09-13T10:34:37.369 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.364+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.369 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.364+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=336722201}) 2024-09-13T10:34:37.369 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.364+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1992560924}) 2024-09-13T10:34:37.369 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.364+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.369 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.364+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=336722201}) 2024-09-13T10:34:37.369 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.364+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1153256922}) 2024-09-13T10:34:37.369 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.364+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.369 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.364+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=336722201}) 2024-09-13T10:34:37.369 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.364+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1730546254}) 2024-09-13T10:34:37.369 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.364+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.364+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=336722201}) 2024-09-13T10:34:37.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=562151820}) 2024-09-13T10:34:37.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=336722201}) 2024-09-13T10:34:37.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1351208360}) 2024-09-13T10:34:37.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=336722201}) 2024-09-13T10:34:37.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=552604459}) 2024-09-13T10:34:37.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=336722201}) 2024-09-13T10:34:37.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3251169589}) 2024-09-13T10:34:37.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=336722201}) 2024-09-13T10:34:37.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.365+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2533427488}) 2024-09-13T10:34:37.378 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.378 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1417644533}) 2024-09-13T10:34:37.378 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1005134790}) 2024-09-13T10:34:37.378 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1417644533}) 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1972810481}) 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1417644533}) 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4134728507}) 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1417644533}) 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1109571895}) 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1417644533}) 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=683511915}) 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.379 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1417644533}) 2024-09-13T10:34:37.380 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1079258809}) 2024-09-13T10:34:37.380 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.380 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1417644533}) 2024-09-13T10:34:37.380 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1746529832}) 2024-09-13T10:34:37.380 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.380 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1417644533}) 2024-09-13T10:34:37.380 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4263476720}) 2024-09-13T10:34:37.639 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.639 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1442971380}) 2024-09-13T10:34:37.639 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=616936419}) 2024-09-13T10:34:37.639 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.639 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1442971380}) 2024-09-13T10:34:37.639 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2554920213}) 2024-09-13T10:34:37.639 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.639 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1442971380}) 2024-09-13T10:34:37.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1185893844}) 2024-09-13T10:34:37.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1442971380}) 2024-09-13T10:34:37.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1937202631}) 2024-09-13T10:34:37.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1442971380}) 2024-09-13T10:34:37.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3939959426}) 2024-09-13T10:34:37.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1442971380}) 2024-09-13T10:34:37.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1864704361}) 2024-09-13T10:34:37.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1442971380}) 2024-09-13T10:34:37.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1682109398}) 2024-09-13T10:34:37.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1442971380}) 2024-09-13T10:34:37.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3221871681}) 2024-09-13T10:34:37.657 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.657 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2880363716}) 2024-09-13T10:34:37.657 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=110565359}) 2024-09-13T10:34:37.657 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.658 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2880363716}) 2024-09-13T10:34:37.658 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=759343042}) 2024-09-13T10:34:37.658 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.658 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2880363716}) 2024-09-13T10:34:37.658 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=156244244}) 2024-09-13T10:34:37.658 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.658 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2880363716}) 2024-09-13T10:34:37.658 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3575835459}) 2024-09-13T10:34:37.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2880363716}) 2024-09-13T10:34:37.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1616508389}) 2024-09-13T10:34:37.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2880363716}) 2024-09-13T10:34:37.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=745527130}) 2024-09-13T10:34:37.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2880363716}) 2024-09-13T10:34:37.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4172027320}) 2024-09-13T10:34:37.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2880363716}) 2024-09-13T10:34:37.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3636570664}) 2024-09-13T10:34:37.856 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.856 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=940203702}) 2024-09-13T10:34:37.856 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343369391}) 2024-09-13T10:34:37.856 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.856 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=940203702}) 2024-09-13T10:34:37.856 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4067317068}) 2024-09-13T10:34:37.856 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.856 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=940203702}) 2024-09-13T10:34:37.856 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1617345258}) 2024-09-13T10:34:37.856 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.856 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=940203702}) 2024-09-13T10:34:37.856 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3583832325}) 2024-09-13T10:34:37.857 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.857 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=940203702}) 2024-09-13T10:34:37.857 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=476303446}) 2024-09-13T10:34:37.857 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.857 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=940203702}) 2024-09-13T10:34:37.857 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=201281278}) 2024-09-13T10:34:37.857 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.857 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=940203702}) 2024-09-13T10:34:37.857 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1259450281}) 2024-09-13T10:34:37.857 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.857 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=940203702}) 2024-09-13T10:34:37.858 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.852+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2160689569}) 2024-09-13T10:34:37.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1597349370}) 2024-09-13T10:34:37.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3634097185}) 2024-09-13T10:34:37.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1597349370}) 2024-09-13T10:34:37.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=432572798}) 2024-09-13T10:34:37.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1597349370}) 2024-09-13T10:34:37.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2591495564}) 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1597349370}) 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3686969558}) 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1597349370}) 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3800723264}) 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1597349370}) 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1792199620}) 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1597349370}) 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3360013879}) 2024-09-13T10:34:37.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1597349370}) 2024-09-13T10:34:37.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.956+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1484155324}) 2024-09-13T10:34:37.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1041602546}) 2024-09-13T10:34:37.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1669990715}) 2024-09-13T10:34:37.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1041602546}) 2024-09-13T10:34:37.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3536929993}) 2024-09-13T10:34:37.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1041602546}) 2024-09-13T10:34:37.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1161925991}) 2024-09-13T10:34:37.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1041602546}) 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=965957149}) 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1041602546}) 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2430220561}) 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1041602546}) 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2264371971}) 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1041602546}) 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2595785190}) 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:37.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1041602546}) 2024-09-13T10:34:37.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:37.975+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1948866984}) 2024-09-13T10:34:38.133 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:34:38.133 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:34:38.224 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.224 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1710173001}) 2024-09-13T10:34:38.224 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=693053931}) 2024-09-13T10:34:38.224 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.224 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1710173001}) 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3436719168}) 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1710173001}) 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3683504458}) 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1710173001}) 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=782139034}) 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1710173001}) 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1898192528}) 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1710173001}) 2024-09-13T10:34:38.225 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2757857380}) 2024-09-13T10:34:38.226 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.226 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1710173001}) 2024-09-13T10:34:38.226 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2523092584}) 2024-09-13T10:34:38.226 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.226 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1710173001}) 2024-09-13T10:34:38.226 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.221+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3703776378}) 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.228+0000 7ff04a517640 10 monclient: get_monmap_and_config 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.228+0000 7ff04a517640 10 monclient: build_initial_monmap 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.228+0000 7ff04a517640 10 monclient: monmap: 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:38.230364+0000 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:38.230364+0000 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:38.231 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:38.232 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:38.232 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:38.232 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:38.232 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:38.232 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:38.232 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.229+0000 7ff04a517640 1 Processor -- start 2024-09-13T10:34:38.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.229+0000 7ff04a517640 1 -- start start 2024-09-13T10:34:38.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.229+0000 7ff04a517640 10 monclient: init 2024-09-13T10:34:38.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff04a517640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:38.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff04a517640 10 monclient: _add_conns ranks=[8,1,0,4,2,5,6,3,7] 2024-09-13T10:34:38.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff04a517640 10 monclient(hunting): picked mon.noname-e con 0x7ff0440a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:38.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff04a517640 10 monclient(hunting): picked mon.noname-f con 0x7ff0440a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:38.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff04a517640 10 monclient(hunting): picked mon.noname-a con 0x7ff04413f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:38.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff04a517640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0440a5fe0 con 0x7ff04413f9a0 2024-09-13T10:34:38.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff04a517640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0440a8080 con 0x7ff0440a6ab0 2024-09-13T10:34:38.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff04a517640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0440a42c0 con 0x7ff0440a66d0 2024-09-13T10:34:38.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff04a517640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:38.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff04a517640 10 monclient(hunting): authenticate will time out at 1017.736193s 2024-09-13T10:34:38.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff043fff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7ff0440a66d0 0x7ff0440a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50490/0 (socket says 172.21.15.181:50490) 2024-09-13T10:34:38.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff048ab4640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff04413f9a0 0x7ff044141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35910/0 (socket says 172.21.15.181:35910) 2024-09-13T10:34:38.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.230+0000 7ff043fff640 1 -- 172.21.15.181:0/2768885441 learned_addr learned my addr 172.21.15.181:0/2768885441 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:38.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff043fff640 1 -- 172.21.15.181:0/2768885441 >> v1:172.21.15.181:6793/0 conn(0x7ff0440a66d0 legacy=0x7ff0440a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff048ab4640 1 -- 172.21.15.181:0/2768885441 >> v1:172.21.15.181:6789/0 conn(0x7ff04413f9a0 legacy=0x7ff044141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff03bfff640 1 -- 172.21.15.181:0/2768885441 >> v1:172.21.15.195:6789/0 conn(0x7ff0440a6ab0 legacy=0x7ff0440a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2995903695 0 0) 0x7ff0440a5fe0 con 0x7ff04413f9a0 2024-09-13T10:34:38.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff0437fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff0437fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff0437fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff0437fe640 10 monclient(hunting): my global_id is 55584 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff030003520 con 0x7ff04413f9a0 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550228433 0 0) 0x7ff0440a42c0 con 0x7ff0440a66d0 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff0437fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff0437fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff0437fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff0437fe640 10 monclient(hunting): my global_id is 84518 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.232+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0440a5fe0 con 0x7ff0440a66d0 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 852316111 0 0) 0x7ff0440a8080 con 0x7ff0440a6ab0 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient(hunting): my global_id is 55909 2024-09-13T10:34:38.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0440a42c0 con 0x7ff0440a6ab0 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2170014108 0 0) 0x7ff030003520 con 0x7ff04413f9a0 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 >> v1:172.21.15.181:6793/0 conn(0x7ff0440a66d0 legacy=0x7ff0440a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 >> v1:172.21.15.195:6789/0 conn(0x7ff0440a6ab0 legacy=0x7ff0440a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient: _finish_hunting 0 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 1 monclient: found mon.noname-a 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0441464e0 con 0x7ff04413f9a0 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient: _finish_auth 0 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient: _check_auth_tickets 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff04a517640 5 monclient: authenticate success, global_id 55584 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff04a517640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:38.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff03c001d80 con 0x7ff04413f9a0 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient: dump: 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.241 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff04a517640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff03c002050 con 0x7ff04413f9a0 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 1 -- 172.21.15.181:0/2768885441 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff03c004ea0 con 0x7ff04413f9a0 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff04a517640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff04a517640 4 set_mon_vals no callback set 2024-09-13T10:34:38.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff0437fe640 10 monclient: dump: 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.243 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff04a517640 10 monclient: shutdown 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff04a517640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff04a517640 1 -- 172.21.15.181:0/2768885441 >> v1:172.21.15.181:6789/0 conn(0x7ff04413f9a0 legacy=0x7ff044141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff04a517640 1 -- 172.21.15.181:0/2768885441 shutdown_connections 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff04a517640 1 -- 172.21.15.181:0/2768885441 >> 172.21.15.181:0/2768885441 conn(0x7ff0440abcd0 msgr2=0x7ff0440ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff04a517640 1 -- 172.21.15.181:0/2768885441 shutdown_connections 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.233+0000 7ff04a517640 1 -- 172.21.15.181:0/2768885441 wait complete. 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.234+0000 7ff04a517640 10 monclient: build_initial_monmap 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.234+0000 7ff04a517640 10 monclient: monmap: 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:38.244 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:38.245 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.234+0000 7ff04a517640 1 Processor -- start 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.234+0000 7ff04a517640 1 -- start start 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.234+0000 7ff04a517640 10 monclient: init 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.235+0000 7ff04a517640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.235+0000 7ff04a517640 10 monclient: _add_conns ranks=[0,1,3,4,8,5,6,2,7] 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.235+0000 7ff04a517640 10 monclient(hunting): picked mon.noname-a con 0x7ff0440a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.235+0000 7ff04a517640 10 monclient(hunting): picked mon.noname-f con 0x7ff0440a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.235+0000 7ff04a517640 10 monclient(hunting): picked mon.noname-g con 0x7ff04413f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.235+0000 7ff04a517640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04413d630 con 0x7ff0440a66d0 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.235+0000 7ff04a517640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04413eff0 con 0x7ff0440a6ab0 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.235+0000 7ff04a517640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04413f2d0 con 0x7ff04413f9a0 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.235+0000 7ff04a517640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:38.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.235+0000 7ff04a517640 10 monclient(hunting): authenticate will time out at 1017.741303s 2024-09-13T10:34:38.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.235+0000 7ff043fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff0440a66d0 0x7ff0441ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35922/0 (socket says 172.21.15.181:35922) 2024-09-13T10:34:38.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.235+0000 7ff043fff640 1 -- 172.21.15.181:0/1076159245 learned_addr learned my addr 172.21.15.181:0/1076159245 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:38.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff043fff640 1 -- 172.21.15.181:0/1076159245 >> v1:172.21.15.181:6789/0 conn(0x7ff0440a66d0 legacy=0x7ff0441ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2313572977 0 0) 0x7ff04413d630 con 0x7ff0440a66d0 2024-09-13T10:34:38.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): my global_id is 55593 2024-09-13T10:34:38.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff024003520 con 0x7ff0440a66d0 2024-09-13T10:34:38.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff03bfff640 1 -- 172.21.15.181:0/1076159245 >> v1:172.21.15.195:6789/0 conn(0x7ff0440a6ab0 legacy=0x7ff0441d3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff048ab4640 1 -- 172.21.15.181:0/1076159245 >> v1:172.21.15.195:6790/0 conn(0x7ff04413f9a0 legacy=0x7ff0441d6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 27357869 0 0) 0x7ff024003520 con 0x7ff0440a66d0 2024-09-13T10:34:38.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff04413d630 con 0x7ff0440a66d0 2024-09-13T10:34:38.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff0340019f0 con 0x7ff0440a66d0 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): dump: 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 997279521 0 0) 0x7ff04413eff0 con 0x7ff0440a6ab0 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): my global_id is 55918 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff024003520 con 0x7ff0440a6ab0 2024-09-13T10:34:38.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2786612672 0 0) 0x7ff04413f2d0 con 0x7ff04413f9a0 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient(hunting): my global_id is 5799 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff04413eff0 con 0x7ff04413f9a0 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2793326477 0 0) 0x7ff04413d630 con 0x7ff0440a66d0 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 >> v1:172.21.15.195:6790/0 conn(0x7ff04413f9a0 legacy=0x7ff0441d6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 >> v1:172.21.15.195:6789/0 conn(0x7ff0440a6ab0 legacy=0x7ff0441d3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 10 monclient: _finish_hunting 0 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.237+0000 7ff0417fa640 1 monclient: found mon.a 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:38.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0440686a0 con 0x7ff0440a66d0 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 10 monclient: _finish_auth 0 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 10 monclient: _check_auth_tickets 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff04a517640 5 monclient: authenticate success, global_id 55593 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff04a517640 10 monclient: _renew_subs 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff04a517640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff04a517640 1 -- 172.21.15.181:0/1076159245 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff0441374e0 con 0x7ff0440a66d0 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff04a517640 10 monclient: _renew_subs 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff04a517640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff04a517640 1 -- 172.21.15.181:0/1076159245 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff0440a23c0 con 0x7ff0440a66d0 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff034004dd0 con 0x7ff0440a66d0 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff0340052c0 con 0x7ff0440a66d0 2024-09-13T10:34:38.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff042ffd640 4 set_mon_vals no callback set 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 10 monclient: dump: 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.255 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff04a517640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff034005560 con 0x7ff0440a66d0 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff04a517640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff04a517640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.238+0000 7ff04a517640 1 -- 172.21.15.181:0/1076159245 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff028005080 con 0x7ff0440a66d0 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.239+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(149..149 src has 1..149) ==== 3898+0+0 (unknown 830733005 0 0) 0x7ff03404e430 con 0x7ff0440a66d0 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.239+0000 7ff03bfff640 10 monclient: get_auth_request con 0x7ff02403fc90 auth_method 0 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.243+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7ff034017920 con 0x7ff0440a66d0 2024-09-13T10:34:38.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.243+0000 7ff0417fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:38.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.243+0000 7ff0417fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:38.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.483+0000 7ff04a517640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:34:38.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.483+0000 7ff04a517640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:34:38.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.483+0000 7ff04a517640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:34:38.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.483+0000 7ff04a517640 1 -- 172.21.15.181:0/1076159245 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff028005370 con 0x7ff0440a66d0 2024-09-13T10:34:38.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.484+0000 7ff0417fa640 1 -- 172.21.15.181:0/1076159245 <== mon.0 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 2697614579) 0x7ff034017220 con 0x7ff0440a66d0 2024-09-13T10:34:38.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.484+0000 7ff0417fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:34:38.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.484+0000 7ff0417fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:38.487 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":84,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":3,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:34:38.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.486+0000 7ff04a517640 1 -- 172.21.15.181:0/1076159245 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff02403fc90 legacy=0x7ff024042150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.486+0000 7ff04a517640 10 monclient: shutdown 2024-09-13T10:34:38.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.486+0000 7ff04a517640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:38.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.486+0000 7ff04a517640 1 -- 172.21.15.181:0/1076159245 >> v1:172.21.15.181:6789/0 conn(0x7ff0440a66d0 legacy=0x7ff0441ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.486+0000 7ff04a517640 1 -- 172.21.15.181:0/1076159245 shutdown_connections 2024-09-13T10:34:38.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.486+0000 7ff04a517640 1 -- 172.21.15.181:0/1076159245 >> 172.21.15.181:0/1076159245 conn(0x7ff0440abcd0 msgr2=0x7ff0440a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:38.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.486+0000 7ff04a517640 1 -- 172.21.15.181:0/1076159245 shutdown_connections 2024-09-13T10:34:38.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.486+0000 7ff04a517640 1 -- 172.21.15.181:0/1076159245 wait complete. 2024-09-13T10:34:38.499 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:34:38.499 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T10:34:38.499 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:34:38.500 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:34:38.531 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.531 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3777880411}) 2024-09-13T10:34:38.531 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3381956446}) 2024-09-13T10:34:38.531 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.531 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3777880411}) 2024-09-13T10:34:38.532 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3619148506}) 2024-09-13T10:34:38.532 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.532 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3777880411}) 2024-09-13T10:34:38.533 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=585831161}) 2024-09-13T10:34:38.533 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.533 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3777880411}) 2024-09-13T10:34:38.533 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2669963657}) 2024-09-13T10:34:38.533 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.533 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3777880411}) 2024-09-13T10:34:38.533 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=186722527}) 2024-09-13T10:34:38.533 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.534 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3777880411}) 2024-09-13T10:34:38.534 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=704163425}) 2024-09-13T10:34:38.534 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.534 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3777880411}) 2024-09-13T10:34:38.534 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=235805365}) 2024-09-13T10:34:38.534 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.534 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3777880411}) 2024-09-13T10:34:38.535 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.515+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1755092402}) 2024-09-13T10:34:38.535 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.535 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3697161336}) 2024-09-13T10:34:38.535 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1158631080}) 2024-09-13T10:34:38.535 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.535 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3697161336}) 2024-09-13T10:34:38.535 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=558073013}) 2024-09-13T10:34:38.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3697161336}) 2024-09-13T10:34:38.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2395590193}) 2024-09-13T10:34:38.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3697161336}) 2024-09-13T10:34:38.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=614965749}) 2024-09-13T10:34:38.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3697161336}) 2024-09-13T10:34:38.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1520429905}) 2024-09-13T10:34:38.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3697161336}) 2024-09-13T10:34:38.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1538296683}) 2024-09-13T10:34:38.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3697161336}) 2024-09-13T10:34:38.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3002086555}) 2024-09-13T10:34:38.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.516+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.517+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3697161336}) 2024-09-13T10:34:38.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.517+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1646093330}) 2024-09-13T10:34:38.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3416738424}) 2024-09-13T10:34:38.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2124421836}) 2024-09-13T10:34:38.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3416738424}) 2024-09-13T10:34:38.539 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=38200934}) 2024-09-13T10:34:38.539 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.539 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3416738424}) 2024-09-13T10:34:38.539 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4071884477}) 2024-09-13T10:34:38.539 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.539 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3416738424}) 2024-09-13T10:34:38.540 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=466016703}) 2024-09-13T10:34:38.540 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.540 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3416738424}) 2024-09-13T10:34:38.540 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3289891755}) 2024-09-13T10:34:38.540 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.540 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3416738424}) 2024-09-13T10:34:38.540 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1261120232}) 2024-09-13T10:34:38.541 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.541 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3416738424}) 2024-09-13T10:34:38.541 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1407543524}) 2024-09-13T10:34:38.541 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.541 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3416738424}) 2024-09-13T10:34:38.541 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.518+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1810854919}) 2024-09-13T10:34:38.542 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.542 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=958581956}) 2024-09-13T10:34:38.542 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1981669918}) 2024-09-13T10:34:38.542 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.542 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=958581956}) 2024-09-13T10:34:38.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2698801948}) 2024-09-13T10:34:38.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=958581956}) 2024-09-13T10:34:38.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1647787443}) 2024-09-13T10:34:38.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=958581956}) 2024-09-13T10:34:38.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2842648832}) 2024-09-13T10:34:38.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=958581956}) 2024-09-13T10:34:38.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2080111183}) 2024-09-13T10:34:38.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=958581956}) 2024-09-13T10:34:38.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1987092421}) 2024-09-13T10:34:38.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=958581956}) 2024-09-13T10:34:38.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1163589402}) 2024-09-13T10:34:38.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.546 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=958581956}) 2024-09-13T10:34:38.546 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.519+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1116483363}) 2024-09-13T10:34:38.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.596+0000 7f778cbc3640 10 monclient: get_monmap_and_config 2024-09-13T10:34:38.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.596+0000 7f778cbc3640 10 monclient: build_initial_monmap 2024-09-13T10:34:38.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.596+0000 7f778cbc3640 10 monclient: monmap: 2024-09-13T10:34:38.599 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:38.599 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.599 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:38.598146+0000 2024-09-13T10:34:38.599 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:38.598146+0000 2024-09-13T10:34:38.599 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:38.599 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.599 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:38.600 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:38.600 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:38.600 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:38.600 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:38.600 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:38.600 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:38.600 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:38.600 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:38.600 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 1 Processor -- start 2024-09-13T10:34:38.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 1 -- start start 2024-09-13T10:34:38.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 10 monclient: init 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 10 monclient: _add_conns ranks=[1,4,6,3,0,2,8,5,7] 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 10 monclient(hunting): picked mon.noname-f con 0x7f77880a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 10 monclient(hunting): picked mon.noname-c con 0x7f77880a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 10 monclient(hunting): picked mon.noname-d con 0x7f778813f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77880a4bc0 con 0x7f77880a6640 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f778813a320 con 0x7f77880a8340 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77880a8100 con 0x7f778813f750 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f778cbc3640 10 monclient(hunting): authenticate will time out at 1018.103797s 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f7785d9b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f77880a8340 0x7f7788139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58654/0 (socket says 172.21.15.181:58654) 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f7786d9d640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f778813f750 0x7f7788141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47394/0 (socket says 172.21.15.181:47394) 2024-09-13T10:34:38.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.597+0000 7f7785d9b640 1 -- 172.21.15.181:0/2108643507 learned_addr learned my addr 172.21.15.181:0/2108643507 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:38.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f7786d9d640 1 -- 172.21.15.181:0/2108643507 >> v1:172.21.15.181:6792/0 conn(0x7f778813f750 legacy=0x7f7788141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f7785d9b640 1 -- 172.21.15.181:0/2108643507 >> v1:172.21.15.181:6791/0 conn(0x7f77880a8340 legacy=0x7f7788139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 1 -- 172.21.15.181:0/2108643507 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 469851505 0 0) 0x7f77880a8100 con 0x7f778813f750 2024-09-13T10:34:38.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient(hunting): my global_id is 5748 2024-09-13T10:34:38.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 1 -- 172.21.15.181:0/2108643507 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7770003520 con 0x7f778813f750 2024-09-13T10:34:38.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 1 -- 172.21.15.181:0/2108643507 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229119944 0 0) 0x7f778813a320 con 0x7f77880a8340 2024-09-13T10:34:38.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient(hunting): my global_id is 5872 2024-09-13T10:34:38.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 1 -- 172.21.15.181:0/2108643507 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77880a8100 con 0x7f77880a8340 2024-09-13T10:34:38.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778659c640 1 -- 172.21.15.181:0/2108643507 >> v1:172.21.15.195:6789/0 conn(0x7f77880a6640 legacy=0x7f7788139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 1 -- 172.21.15.181:0/2108643507 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3154020465 0 0) 0x7f7770003520 con 0x7f778813f750 2024-09-13T10:34:38.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 1 -- 172.21.15.181:0/2108643507 >> v1:172.21.15.181:6791/0 conn(0x7f77880a8340 legacy=0x7f7788139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 1 -- 172.21.15.181:0/2108643507 >> v1:172.21.15.195:6789/0 conn(0x7f77880a6640 legacy=0x7f7788139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient: _finish_hunting 0 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 1 monclient: found mon.noname-d 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 1 -- 172.21.15.181:0/2108643507 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77880a48e0 con 0x7f778813f750 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient: _finish_auth 0 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient: _check_auth_tickets 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778cbc3640 5 monclient: authenticate success, global_id 5748 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 1 -- 172.21.15.181:0/2108643507 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7780001e60 con 0x7f778813f750 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778cbc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:38.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient: dump: 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.609 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778cbc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 1 -- 172.21.15.181:0/2108643507 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7780004b60 con 0x7f778813f750 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 1 -- 172.21.15.181:0/2108643507 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f77800050d0 con 0x7f778813f750 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778cbc3640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778cbc3640 4 set_mon_vals no callback set 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.600+0000 7f778559a640 10 monclient: dump: 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.610 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.611 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.612 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.601+0000 7f778cbc3640 10 monclient: shutdown 2024-09-13T10:34:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.601+0000 7f778cbc3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.601+0000 7f778cbc3640 1 -- 172.21.15.181:0/2108643507 >> v1:172.21.15.181:6792/0 conn(0x7f778813f750 legacy=0x7f7788141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.601+0000 7f778cbc3640 1 -- 172.21.15.181:0/2108643507 shutdown_connections 2024-09-13T10:34:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.601+0000 7f778cbc3640 1 -- 172.21.15.181:0/2108643507 >> 172.21.15.181:0/2108643507 conn(0x7f7788077170 msgr2=0x7f77880abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.601+0000 7f778cbc3640 1 -- 172.21.15.181:0/2108643507 shutdown_connections 2024-09-13T10:34:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.601+0000 7f778cbc3640 1 -- 172.21.15.181:0/2108643507 wait complete. 2024-09-13T10:34:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.601+0000 7f778cbc3640 10 monclient: build_initial_monmap 2024-09-13T10:34:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.601+0000 7f778cbc3640 10 monclient: monmap: 2024-09-13T10:34:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:38.612 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:38.613 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 1 Processor -- start 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 1 -- start start 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 10 monclient: init 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 10 monclient: _add_conns ranks=[4,2,8,1,3,6,5,7,0] 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 10 monclient(hunting): picked mon.noname-c con 0x7f77880a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 10 monclient(hunting): picked mon.noname-b con 0x7f778813f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 10 monclient(hunting): picked mon.noname-e con 0x7f77881d4310 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77880a11b0 con 0x7f778813f750 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7788142ed0 con 0x7f77880a8340 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77880a0340 con 0x7f77881d4310 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778cbc3640 10 monclient(hunting): authenticate will time out at 1018.108834s 2024-09-13T10:34:38.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778659c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f77880a8340 0x7f778809d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58662/0 (socket says 172.21.15.181:58662) 2024-09-13T10:34:38.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.602+0000 7f778659c640 1 -- 172.21.15.181:0/2029686836 learned_addr learned my addr 172.21.15.181:0/2029686836 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f778659c640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.181:6791/0 conn(0x7f77880a8340 legacy=0x7f778809d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7786d9d640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.181:6793/0 conn(0x7f77881d4310 legacy=0x7f77881d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7785d9b640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.181:6790/0 conn(0x7f778813f750 legacy=0x7f778809dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 84132193 0 0) 0x7f7788142ed0 con 0x7f77880a8340 2024-09-13T10:34:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): my global_id is 5881 2024-09-13T10:34:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7768003550 con 0x7f77880a8340 2024-09-13T10:34:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1302058323 0 0) 0x7f77880a0340 con 0x7f77881d4310 2024-09-13T10:34:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): my global_id is 84527 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7788142ed0 con 0x7f77881d4310 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504705360 0 0) 0x7f77880a11b0 con 0x7f778813f750 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): my global_id is 94205 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77880a0340 con 0x7f778813f750 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3005455846 0 0) 0x7f7768003550 con 0x7f77880a8340 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77880a11b0 con 0x7f77880a8340 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7778003610 con 0x7f77880a8340 2024-09-13T10:34:38.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): dump: 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.621 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2654290107 0 0) 0x7f77880a0340 con 0x7f778813f750 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7768003550 con 0x7f778813f750 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3175146395 0 0) 0x7f7788142ed0 con 0x7f77881d4310 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77880a0340 con 0x7f77881d4310 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f777c001320 con 0x7f778813f750 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): dump: 2024-09-13T10:34:38.622 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.623 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f77800020b0 con 0x7f77881d4310 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient(hunting): dump: 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.624 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4004261168 0 0) 0x7f77880a11b0 con 0x7f77880a8340 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.181:6793/0 conn(0x7f77881d4310 legacy=0x7f77881d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.181:6790/0 conn(0x7f778813f750 legacy=0x7f778809dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 monclient: found mon.c 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:38.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778809ee50 con 0x7f77880a8340 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient: _finish_auth 0 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f778cbc3640 5 monclient: authenticate success, global_id 5881 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f778cbc3640 10 monclient: _renew_subs 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f778cbc3640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f778cbc3640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f778809e2c0 con 0x7f77880a8340 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f778cbc3640 10 monclient: _renew_subs 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f778cbc3640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f778cbc3640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f77880a2a10 con 0x7f77880a8340 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7778003b90 con 0x7f77880a8340 2024-09-13T10:34:38.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f77780040c0 con 0x7f77880a8340 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7784d99640 4 set_mon_vals no callback set 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.605+0000 7f7776ffd640 10 monclient: dump: 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.627 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.628 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.628 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.628 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.628 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.628 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.628 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.628 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.606+0000 7f778cbc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:38.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.606+0000 7f778cbc3640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f776c0065c0 con 0x7f776c002860 2024-09-13T10:34:38.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.606+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7778004260 con 0x7f77880a8340 2024-09-13T10:34:38.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.607+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(149..149 src has 1..149) ==== 3898+0+0 (unknown 830733005 0 0) 0x7f777804e440 con 0x7f77880a8340 2024-09-13T10:34:38.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.607+0000 7f7786d9d640 10 monclient: get_auth_request con 0x7f7768040930 auth_method 0 2024-09-13T10:34:38.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.608+0000 7f7785d9b640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.181:6789/0 conn(0x7f776c002860 legacy=0x7f776c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 500308110 0 0) 0x7f776c0065c0 con 0x7f776c002860 2024-09-13T10:34:38.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 10 monclient(hunting): my global_id is 55602 2024-09-13T10:34:38.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77880a11b0 con 0x7f776c002860 2024-09-13T10:34:38.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2109395320 0 0) 0x7f77880a11b0 con 0x7f776c002860 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f776c0065c0 con 0x7f776c002860 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f777c005190 con 0x7f776c002860 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 10 monclient: dump: 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.630 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.631 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.631 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.631 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.631 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.631 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.631 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.631 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.632 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 361827670 0 0) 0x7f776c0065c0 con 0x7f776c002860 2024-09-13T10:34:38.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f776c00a160 con 0x7f776c002860 2024-09-13T10:34:38.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f777c005350 con 0x7f776c002860 2024-09-13T10:34:38.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:38.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:38.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.181:6789/0 conn(0x7f776c002860 legacy=0x7f776c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.609+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.181:6789/0 conn(0x7f776c002860 legacy=0x7f776c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:38.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.615+0000 7f778cbc3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:38.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.615+0000 7f778cbc3640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f776c009e70 con 0x7f776c009130 2024-09-13T10:34:38.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7785d9b640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.181:6789/0 conn(0x7f776c009130 legacy=0x7f776c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402503918 0 0) 0x7f776c009e70 con 0x7f776c009130 2024-09-13T10:34:38.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 10 monclient(hunting): my global_id is 55611 2024-09-13T10:34:38.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f776c0065c0 con 0x7f776c009130 2024-09-13T10:34:38.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2011157080 0 0) 0x7f776c0065c0 con 0x7f776c009130 2024-09-13T10:34:38.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f776c009e70 con 0x7f776c009130 2024-09-13T10:34:38.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f777c005b40 con 0x7f776c009130 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 10 monclient: dump: 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.635 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1985975084 0 0) 0x7f776c009e70 con 0x7f776c009130 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.618+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f776c00c3f0 con 0x7f776c009130 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 3290758992) 0x7f777c008010 con 0x7f776c009130 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f7776ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f7776ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.181:6789/0 conn(0x7f776c009130 legacy=0x7f776c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f7776ffd640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.181:6789/0 conn(0x7f776c009130 legacy=0x7f776c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:38.637 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:38.637 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:38.637 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:38.637 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:38.637 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:38.637 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 293051, 2024-09-13T10:34:38.637 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:38.637 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:38.637 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:38.637 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:38.637 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:38.638 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:38.638 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:38.638 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:38.638 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:38.638 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:38.638 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.638 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:34:38.638 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:38.638 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:38.638 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:38.638 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:38.639 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.640 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:38.641 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:38.642 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.643 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:38.646 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.647 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.648 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.649 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.650 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:38.652 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.653 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.654 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.654 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:38.654 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.654 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.654 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.654 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:38.654 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:38.654 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.654 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:38.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.656 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:38.657 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:38.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f778cbc3640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7768040930 legacy=0x7f7768042df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f778cbc3640 10 monclient: shutdown 2024-09-13T10:34:38.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f778cbc3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:38.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f778cbc3640 1 -- 172.21.15.181:0/2029686836 >> v1:172.21.15.181:6791/0 conn(0x7f77880a8340 legacy=0x7f778809d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f7786d9d640 1 -- 172.21.15.181:0/2029686836 reap_dead start 2024-09-13T10:34:38.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f7786d9d640 1 -- 172.21.15.181:0/2029686836 reap_dead start 2024-09-13T10:34:38.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f778cbc3640 1 -- 172.21.15.181:0/2029686836 shutdown_connections 2024-09-13T10:34:38.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f778cbc3640 1 -- 172.21.15.181:0/2029686836 >> 172.21.15.181:0/2029686836 conn(0x7f77880a6640 msgr2=0x7f778813eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:38.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f778cbc3640 1 -- 172.21.15.181:0/2029686836 shutdown_connections 2024-09-13T10:34:38.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.619+0000 7f778cbc3640 1 -- 172.21.15.181:0/2029686836 wait complete. 2024-09-13T10:34:38.659 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:38.659 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:34:38.659 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:34:38.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.638+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2410345098}) 2024-09-13T10:34:38.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2210365417}) 2024-09-13T10:34:38.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2410345098}) 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2570112652}) 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2410345098}) 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3514022248}) 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2410345098}) 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2627495127}) 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2410345098}) 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=834672175}) 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2410345098}) 2024-09-13T10:34:38.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=734878162}) 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2410345098}) 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=925855828}) 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2410345098}) 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.639+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3095757173}) 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3328046865}) 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2458478704}) 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3328046865}) 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2833883145}) 2024-09-13T10:34:38.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3328046865}) 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3440160360}) 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3328046865}) 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=331121683}) 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3328046865}) 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.648+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4275223699}) 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.649+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.649+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3328046865}) 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.649+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=107358940}) 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.649+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.649+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3328046865}) 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.649+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2629275296}) 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.649+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.649+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3328046865}) 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.649+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2624343923}) 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3825791311}) 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2564811997}) 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3825791311}) 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3116179774}) 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3825791311}) 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1765076480}) 2024-09-13T10:34:38.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3825791311}) 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1943646234}) 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3825791311}) 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4055463677}) 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3825791311}) 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2090017455}) 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3825791311}) 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1666037567}) 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3825791311}) 2024-09-13T10:34:38.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.655+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1829006755}) 2024-09-13T10:34:38.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.764+0000 7f5749775640 10 monclient: get_monmap_and_config 2024-09-13T10:34:38.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.764+0000 7f5749775640 10 monclient: build_initial_monmap 2024-09-13T10:34:38.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.764+0000 7f5749775640 10 monclient: monmap: 2024-09-13T10:34:38.768 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:38.768 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.768 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:38.765729+0000 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:38.765729+0000 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:38.769 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.764+0000 7f5749775640 1 Processor -- start 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.764+0000 7f5749775640 1 -- start start 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.764+0000 7f5749775640 10 monclient: init 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f5749775640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f5749775640 10 monclient: _add_conns ranks=[8,3,2,6,7,5,4,0,1] 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f5749775640 10 monclient(hunting): picked mon.noname-e con 0x7f57440a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f5749775640 10 monclient(hunting): picked mon.noname-g con 0x7f57440a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f5749775640 10 monclient(hunting): picked mon.noname-b con 0x7f574413f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f5749775640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57440a5fe0 con 0x7f574413f9a0 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f5749775640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57440a8080 con 0x7f57440a6ab0 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f5749775640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57440a42c0 con 0x7f57440a66d0 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f5749775640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f5749775640 10 monclient(hunting): authenticate will time out at 1018.271281s 2024-09-13T10:34:38.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f5742ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f57440a66d0 0x7f57440a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50514/0 (socket says 172.21.15.181:50514) 2024-09-13T10:34:38.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f5742ffd640 1 -- 172.21.15.181:0/2119153016 learned_addr learned my addr 172.21.15.181:0/2119153016 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:38.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.765+0000 7f57437fe640 1 --1- 172.21.15.181:0/2119153016 >> v1:172.21.15.181:6790/0 conn(0x7f574413f9a0 0x7f5744141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:36658/0 (socket says 172.21.15.181:36658) 2024-09-13T10:34:38.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f57437fe640 1 -- 172.21.15.181:0/2119153016 >> v1:172.21.15.181:6790/0 conn(0x7f574413f9a0 legacy=0x7f5744141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5742ffd640 1 -- 172.21.15.181:0/2119153016 >> v1:172.21.15.181:6793/0 conn(0x7f57440a66d0 legacy=0x7f57440a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f57427fc640 1 -- 172.21.15.181:0/2119153016 >> v1:172.21.15.195:6790/0 conn(0x7f57440a6ab0 legacy=0x7f57440a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706379183 0 0) 0x7f57440a42c0 con 0x7f57440a66d0 2024-09-13T10:34:38.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient(hunting): my global_id is 84536 2024-09-13T10:34:38.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f572c003520 con 0x7f57440a66d0 2024-09-13T10:34:38.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505590132 0 0) 0x7f57440a5fe0 con 0x7f574413f9a0 2024-09-13T10:34:38.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient(hunting): my global_id is 94214 2024-09-13T10:34:38.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57440a42c0 con 0x7f574413f9a0 2024-09-13T10:34:38.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 353263944 0 0) 0x7f57440a8080 con 0x7f57440a6ab0 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient(hunting): my global_id is 5808 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57440a5fe0 con 0x7f57440a6ab0 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3379197272 0 0) 0x7f572c003520 con 0x7f57440a66d0 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 >> v1:172.21.15.195:6790/0 conn(0x7f57440a6ab0 legacy=0x7f57440a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 >> v1:172.21.15.181:6790/0 conn(0x7f574413f9a0 legacy=0x7f5744141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 1 monclient: found mon.noname-e 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:34:38.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57441464e0 con 0x7f57440a66d0 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient: _finish_auth 0 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5734001ad0 con 0x7f57440a66d0 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5749775640 5 monclient: authenticate success, global_id 84536 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5749775640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.767+0000 7f5741ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5741ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5741ffb640 10 monclient: dump: 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.782 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5749775640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f57340048a0 con 0x7f57440a66d0 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5741ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5749775640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5741ffb640 1 -- 172.21.15.181:0/2119153016 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5734004dd0 con 0x7f57440a66d0 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5741ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5749775640 4 set_mon_vals no callback set 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5741ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5741ffb640 10 monclient: dump: 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.784 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5749775640 10 monclient: shutdown 2024-09-13T10:34:38.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5749775640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5749775640 1 -- 172.21.15.181:0/2119153016 >> v1:172.21.15.181:6793/0 conn(0x7f57440a66d0 legacy=0x7f57440a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5749775640 1 -- 172.21.15.181:0/2119153016 shutdown_connections 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5749775640 1 -- 172.21.15.181:0/2119153016 >> 172.21.15.181:0/2119153016 conn(0x7f57440abcd0 msgr2=0x7f57440ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5749775640 1 -- 172.21.15.181:0/2119153016 shutdown_connections 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.768+0000 7f5749775640 1 -- 172.21.15.181:0/2119153016 wait complete. 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.769+0000 7f5749775640 10 monclient: build_initial_monmap 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.769+0000 7f5749775640 10 monclient: monmap: 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:38.786 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:38.787 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:38.787 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:38.787 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:38.787 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:38.787 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:38.787 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:38.787 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:38.787 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:38.787 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:38.787 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.769+0000 7f5749775640 1 Processor -- start 2024-09-13T10:34:38.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.769+0000 7f5749775640 1 -- start start 2024-09-13T10:34:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.769+0000 7f5749775640 10 monclient: init 2024-09-13T10:34:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f5749775640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f5749775640 10 monclient: _add_conns ranks=[6,5,8,1,2,7,4,3,0] 2024-09-13T10:34:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f5749775640 10 monclient(hunting): picked mon.noname-d con 0x7f57440a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f5749775640 10 monclient(hunting): picked mon.noname-h con 0x7f57440a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f5749775640 10 monclient(hunting): picked mon.noname-e con 0x7f574413f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f5749775640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f574413d540 con 0x7f57440a6ab0 2024-09-13T10:34:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f5749775640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f574413ed80 con 0x7f57440a66d0 2024-09-13T10:34:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f5749775640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f574413f060 con 0x7f574413f9a0 2024-09-13T10:34:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f5749775640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f5749775640 10 monclient(hunting): authenticate will time out at 1018.276248s 2024-09-13T10:34:38.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f57437fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f574413f9a0 0x7f57441d6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50524/0 (socket says 172.21.15.181:50524) 2024-09-13T10:34:38.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f5742ffd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f57440a66d0 0x7f57440a21e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47396/0 (socket says 172.21.15.181:47396) 2024-09-13T10:34:38.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.770+0000 7f57437fe640 1 -- 172.21.15.181:0/265424388 learned_addr learned my addr 172.21.15.181:0/265424388 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:38.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f5742ffd640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.181:6792/0 conn(0x7f57440a66d0 legacy=0x7f57440a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f57437fe640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.181:6793/0 conn(0x7f574413f9a0 legacy=0x7f57441d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f57427fc640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.195:6791/0 conn(0x7f57440a6ab0 legacy=0x7f57441d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462222914 0 0) 0x7f574413ed80 con 0x7f57440a66d0 2024-09-13T10:34:38.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): my global_id is 5757 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5730003550 con 0x7f57440a66d0 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603727003 0 0) 0x7f574413f060 con 0x7f574413f9a0 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): my global_id is 84545 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f574413ed80 con 0x7f574413f9a0 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2486700102 0 0) 0x7f57440a5fe0 con 0x7f57440a6ab0 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): my global_id is 5783 2024-09-13T10:34:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f574413f060 con 0x7f57440a6ab0 2024-09-13T10:34:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2494661198 0 0) 0x7f5730003550 con 0x7f57440a66d0 2024-09-13T10:34:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57440a5fe0 con 0x7f57440a66d0 2024-09-13T10:34:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3170387214 0 0) 0x7f574413ed80 con 0x7f574413f9a0 2024-09-13T10:34:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5730003550 con 0x7f574413f9a0 2024-09-13T10:34:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5734004d90 con 0x7f57440a66d0 2024-09-13T10:34:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): dump: 2024-09-13T10:34:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.791 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.792 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.792 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.792 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.792 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.792 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.792 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.792 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.792 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.792 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.793 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f573c004b60 con 0x7f574413f9a0 2024-09-13T10:34:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 10 monclient(hunting): dump: 2024-09-13T10:34:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.793 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.794 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.794 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.794 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.794 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.794 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.794 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.794 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.794 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.794 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.794 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.795 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.795 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.795 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.795 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.772+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1310607069 0 0) 0x7f574413f060 con 0x7f57440a6ab0 2024-09-13T10:34:38.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f574413ed80 con 0x7f57440a6ab0 2024-09-13T10:34:38.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5738003610 con 0x7f57440a6ab0 2024-09-13T10:34:38.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:38.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:34:38.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 10 monclient(hunting): dump: 2024-09-13T10:34:38.795 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.796 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.797 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 148447235 0 0) 0x7f57440a5fe0 con 0x7f57440a66d0 2024-09-13T10:34:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.181:6793/0 conn(0x7f574413f9a0 legacy=0x7f57441d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.195:6791/0 conn(0x7f57440a6ab0 legacy=0x7f57441d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:34:38.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 1 monclient: found mon.d 2024-09-13T10:34:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574413f340 con 0x7f57440a66d0 2024-09-13T10:34:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:34:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:34:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f5749775640 5 monclient: authenticate success, global_id 5757 2024-09-13T10:34:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f5749775640 10 monclient: _renew_subs 2024-09-13T10:34:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f5749775640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f5749775640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f57441374e0 con 0x7f57440a66d0 2024-09-13T10:34:38.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f5749775640 10 monclient: _renew_subs 2024-09-13T10:34:38.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f5749775640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:38.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f5749775640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f574413de20 con 0x7f57440a66d0 2024-09-13T10:34:38.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f57340048a0 con 0x7f57440a66d0 2024-09-13T10:34:38.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:38.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5734001d20 con 0x7f57440a66d0 2024-09-13T10:34:38.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f57417fa640 4 set_mon_vals no callback set 2024-09-13T10:34:38.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:38.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f572b7fe640 10 monclient: dump: 2024-09-13T10:34:38.799 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.800 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.800 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.800 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.800 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.800 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.800 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.800 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.800 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.800 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.800 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.800 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.801 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.801 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.801 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.801 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f5749775640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:38.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.773+0000 7f5749775640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f57240065c0 con 0x7f5724002860 2024-09-13T10:34:38.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.774+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5734011be0 con 0x7f57440a66d0 2024-09-13T10:34:38.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.774+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(150..150 src has 1..150) ==== 3898+0+0 (unknown 258890366 0 0) 0x7f573404e300 con 0x7f57440a66d0 2024-09-13T10:34:38.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.774+0000 7f57437fe640 10 monclient: get_auth_request con 0x7f5730040480 auth_method 0 2024-09-13T10:34:38.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f57427fc640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.181:6790/0 conn(0x7f5724002860 legacy=0x7f5724004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408013251 0 0) 0x7f57240065c0 con 0x7f5724002860 2024-09-13T10:34:38.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 10 monclient(hunting): my global_id is 94223 2024-09-13T10:34:38.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57440a5fe0 con 0x7f5724002860 2024-09-13T10:34:38.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1349011532 0 0) 0x7f57440a5fe0 con 0x7f5724002860 2024-09-13T10:34:38.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57240065c0 con 0x7f5724002860 2024-09-13T10:34:38.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5738003e50 con 0x7f5724002860 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 10 monclient: dump: 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.803 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.804 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.804 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.804 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.804 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 564392380 0 0) 0x7f57240065c0 con 0x7f5724002860 2024-09-13T10:34:38.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f572400a160 con 0x7f5724002860 2024-09-13T10:34:38.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f57380040d0 con 0x7f5724002860 2024-09-13T10:34:38.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:38.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:38.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.181:6790/0 conn(0x7f5724002860 legacy=0x7f5724004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.776+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.181:6790/0 conn(0x7f5724002860 legacy=0x7f5724004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:38.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.782+0000 7f5749775640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:38.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.782+0000 7f5749775640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5724009e50 con 0x7f5724009110 2024-09-13T10:34:38.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f57427fc640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.181:6790/0 conn(0x7f5724009110 legacy=0x7f57240095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3262444461 0 0) 0x7f5724009e50 con 0x7f5724009110 2024-09-13T10:34:38.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 10 monclient(hunting): my global_id is 94232 2024-09-13T10:34:38.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57240065c0 con 0x7f5724009110 2024-09-13T10:34:38.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3752657438 0 0) 0x7f57240065c0 con 0x7f5724009110 2024-09-13T10:34:38.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5724009e50 con 0x7f5724009110 2024-09-13T10:34:38.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5738005b00 con 0x7f5724009110 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 10 monclient: dump: 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.807 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 147493556 0 0) 0x7f5724009e50 con 0x7f5724009110 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f572400c3a0 con 0x7f5724009110 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 3915336324) 0x7f5738007d90 con 0x7f5724009110 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.181:6790/0 conn(0x7f5724009110 legacy=0x7f57240095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.785+0000 7f572b7fe640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.181:6790/0 conn(0x7f5724009110 legacy=0x7f57240095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:38.809 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:38.809 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:38.809 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:38.809 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:38.809 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:38.809 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 18810, 2024-09-13T10:34:38.809 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:38.809 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:38.809 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:38.809 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:38.809 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:38.810 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:38.811 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:38.812 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:38.813 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.814 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:38.815 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:38.816 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.816 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.816 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.816 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:38.816 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:38.816 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.816 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:38.817 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.817 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:38.817 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:38.817 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.817 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.817 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.817 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.818 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.820 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.821 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:38.822 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.823 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.824 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:38.824 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:38.824 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.824 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.824 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:38.825 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:38.826 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.826 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.826 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.826 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:38.826 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:38.826 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.826 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.826 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.826 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:38.827 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.827 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.827 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.827 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:38.827 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:38.827 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.827 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.827 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.827 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.828 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.828 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:38.828 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:38.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.828 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:38.828 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:38.828 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:38.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.828 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.828 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:38.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.829 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:38.829 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:38.829 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:38.829 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.829 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.829 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:38.829 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:38.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.786+0000 7f5749775640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5730040480 legacy=0x7f5730042940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.786+0000 7f5749775640 10 monclient: shutdown 2024-09-13T10:34:38.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.786+0000 7f5749775640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:38.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.786+0000 7f5749775640 1 -- 172.21.15.181:0/265424388 >> v1:172.21.15.181:6792/0 conn(0x7f57440a66d0 legacy=0x7f57440a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.786+0000 7f57437fe640 1 -- 172.21.15.181:0/265424388 reap_dead start 2024-09-13T10:34:38.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.786+0000 7f57437fe640 1 -- 172.21.15.181:0/265424388 reap_dead start 2024-09-13T10:34:38.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.786+0000 7f5749775640 1 -- 172.21.15.181:0/265424388 shutdown_connections 2024-09-13T10:34:38.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.786+0000 7f5749775640 1 -- 172.21.15.181:0/265424388 >> 172.21.15.181:0/265424388 conn(0x7f57440abcd0 msgr2=0x7f5744138cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:38.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.786+0000 7f5749775640 1 -- 172.21.15.181:0/265424388 shutdown_connections 2024-09-13T10:34:38.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.786+0000 7f5749775640 1 -- 172.21.15.181:0/265424388 wait complete. 2024-09-13T10:34:38.832 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:38.832 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:34:38.833 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:34:38.902 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.903 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3779649320}) 2024-09-13T10:34:38.903 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1065297723}) 2024-09-13T10:34:38.903 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.903 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3779649320}) 2024-09-13T10:34:38.903 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2322229299}) 2024-09-13T10:34:38.903 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.903 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3779649320}) 2024-09-13T10:34:38.903 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=602909275}) 2024-09-13T10:34:38.903 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.904 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3779649320}) 2024-09-13T10:34:38.904 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3487374411}) 2024-09-13T10:34:38.904 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.904 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3779649320}) 2024-09-13T10:34:38.904 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1258272692}) 2024-09-13T10:34:38.904 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.904 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3779649320}) 2024-09-13T10:34:38.904 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1246655385}) 2024-09-13T10:34:38.904 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.904 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3779649320}) 2024-09-13T10:34:38.904 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3596295861}) 2024-09-13T10:34:38.905 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:38.905 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3779649320}) 2024-09-13T10:34:38.905 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=926535378}) 2024-09-13T10:34:38.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.937+0000 7f03bfecd640 10 monclient: get_monmap_and_config 2024-09-13T10:34:38.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.937+0000 7f03bfecd640 10 monclient: build_initial_monmap 2024-09-13T10:34:38.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.937+0000 7f03bfecd640 10 monclient: monmap: 2024-09-13T10:34:38.940 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:38.940 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.940 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:38.939416+0000 2024-09-13T10:34:38.940 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:38.939416+0000 2024-09-13T10:34:38.940 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:38.941 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.941 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:38.941 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:38.941 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:38.941 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:38.941 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:38.941 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:38.941 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:38.941 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:38.941 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:38.941 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.938+0000 7f03bfecd640 1 Processor -- start 2024-09-13T10:34:38.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.938+0000 7f03bfecd640 1 -- start start 2024-09-13T10:34:38.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.938+0000 7f03bfecd640 10 monclient: init 2024-09-13T10:34:38.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.939+0000 7f03bfecd640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:38.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.939+0000 7f03bfecd640 10 monclient: _add_conns ranks=[8,7,3,0,2,4,6,5,1] 2024-09-13T10:34:38.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.939+0000 7f03bfecd640 10 monclient(hunting): picked mon.noname-e con 0x7f03b80a19f0 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:38.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.939+0000 7f03bfecd640 10 monclient(hunting): picked mon.noname-i con 0x7f03b80a1dd0 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:38.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.939+0000 7f03bfecd640 10 monclient(hunting): picked mon.noname-g con 0x7f03b80a21f0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:38.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.939+0000 7f03bfecd640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b806d800 con 0x7f03b80a21f0 2024-09-13T10:34:38.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.939+0000 7f03bfecd640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b809e610 con 0x7f03b80a1dd0 2024-09-13T10:34:38.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.939+0000 7f03bfecd640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b809e8f0 con 0x7f03b80a19f0 2024-09-13T10:34:38.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.939+0000 7f03bfecd640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:38.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.939+0000 7f03bfecd640 10 monclient(hunting): authenticate will time out at 1018.445300s 2024-09-13T10:34:38.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.939+0000 7f03bdc69640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f03b80a19f0 0x7f03b8136220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50528/0 (socket says 172.21.15.181:50528) 2024-09-13T10:34:38.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.939+0000 7f03bdc69640 1 -- 172.21.15.181:0/1628195203 learned_addr learned my addr 172.21.15.181:0/1628195203 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:38.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bdc69640 1 -- 172.21.15.181:0/1628195203 >> v1:172.21.15.181:6793/0 conn(0x7f03b80a19f0 legacy=0x7f03b8136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03be46a640 1 -- 172.21.15.181:0/1628195203 >> v1:172.21.15.195:6790/0 conn(0x7f03b80a21f0 legacy=0x7f03b813e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bd468640 1 -- 172.21.15.181:0/1628195203 >> v1:172.21.15.195:6792/0 conn(0x7f03b80a1dd0 legacy=0x7f03b813b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970120773 0 0) 0x7f03b809e8f0 con 0x7f03b80a19f0 2024-09-13T10:34:38.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 10 monclient(hunting): my global_id is 84554 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03a4003520 con 0x7f03b80a19f0 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752227337 0 0) 0x7f03b806d800 con 0x7f03b80a21f0 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 10 monclient(hunting): my global_id is 5817 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b809e8f0 con 0x7f03b80a21f0 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475298999 0 0) 0x7f03b809e610 con 0x7f03b80a1dd0 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 10 monclient(hunting): my global_id is 55897 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.941+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b806d800 con 0x7f03b80a1dd0 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2348597412 0 0) 0x7f03a4003520 con 0x7f03b80a19f0 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 >> v1:172.21.15.195:6792/0 conn(0x7f03b80a1dd0 legacy=0x7f03b813b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03be46a640 1 --1- 172.21.15.181:0/1628195203 >> v1:172.21.15.195:6790/0 conn(0x7f03b80a21f0 0x7f03b813e7d0 :-1 s=OPENED pgs=385 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f03b809e8f0 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 >> v1:172.21.15.195:6790/0 conn(0x7f03b80a21f0 legacy=0x7f03b813e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 10 monclient: _finish_hunting 0 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 1 monclient: found mon.noname-e 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b809ebd0 con 0x7f03b80a19f0 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 10 monclient: _finish_auth 0 2024-09-13T10:34:38.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 10 monclient: _check_auth_tickets 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bfecd640 5 monclient: authenticate success, global_id 84554 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03b4001ae0 con 0x7f03b80a19f0 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 10 monclient: dump: 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.951 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bfecd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03b40048a0 con 0x7f03b80a19f0 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 1 -- 172.21.15.181:0/1628195203 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03b4004d90 con 0x7f03b80a19f0 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bfecd640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:38.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bfecd640 4 set_mon_vals no callback set 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bcc67640 10 monclient: dump: 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.953 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bfecd640 10 monclient: shutdown 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bfecd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.942+0000 7f03bfecd640 1 -- 172.21.15.181:0/1628195203 >> v1:172.21.15.181:6793/0 conn(0x7f03b80a19f0 legacy=0x7f03b8136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.943+0000 7f03bfecd640 1 -- 172.21.15.181:0/1628195203 shutdown_connections 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.943+0000 7f03bfecd640 1 -- 172.21.15.181:0/1628195203 >> 172.21.15.181:0/1628195203 conn(0x7f03b80a4bd0 msgr2=0x7f03b80a4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.943+0000 7f03bfecd640 1 -- 172.21.15.181:0/1628195203 shutdown_connections 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.943+0000 7f03bfecd640 1 -- 172.21.15.181:0/1628195203 wait complete. 2024-09-13T10:34:38.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.943+0000 7f03bfecd640 10 monclient: build_initial_monmap 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.943+0000 7f03bfecd640 10 monclient: monmap: 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:38.955 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 1 Processor -- start 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 1 -- start start 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 10 monclient: init 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 10 monclient: _add_conns ranks=[4,6,7,5,2,0,1,8,3] 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 10 monclient(hunting): picked mon.noname-c con 0x7f03b80a19f0 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 10 monclient(hunting): picked mon.noname-d con 0x7f03b80a1dd0 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 10 monclient(hunting): picked mon.noname-i con 0x7f03b80a21f0 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b8123d90 con 0x7f03b80a19f0 2024-09-13T10:34:38.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b8123950 con 0x7f03b80a1dd0 2024-09-13T10:34:38.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b8133690 con 0x7f03b80a21f0 2024-09-13T10:34:38.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:38.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bfecd640 10 monclient(hunting): authenticate will time out at 1018.450696s 2024-09-13T10:34:38.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bdc69640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f03b80a19f0 0x7f03b8122b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58672/0 (socket says 172.21.15.181:58672) 2024-09-13T10:34:38.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.944+0000 7f03bdc69640 1 -- 172.21.15.181:0/3449330919 learned_addr learned my addr 172.21.15.181:0/3449330919 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:38.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.946+0000 7f03bdc69640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.181:6791/0 conn(0x7f03b80a19f0 legacy=0x7f03b8122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.946+0000 7f03bd468640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.181:6792/0 conn(0x7f03b80a1dd0 legacy=0x7f03b8123240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03be46a640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.195:6792/0 conn(0x7f03b80a21f0 legacy=0x7f03b81d6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161159303 0 0) 0x7f03b8123950 con 0x7f03b80a1dd0 2024-09-13T10:34:38.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): my global_id is 5766 2024-09-13T10:34:38.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f039c003520 con 0x7f03b80a1dd0 2024-09-13T10:34:38.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128741511 0 0) 0x7f03b8123d90 con 0x7f03b80a19f0 2024-09-13T10:34:38.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): my global_id is 5890 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b8123950 con 0x7f03b80a19f0 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1042233935 0 0) 0x7f03b8133690 con 0x7f03b80a21f0 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): my global_id is 55906 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b8123d90 con 0x7f03b80a21f0 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 920455414 0 0) 0x7f039c003520 con 0x7f03b80a1dd0 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03b8133690 con 0x7f03b80a1dd0 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03a8003610 con 0x7f03b80a1dd0 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:38.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): dump: 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.963 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2684382949 0 0) 0x7f03b8123950 con 0x7f03b80a19f0 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f039c003520 con 0x7f03b80a19f0 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03b4004d90 con 0x7f03b80a19f0 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): dump: 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.964 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1939427079 0 0) 0x7f03b8123d90 con 0x7f03b80a21f0 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03b8123950 con 0x7f03b80a21f0 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03b0003cd0 con 0x7f03b80a21f0 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient(hunting): dump: 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.966 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1598606952 0 0) 0x7f03b8133690 con 0x7f03b80a1dd0 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.195:6792/0 conn(0x7f03b80a21f0 legacy=0x7f03b81d6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.181:6791/0 conn(0x7f03b80a19f0 legacy=0x7f03b8122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 monclient: found mon.d 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:38.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:38.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b81248f0 con 0x7f03b80a1dd0 2024-09-13T10:34:38.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient: _finish_auth 0 2024-09-13T10:34:38.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:34:38.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:38.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03bfecd640 5 monclient: authenticate success, global_id 5766 2024-09-13T10:34:38.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03bfecd640 10 monclient: _renew_subs 2024-09-13T10:34:38.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03bfecd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:38.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03bfecd640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f03b8125850 con 0x7f03b80a1dd0 2024-09-13T10:34:38.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03bfecd640 10 monclient: _renew_subs 2024-09-13T10:34:38.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03bfecd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:38.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03bfecd640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f03b8074930 con 0x7f03b80a1dd0 2024-09-13T10:34:38.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03a8003a60 con 0x7f03b80a1dd0 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03a8003fd0 con 0x7f03b80a1dd0 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03affff640 4 set_mon_vals no callback set 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.947+0000 7f03ae7fc640 10 monclient: dump: 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.969 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.948+0000 7f03bfecd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.948+0000 7f03bfecd640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f03a00065c0 con 0x7f03a0002860 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.949+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f03a8004170 con 0x7f03b80a1dd0 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.949+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(150..150 src has 1..150) ==== 3898+0+0 (unknown 258890366 0 0) 0x7f03a804e260 con 0x7f03b80a1dd0 2024-09-13T10:34:38.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.949+0000 7f03be46a640 10 monclient: get_auth_request con 0x7f039c048c40 auth_method 0 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03bdc69640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.181:6791/0 conn(0x7f03a0002860 legacy=0x7f03a0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708769630 0 0) 0x7f03a00065c0 con 0x7f03a0002860 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 10 monclient(hunting): my global_id is 5899 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b8133690 con 0x7f03a0002860 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1121203156 0 0) 0x7f03b8133690 con 0x7f03a0002860 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03a00065c0 con 0x7f03a0002860 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03b4001a80 con 0x7f03a0002860 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 10 monclient: dump: 2024-09-13T10:34:38.971 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.972 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.973 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.973 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3682120351 0 0) 0x7f03a00065c0 con 0x7f03a0002860 2024-09-13T10:34:38.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03a000a160 con 0x7f03a0002860 2024-09-13T10:34:38.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f03b4005410 con 0x7f03a0002860 2024-09-13T10:34:38.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:38.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:38.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.181:6791/0 conn(0x7f03a0002860 legacy=0x7f03a0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.951+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.181:6791/0 conn(0x7f03a0002860 legacy=0x7f03a0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:38.974 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:38.974 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37814]: starting. 2024-09-13T10:34:38.974 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37814]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37777 2024-09-13T10:34:38.974 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37814]: created object 0... 2024-09-13T10:34:38.974 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37814]: created object 25... 2024-09-13T10:34:38.974 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37814]: created object 49... 2024-09-13T10:34:38.974 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37814]: finishing. 2024-09-13T10:34:38.974 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37814]: shutting down. 2024-09-13T10:34:38.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.959+0000 7f03bfecd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.959+0000 7f03bfecd640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f03a0009e70 con 0x7f03a0009130 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.961+0000 7f03bdc69640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.181:6791/0 conn(0x7f03a0009130 legacy=0x7f03a00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.961+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1774446513 0 0) 0x7f03a0009e70 con 0x7f03a0009130 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.961+0000 7f03ae7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.961+0000 7f03ae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.961+0000 7f03ae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.961+0000 7f03ae7fc640 10 monclient(hunting): my global_id is 5908 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.961+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03a00065c0 con 0x7f03a0009130 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 900860917 0 0) 0x7f03a00065c0 con 0x7f03a0009130 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03a0009e70 con 0x7f03a0009130 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03b4005b70 con 0x7f03a0009130 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:38.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 10 monclient: dump: 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:38.978 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:38.979 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:38.979 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:38.979 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:38.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2067970246 0 0) 0x7f03a0009e70 con 0x7f03a0009130 2024-09-13T10:34:38.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f03a000c410 con 0x7f03a0009130 2024-09-13T10:34:38.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 4222456566) 0x7f03b4007020 con 0x7f03a0009130 2024-09-13T10:34:38.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:38.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:38.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.181:6791/0 conn(0x7f03a0009130 legacy=0x7f03a00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:38.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03ae7fc640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.181:6791/0 conn(0x7f03a0009130 legacy=0x7f03a00095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:38.980 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:38.980 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:38.980 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:38.980 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:38.980 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:38.980 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 293412, 2024-09-13T10:34:38.980 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:38.980 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:38.980 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:38.980 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:38.980 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:38.980 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:38.981 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:38.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:38.983 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:38.984 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:38.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:38.988 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.989 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.991 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:38.992 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.993 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.995 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:38.996 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:38.997 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.998 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:38.999 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:39.001 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.001 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=348922271}) 2024-09-13T10:34:39.001 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1825650471}) 2024-09-13T10:34:39.001 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=348922271}) 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3128579880}) 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=348922271}) 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3149874652}) 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=348922271}) 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=51757519}) 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=348922271}) 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3271450862}) 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.002 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=348922271}) 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2055045210}) 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=348922271}) 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3258470386}) 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=348922271}) 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.970+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2530917029}) 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3354314885}) 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665455040}) 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3354314885}) 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=949898518}) 2024-09-13T10:34:39.003 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3354314885}) 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2791417280}) 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3354314885}) 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2187911042}) 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3354314885}) 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=420482904}) 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3354314885}) 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=24228127}) 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3354314885}) 2024-09-13T10:34:39.004 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3584812859}) 2024-09-13T10:34:39.005 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.005 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3354314885}) 2024-09-13T10:34:39.005 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:38.980+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3172106490}) 2024-09-13T10:34:39.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03bfecd640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.195:6800/1839191919 conn(0x7f039c048c40 legacy=0x7f039c04b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03bfecd640 10 monclient: shutdown 2024-09-13T10:34:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03bfecd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03bfecd640 1 -- 172.21.15.181:0/3449330919 >> v1:172.21.15.181:6792/0 conn(0x7f03b80a1dd0 legacy=0x7f03b8123240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.962+0000 7f03be46a640 1 -- 172.21.15.181:0/3449330919 reap_dead start 2024-09-13T10:34:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.963+0000 7f03be46a640 1 -- 172.21.15.181:0/3449330919 reap_dead start 2024-09-13T10:34:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.963+0000 7f03bfecd640 1 -- 172.21.15.181:0/3449330919 shutdown_connections 2024-09-13T10:34:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.963+0000 7f03bfecd640 1 -- 172.21.15.181:0/3449330919 >> 172.21.15.181:0/3449330919 conn(0x7f03b80a4bd0 msgr2=0x7f03b81bbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.963+0000 7f03bfecd640 1 -- 172.21.15.181:0/3449330919 shutdown_connections 2024-09-13T10:34:39.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:38.963+0000 7f03bfecd640 1 -- 172.21.15.181:0/3449330919 wait complete. 2024-09-13T10:34:39.007 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:39.007 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:34:39.007 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:34:39.009 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:39.009 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37816]: starting. 2024-09-13T10:34:39.009 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37816]: listing objects. 2024-09-13T10:34:39.009 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37816]: listed object 0... 2024-09-13T10:34:39.009 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37816]: listed object 25... 2024-09-13T10:34:39.009 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37816]: saw 50 objects 2024-09-13T10:34:39.009 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37816]: shutting down. 2024-09-13T10:34:39.050 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.050 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1406504459}) 2024-09-13T10:34:39.050 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3226418574}) 2024-09-13T10:34:39.050 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.050 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1406504459}) 2024-09-13T10:34:39.050 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4003820338}) 2024-09-13T10:34:39.050 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1406504459}) 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3131093236}) 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1406504459}) 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1462279224}) 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1406504459}) 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3720010308}) 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1406504459}) 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3274658703}) 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1406504459}) 2024-09-13T10:34:39.051 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4276294763}) 2024-09-13T10:34:39.052 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.052 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1406504459}) 2024-09-13T10:34:39.052 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.047+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4261474107}) 2024-09-13T10:34:39.072 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.072 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=758020895}) 2024-09-13T10:34:39.072 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3049127655}) 2024-09-13T10:34:39.072 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.072 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=758020895}) 2024-09-13T10:34:39.072 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1393192273}) 2024-09-13T10:34:39.072 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.072 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=758020895}) 2024-09-13T10:34:39.072 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=533095128}) 2024-09-13T10:34:39.072 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=758020895}) 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1598120790}) 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=758020895}) 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3620730838}) 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=758020895}) 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3803863470}) 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=758020895}) 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3462165611}) 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.073 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=758020895}) 2024-09-13T10:34:39.074 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.070+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3548696960}) 2024-09-13T10:34:39.079 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.079 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3158776825}) 2024-09-13T10:34:39.079 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3558434725}) 2024-09-13T10:34:39.079 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.079 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3158776825}) 2024-09-13T10:34:39.079 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1921631567}) 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3158776825}) 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2300402223}) 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3158776825}) 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4007184103}) 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3158776825}) 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=872405406}) 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3158776825}) 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=36724025}) 2024-09-13T10:34:39.080 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3158776825}) 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1153561913}) 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3158776825}) 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.071+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1584417140}) 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1058789846}) 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2896299708}) 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1058789846}) 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=712401240}) 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.081 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1058789846}) 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2825300615}) 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1058789846}) 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=97260484}) 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1058789846}) 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=671038570}) 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1058789846}) 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2656331221}) 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1058789846}) 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=213421459}) 2024-09-13T10:34:39.082 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1058789846}) 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.072+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2811638076}) 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1708090240}) 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1953068868}) 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1708090240}) 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2045106374}) 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1708090240}) 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2795662260}) 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1708090240}) 2024-09-13T10:34:39.083 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1902162519}) 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1708090240}) 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1125854172}) 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1708090240}) 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=536949126}) 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1708090240}) 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3540222648}) 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1708090240}) 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.073+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=104264977}) 2024-09-13T10:34:39.084 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=181517007}) 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1702185029}) 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=181517007}) 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3314809114}) 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=181517007}) 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=984830346}) 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=181517007}) 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=278673170}) 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=181517007}) 2024-09-13T10:34:39.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2131731488}) 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=181517007}) 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4206220692}) 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=181517007}) 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=647676543}) 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=181517007}) 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2317969019}) 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1804285818}) 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1570373326}) 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1804285818}) 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1079931474}) 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1804285818}) 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2096678319}) 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1804285818}) 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2623605003}) 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1804285818}) 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4007738241}) 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1804285818}) 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3745228216}) 2024-09-13T10:34:39.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.088 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1804285818}) 2024-09-13T10:34:39.088 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2794919631}) 2024-09-13T10:34:39.088 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.088 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.074+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1804285818}) 2024-09-13T10:34:39.088 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.075+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=395872222}) 2024-09-13T10:34:39.091 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.091 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=12,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=1,osdmap=38} crc {logm=3472986252,mdsmap=2874252694,mgr=4031651612,mgr_command_descs=3192186154,mgr_metadata=1537866486,mgrstat=1012629254,mon_config_key=1700880413,monmap=2763160955,nvmeofgw=598337686,osd_metadata=4151044668,osd_pg_creating=3622942885,osd_snap=3823785925,osdmap=480749649}) 2024-09-13T10:34:39.091 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=14,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=2,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=1687927349,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3357364708,mon_config_key=3559042346,monmap=2232244610,nvmeofgw=598337686,osd_metadata=3891265705,osd_pg_creating=3622942885,osd_snap=4133920409,osdmap=2844332791}) 2024-09-13T10:34:39.091 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=12,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=1,osdmap=38} crc {logm=3472986252,mdsmap=2874252694,mgr=4031651612,mgr_command_descs=3192186154,mgr_metadata=1537866486,mgrstat=1012629254,mon_config_key=1700880413,monmap=2763160955,nvmeofgw=598337686,osd_metadata=4151044668,osd_pg_creating=3622942885,osd_snap=3823785925,osdmap=480749649}) 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=14,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=32} crc {logm=1687927349,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=1448667722,mon_config_key=4256284388,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3622942885,osd_snap=4133920409,osdmap=2975986593}) 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=12,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=1,osdmap=38} crc {logm=3472986252,mdsmap=2874252694,mgr=4031651612,mgr_command_descs=3192186154,mgr_metadata=1537866486,mgrstat=1012629254,mon_config_key=1700880413,monmap=2763160955,nvmeofgw=598337686,osd_metadata=4151044668,osd_pg_creating=3622942885,osd_snap=3823785925,osdmap=480749649}) 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=11,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_snap=2,osdmap=38} crc {logm=270813820,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3357364708,mon_config_key=1505041641,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2008106561,osd_snap=4133920409,osdmap=255559295}) 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=12,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=1,osdmap=38} crc {logm=3472986252,mdsmap=2874252694,mgr=4031651612,mgr_command_descs=3192186154,mgr_metadata=1537866486,mgrstat=1012629254,mon_config_key=1700880413,monmap=2763160955,nvmeofgw=598337686,osd_metadata=4151044668,osd_pg_creating=3622942885,osd_snap=3823785925,osdmap=480749649}) 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=13,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=2,nvmeofgw=3,osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=38} crc {logm=1646213237,mdsmap=3985170090,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1410035963,mon_config_key=4000188779,monmap=2232244610,nvmeofgw=598337686,osd_metadata=3403280600,osd_pg_creating=3622942885,osd_snap=4133920409,osdmap=2424092172}) 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=12,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=1,osdmap=38} crc {logm=3472986252,mdsmap=2874252694,mgr=4031651612,mgr_command_descs=3192186154,mgr_metadata=1537866486,mgrstat=1012629254,mon_config_key=1700880413,monmap=2763160955,nvmeofgw=598337686,osd_metadata=4151044668,osd_pg_creating=3622942885,osd_snap=3823785925,osdmap=480749649}) 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=12,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=35} crc {logm=54483022,mdsmap=3140514009,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1448667722,mon_config_key=805668223,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=2159323046,osd_pg_creating=3622942885,osd_snap=4133920409,osdmap=788066030}) 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=12,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=1,osdmap=38} crc {logm=3472986252,mdsmap=2874252694,mgr=4031651612,mgr_command_descs=3192186154,mgr_metadata=1537866486,mgrstat=1012629254,mon_config_key=1700880413,monmap=2763160955,nvmeofgw=598337686,osd_metadata=4151044668,osd_pg_creating=3622942885,osd_snap=3823785925,osdmap=480749649}) 2024-09-13T10:34:39.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=14,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=33} crc {logm=1687927349,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1410035963,mon_config_key=4256284388,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2008106561,osd_pg_creating=3622942885,osd_snap=4133920409,osdmap=2218353600}) 2024-09-13T10:34:39.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=12,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=1,osdmap=38} crc {logm=3472986252,mdsmap=2874252694,mgr=4031651612,mgr_command_descs=3192186154,mgr_metadata=1537866486,mgrstat=1012629254,mon_config_key=1700880413,monmap=2763160955,nvmeofgw=598337686,osd_metadata=4151044668,osd_pg_creating=3622942885,osd_snap=3823785925,osdmap=480749649}) 2024-09-13T10:34:39.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=14,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=31} crc {logm=1687927349,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1448667722,mon_config_key=4256284388,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3622942885,osd_snap=4133920409,osdmap=3265408478}) 2024-09-13T10:34:39.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=12,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=1,osdmap=38} crc {logm=3472986252,mdsmap=2874252694,mgr=4031651612,mgr_command_descs=3192186154,mgr_metadata=1537866486,mgrstat=1012629254,mon_config_key=1700880413,monmap=2763160955,nvmeofgw=598337686,osd_metadata=4151044668,osd_pg_creating=3622942885,osd_snap=3823785925,osdmap=480749649}) 2024-09-13T10:34:39.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.087+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=12,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=2,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=37} crc {logm=1349126448,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=1448667722,mon_config_key=1382017330,monmap=2232244610,nvmeofgw=1596038039,osd_metadata=2159323046,osd_pg_creating=3622942885,osd_snap=4133920409,osdmap=3212208379}) 2024-09-13T10:34:39.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2286419127}) 2024-09-13T10:34:39.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1643063365}) 2024-09-13T10:34:39.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2286419127}) 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=194740298}) 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2286419127}) 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3925502012}) 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2286419127}) 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=837394723}) 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2286419127}) 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=4017630393}) 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.088+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2286419127}) 2024-09-13T10:34:39.094 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.089+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=2395120302}) 2024-09-13T10:34:39.095 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.089+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.095 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.089+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2286419127}) 2024-09-13T10:34:39.095 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.089+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1604127187}) 2024-09-13T10:34:39.095 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.089+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.095 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.089+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2286419127}) 2024-09-13T10:34:39.095 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.089+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=1832665685}) 2024-09-13T10:34:39.108 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.108 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=95} crc {osdmap=719341980}) 2024-09-13T10:34:39.108 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=93} crc {osdmap=2301135253}) 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=95} crc {osdmap=719341980}) 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=91} crc {osdmap=1347289926}) 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=95} crc {osdmap=719341980}) 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=94} crc {osdmap=3152051787}) 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=95} crc {osdmap=719341980}) 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=98} crc {osdmap=3802882561}) 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=95} crc {osdmap=719341980}) 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=94} crc {osdmap=588636784}) 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.109 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=95} crc {osdmap=719341980}) 2024-09-13T10:34:39.110 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=96} crc {osdmap=2549411059}) 2024-09-13T10:34:39.110 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.110 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=95} crc {osdmap=719341980}) 2024-09-13T10:34:39.110 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=95} crc {osdmap=2762681194}) 2024-09-13T10:34:39.110 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:34:39.110 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=95} crc {osdmap=719341980}) 2024-09-13T10:34:39.110 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:34:39.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=92} crc {osdmap=4150422563}) 2024-09-13T10:34:39.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.107+0000 7f8a2b1cd640 10 monclient: get_monmap_and_config 2024-09-13T10:34:39.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.107+0000 7f8a2b1cd640 10 monclient: build_initial_monmap 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.107+0000 7f8a2b1cd640 10 monclient: monmap: 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:39.109323+0000 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:39.109323+0000 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:39.112 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 1 Processor -- start 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 1 -- start start 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 10 monclient: init 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 10 monclient: _add_conns ranks=[7,6,8,5,4,2,1,3,0] 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 10 monclient(hunting): picked mon.noname-i con 0x7f8a240a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 10 monclient(hunting): picked mon.noname-d con 0x7f8a240a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 10 monclient(hunting): picked mon.noname-e con 0x7f8a2413f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a240a4bc0 con 0x7f8a240a8340 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a2413a320 con 0x7f8a240a6640 2024-09-13T10:34:39.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a240a8100 con 0x7f8a2413f750 2024-09-13T10:34:39.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:39.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.108+0000 7f8a2b1cd640 10 monclient(hunting): authenticate will time out at 1018.614966s 2024-09-13T10:34:39.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.109+0000 7f8a2976a640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f8a2413f750 0x7f8a24141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50530/0 (socket says 172.21.15.181:50530) 2024-09-13T10:34:39.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.109+0000 7f8a2976a640 1 -- 172.21.15.181:0/2090308341 learned_addr learned my addr 172.21.15.181:0/2090308341 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:39.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a2976a640 1 -- 172.21.15.181:0/2090308341 >> v1:172.21.15.181:6793/0 conn(0x7f8a2413f750 legacy=0x7f8a24141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a23fff640 1 -- 172.21.15.181:0/2090308341 >> v1:172.21.15.181:6792/0 conn(0x7f8a240a8340 legacy=0x7f8a24139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a28f69640 1 -- 172.21.15.181:0/2090308341 >> v1:172.21.15.195:6792/0 conn(0x7f8a240a6640 legacy=0x7f8a24139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1868285274 0 0) 0x7f8a240a8100 con 0x7f8a2413f750 2024-09-13T10:34:39.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient(hunting): my global_id is 84563 2024-09-13T10:34:39.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a14003520 con 0x7f8a2413f750 2024-09-13T10:34:39.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782173234 0 0) 0x7f8a240a4bc0 con 0x7f8a240a8340 2024-09-13T10:34:39.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient(hunting): my global_id is 5775 2024-09-13T10:34:39.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a240a8100 con 0x7f8a240a8340 2024-09-13T10:34:39.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2293013450 0 0) 0x7f8a2413a320 con 0x7f8a240a6640 2024-09-13T10:34:39.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient(hunting): my global_id is 55915 2024-09-13T10:34:39.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a240a4bc0 con 0x7f8a240a6640 2024-09-13T10:34:39.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3144241776 0 0) 0x7f8a240a8100 con 0x7f8a240a8340 2024-09-13T10:34:39.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 >> v1:172.21.15.181:6793/0 conn(0x7f8a2413f750 legacy=0x7f8a24141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 >> v1:172.21.15.195:6792/0 conn(0x7f8a240a6640 legacy=0x7f8a24139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient: _finish_hunting 0 2024-09-13T10:34:39.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 monclient: found mon.noname-d 2024-09-13T10:34:39.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a240a48e0 con 0x7f8a240a8340 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient: _finish_auth 0 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient: _check_auth_tickets 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8a10001b10 con 0x7f8a240a8340 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient: dump: 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.121 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a2b1cd640 5 monclient: authenticate success, global_id 5775 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a2b1cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:39.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8a10003610 con 0x7f8a240a8340 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 1 -- 172.21.15.181:0/2090308341 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8a10003b80 con 0x7f8a240a8340 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a2b1cd640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a2b1cd640 4 set_mon_vals no callback set 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.111+0000 7f8a237fe640 10 monclient: dump: 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.123 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.112+0000 7f8a2b1cd640 10 monclient: shutdown 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.112+0000 7f8a2b1cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.112+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2090308341 >> v1:172.21.15.181:6792/0 conn(0x7f8a240a8340 legacy=0x7f8a24139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.112+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2090308341 shutdown_connections 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.112+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2090308341 >> 172.21.15.181:0/2090308341 conn(0x7f8a24077170 msgr2=0x7f8a240abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.112+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2090308341 shutdown_connections 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.112+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2090308341 wait complete. 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.112+0000 7f8a2b1cd640 10 monclient: build_initial_monmap 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.112+0000 7f8a2b1cd640 10 monclient: monmap: 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:39.125 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 1 Processor -- start 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 1 -- start start 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 10 monclient: init 2024-09-13T10:34:39.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:39.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 10 monclient: _add_conns ranks=[3,4,6,1,0,7,2,8,5] 2024-09-13T10:34:39.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 10 monclient(hunting): picked mon.noname-g con 0x7f8a240a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:39.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 10 monclient(hunting): picked mon.noname-c con 0x7f8a2413f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:39.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 10 monclient(hunting): picked mon.noname-d con 0x7f8a2413c970 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:39.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a240a9f40 con 0x7f8a240a8340 2024-09-13T10:34:39.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a241cf0f0 con 0x7f8a2413f750 2024-09-13T10:34:39.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a24142fd0 con 0x7f8a2413c970 2024-09-13T10:34:39.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:39.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2b1cd640 10 monclient(hunting): authenticate will time out at 1018.619818s 2024-09-13T10:34:39.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a23fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f8a2413f750 0x7f8a241ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58704/0 (socket says 172.21.15.181:58704) 2024-09-13T10:34:39.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a23fff640 1 -- 172.21.15.181:0/2526754699 learned_addr learned my addr 172.21.15.181:0/2526754699 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:39.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.113+0000 7f8a2976a640 1 --1- 172.21.15.181:0/2526754699 >> v1:172.21.15.181:6792/0 conn(0x7f8a2413c970 0x7f8a241d6530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47430/0 (socket says 172.21.15.181:47430) 2024-09-13T10:34:39.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a2976a640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.181:6792/0 conn(0x7f8a2413c970 legacy=0x7f8a241d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a23fff640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.181:6791/0 conn(0x7f8a2413f750 legacy=0x7f8a241ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711640470 0 0) 0x7f8a24142fd0 con 0x7f8a2413c970 2024-09-13T10:34:39.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): my global_id is 5784 2024-09-13T10:34:39.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a08003550 con 0x7f8a2413c970 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3141455640 0 0) 0x7f8a241cf0f0 con 0x7f8a2413f750 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): my global_id is 5917 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a24142fd0 con 0x7f8a2413f750 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a28f69640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.195:6790/0 conn(0x7f8a240a8340 legacy=0x7f8a241ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 972397057 0 0) 0x7f8a240a4bc0 con 0x7f8a240a8340 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): my global_id is 5826 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a241cf0f0 con 0x7f8a240a8340 2024-09-13T10:34:39.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2610057965 0 0) 0x7f8a08003550 con 0x7f8a2413c970 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a240a4bc0 con 0x7f8a2413c970 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1618896512 0 0) 0x7f8a24142fd0 con 0x7f8a2413f750 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a08003550 con 0x7f8a2413f750 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8a1c0020b0 con 0x7f8a2413c970 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): dump: 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.135 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8a10003b00 con 0x7f8a2413f750 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:39.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient(hunting): dump: 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.137 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 651629903 0 0) 0x7f8a241cf0f0 con 0x7f8a240a8340 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a24142fd0 con 0x7f8a240a8340 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 478443331 0 0) 0x7f8a240a4bc0 con 0x7f8a2413c970 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.181:6791/0 conn(0x7f8a2413f750 legacy=0x7f8a241ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.195:6790/0 conn(0x7f8a240a8340 legacy=0x7f8a241ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient: _finish_hunting 0 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 monclient: found mon.d 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2413e040 con 0x7f8a2413c970 2024-09-13T10:34:39.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient: _finish_auth 0 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient: _check_auth_tickets 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a2b1cd640 5 monclient: authenticate success, global_id 5784 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a2b1cd640 10 monclient: _renew_subs 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a2b1cd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2413d3d0 con 0x7f8a2413c970 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a2b1cd640 10 monclient: _renew_subs 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a2b1cd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f8a2413e710 con 0x7f8a2413c970 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8a1c004f40 con 0x7f8a2413c970 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8a1c0054b0 con 0x7f8a2413c970 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a22ffd640 4 set_mon_vals no callback set 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.116+0000 7f8a217fa640 10 monclient: dump: 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.140 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.117+0000 7f8a2b1cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.117+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8a040065c0 con 0x7f8a04002860 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.117+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f8a1c005650 con 0x7f8a2413c970 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.117+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(150..150 src has 1..150) ==== 3898+0+0 (unknown 258890366 0 0) 0x7f8a1c04e490 con 0x7f8a2413c970 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.118+0000 7f8a23fff640 10 monclient: get_auth_request con 0x7f8a080404f0 auth_method 0 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.119+0000 7f8a28f69640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.181:6792/0 conn(0x7f8a04002860 legacy=0x7f8a04004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.119+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 170111272 0 0) 0x7f8a040065c0 con 0x7f8a04002860 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.119+0000 7f8a217fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.119+0000 7f8a217fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.119+0000 7f8a217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.119+0000 7f8a217fa640 10 monclient(hunting): my global_id is 5793 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.119+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a240a4bc0 con 0x7f8a04002860 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2994515538 0 0) 0x7f8a240a4bc0 con 0x7f8a04002860 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a040065c0 con 0x7f8a04002860 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8a18003d60 con 0x7f8a04002860 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 10 monclient: dump: 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.142 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2295507873 0 0) 0x7f8a040065c0 con 0x7f8a04002860 2024-09-13T10:34:39.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a0400a160 con 0x7f8a04002860 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8a18004050 con 0x7f8a04002860 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.181:6792/0 conn(0x7f8a04002860 legacy=0x7f8a04004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.120+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.181:6792/0 conn(0x7f8a04002860 legacy=0x7f8a04004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.126+0000 7f8a2b1cd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.126+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8a04009e50 con 0x7f8a04009110 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.128+0000 7f8a28f69640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.181:6792/0 conn(0x7f8a04009110 legacy=0x7f8a040095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837456699 0 0) 0x7f8a04009e50 con 0x7f8a04009110 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 10 monclient(hunting): my global_id is 5802 2024-09-13T10:34:39.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a040065c0 con 0x7f8a04009110 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1517801453 0 0) 0x7f8a040065c0 con 0x7f8a04009110 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a04009e50 con 0x7f8a04009110 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8a18005b00 con 0x7f8a04009110 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 10 monclient: dump: 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.145 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2351104122 0 0) 0x7f8a04009e50 con 0x7f8a04009110 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8a0400c3f0 con 0x7f8a04009110 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 2164131645) 0x7f8a18007d90 con 0x7f8a04009110 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:39.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:39.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.181:6792/0 conn(0x7f8a04009110 legacy=0x7f8a040095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.129+0000 7f8a217fa640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.181:6792/0 conn(0x7f8a04009110 legacy=0x7f8a040095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.147 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 293573, 2024-09-13T10:34:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:39.147 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:39.148 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.149 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:39.151 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.152 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.153 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:39.154 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.155 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.157 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:39.158 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.159 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.161 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:39.162 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.163 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.164 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.165 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:39.166 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:39.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.130+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.195:6800/1839191919 conn(0x7f8a080404f0 legacy=0x7f8a080429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.130+0000 7f8a2b1cd640 10 monclient: shutdown 2024-09-13T10:34:39.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.130+0000 7f8a2b1cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.130+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2526754699 >> v1:172.21.15.181:6792/0 conn(0x7f8a2413c970 legacy=0x7f8a241d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.130+0000 7f8a2976a640 1 -- 172.21.15.181:0/2526754699 reap_dead start 2024-09-13T10:34:39.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.130+0000 7f8a2976a640 1 -- 172.21.15.181:0/2526754699 reap_dead start 2024-09-13T10:34:39.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.130+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2526754699 shutdown_connections 2024-09-13T10:34:39.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.130+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2526754699 >> 172.21.15.181:0/2526754699 conn(0x7f8a240a6640 msgr2=0x7f8a240a6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.130+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2526754699 shutdown_connections 2024-09-13T10:34:39.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.130+0000 7f8a2b1cd640 1 -- 172.21.15.181:0/2526754699 wait complete. 2024-09-13T10:34:39.169 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:39.169 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:34:39.169 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:34:39.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.265+0000 7fa4ce794640 10 monclient: get_monmap_and_config 2024-09-13T10:34:39.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.265+0000 7fa4ce794640 10 monclient: build_initial_monmap 2024-09-13T10:34:39.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.265+0000 7fa4ce794640 10 monclient: monmap: 2024-09-13T10:34:39.268 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:39.268 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.268 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:39.266746+0000 2024-09-13T10:34:39.268 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:39.266746+0000 2024-09-13T10:34:39.268 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:39.268 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.268 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:39.268 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:39.269 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:39.269 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:39.269 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:39.269 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:39.269 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:39.269 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:39.269 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:39.269 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.265+0000 7fa4ce794640 1 Processor -- start 2024-09-13T10:34:39.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.265+0000 7fa4ce794640 1 -- start start 2024-09-13T10:34:39.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.265+0000 7fa4ce794640 10 monclient: init 2024-09-13T10:34:39.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4ce794640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:39.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4ce794640 10 monclient: _add_conns ranks=[5,7,3,8,0,6,1,4,2] 2024-09-13T10:34:39.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4ce794640 10 monclient(hunting): picked mon.noname-h con 0x7fa4c80a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:39.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4ce794640 10 monclient(hunting): picked mon.noname-i con 0x7fa4c80a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:39.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4ce794640 10 monclient(hunting): picked mon.noname-g con 0x7fa4c813f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:39.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4ce794640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c80a5fe0 con 0x7fa4c813f9a0 2024-09-13T10:34:39.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4ce794640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c80a8080 con 0x7fa4c80a66d0 2024-09-13T10:34:39.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4ce794640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c80a42c0 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4ce794640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:39.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4ce794640 10 monclient(hunting): authenticate will time out at 1018.772449s 2024-09-13T10:34:39.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4c77fe640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7fa4c80a6ab0 0x7fa4c80a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:50210/0 (socket says 172.21.15.181:50210) 2024-09-13T10:34:39.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4c77fe640 1 -- 172.21.15.181:0/189391641 learned_addr learned my addr 172.21.15.181:0/189391641 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:39.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.266+0000 7fa4c7fff640 1 --1- 172.21.15.181:0/189391641 >> v1:172.21.15.195:6791/0 conn(0x7fa4c80a66d0 0x7fa4c80a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:38748/0 (socket says 172.21.15.181:38748) 2024-09-13T10:34:39.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c77fe640 1 -- 172.21.15.181:0/189391641 >> v1:172.21.15.195:6792/0 conn(0x7fa4c80a6ab0 legacy=0x7fa4c80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4ccd31640 1 -- 172.21.15.181:0/189391641 >> v1:172.21.15.195:6790/0 conn(0x7fa4c813f9a0 legacy=0x7fa4c8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c7fff640 1 -- 172.21.15.181:0/189391641 >> v1:172.21.15.195:6791/0 conn(0x7fa4c80a66d0 legacy=0x7fa4c80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477061185 0 0) 0x7fa4c80a42c0 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c6ffd640 10 monclient(hunting): my global_id is 55924 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4b4003520 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4206181568 0 0) 0x7fa4c80a5fe0 con 0x7fa4c813f9a0 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.268+0000 7fa4c6ffd640 10 monclient(hunting): my global_id is 5835 2024-09-13T10:34:39.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c80a42c0 con 0x7fa4c813f9a0 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229929404 0 0) 0x7fa4c80a8080 con 0x7fa4c80a66d0 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient(hunting): my global_id is 5792 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c80a5fe0 con 0x7fa4c80a66d0 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2235445218 0 0) 0x7fa4b4003520 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 >> v1:172.21.15.195:6791/0 conn(0x7fa4c80a66d0 legacy=0x7fa4c80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 >> v1:172.21.15.195:6790/0 conn(0x7fa4c813f9a0 legacy=0x7fa4c8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 1 monclient: found mon.noname-i 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:34:39.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c81464e0 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4b0001b90 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient: dump: 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.279 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4ce794640 5 monclient: authenticate success, global_id 55924 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4ce794640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:39.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4b00048a0 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 1 -- 172.21.15.181:0/189391641 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4b0004dd0 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4ce794640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4ce794640 4 set_mon_vals no callback set 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4c6ffd640 10 monclient: dump: 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.281 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4ce794640 10 monclient: shutdown 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4ce794640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4ce794640 1 -- 172.21.15.181:0/189391641 >> v1:172.21.15.195:6792/0 conn(0x7fa4c80a6ab0 legacy=0x7fa4c80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4ce794640 1 -- 172.21.15.181:0/189391641 shutdown_connections 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4ce794640 1 -- 172.21.15.181:0/189391641 >> 172.21.15.181:0/189391641 conn(0x7fa4c80abcd0 msgr2=0x7fa4c80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4ce794640 1 -- 172.21.15.181:0/189391641 shutdown_connections 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.269+0000 7fa4ce794640 1 -- 172.21.15.181:0/189391641 wait complete. 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.270+0000 7fa4ce794640 10 monclient: build_initial_monmap 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.270+0000 7fa4ce794640 10 monclient: monmap: 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:39.283 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.270+0000 7fa4ce794640 1 Processor -- start 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.270+0000 7fa4ce794640 1 -- start start 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.270+0000 7fa4ce794640 10 monclient: init 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.271+0000 7fa4ce794640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.271+0000 7fa4ce794640 10 monclient: _add_conns ranks=[7,5,1,0,6,2,3,4,8] 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.271+0000 7fa4ce794640 10 monclient(hunting): picked mon.noname-i con 0x7fa4c80a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:39.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.271+0000 7fa4ce794640 10 monclient(hunting): picked mon.noname-h con 0x7fa4c80a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:39.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.271+0000 7fa4ce794640 10 monclient(hunting): picked mon.noname-f con 0x7fa4c813f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:39.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.271+0000 7fa4ce794640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c813f0e0 con 0x7fa4c813f9a0 2024-09-13T10:34:39.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.271+0000 7fa4ce794640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c8142d70 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.271+0000 7fa4ce794640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c8143100 con 0x7fa4c80a66d0 2024-09-13T10:34:39.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.271+0000 7fa4ce794640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:39.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.271+0000 7fa4ce794640 10 monclient(hunting): authenticate will time out at 1018.777375s 2024-09-13T10:34:39.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.271+0000 7fa4c7fff640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7fa4c80a66d0 0x7fa4c813b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:50214/0 (socket says 172.21.15.181:50214) 2024-09-13T10:34:39.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.271+0000 7fa4c7fff640 1 -- 172.21.15.181:0/827251789 learned_addr learned my addr 172.21.15.181:0/827251789 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:39.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4ccd31640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.195:6789/0 conn(0x7fa4c813f9a0 legacy=0x7fa4c81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c7fff640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.195:6792/0 conn(0x7fa4c80a66d0 legacy=0x7fa4c813b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c77fe640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.195:6791/0 conn(0x7fa4c80a6ab0 legacy=0x7fa4c813bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4ccd31640 1 --1- 172.21.15.181:0/827251789 >> v1:172.21.15.195:6789/0 conn(0x7fa4c813f9a0 0x7fa4c81d6440 :-1 s=OPENED pgs=368 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fa4c813f0e0 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:34:39.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279470511 0 0) 0x7fa4c8143100 con 0x7fa4c80a66d0 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c4ff9640 10 monclient(hunting): my global_id is 55933 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4a8003520 con 0x7fa4c80a66d0 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089683307 0 0) 0x7fa4c8142d70 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c4ff9640 10 monclient(hunting): my global_id is 5801 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.273+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c8143100 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1605949263 0 0) 0x7fa4c8143100 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4c8142d70 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4b0001b50 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient(hunting): dump: 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.292 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1109093169 0 0) 0x7fa4a8003520 con 0x7fa4c80a66d0 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4c8143100 con 0x7fa4c80a66d0 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4b80047e0 con 0x7fa4c80a66d0 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient(hunting): dump: 2024-09-13T10:34:39.293 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.294 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 408976981 0 0) 0x7fa4c8142d70 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.195:6792/0 conn(0x7fa4c80a66d0 legacy=0x7fa4c813b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.195:6789/0 conn(0x7fa4c813f9a0 legacy=0x7fa4c81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 monclient: found mon.h 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c813e540 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient: _finish_auth 0 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:39.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4ce794640 5 monclient: authenticate success, global_id 5801 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418885030 0 0) 0x7fa4c813f0e0 con 0x7fa4c813f9a0 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4ce794640 10 monclient: _renew_subs 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4ce794640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4ce794640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c813cd80 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4ce794640 10 monclient: _renew_subs 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4ce794640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4ce794640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4c80a2150 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4b0001320 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4b00048a0 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c67fc640 4 set_mon_vals no callback set 2024-09-13T10:34:39.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.274+0000 7fa4c4ff9640 10 monclient: dump: 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.297 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.275+0000 7fa4ce794640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.275+0000 7fa4ce794640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa4ac0065c0 con 0x7fa4ac002860 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.275+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa4b0011c90 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.275+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(150..150 src has 1..150) ==== 3898+0+0 (unknown 258890366 0 0) 0x7fa4b004e2f0 con 0x7fa4c80a6ab0 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.275+0000 7fa4ccd31640 10 monclient: get_auth_request con 0x7fa4a80402b0 auth_method 0 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c7fff640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.181:6793/0 conn(0x7fa4ac002860 legacy=0x7fa4ac004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009052517 0 0) 0x7fa4ac0065c0 con 0x7fa4ac002860 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 10 monclient(hunting): my global_id is 84572 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c813f0e0 con 0x7fa4ac002860 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 355270317 0 0) 0x7fa4c813f0e0 con 0x7fa4ac002860 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4ac0065c0 con 0x7fa4ac002860 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4b8004fe0 con 0x7fa4ac002860 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 10 monclient: dump: 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.299 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2440390055 0 0) 0x7fa4ac0065c0 con 0x7fa4ac002860 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.277+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4ac00a160 con 0x7fa4ac002860 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.278+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa4b80071c0 con 0x7fa4ac002860 2024-09-13T10:34:39.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.278+0000 7fa4c4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:39.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.278+0000 7fa4c4ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:39.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.278+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.181:6793/0 conn(0x7fa4ac002860 legacy=0x7fa4ac004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.278+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.181:6793/0 conn(0x7fa4ac002860 legacy=0x7fa4ac004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.284+0000 7fa4ce794640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:39.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.284+0000 7fa4ce794640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa4ac009e70 con 0x7fa4ac009130 2024-09-13T10:34:39.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c7fff640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.181:6793/0 conn(0x7fa4ac009130 legacy=0x7fa4ac0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371966176 0 0) 0x7fa4ac009e70 con 0x7fa4ac009130 2024-09-13T10:34:39.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 10 monclient(hunting): my global_id is 84581 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4ac0065c0 con 0x7fa4ac009130 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 620487220 0 0) 0x7fa4ac0065c0 con 0x7fa4ac009130 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4ac009e70 con 0x7fa4ac009130 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa4b8005680 con 0x7fa4ac009130 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 10 monclient: dump: 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.302 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2062467047 0 0) 0x7fa4ac009e70 con 0x7fa4ac009130 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.286+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa4ac00c410 con 0x7fa4ac009130 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 136410869) 0x7fa4b800a130 con 0x7fa4ac009130 2024-09-13T10:34:39.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4c4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:39.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4c4ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:39.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.181:6793/0 conn(0x7fa4ac009130 legacy=0x7fa4ac0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4c4ff9640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.181:6793/0 conn(0x7fa4ac009130 legacy=0x7fa4ac0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.304 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:39.304 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 88175, 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:34:39.305 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.306 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.307 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:39.308 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.309 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.310 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.311 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:39.312 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.313 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:39.316 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.317 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.318 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.319 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.320 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.322 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:39.323 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:39.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4ce794640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa4a80402b0 legacy=0x7fa4a8042770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4ce794640 10 monclient: shutdown 2024-09-13T10:34:39.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4ce794640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4ce794640 1 -- 172.21.15.181:0/827251789 >> v1:172.21.15.195:6791/0 conn(0x7fa4c80a6ab0 legacy=0x7fa4c813bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4ccd31640 1 -- 172.21.15.181:0/827251789 reap_dead start 2024-09-13T10:34:39.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4ccd31640 1 -- 172.21.15.181:0/827251789 reap_dead start 2024-09-13T10:34:39.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4ce794640 1 -- 172.21.15.181:0/827251789 shutdown_connections 2024-09-13T10:34:39.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4ce794640 1 -- 172.21.15.181:0/827251789 >> 172.21.15.181:0/827251789 conn(0x7fa4c80abcd0 msgr2=0x7fa4c8138f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4ce794640 1 -- 172.21.15.181:0/827251789 shutdown_connections 2024-09-13T10:34:39.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.287+0000 7fa4ce794640 1 -- 172.21.15.181:0/827251789 wait complete. 2024-09-13T10:34:39.326 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:39.326 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:34:39.326 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:34:39.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.422+0000 7f8c07cdd640 10 monclient: get_monmap_and_config 2024-09-13T10:34:39.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.422+0000 7f8c07cdd640 10 monclient: build_initial_monmap 2024-09-13T10:34:39.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.422+0000 7f8c07cdd640 10 monclient: monmap: 2024-09-13T10:34:39.425 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:39.425 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.425 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:39.424135+0000 2024-09-13T10:34:39.425 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:39.424135+0000 2024-09-13T10:34:39.425 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:39.425 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.426 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:39.426 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:39.426 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:39.426 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:39.426 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:39.426 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:39.426 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:39.426 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:39.426 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:39.426 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 1 Processor -- start 2024-09-13T10:34:39.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 1 -- start start 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 10 monclient: init 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 10 monclient: _add_conns ranks=[8,4,0,6,3,7,1,5,2] 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 10 monclient(hunting): picked mon.noname-e con 0x7f8c000a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 10 monclient(hunting): picked mon.noname-c con 0x7f8c000a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 10 monclient(hunting): picked mon.noname-a con 0x7f8c0013f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c000a4bc0 con 0x7f8c0013f750 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c0013a320 con 0x7f8c000a8340 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c000a8100 con 0x7f8c000a6640 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c07cdd640 10 monclient(hunting): authenticate will time out at 1018.929821s 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c0627a640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8c0013f750 0x7f8c00141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35944/0 (socket says 172.21.15.181:35944) 2024-09-13T10:34:39.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c05a79640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f8c000a6640 0x7f8c00139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50546/0 (socket says 172.21.15.181:50546) 2024-09-13T10:34:39.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c0627a640 1 -- 172.21.15.181:0/2281748095 learned_addr learned my addr 172.21.15.181:0/2281748095 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:39.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.423+0000 7f8c05278640 1 --1- 172.21.15.181:0/2281748095 >> v1:172.21.15.181:6791/0 conn(0x7f8c000a8340 0x7f8c00139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58708/0 (socket says 172.21.15.181:58708) 2024-09-13T10:34:39.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c0627a640 1 -- 172.21.15.181:0/2281748095 >> v1:172.21.15.181:6789/0 conn(0x7f8c0013f750 legacy=0x7f8c00141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c05a79640 1 -- 172.21.15.181:0/2281748095 >> v1:172.21.15.181:6793/0 conn(0x7f8c000a6640 legacy=0x7f8c00139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c05278640 1 -- 172.21.15.181:0/2281748095 >> v1:172.21.15.181:6791/0 conn(0x7f8c000a8340 legacy=0x7f8c00139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709519913 0 0) 0x7f8c000a4bc0 con 0x7f8c0013f750 2024-09-13T10:34:39.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient(hunting): my global_id is 55620 2024-09-13T10:34:39.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bec003520 con 0x7f8c0013f750 2024-09-13T10:34:39.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321532317 0 0) 0x7f8c0013a320 con 0x7f8c000a8340 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient(hunting): my global_id is 5926 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c000a4bc0 con 0x7f8c000a8340 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107552738 0 0) 0x7f8c000a8100 con 0x7f8c000a6640 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient(hunting): my global_id is 84590 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c0013a320 con 0x7f8c000a6640 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 908642497 0 0) 0x7f8c000a4bc0 con 0x7f8c000a8340 2024-09-13T10:34:39.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 >> v1:172.21.15.181:6793/0 conn(0x7f8c000a6640 legacy=0x7f8c00139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 >> v1:172.21.15.181:6789/0 conn(0x7f8c0013f750 legacy=0x7f8c00141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient: _finish_hunting 0 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 monclient: found mon.noname-c 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c000a48e0 con 0x7f8c000a8340 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient: _finish_auth 0 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient: _check_auth_tickets 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8bf00019f0 con 0x7f8c000a8340 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c07cdd640 5 monclient: authenticate success, global_id 5926 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c07cdd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:39.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient: dump: 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.441 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c07cdd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8bf0001cc0 con 0x7f8c000a8340 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 1 -- 172.21.15.181:0/2281748095 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8bf0004b20 con 0x7f8c000a8340 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c07cdd640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c07cdd640 4 set_mon_vals no callback set 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.426+0000 7f8c04a77640 10 monclient: dump: 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.442 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.443 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.427+0000 7f8c07cdd640 10 monclient: shutdown 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.427+0000 7f8c07cdd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.427+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2281748095 >> v1:172.21.15.181:6791/0 conn(0x7f8c000a8340 legacy=0x7f8c00139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.427+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2281748095 shutdown_connections 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.427+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2281748095 >> 172.21.15.181:0/2281748095 conn(0x7f8c00077170 msgr2=0x7f8c000abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.427+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2281748095 shutdown_connections 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.427+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2281748095 wait complete. 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.427+0000 7f8c07cdd640 10 monclient: build_initial_monmap 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.427+0000 7f8c07cdd640 10 monclient: monmap: 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:39.444 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 1 Processor -- start 2024-09-13T10:34:39.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 1 -- start start 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 10 monclient: init 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 10 monclient: _add_conns ranks=[3,6,5,1,0,7,2,4,8] 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 10 monclient(hunting): picked mon.noname-g con 0x7f8c000a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 10 monclient(hunting): picked mon.noname-d con 0x7f8c0013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 10 monclient(hunting): picked mon.noname-h con 0x7f8c001d4310 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c000a10e0 con 0x7f8c000a8340 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c0009e180 con 0x7f8c001d4310 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c00142d40 con 0x7f8c0013f750 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c07cdd640 10 monclient(hunting): authenticate will time out at 1018.934644s 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c05278640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f8c0013f750 0x7f8c0009da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47444/0 (socket says 172.21.15.181:47444) 2024-09-13T10:34:39.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.428+0000 7f8c05278640 1 -- 172.21.15.181:0/2822350128 learned_addr learned my addr 172.21.15.181:0/2822350128 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.430+0000 7f8c05278640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.181:6792/0 conn(0x7f8c0013f750 legacy=0x7f8c0009da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.430+0000 7f8c0627a640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.195:6791/0 conn(0x7f8c001d4310 legacy=0x7f8c001d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.430+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511655110 0 0) 0x7f8c00142d40 con 0x7f8c0013f750 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): my global_id is 5811 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8c05a79640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.195:6790/0 conn(0x7f8c000a8340 legacy=0x7f8c0009d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8be4003520 con 0x7f8c0013f750 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3282632186 0 0) 0x7f8c0009e180 con 0x7f8c001d4310 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): my global_id is 5810 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c00142d40 con 0x7f8c001d4310 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3278902415 0 0) 0x7f8c000a10e0 con 0x7f8c000a8340 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): my global_id is 5844 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c0009e180 con 0x7f8c000a8340 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 323863218 0 0) 0x7f8be4003520 con 0x7f8c0013f750 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c000a10e0 con 0x7f8c0013f750 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8bf0004b20 con 0x7f8c0013f750 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): dump: 2024-09-13T10:34:39.448 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.449 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1438867149 0 0) 0x7f8c00142d40 con 0x7f8c001d4310 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8be4003520 con 0x7f8c001d4310 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8bf80020b0 con 0x7f8c001d4310 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): dump: 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.450 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2048413951 0 0) 0x7f8c0009e180 con 0x7f8c000a8340 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c00142d40 con 0x7f8c000a8340 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8bfc001320 con 0x7f8c000a8340 2024-09-13T10:34:39.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient(hunting): dump: 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.452 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3175032293 0 0) 0x7f8c000a10e0 con 0x7f8c0013f750 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.195:6791/0 conn(0x7f8c001d4310 legacy=0x7f8c001d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.195:6790/0 conn(0x7f8c000a8340 legacy=0x7f8c0009d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 monclient: found mon.d 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c000a0270 con 0x7f8c0013f750 2024-09-13T10:34:39.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient: _finish_auth 0 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8c07cdd640 5 monclient: authenticate success, global_id 5811 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8c07cdd640 10 monclient: _renew_subs 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8c07cdd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0009ed80 con 0x7f8c0013f750 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8c07cdd640 10 monclient: _renew_subs 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8c07cdd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f8c0009fb80 con 0x7f8c0013f750 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8bf0005110 con 0x7f8c0013f750 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8bf0005600 con 0x7f8c0013f750 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf7fff640 4 set_mon_vals no callback set 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.431+0000 7f8bf67fc640 10 monclient: dump: 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.455 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.432+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f8bf0011c80 con 0x7f8c0013f750 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.432+0000 7f8c07cdd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.432+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8be80065c0 con 0x7f8be8002860 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.432+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(150..150 src has 1..150) ==== 3898+0+0 (unknown 258890366 0 0) 0x7f8bf004e2b0 con 0x7f8c0013f750 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.432+0000 7f8c0627a640 10 monclient: get_auth_request con 0x7f8be4040820 auth_method 0 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.434+0000 7f8c05a79640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.195:6789/0 conn(0x7f8be8002860 legacy=0x7f8be8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3350958641 0 0) 0x7f8be80065c0 con 0x7f8be8002860 2024-09-13T10:34:39.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 10 monclient(hunting): my global_id is 55945 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c000a10e0 con 0x7f8be8002860 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2567857031 0 0) 0x7f8c000a10e0 con 0x7f8be8002860 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8be80065c0 con 0x7f8be8002860 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8bfc004e20 con 0x7f8be8002860 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 10 monclient: dump: 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.457 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2036145892 0 0) 0x7f8be80065c0 con 0x7f8be8002860 2024-09-13T10:34:39.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8be800a160 con 0x7f8be8002860 2024-09-13T10:34:39.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8bfc007100 con 0x7f8be8002860 2024-09-13T10:34:39.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:39.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:39.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.195:6789/0 conn(0x7f8be8002860 legacy=0x7f8be8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.435+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.195:6789/0 conn(0x7f8be8002860 legacy=0x7f8be8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.441+0000 7f8c07cdd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:39.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.441+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8be8009e50 con 0x7f8be8009110 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8c05a79640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.195:6789/0 conn(0x7f8be8009110 legacy=0x7f8be80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4011879580 0 0) 0x7f8be8009e50 con 0x7f8be8009110 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 10 monclient(hunting): my global_id is 55954 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8be80065c0 con 0x7f8be8009110 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3154885907 0 0) 0x7f8be80065c0 con 0x7f8be8009110 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8be8009e50 con 0x7f8be8009110 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8bfc0057c0 con 0x7f8be8009110 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:34:39.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 10 monclient: dump: 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.462 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.463 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2845074341 0 0) 0x7f8be8009e50 con 0x7f8be8009110 2024-09-13T10:34:39.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.444+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8be800c3f0 con 0x7f8be8009110 2024-09-13T10:34:39.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7893 (unknown 0 0 914168421) 0x7f8bfc00a1c0 con 0x7f8be8009110 2024-09-13T10:34:39.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8bf67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:39.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8bf67fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:39.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.195:6789/0 conn(0x7f8be8009110 legacy=0x7f8be80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8bf67fc640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.195:6789/0 conn(0x7f8be8009110 legacy=0x7f8be80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.463 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:39.463 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 293854, 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:39.464 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.465 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.466 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:39.467 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.468 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:39.469 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.470 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.471 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:39.472 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:39.472 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.472 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.472 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.472 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:39.472 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:39.472 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.474 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:39.475 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:39.476 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:39.478 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.479 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:39.482 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.483 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:39.484 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.484 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.484 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:39.484 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:39.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.195:6800/1839191919 conn(0x7f8be4040820 legacy=0x7f8be4042ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8c07cdd640 10 monclient: shutdown 2024-09-13T10:34:39.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8c07cdd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2822350128 >> v1:172.21.15.181:6792/0 conn(0x7f8c0013f750 legacy=0x7f8c0009da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8c0627a640 1 -- 172.21.15.181:0/2822350128 reap_dead start 2024-09-13T10:34:39.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8c0627a640 1 -- 172.21.15.181:0/2822350128 reap_dead start 2024-09-13T10:34:39.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2822350128 shutdown_connections 2024-09-13T10:34:39.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2822350128 >> 172.21.15.181:0/2822350128 conn(0x7f8c000a6640 msgr2=0x7f8c00141e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2822350128 shutdown_connections 2024-09-13T10:34:39.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.445+0000 7f8c07cdd640 1 -- 172.21.15.181:0/2822350128 wait complete. 2024-09-13T10:34:39.486 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:39.486 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:34:39.487 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:34:39.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.581+0000 7f013f9ab640 10 monclient: get_monmap_and_config 2024-09-13T10:34:39.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.581+0000 7f013f9ab640 10 monclient: build_initial_monmap 2024-09-13T10:34:39.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.581+0000 7f013f9ab640 10 monclient: monmap: 2024-09-13T10:34:39.585 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:39.585 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.585 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:39.583540+0000 2024-09-13T10:34:39.585 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:39.583540+0000 2024-09-13T10:34:39.585 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:39.585 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.585 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:39.585 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:39.585 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:39.585 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:39.586 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:39.586 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:39.586 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:39.586 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:39.586 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:39.586 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.582+0000 7f013f9ab640 1 Processor -- start 2024-09-13T10:34:39.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.582+0000 7f013f9ab640 1 -- start start 2024-09-13T10:34:39.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.582+0000 7f013f9ab640 10 monclient: init 2024-09-13T10:34:39.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013f9ab640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:39.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013f9ab640 10 monclient: _add_conns ranks=[8,6,1,4,3,5,2,0,7] 2024-09-13T10:34:39.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013f9ab640 10 monclient(hunting): picked mon.noname-e con 0x7f01380a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:39.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013f9ab640 10 monclient(hunting): picked mon.noname-d con 0x7f01380a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:39.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013f9ab640 10 monclient(hunting): picked mon.noname-f con 0x7f013813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:39.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013f9ab640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01380a4bc0 con 0x7f013813f750 2024-09-13T10:34:39.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013f9ab640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013813a320 con 0x7f01380a8340 2024-09-13T10:34:39.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013f9ab640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01380a8100 con 0x7f01380a6640 2024-09-13T10:34:39.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013f9ab640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:39.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013f9ab640 10 monclient(hunting): authenticate will time out at 1019.089156s 2024-09-13T10:34:39.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013cf46640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f01380a8340 0x7f0138139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47450/0 (socket says 172.21.15.181:47450) 2024-09-13T10:34:39.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013d747640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f01380a6640 0x7f0138139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50558/0 (socket says 172.21.15.181:50558) 2024-09-13T10:34:39.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.583+0000 7f013cf46640 1 -- 172.21.15.181:0/420832864 learned_addr learned my addr 172.21.15.181:0/420832864 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:39.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f013cf46640 1 -- 172.21.15.181:0/420832864 >> v1:172.21.15.181:6792/0 conn(0x7f01380a8340 legacy=0x7f0138139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f013d747640 1 -- 172.21.15.181:0/420832864 >> v1:172.21.15.181:6793/0 conn(0x7f01380a6640 legacy=0x7f0138139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 1 -- 172.21.15.181:0/420832864 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2560492431 0 0) 0x7f013813a320 con 0x7f01380a8340 2024-09-13T10:34:39.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient(hunting): my global_id is 5820 2024-09-13T10:34:39.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 1 -- 172.21.15.181:0/420832864 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0124003520 con 0x7f01380a8340 2024-09-13T10:34:39.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 1 -- 172.21.15.181:0/420832864 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386319185 0 0) 0x7f01380a8100 con 0x7f01380a6640 2024-09-13T10:34:39.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient(hunting): my global_id is 84599 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 1 -- 172.21.15.181:0/420832864 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f013813a320 con 0x7f01380a6640 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f013df48640 1 -- 172.21.15.181:0/420832864 >> v1:172.21.15.195:6789/0 conn(0x7f013813f750 legacy=0x7f0138141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 1 -- 172.21.15.181:0/420832864 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 963898235 0 0) 0x7f0124003520 con 0x7f01380a8340 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 1 -- 172.21.15.181:0/420832864 >> v1:172.21.15.181:6793/0 conn(0x7f01380a6640 legacy=0x7f0138139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f013df48640 1 -- 172.21.15.181:0/420832864 >> v1:172.21.15.195:6789/0 conn(0x7f013813f750 legacy=0x7f0138141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f013df48640 1 -- 172.21.15.181:0/420832864 >> v1:172.21.15.195:6789/0 conn(0x7f013813f750 legacy=0x7f0138141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f013df48640 1 --1- 172.21.15.181:0/420832864 >> v1:172.21.15.195:6789/0 conn(0x7f013813f750 0x7f0138141b40 :-1 s=OPENED pgs=371 cs=1 l=1).handle_message read tag failed 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f013df48640 1 --1- 172.21.15.181:0/420832864 >> v1:172.21.15.195:6789/0 conn(0x7f013813f750 0x7f0138141b40 :-1 s=OPENED pgs=371 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 1 -- 172.21.15.181:0/420832864 >> v1:172.21.15.195:6789/0 conn(0x7f013813f750 legacy=0x7f0138141b40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 1 monclient: found mon.noname-d 2024-09-13T10:34:39.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 1 -- 172.21.15.181:0/420832864 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01380a48e0 con 0x7f01380a8340 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient: _finish_auth 0 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient: ms_handle_reset stray mon v1:172.21.15.195:6789/0 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 1 -- 172.21.15.181:0/420832864 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0128001ae0 con 0x7f01380a8340 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f013f9ab640 5 monclient: authenticate success, global_id 5820 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f013f9ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient: dump: 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.593 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.594 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f013f9ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 1 -- 172.21.15.181:0/420832864 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f01280048a0 con 0x7f01380a8340 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 1 -- 172.21.15.181:0/420832864 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0128004e10 con 0x7f01380a8340 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f012ffff640 10 monclient: dump: 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.595 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.596 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.596 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.596 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.596 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.596 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.596 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.597 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.597 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.597 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.597 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f013f9ab640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:39.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.585+0000 7f013f9ab640 4 set_mon_vals no callback set 2024-09-13T10:34:39.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.586+0000 7f013f9ab640 10 monclient: shutdown 2024-09-13T10:34:39.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.586+0000 7f013f9ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.586+0000 7f013f9ab640 1 -- 172.21.15.181:0/420832864 >> v1:172.21.15.181:6792/0 conn(0x7f01380a8340 legacy=0x7f0138139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.586+0000 7f013f9ab640 1 -- 172.21.15.181:0/420832864 shutdown_connections 2024-09-13T10:34:39.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.586+0000 7f013f9ab640 1 -- 172.21.15.181:0/420832864 >> 172.21.15.181:0/420832864 conn(0x7f0138077170 msgr2=0x7f01380abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.586+0000 7f013f9ab640 1 -- 172.21.15.181:0/420832864 shutdown_connections 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.586+0000 7f013f9ab640 1 -- 172.21.15.181:0/420832864 wait complete. 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.587+0000 7f013f9ab640 10 monclient: build_initial_monmap 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.587+0000 7f013f9ab640 10 monclient: monmap: 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:39.598 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:39.599 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:39.599 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:39.599 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:39.599 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:39.599 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:39.599 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.587+0000 7f013f9ab640 1 Processor -- start 2024-09-13T10:34:39.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.587+0000 7f013f9ab640 1 -- start start 2024-09-13T10:34:39.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.587+0000 7f013f9ab640 10 monclient: init 2024-09-13T10:34:39.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.587+0000 7f013f9ab640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:39.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.587+0000 7f013f9ab640 10 monclient: _add_conns ranks=[2,8,1,4,3,7,6,5,0] 2024-09-13T10:34:39.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.587+0000 7f013f9ab640 10 monclient(hunting): picked mon.noname-b con 0x7f01380a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:34:39.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.587+0000 7f013f9ab640 10 monclient(hunting): picked mon.noname-e con 0x7f013813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:39.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.587+0000 7f013f9ab640 10 monclient(hunting): picked mon.noname-f con 0x7f01381d4730 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:39.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.588+0000 7f013f9ab640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0138138bb0 con 0x7f01381d4730 2024-09-13T10:34:39.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.588+0000 7f013f9ab640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0138130280 con 0x7f01380a8340 2024-09-13T10:34:39.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.588+0000 7f013f9ab640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01380a9eb0 con 0x7f013813f750 2024-09-13T10:34:39.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.588+0000 7f013f9ab640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:39.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.588+0000 7f013d747640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f01380a8340 0x7f013812f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:36696/0 (socket says 172.21.15.181:36696) 2024-09-13T10:34:39.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.588+0000 7f013f9ab640 10 monclient(hunting): authenticate will time out at 1019.094094s 2024-09-13T10:34:39.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.588+0000 7f013cf46640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f013813f750 0x7f013812fb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50560/0 (socket says 172.21.15.181:50560) 2024-09-13T10:34:39.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.588+0000 7f013d747640 1 -- 172.21.15.181:0/2704426382 learned_addr learned my addr 172.21.15.181:0/2704426382 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:39.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f013d747640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.181:6790/0 conn(0x7f01380a8340 legacy=0x7f013812f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f013cf46640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.181:6793/0 conn(0x7f013813f750 legacy=0x7f013812fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3757469463 0 0) 0x7f01380a9eb0 con 0x7f013813f750 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): my global_id is 84608 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f013df48640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.195:6789/0 conn(0x7f01381d4730 legacy=0x7f01381d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f011c003520 con 0x7f013813f750 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288188065 0 0) 0x7f0138130280 con 0x7f01380a8340 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): my global_id is 94241 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01380a9eb0 con 0x7f01380a8340 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811093739 0 0) 0x7f0138138bb0 con 0x7f01381d4730 2024-09-13T10:34:39.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): my global_id is 55963 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0138130280 con 0x7f01381d4730 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3336407038 0 0) 0x7f011c003520 con 0x7f013813f750 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0138138bb0 con 0x7f013813f750 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0128004d90 con 0x7f013813f750 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): dump: 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.607 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:39.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 717954732 0 0) 0x7f01380a9eb0 con 0x7f01380a8340 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f011c003520 con 0x7f01380a8340 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0134001950 con 0x7f01380a8340 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): dump: 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.609 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2111947986 0 0) 0x7f0138130280 con 0x7f01381d4730 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01380a9eb0 con 0x7f01381d4730 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0130002040 con 0x7f01381d4730 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:34:39.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient(hunting): dump: 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.611 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2394227551 0 0) 0x7f0138138bb0 con 0x7f013813f750 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.181:6790/0 conn(0x7f01380a8340 legacy=0x7f013812f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.195:6789/0 conn(0x7f01381d4730 legacy=0x7f01381d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient: _finish_hunting 0 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 monclient: found mon.e 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013813d870 con 0x7f013813f750 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient: _finish_auth 0 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient: _check_auth_tickets 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f013f9ab640 5 monclient: authenticate success, global_id 84608 2024-09-13T10:34:39.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f013f9ab640 10 monclient: _renew_subs 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f013f9ab640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f013f9ab640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0138134e70 con 0x7f013813f750 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0128001320 con 0x7f013813f750 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0128001b00 con 0x7f013813f750 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.591+0000 7f012dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.591+0000 7f012dffb640 10 monclient: dump: 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.613 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.590+0000 7f012f7fe640 4 set_mon_vals no callback set 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.591+0000 7f013f9ab640 10 monclient: _renew_subs 2024-09-13T10:34:39.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.591+0000 7f013f9ab640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.591+0000 7f013f9ab640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f0138134270 con 0x7f013813f750 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.591+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0128011c20 con 0x7f013813f750 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.591+0000 7f013f9ab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.591+0000 7f013f9ab640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0138077660 con 0x7f0138077170 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.591+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(150..150 src has 1..150) ==== 3898+0+0 (unknown 258890366 0 0) 0x7f012804e350 con 0x7f013813f750 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.592+0000 7f013df48640 10 monclient: get_auth_request con 0x7f011c040550 auth_method 0 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.594+0000 7f013d747640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.195:6790/0 conn(0x7f0138077170 legacy=0x7f0138130680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.594+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523812979 0 0) 0x7f011c003520 con 0x7f0138077170 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.594+0000 7f012dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.594+0000 7f012dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.594+0000 7f012dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.594+0000 7f012dffb640 10 monclient(hunting): my global_id is 5853 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.594+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0138138bb0 con 0x7f0138077170 2024-09-13T10:34:39.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3960881755 0 0) 0x7f0138138bb0 con 0x7f0138077170 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f011c003520 con 0x7f0138077170 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0134005050 con 0x7f0138077170 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 10 monclient: dump: 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.616 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1988674762 0 0) 0x7f011c003520 con 0x7f0138077170 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01380aae60 con 0x7f0138077170 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f01340051e0 con 0x7f0138077170 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:39.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.195:6790/0 conn(0x7f0138077170 legacy=0x7f0138130680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.595+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.195:6790/0 conn(0x7f0138077170 legacy=0x7f0138130680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.601+0000 7f013f9ab640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:39.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.601+0000 7f013f9ab640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f01380008d0 con 0x7f0138135290 2024-09-13T10:34:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f013d747640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.195:6790/0 conn(0x7f0138135290 legacy=0x7f0138130d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3968832947 0 0) 0x7f01380008d0 con 0x7f0138135290 2024-09-13T10:34:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 10 monclient(hunting): my global_id is 5862 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f011c003520 con 0x7f0138135290 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1050308896 0 0) 0x7f011c003520 con 0x7f0138135290 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01380008d0 con 0x7f0138135290 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0134005a70 con 0x7f0138135290 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 10 monclient: dump: 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.620 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2262458562 0 0) 0x7f01380008d0 con 0x7f0138135290 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.604+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0138134940 con 0x7f0138135290 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7728 (unknown 0 0 731928847) 0x7f0134008690 con 0x7f0138135290 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f012dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f012dffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:39.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.195:6790/0 conn(0x7f0138135290 legacy=0x7f0138130d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f012dffb640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.195:6790/0 conn(0x7f0138135290 legacy=0x7f0138130d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.622 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:39.622 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:39.622 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:39.622 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:34:39.622 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:39.622 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 294020, 2024-09-13T10:34:39.622 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:39.622 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.623 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.624 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.624 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.624 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.624 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.624 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.624 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.624 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.624 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.624 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.624 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:39.624 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:39.624 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:39.625 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:39.626 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.627 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.628 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:39.631 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.632 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.634 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:39.635 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.636 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.636 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.636 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:39.636 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:39.636 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.638 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:39.638 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:39.638 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.638 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.638 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.638 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:39.638 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.638 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.638 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.639 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:39.639 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:39.639 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.639 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.639 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.639 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:39.639 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:39.639 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.640 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:39.640 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.640 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.640 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.641 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.642 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.643 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:39.643 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.643 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.643 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:39.643 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:39.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f013f9ab640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.195:6800/1839191919 conn(0x7f011c040550 legacy=0x7f011c042a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f013f9ab640 10 monclient: shutdown 2024-09-13T10:34:39.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f013f9ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f013f9ab640 1 -- 172.21.15.181:0/2704426382 >> v1:172.21.15.181:6793/0 conn(0x7f013813f750 legacy=0x7f013812fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f013df48640 1 -- 172.21.15.181:0/2704426382 reap_dead start 2024-09-13T10:34:39.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f013df48640 1 -- 172.21.15.181:0/2704426382 reap_dead start 2024-09-13T10:34:39.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f013f9ab640 1 -- 172.21.15.181:0/2704426382 shutdown_connections 2024-09-13T10:34:39.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f013f9ab640 1 -- 172.21.15.181:0/2704426382 >> 172.21.15.181:0/2704426382 conn(0x7f01380a6640 msgr2=0x7f01380a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f013f9ab640 1 -- 172.21.15.181:0/2704426382 shutdown_connections 2024-09-13T10:34:39.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.605+0000 7f013f9ab640 1 -- 172.21.15.181:0/2704426382 wait complete. 2024-09-13T10:34:39.645 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:39.645 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:34:39.646 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:34:39.661 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:39.661 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37815]: starting. 2024-09-13T10:34:39.662 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37815]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37777 2024-09-13T10:34:39.662 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37815]: shutting down. 2024-09-13T10:34:39.663 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:39.663 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:34:39.663 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:34:39.666 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:34:39.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.747+0000 7f6c6c517640 10 monclient: get_monmap_and_config 2024-09-13T10:34:39.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.747+0000 7f6c6c517640 10 monclient: build_initial_monmap 2024-09-13T10:34:39.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.747+0000 7f6c6c517640 10 monclient: monmap: 2024-09-13T10:34:39.750 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:39.750 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.750 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:39.748729+0000 2024-09-13T10:34:39.750 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:39.748729+0000 2024-09-13T10:34:39.750 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:39.750 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.750 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:39.750 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:39.751 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:39.751 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:39.751 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:39.751 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:39.751 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:39.751 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:39.751 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:39.751 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.747+0000 7f6c6c517640 1 Processor -- start 2024-09-13T10:34:39.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.747+0000 7f6c6c517640 1 -- start start 2024-09-13T10:34:39.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.747+0000 7f6c6c517640 10 monclient: init 2024-09-13T10:34:39.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.748+0000 7f6c6c517640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:39.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.748+0000 7f6c6c517640 10 monclient: _add_conns ranks=[4,1,3,6,2,7,8,5,0] 2024-09-13T10:34:39.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.748+0000 7f6c6c517640 10 monclient(hunting): picked mon.noname-c con 0x7f6c640a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:39.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.748+0000 7f6c6c517640 10 monclient(hunting): picked mon.noname-f con 0x7f6c640a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:39.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.748+0000 7f6c6c517640 10 monclient(hunting): picked mon.noname-g con 0x7f6c6413f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:39.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.748+0000 7f6c6c517640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c640a5fe0 con 0x7f6c640a6ab0 2024-09-13T10:34:39.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.748+0000 7f6c6c517640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c640a8080 con 0x7f6c6413f9a0 2024-09-13T10:34:39.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.748+0000 7f6c6c517640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c640a42c0 con 0x7f6c640a66d0 2024-09-13T10:34:39.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.748+0000 7f6c6c517640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:39.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.748+0000 7f6c6c517640 10 monclient(hunting): authenticate will time out at 1019.254425s 2024-09-13T10:34:39.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.748+0000 7f6c6a2b3640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f6c640a66d0 0x7f6c640a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58716/0 (socket says 172.21.15.181:58716) 2024-09-13T10:34:39.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.748+0000 7f6c6a2b3640 1 -- 172.21.15.181:0/4001139350 learned_addr learned my addr 172.21.15.181:0/4001139350 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:39.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.750+0000 7f6c6a2b3640 1 -- 172.21.15.181:0/4001139350 >> v1:172.21.15.181:6791/0 conn(0x7f6c640a66d0 legacy=0x7f6c640a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.750+0000 7f6c692b1640 1 -- 172.21.15.181:0/4001139350 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 109856593 0 0) 0x7f6c640a42c0 con 0x7f6c640a66d0 2024-09-13T10:34:39.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.750+0000 7f6c692b1640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.750+0000 7f6c692b1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.750+0000 7f6c692b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.750+0000 7f6c692b1640 10 monclient(hunting): my global_id is 5953 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.750+0000 7f6c692b1640 1 -- 172.21.15.181:0/4001139350 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c50003520 con 0x7f6c640a66d0 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.750+0000 7f6c69ab2640 1 -- 172.21.15.181:0/4001139350 >> v1:172.21.15.195:6789/0 conn(0x7f6c640a6ab0 legacy=0x7f6c640a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.750+0000 7f6c6aab4640 1 -- 172.21.15.181:0/4001139350 >> v1:172.21.15.195:6790/0 conn(0x7f6c6413f9a0 legacy=0x7f6c64141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 1 -- 172.21.15.181:0/4001139350 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3334201838 0 0) 0x7f6c50003520 con 0x7f6c640a66d0 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 1 -- 172.21.15.181:0/4001139350 >> v1:172.21.15.195:6790/0 conn(0x7f6c6413f9a0 legacy=0x7f6c64141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 1 -- 172.21.15.181:0/4001139350 >> v1:172.21.15.195:6789/0 conn(0x7f6c640a6ab0 legacy=0x7f6c640a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 10 monclient: _finish_hunting 0 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 1 monclient: found mon.noname-c 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:34:39.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 1 -- 172.21.15.181:0/4001139350 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c641464e0 con 0x7f6c640a66d0 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 10 monclient: _finish_auth 0 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 10 monclient: _check_auth_tickets 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 1 -- 172.21.15.181:0/4001139350 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c5c001e50 con 0x7f6c640a66d0 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c6c517640 5 monclient: authenticate success, global_id 5953 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c6c517640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 10 monclient: dump: 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.760 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.761 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.761 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.761 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.761 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.761 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.761 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.761 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.761 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.761 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c6c517640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 1 -- 172.21.15.181:0/4001139350 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288577544 0 0) 0x7f6c640a5fe0 con 0x7f6c640a6ab0 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 1 -- 172.21.15.181:0/4001139350 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c5c004c20 con 0x7f6c640a66d0 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c6c517640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c6c517640 4 set_mon_vals no callback set 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 1 -- 172.21.15.181:0/4001139350 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c5c005150 con 0x7f6c640a66d0 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c692b1640 10 monclient: dump: 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.763 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c6c517640 10 monclient: shutdown 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c6c517640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c6c517640 1 -- 172.21.15.181:0/4001139350 >> v1:172.21.15.181:6791/0 conn(0x7f6c640a66d0 legacy=0x7f6c640a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c6c517640 1 -- 172.21.15.181:0/4001139350 shutdown_connections 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c6c517640 1 -- 172.21.15.181:0/4001139350 >> 172.21.15.181:0/4001139350 conn(0x7f6c640abcd0 msgr2=0x7f6c640ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c6c517640 1 -- 172.21.15.181:0/4001139350 shutdown_connections 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.751+0000 7f6c6c517640 1 -- 172.21.15.181:0/4001139350 wait complete. 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.752+0000 7f6c6c517640 10 monclient: build_initial_monmap 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.752+0000 7f6c6c517640 10 monclient: monmap: 2024-09-13T10:34:39.764 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:39.765 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.752+0000 7f6c6c517640 1 Processor -- start 2024-09-13T10:34:39.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.752+0000 7f6c6c517640 1 -- start start 2024-09-13T10:34:39.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.752+0000 7f6c6c517640 10 monclient: init 2024-09-13T10:34:39.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.753+0000 7f6c6c517640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:39.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.753+0000 7f6c6c517640 10 monclient: _add_conns ranks=[8,5,7,4,3,0,1,2,6] 2024-09-13T10:34:39.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.753+0000 7f6c6c517640 10 monclient(hunting): picked mon.noname-e con 0x7f6c640a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:39.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.753+0000 7f6c6c517640 10 monclient(hunting): picked mon.noname-h con 0x7f6c640a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:39.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.753+0000 7f6c6c517640 10 monclient(hunting): picked mon.noname-i con 0x7f6c6413f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:39.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.753+0000 7f6c6c517640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c6413f040 con 0x7f6c640a6ab0 2024-09-13T10:34:39.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.753+0000 7f6c6c517640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c6413c1d0 con 0x7f6c6413f9a0 2024-09-13T10:34:39.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.753+0000 7f6c6c517640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c64137600 con 0x7f6c640a66d0 2024-09-13T10:34:39.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.753+0000 7f6c6c517640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:39.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.753+0000 7f6c6c517640 10 monclient(hunting): authenticate will time out at 1019.259134s 2024-09-13T10:34:39.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.753+0000 7f6c6a2b3640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f6c640a66d0 0x7f6c6413b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50566/0 (socket says 172.21.15.181:50566) 2024-09-13T10:34:39.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.753+0000 7f6c6a2b3640 1 -- 172.21.15.181:0/1319179166 learned_addr learned my addr 172.21.15.181:0/1319179166 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:39.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c6a2b3640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.181:6793/0 conn(0x7f6c640a66d0 legacy=0x7f6c6413b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c69ab2640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.195:6791/0 conn(0x7f6c640a6ab0 legacy=0x7f6c6413bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c6aab4640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.195:6792/0 conn(0x7f6c6413f9a0 legacy=0x7f6c641d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056788838 0 0) 0x7f6c64137600 con 0x7f6c640a66d0 2024-09-13T10:34:39.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): my global_id is 84617 2024-09-13T10:34:39.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c48003520 con 0x7f6c640a66d0 2024-09-13T10:34:39.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3752755218 0 0) 0x7f6c6413f040 con 0x7f6c640a6ab0 2024-09-13T10:34:39.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): my global_id is 5837 2024-09-13T10:34:39.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c64137600 con 0x7f6c640a6ab0 2024-09-13T10:34:39.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2555792926 0 0) 0x7f6c6413c1d0 con 0x7f6c6413f9a0 2024-09-13T10:34:39.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): my global_id is 55942 2024-09-13T10:34:39.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c6413f040 con 0x7f6c6413f9a0 2024-09-13T10:34:39.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 793531179 0 0) 0x7f6c48003520 con 0x7f6c640a66d0 2024-09-13T10:34:39.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c6413c1d0 con 0x7f6c640a66d0 2024-09-13T10:34:39.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c5c005110 con 0x7f6c640a66d0 2024-09-13T10:34:39.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:34:39.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): dump: 2024-09-13T10:34:39.779 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.779 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.779 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.780 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.780 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.780 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.780 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.780 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.781 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.781 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.781 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.781 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.781 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.781 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.781 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.781 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:39.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2766761314 0 0) 0x7f6c6413f040 con 0x7f6c6413f9a0 2024-09-13T10:34:39.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c48003520 con 0x7f6c6413f9a0 2024-09-13T10:34:39.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c60001c30 con 0x7f6c6413f9a0 2024-09-13T10:34:39.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:39.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 10 monclient(hunting): dump: 2024-09-13T10:34:39.782 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.782 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.782 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.782 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.782 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.782 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.782 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.782 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.782 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.783 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.783 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.783 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.783 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.783 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.783 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.783 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4100887756 0 0) 0x7f6c64137600 con 0x7f6c640a6ab0 2024-09-13T10:34:39.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.755+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c6413f040 con 0x7f6c640a6ab0 2024-09-13T10:34:39.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1162144605 0 0) 0x7f6c6413c1d0 con 0x7f6c640a66d0 2024-09-13T10:34:39.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.195:6792/0 conn(0x7f6c6413f9a0 legacy=0x7f6c641d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.195:6791/0 conn(0x7f6c640a6ab0 legacy=0x7f6c6413bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 10 monclient: _finish_hunting 0 2024-09-13T10:34:39.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 1 monclient: found mon.e 2024-09-13T10:34:39.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:39.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:39.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c641390e0 con 0x7f6c640a66d0 2024-09-13T10:34:39.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 10 monclient: _finish_auth 0 2024-09-13T10:34:39.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 10 monclient: _check_auth_tickets 2024-09-13T10:34:39.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:39.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c6c517640 5 monclient: authenticate success, global_id 84617 2024-09-13T10:34:39.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c6c517640 10 monclient: _renew_subs 2024-09-13T10:34:39.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c6c517640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:39.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c6c517640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6413e1d0 con 0x7f6c640a66d0 2024-09-13T10:34:39.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c6c517640 10 monclient: _renew_subs 2024-09-13T10:34:39.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c6c517640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:39.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c6c517640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f6c6413ed60 con 0x7f6c640a66d0 2024-09-13T10:34:39.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c5c004c20 con 0x7f6c640a66d0 2024-09-13T10:34:39.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:39.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c5c001df0 con 0x7f6c640a66d0 2024-09-13T10:34:39.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c68ab0640 4 set_mon_vals no callback set 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 10 monclient: dump: 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.786 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c6c517640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c6c517640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6c4c0065c0 con 0x7f6c4c002860 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.756+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6c5c011f60 con 0x7f6c640a66d0 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.757+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(151..151 src has 1..151) ==== 3506+0+0 (unknown 2924825394 0 0) 0x7f6c5c04e570 con 0x7f6c640a66d0 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.757+0000 7f6c6aab4640 10 monclient: get_auth_request con 0x7f6c480404e0 auth_method 0 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c69ab2640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.195:6791/0 conn(0x7f6c4c002860 legacy=0x7f6c4c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4119492419 0 0) 0x7f6c4c0065c0 con 0x7f6c4c002860 2024-09-13T10:34:39.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 10 monclient(hunting): my global_id is 5846 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c6413c1d0 con 0x7f6c4c002860 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 330534085 0 0) 0x7f6c6413c1d0 con 0x7f6c4c002860 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c4c0065c0 con 0x7f6c4c002860 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c54003c30 con 0x7f6c4c002860 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 10 monclient: dump: 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.788 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 377846386 0 0) 0x7f6c4c0065c0 con 0x7f6c4c002860 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c4c00a160 con 0x7f6c4c002860 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6c54003f30 con 0x7f6c4c002860 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.195:6791/0 conn(0x7f6c4c002860 legacy=0x7f6c4c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.759+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.195:6791/0 conn(0x7f6c4c002860 legacy=0x7f6c4c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.765+0000 7f6c6c517640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.766+0000 7f6c6c517640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6c4c009e70 con 0x7f6c4c009130 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.768+0000 7f6c69ab2640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.195:6791/0 conn(0x7f6c4c009130 legacy=0x7f6c4c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.768+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833201531 0 0) 0x7f6c4c009e70 con 0x7f6c4c009130 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.768+0000 7f6c5affd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.768+0000 7f6c5affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.768+0000 7f6c5affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.768+0000 7f6c5affd640 10 monclient(hunting): my global_id is 5855 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.768+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c4c0065c0 con 0x7f6c4c009130 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 39101160 0 0) 0x7f6c4c0065c0 con 0x7f6c4c009130 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c4c009e70 con 0x7f6c4c009130 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c54004420 con 0x7f6c4c009130 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 10 monclient: dump: 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.791 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 307147627 0 0) 0x7f6c4c009e70 con 0x7f6c4c009130 2024-09-13T10:34:39.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6c4c00c410 con 0x7f6c4c009130 2024-09-13T10:34:39.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 3755775146) 0x7f6c54005bb0 con 0x7f6c4c009130 2024-09-13T10:34:39.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:39.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:39.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.195:6791/0 conn(0x7f6c4c009130 legacy=0x7f6c4c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c5affd640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.195:6791/0 conn(0x7f6c4c009130 legacy=0x7f6c4c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.793 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:39.793 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:39.793 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:39.793 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 294198, 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.794 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.795 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.796 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.796 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:39.796 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:39.796 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.796 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.796 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.796 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.796 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.796 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.796 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.796 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.796 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:39.797 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.798 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.800 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.800 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:39.800 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.800 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.800 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.800 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:39.800 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.801 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.802 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.804 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:39.804 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:39.804 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.804 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.805 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.805 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:39.805 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.805 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.805 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.806 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.807 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:39.808 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.809 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:39.812 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.813 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.814 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:39.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.814 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.814 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.814 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:34:39.814 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.814 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.814 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:39.814 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c6c517640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6c480404e0 legacy=0x7f6c480429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c6c517640 10 monclient: shutdown 2024-09-13T10:34:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c6c517640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c6c517640 1 -- 172.21.15.181:0/1319179166 >> v1:172.21.15.181:6793/0 conn(0x7f6c640a66d0 legacy=0x7f6c6413b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c6aab4640 1 -- 172.21.15.181:0/1319179166 reap_dead start 2024-09-13T10:34:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c6aab4640 1 -- 172.21.15.181:0/1319179166 reap_dead start 2024-09-13T10:34:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c6c517640 1 -- 172.21.15.181:0/1319179166 shutdown_connections 2024-09-13T10:34:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c6c517640 1 -- 172.21.15.181:0/1319179166 >> 172.21.15.181:0/1319179166 conn(0x7f6c640abcd0 msgr2=0x7f6c640a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c6c517640 1 -- 172.21.15.181:0/1319179166 shutdown_connections 2024-09-13T10:34:39.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.769+0000 7f6c6c517640 1 -- 172.21.15.181:0/1319179166 wait complete. 2024-09-13T10:34:39.817 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:39.817 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:34:39.817 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:34:39.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.914+0000 7fe41eb75640 10 monclient: get_monmap_and_config 2024-09-13T10:34:39.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.914+0000 7fe41eb75640 10 monclient: build_initial_monmap 2024-09-13T10:34:39.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.914+0000 7fe41eb75640 10 monclient: monmap: 2024-09-13T10:34:39.917 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:39.917 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.917 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:39.916184+0000 2024-09-13T10:34:39.917 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:39.916184+0000 2024-09-13T10:34:39.917 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:39.917 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.917 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:39.917 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:39.918 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:39.918 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:39.918 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:39.918 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:39.918 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:39.918 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:39.918 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:39.918 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 1 Processor -- start 2024-09-13T10:34:39.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 1 -- start start 2024-09-13T10:34:39.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 10 monclient: init 2024-09-13T10:34:39.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:39.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 10 monclient: _add_conns ranks=[1,5,6,4,2,8,7,3,0] 2024-09-13T10:34:39.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 10 monclient(hunting): picked mon.noname-f con 0x7fe4180a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:39.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 10 monclient(hunting): picked mon.noname-h con 0x7fe4180a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:39.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 10 monclient(hunting): picked mon.noname-d con 0x7fe41813f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:39.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4180a4bc0 con 0x7fe4180a6640 2024-09-13T10:34:39.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe41813a320 con 0x7fe4180a8340 2024-09-13T10:34:39.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4180a8100 con 0x7fe41813f750 2024-09-13T10:34:39.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:39.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41eb75640 10 monclient(hunting): authenticate will time out at 1019.421897s 2024-09-13T10:34:39.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.915+0000 7fe41d112640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fe41813f750 0x7fe418141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47456/0 (socket says 172.21.15.181:47456) 2024-09-13T10:34:39.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.916+0000 7fe41d112640 1 -- 172.21.15.181:0/2750407854 learned_addr learned my addr 172.21.15.181:0/2750407854 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:39.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe41d112640 1 -- 172.21.15.181:0/2750407854 >> v1:172.21.15.181:6792/0 conn(0x7fe41813f750 legacy=0x7fe418141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe417fff640 1 -- 172.21.15.181:0/2750407854 >> v1:172.21.15.195:6791/0 conn(0x7fe4180a8340 legacy=0x7fe418139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2354506218 0 0) 0x7fe4180a8100 con 0x7fe41813f750 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient(hunting): my global_id is 5838 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe408003520 con 0x7fe41813f750 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe41c911640 1 -- 172.21.15.181:0/2750407854 >> v1:172.21.15.195:6789/0 conn(0x7fe4180a6640 legacy=0x7fe418139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 585686668 0 0) 0x7fe41813a320 con 0x7fe4180a8340 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient(hunting): my global_id is 5864 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4180a8100 con 0x7fe4180a8340 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421293314 0 0) 0x7fe4180a4bc0 con 0x7fe4180a6640 2024-09-13T10:34:39.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient(hunting): my global_id is 55999 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe41813a320 con 0x7fe4180a6640 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3694572968 0 0) 0x7fe408003520 con 0x7fe41813f750 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 >> v1:172.21.15.195:6791/0 conn(0x7fe4180a8340 legacy=0x7fe418139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 >> v1:172.21.15.195:6789/0 conn(0x7fe4180a6640 legacy=0x7fe418139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient: _finish_hunting 0 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 monclient: found mon.noname-d 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4180a48e0 con 0x7fe41813f750 2024-09-13T10:34:39.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient: _finish_auth 0 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient: _check_auth_tickets 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe410001e60 con 0x7fe41813f750 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe41eb75640 5 monclient: authenticate success, global_id 5838 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe41eb75640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient: dump: 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.927 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe41eb75640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4100020b0 con 0x7fe41813f750 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 1 -- 172.21.15.181:0/2750407854 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe410004f60 con 0x7fe41813f750 2024-09-13T10:34:39.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe41eb75640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe41eb75640 4 set_mon_vals no callback set 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.918+0000 7fe4177fe640 10 monclient: dump: 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.929 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.919+0000 7fe41eb75640 10 monclient: shutdown 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.919+0000 7fe41eb75640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.919+0000 7fe41eb75640 1 -- 172.21.15.181:0/2750407854 >> v1:172.21.15.181:6792/0 conn(0x7fe41813f750 legacy=0x7fe418141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.919+0000 7fe41eb75640 1 -- 172.21.15.181:0/2750407854 shutdown_connections 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.919+0000 7fe41eb75640 1 -- 172.21.15.181:0/2750407854 >> 172.21.15.181:0/2750407854 conn(0x7fe418077170 msgr2=0x7fe4180abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.919+0000 7fe41eb75640 1 -- 172.21.15.181:0/2750407854 shutdown_connections 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.919+0000 7fe41eb75640 1 -- 172.21.15.181:0/2750407854 wait complete. 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.919+0000 7fe41eb75640 10 monclient: build_initial_monmap 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.919+0000 7fe41eb75640 10 monclient: monmap: 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:39.931 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:39.932 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:39.932 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:39.932 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:39.932 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:39.932 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 1 Processor -- start 2024-09-13T10:34:39.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 1 -- start start 2024-09-13T10:34:39.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 10 monclient: init 2024-09-13T10:34:39.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:39.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 10 monclient: _add_conns ranks=[8,4,7,3,6,0,2,5,1] 2024-09-13T10:34:39.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 10 monclient(hunting): picked mon.noname-e con 0x7fe4180a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:39.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 10 monclient(hunting): picked mon.noname-c con 0x7fe41813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:39.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 10 monclient(hunting): picked mon.noname-i con 0x7fe4181d4720 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:39.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4180a9cb0 con 0x7fe41813f750 2024-09-13T10:34:39.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe418134af0 con 0x7fe4181d4720 2024-09-13T10:34:39.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe418138fd0 con 0x7fe4180a8340 2024-09-13T10:34:39.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:39.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41eb75640 10 monclient(hunting): authenticate will time out at 1019.426707s 2024-09-13T10:34:39.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41c911640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fe4180a8340 0x7fe4181ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:50582/0 (socket says 172.21.15.181:50582) 2024-09-13T10:34:39.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.920+0000 7fe41c911640 1 -- 172.21.15.181:0/2910570651 learned_addr learned my addr 172.21.15.181:0/2910570651 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:39.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.922+0000 7fe41c911640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.181:6793/0 conn(0x7fe4180a8340 legacy=0x7fe4181ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.922+0000 7fe417fff640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.181:6791/0 conn(0x7fe41813f750 legacy=0x7fe4181388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe41d112640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.195:6792/0 conn(0x7fe4181d4720 legacy=0x7fe4181d6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373973165 0 0) 0x7fe418138fd0 con 0x7fe4180a8340 2024-09-13T10:34:39.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): my global_id is 84626 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3fc003520 con 0x7fe4180a8340 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928482597 0 0) 0x7fe4180a9cb0 con 0x7fe41813f750 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): my global_id is 5962 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe418138fd0 con 0x7fe41813f750 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653637009 0 0) 0x7fe418134af0 con 0x7fe4181d4720 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): my global_id is 55951 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4180a9cb0 con 0x7fe4181d4720 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3703069557 0 0) 0x7fe3fc003520 con 0x7fe4180a8340 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe418134af0 con 0x7fe4180a8340 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe40c003610 con 0x7fe4180a8340 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): dump: 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.941 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1841264528 0 0) 0x7fe418138fd0 con 0x7fe41813f750 2024-09-13T10:34:39.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3fc003520 con 0x7fe41813f750 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe404003610 con 0x7fe41813f750 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): dump: 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.943 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3318879746 0 0) 0x7fe4180a9cb0 con 0x7fe4181d4720 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe418138fd0 con 0x7fe4181d4720 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe4100016a0 con 0x7fe4181d4720 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient(hunting): dump: 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.944 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.945 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1931816763 0 0) 0x7fe418134af0 con 0x7fe4180a8340 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.195:6792/0 conn(0x7fe4181d4720 legacy=0x7fe4181d6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.181:6791/0 conn(0x7fe41813f750 legacy=0x7fe4181388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient: _finish_hunting 0 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 monclient: found mon.e 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41813da10 con 0x7fe4180a8340 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient: _finish_auth 0 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient: _check_auth_tickets 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe41eb75640 5 monclient: authenticate success, global_id 84626 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe41eb75640 10 monclient: _renew_subs 2024-09-13T10:34:39.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe41eb75640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:39.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe41eb75640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe4181d8230 con 0x7fe4180a8340 2024-09-13T10:34:39.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe41eb75640 10 monclient: _renew_subs 2024-09-13T10:34:39.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe41eb75640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:34:39.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe41eb75640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fe4181d85e0 con 0x7fe4180a8340 2024-09-13T10:34:39.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe40c003be0 con 0x7fe4180a8340 2024-09-13T10:34:39.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:39.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe40c004110 con 0x7fe4180a8340 2024-09-13T10:34:39.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe416ffd640 4 set_mon_vals no callback set 2024-09-13T10:34:39.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:34:39.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.923+0000 7fe4157fa640 10 monclient: dump: 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.948 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.949 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.949 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.949 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.924+0000 7fe41eb75640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:39.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.924+0000 7fe41eb75640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe3f80065c0 con 0x7fe3f8002860 2024-09-13T10:34:39.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.924+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe40c011ca0 con 0x7fe4180a8340 2024-09-13T10:34:39.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.924+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(151..151 src has 1..151) ==== 3506+0+0 (unknown 2924825394 0 0) 0x7fe40c04e300 con 0x7fe4180a8340 2024-09-13T10:34:39.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.925+0000 7fe41d112640 10 monclient: get_auth_request con 0x7fe3fc0406e0 auth_method 0 2024-09-13T10:34:39.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.926+0000 7fe417fff640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.195:6792/0 conn(0x7fe3f8002860 legacy=0x7fe3f8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.926+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910109107 0 0) 0x7fe3f80065c0 con 0x7fe3f8002860 2024-09-13T10:34:39.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.926+0000 7fe4157fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.926+0000 7fe4157fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.926+0000 7fe4157fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.926+0000 7fe4157fa640 10 monclient(hunting): my global_id is 55960 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.926+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe418134af0 con 0x7fe3f8002860 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1109446525 0 0) 0x7fe418134af0 con 0x7fe3f8002860 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3f80065c0 con 0x7fe3f8002860 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe404003d90 con 0x7fe3f8002860 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 10 monclient: dump: 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.950 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3339104972 0 0) 0x7fe3f80065c0 con 0x7fe3f8002860 2024-09-13T10:34:39.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3f800a160 con 0x7fe3f8002860 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe404003fc0 con 0x7fe3f8002860 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.195:6792/0 conn(0x7fe3f8002860 legacy=0x7fe3f8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.927+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.195:6792/0 conn(0x7fe3f8002860 legacy=0x7fe3f8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.933+0000 7fe41eb75640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.933+0000 7fe41eb75640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe3f8009e70 con 0x7fe3f8009130 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe417fff640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.195:6792/0 conn(0x7fe3f8009130 legacy=0x7fe3f80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674930942 0 0) 0x7fe3f8009e70 con 0x7fe3f8009130 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:39.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 10 monclient(hunting): my global_id is 55969 2024-09-13T10:34:39.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3f80065c0 con 0x7fe3f8009130 2024-09-13T10:34:39.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 252885294 0 0) 0x7fe3f80065c0 con 0x7fe3f8009130 2024-09-13T10:34:39.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3f8009e70 con 0x7fe3f8009130 2024-09-13T10:34:39.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe404005b00 con 0x7fe3f8009130 2024-09-13T10:34:39.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:39.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:39.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 10 monclient: dump: 2024-09-13T10:34:39.953 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:39.956 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:39.956 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.956 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:39.956 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:39.956 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:39.956 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:39.956 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:39.957 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:39.957 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:39.957 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:39.957 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:39.957 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:39.957 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:39.957 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:39.957 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:39.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 574324395 0 0) 0x7fe3f8009e70 con 0x7fe3f8009130 2024-09-13T10:34:39.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe3f800c3f0 con 0x7fe3f8009130 2024-09-13T10:34:39.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 4162361921) 0x7fe404007d90 con 0x7fe3f8009130 2024-09-13T10:34:39.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:39.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:39.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.195:6792/0 conn(0x7fe3f8009130 legacy=0x7fe3f80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.936+0000 7fe4157fa640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.195:6792/0 conn(0x7fe3f8009130 legacy=0x7fe3f80095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:39.958 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 84, 2024-09-13T10:34:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 294357, 2024-09-13T10:34:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:34:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:39.978 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:39.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.937+0000 7fe41eb75640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.195:6800/1839191919 conn(0x7fe3fc0406e0 legacy=0x7fe3fc042ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.937+0000 7fe41eb75640 10 monclient: shutdown 2024-09-13T10:34:39.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.937+0000 7fe41eb75640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:39.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.937+0000 7fe41eb75640 1 -- 172.21.15.181:0/2910570651 >> v1:172.21.15.181:6793/0 conn(0x7fe4180a8340 legacy=0x7fe4181ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:39.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.937+0000 7fe41d112640 1 -- 172.21.15.181:0/2910570651 reap_dead start 2024-09-13T10:34:39.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.937+0000 7fe41d112640 1 -- 172.21.15.181:0/2910570651 reap_dead start 2024-09-13T10:34:39.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.937+0000 7fe41eb75640 1 -- 172.21.15.181:0/2910570651 shutdown_connections 2024-09-13T10:34:39.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.937+0000 7fe41eb75640 1 -- 172.21.15.181:0/2910570651 >> 172.21.15.181:0/2910570651 conn(0x7fe4180a6640 msgr2=0x7fe4181308c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:39.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.937+0000 7fe41eb75640 1 -- 172.21.15.181:0/2910570651 shutdown_connections 2024-09-13T10:34:39.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:39.937+0000 7fe41eb75640 1 -- 172.21.15.181:0/2910570651 wait complete. 2024-09-13T10:34:39.981 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:34:39.981 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a', 'e', 'h'] 2024-09-13T10:34:39.981 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-13T10:34:39.981 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-13T10:34:39.981 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-13T10:34:39.981 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T10:34:39.982 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:34:39.996 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T10:34:39.996 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-09-13T10:34:39.996 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-09-13T10:34:39.996 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-09-13T10:34:39.996 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:34:40.047 INFO:tasks.ceph.mon.e:Stopped 2024-09-13T10:34:40.048 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.h 2024-09-13T10:34:40.048 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2024-09-13T10:34:40.048 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-09-13T10:34:40.048 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:34:40.060 INFO:tasks.ceph.mon.h:Stopped 2024-09-13T10:34:40.060 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 6 2024-09-13T10:34:40.060 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:34:40.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.181+0000 7f4f60e48640 10 monclient: get_monmap_and_config 2024-09-13T10:34:40.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.181+0000 7f4f60e48640 10 monclient: build_initial_monmap 2024-09-13T10:34:40.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.181+0000 7f4f60e48640 10 monclient: monmap: 2024-09-13T10:34:40.184 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:40.184 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:40.184 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:40.183045+0000 2024-09-13T10:34:40.184 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:40.183045+0000 2024-09-13T10:34:40.184 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:40.184 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:40.185 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:40.185 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:40.185 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:40.185 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:40.185 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:40.185 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:40.185 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:40.185 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:40.185 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:40.186 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:40.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.181+0000 7f4f60e48640 1 Processor -- start 2024-09-13T10:34:40.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f60e48640 1 -- start start 2024-09-13T10:34:40.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f60e48640 10 monclient: init 2024-09-13T10:34:40.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f60e48640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:40.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f60e48640 10 monclient: _add_conns ranks=[7,0,6,3,4,2,5,8,1] 2024-09-13T10:34:40.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f60e48640 10 monclient(hunting): picked mon.noname-i con 0x7f4f5c0a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:40.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f60e48640 10 monclient(hunting): picked mon.noname-a con 0x7f4f5c0a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:40.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f60e48640 10 monclient(hunting): picked mon.noname-d con 0x7f4f5c13f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:40.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f60e48640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c0a4bc0 con 0x7f4f5c0a8340 2024-09-13T10:34:40.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f60e48640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c13a320 con 0x7f4f5c13f750 2024-09-13T10:34:40.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f60e48640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c0a8100 con 0x7f4f5c0a6640 2024-09-13T10:34:40.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f60e48640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:40.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f60e48640 10 monclient(hunting): authenticate will time out at 1019.688800s 2024-09-13T10:34:40.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f59d9b640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f4f5c0a8340 legacy=0x7f4f5c139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:34:40.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f5ad9d640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f4f5c13f750 0x7f4f5c141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:47464/0 (socket says 172.21.15.181:47464) 2024-09-13T10:34:40.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.182+0000 7f4f5ad9d640 1 -- 172.21.15.181:0/2686664515 learned_addr learned my addr 172.21.15.181:0/2686664515 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:40.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5ad9d640 1 -- 172.21.15.181:0/2686664515 >> v1:172.21.15.181:6792/0 conn(0x7f4f5c13f750 legacy=0x7f4f5c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5a59c640 1 -- 172.21.15.181:0/2686664515 >> v1:172.21.15.195:6792/0 conn(0x7f4f5c0a6640 legacy=0x7f4f5c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 1 -- 172.21.15.181:0/2686664515 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033676702 0 0) 0x7f4f5c13a320 con 0x7f4f5c13f750 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient(hunting): _negotiate 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient(hunting): my global_id is 5847 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 1 -- 172.21.15.181:0/2686664515 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f44003520 con 0x7f4f5c13f750 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 1 -- 172.21.15.181:0/2686664515 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565555322 0 0) 0x7f4f5c0a8100 con 0x7f4f5c0a6640 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient(hunting): _negotiate 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient(hunting): my global_id is 55978 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 1 -- 172.21.15.181:0/2686664515 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f5c13a320 con 0x7f4f5c0a6640 2024-09-13T10:34:40.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 1 -- 172.21.15.181:0/2686664515 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4005074958 0 0) 0x7f4f44003520 con 0x7f4f5c13f750 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 1 -- 172.21.15.181:0/2686664515 >> v1:172.21.15.195:6792/0 conn(0x7f4f5c0a6640 legacy=0x7f4f5c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 1 -- 172.21.15.181:0/2686664515 >> v1:172.21.15.181:6789/0 conn(0x7f4f5c0a8340 legacy=0x7f4f5c139c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient: _finish_hunting 0 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 1 monclient: found mon.noname-d 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 1 -- 172.21.15.181:0/2686664515 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5c0a48e0 con 0x7f4f5c13f750 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient: _finish_auth 0 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient: _check_auth_tickets 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 1 -- 172.21.15.181:0/2686664515 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4f54001e60 con 0x7f4f5c13f750 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f60e48640 5 monclient: authenticate success, global_id 5847 2024-09-13T10:34:40.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f60e48640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient: dump: 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:40.195 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f60e48640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 1 -- 172.21.15.181:0/2686664515 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f54004c20 con 0x7f4f5c13f750 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 1 -- 172.21.15.181:0/2686664515 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4f54005190 con 0x7f4f5c13f750 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f60e48640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f60e48640 4 set_mon_vals no callback set 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:40.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.185+0000 7f4f5959a640 10 monclient: dump: 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:40.197 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:40.198 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:40.198 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:40.198 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:40.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.186+0000 7f4f60e48640 10 monclient: shutdown 2024-09-13T10:34:40.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.186+0000 7f4f60e48640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:40.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.186+0000 7f4f60e48640 1 -- 172.21.15.181:0/2686664515 >> v1:172.21.15.181:6792/0 conn(0x7f4f5c13f750 legacy=0x7f4f5c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:40.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.186+0000 7f4f60e48640 1 -- 172.21.15.181:0/2686664515 shutdown_connections 2024-09-13T10:34:40.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.186+0000 7f4f60e48640 1 -- 172.21.15.181:0/2686664515 >> 172.21.15.181:0/2686664515 conn(0x7f4f5c077170 msgr2=0x7f4f5c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:40.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.186+0000 7f4f60e48640 1 -- 172.21.15.181:0/2686664515 shutdown_connections 2024-09-13T10:34:40.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.186+0000 7f4f60e48640 1 -- 172.21.15.181:0/2686664515 wait complete. 2024-09-13T10:34:40.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.186+0000 7f4f60e48640 10 monclient: build_initial_monmap 2024-09-13T10:34:40.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.186+0000 7f4f60e48640 10 monclient: monmap: 2024-09-13T10:34:40.199 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:40.199 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:40.199 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:40.200 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:40.200 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:40.200 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:40.200 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:40.200 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:40.200 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:40.201 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:40.201 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:40.201 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:40.201 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:40.202 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:40.202 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:40.202 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:40.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 1 Processor -- start 2024-09-13T10:34:40.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 1 -- start start 2024-09-13T10:34:40.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 10 monclient: init 2024-09-13T10:34:40.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:40.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 10 monclient: _add_conns ranks=[5,7,1,4,3,2,8,0,6] 2024-09-13T10:34:40.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 10 monclient(hunting): picked mon.noname-h con 0x7f4f5c0a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:40.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 10 monclient(hunting): picked mon.noname-i con 0x7f4f5c13f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:40.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 10 monclient(hunting): picked mon.noname-f con 0x7f4f5c13caa0 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:40.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c1392a0 con 0x7f4f5c13caa0 2024-09-13T10:34:40.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c1cf0f0 con 0x7f4f5c0a8340 2024-09-13T10:34:40.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c0a9b40 con 0x7f4f5c13f750 2024-09-13T10:34:40.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:40.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f60e48640 10 monclient(hunting): authenticate will time out at 1019.693785s 2024-09-13T10:34:40.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f5a59c640 1 -- >> v1:172.21.15.195:6791/0 conn(0x7f4f5c0a8340 legacy=0x7f4f5c1ce2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6791/0 2024-09-13T10:34:40.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f5ad9d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f4f5c13caa0 0x7f4f5c1d6530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:37772/0 (socket says 172.21.15.181:37772) 2024-09-13T10:34:40.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f59d9b640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f4f5c13f750 0x7f4f5c1ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:50256/0 (socket says 172.21.15.181:50256) 2024-09-13T10:34:40.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.187+0000 7f4f5ad9d640 1 -- 172.21.15.181:0/3260625169 learned_addr learned my addr 172.21.15.181:0/3260625169 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:40.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f5ad9d640 1 -- 172.21.15.181:0/3260625169 >> v1:172.21.15.195:6789/0 conn(0x7f4f5c13caa0 legacy=0x7f4f5c1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:40.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f59d9b640 1 -- 172.21.15.181:0/3260625169 >> v1:172.21.15.195:6792/0 conn(0x7f4f5c13f750 legacy=0x7f4f5c1ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:40.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1100676324 0 0) 0x7f4f5c0a9b40 con 0x7f4f5c13f750 2024-09-13T10:34:40.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:40.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:40.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:40.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): my global_id is 55987 2024-09-13T10:34:40.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f3c003550 con 0x7f4f5c13f750 2024-09-13T10:34:40.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498352040 0 0) 0x7f4f5c0a48e0 con 0x7f4f5c13caa0 2024-09-13T10:34:40.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:40.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:40.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:40.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): my global_id is 56008 2024-09-13T10:34:40.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f5c0a9b40 con 0x7f4f5c13caa0 2024-09-13T10:34:40.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1038569041 0 0) 0x7f4f3c003550 con 0x7f4f5c13f750 2024-09-13T10:34:40.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f5c0a48e0 con 0x7f4f5c13f750 2024-09-13T10:34:40.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4f500046a0 con 0x7f4f5c13f750 2024-09-13T10:34:40.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:40.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:34:40.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): dump: 2024-09-13T10:34:40.212 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:40.213 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:40.213 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:40.213 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:40.213 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:40.213 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:40.213 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:40.214 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:40.214 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:40.214 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:40.214 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:40.214 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:40.214 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:40.214 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:40.214 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:40.214 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:40.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3156000249 0 0) 0x7f4f5c0a9b40 con 0x7f4f5c13caa0 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f3c003550 con 0x7f4f5c13caa0 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4f540020b0 con 0x7f4f5c13caa0 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient(hunting): dump: 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:40.215 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 223297983 0 0) 0x7f4f5c0a48e0 con 0x7f4f5c13f750 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 >> v1:172.21.15.195:6791/0 conn(0x7f4f5c0a8340 legacy=0x7f4f5c1ce2d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 >> v1:172.21.15.195:6789/0 conn(0x7f4f5c13caa0 legacy=0x7f4f5c1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient: _finish_hunting 0 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 monclient: found mon.i 2024-09-13T10:34:40.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5c13e760 con 0x7f4f5c13f750 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient: _finish_auth 0 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient: _check_auth_tickets 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f60e48640 5 monclient: authenticate success, global_id 55987 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f60e48640 10 monclient: _renew_subs 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f60e48640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f60e48640 1 -- 172.21.15.181:0/3260625169 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5c134240 con 0x7f4f5c13f750 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f60e48640 10 monclient: _renew_subs 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f60e48640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f60e48640 1 -- 172.21.15.181:0/3260625169 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f4f5c13de30 con 0x7f4f5c13f750 2024-09-13T10:34:40.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f500048c0 con 0x7f4f5c13f750 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4f50004e30 con 0x7f4f5c13f750 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f58d99640 4 set_mon_vals no callback set 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.190+0000 7f4f4affd640 10 monclient: dump: 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:40.218 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.191+0000 7f4f60e48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.191+0000 7f4f60e48640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.191+0000 7f4f60e48640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:40.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.191+0000 7f4f60e48640 1 -- 172.21.15.181:0/3260625169 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f40005080 con 0x7f4f5c13f750 2024-09-13T10:34:40.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.191+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4f500050d0 con 0x7f4f5c13f750 2024-09-13T10:34:40.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.191+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(151..151 src has 1..151) ==== 3506+0+0 (unknown 2924825394 0 0) 0x7f4f5004e1b0 con 0x7f4f5c13f750 2024-09-13T10:34:40.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.192+0000 7f4f5a59c640 10 monclient: get_auth_request con 0x7f4f3c040220 auth_method 0 2024-09-13T10:34:40.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.196+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.7 v1:172.21.15.195:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f4f50017760 con 0x7f4f5c13f750 2024-09-13T10:34:40.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.196+0000 7f4f4affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:40.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.196+0000 7f4f4affd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:40.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.438+0000 7f4f60e48640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:34:40.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.438+0000 7f4f60e48640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:34:40.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.438+0000 7f4f60e48640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:40.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.438+0000 7f4f60e48640 1 -- 172.21.15.181:0/3260625169 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4f40005370 con 0x7f4f5c13f750 2024-09-13T10:34:40.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.439+0000 7f4f4affd640 1 -- 172.21.15.181:0/3260625169 <== mon.7 v1:172.21.15.195:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 297207955) 0x7f4f50017060 con 0x7f4f5c13f750 2024-09-13T10:34:40.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.439+0000 7f4f4affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:34:40.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.439+0000 7f4f4affd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:40.442 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":84,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":5,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:34:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.441+0000 7f4f60e48640 1 -- 172.21.15.181:0/3260625169 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4f3c040220 legacy=0x7f4f3c0426e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.441+0000 7f4f60e48640 10 monclient: shutdown 2024-09-13T10:34:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.441+0000 7f4f60e48640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.441+0000 7f4f60e48640 1 -- 172.21.15.181:0/3260625169 >> v1:172.21.15.195:6792/0 conn(0x7f4f5c13f750 legacy=0x7f4f5c1ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.441+0000 7f4f60e48640 1 -- 172.21.15.181:0/3260625169 shutdown_connections 2024-09-13T10:34:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.441+0000 7f4f60e48640 1 -- 172.21.15.181:0/3260625169 >> 172.21.15.181:0/3260625169 conn(0x7f4f5c0a6640 msgr2=0x7f4f5c0a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.441+0000 7f4f60e48640 1 -- 172.21.15.181:0/3260625169 shutdown_connections 2024-09-13T10:34:40.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:40.441+0000 7f4f60e48640 1 -- 172.21.15.181:0/3260625169 wait complete. 2024-09-13T10:34:43.455 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:34:43.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.562+0000 7fa84fd56640 10 monclient: get_monmap_and_config 2024-09-13T10:34:43.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.562+0000 7fa84fd56640 10 monclient: build_initial_monmap 2024-09-13T10:34:43.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.562+0000 7fa84fd56640 10 monclient: monmap: 2024-09-13T10:34:43.564 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:43.564 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:43.563675+0000 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:43.563675+0000 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:43.565 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.562+0000 7fa84fd56640 1 Processor -- start 2024-09-13T10:34:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.562+0000 7fa84fd56640 1 -- start start 2024-09-13T10:34:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.562+0000 7fa84fd56640 10 monclient: init 2024-09-13T10:34:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.563+0000 7fa84fd56640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.563+0000 7fa84fd56640 10 monclient: _add_conns ranks=[4,7,3,5,2,8,6,1,0] 2024-09-13T10:34:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.563+0000 7fa84fd56640 10 monclient(hunting): picked mon.noname-c con 0x7fa8480a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.563+0000 7fa84fd56640 10 monclient(hunting): picked mon.noname-i con 0x7fa8480a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.563+0000 7fa84fd56640 10 monclient(hunting): picked mon.noname-g con 0x7fa84813f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.563+0000 7fa84fd56640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8480a5fe0 con 0x7fa84813f9a0 2024-09-13T10:34:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.563+0000 7fa84fd56640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8480a8080 con 0x7fa8480a66d0 2024-09-13T10:34:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.563+0000 7fa84fd56640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8480a42c0 con 0x7fa8480a6ab0 2024-09-13T10:34:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.563+0000 7fa84fd56640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:43.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.563+0000 7fa84fd56640 10 monclient(hunting): authenticate will time out at 1023.069565s 2024-09-13T10:34:43.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.563+0000 7fa84daf2640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fa8480a66d0 0x7fa8480a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:47888/0 (socket says 172.21.15.181:47888) 2024-09-13T10:34:43.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.563+0000 7fa84daf2640 1 -- 172.21.15.181:0/3602345359 learned_addr learned my addr 172.21.15.181:0/3602345359 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:43.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.565+0000 7fa84daf2640 1 -- 172.21.15.181:0/3602345359 >> v1:172.21.15.181:6791/0 conn(0x7fa8480a66d0 legacy=0x7fa8480a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:43.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84e2f3640 1 -- 172.21.15.181:0/3602345359 >> v1:172.21.15.195:6790/0 conn(0x7fa84813f9a0 legacy=0x7fa848141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:43.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84d2f1640 1 -- 172.21.15.181:0/3602345359 >> v1:172.21.15.195:6792/0 conn(0x7fa8480a6ab0 legacy=0x7fa8480a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:43.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 1 -- 172.21.15.181:0/3602345359 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256241891 0 0) 0x7fa8480a5fe0 con 0x7fa84813f9a0 2024-09-13T10:34:43.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient(hunting): _negotiate 2024-09-13T10:34:43.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:43.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:43.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient(hunting): my global_id is 5880 2024-09-13T10:34:43.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 1 -- 172.21.15.181:0/3602345359 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa830003520 con 0x7fa84813f9a0 2024-09-13T10:34:43.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 1 -- 172.21.15.181:0/3602345359 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 487393571 0 0) 0x7fa830003520 con 0x7fa84813f9a0 2024-09-13T10:34:43.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 1 -- 172.21.15.181:0/3602345359 >> v1:172.21.15.195:6792/0 conn(0x7fa8480a6ab0 legacy=0x7fa8480a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:43.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 1 -- 172.21.15.181:0/3602345359 >> v1:172.21.15.181:6791/0 conn(0x7fa8480a66d0 legacy=0x7fa8480a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:43.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient: _finish_hunting 0 2024-09-13T10:34:43.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 1 monclient: found mon.noname-g 2024-09-13T10:34:43.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:43.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:34:43.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 1 -- 172.21.15.181:0/3602345359 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8481464e0 con 0x7fa84813f9a0 2024-09-13T10:34:43.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient: _finish_auth 0 2024-09-13T10:34:43.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient: _check_auth_tickets 2024-09-13T10:34:43.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:43.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 1 -- 172.21.15.181:0/3602345359 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa838001be0 con 0x7fa84813f9a0 2024-09-13T10:34:43.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84fd56640 5 monclient: authenticate success, global_id 5880 2024-09-13T10:34:43.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84fd56640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:43.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:43.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient: dump: 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:43.574 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84fd56640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 1 -- 172.21.15.181:0/3602345359 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa838003610 con 0x7fa84813f9a0 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 1 -- 172.21.15.181:0/3602345359 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa838003b40 con 0x7fa84813f9a0 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84fd56640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84fd56640 4 set_mon_vals no callback set 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.566+0000 7fa84caf0640 10 monclient: dump: 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:43.575 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:43.576 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.567+0000 7fa84fd56640 10 monclient: shutdown 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.567+0000 7fa84fd56640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.567+0000 7fa84fd56640 1 -- 172.21.15.181:0/3602345359 >> v1:172.21.15.195:6790/0 conn(0x7fa84813f9a0 legacy=0x7fa848141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.567+0000 7fa84fd56640 1 -- 172.21.15.181:0/3602345359 shutdown_connections 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.567+0000 7fa84fd56640 1 -- 172.21.15.181:0/3602345359 >> 172.21.15.181:0/3602345359 conn(0x7fa8480abcd0 msgr2=0x7fa8480ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.567+0000 7fa84fd56640 1 -- 172.21.15.181:0/3602345359 shutdown_connections 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.567+0000 7fa84fd56640 1 -- 172.21.15.181:0/3602345359 wait complete. 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 10 monclient: build_initial_monmap 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 10 monclient: monmap: 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:43.577 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 1 Processor -- start 2024-09-13T10:34:43.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 1 -- start start 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 10 monclient: init 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 10 monclient: _add_conns ranks=[6,2,8,7,3,1,0,4,5] 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 10 monclient(hunting): picked mon.noname-d con 0x7fa8480a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 10 monclient(hunting): picked mon.noname-b con 0x7fa8480a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 10 monclient(hunting): picked mon.noname-e con 0x7fa84813f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84813f3e0 con 0x7fa8480a6ab0 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8481430d0 con 0x7fa8480a66d0 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84813dbe0 con 0x7fa84813f9a0 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84fd56640 10 monclient(hunting): authenticate will time out at 1023.074893s 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84e2f3640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7fa84813f9a0 legacy=0x7fa8481d6f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84daf2640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fa8480a66d0 0x7fa848136700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54120/0 (socket says 172.21.15.181:54120) 2024-09-13T10:34:43.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.568+0000 7fa84daf2640 1 -- 172.21.15.181:0/715797319 learned_addr learned my addr 172.21.15.181:0/715797319 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:43.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.571+0000 7fa84daf2640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6792/0 conn(0x7fa8480a66d0 legacy=0x7fa848136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:43.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.571+0000 7fa84d2f1640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6790/0 conn(0x7fa8480a6ab0 legacy=0x7fa8481d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:43.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:43.770+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6793/0 conn(0x7fa84813f9a0 legacy=0x7fa8481d6f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:34:44.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:44.172+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6793/0 conn(0x7fa84813f9a0 legacy=0x7fa8481d6f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:34:44.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:44.973+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6793/0 conn(0x7fa84813f9a0 legacy=0x7fa8481d6f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:34:46.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 10 monclient(hunting): tick 2024-09-13T10:34:46.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:34:46.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:34:46.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:34:46.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6793/0 conn(0x7fa84813f9a0 legacy=0x7fa8481d6f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:34:46.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6792/0 conn(0x7fa8480a66d0 legacy=0x7fa848136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:46.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6790/0 conn(0x7fa8480a6ab0 legacy=0x7fa8481d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:46.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 10 monclient: _add_conns ranks=[1,7,5,4,0,3] 2024-09-13T10:34:46.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 10 monclient(hunting): picked mon.noname-f con 0x7fa8280038c0 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:46.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 10 monclient(hunting): picked mon.noname-i con 0x7fa828007550 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:46.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 10 monclient(hunting): picked mon.noname-h con 0x7fa82800b2e0 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:46.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84813d080 con 0x7fa8280038c0 2024-09-13T10:34:46.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84813dbe0 con 0x7fa82800b2e0 2024-09-13T10:34:46.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa828011110 con 0x7fa828007550 2024-09-13T10:34:46.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa8457fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:46.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.569+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6791/0 conn(0x7fa82800b2e0 legacy=0x7fa82800d760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6791/0 2024-09-13T10:34:46.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.571+0000 7fa84d2f1640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6792/0 conn(0x7fa828007550 legacy=0x7fa828009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:46.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.571+0000 7fa84daf2640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6789/0 conn(0x7fa8280038c0 legacy=0x7fa828005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:46.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:46.770+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6791/0 conn(0x7fa82800b2e0 legacy=0x7fa82800d760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6791/0 2024-09-13T10:34:47.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:47.171+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6791/0 conn(0x7fa82800b2e0 legacy=0x7fa82800d760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6791/0 2024-09-13T10:34:47.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:47.972+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6791/0 conn(0x7fa82800b2e0 legacy=0x7fa82800d760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6791/0 2024-09-13T10:34:49.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 10 monclient(hunting): tick 2024-09-13T10:34:49.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:34:49.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:34:49.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:34:49.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6792/0 conn(0x7fa828007550 legacy=0x7fa828009a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:49.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6791/0 conn(0x7fa82800b2e0 legacy=0x7fa82800d760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:34:49.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6789/0 conn(0x7fa8280038c0 legacy=0x7fa828005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:49.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 reap_dead start 2024-09-13T10:34:49.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 10 monclient: _add_conns ranks=[3,0,4] 2024-09-13T10:34:49.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 reap_dead start 2024-09-13T10:34:49.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 10 monclient(hunting): picked mon.noname-g con 0x7fa82800f2f0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:49.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 10 monclient(hunting): picked mon.noname-a con 0x7fa82800f770 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:49.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 10 monclient(hunting): picked mon.noname-c con 0x7fa8280064e0 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:49.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8280123b0 con 0x7fa82800f770 2024-09-13T10:34:49.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84813dbe0 con 0x7fa82800f2f0 2024-09-13T10:34:49.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8280068f0 con 0x7fa8280064e0 2024-09-13T10:34:49.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa8457fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:49.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.569+0000 7fa84d2f1640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6789/0 conn(0x7fa82800f770 legacy=0x7fa828009a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:34:49.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.572+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6791/0 conn(0x7fa8280064e0 legacy=0x7fa828005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:49.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.572+0000 7fa84daf2640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6790/0 conn(0x7fa82800f2f0 legacy=0x7fa82800d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:49.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:49.770+0000 7fa84d2f1640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6789/0 conn(0x7fa82800f770 legacy=0x7fa828009a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:34:50.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:50.171+0000 7fa84d2f1640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6789/0 conn(0x7fa82800f770 legacy=0x7fa828009a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:34:50.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:50.972+0000 7fa84d2f1640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6789/0 conn(0x7fa82800f770 legacy=0x7fa828009a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:34:52.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 10 monclient(hunting): tick 2024-09-13T10:34:52.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:34:52.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:34:52.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:34:52.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6791/0 conn(0x7fa8280064e0 legacy=0x7fa828005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:52.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6790/0 conn(0x7fa82800f2f0 legacy=0x7fa82800d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:52.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6789/0 conn(0x7fa82800f770 legacy=0x7fa828009a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:34:52.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 10 monclient: _add_conns ranks=[7,3,0,4,5,8,1,6,2] 2024-09-13T10:34:52.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 10 monclient(hunting): picked mon.noname-i con 0x7fa828006da0 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:52.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 10 monclient(hunting): picked mon.noname-g con 0x7fa82800f2f0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:52.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 10 monclient(hunting): picked mon.noname-a con 0x7fa82800f770 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:52.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa828006ac0 con 0x7fa82800f770 2024-09-13T10:34:52.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8280123b0 con 0x7fa82800f2f0 2024-09-13T10:34:52.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa828007220 con 0x7fa828006da0 2024-09-13T10:34:52.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa8457fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:52.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.570+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6789/0 conn(0x7fa82800f770 legacy=0x7fa828009a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:34:52.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.572+0000 7fa84daf2640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6792/0 conn(0x7fa828006da0 legacy=0x7fa82800df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:52.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.572+0000 7fa84d2f1640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6790/0 conn(0x7fa82800f2f0 legacy=0x7fa82800d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:52.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:52.771+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6789/0 conn(0x7fa82800f770 legacy=0x7fa828009a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:34:53.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:53.172+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6789/0 conn(0x7fa82800f770 legacy=0x7fa828009a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:34:53.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:53.973+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6789/0 conn(0x7fa82800f770 legacy=0x7fa828009a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:34:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:54.999+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012124690 0 0) 0x7fa828007220 con 0x7fa828006da0 2024-09-13T10:34:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:54.999+0000 7fa8467fc640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:54.999+0000 7fa8467fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:54.999+0000 7fa8467fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:54.999+0000 7fa8467fc640 10 monclient(hunting): my global_id is 55996 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:54.999+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa834003550 con 0x7fa828006da0 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 70823919 0 0) 0x7fa834003550 con 0x7fa828006da0 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa828007220 con 0x7fa828006da0 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa840001f90 con 0x7fa828006da0 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 10 monclient(hunting): dump: 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2991879294 0 0) 0x7fa828007220 con 0x7fa828006da0 2024-09-13T10:34:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6790/0 conn(0x7fa82800f2f0 legacy=0x7fa82800d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.181:6789/0 conn(0x7fa82800f770 legacy=0x7fa828009a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 10 monclient: _finish_hunting 0 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 1 monclient: found mon.i 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82800e640 con 0x7fa828006da0 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 10 monclient: _finish_auth 0 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 10 monclient: _check_auth_tickets 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa84fd56640 5 monclient: authenticate success, global_id 55996 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa84fd56640 10 monclient: _renew_subs 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa84fd56640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa84fd56640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa848068b30 con 0x7fa828006da0 2024-09-13T10:34:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa84fd56640 10 monclient: _renew_subs 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa84fd56640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa84fd56640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fa84813ee20 con 0x7fa828006da0 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa840004e10 con 0x7fa828006da0 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa840005340 con 0x7fa828006da0 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa8467fc640 10 monclient: dump: 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.000+0000 7fa847fff640 4 set_mon_vals no callback set 2024-09-13T10:34:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.002+0000 7fa84fd56640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.002+0000 7fa84fd56640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.002+0000 7fa84fd56640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.002+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa8400054e0 con 0x7fa828006da0 2024-09-13T10:34:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.002+0000 7fa84fd56640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa84806ccd0 con 0x7fa828006da0 2024-09-13T10:34:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.002+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(151..151 src has 1..151) ==== 3506+0+0 (unknown 2924825394 0 0) 0x7fa84004e2b0 con 0x7fa828006da0 2024-09-13T10:34:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.002+0000 7fa84d2f1640 10 monclient: get_auth_request con 0x7fa83403f9d0 auth_method 0 2024-09-13T10:34:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.009+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 <== mon.7 v1:172.21.15.195:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fa840017940 con 0x7fa828006da0 2024-09-13T10:34:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.009+0000 7fa8467fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.009+0000 7fa8467fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:55.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.256+0000 7fa84fd56640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:34:55.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.256+0000 7fa84fd56640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:34:55.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.256+0000 7fa84fd56640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:55.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.256+0000 7fa84fd56640 1 -- 172.21.15.181:0/715797319 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa84806ccd0 con 0x7fa828006da0 2024-09-13T10:34:55.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.256+0000 7fa8467fc640 1 -- 172.21.15.181:0/715797319 <== mon.7 v1:172.21.15.195:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2726 (unknown 254746657 0 903064762) 0x7fa840017240 con 0x7fa828006da0 2024-09-13T10:34:55.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.256+0000 7fa8467fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:34:55.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.256+0000 7fa8467fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:55.259 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":88,"quorum":[1,2,3,4,6,7],"quorum_names":["f","b","g","c","d","i"],"quorum_leader_name":"g","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:34:55.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.259+0000 7fa84fd56640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa83403f9d0 legacy=0x7fa834041e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.259+0000 7fa84fd56640 10 monclient: shutdown 2024-09-13T10:34:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.259+0000 7fa84fd56640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.259+0000 7fa84fd56640 1 -- 172.21.15.181:0/715797319 >> v1:172.21.15.195:6792/0 conn(0x7fa828006da0 legacy=0x7fa82800df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.259+0000 7fa84e2f3640 1 -- 172.21.15.181:0/715797319 reap_dead start 2024-09-13T10:34:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.259+0000 7fa84fd56640 1 -- 172.21.15.181:0/715797319 shutdown_connections 2024-09-13T10:34:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.259+0000 7fa84fd56640 1 -- 172.21.15.181:0/715797319 >> 172.21.15.181:0/715797319 conn(0x7fa8480abcd0 msgr2=0x7fa8480a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.259+0000 7fa84fd56640 1 -- 172.21.15.181:0/715797319 shutdown_connections 2024-09-13T10:34:55.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.259+0000 7fa84fd56640 1 -- 172.21.15.181:0/715797319 wait complete. 2024-09-13T10:34:55.272 INFO:tasks.mon_thrash.ceph_manager:quorum is size 6 2024-09-13T10:34:55.272 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon b 2024-09-13T10:34:55.273 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:34:55.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.368+0000 7f98e87f3640 10 monclient: get_monmap_and_config 2024-09-13T10:34:55.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.368+0000 7f98e87f3640 10 monclient: build_initial_monmap 2024-09-13T10:34:55.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.368+0000 7f98e87f3640 10 monclient: monmap: 2024-09-13T10:34:55.371 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:55.371 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.371 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:55.370525+0000 2024-09-13T10:34:55.371 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:55.370525+0000 2024-09-13T10:34:55.372 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:55.372 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.372 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:55.372 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:55.372 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:55.372 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:55.372 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:55.372 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:55.372 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:55.372 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:55.372 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:55.372 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.369+0000 7f98e87f3640 1 Processor -- start 2024-09-13T10:34:55.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.369+0000 7f98e87f3640 1 -- start start 2024-09-13T10:34:55.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.369+0000 7f98e87f3640 10 monclient: init 2024-09-13T10:34:55.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e87f3640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:55.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e87f3640 10 monclient: _add_conns ranks=[8,7,6,3,4,5,0,1,2] 2024-09-13T10:34:55.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e87f3640 10 monclient(hunting): picked mon.noname-e con 0x7f98e00a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:55.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e87f3640 10 monclient(hunting): picked mon.noname-i con 0x7f98e00a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:55.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e87f3640 10 monclient(hunting): picked mon.noname-d con 0x7f98e013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:55.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e87f3640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e00a4bc0 con 0x7f98e013f750 2024-09-13T10:34:55.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e87f3640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e013a320 con 0x7f98e00a8340 2024-09-13T10:34:55.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e87f3640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e00a8100 con 0x7f98e00a6640 2024-09-13T10:34:55.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e87f3640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:55.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e87f3640 10 monclient(hunting): authenticate will time out at 1034.876291s 2024-09-13T10:34:55.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e658f640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f98e00a6640 legacy=0x7f98e0139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:34:55.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e6d90640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f98e013f750 0x7f98e0141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:35126/0 (socket says 172.21.15.181:35126) 2024-09-13T10:34:55.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.370+0000 7f98e6d90640 1 -- 172.21.15.181:0/3391999821 learned_addr learned my addr 172.21.15.181:0/3391999821 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:55.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.372+0000 7f98e6d90640 1 -- 172.21.15.181:0/3391999821 >> v1:172.21.15.181:6792/0 conn(0x7f98e013f750 legacy=0x7f98e0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.372+0000 7f98e5d8e640 1 -- 172.21.15.181:0/3391999821 >> v1:172.21.15.195:6792/0 conn(0x7f98e00a8340 legacy=0x7f98e0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 1 -- 172.21.15.181:0/3391999821 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1639511607 0 0) 0x7f98e00a4bc0 con 0x7f98e013f750 2024-09-13T10:34:55.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient(hunting): my global_id is 5856 2024-09-13T10:34:55.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 1 -- 172.21.15.181:0/3391999821 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98cc003520 con 0x7f98e013f750 2024-09-13T10:34:55.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 1 -- 172.21.15.181:0/3391999821 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2779482282 0 0) 0x7f98e013a320 con 0x7f98e00a8340 2024-09-13T10:34:55.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient(hunting): my global_id is 56005 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 1 -- 172.21.15.181:0/3391999821 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98e00a4bc0 con 0x7f98e00a8340 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 1 -- 172.21.15.181:0/3391999821 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1799325035 0 0) 0x7f98cc003520 con 0x7f98e013f750 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 1 -- 172.21.15.181:0/3391999821 >> v1:172.21.15.181:6793/0 conn(0x7f98e00a6640 legacy=0x7f98e0139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 1 -- 172.21.15.181:0/3391999821 >> v1:172.21.15.195:6792/0 conn(0x7f98e00a8340 legacy=0x7f98e0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient: _finish_hunting 0 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 1 monclient: found mon.noname-d 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 1 -- 172.21.15.181:0/3391999821 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e00a48e0 con 0x7f98e013f750 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient: _finish_auth 0 2024-09-13T10:34:55.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient: _check_auth_tickets 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 1 -- 172.21.15.181:0/3391999821 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f98d8001e60 con 0x7f98e013f750 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e87f3640 5 monclient: authenticate success, global_id 5856 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e87f3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient: dump: 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.381 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e87f3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 1 -- 172.21.15.181:0/3391999821 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98d8004c20 con 0x7f98e013f750 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:55.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 1 -- 172.21.15.181:0/3391999821 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f98d8005190 con 0x7f98e013f750 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e87f3640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e87f3640 4 set_mon_vals no callback set 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e558d640 10 monclient: dump: 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.383 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e87f3640 10 monclient: shutdown 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e87f3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e87f3640 1 -- 172.21.15.181:0/3391999821 >> v1:172.21.15.181:6792/0 conn(0x7f98e013f750 legacy=0x7f98e0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e87f3640 1 -- 172.21.15.181:0/3391999821 shutdown_connections 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.373+0000 7f98e87f3640 1 -- 172.21.15.181:0/3391999821 >> 172.21.15.181:0/3391999821 conn(0x7f98e0077170 msgr2=0x7f98e00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:55.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.374+0000 7f98e87f3640 1 -- 172.21.15.181:0/3391999821 shutdown_connections 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.374+0000 7f98e87f3640 1 -- 172.21.15.181:0/3391999821 wait complete. 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.374+0000 7f98e87f3640 10 monclient: build_initial_monmap 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.374+0000 7f98e87f3640 10 monclient: monmap: 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:55.385 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.374+0000 7f98e87f3640 1 Processor -- start 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.374+0000 7f98e87f3640 1 -- start start 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.374+0000 7f98e87f3640 10 monclient: init 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e87f3640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e87f3640 10 monclient: _add_conns ranks=[3,2,5,8,6,4,1,7,0] 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e87f3640 10 monclient(hunting): picked mon.noname-g con 0x7f98e00a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e87f3640 10 monclient(hunting): picked mon.noname-b con 0x7f98e013f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:34:55.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e87f3640 10 monclient(hunting): picked mon.noname-h con 0x7f98e01d4310 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:55.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e87f3640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e00a11d0 con 0x7f98e013f750 2024-09-13T10:34:55.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e87f3640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e0142ed0 con 0x7f98e00a8340 2024-09-13T10:34:55.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e87f3640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e00a0360 con 0x7f98e01d4310 2024-09-13T10:34:55.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e87f3640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:55.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e87f3640 10 monclient(hunting): authenticate will time out at 1034.881331s 2024-09-13T10:34:55.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e6d90640 1 -- >> v1:172.21.15.195:6791/0 conn(0x7f98e01d4310 legacy=0x7f98e01d6700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6791/0 2024-09-13T10:34:55.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e5d8e640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f98e013f750 0x7f98e009dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:47608/0 (socket says 172.21.15.181:47608) 2024-09-13T10:34:55.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.375+0000 7f98e5d8e640 1 -- 172.21.15.181:0/3360674838 learned_addr learned my addr 172.21.15.181:0/3360674838 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:55.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98e5d8e640 1 -- 172.21.15.181:0/3360674838 >> v1:172.21.15.181:6790/0 conn(0x7f98e013f750 legacy=0x7f98e009dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98e658f640 1 -- 172.21.15.181:0/3360674838 >> v1:172.21.15.195:6790/0 conn(0x7f98e00a8340 legacy=0x7f98e009d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882340223 0 0) 0x7f98e00a11d0 con 0x7f98e013f750 2024-09-13T10:34:55.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 10 monclient(hunting): my global_id is 94277 2024-09-13T10:34:55.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98c4003550 con 0x7f98e013f750 2024-09-13T10:34:55.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3761995412 0 0) 0x7f98e0142ed0 con 0x7f98e00a8340 2024-09-13T10:34:55.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 10 monclient(hunting): my global_id is 5889 2024-09-13T10:34:55.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98e00a11d0 con 0x7f98e00a8340 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 187725932 0 0) 0x7f98c4003550 con 0x7f98e013f750 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98e0142ed0 con 0x7f98e013f750 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f98d0003610 con 0x7f98e013f750 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 10 monclient(hunting): dump: 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.393 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.377+0000 7f98d6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2778304017 0 0) 0x7f98e00a11d0 con 0x7f98e00a8340 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98c4003550 con 0x7f98e00a8340 2024-09-13T10:34:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f98dc0045a0 con 0x7f98e00a8340 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 10 monclient(hunting): dump: 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1813622970 0 0) 0x7f98e0142ed0 con 0x7f98e013f750 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 >> v1:172.21.15.195:6791/0 conn(0x7f98e01d4310 legacy=0x7f98e01d6700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 >> v1:172.21.15.195:6790/0 conn(0x7f98e00a8340 legacy=0x7f98e009d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 1 monclient: found mon.b 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e009ee70 con 0x7f98e013f750 2024-09-13T10:34:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98e87f3640 5 monclient: authenticate success, global_id 94277 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98e87f3640 10 monclient: _renew_subs 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98e87f3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98e87f3640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f98e009e1e0 con 0x7f98e013f750 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98e87f3640 10 monclient: _renew_subs 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98e87f3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98e87f3640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f98e00a2a30 con 0x7f98e013f750 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98d0003bf0 con 0x7f98e013f750 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f98d00040e0 con 0x7f98e013f750 2024-09-13T10:34:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98e4d8c640 4 set_mon_vals no callback set 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.378+0000 7f98d6ffd640 10 monclient: dump: 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.379+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f98d0004280 con 0x7f98e013f750 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.379+0000 7f98e87f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.379+0000 7f98e87f3640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f98c80065c0 con 0x7f98c8002860 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.379+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(151..151 src has 1..151) ==== 3506+0+0 (unknown 2924825394 0 0) 0x7f98d004e2f0 con 0x7f98e013f750 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.379+0000 7f98e6d90640 10 monclient: get_auth_request con 0x7f98c4040130 auth_method 0 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98e658f640 1 -- 172.21.15.181:0/3360674838 >> v1:172.21.15.181:6790/0 conn(0x7f98c8002860 legacy=0x7f98c8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838540628 0 0) 0x7f98c80065c0 con 0x7f98c8002860 2024-09-13T10:34:55.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 10 monclient(hunting): my global_id is 94286 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98e0142ed0 con 0x7f98c8002860 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 522363193 0 0) 0x7f98e0142ed0 con 0x7f98c8002860 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98c80065c0 con 0x7f98c8002860 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f98dc004e00 con 0x7f98c8002860 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 10 monclient: dump: 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.400 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3175242008 0 0) 0x7f98c80065c0 con 0x7f98c8002860 2024-09-13T10:34:55.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.381+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98c800a160 con 0x7f98c8002860 2024-09-13T10:34:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.382+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f98dc0070e0 con 0x7f98c8002860 2024-09-13T10:34:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.382+0000 7f98d6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.382+0000 7f98d6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.382+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 >> v1:172.21.15.181:6790/0 conn(0x7f98c8002860 legacy=0x7f98c8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.382+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 >> v1:172.21.15.181:6790/0 conn(0x7f98c8002860 legacy=0x7f98c8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.388+0000 7f98e87f3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.388+0000 7f98e87f3640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f98c8009e70 con 0x7f98c8009130 2024-09-13T10:34:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.390+0000 7f98e658f640 1 -- 172.21.15.181:0/3360674838 >> v1:172.21.15.181:6790/0 conn(0x7f98c8009130 legacy=0x7f98c80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.390+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72136977 0 0) 0x7f98c8009e70 con 0x7f98c8009130 2024-09-13T10:34:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.390+0000 7f98d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.390+0000 7f98d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.390+0000 7f98d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.390+0000 7f98d6ffd640 10 monclient(hunting): my global_id is 94295 2024-09-13T10:34:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.390+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98c80065c0 con 0x7f98c8009130 2024-09-13T10:34:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.390+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2467317051 0 0) 0x7f98c80065c0 con 0x7f98c8009130 2024-09-13T10:34:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.390+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98c8009e70 con 0x7f98c8009130 2024-09-13T10:34:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.390+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f98dc0057e0 con 0x7f98c8009130 2024-09-13T10:34:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.390+0000 7f98d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98d6ffd640 10 monclient: dump: 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.406 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 18884185 0 0) 0x7f98c8009e70 con 0x7f98c8009130 2024-09-13T10:34:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f98c800c410 con 0x7f98c8009130 2024-09-13T10:34:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7692 (unknown 0 0 4015783258) 0x7f98dc00a0e0 con 0x7f98c8009130 2024-09-13T10:34:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98d6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98d6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 >> v1:172.21.15.181:6790/0 conn(0x7f98c8009130 legacy=0x7f98c80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98d6ffd640 1 -- 172.21.15.181:0/3360674838 >> v1:172.21.15.181:6790/0 conn(0x7f98c8009130 legacy=0x7f98c80095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:55.407 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:55.407 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:55.407 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:55.407 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:55.407 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 88, 2024-09-13T10:34:55.407 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 35416, 2024-09-13T10:34:55.407 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:55.407 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:55.407 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:55.407 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:55.407 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:55.407 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:55.408 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:55.409 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:55.410 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:55.410 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:55.410 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:55.410 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:55.410 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:55.410 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.410 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:55.410 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:55.410 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:55.410 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:55.410 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:55.411 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:55.412 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:55.412 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:55.412 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:55.412 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:55.412 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:55.412 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:55.412 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:55.412 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:55.412 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:55.412 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:55.412 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.412 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.413 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.414 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:55.415 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.416 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.417 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.418 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.419 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:55.420 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.421 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.422 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:55.424 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:55.425 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.425 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.425 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.425 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.425 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.425 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:55.425 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:55.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.425 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:55.425 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:55.425 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:55.426 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:55.427 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:55.427 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.427 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.427 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:55.427 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98e87f3640 1 -- 172.21.15.181:0/3360674838 >> v1:172.21.15.195:6800/1839191919 conn(0x7f98c4040130 legacy=0x7f98c40425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98e87f3640 10 monclient: shutdown 2024-09-13T10:34:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98e87f3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98e87f3640 1 -- 172.21.15.181:0/3360674838 >> v1:172.21.15.181:6790/0 conn(0x7f98e013f750 legacy=0x7f98e009dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98e6d90640 1 -- 172.21.15.181:0/3360674838 reap_dead start 2024-09-13T10:34:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98e6d90640 1 -- 172.21.15.181:0/3360674838 reap_dead start 2024-09-13T10:34:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98e87f3640 1 -- 172.21.15.181:0/3360674838 shutdown_connections 2024-09-13T10:34:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98e87f3640 1 -- 172.21.15.181:0/3360674838 >> 172.21.15.181:0/3360674838 conn(0x7f98e00a6640 msgr2=0x7f98e0141e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98e87f3640 1 -- 172.21.15.181:0/3360674838 shutdown_connections 2024-09-13T10:34:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.391+0000 7f98e87f3640 1 -- 172.21.15.181:0/3360674838 wait complete. 2024-09-13T10:34:55.429 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:34:55.429 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon c 2024-09-13T10:34:55.430 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:34:55.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.524+0000 7fb15eafe640 10 monclient: get_monmap_and_config 2024-09-13T10:34:55.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.524+0000 7fb15eafe640 10 monclient: build_initial_monmap 2024-09-13T10:34:55.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.525+0000 7fb15eafe640 10 monclient: monmap: 2024-09-13T10:34:55.527 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:55.527 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.527 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:55.526616+0000 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:55.526616+0000 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:55.528 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.525+0000 7fb15eafe640 1 Processor -- start 2024-09-13T10:34:55.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.525+0000 7fb15eafe640 1 -- start start 2024-09-13T10:34:55.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.525+0000 7fb15eafe640 10 monclient: init 2024-09-13T10:34:55.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15eafe640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:55.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15eafe640 10 monclient: _add_conns ranks=[5,0,4,6,1,7,3,8,2] 2024-09-13T10:34:55.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15eafe640 10 monclient(hunting): picked mon.noname-h con 0x7fb1580a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:55.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15eafe640 10 monclient(hunting): picked mon.noname-a con 0x7fb1580a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:55.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15eafe640 10 monclient(hunting): picked mon.noname-c con 0x7fb15813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:55.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15eafe640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1580a4bc0 con 0x7fb1580a8340 2024-09-13T10:34:55.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15eafe640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15813a320 con 0x7fb15813f750 2024-09-13T10:34:55.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15eafe640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1580a8100 con 0x7fb1580a6640 2024-09-13T10:34:55.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15eafe640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:55.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15eafe640 10 monclient(hunting): authenticate will time out at 1035.032387s 2024-09-13T10:34:55.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb157fff640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fb1580a8340 legacy=0x7fb158139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:34:55.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15d09b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fb15813f750 0x7fb158141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51428/0 (socket says 172.21.15.181:51428) 2024-09-13T10:34:55.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15d09b640 1 -- 172.21.15.181:0/750648275 learned_addr learned my addr 172.21.15.181:0/750648275 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:55.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.526+0000 7fb15c89a640 1 -- 172.21.15.181:0/750648275 >> v1:172.21.15.195:6791/0 conn(0x7fb1580a6640 legacy=0x7fb158139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6791/0 2024-09-13T10:34:55.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.528+0000 7fb15d09b640 1 -- 172.21.15.181:0/750648275 >> v1:172.21.15.181:6791/0 conn(0x7fb15813f750 legacy=0x7fb158141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 1 -- 172.21.15.181:0/750648275 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926735731 0 0) 0x7fb15813a320 con 0x7fb15813f750 2024-09-13T10:34:55.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient(hunting): my global_id is 5971 2024-09-13T10:34:55.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 1 -- 172.21.15.181:0/750648275 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb140003520 con 0x7fb15813f750 2024-09-13T10:34:55.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 1 -- 172.21.15.181:0/750648275 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1614364556 0 0) 0x7fb140003520 con 0x7fb15813f750 2024-09-13T10:34:55.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 1 -- 172.21.15.181:0/750648275 >> v1:172.21.15.195:6791/0 conn(0x7fb1580a6640 legacy=0x7fb158139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:34:55.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 1 -- 172.21.15.181:0/750648275 >> v1:172.21.15.181:6789/0 conn(0x7fb1580a8340 legacy=0x7fb158139c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:34:55.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient: _finish_hunting 0 2024-09-13T10:34:55.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 1 monclient: found mon.noname-c 2024-09-13T10:34:55.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:55.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:34:55.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 1 -- 172.21.15.181:0/750648275 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1580a48e0 con 0x7fb15813f750 2024-09-13T10:34:55.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient: _finish_auth 0 2024-09-13T10:34:55.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient: _check_auth_tickets 2024-09-13T10:34:55.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:55.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb15eafe640 5 monclient: authenticate success, global_id 5971 2024-09-13T10:34:55.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 1 -- 172.21.15.181:0/750648275 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb150001e60 con 0x7fb15813f750 2024-09-13T10:34:55.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb15eafe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:55.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:34:55.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient: dump: 2024-09-13T10:34:55.538 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.538 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.538 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.538 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb15eafe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 1 -- 172.21.15.181:0/750648275 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb150004c20 con 0x7fb15813f750 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb15eafe640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 1 -- 172.21.15.181:0/750648275 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb150005190 con 0x7fb15813f750 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb15eafe640 4 set_mon_vals no callback set 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb1577fe640 10 monclient: dump: 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.540 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb15eafe640 10 monclient: shutdown 2024-09-13T10:34:55.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb15eafe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb15eafe640 1 -- 172.21.15.181:0/750648275 >> v1:172.21.15.181:6791/0 conn(0x7fb15813f750 legacy=0x7fb158141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb15eafe640 1 -- 172.21.15.181:0/750648275 shutdown_connections 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb15eafe640 1 -- 172.21.15.181:0/750648275 >> 172.21.15.181:0/750648275 conn(0x7fb158077170 msgr2=0x7fb1580abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.529+0000 7fb15eafe640 1 -- 172.21.15.181:0/750648275 shutdown_connections 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.530+0000 7fb15eafe640 1 -- 172.21.15.181:0/750648275 wait complete. 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.530+0000 7fb15eafe640 10 monclient: build_initial_monmap 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.530+0000 7fb15eafe640 10 monclient: monmap: 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:55.542 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.530+0000 7fb15eafe640 1 Processor -- start 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.530+0000 7fb15eafe640 1 -- start start 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.530+0000 7fb15eafe640 10 monclient: init 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.531+0000 7fb15eafe640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:55.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.531+0000 7fb15eafe640 10 monclient: _add_conns ranks=[6,3,1,8,4,5,0,2,7] 2024-09-13T10:34:55.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.531+0000 7fb15eafe640 10 monclient(hunting): picked mon.noname-d con 0x7fb1580a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:55.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.531+0000 7fb15eafe640 10 monclient(hunting): picked mon.noname-g con 0x7fb15813f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:55.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.531+0000 7fb15eafe640 10 monclient(hunting): picked mon.noname-f con 0x7fb1581d43a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:55.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.531+0000 7fb15eafe640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1580a10a0 con 0x7fb1581d43a0 2024-09-13T10:34:55.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.531+0000 7fb15eafe640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1580a9b40 con 0x7fb15813f750 2024-09-13T10:34:55.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.531+0000 7fb15eafe640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb158142b60 con 0x7fb1580a8340 2024-09-13T10:34:55.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.531+0000 7fb15eafe640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:55.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.531+0000 7fb15eafe640 10 monclient(hunting): authenticate will time out at 1035.037496s 2024-09-13T10:34:55.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.531+0000 7fb15c89a640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fb1580a8340 0x7fb15809d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:35136/0 (socket says 172.21.15.181:35136) 2024-09-13T10:34:55.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.531+0000 7fb15c89a640 1 -- 172.21.15.181:0/328326574 learned_addr learned my addr 172.21.15.181:0/328326574 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:55.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.533+0000 7fb15c89a640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.181:6792/0 conn(0x7fb1580a8340 legacy=0x7fb15809d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.533+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1601562676 0 0) 0x7fb158142b60 con 0x7fb1580a8340 2024-09-13T10:34:55.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.533+0000 7fb1557fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.533+0000 7fb1557fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.533+0000 7fb1557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.533+0000 7fb1557fa640 10 monclient(hunting): my global_id is 5865 2024-09-13T10:34:55.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.533+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb144003520 con 0x7fb1580a8340 2024-09-13T10:34:55.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.533+0000 7fb157fff640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.195:6790/0 conn(0x7fb15813f750 legacy=0x7fb15809da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.533+0000 7fb15d09b640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.195:6789/0 conn(0x7fb1581d43a0 legacy=0x7fb1581d6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2159328254 0 0) 0x7fb144003520 con 0x7fb1580a8340 2024-09-13T10:34:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb158142b60 con 0x7fb1580a8340 2024-09-13T10:34:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb148004730 con 0x7fb1580a8340 2024-09-13T10:34:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient(hunting): dump: 2024-09-13T10:34:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.552 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511707755 0 0) 0x7fb1580a9b40 con 0x7fb15813f750 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient(hunting): my global_id is 5898 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb144003520 con 0x7fb15813f750 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678831480 0 0) 0x7fb1580a10a0 con 0x7fb1581d43a0 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient(hunting): my global_id is 56017 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1580a9b40 con 0x7fb1581d43a0 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 725225024 0 0) 0x7fb158142b60 con 0x7fb1580a8340 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.195:6790/0 conn(0x7fb15813f750 legacy=0x7fb15809da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.195:6789/0 conn(0x7fb1581d43a0 legacy=0x7fb1581d6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient: _finish_hunting 0 2024-09-13T10:34:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 monclient: found mon.d 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1580a0230 con 0x7fb1580a8340 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient: _finish_auth 0 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient: _check_auth_tickets 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb15eafe640 5 monclient: authenticate success, global_id 5865 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb15eafe640 10 monclient: _renew_subs 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb15eafe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb15eafe640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb15809ed40 con 0x7fb1580a8340 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb15eafe640 10 monclient: _renew_subs 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb15eafe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb15eafe640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb1580a0dc0 con 0x7fb1580a8340 2024-09-13T10:34:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb148004950 con 0x7fb1580a8340 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb148004ec0 con 0x7fb1580a8340 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb156ffd640 4 set_mon_vals no callback set 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.534+0000 7fb1557fa640 10 monclient: dump: 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.556 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.535+0000 7fb15eafe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.535+0000 7fb15eafe640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb1380065c0 con 0x7fb138002860 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.535+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb1480051d0 con 0x7fb1580a8340 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.535+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(151..151 src has 1..151) ==== 3506+0+0 (unknown 2924825394 0 0) 0x7fb14804e350 con 0x7fb1580a8340 2024-09-13T10:34:55.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.535+0000 7fb15d09b640 10 monclient: get_auth_request con 0x7fb14403fd80 auth_method 0 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb157fff640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.181:6791/0 conn(0x7fb138002860 legacy=0x7fb138004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649651576 0 0) 0x7fb1380065c0 con 0x7fb138002860 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 10 monclient(hunting): my global_id is 5980 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb158142b60 con 0x7fb138002860 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 704855217 0 0) 0x7fb158142b60 con 0x7fb138002860 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1380065c0 con 0x7fb138002860 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb14c004530 con 0x7fb138002860 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:55.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 10 monclient: dump: 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3612700235 0 0) 0x7fb1380065c0 con 0x7fb138002860 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.537+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb13800a160 con 0x7fb138002860 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.538+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb14c006850 con 0x7fb138002860 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.538+0000 7fb1557fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.538+0000 7fb1557fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.538+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.181:6791/0 conn(0x7fb138002860 legacy=0x7fb138004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.538+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.181:6791/0 conn(0x7fb138002860 legacy=0x7fb138004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.544+0000 7fb15eafe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.544+0000 7fb15eafe640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb138009e50 con 0x7fb138009110 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb157fff640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.181:6791/0 conn(0x7fb138009110 legacy=0x7fb1380095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264126101 0 0) 0x7fb138009e50 con 0x7fb138009110 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 10 monclient(hunting): my global_id is 5989 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1380065c0 con 0x7fb138009110 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4016281849 0 0) 0x7fb1380065c0 con 0x7fb138009110 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb138009e50 con 0x7fb138009110 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb14c004f10 con 0x7fb138009110 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 10 monclient: dump: 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.562 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 815538621 0 0) 0x7fb138009e50 con 0x7fb138009110 2024-09-13T10:34:55.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.546+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb13800c3f0 con 0x7fb138009110 2024-09-13T10:34:55.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7860 (unknown 0 0 1692195593) 0x7fb14c006440 con 0x7fb138009110 2024-09-13T10:34:55.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb1557fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:55.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb1557fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:55.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.181:6791/0 conn(0x7fb138009110 legacy=0x7fb1380095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb1557fa640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.181:6791/0 conn(0x7fb138009110 legacy=0x7fb1380095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:55.563 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:55.563 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:55.563 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 88, 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 309997, 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:55.564 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:55.565 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:55.566 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:55.567 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:55.568 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:55.571 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.572 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.572 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.572 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:55.572 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:55.572 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.572 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.572 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.572 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:55.572 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.573 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:55.575 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:55.576 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:55.577 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:55.579 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:55.580 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.580 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.580 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.580 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:55.580 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:55.580 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.580 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.581 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:55.582 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:55.583 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:55.584 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:55.584 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.584 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.584 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:55.584 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb15eafe640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb14403fd80 legacy=0x7fb144042240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb15eafe640 10 monclient: shutdown 2024-09-13T10:34:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb15eafe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb15eafe640 1 -- 172.21.15.181:0/328326574 >> v1:172.21.15.181:6792/0 conn(0x7fb1580a8340 legacy=0x7fb15809d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb15d09b640 1 -- 172.21.15.181:0/328326574 reap_dead start 2024-09-13T10:34:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb15d09b640 1 -- 172.21.15.181:0/328326574 reap_dead start 2024-09-13T10:34:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb15eafe640 1 -- 172.21.15.181:0/328326574 shutdown_connections 2024-09-13T10:34:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb15eafe640 1 -- 172.21.15.181:0/328326574 >> 172.21.15.181:0/328326574 conn(0x7fb1580a6640 msgr2=0x7fb158141c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb15eafe640 1 -- 172.21.15.181:0/328326574 shutdown_connections 2024-09-13T10:34:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.547+0000 7fb15eafe640 1 -- 172.21.15.181:0/328326574 wait complete. 2024-09-13T10:34:55.586 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:34:55.586 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon d 2024-09-13T10:34:55.587 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:34:55.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.682+0000 7f413f110640 10 monclient: get_monmap_and_config 2024-09-13T10:34:55.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.682+0000 7f413f110640 10 monclient: build_initial_monmap 2024-09-13T10:34:55.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.682+0000 7f413f110640 10 monclient: monmap: 2024-09-13T10:34:55.685 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:55.685 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.685 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:55.684035+0000 2024-09-13T10:34:55.685 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:55.684035+0000 2024-09-13T10:34:55.685 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:55.685 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.685 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:55.685 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:55.685 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:55.685 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:55.686 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:55.686 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:55.686 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:55.686 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:55.686 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:55.686 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 1 Processor -- start 2024-09-13T10:34:55.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 1 -- start start 2024-09-13T10:34:55.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 10 monclient: init 2024-09-13T10:34:55.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:55.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 10 monclient: _add_conns ranks=[7,6,3,2,1,8,0,4,5] 2024-09-13T10:34:55.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 10 monclient(hunting): picked mon.noname-i con 0x7f41380a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:55.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 10 monclient(hunting): picked mon.noname-d con 0x7f41380a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:55.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 10 monclient(hunting): picked mon.noname-g con 0x7f413813f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:55.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41380a4bc0 con 0x7f413813f750 2024-09-13T10:34:55.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413813a320 con 0x7f41380a8340 2024-09-13T10:34:55.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41380a8100 con 0x7f41380a6640 2024-09-13T10:34:55.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:55.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f413f110640 10 monclient(hunting): authenticate will time out at 1035.189794s 2024-09-13T10:34:55.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f4137fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f41380a8340 0x7f4138139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:35144/0 (socket says 172.21.15.181:35144) 2024-09-13T10:34:55.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.683+0000 7f4137fff640 1 -- 172.21.15.181:0/4080408936 learned_addr learned my addr 172.21.15.181:0/4080408936 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:55.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f4137fff640 1 -- 172.21.15.181:0/4080408936 >> v1:172.21.15.181:6792/0 conn(0x7f41380a8340 legacy=0x7f4138139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 1 -- 172.21.15.181:0/4080408936 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4077329649 0 0) 0x7f413813a320 con 0x7f41380a8340 2024-09-13T10:34:55.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient(hunting): my global_id is 5874 2024-09-13T10:34:55.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 1 -- 172.21.15.181:0/4080408936 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4128003520 con 0x7f41380a8340 2024-09-13T10:34:55.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f413ceac640 1 -- 172.21.15.181:0/4080408936 >> v1:172.21.15.195:6792/0 conn(0x7f41380a6640 legacy=0x7f4138139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 1 -- 172.21.15.181:0/4080408936 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1185676832 0 0) 0x7f4128003520 con 0x7f41380a8340 2024-09-13T10:34:55.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f413d6ad640 1 -- 172.21.15.181:0/4080408936 >> v1:172.21.15.195:6790/0 conn(0x7f413813f750 legacy=0x7f4138141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 1 -- 172.21.15.181:0/4080408936 >> v1:172.21.15.195:6792/0 conn(0x7f41380a6640 legacy=0x7f4138139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 1 -- 172.21.15.181:0/4080408936 >> v1:172.21.15.195:6790/0 conn(0x7f413813f750 legacy=0x7f4138141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient: _finish_hunting 0 2024-09-13T10:34:55.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 1 monclient: found mon.noname-d 2024-09-13T10:34:55.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:55.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:34:55.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 1 -- 172.21.15.181:0/4080408936 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41380a48e0 con 0x7f41380a8340 2024-09-13T10:34:55.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient: _finish_auth 0 2024-09-13T10:34:55.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient: _check_auth_tickets 2024-09-13T10:34:55.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:55.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f413f110640 5 monclient: authenticate success, global_id 5874 2024-09-13T10:34:55.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 1 -- 172.21.15.181:0/4080408936 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4124001ae0 con 0x7f41380a8340 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient: dump: 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.694 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f413f110640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 1 -- 172.21.15.181:0/4080408936 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41240048a0 con 0x7f41380a8340 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 1 -- 172.21.15.181:0/4080408936 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4124004dd0 con 0x7f41380a8340 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f413f110640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f413f110640 4 set_mon_vals no callback set 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.686+0000 7f41377fe640 10 monclient: dump: 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.696 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.687+0000 7f413f110640 10 monclient: shutdown 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.687+0000 7f413f110640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.687+0000 7f413f110640 1 -- 172.21.15.181:0/4080408936 >> v1:172.21.15.181:6792/0 conn(0x7f41380a8340 legacy=0x7f4138139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.687+0000 7f413f110640 1 -- 172.21.15.181:0/4080408936 shutdown_connections 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.687+0000 7f413f110640 1 -- 172.21.15.181:0/4080408936 >> 172.21.15.181:0/4080408936 conn(0x7f4138077170 msgr2=0x7f41380abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.687+0000 7f413f110640 1 -- 172.21.15.181:0/4080408936 shutdown_connections 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.687+0000 7f413f110640 1 -- 172.21.15.181:0/4080408936 wait complete. 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.687+0000 7f413f110640 10 monclient: build_initial_monmap 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.687+0000 7f413f110640 10 monclient: monmap: 2024-09-13T10:34:55.697 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:55.698 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 1 Processor -- start 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 1 -- start start 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 10 monclient: init 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 10 monclient: _add_conns ranks=[4,3,6,8,5,7,1,2,0] 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 10 monclient(hunting): picked mon.noname-c con 0x7f41380a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 10 monclient(hunting): picked mon.noname-g con 0x7f413813f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 10 monclient(hunting): picked mon.noname-d con 0x7f41380a1b90 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41380a13d0 con 0x7f413813f750 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41381cf0f0 con 0x7f41380a8340 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41380aa120 con 0x7f41380a1b90 2024-09-13T10:34:55.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:55.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413f110640 10 monclient(hunting): authenticate will time out at 1035.194694s 2024-09-13T10:34:55.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413d6ad640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f41380a1b90 0x7f41381d65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:35150/0 (socket says 172.21.15.181:35150) 2024-09-13T10:34:55.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.688+0000 7f413d6ad640 1 -- 172.21.15.181:0/944233275 learned_addr learned my addr 172.21.15.181:0/944233275 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.690+0000 7f413ceac640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.181:6791/0 conn(0x7f41380a8340 legacy=0x7f41381ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.690+0000 7f413d6ad640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.181:6792/0 conn(0x7f41380a1b90 legacy=0x7f41381d65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2397221396 0 0) 0x7f41381cf0f0 con 0x7f41380a8340 2024-09-13T10:34:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): my global_id is 5998 2024-09-13T10:34:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f411c003550 con 0x7f41380a8340 2024-09-13T10:34:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306063829 0 0) 0x7f41380aa120 con 0x7f41380a1b90 2024-09-13T10:34:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): my global_id is 5883 2024-09-13T10:34:55.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41381cf0f0 con 0x7f41380a1b90 2024-09-13T10:34:55.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f4137fff640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.195:6790/0 conn(0x7f413813f750 legacy=0x7f41381ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3140145490 0 0) 0x7f411c003550 con 0x7f41380a8340 2024-09-13T10:34:55.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41380aa120 con 0x7f41380a8340 2024-09-13T10:34:55.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 791566269 0 0) 0x7f41381cf0f0 con 0x7f41380a1b90 2024-09-13T10:34:55.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f411c003550 con 0x7f41380a1b90 2024-09-13T10:34:55.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f412c003610 con 0x7f41380a8340 2024-09-13T10:34:55.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:55.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:34:55.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): dump: 2024-09-13T10:34:55.705 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.706 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4130002070 con 0x7f41380a1b90 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient(hunting): dump: 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.707 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 981516172 0 0) 0x7f41380aa120 con 0x7f41380a8340 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.181:6792/0 conn(0x7f41380a1b90 legacy=0x7f41381d65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.195:6790/0 conn(0x7f413813f750 legacy=0x7f41381ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient: _finish_hunting 0 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 monclient: found mon.c 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41380a9c40 con 0x7f41380a8340 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient: _finish_auth 0 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient: _check_auth_tickets 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f413f110640 5 monclient: authenticate success, global_id 5998 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f413f110640 10 monclient: _renew_subs 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f413f110640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f413f110640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f41380a28b0 con 0x7f41380a8340 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f413f110640 10 monclient: _renew_subs 2024-09-13T10:34:55.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f413f110640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f413f110640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f41380a10f0 con 0x7f41380a8340 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f412c003b40 con 0x7f41380a8340 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f412c004070 con 0x7f41380a8340 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f4136ffd640 4 set_mon_vals no callback set 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.691+0000 7f41357fa640 10 monclient: dump: 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.710 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.692+0000 7f413f110640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:55.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.692+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f412c004210 con 0x7f41380a8340 2024-09-13T10:34:55.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.692+0000 7f413f110640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f41180065c0 con 0x7f4118002860 2024-09-13T10:34:55.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.692+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(151..151 src has 1..151) ==== 3506+0+0 (unknown 2924825394 0 0) 0x7f412c04e1d0 con 0x7f41380a8340 2024-09-13T10:34:55.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.692+0000 7f413d6ad640 10 monclient: get_auth_request con 0x7f411c040050 auth_method 0 2024-09-13T10:34:55.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f4137fff640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.181:6792/0 conn(0x7f4118002860 legacy=0x7f4118004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3407588439 0 0) 0x7f41180065c0 con 0x7f4118002860 2024-09-13T10:34:55.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f41357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f41357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f41357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f41357fa640 10 monclient(hunting): my global_id is 5892 2024-09-13T10:34:55.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41380aa120 con 0x7f4118002860 2024-09-13T10:34:55.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 156077640 0 0) 0x7f41380aa120 con 0x7f4118002860 2024-09-13T10:34:55.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41180065c0 con 0x7f4118002860 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4124001320 con 0x7f4118002860 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f41357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f41357fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.694+0000 7f41357fa640 10 monclient: dump: 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.714 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.695+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4177902031 0 0) 0x7f41180065c0 con 0x7f4118002860 2024-09-13T10:34:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.695+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f411800a160 con 0x7f4118002860 2024-09-13T10:34:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.695+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4124004af0 con 0x7f4118002860 2024-09-13T10:34:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.695+0000 7f41357fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.695+0000 7f41357fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.695+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.181:6792/0 conn(0x7f4118002860 legacy=0x7f4118004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.695+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.181:6792/0 conn(0x7f4118002860 legacy=0x7f4118004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.701+0000 7f413f110640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.701+0000 7f413f110640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4118009e40 con 0x7f4118009100 2024-09-13T10:34:55.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.703+0000 7f4137fff640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.181:6792/0 conn(0x7f4118009100 legacy=0x7f4118009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.703+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3718193266 0 0) 0x7f4118009e40 con 0x7f4118009100 2024-09-13T10:34:55.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.703+0000 7f41357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.703+0000 7f41357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.703+0000 7f41357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.703+0000 7f41357fa640 10 monclient(hunting): my global_id is 5901 2024-09-13T10:34:55.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.703+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41180065c0 con 0x7f4118009100 2024-09-13T10:34:55.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3554755302 0 0) 0x7f41180065c0 con 0x7f4118009100 2024-09-13T10:34:55.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4118009e40 con 0x7f4118009100 2024-09-13T10:34:55.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4124004ed0 con 0x7f4118009100 2024-09-13T10:34:55.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:34:55.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 10 monclient: dump: 2024-09-13T10:34:55.718 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.718 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.718 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.718 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.718 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.718 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.718 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.718 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1308993933 0 0) 0x7f4118009e40 con 0x7f4118009100 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f411800c3f0 con 0x7f4118009100 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7526 (unknown 0 0 2557535411) 0x7f4124007d70 con 0x7f4118009100 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:55.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:55.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.181:6792/0 conn(0x7f4118009100 legacy=0x7f4118009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f41357fa640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.181:6792/0 conn(0x7f4118009100 legacy=0x7f4118009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:55.720 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:55.720 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:55.720 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:55.720 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 88, 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 310148, 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:55.721 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:55.722 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:55.723 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:55.724 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:55.725 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.726 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.727 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.728 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.729 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.730 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:55.731 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.732 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.734 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:55.735 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.736 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:55.738 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:55.739 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.739 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.739 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:55.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.739 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:55.739 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:55.739 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:55.739 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.739 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.739 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:55.739 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f413f110640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.195:6800/1839191919 conn(0x7f411c040050 legacy=0x7f411c042510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f413f110640 10 monclient: shutdown 2024-09-13T10:34:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f413f110640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f413f110640 1 -- 172.21.15.181:0/944233275 >> v1:172.21.15.181:6791/0 conn(0x7f41380a8340 legacy=0x7f41381ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f413d6ad640 1 -- 172.21.15.181:0/944233275 reap_dead start 2024-09-13T10:34:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f413d6ad640 1 -- 172.21.15.181:0/944233275 reap_dead start 2024-09-13T10:34:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f413f110640 1 -- 172.21.15.181:0/944233275 shutdown_connections 2024-09-13T10:34:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f413f110640 1 -- 172.21.15.181:0/944233275 >> 172.21.15.181:0/944233275 conn(0x7f41380a6640 msgr2=0x7f413813e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f413f110640 1 -- 172.21.15.181:0/944233275 shutdown_connections 2024-09-13T10:34:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.704+0000 7f413f110640 1 -- 172.21.15.181:0/944233275 wait complete. 2024-09-13T10:34:55.742 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:34:55.742 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon f 2024-09-13T10:34:55.742 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:34:55.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.837+0000 7f24b30d4640 10 monclient: get_monmap_and_config 2024-09-13T10:34:55.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.837+0000 7f24b30d4640 10 monclient: build_initial_monmap 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.837+0000 7f24b30d4640 10 monclient: monmap: 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:55.838940+0000 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:55.838940+0000 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:55.840 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:55.841 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:55.841 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:55.841 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:55.841 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 1 Processor -- start 2024-09-13T10:34:55.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 1 -- start start 2024-09-13T10:34:55.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 10 monclient: init 2024-09-13T10:34:55.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:55.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 10 monclient: _add_conns ranks=[8,2,1,3,7,6,5,4,0] 2024-09-13T10:34:55.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 10 monclient(hunting): picked mon.noname-e con 0x7f24ac0a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:55.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 10 monclient(hunting): picked mon.noname-b con 0x7f24ac0a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:34:55.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 10 monclient(hunting): picked mon.noname-f con 0x7f24ac13f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:55.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24ac0a4bc0 con 0x7f24ac13f750 2024-09-13T10:34:55.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24ac13a320 con 0x7f24ac0a8340 2024-09-13T10:34:55.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24ac0a8100 con 0x7f24ac0a6640 2024-09-13T10:34:55.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:55.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b0e70640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f24ac0a6640 legacy=0x7f24ac139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:34:55.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24b30d4640 10 monclient(hunting): authenticate will time out at 1035.344662s 2024-09-13T10:34:55.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24abfff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f24ac0a8340 0x7f24ac139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:47640/0 (socket says 172.21.15.181:47640) 2024-09-13T10:34:55.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.838+0000 7f24abfff640 1 -- 172.21.15.181:0/3032840794 learned_addr learned my addr 172.21.15.181:0/3032840794 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:55.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24abfff640 1 -- 172.21.15.181:0/3032840794 >> v1:172.21.15.181:6790/0 conn(0x7f24ac0a8340 legacy=0x7f24ac139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24b1671640 1 -- 172.21.15.181:0/3032840794 >> v1:172.21.15.195:6789/0 conn(0x7f24ac13f750 legacy=0x7f24ac141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 1 -- 172.21.15.181:0/3032840794 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156660697 0 0) 0x7f24ac13a320 con 0x7f24ac0a8340 2024-09-13T10:34:55.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient(hunting): my global_id is 94304 2024-09-13T10:34:55.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 1 -- 172.21.15.181:0/3032840794 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2498003520 con 0x7f24ac0a8340 2024-09-13T10:34:55.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 1 -- 172.21.15.181:0/3032840794 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352764601 0 0) 0x7f24ac0a4bc0 con 0x7f24ac13f750 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient(hunting): my global_id is 56026 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 1 -- 172.21.15.181:0/3032840794 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24ac13a320 con 0x7f24ac13f750 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 1 -- 172.21.15.181:0/3032840794 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1571393257 0 0) 0x7f2498003520 con 0x7f24ac0a8340 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 1 -- 172.21.15.181:0/3032840794 >> v1:172.21.15.181:6793/0 conn(0x7f24ac0a6640 legacy=0x7f24ac139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 1 -- 172.21.15.181:0/3032840794 >> v1:172.21.15.195:6789/0 conn(0x7f24ac13f750 legacy=0x7f24ac141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 1 monclient: found mon.noname-b 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:34:55.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 1 -- 172.21.15.181:0/3032840794 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ac0a48e0 con 0x7f24ac0a8340 2024-09-13T10:34:55.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient: _finish_auth 0 2024-09-13T10:34:55.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:34:55.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:55.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24b30d4640 5 monclient: authenticate success, global_id 94304 2024-09-13T10:34:55.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 1 -- 172.21.15.181:0/3032840794 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2494001e60 con 0x7f24ac0a8340 2024-09-13T10:34:55.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:34:55.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient: dump: 2024-09-13T10:34:55.850 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.850 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.850 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.850 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24b30d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:55.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 1 -- 172.21.15.181:0/3032840794 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2494004c20 con 0x7f24ac0a8340 2024-09-13T10:34:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 1 -- 172.21.15.181:0/3032840794 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f24940051d0 con 0x7f24ac0a8340 2024-09-13T10:34:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24b30d4640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24b30d4640 4 set_mon_vals no callback set 2024-09-13T10:34:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:34:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.841+0000 7f24ab7fe640 10 monclient: dump: 2024-09-13T10:34:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.852 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.842+0000 7f24b30d4640 10 monclient: shutdown 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.842+0000 7f24b30d4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:55.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.842+0000 7f24b30d4640 1 -- 172.21.15.181:0/3032840794 >> v1:172.21.15.181:6790/0 conn(0x7f24ac0a8340 legacy=0x7f24ac139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.842+0000 7f24b30d4640 1 -- 172.21.15.181:0/3032840794 shutdown_connections 2024-09-13T10:34:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.842+0000 7f24b30d4640 1 -- 172.21.15.181:0/3032840794 >> 172.21.15.181:0/3032840794 conn(0x7f24ac077170 msgr2=0x7f24ac0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.842+0000 7f24b30d4640 1 -- 172.21.15.181:0/3032840794 shutdown_connections 2024-09-13T10:34:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.842+0000 7f24b30d4640 1 -- 172.21.15.181:0/3032840794 wait complete. 2024-09-13T10:34:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.842+0000 7f24b30d4640 10 monclient: build_initial_monmap 2024-09-13T10:34:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.842+0000 7f24b30d4640 10 monclient: monmap: 2024-09-13T10:34:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:55.854 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:55.855 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:55.855 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 1 Processor -- start 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 1 -- start start 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 10 monclient: init 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 10 monclient: _add_conns ranks=[0,8,3,7,5,1,2,6,4] 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 10 monclient(hunting): picked mon.noname-a con 0x7f24ac0a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 10 monclient(hunting): picked mon.noname-e con 0x7f24ac13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 10 monclient(hunting): picked mon.noname-g con 0x7f24ac1d4310 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b0e70640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f24ac0a8340 legacy=0x7f24ac09d3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24ac0a1170 con 0x7f24ac0a8340 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24abfff640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f24ac13f750 legacy=0x7f24ac09dad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24ac0a9cd0 con 0x7f24ac1d4310 2024-09-13T10:34:55.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24ac142db0 con 0x7f24ac13f750 2024-09-13T10:34:55.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:55.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.843+0000 7f24b30d4640 10 monclient(hunting): authenticate will time out at 1035.349909s 2024-09-13T10:34:55.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.844+0000 7f24b1671640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f24ac1d4310 0x7f24ac1d6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:58674/0 (socket says 172.21.15.181:58674) 2024-09-13T10:34:55.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.844+0000 7f24b1671640 1 -- 172.21.15.181:0/535467600 learned_addr learned my addr 172.21.15.181:0/535467600 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:55.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.846+0000 7f24b1671640 1 -- 172.21.15.181:0/535467600 >> v1:172.21.15.195:6790/0 conn(0x7f24ac1d4310 legacy=0x7f24ac1d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.846+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566918250 0 0) 0x7f24ac0a9cd0 con 0x7f24ac1d4310 2024-09-13T10:34:55.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.846+0000 7f24a97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.846+0000 7f24a97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.846+0000 7f24a97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.846+0000 7f24a97fa640 10 monclient(hunting): my global_id is 5925 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.846+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f248c003520 con 0x7f24ac1d4310 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.846+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2564358885 0 0) 0x7f248c003520 con 0x7f24ac1d4310 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24ac0a9cd0 con 0x7f24ac1d4310 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f249c001d10 con 0x7f24ac1d4310 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 10 monclient(hunting): dump: 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.862 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.863 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.863 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.863 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.863 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.863 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.863 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.863 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.863 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.863 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.864 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:55.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3757845591 0 0) 0x7f24ac0a9cd0 con 0x7f24ac1d4310 2024-09-13T10:34:55.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 >> v1:172.21.15.181:6793/0 conn(0x7f24ac13f750 legacy=0x7f24ac09dad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:34:55.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 >> v1:172.21.15.181:6789/0 conn(0x7f24ac0a8340 legacy=0x7f24ac09d3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:34:55.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 10 monclient: _finish_hunting 0 2024-09-13T10:34:55.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 1 monclient: found mon.g 2024-09-13T10:34:55.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:55.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:34:55.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ac0a0300 con 0x7f24ac1d4310 2024-09-13T10:34:55.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 10 monclient: _finish_auth 0 2024-09-13T10:34:55.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 10 monclient: _check_auth_tickets 2024-09-13T10:34:55.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:55.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24b30d4640 5 monclient: authenticate success, global_id 5925 2024-09-13T10:34:55.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24b30d4640 10 monclient: _renew_subs 2024-09-13T10:34:55.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24b30d4640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:34:55.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24b30d4640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f24ac09ee10 con 0x7f24ac1d4310 2024-09-13T10:34:55.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24b30d4640 10 monclient: _renew_subs 2024-09-13T10:34:55.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24b30d4640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:34:55.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24b30d4640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f24ac09e230 con 0x7f24ac1d4310 2024-09-13T10:34:55.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f249c003a40 con 0x7f24ac1d4310 2024-09-13T10:34:55.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:55.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f249c003f70 con 0x7f24ac1d4310 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24aaffd640 4 set_mon_vals no callback set 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.847+0000 7f24a97fa640 10 monclient: dump: 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.866 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.848+0000 7f24b30d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.848+0000 7f24b30d4640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f24900065c0 con 0x7f2490002860 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.848+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f249c004110 con 0x7f24ac1d4310 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.848+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(151..151 src has 1..151) ==== 3506+0+0 (unknown 2924825394 0 0) 0x7f249c04e120 con 0x7f24ac1d4310 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.849+0000 7f24abfff640 10 monclient: get_auth_request con 0x7f248c03f9c0 auth_method 0 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24b0e70640 1 -- 172.21.15.181:0/535467600 >> v1:172.21.15.195:6789/0 conn(0x7f2490002860 legacy=0x7f2490004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 918594780 0 0) 0x7f24900065c0 con 0x7f2490002860 2024-09-13T10:34:55.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 10 monclient(hunting): my global_id is 56035 2024-09-13T10:34:55.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24ac0a9cd0 con 0x7f2490002860 2024-09-13T10:34:55.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1386456628 0 0) 0x7f24ac0a9cd0 con 0x7f2490002860 2024-09-13T10:34:55.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24900065c0 con 0x7f2490002860 2024-09-13T10:34:55.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f24a4004480 con 0x7f2490002860 2024-09-13T10:34:55.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:34:55.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 10 monclient: dump: 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.869 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.870 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.870 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.870 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.850+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3018406489 0 0) 0x7f24900065c0 con 0x7f2490002860 2024-09-13T10:34:55.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.851+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f249000a160 con 0x7f2490002860 2024-09-13T10:34:55.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.851+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f24a40067c0 con 0x7f2490002860 2024-09-13T10:34:55.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.851+0000 7f24a97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:55.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.851+0000 7f24a97fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:55.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.851+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 >> v1:172.21.15.195:6789/0 conn(0x7f2490002860 legacy=0x7f2490004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.851+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 >> v1:172.21.15.195:6789/0 conn(0x7f2490002860 legacy=0x7f2490004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:55.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.857+0000 7f24b30d4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:55.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.857+0000 7f24b30d4640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2490009e70 con 0x7f2490009130 2024-09-13T10:34:55.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.859+0000 7f24b0e70640 1 -- 172.21.15.181:0/535467600 >> v1:172.21.15.195:6789/0 conn(0x7f2490009130 legacy=0x7f24900095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:55.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 108273583 0 0) 0x7f2490009e70 con 0x7f2490009130 2024-09-13T10:34:55.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:55.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 10 monclient(hunting): my global_id is 56044 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24900065c0 con 0x7f2490009130 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 5024634 0 0) 0x7f24900065c0 con 0x7f2490009130 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2490009e70 con 0x7f2490009130 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f24a4004ea0 con 0x7f2490009130 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 10 monclient: dump: 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1768998351 0 0) 0x7f2490009e70 con 0x7f2490009130 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f249000c410 con 0x7f2490009130 2024-09-13T10:34:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7693 (unknown 0 0 2852860693) 0x7f24a4006390 con 0x7f2490009130 2024-09-13T10:34:55.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:55.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:55.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 >> v1:172.21.15.195:6789/0 conn(0x7f2490009130 legacy=0x7f24900095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.860+0000 7f24a97fa640 1 -- 172.21.15.181:0/535467600 >> v1:172.21.15.195:6789/0 conn(0x7f2490009130 legacy=0x7f24900095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:55.876 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:55.876 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:55.876 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:55.876 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:55.876 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 88, 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 310270, 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:55.877 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:55.878 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:55.880 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:55.881 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.882 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:55.883 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.883 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.883 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:55.883 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:55.883 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.883 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.883 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:55.884 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:55.885 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.886 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.886 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:55.886 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:55.886 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.886 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.886 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.886 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:55.886 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.887 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.888 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.889 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:55.890 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.891 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.893 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.894 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:55.895 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:55.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.895 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:55.895 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:55.895 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:55.895 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.895 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.895 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:55.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.895 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:55.895 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:55.895 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:55.896 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.896 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:55.896 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:55.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:55.896 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:55.896 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:55.896 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:34:55.896 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:55.896 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:55.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:55.897 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:55.897 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.861+0000 7f24b30d4640 1 -- 172.21.15.181:0/535467600 >> v1:172.21.15.195:6800/1839191919 conn(0x7f248c03f9c0 legacy=0x7f248c041e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.861+0000 7f24b30d4640 10 monclient: shutdown 2024-09-13T10:34:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.861+0000 7f24b30d4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.861+0000 7f24b30d4640 1 -- 172.21.15.181:0/535467600 >> v1:172.21.15.195:6790/0 conn(0x7f24ac1d4310 legacy=0x7f24ac1d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.861+0000 7f24b1671640 1 -- 172.21.15.181:0/535467600 reap_dead start 2024-09-13T10:34:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.861+0000 7f24b1671640 1 -- 172.21.15.181:0/535467600 reap_dead start 2024-09-13T10:34:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.861+0000 7f24b30d4640 1 -- 172.21.15.181:0/535467600 shutdown_connections 2024-09-13T10:34:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.861+0000 7f24b30d4640 1 -- 172.21.15.181:0/535467600 >> 172.21.15.181:0/535467600 conn(0x7f24ac0a6640 msgr2=0x7f24ac141cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.861+0000 7f24b30d4640 1 -- 172.21.15.181:0/535467600 shutdown_connections 2024-09-13T10:34:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.861+0000 7f24b30d4640 1 -- 172.21.15.181:0/535467600 wait complete. 2024-09-13T10:34:55.899 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:34:55.899 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon g 2024-09-13T10:34:55.900 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:34:55.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.995+0000 7f10de671640 10 monclient: get_monmap_and_config 2024-09-13T10:34:55.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.995+0000 7f10de671640 10 monclient: build_initial_monmap 2024-09-13T10:34:55.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.995+0000 7f10de671640 10 monclient: monmap: 2024-09-13T10:34:55.998 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:55.998 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:55.998 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:55.997178+0000 2024-09-13T10:34:55.998 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:55.997178+0000 2024-09-13T10:34:55.998 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:55.998 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:55.998 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:55.999 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:55.999 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:55.999 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:55.999 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:55.999 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:55.999 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:55.999 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:55.999 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:55.999 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 1 Processor -- start 2024-09-13T10:34:56.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 1 -- start start 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 10 monclient: init 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 10 monclient: _add_conns ranks=[0,4,3,5,2,7,1,6,8] 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 10 monclient(hunting): picked mon.noname-a con 0x7f10d80a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 10 monclient(hunting): picked mon.noname-c con 0x7f10d80a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 10 monclient(hunting): picked mon.noname-g con 0x7f10d813f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10d80a4bc0 con 0x7f10d80a6640 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10d813a320 con 0x7f10d813f750 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10d80a8100 con 0x7f10d80a8340 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10de671640 10 monclient(hunting): authenticate will time out at 1035.502991s 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.996+0000 7f10d7fff640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f10d80a6640 legacy=0x7f10d8139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:34:56.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.997+0000 7f10d77fe640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f10d80a8340 0x7f10d8139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51456/0 (socket says 172.21.15.181:51456) 2024-09-13T10:34:56.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.997+0000 7f10d77fe640 1 -- 172.21.15.181:0/3362961716 learned_addr learned my addr 172.21.15.181:0/3362961716 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:56.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.999+0000 7f10d77fe640 1 -- 172.21.15.181:0/3362961716 >> v1:172.21.15.181:6791/0 conn(0x7f10d80a8340 legacy=0x7f10d8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.999+0000 7f10dcc0e640 1 -- 172.21.15.181:0/3362961716 >> v1:172.21.15.195:6790/0 conn(0x7f10d813f750 legacy=0x7f10d8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.999+0000 7f10d6ffd640 1 -- 172.21.15.181:0/3362961716 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365425704 0 0) 0x7f10d813a320 con 0x7f10d813f750 2024-09-13T10:34:56.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.999+0000 7f10d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:34:56.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.999+0000 7f10d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:56.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.999+0000 7f10d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:56.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.999+0000 7f10d6ffd640 10 monclient(hunting): my global_id is 5934 2024-09-13T10:34:56.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:55.999+0000 7f10d6ffd640 1 -- 172.21.15.181:0/3362961716 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10c0003520 con 0x7f10d813f750 2024-09-13T10:34:56.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 1 -- 172.21.15.181:0/3362961716 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2161369113 0 0) 0x7f10c0003520 con 0x7f10d813f750 2024-09-13T10:34:56.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 1 -- 172.21.15.181:0/3362961716 >> v1:172.21.15.181:6791/0 conn(0x7f10d80a8340 legacy=0x7f10d8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 1 -- 172.21.15.181:0/3362961716 >> v1:172.21.15.181:6789/0 conn(0x7f10d80a6640 legacy=0x7f10d8139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 1 monclient: found mon.noname-g 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 1 -- 172.21.15.181:0/3362961716 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d80a48e0 con 0x7f10d813f750 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 1 -- 172.21.15.181:0/3362961716 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f10d0001eb0 con 0x7f10d813f750 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:34:56.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10d6ffd640 10 monclient: dump: 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:56.008 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10de671640 5 monclient: authenticate success, global_id 5934 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.002+0000 7f10de671640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.003+0000 7f10d6ffd640 1 -- 172.21.15.181:0/3362961716 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10d0003990 con 0x7f10d813f750 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.003+0000 7f10d6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.003+0000 7f10de671640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.003+0000 7f10de671640 4 set_mon_vals no callback set 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.003+0000 7f10d6ffd640 1 -- 172.21.15.181:0/3362961716 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f10d0003f40 con 0x7f10d813f750 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.003+0000 7f10d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.003+0000 7f10d6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.003+0000 7f10d6ffd640 10 monclient: dump: 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:56.009 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:56.010 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.003+0000 7f10de671640 10 monclient: shutdown 2024-09-13T10:34:56.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.003+0000 7f10de671640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:56.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.003+0000 7f10de671640 1 -- 172.21.15.181:0/3362961716 >> v1:172.21.15.195:6790/0 conn(0x7f10d813f750 legacy=0x7f10d8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.004+0000 7f10de671640 1 -- 172.21.15.181:0/3362961716 shutdown_connections 2024-09-13T10:34:56.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.004+0000 7f10de671640 1 -- 172.21.15.181:0/3362961716 >> 172.21.15.181:0/3362961716 conn(0x7f10d8077170 msgr2=0x7f10d80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:56.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.004+0000 7f10de671640 1 -- 172.21.15.181:0/3362961716 shutdown_connections 2024-09-13T10:34:56.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.004+0000 7f10de671640 1 -- 172.21.15.181:0/3362961716 wait complete. 2024-09-13T10:34:56.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.004+0000 7f10de671640 10 monclient: build_initial_monmap 2024-09-13T10:34:56.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.004+0000 7f10de671640 10 monclient: monmap: 2024-09-13T10:34:56.013 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:56.013 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:56.013 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:56.013 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:56.013 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:56.013 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:56.013 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:56.013 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.005+0000 7f10de671640 1 Processor -- start 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.005+0000 7f10de671640 1 -- start start 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.005+0000 7f10de671640 10 monclient: init 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10de671640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10de671640 10 monclient: _add_conns ranks=[4,8,1,0,7,3,6,2,5] 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10de671640 10 monclient(hunting): picked mon.noname-c con 0x7f10d80a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:56.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10de671640 10 monclient(hunting): picked mon.noname-e con 0x7f10d813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:34:56.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10de671640 10 monclient(hunting): picked mon.noname-f con 0x7f10d8138e40 addr v1:172.21.15.195:6789/0 2024-09-13T10:34:56.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10de671640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10d813e760 con 0x7f10d8138e40 2024-09-13T10:34:56.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10de671640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10d80a9f20 con 0x7f10d80a8340 2024-09-13T10:34:56.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10de671640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10d8142ff0 con 0x7f10d813f750 2024-09-13T10:34:56.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10de671640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:56.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10de671640 10 monclient(hunting): authenticate will time out at 1035.512159s 2024-09-13T10:34:56.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10d77fe640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f10d813f750 legacy=0x7f10d8138730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:34:56.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10d7fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f10d80a8340 0x7f10d81ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51472/0 (socket says 172.21.15.181:51472) 2024-09-13T10:34:56.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.006+0000 7f10d7fff640 1 -- 172.21.15.181:0/792995539 learned_addr learned my addr 172.21.15.181:0/792995539 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:56.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.008+0000 7f10d7fff640 1 -- 172.21.15.181:0/792995539 >> v1:172.21.15.181:6791/0 conn(0x7f10d80a8340 legacy=0x7f10d81ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.008+0000 7f10dcc0e640 1 -- 172.21.15.181:0/792995539 >> v1:172.21.15.195:6789/0 conn(0x7f10d8138e40 legacy=0x7f10d81d6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380207708 0 0) 0x7f10d813e760 con 0x7f10d8138e40 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 10 monclient(hunting): my global_id is 56053 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10c4003520 con 0x7f10d8138e40 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2101294347 0 0) 0x7f10c4003520 con 0x7f10d8138e40 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10d813e760 con 0x7f10d8138e40 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f10d0003e80 con 0x7f10d8138e40 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 10 monclient(hunting): dump: 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:56.018 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:56.019 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.012+0000 7f10d4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1055492879 0 0) 0x7f10d813e760 con 0x7f10d8138e40 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 >> v1:172.21.15.181:6793/0 conn(0x7f10d813f750 legacy=0x7f10d8138730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 >> v1:172.21.15.181:6791/0 conn(0x7f10d80a8340 legacy=0x7f10d81ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 1 monclient: found mon.f 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d813d9a0 con 0x7f10d8138e40 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 10 monclient: _finish_auth 0 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10de671640 5 monclient: authenticate success, global_id 56053 2024-09-13T10:34:56.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10de671640 10 monclient: _renew_subs 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10de671640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10de671640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f10d81d7da0 con 0x7f10d8138e40 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10de671640 10 monclient: _renew_subs 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10de671640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10de671640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f10d81d8150 con 0x7f10d8138e40 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10d0003990 con 0x7f10d8138e40 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f10d0004750 con 0x7f10d8138e40 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d67fc640 4 set_mon_vals no callback set 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.013+0000 7f10d4ff9640 10 monclient: dump: 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:56.021 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:56.022 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.014+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f10d0012020 con 0x7f10d8138e40 2024-09-13T10:34:56.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.014+0000 7f10de671640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:56.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.014+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(152..152 src has 1..152) ==== 3898+0+0 (unknown 590727743 0 0) 0x7f10d004e630 con 0x7f10d8138e40 2024-09-13T10:34:56.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.014+0000 7f10de671640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f10b80065c0 con 0x7f10b8002860 2024-09-13T10:34:56.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.014+0000 7f10d7fff640 10 monclient: get_auth_request con 0x7f10c403f970 auth_method 0 2024-09-13T10:34:56.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.017+0000 7f10d77fe640 1 -- 172.21.15.181:0/792995539 >> v1:172.21.15.195:6790/0 conn(0x7f10b8002860 legacy=0x7f10b8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.017+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671270114 0 0) 0x7f10b80065c0 con 0x7f10b8002860 2024-09-13T10:34:56.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.017+0000 7f10d4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.017+0000 7f10d4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.017+0000 7f10d4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.017+0000 7f10d4ff9640 10 monclient(hunting): my global_id is 5943 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.017+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10d813e760 con 0x7f10b8002860 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.018+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2887881082 0 0) 0x7f10d813e760 con 0x7f10b8002860 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.018+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10b80065c0 con 0x7f10b8002860 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.018+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f10cc001ae0 con 0x7f10b8002860 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.018+0000 7f10d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.018+0000 7f10d4ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.018+0000 7f10d4ff9640 10 monclient: dump: 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.025 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.018+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1872058346 0 0) 0x7f10b80065c0 con 0x7f10b8002860 2024-09-13T10:34:56.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.018+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10b800a160 con 0x7f10b8002860 2024-09-13T10:34:56.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.019+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f10cc0048a0 con 0x7f10b8002860 2024-09-13T10:34:56.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.019+0000 7f10d4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:56.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.019+0000 7f10d4ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:56.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.019+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 >> v1:172.21.15.195:6790/0 conn(0x7f10b8002860 legacy=0x7f10b8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.019+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 >> v1:172.21.15.195:6790/0 conn(0x7f10b8002860 legacy=0x7f10b8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:56.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.025+0000 7f10de671640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:56.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.025+0000 7f10de671640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f10b8009e50 con 0x7f10b8009110 2024-09-13T10:34:56.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d77fe640 1 -- 172.21.15.181:0/792995539 >> v1:172.21.15.195:6790/0 conn(0x7f10b8009110 legacy=0x7f10b80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127467953 0 0) 0x7f10b8009e50 con 0x7f10b8009110 2024-09-13T10:34:56.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:34:56.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:56.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:56.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 10 monclient(hunting): my global_id is 5952 2024-09-13T10:34:56.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10b80065c0 con 0x7f10b8009110 2024-09-13T10:34:56.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1902288656 0 0) 0x7f10b80065c0 con 0x7f10b8009110 2024-09-13T10:34:56.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10b8009e50 con 0x7f10b8009110 2024-09-13T10:34:56.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f10cc005000 con 0x7f10b8009110 2024-09-13T10:34:56.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:56.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:34:56.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 10 monclient: dump: 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:56.033 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:56.034 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:56.034 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 569787432 0 0) 0x7f10b8009e50 con 0x7f10b8009110 2024-09-13T10:34:56.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.028+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f10b800c3f0 con 0x7f10b8009110 2024-09-13T10:34:56.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7695 (unknown 0 0 1506874225) 0x7f10cc006570 con 0x7f10b8009110 2024-09-13T10:34:56.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10d4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:56.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10d4ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:56.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 >> v1:172.21.15.195:6790/0 conn(0x7f10b8009110 legacy=0x7f10b80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10d4ff9640 1 -- 172.21.15.181:0/792995539 >> v1:172.21.15.195:6790/0 conn(0x7f10b8009110 legacy=0x7f10b80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:56.034 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:56.034 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 88, 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 310444, 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:34:56.035 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:56.036 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:56.037 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:56.038 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:56.039 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.040 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:56.041 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:56.042 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.043 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.043 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.043 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:56.043 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:56.043 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.043 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.043 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:56.044 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.045 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.046 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:56.047 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.048 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:56.050 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.051 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:56.052 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:56.053 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:56.054 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:56.054 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.054 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.054 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:56.054 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10de671640 1 -- 172.21.15.181:0/792995539 >> v1:172.21.15.195:6800/1839191919 conn(0x7f10c403f970 legacy=0x7f10c4041e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10de671640 10 monclient: shutdown 2024-09-13T10:34:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10de671640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10de671640 1 -- 172.21.15.181:0/792995539 >> v1:172.21.15.195:6789/0 conn(0x7f10d8138e40 legacy=0x7f10d81d6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10dcc0e640 1 -- 172.21.15.181:0/792995539 reap_dead start 2024-09-13T10:34:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10dcc0e640 1 -- 172.21.15.181:0/792995539 reap_dead start 2024-09-13T10:34:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10de671640 1 -- 172.21.15.181:0/792995539 shutdown_connections 2024-09-13T10:34:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10de671640 1 -- 172.21.15.181:0/792995539 >> 172.21.15.181:0/792995539 conn(0x7f10d80a6640 msgr2=0x7f10d80a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10de671640 1 -- 172.21.15.181:0/792995539 shutdown_connections 2024-09-13T10:34:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.029+0000 7f10de671640 1 -- 172.21.15.181:0/792995539 wait complete. 2024-09-13T10:34:56.056 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:34:56.056 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon i 2024-09-13T10:34:56.057 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:34:56.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.152+0000 7f8cbe3a4640 10 monclient: get_monmap_and_config 2024-09-13T10:34:56.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.152+0000 7f8cbe3a4640 10 monclient: build_initial_monmap 2024-09-13T10:34:56.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.152+0000 7f8cbe3a4640 10 monclient: monmap: 2024-09-13T10:34:56.155 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:56.155 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.155 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:34:56.154337+0000 2024-09-13T10:34:56.155 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:34:56.154337+0000 2024-09-13T10:34:56.155 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:56.156 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.156 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:56.156 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:56.156 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:56.156 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:56.156 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:56.156 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:56.156 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:56.156 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:56.156 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:56.156 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.153+0000 7f8cbe3a4640 1 Processor -- start 2024-09-13T10:34:56.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.153+0000 7f8cbe3a4640 1 -- start start 2024-09-13T10:34:56.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.153+0000 7f8cbe3a4640 10 monclient: init 2024-09-13T10:34:56.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8cbe3a4640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:56.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8cbe3a4640 10 monclient: _add_conns ranks=[3,6,4,2,8,0,1,7,5] 2024-09-13T10:34:56.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8cbe3a4640 10 monclient(hunting): picked mon.noname-g con 0x7f8cb80a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:56.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8cbe3a4640 10 monclient(hunting): picked mon.noname-d con 0x7f8cb80a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:34:56.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8cbe3a4640 10 monclient(hunting): picked mon.noname-c con 0x7f8cb813f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:34:56.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8cbe3a4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb80a5fe0 con 0x7f8cb80a66d0 2024-09-13T10:34:56.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8cbe3a4640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb80a8080 con 0x7f8cb813f9a0 2024-09-13T10:34:56.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8cbe3a4640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb80a42c0 con 0x7f8cb80a6ab0 2024-09-13T10:34:56.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8cbe3a4640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:56.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8cbe3a4640 10 monclient(hunting): authenticate will time out at 1035.660164s 2024-09-13T10:34:56.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8caffff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f8cb80a6ab0 0x7f8cb80a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:35182/0 (socket says 172.21.15.181:35182) 2024-09-13T10:34:56.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8caffff640 1 -- 172.21.15.181:0/2675013101 learned_addr learned my addr 172.21.15.181:0/2675013101 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:56.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.154+0000 7f8cbc941640 1 --1- 172.21.15.181:0/2675013101 >> v1:172.21.15.181:6791/0 conn(0x7f8cb813f9a0 0x7f8cb8141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51474/0 (socket says 172.21.15.181:51474) 2024-09-13T10:34:56.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cbc941640 1 -- 172.21.15.181:0/2675013101 >> v1:172.21.15.181:6791/0 conn(0x7f8cb813f9a0 legacy=0x7f8cb8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8caffff640 1 -- 172.21.15.181:0/2675013101 >> v1:172.21.15.181:6792/0 conn(0x7f8cb80a6ab0 legacy=0x7f8cb80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1909178902 0 0) 0x7f8cb80a8080 con 0x7f8cb813f9a0 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient(hunting): my global_id is 6007 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ca4003520 con 0x7f8cb813f9a0 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb7fff640 1 -- 172.21.15.181:0/2675013101 >> v1:172.21.15.195:6790/0 conn(0x7f8cb80a66d0 legacy=0x7f8cb80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1135326555 0 0) 0x7f8cb80a42c0 con 0x7f8cb80a6ab0 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient(hunting): my global_id is 5910 2024-09-13T10:34:56.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cb80a8080 con 0x7f8cb80a6ab0 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 998111068 0 0) 0x7f8cb80a5fe0 con 0x7f8cb80a66d0 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient(hunting): my global_id is 5961 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cb80a42c0 con 0x7f8cb80a66d0 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2259744070 0 0) 0x7f8ca4003520 con 0x7f8cb813f9a0 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 >> v1:172.21.15.181:6792/0 conn(0x7f8cb80a6ab0 legacy=0x7f8cb80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 >> v1:172.21.15.195:6790/0 conn(0x7f8cb80a66d0 legacy=0x7f8cb80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient: _finish_hunting 0 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 monclient: found mon.noname-c 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:56.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb81464e0 con 0x7f8cb813f9a0 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient: _finish_auth 0 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient: _check_auth_tickets 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cbe3a4640 5 monclient: authenticate success, global_id 6007 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8cb0001e60 con 0x7f8cb813f9a0 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cbe3a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient: dump: 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.165 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cbe3a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8cb0004b60 con 0x7f8cb813f9a0 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 1 -- 172.21.15.181:0/2675013101 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8cb00050d0 con 0x7f8cb813f9a0 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cbe3a4640 10 monclient: get_monmap_and_config success 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cbe3a4640 4 set_mon_vals no callback set 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.156+0000 7f8cb77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.157+0000 7f8cb77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.157+0000 7f8cb77fe640 10 monclient: dump: 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.167 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.157+0000 7f8cbe3a4640 10 monclient: shutdown 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.157+0000 7f8cbe3a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.157+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/2675013101 >> v1:172.21.15.181:6791/0 conn(0x7f8cb813f9a0 legacy=0x7f8cb8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.157+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/2675013101 shutdown_connections 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.157+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/2675013101 >> 172.21.15.181:0/2675013101 conn(0x7f8cb80abcd0 msgr2=0x7f8cb80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.157+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/2675013101 shutdown_connections 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.157+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/2675013101 wait complete. 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 10 monclient: build_initial_monmap 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 10 monclient: monmap: 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:34:56.169 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 1 Processor -- start 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 1 -- start start 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 10 monclient: init 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 10 monclient: _reopen_session rank -1 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 10 monclient: _add_conns ranks=[3,5,7,1,2,4,0,6,8] 2024-09-13T10:34:56.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 10 monclient(hunting): picked mon.noname-g con 0x7f8cb80a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:34:56.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 10 monclient(hunting): picked mon.noname-h con 0x7f8cb80a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:34:56.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 10 monclient(hunting): picked mon.noname-i con 0x7f8cb813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:34:56.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb813f200 con 0x7f8cb80a66d0 2024-09-13T10:34:56.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb81379a0 con 0x7f8cb80a6ab0 2024-09-13T10:34:56.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb813ef20 con 0x7f8cb813f9a0 2024-09-13T10:34:56.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 10 monclient(hunting): _renew_subs 2024-09-13T10:34:56.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8cbe3a4640 10 monclient(hunting): authenticate will time out at 1035.664933s 2024-09-13T10:34:56.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.158+0000 7f8caffff640 1 -- >> v1:172.21.15.195:6791/0 conn(0x7f8cb80a6ab0 legacy=0x7f8cb813beb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6791/0 2024-09-13T10:34:56.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.159+0000 7f8cb7fff640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f8cb80a66d0 0x7f8cb813b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:58724/0 (socket says 172.21.15.181:58724) 2024-09-13T10:34:56.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.159+0000 7f8cb7fff640 1 -- 172.21.15.181:0/3700028708 learned_addr learned my addr 172.21.15.181:0/3700028708 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:34:56.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb7fff640 1 -- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6790/0 conn(0x7f8cb80a66d0 legacy=0x7f8cb813b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cbc941640 1 -- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6792/0 conn(0x7f8cb813f9a0 legacy=0x7f8cb81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb7fff640 1 --1- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6790/0 conn(0x7f8cb80a66d0 0x7f8cb813b7a0 :-1 s=OPENED pgs=441 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f8cb813f200 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:34:56.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1304079633 0 0) 0x7f8cb813ef20 con 0x7f8cb813f9a0 2024-09-13T10:34:56.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:56.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:56.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:56.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 10 monclient(hunting): my global_id is 56023 2024-09-13T10:34:56.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c98003520 con 0x7f8cb813f9a0 2024-09-13T10:34:56.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2431417059 0 0) 0x7f8c98003520 con 0x7f8cb813f9a0 2024-09-13T10:34:56.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8cb813ef20 con 0x7f8cb813f9a0 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8cb00020b0 con 0x7f8cb813f9a0 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 10 monclient(hunting): dump: 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:56.176 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.161+0000 7f8cb57fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1013052215 0 0) 0x7f8cb813ef20 con 0x7f8cb813f9a0 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6791/0 conn(0x7f8cb80a6ab0 legacy=0x7f8cb813beb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6790/0 conn(0x7f8cb80a66d0 legacy=0x7f8cb813b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 10 monclient: _finish_hunting 0 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 1 monclient: found mon.i 2024-09-13T10:34:56.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb80a22c0 con 0x7f8cb813f9a0 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 10 monclient: _finish_auth 0 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 10 monclient: _check_auth_tickets 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cbe3a4640 5 monclient: authenticate success, global_id 56023 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121299780 0 0) 0x7f8cb813f200 con 0x7f8cb80a66d0 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cbe3a4640 10 monclient: _renew_subs 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cbe3a4640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb813f620 con 0x7f8cb813f9a0 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cbe3a4640 10 monclient: _renew_subs 2024-09-13T10:34:56.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cbe3a4640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f8cb813c7a0 con 0x7f8cb813f9a0 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8cb0004b60 con 0x7f8cb813f9a0 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8cb0005640 con 0x7f8cb813f9a0 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb6ffd640 4 set_mon_vals no callback set 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cb57fa640 10 monclient: dump: 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.179 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cbe3a4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.162+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8c9c0065c0 con 0x7f8c9c002860 2024-09-13T10:34:56.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.163+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f8cb0011cc0 con 0x7f8cb813f9a0 2024-09-13T10:34:56.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.163+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(152..152 src has 1..152) ==== 3898+0+0 (unknown 590727743 0 0) 0x7f8cb004e740 con 0x7f8cb813f9a0 2024-09-13T10:34:56.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.163+0000 7f8caffff640 10 monclient: get_auth_request con 0x7f8c9803fac0 auth_method 0 2024-09-13T10:34:56.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb7fff640 1 -- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6792/0 conn(0x7f8c9c002860 legacy=0x7f8c9c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1553354216 0 0) 0x7f8c9c0065c0 con 0x7f8c9c002860 2024-09-13T10:34:56.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:56.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:56.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:56.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 10 monclient(hunting): my global_id is 56032 2024-09-13T10:34:56.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cb813f200 con 0x7f8c9c002860 2024-09-13T10:34:56.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2379571157 0 0) 0x7f8cb813f200 con 0x7f8c9c002860 2024-09-13T10:34:56.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c9c0065c0 con 0x7f8c9c002860 2024-09-13T10:34:56.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8ca8003610 con 0x7f8c9c002860 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 10 monclient: dump: 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:56.182 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3351029786 0 0) 0x7f8c9c0065c0 con 0x7f8c9c002860 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.165+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c9c00a160 con 0x7f8c9c002860 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.166+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8ca80057c0 con 0x7f8c9c002860 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.166+0000 7f8cb57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.166+0000 7f8cb57fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.166+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6792/0 conn(0x7f8c9c002860 legacy=0x7f8c9c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.166+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6792/0 conn(0x7f8c9c002860 legacy=0x7f8c9c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.172+0000 7f8cbe3a4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:34:56.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.172+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8c9c009e70 con 0x7f8c9c009130 2024-09-13T10:34:56.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb7fff640 1 -- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6792/0 conn(0x7f8c9c009130 legacy=0x7f8c9c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:34:56.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1211916180 0 0) 0x7f8c9c009e70 con 0x7f8c9c009130 2024-09-13T10:34:56.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:34:56.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:34:56.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:34:56.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 10 monclient(hunting): my global_id is 56041 2024-09-13T10:34:56.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c9c0065c0 con 0x7f8c9c009130 2024-09-13T10:34:56.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1960674832 0 0) 0x7f8c9c0065c0 con 0x7f8c9c009130 2024-09-13T10:34:56.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c9c009e70 con 0x7f8c9c009130 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8ca8003de0 con 0x7f8c9c009130 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 10 monclient: dump: 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:34:56.186 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2357058379 0 0) 0x7f8c9c009e70 con 0x7f8c9c009130 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8c9c00c410 con 0x7f8c9c009130 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7693 (unknown 0 0 2859350863) 0x7f8ca8004080 con 0x7f8c9c009130 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6792/0 conn(0x7f8c9c009130 legacy=0x7f8c9c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cb57fa640 1 -- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6792/0 conn(0x7f8c9c009130 legacy=0x7f8c9c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:34:56.188 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:34:56.188 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:56.188 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:56.188 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:34:56.188 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 88, 2024-09-13T10:34:56.188 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 310596, 2024-09-13T10:34:56.188 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:34:56.188 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:34:56.188 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:34:56.188 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:56.189 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:56.190 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:34:56.191 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:34:56.192 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:34:56.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:34:56.194 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.195 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.195 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.195 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:34:56.195 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:34:56.195 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.195 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.195 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.195 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:34:56.196 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.196 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.196 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.196 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:34:56.196 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:34:56.196 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.196 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.196 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:34:56.197 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.198 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.200 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.201 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.202 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:34:56.203 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:34:56.204 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.206 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:34:56.206 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:34:56.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.206 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:56.206 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:56.206 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:34:56.206 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.206 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:56.206 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:34:56.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.206 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:56.207 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:56.207 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:34:56.207 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.207 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:34:56.207 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:34:56.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:34:56.207 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:34:56.207 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:34:56.207 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:34:56.207 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:34:56.208 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:34:56.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:34:56.209 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:34:56.209 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:34:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6800/1839191919 conn(0x7f8c9803fac0 legacy=0x7f8c98041f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cbe3a4640 10 monclient: shutdown 2024-09-13T10:34:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cbe3a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:34:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/3700028708 >> v1:172.21.15.195:6792/0 conn(0x7f8cb813f9a0 legacy=0x7f8cb81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:34:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.175+0000 7f8cbc941640 1 -- 172.21.15.181:0/3700028708 reap_dead start 2024-09-13T10:34:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.176+0000 7f8cbc941640 1 -- 172.21.15.181:0/3700028708 reap_dead start 2024-09-13T10:34:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.176+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/3700028708 shutdown_connections 2024-09-13T10:34:56.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.176+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/3700028708 >> 172.21.15.181:0/3700028708 conn(0x7f8cb80abcd0 msgr2=0x7f8cb80a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:34:56.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.176+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/3700028708 shutdown_connections 2024-09-13T10:34:56.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:34:56.176+0000 7f8cbe3a4640 1 -- 172.21.15.181:0/3700028708 wait complete. 2024-09-13T10:34:56.211 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:34:56.211 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T10:34:57.118 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37885]: starting. 2024-09-13T10:34:57.118 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37885]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37884 2024-09-13T10:34:57.118 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37885]: created object 0... 2024-09-13T10:34:57.118 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37885]: created object 25... 2024-09-13T10:34:57.118 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37885]: created object 49... 2024-09-13T10:34:57.118 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37885]: finishing. 2024-09-13T10:34:57.118 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37885]: shutting down. 2024-09-13T10:34:58.248 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37886]: starting. 2024-09-13T10:34:58.248 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37886]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37884 2024-09-13T10:34:58.248 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37886]: shutting down. 2024-09-13T10:35:01.126 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:01.127 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37923]: starting. 2024-09-13T10:35:01.127 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37923]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37884 2024-09-13T10:35:01.127 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37923]: created object 0... 2024-09-13T10:35:01.127 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37923]: created object 25... 2024-09-13T10:35:01.127 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37923]: created object 49... 2024-09-13T10:35:01.127 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37923]: finishing. 2024-09-13T10:35:01.127 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[37923]: shutting down. 2024-09-13T10:35:01.164 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:01.164 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37925]: starting. 2024-09-13T10:35:01.164 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37925]: listing objects. 2024-09-13T10:35:01.164 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37925]: listed object 0... 2024-09-13T10:35:01.165 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37925]: listed object 25... 2024-09-13T10:35:01.165 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37925]: saw 50 objects 2024-09-13T10:35:01.165 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[37925]: shutting down. 2024-09-13T10:35:02.588 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:02.588 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37924]: starting. 2024-09-13T10:35:02.588 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37924]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37884 2024-09-13T10:35:02.588 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[37924]: shutting down. 2024-09-13T10:35:02.588 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:02.589 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:02.589 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:35:02.592 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:35:05.122 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37994]: starting. 2024-09-13T10:35:05.122 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37994]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37993 2024-09-13T10:35:05.122 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37994]: created object 0... 2024-09-13T10:35:05.122 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37994]: created object 25... 2024-09-13T10:35:05.122 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37994]: created object 49... 2024-09-13T10:35:05.122 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37994]: finishing. 2024-09-13T10:35:05.122 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[37994]: shutting down. 2024-09-13T10:35:06.491 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37995]: starting. 2024-09-13T10:35:06.491 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37995]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37993 2024-09-13T10:35:06.491 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[37995]: shutting down. 2024-09-13T10:35:08.634 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:08.634 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38030]: starting. 2024-09-13T10:35:08.635 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38030]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-37993 2024-09-13T10:35:08.635 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38030]: created object 0... 2024-09-13T10:35:08.635 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38030]: created object 25... 2024-09-13T10:35:08.635 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38030]: created object 49... 2024-09-13T10:35:08.635 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38030]: finishing. 2024-09-13T10:35:08.635 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38030]: shutting down. 2024-09-13T10:35:08.676 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:08.676 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38032]: starting. 2024-09-13T10:35:08.677 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38032]: listing objects. 2024-09-13T10:35:08.677 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38032]: listed object 0... 2024-09-13T10:35:08.677 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38032]: listed object 25... 2024-09-13T10:35:08.677 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38032]: saw 50 objects 2024-09-13T10:35:08.677 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38032]: shutting down. 2024-09-13T10:35:09.519 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:09.519 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38031]: starting. 2024-09-13T10:35:09.520 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38031]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-37993 2024-09-13T10:35:09.520 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38031]: shutting down. 2024-09-13T10:35:09.521 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:09.521 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:09.521 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:35:09.524 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:35:12.331 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38101]: starting. 2024-09-13T10:35:12.331 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38101]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38100 2024-09-13T10:35:12.331 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38101]: created object 0... 2024-09-13T10:35:12.331 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38101]: created object 25... 2024-09-13T10:35:12.331 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38101]: created object 49... 2024-09-13T10:35:12.331 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38101]: finishing. 2024-09-13T10:35:12.331 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38101]: shutting down. 2024-09-13T10:35:14.019 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38102]: starting. 2024-09-13T10:35:14.019 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38102]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38100 2024-09-13T10:35:14.019 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38102]: shutting down. 2024-09-13T10:35:15.734 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:15.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38137]: starting. 2024-09-13T10:35:15.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38137]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38100 2024-09-13T10:35:15.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38137]: created object 0... 2024-09-13T10:35:15.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38137]: created object 25... 2024-09-13T10:35:15.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38137]: created object 49... 2024-09-13T10:35:15.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38137]: finishing. 2024-09-13T10:35:15.735 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38137]: shutting down. 2024-09-13T10:35:15.772 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:15.772 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38139]: starting. 2024-09-13T10:35:15.772 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38139]: listing objects. 2024-09-13T10:35:15.772 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38139]: listed object 0... 2024-09-13T10:35:15.772 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38139]: listed object 25... 2024-09-13T10:35:15.772 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38139]: saw 50 objects 2024-09-13T10:35:15.772 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38139]: shutting down. 2024-09-13T10:35:16.212 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-13T10:35:16.212 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T10:35:16.212 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T10:35:16.215 INFO:tasks.ceph.mon.a:Started 2024-09-13T10:35:16.215 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-09-13T10:35:16.216 INFO:tasks.ceph.mon.e:Restarting daemon 2024-09-13T10:35:16.216 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-09-13T10:35:16.217 INFO:tasks.ceph.mon.e:Started 2024-09-13T10:35:16.218 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2024-09-13T10:35:16.218 INFO:tasks.ceph.mon.h:Restarting daemon 2024-09-13T10:35:16.218 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-09-13T10:35:16.220 INFO:tasks.ceph.mon.h:Started 2024-09-13T10:35:16.220 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:35:16.220 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:35:16.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.325+0000 7feb1ba49640 10 monclient: get_monmap_and_config 2024-09-13T10:35:16.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.325+0000 7feb1ba49640 10 monclient: build_initial_monmap 2024-09-13T10:35:16.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.325+0000 7feb1ba49640 10 monclient: monmap: 2024-09-13T10:35:16.328 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:16.328 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.328 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:16.326784+0000 2024-09-13T10:35:16.328 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:16.326784+0000 2024-09-13T10:35:16.328 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:16.328 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.328 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:16.328 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:16.328 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:16.328 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:16.329 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:16.329 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:16.329 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:16.329 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:16.329 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:16.329 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.325+0000 7feb1ba49640 1 Processor -- start 2024-09-13T10:35:16.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.326+0000 7feb1ba49640 1 -- start start 2024-09-13T10:35:16.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.326+0000 7feb1ba49640 10 monclient: init 2024-09-13T10:35:16.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.326+0000 7feb1ba49640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:16.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.326+0000 7feb1ba49640 10 monclient: _add_conns ranks=[2,7,1,5,3,8,4,0,6] 2024-09-13T10:35:16.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.326+0000 7feb1ba49640 10 monclient(hunting): picked mon.noname-b con 0x7feb14070b30 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:16.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.327+0000 7feb1ba49640 10 monclient(hunting): picked mon.noname-i con 0x7feb140a4ce0 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:16.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.327+0000 7feb1ba49640 10 monclient(hunting): picked mon.noname-f con 0x7feb14073920 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:16.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.327+0000 7feb1ba49640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb14073040 con 0x7feb14073920 2024-09-13T10:35:16.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.327+0000 7feb1ba49640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb140727a0 con 0x7feb14070b30 2024-09-13T10:35:16.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.327+0000 7feb1ba49640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb14072a80 con 0x7feb140a4ce0 2024-09-13T10:35:16.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.327+0000 7feb1ba49640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:16.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.327+0000 7feb1ba49640 10 monclient(hunting): authenticate will time out at 1055.833110s 2024-09-13T10:35:16.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.327+0000 7feb19fe6640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7feb14073920 0x7feb1413ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:54032/0 (socket says 172.21.15.181:54032) 2024-09-13T10:35:16.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.327+0000 7feb18fe4640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7feb140a4ce0 0x7feb1413b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:60742/0 (socket says 172.21.15.181:60742) 2024-09-13T10:35:16.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.327+0000 7feb19fe6640 1 -- 172.21.15.181:0/3070024370 learned_addr learned my addr 172.21.15.181:0/3070024370 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:16.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.329+0000 7feb19fe6640 1 -- 172.21.15.181:0/3070024370 >> v1:172.21.15.195:6789/0 conn(0x7feb14073920 legacy=0x7feb1413ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.329+0000 7feb18fe4640 1 -- 172.21.15.181:0/3070024370 >> v1:172.21.15.195:6792/0 conn(0x7feb140a4ce0 legacy=0x7feb1413b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.330+0000 7feb197e5640 1 -- 172.21.15.181:0/3070024370 >> v1:172.21.15.181:6790/0 conn(0x7feb14070b30 legacy=0x7feb14070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 1 -- 172.21.15.181:0/3070024370 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595199151 0 0) 0x7feb14073040 con 0x7feb14073920 2024-09-13T10:35:16.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient(hunting): my global_id is 56143 2024-09-13T10:35:16.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 1 -- 172.21.15.181:0/3070024370 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb00003520 con 0x7feb14073920 2024-09-13T10:35:16.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 1 -- 172.21.15.181:0/3070024370 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 238539745 0 0) 0x7feb14072a80 con 0x7feb140a4ce0 2024-09-13T10:35:16.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient(hunting): my global_id is 56131 2024-09-13T10:35:16.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 1 -- 172.21.15.181:0/3070024370 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb14073040 con 0x7feb140a4ce0 2024-09-13T10:35:16.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 1 -- 172.21.15.181:0/3070024370 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1867941900 0 0) 0x7feb00003520 con 0x7feb14073920 2024-09-13T10:35:16.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 1 -- 172.21.15.181:0/3070024370 >> v1:172.21.15.195:6792/0 conn(0x7feb140a4ce0 legacy=0x7feb1413b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 1 -- 172.21.15.181:0/3070024370 >> v1:172.21.15.181:6790/0 conn(0x7feb14070b30 legacy=0x7feb14070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:35:16.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 1 monclient: found mon.noname-f 2024-09-13T10:35:16.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:16.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:35:16.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 1 -- 172.21.15.181:0/3070024370 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb140a47e0 con 0x7feb14073920 2024-09-13T10:35:16.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient: _finish_auth 0 2024-09-13T10:35:16.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:35:16.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:16.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 1 -- 172.21.15.181:0/3070024370 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb0c001e60 con 0x7feb14073920 2024-09-13T10:35:16.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:35:16.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient: dump: 2024-09-13T10:35:16.341 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.341 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.341 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.341 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.341 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.341 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.341 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.341 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.341 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.342 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.342 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.342 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.342 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.342 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.342 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.342 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb1ba49640 5 monclient: authenticate success, global_id 56143 2024-09-13T10:35:16.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb1ba49640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:16.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 1 -- 172.21.15.181:0/3070024370 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb0c004c20 con 0x7feb14073920 2024-09-13T10:35:16.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:16.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb1ba49640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:16.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 1 -- 172.21.15.181:0/3070024370 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb0c005190 con 0x7feb14073920 2024-09-13T10:35:16.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb1ba49640 4 set_mon_vals no callback set 2024-09-13T10:35:16.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:16.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.335+0000 7feb0bfff640 10 monclient: dump: 2024-09-13T10:35:16.343 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.344 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.344 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.344 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.344 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.344 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.344 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.344 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.344 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.344 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.345 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.345 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.345 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.345 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.345 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.345 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.336+0000 7feb1ba49640 10 monclient: shutdown 2024-09-13T10:35:16.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.336+0000 7feb1ba49640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:16.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.336+0000 7feb1ba49640 1 -- 172.21.15.181:0/3070024370 >> v1:172.21.15.195:6789/0 conn(0x7feb14073920 legacy=0x7feb1413ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.336+0000 7feb1ba49640 1 -- 172.21.15.181:0/3070024370 shutdown_connections 2024-09-13T10:35:16.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.336+0000 7feb1ba49640 1 -- 172.21.15.181:0/3070024370 >> 172.21.15.181:0/3070024370 conn(0x7feb1406e8c0 msgr2=0x7feb1406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:16.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.336+0000 7feb1ba49640 1 -- 172.21.15.181:0/3070024370 shutdown_connections 2024-09-13T10:35:16.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.336+0000 7feb1ba49640 1 -- 172.21.15.181:0/3070024370 wait complete. 2024-09-13T10:35:16.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.337+0000 7feb1ba49640 10 monclient: build_initial_monmap 2024-09-13T10:35:16.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.337+0000 7feb1ba49640 10 monclient: monmap: 2024-09-13T10:35:16.349 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:16.349 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:16.349 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:16.349 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:16.349 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:16.349 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:16.350 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:16.350 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:16.350 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:16.350 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:16.350 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:16.350 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:16.350 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:16.350 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:16.350 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:16.350 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.337+0000 7feb1ba49640 1 Processor -- start 2024-09-13T10:35:16.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb1ba49640 1 -- start start 2024-09-13T10:35:16.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb1ba49640 10 monclient: init 2024-09-13T10:35:16.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb1ba49640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:16.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb1ba49640 10 monclient: _add_conns ranks=[7,0,1,5,3,8,2,4,6] 2024-09-13T10:35:16.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb1ba49640 10 monclient(hunting): picked mon.noname-i con 0x7feb14070b30 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:16.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb1ba49640 10 monclient(hunting): picked mon.noname-a con 0x7feb14073920 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:16.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb1ba49640 10 monclient(hunting): picked mon.noname-f con 0x7feb140a4ce0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:16.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb18fe4640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7feb14073920 0x7feb14121ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43442/0 (socket says 172.21.15.181:43442) 2024-09-13T10:35:16.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb18fe4640 1 -- 172.21.15.181:0/4238355200 learned_addr learned my addr 172.21.15.181:0/4238355200 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:16.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb141250f0 con 0x7feb14073920 2024-09-13T10:35:16.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb141253d0 con 0x7feb140a4ce0 2024-09-13T10:35:16.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb14124840 con 0x7feb14070b30 2024-09-13T10:35:16.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb1ba49640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:16.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.338+0000 7feb1ba49640 10 monclient(hunting): authenticate will time out at 1055.844870s 2024-09-13T10:35:16.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.340+0000 7feb197e5640 1 -- 172.21.15.181:0/4238355200 >> v1:172.21.15.195:6792/0 conn(0x7feb14070b30 legacy=0x7feb141218e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.340+0000 7feb18fe4640 1 -- 172.21.15.181:0/4238355200 >> v1:172.21.15.181:6789/0 conn(0x7feb14073920 legacy=0x7feb14121ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.340+0000 7feb19fe6640 1 -- 172.21.15.181:0/4238355200 >> v1:172.21.15.195:6789/0 conn(0x7feb140a4ce0 legacy=0x7feb141da940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4022289993 0 0) 0x7feb141253d0 con 0x7feb140a4ce0 2024-09-13T10:35:16.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient(hunting): my global_id is 56152 2024-09-13T10:35:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feaf8003520 con 0x7feb140a4ce0 2024-09-13T10:35:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3993816292 0 0) 0x7feaf8003520 con 0x7feb140a4ce0 2024-09-13T10:35:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb141253d0 con 0x7feb140a4ce0 2024-09-13T10:35:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb0c005110 con 0x7feb140a4ce0 2024-09-13T10:35:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:35:16.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient(hunting): dump: 2024-09-13T10:35:16.358 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.358 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.358 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.358 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.358 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.358 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.358 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.358 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.358 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.358 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.358 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.359 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.359 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.359 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.359 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.359 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:16.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 888919855 0 0) 0x7feb141253d0 con 0x7feb140a4ce0 2024-09-13T10:35:16.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 >> v1:172.21.15.195:6792/0 conn(0x7feb14070b30 legacy=0x7feb141218e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 >> v1:172.21.15.181:6789/0 conn(0x7feb14073920 legacy=0x7feb14121ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:35:16.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 1 monclient: found mon.f 2024-09-13T10:35:16.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:16.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:35:16.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb14123350 con 0x7feb140a4ce0 2024-09-13T10:35:16.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient: _finish_auth 0 2024-09-13T10:35:16.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:35:16.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:16.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb1ba49640 5 monclient: authenticate success, global_id 56152 2024-09-13T10:35:16.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb1ba49640 10 monclient: _renew_subs 2024-09-13T10:35:16.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb1ba49640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:35:16.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb14122700 con 0x7feb140a4ce0 2024-09-13T10:35:16.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb0c0020b0 con 0x7feb140a4ce0 2024-09-13T10:35:16.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:16.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb0c005ac0 con 0x7feb140a4ce0 2024-09-13T10:35:16.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:16.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb09ffb640 10 monclient: dump: 2024-09-13T10:35:16.361 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.361 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.361 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.361 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.361 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.362 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.362 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.362 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.362 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.362 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.362 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.362 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.362 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.362 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.362 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.363 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.349+0000 7feb0b7fe640 4 set_mon_vals no callback set 2024-09-13T10:35:16.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.350+0000 7feb1ba49640 10 monclient: _renew_subs 2024-09-13T10:35:16.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.350+0000 7feb1ba49640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:35:16.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.350+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feb1413f090 con 0x7feb140a4ce0 2024-09-13T10:35:16.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.350+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7feb0c012140 con 0x7feb140a4ce0 2024-09-13T10:35:16.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.351+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(169..169 src has 1..169) ==== 3898+0+0 (unknown 719054882 0 0) 0x7feb0c04e760 con 0x7feb140a4ce0 2024-09-13T10:35:16.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.351+0000 7feb197e5640 10 monclient: get_auth_request con 0x7feaf803fa60 auth_method 0 2024-09-13T10:35:16.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.351+0000 7feb1ba49640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:16.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.351+0000 7feb1ba49640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:16.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.351+0000 7feb1ba49640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:35:16.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.351+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 --> v1:172.21.15.195:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb140008d0 con 0x7feb140a4ce0 2024-09-13T10:35:16.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.356+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 <== mon.1 v1:172.21.15.195:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7feb0c017cb0 con 0x7feb140a4ce0 2024-09-13T10:35:16.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.356+0000 7feb09ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:16.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.356+0000 7feb09ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:16.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.598+0000 7feb1ba49640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:35:16.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.598+0000 7feb1ba49640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:35:16.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.598+0000 7feb1ba49640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:35:16.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.598+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 --> v1:172.21.15.195:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feb140715f0 con 0x7feb140a4ce0 2024-09-13T10:35:16.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.599+0000 7feb09ffb640 1 -- 172.21.15.181:0/4238355200 <== mon.1 v1:172.21.15.195:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 4055163467) 0x7feb0c0175b0 con 0x7feb140a4ce0 2024-09-13T10:35:16.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.599+0000 7feb09ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:35:16.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.599+0000 7feb09ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:16.602 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":90,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:35:16.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.601+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 >> v1:172.21.15.195:6800/1839191919 conn(0x7feaf803fa60 legacy=0x7feaf8041f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.601+0000 7feb1ba49640 10 monclient: shutdown 2024-09-13T10:35:16.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.601+0000 7feb1ba49640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:16.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.601+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 >> v1:172.21.15.195:6789/0 conn(0x7feb140a4ce0 legacy=0x7feb141da940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.601+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 shutdown_connections 2024-09-13T10:35:16.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.601+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 >> 172.21.15.181:0/4238355200 conn(0x7feb1406e8c0 msgr2=0x7feb140a76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:16.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.601+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 shutdown_connections 2024-09-13T10:35:16.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.601+0000 7feb1ba49640 1 -- 172.21.15.181:0/4238355200 wait complete. 2024-09-13T10:35:16.614 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:35:16.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:35:16.614 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:35:16.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.709+0000 7fbe46d1e640 10 monclient: get_monmap_and_config 2024-09-13T10:35:16.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.709+0000 7fbe46d1e640 10 monclient: build_initial_monmap 2024-09-13T10:35:16.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.709+0000 7fbe46d1e640 10 monclient: monmap: 2024-09-13T10:35:16.712 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:16.712 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.712 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:16.711334+0000 2024-09-13T10:35:16.712 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:16.711334+0000 2024-09-13T10:35:16.712 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:16.712 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.713 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:16.713 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:16.713 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:16.713 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:16.713 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:16.713 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:16.713 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:16.713 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:16.713 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:16.713 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.710+0000 7fbe46d1e640 1 Processor -- start 2024-09-13T10:35:16.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.710+0000 7fbe46d1e640 1 -- start start 2024-09-13T10:35:16.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.710+0000 7fbe46d1e640 10 monclient: init 2024-09-13T10:35:16.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.710+0000 7fbe46d1e640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:16.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.710+0000 7fbe46d1e640 10 monclient: _add_conns ranks=[1,0,4,2,7,3,6,8,5] 2024-09-13T10:35:16.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.710+0000 7fbe46d1e640 10 monclient(hunting): picked mon.noname-f con 0x7fbe400a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:16.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.710+0000 7fbe46d1e640 10 monclient(hunting): picked mon.noname-a con 0x7fbe400a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:16.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.710+0000 7fbe46d1e640 10 monclient(hunting): picked mon.noname-c con 0x7fbe4013f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:16.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.710+0000 7fbe46d1e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe400a4bc0 con 0x7fbe400a8340 2024-09-13T10:35:16.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.711+0000 7fbe46d1e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe4013a320 con 0x7fbe400a6640 2024-09-13T10:35:16.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.711+0000 7fbe46d1e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe400a8100 con 0x7fbe4013f750 2024-09-13T10:35:16.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.711+0000 7fbe46d1e640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:16.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.711+0000 7fbe46d1e640 10 monclient(hunting): authenticate will time out at 1056.217041s 2024-09-13T10:35:16.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.711+0000 7fbe3ffff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fbe400a8340 0x7fbe40139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43446/0 (socket says 172.21.15.181:43446) 2024-09-13T10:35:16.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.711+0000 7fbe3ffff640 1 -- 172.21.15.181:0/455695286 learned_addr learned my addr 172.21.15.181:0/455695286 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:16.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.711+0000 7fbe452bb640 1 --1- 172.21.15.181:0/455695286 >> v1:172.21.15.181:6791/0 conn(0x7fbe4013f750 0x7fbe40141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42534/0 (socket says 172.21.15.181:42534) 2024-09-13T10:35:16.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3ffff640 1 -- 172.21.15.181:0/455695286 >> v1:172.21.15.181:6789/0 conn(0x7fbe400a8340 legacy=0x7fbe40139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe452bb640 1 -- 172.21.15.181:0/455695286 >> v1:172.21.15.181:6791/0 conn(0x7fbe4013f750 legacy=0x7fbe40141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe44aba640 1 -- 172.21.15.181:0/455695286 >> v1:172.21.15.195:6789/0 conn(0x7fbe400a6640 legacy=0x7fbe40139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 1 -- 172.21.15.181:0/455695286 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 720996269 0 0) 0x7fbe4013a320 con 0x7fbe400a6640 2024-09-13T10:35:16.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient(hunting): my global_id is 56161 2024-09-13T10:35:16.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 1 -- 172.21.15.181:0/455695286 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe30003520 con 0x7fbe400a6640 2024-09-13T10:35:16.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 1 -- 172.21.15.181:0/455695286 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4178592169 0 0) 0x7fbe30003520 con 0x7fbe400a6640 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 1 -- 172.21.15.181:0/455695286 >> v1:172.21.15.181:6791/0 conn(0x7fbe4013f750 legacy=0x7fbe40141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 1 -- 172.21.15.181:0/455695286 >> v1:172.21.15.181:6789/0 conn(0x7fbe400a8340 legacy=0x7fbe40139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 1 monclient: found mon.noname-f 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 1 -- 172.21.15.181:0/455695286 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe400a48e0 con 0x7fbe400a6640 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe46d1e640 5 monclient: authenticate success, global_id 56161 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 1 -- 172.21.15.181:0/455695286 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbe34001bf0 con 0x7fbe400a6640 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe46d1e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:16.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:35:16.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient: dump: 2024-09-13T10:35:16.722 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.722 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.722 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.722 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.722 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.722 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.722 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.722 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.722 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe46d1e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 1 -- 172.21.15.181:0/455695286 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe34003610 con 0x7fbe400a6640 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 1 -- 172.21.15.181:0/455695286 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbe34003b40 con 0x7fbe400a6640 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe46d1e640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:16.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe46d1e640 4 set_mon_vals no callback set 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.713+0000 7fbe3f7fe640 10 monclient: dump: 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.724 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.725 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.725 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.725 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.725 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.725 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.714+0000 7fbe46d1e640 10 monclient: shutdown 2024-09-13T10:35:16.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.714+0000 7fbe46d1e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:16.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.714+0000 7fbe46d1e640 1 -- 172.21.15.181:0/455695286 >> v1:172.21.15.195:6789/0 conn(0x7fbe400a6640 legacy=0x7fbe40139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.714+0000 7fbe46d1e640 1 -- 172.21.15.181:0/455695286 shutdown_connections 2024-09-13T10:35:16.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.714+0000 7fbe46d1e640 1 -- 172.21.15.181:0/455695286 >> 172.21.15.181:0/455695286 conn(0x7fbe40077170 msgr2=0x7fbe400abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:16.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.714+0000 7fbe46d1e640 1 -- 172.21.15.181:0/455695286 shutdown_connections 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.714+0000 7fbe46d1e640 1 -- 172.21.15.181:0/455695286 wait complete. 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.715+0000 7fbe46d1e640 10 monclient: build_initial_monmap 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.715+0000 7fbe46d1e640 10 monclient: monmap: 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:16.726 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.715+0000 7fbe46d1e640 1 Processor -- start 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.715+0000 7fbe46d1e640 1 -- start start 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.715+0000 7fbe46d1e640 10 monclient: init 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.716+0000 7fbe46d1e640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.716+0000 7fbe46d1e640 10 monclient: _add_conns ranks=[2,5,4,8,6,7,3,0,1] 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.716+0000 7fbe46d1e640 10 monclient(hunting): picked mon.noname-b con 0x7fbe400a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.716+0000 7fbe46d1e640 10 monclient(hunting): picked mon.noname-h con 0x7fbe4013f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.716+0000 7fbe46d1e640 10 monclient(hunting): picked mon.noname-c con 0x7fbe40142490 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:16.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.716+0000 7fbe46d1e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe4013c850 con 0x7fbe400a8340 2024-09-13T10:35:16.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.716+0000 7fbe46d1e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe400a9cd0 con 0x7fbe40142490 2024-09-13T10:35:16.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.716+0000 7fbe46d1e640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe4013b050 con 0x7fbe4013f750 2024-09-13T10:35:16.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.716+0000 7fbe46d1e640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:16.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.716+0000 7fbe46d1e640 10 monclient(hunting): authenticate will time out at 1056.222422s 2024-09-13T10:35:16.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.716+0000 7fbe452bb640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fbe40142490 0x7fbe401d6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42538/0 (socket says 172.21.15.181:42538) 2024-09-13T10:35:16.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.716+0000 7fbe452bb640 1 -- 172.21.15.181:0/1385518852 learned_addr learned my addr 172.21.15.181:0/1385518852 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:16.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe44aba640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6790/0 conn(0x7fbe400a8340 legacy=0x7fbe4012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe452bb640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6791/0 conn(0x7fbe40142490 legacy=0x7fbe401d6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3ffff640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.195:6791/0 conn(0x7fbe4013f750 legacy=0x7fbe401d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2018867538 0 0) 0x7fbe4013c850 con 0x7fbe400a8340 2024-09-13T10:35:16.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 10 monclient(hunting): my global_id is 94376 2024-09-13T10:35:16.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe24003520 con 0x7fbe400a8340 2024-09-13T10:35:16.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653019209 0 0) 0x7fbe400a9cd0 con 0x7fbe40142490 2024-09-13T10:35:16.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 10 monclient(hunting): my global_id is 6097 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe4013c850 con 0x7fbe40142490 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692005126 0 0) 0x7fbe4013b050 con 0x7fbe4013f750 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 10 monclient(hunting): my global_id is 104108 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.718+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe400a9cd0 con 0x7fbe4013f750 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3558101850 0 0) 0x7fbe24003520 con 0x7fbe400a8340 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe4013b050 con 0x7fbe400a8340 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbe34001bb0 con 0x7fbe400a8340 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:35:16.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient(hunting): dump: 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.735 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3455294671 0 0) 0x7fbe4013c850 con 0x7fbe40142490 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe24003520 con 0x7fbe40142490 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbe38001fe0 con 0x7fbe40142490 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient(hunting): dump: 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.736 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3495321999 0 0) 0x7fbe4013b050 con 0x7fbe400a8340 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.195:6791/0 conn(0x7fbe4013f750 legacy=0x7fbe401d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6791/0 conn(0x7fbe40142490 legacy=0x7fbe401d6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 monclient: found mon.b 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe400aa1a0 con 0x7fbe400a8340 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient: _finish_auth 0 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe46d1e640 5 monclient: authenticate success, global_id 94376 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe46d1e640 10 monclient: _renew_subs 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe46d1e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe46d1e640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbe4012ce10 con 0x7fbe400a8340 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe46d1e640 10 monclient: _renew_subs 2024-09-13T10:35:16.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe46d1e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe46d1e640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbe401d85e0 con 0x7fbe400a8340 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe34003b60 con 0x7fbe400a8340 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbe340015d0 con 0x7fbe400a8340 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3effd640 4 set_mon_vals no callback set 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.719+0000 7fbe3d7fa640 10 monclient: dump: 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.739 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.720+0000 7fbe46d1e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.720+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fbe34011ca0 con 0x7fbe400a8340 2024-09-13T10:35:16.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.720+0000 7fbe46d1e640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbe200065c0 con 0x7fbe20002860 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.720+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(169..169 src has 1..169) ==== 3898+0+0 (unknown 719054882 0 0) 0x7fbe3404e3d0 con 0x7fbe400a8340 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.720+0000 7fbe452bb640 10 monclient: get_auth_request con 0x7fbe24040090 auth_method 0 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.722+0000 7fbe3ffff640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe20002860 legacy=0x7fbe20004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.722+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047181950 0 0) 0x7fbe200065c0 con 0x7fbe20002860 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.722+0000 7fbe3d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.722+0000 7fbe3d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.722+0000 7fbe3d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.722+0000 7fbe3d7fa640 10 monclient(hunting): my global_id is 104103 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.722+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe4013b050 con 0x7fbe20002860 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3127739295 0 0) 0x7fbe4013b050 con 0x7fbe20002860 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe200065c0 con 0x7fbe20002860 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbe2c004d10 con 0x7fbe20002860 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 10 monclient: dump: 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.742 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.743 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.743 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.743 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3854939257 0 0) 0x7fbe200065c0 con 0x7fbe20002860 2024-09-13T10:35:16.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe2000a160 con 0x7fbe20002860 2024-09-13T10:35:16.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fbe2c0062d0 con 0x7fbe20002860 2024-09-13T10:35:16.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:16.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:16.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe20002860 legacy=0x7fbe20004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.723+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe20002860 legacy=0x7fbe20004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:16.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.729+0000 7fbe46d1e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:16.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.729+0000 7fbe46d1e640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbe20009e50 con 0x7fbe20009110 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.732+0000 7fbe3ffff640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe20009110 legacy=0x7fbe200095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.732+0000 7fbe3ffff640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe20009110 legacy=0x7fbe200095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.732+0000 7fbe3ffff640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe20009110 legacy=0x7fbe200095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.732+0000 7fbe3ffff640 1 --1- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe20009110 0x7fbe200095a0 :-1 s=OPENED pgs=399 cs=1 l=1).handle_message read tag failed 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.732+0000 7fbe3ffff640 1 --1- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe20009110 0x7fbe200095a0 :-1 s=OPENED pgs=399 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.732+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe20009110 legacy=0x7fbe200095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.732+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe20009110 legacy=0x7fbe200095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.732+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbe200065c0 con 0x7fbe24048c00 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.734+0000 7fbe3ffff640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe24048c00 legacy=0x7fbe24047250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.734+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3287903907 0 0) 0x7fbe200065c0 con 0x7fbe24048c00 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.734+0000 7fbe3d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.734+0000 7fbe3d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.734+0000 7fbe3d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.734+0000 7fbe3d7fa640 10 monclient(hunting): my global_id is 104121 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.734+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe4013b050 con 0x7fbe24048c00 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.734+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3446399421 0 0) 0x7fbe4013b050 con 0x7fbe24048c00 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.734+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe200065c0 con 0x7fbe24048c00 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.734+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbe2c005350 con 0x7fbe24048c00 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.734+0000 7fbe3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe3d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe3d7fa640 10 monclient: dump: 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.747 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.748 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.748 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.748 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.748 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.748 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.748 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.748 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.748 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.748 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.748 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 621703223 0 0) 0x7fbe200065c0 con 0x7fbe24048c00 2024-09-13T10:35:16.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbe2c0062d0 con 0x7fbe24048c00 2024-09-13T10:35:16.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7556 (unknown 0 0 507908282) 0x7fbe2c005670 con 0x7fbe24048c00 2024-09-13T10:35:16.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe3d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:16.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe3d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:16.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe24048c00 legacy=0x7fbe24047250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe3d7fa640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6789/0 conn(0x7fbe24048c00 legacy=0x7fbe24047250 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:16.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe452bb640 1 -- 172.21.15.181:0/1385518852 reap_dead start 2024-09-13T10:35:16.749 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:16.749 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 438, 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:16.750 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:16.751 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:16.752 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:16.753 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:16.754 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.755 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:16.756 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.757 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.758 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.759 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:16.761 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.764 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:16.765 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:16.766 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.767 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.768 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:16.769 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.770 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:16.771 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:16.773 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.774 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:16.775 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:16.776 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.777 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:16.777 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:16.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe46d1e640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.195:6800/1839191919 conn(0x7fbe24040090 legacy=0x7fbe24042550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe46d1e640 10 monclient: shutdown 2024-09-13T10:35:16.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe46d1e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:16.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe46d1e640 1 -- 172.21.15.181:0/1385518852 >> v1:172.21.15.181:6790/0 conn(0x7fbe400a8340 legacy=0x7fbe4012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe46d1e640 1 -- 172.21.15.181:0/1385518852 shutdown_connections 2024-09-13T10:35:16.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe46d1e640 1 -- 172.21.15.181:0/1385518852 >> 172.21.15.181:0/1385518852 conn(0x7fbe400a6640 msgr2=0x7fbe400a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:16.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe46d1e640 1 -- 172.21.15.181:0/1385518852 shutdown_connections 2024-09-13T10:35:16.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.735+0000 7fbe46d1e640 1 -- 172.21.15.181:0/1385518852 wait complete. 2024-09-13T10:35:16.781 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:16.781 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:35:16.781 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:35:16.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.877+0000 7fdbc7dcd640 10 monclient: get_monmap_and_config 2024-09-13T10:35:16.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.877+0000 7fdbc7dcd640 10 monclient: build_initial_monmap 2024-09-13T10:35:16.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.877+0000 7fdbc7dcd640 10 monclient: monmap: 2024-09-13T10:35:16.879 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:16.880 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.880 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:16.878725+0000 2024-09-13T10:35:16.880 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:16.878725+0000 2024-09-13T10:35:16.880 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:16.880 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.880 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:16.880 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:16.880 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:16.880 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:16.881 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:16.881 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:16.881 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:16.881 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:16.881 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:16.881 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.877+0000 7fdbc7dcd640 1 Processor -- start 2024-09-13T10:35:16.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.877+0000 7fdbc7dcd640 1 -- start start 2024-09-13T10:35:16.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.877+0000 7fdbc7dcd640 10 monclient: init 2024-09-13T10:35:16.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.878+0000 7fdbc7dcd640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:16.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.878+0000 7fdbc7dcd640 10 monclient: _add_conns ranks=[5,1,2,8,6,7,3,4,0] 2024-09-13T10:35:16.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.878+0000 7fdbc7dcd640 10 monclient(hunting): picked mon.noname-h con 0x7fdbc00a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:16.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.878+0000 7fdbc7dcd640 10 monclient(hunting): picked mon.noname-f con 0x7fdbc00a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:16.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.878+0000 7fdbc7dcd640 10 monclient(hunting): picked mon.noname-b con 0x7fdbc013f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:16.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.878+0000 7fdbc7dcd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc00a5fe0 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.878+0000 7fdbc7dcd640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc00a8080 con 0x7fdbc013f9a0 2024-09-13T10:35:16.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.878+0000 7fdbc7dcd640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc00a42c0 con 0x7fdbc00a66d0 2024-09-13T10:35:16.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.878+0000 7fdbc7dcd640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:16.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.878+0000 7fdbc7dcd640 10 monclient(hunting): authenticate will time out at 1056.384473s 2024-09-13T10:35:16.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.878+0000 7fdbc636a640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fdbc013f9a0 0x7fdbc0141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:59162/0 (socket says 172.21.15.181:59162) 2024-09-13T10:35:16.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.878+0000 7fdbc636a640 1 -- 172.21.15.181:0/244657169 learned_addr learned my addr 172.21.15.181:0/244657169 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:16.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.880+0000 7fdbc636a640 1 -- 172.21.15.181:0/244657169 >> v1:172.21.15.181:6790/0 conn(0x7fdbc013f9a0 legacy=0x7fdbc0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.880+0000 7fdbc4b67640 1 -- 172.21.15.181:0/244657169 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614702156 0 0) 0x7fdbc00a8080 con 0x7fdbc013f9a0 2024-09-13T10:35:16.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.880+0000 7fdbc4b67640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.880+0000 7fdbc4b67640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.880+0000 7fdbc4b67640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.880+0000 7fdbc4b67640 10 monclient(hunting): my global_id is 94385 2024-09-13T10:35:16.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.880+0000 7fdbc4b67640 1 -- 172.21.15.181:0/244657169 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdba8003520 con 0x7fdbc013f9a0 2024-09-13T10:35:16.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.880+0000 7fdbc5b69640 1 -- 172.21.15.181:0/244657169 >> v1:172.21.15.195:6791/0 conn(0x7fdbc00a66d0 legacy=0x7fdbc00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.880+0000 7fdbc5368640 1 -- 172.21.15.181:0/244657169 >> v1:172.21.15.195:6789/0 conn(0x7fdbc00a6ab0 legacy=0x7fdbc00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 1 -- 172.21.15.181:0/244657169 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344139646 0 0) 0x7fdbc00a42c0 con 0x7fdbc00a66d0 2024-09-13T10:35:16.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient(hunting): my global_id is 104117 2024-09-13T10:35:16.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 1 -- 172.21.15.181:0/244657169 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbc00a8080 con 0x7fdbc00a66d0 2024-09-13T10:35:16.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 1 -- 172.21.15.181:0/244657169 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3963405403 0 0) 0x7fdba8003520 con 0x7fdbc013f9a0 2024-09-13T10:35:16.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 1 -- 172.21.15.181:0/244657169 >> v1:172.21.15.195:6791/0 conn(0x7fdbc00a66d0 legacy=0x7fdbc00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 1 -- 172.21.15.181:0/244657169 >> v1:172.21.15.195:6789/0 conn(0x7fdbc00a6ab0 legacy=0x7fdbc00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient: _finish_hunting 0 2024-09-13T10:35:16.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 1 monclient: found mon.noname-b 2024-09-13T10:35:16.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:16.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:35:16.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 1 -- 172.21.15.181:0/244657169 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc01464e0 con 0x7fdbc013f9a0 2024-09-13T10:35:16.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient: _finish_auth 0 2024-09-13T10:35:16.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient: _check_auth_tickets 2024-09-13T10:35:16.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:16.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 1 -- 172.21.15.181:0/244657169 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbb0001e60 con 0x7fdbc013f9a0 2024-09-13T10:35:16.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:35:16.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient: dump: 2024-09-13T10:35:16.897 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.897 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.897 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.897 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.897 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.897 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.897 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.897 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.897 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc7dcd640 5 monclient: authenticate success, global_id 94385 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc7dcd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 1 -- 172.21.15.181:0/244657169 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdbb0004c20 con 0x7fdbc013f9a0 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 1 -- 172.21.15.181:0/244657169 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbb0005190 con 0x7fdbc013f9a0 2024-09-13T10:35:16.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc7dcd640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:16.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc7dcd640 4 set_mon_vals no callback set 2024-09-13T10:35:16.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:16.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc4b67640 10 monclient: dump: 2024-09-13T10:35:16.899 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.899 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.900 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.900 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.900 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.900 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.900 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.901 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.901 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.901 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.901 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.901 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.902 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.902 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.902 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.902 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc7dcd640 10 monclient: shutdown 2024-09-13T10:35:16.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc7dcd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:16.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/244657169 >> v1:172.21.15.181:6790/0 conn(0x7fdbc013f9a0 legacy=0x7fdbc0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/244657169 shutdown_connections 2024-09-13T10:35:16.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/244657169 >> 172.21.15.181:0/244657169 conn(0x7fdbc00abcd0 msgr2=0x7fdbc00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:16.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/244657169 shutdown_connections 2024-09-13T10:35:16.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.881+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/244657169 wait complete. 2024-09-13T10:35:16.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.882+0000 7fdbc7dcd640 10 monclient: build_initial_monmap 2024-09-13T10:35:16.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.882+0000 7fdbc7dcd640 10 monclient: monmap: 2024-09-13T10:35:16.904 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:16.905 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:16.905 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:16.905 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:16.905 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:16.905 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:16.906 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:16.906 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:16.906 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:16.906 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:16.906 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:16.906 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:16.907 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:16.907 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:16.907 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:16.907 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.882+0000 7fdbc7dcd640 1 Processor -- start 2024-09-13T10:35:16.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.882+0000 7fdbc7dcd640 1 -- start start 2024-09-13T10:35:16.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.882+0000 7fdbc7dcd640 10 monclient: init 2024-09-13T10:35:16.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.883+0000 7fdbc7dcd640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:16.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.883+0000 7fdbc7dcd640 10 monclient: _add_conns ranks=[1,8,3,2,6,4,0,5,7] 2024-09-13T10:35:16.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.883+0000 7fdbc7dcd640 10 monclient(hunting): picked mon.noname-f con 0x7fdbc00a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:16.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.883+0000 7fdbc7dcd640 10 monclient(hunting): picked mon.noname-e con 0x7fdbc00a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:16.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.883+0000 7fdbc7dcd640 10 monclient(hunting): picked mon.noname-g con 0x7fdbc013f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:35:16.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.883+0000 7fdbc7dcd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc013dbc0 con 0x7fdbc00a66d0 2024-09-13T10:35:16.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.883+0000 7fdbc7dcd640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc013f0f0 con 0x7fdbc013f9a0 2024-09-13T10:35:16.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.883+0000 7fdbc7dcd640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc0068680 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.883+0000 7fdbc7dcd640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:16.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.883+0000 7fdbc7dcd640 10 monclient(hunting): authenticate will time out at 1056.389295s 2024-09-13T10:35:16.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.883+0000 7fdbc5368640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fdbc00a6ab0 0x7fdbc013bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54432/0 (socket says 172.21.15.181:54432) 2024-09-13T10:35:16.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.883+0000 7fdbc5368640 1 -- 172.21.15.181:0/545384343 learned_addr learned my addr 172.21.15.181:0/545384343 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:16.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbc5368640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.181:6793/0 conn(0x7fdbc00a6ab0 legacy=0x7fdbc013bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbc5b69640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.195:6789/0 conn(0x7fdbc00a66d0 legacy=0x7fdbc013b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbc636a640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.195:6790/0 conn(0x7fdbc013f9a0 legacy=0x7fdbc01d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127301039 0 0) 0x7fdbc0068680 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): my global_id is 104111 2024-09-13T10:35:16.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbac003520 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879088915 0 0) 0x7fdbc013dbc0 con 0x7fdbc00a66d0 2024-09-13T10:35:16.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): my global_id is 56179 2024-09-13T10:35:16.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbc0068680 con 0x7fdbc00a66d0 2024-09-13T10:35:16.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504261601 0 0) 0x7fdbc013f0f0 con 0x7fdbc013f9a0 2024-09-13T10:35:16.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): my global_id is 6024 2024-09-13T10:35:16.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbc013dbc0 con 0x7fdbc013f9a0 2024-09-13T10:35:16.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 664160537 0 0) 0x7fdbac003520 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbc013f0f0 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbb4003610 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:16.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:35:16.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): dump: 2024-09-13T10:35:16.914 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.915 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.915 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.915 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.915 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.915 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.915 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.916 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.916 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.916 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.916 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.916 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.916 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 508783337 0 0) 0x7fdbc0068680 con 0x7fdbc00a66d0 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbac003520 con 0x7fdbc00a66d0 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbb8003610 con 0x7fdbc00a66d0 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 10 monclient(hunting): dump: 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.917 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.918 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.918 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.918 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.918 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.918 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.918 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.918 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.918 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.918 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.918 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.919 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.919 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.919 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2215401774 0 0) 0x7fdbc013f0f0 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.885+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.195:6790/0 conn(0x7fdbc013f9a0 legacy=0x7fdbc01d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.195:6789/0 conn(0x7fdbc00a66d0 legacy=0x7fdbc013b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:35:16.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 1 monclient: found mon.e 2024-09-13T10:35:16.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:16.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc0142db0 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 10 monclient: _finish_auth 0 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbc7dcd640 5 monclient: authenticate success, global_id 104111 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbc7dcd640 10 monclient: _renew_subs 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbc7dcd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc013cd90 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbc7dcd640 10 monclient: _renew_subs 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbc7dcd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fdbc01374e0 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdbb4003b80 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:16.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbb4004070 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbffff640 4 set_mon_vals no callback set 2024-09-13T10:35:16.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:16.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 10 monclient: dump: 2024-09-13T10:35:16.921 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.921 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.921 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.921 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.921 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.921 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.922 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.922 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.922 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.922 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.922 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.922 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.886+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fdbb4004210 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.887+0000 7fdbc7dcd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.887+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdba00065c0 con 0x7fdba0002860 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.887+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(169..169 src has 1..169) ==== 3898+0+0 (unknown 719054882 0 0) 0x7fdbb404e430 con 0x7fdbc00a6ab0 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.887+0000 7fdbc636a640 10 monclient: get_auth_request con 0x7fdbac0401e0 auth_method 0 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbc5b69640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.181:6790/0 conn(0x7fdba0002860 legacy=0x7fdba0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2003166054 0 0) 0x7fdba00065c0 con 0x7fdba0002860 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 10 monclient(hunting): my global_id is 94394 2024-09-13T10:35:16.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbc013f0f0 con 0x7fdba0002860 2024-09-13T10:35:16.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 591917895 0 0) 0x7fdbc013f0f0 con 0x7fdba0002860 2024-09-13T10:35:16.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdba00065c0 con 0x7fdba0002860 2024-09-13T10:35:16.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbb8003e30 con 0x7fdba0002860 2024-09-13T10:35:16.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:16.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 10 monclient: dump: 2024-09-13T10:35:16.924 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.924 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.924 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.925 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.925 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.925 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.925 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.925 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.925 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.925 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.925 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.925 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.925 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.926 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.926 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.926 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 865267484 0 0) 0x7fdba00065c0 con 0x7fdba0002860 2024-09-13T10:35:16.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdba000a160 con 0x7fdba0002860 2024-09-13T10:35:16.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fdbb80040a0 con 0x7fdba0002860 2024-09-13T10:35:16.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:16.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:16.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.889+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.181:6790/0 conn(0x7fdba0002860 legacy=0x7fdba0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.890+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.181:6790/0 conn(0x7fdba0002860 legacy=0x7fdba0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:16.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.895+0000 7fdbc7dcd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:16.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.895+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdba0009e70 con 0x7fdba0009130 2024-09-13T10:35:16.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbc5b69640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.181:6790/0 conn(0x7fdba0009130 legacy=0x7fdba00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:16.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1434537079 0 0) 0x7fdba0009e70 con 0x7fdba0009130 2024-09-13T10:35:16.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:35:16.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 10 monclient(hunting): my global_id is 94403 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdba00065c0 con 0x7fdba0009130 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1381395756 0 0) 0x7fdba00065c0 con 0x7fdba0009130 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdba0009e70 con 0x7fdba0009130 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbb8005b00 con 0x7fdba0009130 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 10 monclient: dump: 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.930 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3595456152 0 0) 0x7fdba0009e70 con 0x7fdba0009130 2024-09-13T10:35:16.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdba000c3f0 con 0x7fdba0009130 2024-09-13T10:35:16.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7725 (unknown 0 0 3478000174) 0x7fdbb8007e40 con 0x7fdba0009130 2024-09-13T10:35:16.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:16.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:16.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.181:6790/0 conn(0x7fdba0009130 legacy=0x7fdba00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.898+0000 7fdbbe7fc640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.181:6790/0 conn(0x7fdba0009130 legacy=0x7fdba00095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:16.932 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:16.932 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:16.933 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:16.933 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:16.933 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:16.933 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 56923, 2024-09-13T10:35:16.933 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:16.933 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:16.933 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:16.934 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:16.934 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:16.934 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:16.934 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:16.934 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:16.934 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:16.934 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:16.934 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:16.934 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:35:16.934 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:16.935 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:16.935 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:16.935 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:16.935 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:16.935 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:16.935 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:16.935 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:16.935 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:16.935 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:16.935 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:16.935 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:16.936 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:16.936 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:16.936 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:16.936 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:16.936 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:16.936 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:16.936 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:16.936 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:16.936 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:16.936 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:16.937 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:16.937 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:16.937 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:16.937 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:16.937 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:16.937 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:16.937 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.937 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:16.937 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:16.937 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:16.937 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:16.938 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:16.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.941 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:16.941 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:16.941 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.941 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.941 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.942 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:16.942 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:16.942 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.942 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.943 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.943 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:16.943 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.943 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.943 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.944 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:16.944 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:16.944 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.944 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.945 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.945 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:16.945 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:16.945 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.946 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.946 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.946 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:16.947 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.947 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.947 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.947 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:16.947 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:16.948 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.948 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.948 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.949 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:16.949 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:16.949 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.949 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.950 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.950 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:16.950 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.950 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.950 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.951 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:16.951 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:16.951 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.951 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.952 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.952 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:16.952 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:16.952 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.953 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.953 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.953 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:16.953 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.954 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.954 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.954 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:16.954 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:16.955 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.955 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.955 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.956 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:16.956 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:16.956 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.956 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.957 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.957 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:16.957 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.957 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.957 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.958 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:16.958 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:16.958 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.958 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.958 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.959 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:16.959 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:16.959 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.960 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.960 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.960 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:16.960 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.960 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.961 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.961 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:16.961 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:16.961 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.962 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.962 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.962 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:16.963 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:16.963 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.963 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.963 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.963 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:16.964 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.964 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.964 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.964 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:16.965 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:16.965 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.965 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.965 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.968 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:16.968 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:16.968 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:16.969 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:16.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.969 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:16.969 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:16.969 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:16.970 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.970 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.970 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:16.970 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:16.971 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:16.971 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:16.971 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:16.971 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.971 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.972 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:16.972 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:16.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.972 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:16.972 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:16.973 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:16.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.973 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:16.973 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:16.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.973 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:16.973 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:16.973 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:16.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.973 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:16.973 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:16.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:16.974 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:16.974 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:16.974 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:16.974 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:16.974 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:16.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:16.975 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:16.975 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:16.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.899+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.195:6800/1839191919 conn(0x7fdbac0401e0 legacy=0x7fdbac0426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.899+0000 7fdbc7dcd640 10 monclient: shutdown 2024-09-13T10:35:16.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.899+0000 7fdbc7dcd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:16.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.899+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/545384343 >> v1:172.21.15.181:6793/0 conn(0x7fdbc00a6ab0 legacy=0x7fdbc013bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:16.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.899+0000 7fdbc636a640 1 -- 172.21.15.181:0/545384343 reap_dead start 2024-09-13T10:35:16.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.899+0000 7fdbc636a640 1 -- 172.21.15.181:0/545384343 reap_dead start 2024-09-13T10:35:16.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.899+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/545384343 shutdown_connections 2024-09-13T10:35:16.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.899+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/545384343 >> 172.21.15.181:0/545384343 conn(0x7fdbc00abcd0 msgr2=0x7fdbc00a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:16.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.899+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/545384343 shutdown_connections 2024-09-13T10:35:16.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:16.899+0000 7fdbc7dcd640 1 -- 172.21.15.181:0/545384343 wait complete. 2024-09-13T10:35:16.979 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:16.979 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:35:16.979 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:35:17.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.075+0000 7fe466e16640 10 monclient: get_monmap_and_config 2024-09-13T10:35:17.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.075+0000 7fe466e16640 10 monclient: build_initial_monmap 2024-09-13T10:35:17.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.075+0000 7fe466e16640 10 monclient: monmap: 2024-09-13T10:35:17.079 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:17.079 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.079 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:17.077305+0000 2024-09-13T10:35:17.079 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:17.077305+0000 2024-09-13T10:35:17.079 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:17.079 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.079 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:17.079 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:17.080 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:17.080 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:17.080 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:17.080 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:17.080 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:17.080 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:17.080 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:17.080 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.076+0000 7fe466e16640 1 Processor -- start 2024-09-13T10:35:17.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.076+0000 7fe466e16640 1 -- start start 2024-09-13T10:35:17.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.076+0000 7fe466e16640 10 monclient: init 2024-09-13T10:35:17.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.076+0000 7fe466e16640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:17.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.076+0000 7fe466e16640 10 monclient: _add_conns ranks=[5,0,6,4,7,1,3,8,2] 2024-09-13T10:35:17.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.076+0000 7fe466e16640 10 monclient(hunting): picked mon.noname-h con 0x7fe4600a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:17.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.076+0000 7fe466e16640 10 monclient(hunting): picked mon.noname-a con 0x7fe4600a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:17.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.076+0000 7fe466e16640 10 monclient(hunting): picked mon.noname-d con 0x7fe46013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:17.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.076+0000 7fe466e16640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4600a4bc0 con 0x7fe4600a8340 2024-09-13T10:35:17.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.076+0000 7fe466e16640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe46013a320 con 0x7fe4600a6640 2024-09-13T10:35:17.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.076+0000 7fe466e16640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4600a8100 con 0x7fe46013f750 2024-09-13T10:35:17.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.076+0000 7fe466e16640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:17.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.077+0000 7fe466e16640 10 monclient(hunting): authenticate will time out at 1056.583008s 2024-09-13T10:35:17.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.077+0000 7fe457fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe4600a8340 0x7fe460139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43482/0 (socket says 172.21.15.181:43482) 2024-09-13T10:35:17.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.077+0000 7fe4653b3640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fe46013f750 0x7fe460141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:40200/0 (socket says 172.21.15.181:40200) 2024-09-13T10:35:17.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.077+0000 7fe457fff640 1 -- 172.21.15.181:0/1441224061 learned_addr learned my addr 172.21.15.181:0/1441224061 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:17.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.079+0000 7fe457fff640 1 -- 172.21.15.181:0/1441224061 >> v1:172.21.15.181:6789/0 conn(0x7fe4600a8340 legacy=0x7fe460139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.079+0000 7fe4653b3640 1 -- 172.21.15.181:0/1441224061 >> v1:172.21.15.181:6792/0 conn(0x7fe46013f750 legacy=0x7fe460141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.079+0000 7fe464bb2640 1 -- 172.21.15.181:0/1441224061 >> v1:172.21.15.195:6791/0 conn(0x7fe4600a6640 legacy=0x7fe460139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 1 -- 172.21.15.181:0/1441224061 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 866732210 0 0) 0x7fe4600a8100 con 0x7fe46013f750 2024-09-13T10:35:17.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 10 monclient(hunting): my global_id is 6000 2024-09-13T10:35:17.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 1 -- 172.21.15.181:0/1441224061 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe448003520 con 0x7fe46013f750 2024-09-13T10:35:17.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 1 -- 172.21.15.181:0/1441224061 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2816308852 0 0) 0x7fe448003520 con 0x7fe46013f750 2024-09-13T10:35:17.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 1 -- 172.21.15.181:0/1441224061 >> v1:172.21.15.195:6791/0 conn(0x7fe4600a6640 legacy=0x7fe460139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 1 -- 172.21.15.181:0/1441224061 >> v1:172.21.15.181:6789/0 conn(0x7fe4600a8340 legacy=0x7fe460139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 10 monclient: _finish_hunting 0 2024-09-13T10:35:17.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 1 monclient: found mon.noname-d 2024-09-13T10:35:17.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:17.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:35:17.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 1 -- 172.21.15.181:0/1441224061 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4600a48e0 con 0x7fe46013f750 2024-09-13T10:35:17.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 10 monclient: _finish_auth 0 2024-09-13T10:35:17.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 10 monclient: _check_auth_tickets 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 1 -- 172.21.15.181:0/1441224061 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe458001d90 con 0x7fe46013f750 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.324+0000 7fe4577fe640 10 monclient: dump: 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.331 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.325+0000 7fe466e16640 5 monclient: authenticate success, global_id 6000 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.325+0000 7fe466e16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.325+0000 7fe4577fe640 1 -- 172.21.15.181:0/1441224061 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4580020a0 con 0x7fe46013f750 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.325+0000 7fe4577fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.325+0000 7fe4577fe640 1 -- 172.21.15.181:0/1441224061 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe458004ea0 con 0x7fe46013f750 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.325+0000 7fe4577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.325+0000 7fe4577fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.325+0000 7fe4577fe640 10 monclient: dump: 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.333 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.334 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.334 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.334 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.334 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.325+0000 7fe466e16640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:17.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.325+0000 7fe466e16640 4 set_mon_vals no callback set 2024-09-13T10:35:17.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.326+0000 7fe466e16640 10 monclient: shutdown 2024-09-13T10:35:17.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.326+0000 7fe466e16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:17.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.326+0000 7fe466e16640 1 -- 172.21.15.181:0/1441224061 >> v1:172.21.15.181:6792/0 conn(0x7fe46013f750 legacy=0x7fe460141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.326+0000 7fe466e16640 1 -- 172.21.15.181:0/1441224061 shutdown_connections 2024-09-13T10:35:17.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.326+0000 7fe466e16640 1 -- 172.21.15.181:0/1441224061 >> 172.21.15.181:0/1441224061 conn(0x7fe460077170 msgr2=0x7fe4600abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.326+0000 7fe466e16640 1 -- 172.21.15.181:0/1441224061 shutdown_connections 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.326+0000 7fe466e16640 1 -- 172.21.15.181:0/1441224061 wait complete. 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.327+0000 7fe466e16640 10 monclient: build_initial_monmap 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.327+0000 7fe466e16640 10 monclient: monmap: 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:17.335 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:17.336 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:17.336 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:17.336 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:17.336 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:17.336 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.327+0000 7fe466e16640 1 Processor -- start 2024-09-13T10:35:17.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe466e16640 1 -- start start 2024-09-13T10:35:17.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe466e16640 10 monclient: init 2024-09-13T10:35:17.337 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:17.337 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38138]: starting. 2024-09-13T10:35:17.337 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38138]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38100 2024-09-13T10:35:17.337 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38138]: shutting down. 2024-09-13T10:35:17.337 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:17.337 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:17.337 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:35:17.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe466e16640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:17.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe466e16640 10 monclient: _add_conns ranks=[5,2,3,6,1,8,0,4,7] 2024-09-13T10:35:17.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe466e16640 10 monclient(hunting): picked mon.noname-h con 0x7fe4600a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:17.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe466e16640 10 monclient(hunting): picked mon.noname-b con 0x7fe46013f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:17.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe466e16640 10 monclient(hunting): picked mon.noname-g con 0x7fe460142420 addr v1:172.21.15.195:6790/0 2024-09-13T10:35:17.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe466e16640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe46013aa90 con 0x7fe46013f750 2024-09-13T10:35:17.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe466e16640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe46013c430 con 0x7fe460142420 2024-09-13T10:35:17.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe466e16640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe46013ac90 con 0x7fe4600a8340 2024-09-13T10:35:17.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe466e16640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:17.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe466e16640 10 monclient(hunting): authenticate will time out at 1056.834677s 2024-09-13T10:35:17.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe457fff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fe46013f750 0x7fe4601d3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:59186/0 (socket says 172.21.15.181:59186) 2024-09-13T10:35:17.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.328+0000 7fe457fff640 1 -- 172.21.15.181:0/309817547 learned_addr learned my addr 172.21.15.181:0/309817547 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:17.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.331+0000 7fe457fff640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.181:6790/0 conn(0x7fe46013f750 legacy=0x7fe4601d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.331+0000 7fe4653b3640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.195:6790/0 conn(0x7fe460142420 legacy=0x7fe4601d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.331+0000 7fe464bb2640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.195:6791/0 conn(0x7fe4600a8340 legacy=0x7fe46012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T10:35:17.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.331+0000 7fe464bb2640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.195:6791/0 conn(0x7fe4600a8340 legacy=0x7fe46012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:35:17.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.331+0000 7fe464bb2640 1 --1- 172.21.15.181:0/309817547 >> v1:172.21.15.195:6791/0 conn(0x7fe4600a8340 0x7fe46012c700 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2024-09-13T10:35:17.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.331+0000 7fe464bb2640 1 --1- 172.21.15.181:0/309817547 >> v1:172.21.15.195:6791/0 conn(0x7fe4600a8340 0x7fe46012c700 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.331+0000 7fe4557fa640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.195:6791/0 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.332+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254254568 0 0) 0x7fe46013c430 con 0x7fe460142420 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.332+0000 7fe4557fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.332+0000 7fe4557fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.332+0000 7fe4557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.332+0000 7fe4557fa640 10 monclient(hunting): my global_id is 6033 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.332+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe44c003550 con 0x7fe460142420 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.333+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 362977541 0 0) 0x7fe44c003550 con 0x7fe460142420 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.333+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe46013c430 con 0x7fe460142420 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.333+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe458001df0 con 0x7fe460142420 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.333+0000 7fe4557fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.333+0000 7fe4557fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:35:17.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.333+0000 7fe4557fa640 10 monclient(hunting): dump: 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.344 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.333+0000 7fe4557fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1232817799 0 0) 0x7fe46013c430 con 0x7fe460142420 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.195:6791/0 conn(0x7fe4600a8340 legacy=0x7fe46012c700 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.181:6790/0 conn(0x7fe46013f750 legacy=0x7fe4601d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 10 monclient: _finish_hunting 0 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 1 monclient: found mon.g 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46013c710 con 0x7fe460142420 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 10 monclient: _finish_auth 0 2024-09-13T10:35:17.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 10 monclient: _check_auth_tickets 2024-09-13T10:35:17.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:17.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe466e16640 5 monclient: authenticate success, global_id 6033 2024-09-13T10:35:17.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe466e16640 10 monclient: _renew_subs 2024-09-13T10:35:17.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe466e16640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:35:17.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe466e16640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe46013c150 con 0x7fe460142420 2024-09-13T10:35:17.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe466e16640 10 monclient: _renew_subs 2024-09-13T10:35:17.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe466e16640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:35:17.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe466e16640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe46012ce10 con 0x7fe460142420 2024-09-13T10:35:17.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe458005150 con 0x7fe460142420 2024-09-13T10:35:17.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:17.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe456ffd640 4 set_mon_vals no callback set 2024-09-13T10:35:17.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe458005700 con 0x7fe460142420 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.334+0000 7fe4557fa640 10 monclient: dump: 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.347 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.348 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.348 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.348 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.348 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.348 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.348 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.335+0000 7fe466e16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:17.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.335+0000 7fe466e16640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe4400065c0 con 0x7fe440002860 2024-09-13T10:35:17.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.336+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe458005920 con 0x7fe460142420 2024-09-13T10:35:17.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.336+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(170..170 src has 1..170) ==== 3506+0+0 (unknown 3052054584 0 0) 0x7fe45804e440 con 0x7fe460142420 2024-09-13T10:35:17.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.336+0000 7fe457fff640 10 monclient: get_auth_request con 0x7fe44c03fa20 auth_method 0 2024-09-13T10:35:17.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.338+0000 7fe464bb2640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.181:6791/0 conn(0x7fe440002860 legacy=0x7fe440004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.350 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:35:17.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3986012069 0 0) 0x7fe4400065c0 con 0x7fe440002860 2024-09-13T10:35:17.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 10 monclient(hunting): my global_id is 6106 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe46013c430 con 0x7fe440002860 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1061036077 0 0) 0x7fe46013c430 con 0x7fe440002860 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4400065c0 con 0x7fe440002860 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe45c001c20 con 0x7fe440002860 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 10 monclient: dump: 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.352 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2312244761 0 0) 0x7fe4400065c0 con 0x7fe440002860 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe44000a160 con 0x7fe440002860 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe45c006830 con 0x7fe440002860 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:17.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:17.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.181:6791/0 conn(0x7fe440002860 legacy=0x7fe440004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.342+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.181:6791/0 conn(0x7fe440002860 legacy=0x7fe440004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:17.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.349+0000 7fe466e16640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:17.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.349+0000 7fe466e16640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe440009e70 con 0x7fe440009130 2024-09-13T10:35:17.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe464bb2640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.181:6791/0 conn(0x7fe440009130 legacy=0x7fe4400095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706033901 0 0) 0x7fe440009e70 con 0x7fe440009130 2024-09-13T10:35:17.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 10 monclient(hunting): my global_id is 6115 2024-09-13T10:35:17.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4400065c0 con 0x7fe440009130 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1257520604 0 0) 0x7fe4400065c0 con 0x7fe440009130 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe440009e70 con 0x7fe440009130 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe45c003d40 con 0x7fe440009130 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 10 monclient: dump: 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.356 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3283617647 0 0) 0x7fe440009e70 con 0x7fe440009130 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.351+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe44000c410 con 0x7fe440009130 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7893 (unknown 0 0 3888796904) 0x7fe45c004050 con 0x7fe440009130 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe4557fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:17.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe4557fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:17.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.181:6791/0 conn(0x7fe440009130 legacy=0x7fe4400095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe4557fa640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.181:6791/0 conn(0x7fe440009130 legacy=0x7fe4400095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:17.358 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 331801, 2024-09-13T10:35:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:35:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:17.380 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:17.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe466e16640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.195:6800/1839191919 conn(0x7fe44c03fa20 legacy=0x7fe44c041ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe466e16640 10 monclient: shutdown 2024-09-13T10:35:17.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe466e16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:17.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe466e16640 1 -- 172.21.15.181:0/309817547 >> v1:172.21.15.195:6790/0 conn(0x7fe460142420 legacy=0x7fe4601d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe4653b3640 1 -- 172.21.15.181:0/309817547 reap_dead start 2024-09-13T10:35:17.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe4653b3640 1 -- 172.21.15.181:0/309817547 reap_dead start 2024-09-13T10:35:17.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe466e16640 1 -- 172.21.15.181:0/309817547 shutdown_connections 2024-09-13T10:35:17.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe466e16640 1 -- 172.21.15.181:0/309817547 >> 172.21.15.181:0/309817547 conn(0x7fe4600a6640 msgr2=0x7fe4600a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:17.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe466e16640 1 -- 172.21.15.181:0/309817547 shutdown_connections 2024-09-13T10:35:17.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.352+0000 7fe466e16640 1 -- 172.21.15.181:0/309817547 wait complete. 2024-09-13T10:35:17.382 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:17.382 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:35:17.382 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:35:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.478+0000 7fb3661d1640 10 monclient: get_monmap_and_config 2024-09-13T10:35:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.478+0000 7fb3661d1640 10 monclient: build_initial_monmap 2024-09-13T10:35:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.478+0000 7fb3661d1640 10 monclient: monmap: 2024-09-13T10:35:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:17.480174+0000 2024-09-13T10:35:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:17.480174+0000 2024-09-13T10:35:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:17.481 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:17.482 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:17.482 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 1 Processor -- start 2024-09-13T10:35:17.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 1 -- start start 2024-09-13T10:35:17.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 10 monclient: init 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 10 monclient: _add_conns ranks=[2,8,6,5,4,3,1,0,7] 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 10 monclient(hunting): picked mon.noname-b con 0x7fb3600a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 10 monclient(hunting): picked mon.noname-e con 0x7fb3600a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 10 monclient(hunting): picked mon.noname-d con 0x7fb36013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3600a4bc0 con 0x7fb3600a6640 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb36013a320 con 0x7fb36013f750 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3600a8100 con 0x7fb3600a8340 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb3661d1640 10 monclient(hunting): authenticate will time out at 1056.985820s 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb35effd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fb3600a8340 0x7fb360139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54446/0 (socket says 172.21.15.181:54446) 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb35f7fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fb3600a6640 0x7fb360139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:59194/0 (socket says 172.21.15.181:59194) 2024-09-13T10:35:17.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb35effd640 1 -- 172.21.15.181:0/4123264556 learned_addr learned my addr 172.21.15.181:0/4123264556 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:17.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.479+0000 7fb35ffff640 1 --1- 172.21.15.181:0/4123264556 >> v1:172.21.15.181:6792/0 conn(0x7fb36013f750 0x7fb360141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:40204/0 (socket says 172.21.15.181:40204) 2024-09-13T10:35:17.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35f7fe640 1 -- 172.21.15.181:0/4123264556 >> v1:172.21.15.181:6790/0 conn(0x7fb3600a6640 legacy=0x7fb360139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35ffff640 1 -- 172.21.15.181:0/4123264556 >> v1:172.21.15.181:6792/0 conn(0x7fb36013f750 legacy=0x7fb360141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35effd640 1 -- 172.21.15.181:0/4123264556 >> v1:172.21.15.181:6793/0 conn(0x7fb3600a8340 legacy=0x7fb360139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80960468 0 0) 0x7fb3600a4bc0 con 0x7fb3600a6640 2024-09-13T10:35:17.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient(hunting): my global_id is 94412 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb348003520 con 0x7fb3600a6640 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180692530 0 0) 0x7fb3600a8100 con 0x7fb3600a8340 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient(hunting): my global_id is 104138 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3600a4bc0 con 0x7fb3600a8340 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799594460 0 0) 0x7fb36013a320 con 0x7fb36013f750 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient(hunting): my global_id is 6027 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3600a8100 con 0x7fb36013f750 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4164175425 0 0) 0x7fb348003520 con 0x7fb3600a6640 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 >> v1:172.21.15.181:6793/0 conn(0x7fb3600a8340 legacy=0x7fb360139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 >> v1:172.21.15.181:6792/0 conn(0x7fb36013f750 legacy=0x7fb360141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 monclient: found mon.noname-b 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3600a48e0 con 0x7fb3600a6640 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient: _finish_auth 0 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:17.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb350001ae0 con 0x7fb3600a6640 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient: dump: 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.491 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb3661d1640 5 monclient: authenticate success, global_id 94412 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb3661d1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3500047e0 con 0x7fb3600a6640 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 1 -- 172.21.15.181:0/4123264556 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb350004d50 con 0x7fb3600a6640 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb3661d1640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb3661d1640 4 set_mon_vals no callback set 2024-09-13T10:35:17.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.482+0000 7fb35e7fc640 10 monclient: dump: 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.493 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.483+0000 7fb3661d1640 10 monclient: shutdown 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.483+0000 7fb3661d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.483+0000 7fb3661d1640 1 -- 172.21.15.181:0/4123264556 >> v1:172.21.15.181:6790/0 conn(0x7fb3600a6640 legacy=0x7fb360139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.483+0000 7fb3661d1640 1 -- 172.21.15.181:0/4123264556 shutdown_connections 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.483+0000 7fb3661d1640 1 -- 172.21.15.181:0/4123264556 >> 172.21.15.181:0/4123264556 conn(0x7fb360077170 msgr2=0x7fb3600abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.483+0000 7fb3661d1640 1 -- 172.21.15.181:0/4123264556 shutdown_connections 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.483+0000 7fb3661d1640 1 -- 172.21.15.181:0/4123264556 wait complete. 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.483+0000 7fb3661d1640 10 monclient: build_initial_monmap 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.483+0000 7fb3661d1640 10 monclient: monmap: 2024-09-13T10:35:17.494 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:17.495 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 1 Processor -- start 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 1 -- start start 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 10 monclient: init 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 10 monclient: _add_conns ranks=[8,6,7,0,1,2,4,3,5] 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 10 monclient(hunting): picked mon.noname-e con 0x7fb3600a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 10 monclient(hunting): picked mon.noname-d con 0x7fb36013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 10 monclient(hunting): picked mon.noname-i con 0x7fb3601d4310 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3600a1050 con 0x7fb36013f750 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb36009e050 con 0x7fb3601d4310 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb360142cd0 con 0x7fb3600a8340 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:17.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb3661d1640 10 monclient(hunting): authenticate will time out at 1056.990783s 2024-09-13T10:35:17.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb35f7fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fb3600a8340 0x7fb36009d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54456/0 (socket says 172.21.15.181:54456) 2024-09-13T10:35:17.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.484+0000 7fb35f7fe640 1 -- 172.21.15.181:0/2715443163 learned_addr learned my addr 172.21.15.181:0/2715443163 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:17.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.486+0000 7fb35f7fe640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.181:6793/0 conn(0x7fb3600a8340 legacy=0x7fb36009d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.486+0000 7fb35effd640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.181:6792/0 conn(0x7fb36013f750 legacy=0x7fb36009d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652552214 0 0) 0x7fb3600a1050 con 0x7fb36013f750 2024-09-13T10:35:17.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): my global_id is 6036 2024-09-13T10:35:17.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb34c003550 con 0x7fb36013f750 2024-09-13T10:35:17.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1962798745 0 0) 0x7fb360142cd0 con 0x7fb3600a8340 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): my global_id is 104147 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3600a1050 con 0x7fb3600a8340 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb35ffff640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.195:6792/0 conn(0x7fb3601d4310 legacy=0x7fb3601d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 333177038 0 0) 0x7fb34c003550 con 0x7fb36013f750 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb360142cd0 con 0x7fb36013f750 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb354001ce0 con 0x7fb36013f750 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): dump: 2024-09-13T10:35:17.502 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.503 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1036523226 0 0) 0x7fb3600a1050 con 0x7fb3600a8340 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb34c003550 con 0x7fb3600a8340 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb350004cd0 con 0x7fb3600a8340 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient(hunting): dump: 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.504 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3149193923 0 0) 0x7fb360142cd0 con 0x7fb36013f750 2024-09-13T10:35:17.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.181:6793/0 conn(0x7fb3600a8340 legacy=0x7fb36009d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.195:6792/0 conn(0x7fb3601d4310 legacy=0x7fb3601d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient: _finish_hunting 0 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 monclient: found mon.d 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3600a01e0 con 0x7fb36013f750 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient: _finish_auth 0 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient: _check_auth_tickets 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb3661d1640 5 monclient: authenticate success, global_id 6036 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb3661d1640 10 monclient: _renew_subs 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb3661d1640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:17.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb3661d1640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb36009ecf0 con 0x7fb36013f750 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb3661d1640 10 monclient: _renew_subs 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb3661d1640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb3661d1640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb36009faf0 con 0x7fb36013f750 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb354004a90 con 0x7fb36013f750 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb354004fc0 con 0x7fb36013f750 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb35dffb640 4 set_mon_vals no callback set 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.487+0000 7fb347fff640 10 monclient: dump: 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.507 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.508 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.508 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.508 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.508 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.508 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.508 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.508 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.508 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.508 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.508 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.508 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.508 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.488+0000 7fb3661d1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.488+0000 7fb3661d1640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb3400065c0 con 0x7fb340002860 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.488+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb354005160 con 0x7fb36013f750 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.488+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(170..170 src has 1..170) ==== 3506+0+0 (unknown 3052054584 0 0) 0x7fb35404e0e0 con 0x7fb36013f750 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.489+0000 7fb35ffff640 10 monclient: get_auth_request con 0x7fb34c040170 auth_method 0 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.490+0000 7fb35f7fe640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.181:6792/0 conn(0x7fb340002860 legacy=0x7fb340004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.490+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 487123869 0 0) 0x7fb3400065c0 con 0x7fb340002860 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.490+0000 7fb347fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.490+0000 7fb347fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.490+0000 7fb347fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.490+0000 7fb347fff640 10 monclient(hunting): my global_id is 6045 2024-09-13T10:35:17.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.490+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb360142cd0 con 0x7fb340002860 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3060620686 0 0) 0x7fb360142cd0 con 0x7fb340002860 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3400065c0 con 0x7fb340002860 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb3500047e0 con 0x7fb340002860 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 10 monclient: dump: 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.510 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2083741491 0 0) 0x7fb3400065c0 con 0x7fb340002860 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb34000a160 con 0x7fb340002860 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb3500053d0 con 0x7fb340002860 2024-09-13T10:35:17.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:17.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:17.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.181:6792/0 conn(0x7fb340002860 legacy=0x7fb340004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.491+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.181:6792/0 conn(0x7fb340002860 legacy=0x7fb340004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:17.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.497+0000 7fb3661d1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:17.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.497+0000 7fb3661d1640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb340009e70 con 0x7fb340009130 2024-09-13T10:35:17.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.499+0000 7fb35f7fe640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.181:6792/0 conn(0x7fb340009130 legacy=0x7fb3400095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 720686682 0 0) 0x7fb340009e70 con 0x7fb340009130 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 10 monclient(hunting): my global_id is 6054 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3400065c0 con 0x7fb340009130 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1213281996 0 0) 0x7fb3400065c0 con 0x7fb340009130 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb340009e70 con 0x7fb340009130 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb350005c60 con 0x7fb340009130 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 10 monclient: dump: 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.514 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.515 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 262320534 0 0) 0x7fb340009e70 con 0x7fb340009130 2024-09-13T10:35:17.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb34000c3f0 con 0x7fb340009130 2024-09-13T10:35:17.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 670945614) 0x7fb3500081c0 con 0x7fb340009130 2024-09-13T10:35:17.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:17.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:17.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.181:6792/0 conn(0x7fb340009130 legacy=0x7fb3400095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.500+0000 7fb347fff640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.181:6792/0 conn(0x7fb340009130 legacy=0x7fb3400095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:17.516 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:17.516 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 331944, 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:17.517 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:17.518 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:17.519 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:17.520 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:17.521 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.522 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:17.523 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.524 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.525 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.525 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:17.525 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:17.525 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.525 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.525 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.525 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:17.525 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:17.525 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.526 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.527 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:17.527 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:17.527 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.527 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.527 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.527 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:17.527 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.527 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.527 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.528 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:17.528 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:17.528 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.528 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.528 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.528 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:17.528 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:17.528 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.528 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:17.530 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.531 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:17.534 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:17.535 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.536 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.536 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:17.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.536 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:17.536 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:17.536 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:17.536 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.536 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.536 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:17.536 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:17.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.501+0000 7fb3661d1640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb34c040170 legacy=0x7fb34c042630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.501+0000 7fb3661d1640 10 monclient: shutdown 2024-09-13T10:35:17.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.501+0000 7fb3661d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:17.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.501+0000 7fb3661d1640 1 -- 172.21.15.181:0/2715443163 >> v1:172.21.15.181:6792/0 conn(0x7fb36013f750 legacy=0x7fb36009d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.501+0000 7fb35ffff640 1 -- 172.21.15.181:0/2715443163 reap_dead start 2024-09-13T10:35:17.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.501+0000 7fb35ffff640 1 -- 172.21.15.181:0/2715443163 reap_dead start 2024-09-13T10:35:17.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.501+0000 7fb3661d1640 1 -- 172.21.15.181:0/2715443163 shutdown_connections 2024-09-13T10:35:17.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.501+0000 7fb3661d1640 1 -- 172.21.15.181:0/2715443163 >> 172.21.15.181:0/2715443163 conn(0x7fb3600a6640 msgr2=0x7fb360141d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:17.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.501+0000 7fb3661d1640 1 -- 172.21.15.181:0/2715443163 shutdown_connections 2024-09-13T10:35:17.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.501+0000 7fb3661d1640 1 -- 172.21.15.181:0/2715443163 wait complete. 2024-09-13T10:35:17.539 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:17.539 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:35:17.539 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:35:17.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.635+0000 7fc7a5211640 10 monclient: get_monmap_and_config 2024-09-13T10:35:17.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.635+0000 7fc7a5211640 10 monclient: build_initial_monmap 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.635+0000 7fc7a5211640 10 monclient: monmap: 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:17.636865+0000 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:17.636865+0000 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:17.638 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:17.639 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:17.639 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:17.639 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:17.639 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.635+0000 7fc7a5211640 1 Processor -- start 2024-09-13T10:35:17.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc7a5211640 1 -- start start 2024-09-13T10:35:17.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc7a5211640 10 monclient: init 2024-09-13T10:35:17.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc7a5211640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:17.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc7a5211640 10 monclient: _add_conns ranks=[5,1,4,8,2,0,7,6,3] 2024-09-13T10:35:17.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc7a5211640 10 monclient(hunting): picked mon.noname-h con 0x7fc7a00a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:17.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc7a5211640 10 monclient(hunting): picked mon.noname-f con 0x7fc7a00a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:17.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc7a5211640 10 monclient(hunting): picked mon.noname-c con 0x7fc7a013f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:17.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc7a5211640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a00a5fe0 con 0x7fc7a00a6ab0 2024-09-13T10:35:17.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc7a5211640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a00a8080 con 0x7fc7a013f9a0 2024-09-13T10:35:17.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc7a5211640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a00a42c0 con 0x7fc7a00a66d0 2024-09-13T10:35:17.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc7a5211640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:17.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc7a5211640 10 monclient(hunting): authenticate will time out at 1057.142570s 2024-09-13T10:35:17.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc79f59e640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fc7a013f9a0 0x7fc7a0141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42566/0 (socket says 172.21.15.181:42566) 2024-09-13T10:35:17.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.636+0000 7fc79f59e640 1 -- 172.21.15.181:0/3217963044 learned_addr learned my addr 172.21.15.181:0/3217963044 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:17.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.638+0000 7fc79f59e640 1 -- 172.21.15.181:0/3217963044 >> v1:172.21.15.181:6791/0 conn(0x7fc7a013f9a0 legacy=0x7fc7a0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79ed9d640 1 -- 172.21.15.181:0/3217963044 >> v1:172.21.15.195:6791/0 conn(0x7fc7a00a66d0 legacy=0x7fc7a00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc797fff640 1 -- 172.21.15.181:0/3217963044 >> v1:172.21.15.195:6789/0 conn(0x7fc7a00a6ab0 legacy=0x7fc7a00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 978884266 0 0) 0x7fc7a00a8080 con 0x7fc7a013f9a0 2024-09-13T10:35:17.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient(hunting): my global_id is 6124 2024-09-13T10:35:17.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc78c003520 con 0x7fc7a013f9a0 2024-09-13T10:35:17.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501592882 0 0) 0x7fc7a00a42c0 con 0x7fc7a00a66d0 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient(hunting): my global_id is 104126 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a00a8080 con 0x7fc7a00a66d0 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403270281 0 0) 0x7fc7a00a5fe0 con 0x7fc7a00a6ab0 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient(hunting): my global_id is 56206 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a00a42c0 con 0x7fc7a00a6ab0 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4277071602 0 0) 0x7fc78c003520 con 0x7fc7a013f9a0 2024-09-13T10:35:17.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 >> v1:172.21.15.195:6791/0 conn(0x7fc7a00a66d0 legacy=0x7fc7a00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 >> v1:172.21.15.195:6789/0 conn(0x7fc7a00a6ab0 legacy=0x7fc7a00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient: _finish_hunting 0 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 monclient: found mon.noname-c 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a01464e0 con 0x7fc7a013f9a0 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient: _finish_auth 0 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient: _check_auth_tickets 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc798001e60 con 0x7fc7a013f9a0 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc7a5211640 5 monclient: authenticate success, global_id 6124 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc7a5211640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:17.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient: dump: 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.654 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc7a5211640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc798004c20 con 0x7fc7a013f9a0 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 1 -- 172.21.15.181:0/3217963044 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc798005190 con 0x7fc7a013f9a0 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc7a5211640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc7a5211640 4 set_mon_vals no callback set 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:17.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.639+0000 7fc79e59c640 10 monclient: dump: 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.656 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.640+0000 7fc7a5211640 10 monclient: shutdown 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.640+0000 7fc7a5211640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.640+0000 7fc7a5211640 1 -- 172.21.15.181:0/3217963044 >> v1:172.21.15.181:6791/0 conn(0x7fc7a013f9a0 legacy=0x7fc7a0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.640+0000 7fc7a5211640 1 -- 172.21.15.181:0/3217963044 shutdown_connections 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.640+0000 7fc7a5211640 1 -- 172.21.15.181:0/3217963044 >> 172.21.15.181:0/3217963044 conn(0x7fc7a00abcd0 msgr2=0x7fc7a00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.640+0000 7fc7a5211640 1 -- 172.21.15.181:0/3217963044 shutdown_connections 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.640+0000 7fc7a5211640 1 -- 172.21.15.181:0/3217963044 wait complete. 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.640+0000 7fc7a5211640 10 monclient: build_initial_monmap 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.640+0000 7fc7a5211640 10 monclient: monmap: 2024-09-13T10:35:17.657 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:17.658 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 1 Processor -- start 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 1 -- start start 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 10 monclient: init 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 10 monclient: _add_conns ranks=[5,8,4,6,0,2,7,3,1] 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 10 monclient(hunting): picked mon.noname-h con 0x7fc7a00a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 10 monclient(hunting): picked mon.noname-e con 0x7fc7a00a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 10 monclient(hunting): picked mon.noname-c con 0x7fc7a013f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a0143140 con 0x7fc7a013f9a0 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a0138f60 con 0x7fc7a00a66d0 2024-09-13T10:35:17.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a013d600 con 0x7fc7a00a6ab0 2024-09-13T10:35:17.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:17.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc7a5211640 10 monclient(hunting): authenticate will time out at 1057.147766s 2024-09-13T10:35:17.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc79f59e640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fc7a013f9a0 0x7fc7a01d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42580/0 (socket says 172.21.15.181:42580) 2024-09-13T10:35:17.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc797fff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fc7a00a6ab0 0x7fc7a01d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54466/0 (socket says 172.21.15.181:54466) 2024-09-13T10:35:17.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.641+0000 7fc79f59e640 1 -- 172.21.15.181:0/348148424 learned_addr learned my addr 172.21.15.181:0/348148424 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:17.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.643+0000 7fc79f59e640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.181:6791/0 conn(0x7fc7a013f9a0 legacy=0x7fc7a01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.643+0000 7fc797fff640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.181:6793/0 conn(0x7fc7a00a6ab0 legacy=0x7fc7a01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc79ed9d640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.195:6791/0 conn(0x7fc7a00a66d0 legacy=0x7fc7a01ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721752789 0 0) 0x7fc7a01464e0 con 0x7fc7a013f9a0 2024-09-13T10:35:17.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): my global_id is 6133 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc780003550 con 0x7fc7a013f9a0 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3833579855 0 0) 0x7fc7a013d600 con 0x7fc7a00a6ab0 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): my global_id is 104156 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a01464e0 con 0x7fc7a00a6ab0 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810214749 0 0) 0x7fc7a0138f60 con 0x7fc7a00a66d0 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): my global_id is 104135 2024-09-13T10:35:17.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a013d600 con 0x7fc7a00a66d0 2024-09-13T10:35:17.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1268403337 0 0) 0x7fc780003550 con 0x7fc7a013f9a0 2024-09-13T10:35:17.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7a0138f60 con 0x7fc7a013f9a0 2024-09-13T10:35:17.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc7980020b0 con 0x7fc7a013f9a0 2024-09-13T10:35:17.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:17.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:35:17.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): dump: 2024-09-13T10:35:17.662 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.662 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.662 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.662 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.662 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.662 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2248788516 0 0) 0x7fc7a01464e0 con 0x7fc7a00a6ab0 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc780003550 con 0x7fc7a00a6ab0 2024-09-13T10:35:17.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc7880014d0 con 0x7fc7a00a6ab0 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): dump: 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1416242135 0 0) 0x7fc7a013d600 con 0x7fc7a00a66d0 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7a01464e0 con 0x7fc7a00a66d0 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc790003610 con 0x7fc7a00a66d0 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient(hunting): dump: 2024-09-13T10:35:17.665 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.666 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.666 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.666 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.666 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.666 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.666 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.666 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.666 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.666 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.666 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.666 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.666 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4160329130 0 0) 0x7fc7a0138f60 con 0x7fc7a013f9a0 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.181:6793/0 conn(0x7fc7a00a6ab0 legacy=0x7fc7a01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.195:6791/0 conn(0x7fc7a00a66d0 legacy=0x7fc7a01ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient: _finish_hunting 0 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 monclient: found mon.c 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a013f680 con 0x7fc7a013f9a0 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient: _finish_auth 0 2024-09-13T10:35:17.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient: _check_auth_tickets 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7a5211640 5 monclient: authenticate success, global_id 6133 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7a5211640 10 monclient: _renew_subs 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7a5211640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7a5211640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a013e160 con 0x7fc7a013f9a0 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7a5211640 10 monclient: _renew_subs 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7a5211640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7a5211640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc7a013e440 con 0x7fc7a013f9a0 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc798004c20 con 0x7fc7a013f9a0 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc798005700 con 0x7fc7a013f9a0 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc79dd9b640 4 set_mon_vals no callback set 2024-09-13T10:35:17.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:17.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.644+0000 7fc7977fe640 10 monclient: dump: 2024-09-13T10:35:17.669 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.669 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.669 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.669 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.669 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.669 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.669 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.669 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.669 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.669 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.645+0000 7fc7a5211640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.645+0000 7fc7a5211640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc7840065c0 con 0x7fc784002860 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.645+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fc798011d80 con 0x7fc7a013f9a0 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.645+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(170..170 src has 1..170) ==== 3506+0+0 (unknown 3052054584 0 0) 0x7fc79804e4a0 con 0x7fc7a013f9a0 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.645+0000 7fc797fff640 10 monclient: get_auth_request con 0x7fc780040620 auth_method 0 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.647+0000 7fc79ed9d640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.181:6793/0 conn(0x7fc784002860 legacy=0x7fc784004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.647+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1070938786 0 0) 0x7fc7840065c0 con 0x7fc784002860 2024-09-13T10:35:17.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.647+0000 7fc7977fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.647+0000 7fc7977fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.647+0000 7fc7977fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.647+0000 7fc7977fe640 10 monclient(hunting): my global_id is 104165 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.647+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a0138f60 con 0x7fc784002860 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.647+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3214548994 0 0) 0x7fc7a0138f60 con 0x7fc784002860 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.648+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7840065c0 con 0x7fc784002860 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.648+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc790003d60 con 0x7fc784002860 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.648+0000 7fc7977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.648+0000 7fc7977fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.648+0000 7fc7977fe640 10 monclient: dump: 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.671 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.672 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.648+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4290290074 0 0) 0x7fc7840065c0 con 0x7fc784002860 2024-09-13T10:35:17.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.648+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc78400a160 con 0x7fc784002860 2024-09-13T10:35:17.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.648+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc790003fd0 con 0x7fc784002860 2024-09-13T10:35:17.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.648+0000 7fc7977fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:17.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.648+0000 7fc7977fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:17.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.648+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.181:6793/0 conn(0x7fc784002860 legacy=0x7fc784004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.648+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.181:6793/0 conn(0x7fc784002860 legacy=0x7fc784004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:17.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.654+0000 7fc7a5211640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:17.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.654+0000 7fc7a5211640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc784009e70 con 0x7fc784009130 2024-09-13T10:35:17.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.656+0000 7fc79ed9d640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.181:6793/0 conn(0x7fc784009130 legacy=0x7fc7840095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 362023602 0 0) 0x7fc784009e70 con 0x7fc784009130 2024-09-13T10:35:17.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 10 monclient(hunting): my global_id is 104174 2024-09-13T10:35:17.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7840065c0 con 0x7fc784009130 2024-09-13T10:35:17.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2982415368 0 0) 0x7fc7840065c0 con 0x7fc784009130 2024-09-13T10:35:17.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc784009e70 con 0x7fc784009130 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc790004440 con 0x7fc784009130 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 10 monclient: dump: 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.676 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4084430404 0 0) 0x7fc784009e70 con 0x7fc784009130 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc78400c3f0 con 0x7fc784009130 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7557 (unknown 0 0 2904752042) 0x7fc790007bc0 con 0x7fc784009130 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.181:6793/0 conn(0x7fc784009130 legacy=0x7fc7840095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7977fe640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.181:6793/0 conn(0x7fc784009130 legacy=0x7fc7840095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:17.678 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:17.678 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:17.678 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:17.678 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:17.678 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:17.678 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 1360, 2024-09-13T10:35:17.678 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:17.678 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:17.678 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:17.678 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:17.678 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:17.679 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:17.680 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:17.681 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:17.682 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.683 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.684 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.686 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:17.687 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.688 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.689 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.690 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.690 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:17.690 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.690 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.690 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.690 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:17.690 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:17.690 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.690 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.690 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.691 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.692 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:17.694 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.694 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:17.694 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.694 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:17.694 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:17.694 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.696 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:17.697 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:17.697 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:17.697 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.697 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.697 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:17.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.697 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:17.697 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:17.697 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:17.697 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.698 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.698 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:17.698 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:17.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7a5211640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.195:6800/1839191919 conn(0x7fc780040620 legacy=0x7fc780042ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7a5211640 10 monclient: shutdown 2024-09-13T10:35:17.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7a5211640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:17.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc7a5211640 1 -- 172.21.15.181:0/348148424 >> v1:172.21.15.181:6791/0 conn(0x7fc7a013f9a0 legacy=0x7fc7a01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc79f59e640 1 -- 172.21.15.181:0/348148424 reap_dead start 2024-09-13T10:35:17.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.657+0000 7fc79f59e640 1 -- 172.21.15.181:0/348148424 reap_dead start 2024-09-13T10:35:17.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.658+0000 7fc7a5211640 1 -- 172.21.15.181:0/348148424 shutdown_connections 2024-09-13T10:35:17.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.658+0000 7fc7a5211640 1 -- 172.21.15.181:0/348148424 >> 172.21.15.181:0/348148424 conn(0x7fc7a00abcd0 msgr2=0x7fc7a0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:17.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.658+0000 7fc7a5211640 1 -- 172.21.15.181:0/348148424 shutdown_connections 2024-09-13T10:35:17.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.658+0000 7fc7a5211640 1 -- 172.21.15.181:0/348148424 wait complete. 2024-09-13T10:35:17.700 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:17.700 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:35:17.701 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:35:17.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.796+0000 7f3002cbf640 10 monclient: get_monmap_and_config 2024-09-13T10:35:17.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.796+0000 7f3002cbf640 10 monclient: build_initial_monmap 2024-09-13T10:35:17.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.796+0000 7f3002cbf640 10 monclient: monmap: 2024-09-13T10:35:17.799 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:17.799 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.799 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:17.798242+0000 2024-09-13T10:35:17.799 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:17.798242+0000 2024-09-13T10:35:17.799 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:17.800 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.800 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:17.800 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:17.800 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:17.800 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:17.800 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:17.800 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:17.800 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:17.800 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:17.800 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:17.800 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 1 Processor -- start 2024-09-13T10:35:17.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 1 -- start start 2024-09-13T10:35:17.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 10 monclient: init 2024-09-13T10:35:17.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:17.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 10 monclient: _add_conns ranks=[1,7,4,5,6,8,2,0,3] 2024-09-13T10:35:17.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 10 monclient(hunting): picked mon.noname-f con 0x7f2ffc139040 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:17.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 10 monclient(hunting): picked mon.noname-i con 0x7f2ffc09cd50 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 10 monclient(hunting): picked mon.noname-c con 0x7f2ffc13fae0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc09dbb0 con 0x7f2ffc139040 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc09de90 con 0x7f2ffc13fae0 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc09e170 con 0x7f2ffc09cd50 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.797+0000 7f3002cbf640 10 monclient(hunting): authenticate will time out at 1057.303962s 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.798+0000 7f300125c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f2ffc13fae0 0x7f2ffc141ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42590/0 (socket says 172.21.15.181:42590) 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.798+0000 7f300125c640 1 -- 172.21.15.181:0/243844325 learned_addr learned my addr 172.21.15.181:0/243844325 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f300125c640 1 -- 172.21.15.181:0/243844325 >> v1:172.21.15.181:6791/0 conn(0x7f2ffc13fae0 legacy=0x7f2ffc141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f3000a5b640 1 -- 172.21.15.181:0/243844325 >> v1:172.21.15.195:6789/0 conn(0x7f2ffc139040 legacy=0x7f2ffc0a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffbfff640 1 -- 172.21.15.181:0/243844325 >> v1:172.21.15.195:6792/0 conn(0x7f2ffc09cd50 legacy=0x7f2ffc13e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 1 -- 172.21.15.181:0/243844325 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1905017199 0 0) 0x7f2ffc09e170 con 0x7f2ffc09cd50 2024-09-13T10:35:17.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient(hunting): my global_id is 56167 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 1 -- 172.21.15.181:0/243844325 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fec003520 con 0x7f2ffc09cd50 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 1 -- 172.21.15.181:0/243844325 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2244335036 0 0) 0x7f2ffc09dbb0 con 0x7f2ffc139040 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient(hunting): my global_id is 56215 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 1 -- 172.21.15.181:0/243844325 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ffc09e170 con 0x7f2ffc139040 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 1 -- 172.21.15.181:0/243844325 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3274786435 0 0) 0x7f2fec003520 con 0x7f2ffc09cd50 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 1 -- 172.21.15.181:0/243844325 >> v1:172.21.15.181:6791/0 conn(0x7f2ffc13fae0 legacy=0x7f2ffc141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 1 -- 172.21.15.181:0/243844325 >> v1:172.21.15.195:6789/0 conn(0x7f2ffc139040 legacy=0x7f2ffc0a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 1 monclient: found mon.noname-i 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 1 -- 172.21.15.181:0/243844325 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ffc0a5ff0 con 0x7f2ffc09cd50 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient: _finish_auth 0 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 1 -- 172.21.15.181:0/243844325 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2fe8001bf0 con 0x7f2ffc09cd50 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient: dump: 2024-09-13T10:35:17.809 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.810 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f3002cbf640 5 monclient: authenticate success, global_id 56167 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f3002cbf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 1 -- 172.21.15.181:0/243844325 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fe8003610 con 0x7f2ffc09cd50 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f3002cbf640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 1 -- 172.21.15.181:0/243844325 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2fe8003c00 con 0x7f2ffc09cd50 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f3002cbf640 4 set_mon_vals no callback set 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.800+0000 7f2ffb7fe640 10 monclient: dump: 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.811 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.812 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.801+0000 7f3002cbf640 10 monclient: shutdown 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.801+0000 7f3002cbf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.801+0000 7f3002cbf640 1 -- 172.21.15.181:0/243844325 >> v1:172.21.15.195:6792/0 conn(0x7f2ffc09cd50 legacy=0x7f2ffc13e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.801+0000 7f3002cbf640 1 -- 172.21.15.181:0/243844325 shutdown_connections 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.801+0000 7f3002cbf640 1 -- 172.21.15.181:0/243844325 >> 172.21.15.181:0/243844325 conn(0x7f2ffc077120 msgr2=0x7f2ffc0abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.801+0000 7f3002cbf640 1 -- 172.21.15.181:0/243844325 shutdown_connections 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.801+0000 7f3002cbf640 1 -- 172.21.15.181:0/243844325 wait complete. 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.801+0000 7f3002cbf640 10 monclient: build_initial_monmap 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.801+0000 7f3002cbf640 10 monclient: monmap: 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:17.813 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.802+0000 7f3002cbf640 1 Processor -- start 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.802+0000 7f3002cbf640 1 -- start start 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.802+0000 7f3002cbf640 10 monclient: init 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.802+0000 7f3002cbf640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.802+0000 7f3002cbf640 10 monclient: _add_conns ranks=[7,1,3,6,8,4,0,2,5] 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.802+0000 7f3002cbf640 10 monclient(hunting): picked mon.noname-i con 0x7f2ffc09cd50 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.802+0000 7f3002cbf640 10 monclient(hunting): picked mon.noname-f con 0x7f2ffc139040 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.802+0000 7f3002cbf640 10 monclient(hunting): picked mon.noname-g con 0x7f2ffc13fae0 addr v1:172.21.15.195:6790/0 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.802+0000 7f3002cbf640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc13add0 con 0x7f2ffc139040 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.803+0000 7f3002cbf640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc13b0b0 con 0x7f2ffc13fae0 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.803+0000 7f3002cbf640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ffc136470 con 0x7f2ffc09cd50 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.803+0000 7f3002cbf640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.803+0000 7f3002cbf640 10 monclient(hunting): authenticate will time out at 1057.309029s 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.803+0000 7f2ffbfff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f2ffc139040 0x7f2ffc134910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:54100/0 (socket says 172.21.15.181:54100) 2024-09-13T10:35:17.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.803+0000 7f3000a5b640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f2ffc09cd50 0x7f2ffc134200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:60770/0 (socket says 172.21.15.181:60770) 2024-09-13T10:35:17.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.803+0000 7f2ffbfff640 1 -- 172.21.15.181:0/3200264815 learned_addr learned my addr 172.21.15.181:0/3200264815 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:17.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f300125c640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6790/0 conn(0x7f2ffc13fae0 legacy=0x7f2ffc1d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ffbfff640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6789/0 conn(0x7f2ffc139040 legacy=0x7f2ffc134910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f3000a5b640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6792/0 conn(0x7f2ffc09cd50 legacy=0x7f2ffc134200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3636302215 0 0) 0x7f2ffc13add0 con 0x7f2ffc139040 2024-09-13T10:35:17.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 10 monclient(hunting): my global_id is 56224 2024-09-13T10:35:17.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fe0003520 con 0x7f2ffc139040 2024-09-13T10:35:17.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1721092045 0 0) 0x7f2ffc13b0b0 con 0x7f2ffc13fae0 2024-09-13T10:35:17.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 10 monclient(hunting): my global_id is 6069 2024-09-13T10:35:17.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ffc13add0 con 0x7f2ffc13fae0 2024-09-13T10:35:17.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1581656589 0 0) 0x7f2ffc136470 con 0x7f2ffc09cd50 2024-09-13T10:35:17.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 10 monclient(hunting): my global_id is 56176 2024-09-13T10:35:17.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.805+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ffc13b0b0 con 0x7f2ffc09cd50 2024-09-13T10:35:17.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2079277455 0 0) 0x7f2fe0003520 con 0x7f2ffc139040 2024-09-13T10:35:17.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ffc136470 con 0x7f2ffc139040 2024-09-13T10:35:17.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2fe8001bb0 con 0x7f2ffc139040 2024-09-13T10:35:17.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:17.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:35:17.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient(hunting): dump: 2024-09-13T10:35:17.822 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.823 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2170650488 0 0) 0x7f2ffc13b0b0 con 0x7f2ffc09cd50 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fe0003520 con 0x7f2ffc09cd50 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1165721369 0 0) 0x7f2ffc13add0 con 0x7f2ffc13fae0 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ffc13b0b0 con 0x7f2ffc13fae0 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ff0003610 con 0x7f2ffc09cd50 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient(hunting): dump: 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.824 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ff4001f60 con 0x7f2ffc13fae0 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient(hunting): dump: 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.826 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 413076112 0 0) 0x7f2ffc136470 con 0x7f2ffc139040 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6792/0 conn(0x7f2ffc09cd50 legacy=0x7f2ffc134200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6790/0 conn(0x7f2ffc13fae0 legacy=0x7f2ffc1d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient: _finish_hunting 0 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 monclient: found mon.f 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:35:17.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ffc133270 con 0x7f2ffc139040 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient: _finish_auth 0 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient: _check_auth_tickets 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f3002cbf640 5 monclient: authenticate success, global_id 56224 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f3002cbf640 10 monclient: _renew_subs 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f3002cbf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f3002cbf640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2ffc135780 con 0x7f2ffc139040 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f3002cbf640 10 monclient: _renew_subs 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f3002cbf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f3002cbf640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2ffc135020 con 0x7f2ffc139040 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fe8003610 con 0x7f2ffc139040 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2fe8003b80 con 0x7f2ffc139040 2024-09-13T10:35:17.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ffaffd640 4 set_mon_vals no callback set 2024-09-13T10:35:17.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:17.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.806+0000 7f2ff97fa640 10 monclient: dump: 2024-09-13T10:35:17.829 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.829 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.829 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.829 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.829 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.829 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.829 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.829 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.829 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.807+0000 7f3002cbf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.807+0000 7f3002cbf640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2fdc0065c0 con 0x7f2fdc002860 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.807+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2fe8011ca0 con 0x7f2ffc139040 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.807+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(170..170 src has 1..170) ==== 3506+0+0 (unknown 3052054584 0 0) 0x7f2fe804e2f0 con 0x7f2ffc139040 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.807+0000 7f300125c640 10 monclient: get_auth_request con 0x7f2fe0040620 auth_method 0 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f3000a5b640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6789/0 conn(0x7f2fdc002860 legacy=0x7f2fdc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812239816 0 0) 0x7f2fdc0065c0 con 0x7f2fdc002860 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f2ff97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f2ff97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f2ff97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f2ff97fa640 10 monclient(hunting): my global_id is 56233 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ffc136470 con 0x7f2fdc002860 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 27558981 0 0) 0x7f2ffc136470 con 0x7f2fdc002860 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fdc0065c0 con 0x7f2fdc002860 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ff0003da0 con 0x7f2fdc002860 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f2ff97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f2ff97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.809+0000 7f2ff97fa640 10 monclient: dump: 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.831 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.832 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.832 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.832 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.832 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.832 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.832 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.832 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.832 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.832 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.832 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.832 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.832 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.833 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.833 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.810+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3067438945 0 0) 0x7f2fdc0065c0 con 0x7f2fdc002860 2024-09-13T10:35:17.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.810+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fdc00a160 con 0x7f2fdc002860 2024-09-13T10:35:17.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.810+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2ff0003e30 con 0x7f2fdc002860 2024-09-13T10:35:17.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.810+0000 7f2ff97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:17.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.810+0000 7f2ff97fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:17.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.810+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6789/0 conn(0x7f2fdc002860 legacy=0x7f2fdc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.810+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6789/0 conn(0x7f2fdc002860 legacy=0x7f2fdc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:17.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.816+0000 7f3002cbf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:17.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.816+0000 7f3002cbf640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2fdc009e70 con 0x7f2fdc009130 2024-09-13T10:35:17.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f3000a5b640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6789/0 conn(0x7f2fdc009130 legacy=0x7f2fdc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211749496 0 0) 0x7f2fdc009e70 con 0x7f2fdc009130 2024-09-13T10:35:17.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 10 monclient(hunting): my global_id is 56242 2024-09-13T10:35:17.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fdc0065c0 con 0x7f2fdc009130 2024-09-13T10:35:17.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2478377832 0 0) 0x7f2fdc0065c0 con 0x7f2fdc009130 2024-09-13T10:35:17.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fdc009e70 con 0x7f2fdc009130 2024-09-13T10:35:17.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ff0004330 con 0x7f2fdc009130 2024-09-13T10:35:17.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:17.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 10 monclient: dump: 2024-09-13T10:35:17.836 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.836 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.836 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.836 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.836 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.836 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.836 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.836 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.836 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.836 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.836 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.837 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.837 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.837 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.837 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.837 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1380236543 0 0) 0x7f2fdc009e70 con 0x7f2fdc009130 2024-09-13T10:35:17.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.819+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2fdc00c410 con 0x7f2fdc009130 2024-09-13T10:35:17.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 483575055) 0x7f2ff0005b00 con 0x7f2fdc009130 2024-09-13T10:35:17.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f2ff97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:17.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f2ff97fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:17.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6789/0 conn(0x7f2fdc009130 legacy=0x7f2fdc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f2ff97fa640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6789/0 conn(0x7f2fdc009130 legacy=0x7f2fdc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:17.838 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:17.838 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:17.838 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:17.838 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:17.838 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:17.838 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 332229, 2024-09-13T10:35:17.838 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:17.838 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:17.838 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:17.838 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:17.838 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:17.838 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:17.839 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:17.840 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:17.840 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:17.840 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:17.840 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:17.840 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:17.840 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:17.840 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:17.840 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.840 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:17.840 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:17.840 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.841 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:17.842 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:17.842 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:17.842 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:17.842 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:17.842 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:17.842 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:17.842 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:17.842 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:17.842 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:17.842 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:17.842 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:17.842 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:17.843 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.844 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:17.845 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.846 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.848 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:17.849 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:17.850 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.850 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.850 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.850 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:17.850 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.850 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.850 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.850 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:17.850 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:17.850 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.851 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.852 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:17.852 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:17.852 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.852 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.852 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.852 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:17.852 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:17.852 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.852 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:17.854 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:17.855 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:17.856 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:17.857 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:17.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:17.858 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:17.858 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:17.858 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:35:17.858 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:17.858 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:17.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:17.858 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:17.858 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:17.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f3002cbf640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6800/1839191919 conn(0x7f2fe0040620 legacy=0x7f2fe0042ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f3002cbf640 10 monclient: shutdown 2024-09-13T10:35:17.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f3002cbf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:17.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f3002cbf640 1 -- 172.21.15.181:0/3200264815 >> v1:172.21.15.195:6789/0 conn(0x7f2ffc139040 legacy=0x7f2ffc134910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f300125c640 1 -- 172.21.15.181:0/3200264815 reap_dead start 2024-09-13T10:35:17.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f300125c640 1 -- 172.21.15.181:0/3200264815 reap_dead start 2024-09-13T10:35:17.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f3002cbf640 1 -- 172.21.15.181:0/3200264815 shutdown_connections 2024-09-13T10:35:17.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f3002cbf640 1 -- 172.21.15.181:0/3200264815 >> 172.21.15.181:0/3200264815 conn(0x7f2ffc077120 msgr2=0x7f2ffc12c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:17.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f3002cbf640 1 -- 172.21.15.181:0/3200264815 shutdown_connections 2024-09-13T10:35:17.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.820+0000 7f3002cbf640 1 -- 172.21.15.181:0/3200264815 wait complete. 2024-09-13T10:35:17.861 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:17.861 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:35:17.861 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:35:17.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.956+0000 7fa89b917640 10 monclient: get_monmap_and_config 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.956+0000 7fa89b917640 10 monclient: build_initial_monmap 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.956+0000 7fa89b917640 10 monclient: monmap: 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:17.958009+0000 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:17.958009+0000 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:17.960 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.956+0000 7fa89b917640 1 Processor -- start 2024-09-13T10:35:17.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa89b917640 1 -- start start 2024-09-13T10:35:17.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa89b917640 10 monclient: init 2024-09-13T10:35:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa89b917640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa89b917640 10 monclient: _add_conns ranks=[7,6,4,0,8,5,2,1,3] 2024-09-13T10:35:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa89b917640 10 monclient(hunting): picked mon.noname-i con 0x7fa8940a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa89b917640 10 monclient(hunting): picked mon.noname-d con 0x7fa8940a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa89b917640 10 monclient(hunting): picked mon.noname-c con 0x7fa89413f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa89b917640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8940a4bc0 con 0x7fa89413f750 2024-09-13T10:35:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa89b917640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa89413a320 con 0x7fa8940a8340 2024-09-13T10:35:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa89b917640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8940a8100 con 0x7fa8940a6640 2024-09-13T10:35:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa89b917640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa89b917640 10 monclient(hunting): authenticate will time out at 1057.463681s 2024-09-13T10:35:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa899eb4640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fa89413f750 0x7fa894141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42592/0 (socket says 172.21.15.181:42592) 2024-09-13T10:35:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa898eb2640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fa8940a8340 0x7fa894139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:40244/0 (socket says 172.21.15.181:40244) 2024-09-13T10:35:17.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.957+0000 7fa899eb4640 1 -- 172.21.15.181:0/2562392968 learned_addr learned my addr 172.21.15.181:0/2562392968 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.959+0000 7fa899eb4640 1 -- 172.21.15.181:0/2562392968 >> v1:172.21.15.181:6791/0 conn(0x7fa89413f750 legacy=0x7fa894141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.959+0000 7fa898eb2640 1 -- 172.21.15.181:0/2562392968 >> v1:172.21.15.181:6792/0 conn(0x7fa8940a8340 legacy=0x7fa894139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa8996b3640 1 -- 172.21.15.181:0/2562392968 >> v1:172.21.15.195:6792/0 conn(0x7fa8940a6640 legacy=0x7fa894139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147288592 0 0) 0x7fa8940a4bc0 con 0x7fa89413f750 2024-09-13T10:35:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient(hunting): my global_id is 6142 2024-09-13T10:35:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa880003520 con 0x7fa89413f750 2024-09-13T10:35:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2607991710 0 0) 0x7fa89413a320 con 0x7fa8940a8340 2024-09-13T10:35:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient(hunting): my global_id is 6063 2024-09-13T10:35:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8940a4bc0 con 0x7fa8940a8340 2024-09-13T10:35:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2735434448 0 0) 0x7fa8940a8100 con 0x7fa8940a6640 2024-09-13T10:35:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient(hunting): my global_id is 56185 2024-09-13T10:35:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa89413a320 con 0x7fa8940a6640 2024-09-13T10:35:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2957474745 0 0) 0x7fa8940a4bc0 con 0x7fa8940a8340 2024-09-13T10:35:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 >> v1:172.21.15.195:6792/0 conn(0x7fa8940a6640 legacy=0x7fa894139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 >> v1:172.21.15.181:6791/0 conn(0x7fa89413f750 legacy=0x7fa894141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 monclient: found mon.noname-d 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8940a48e0 con 0x7fa8940a8340 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient: _finish_auth 0 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa89b917640 5 monclient: authenticate success, global_id 6063 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa884001ac0 con 0x7fa8940a8340 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient: dump: 2024-09-13T10:35:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.975 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa89b917640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8840047e0 con 0x7fa8940a8340 2024-09-13T10:35:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 1 -- 172.21.15.181:0/2562392968 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa884004d50 con 0x7fa8940a8340 2024-09-13T10:35:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa88bfff640 10 monclient: dump: 2024-09-13T10:35:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.976 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa89b917640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.960+0000 7fa89b917640 4 set_mon_vals no callback set 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.961+0000 7fa89b917640 10 monclient: shutdown 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.961+0000 7fa89b917640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.961+0000 7fa89b917640 1 -- 172.21.15.181:0/2562392968 >> v1:172.21.15.181:6792/0 conn(0x7fa8940a8340 legacy=0x7fa894139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.961+0000 7fa89b917640 1 -- 172.21.15.181:0/2562392968 shutdown_connections 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.961+0000 7fa89b917640 1 -- 172.21.15.181:0/2562392968 >> 172.21.15.181:0/2562392968 conn(0x7fa894077170 msgr2=0x7fa8940abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.961+0000 7fa89b917640 1 -- 172.21.15.181:0/2562392968 shutdown_connections 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.961+0000 7fa89b917640 1 -- 172.21.15.181:0/2562392968 wait complete. 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.961+0000 7fa89b917640 10 monclient: build_initial_monmap 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.961+0000 7fa89b917640 10 monclient: monmap: 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 1 Processor -- start 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 1 -- start start 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 10 monclient: init 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 10 monclient: _add_conns ranks=[2,8,0,6,4,5,1,3,7] 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 10 monclient(hunting): picked mon.noname-b con 0x7fa8940a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 10 monclient(hunting): picked mon.noname-e con 0x7fa89413f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 10 monclient(hunting): picked mon.noname-a con 0x7fa894142140 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa89413c370 con 0x7fa894142140 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa89413c650 con 0x7fa8940a8340 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8940a9f20 con 0x7fa89413f750 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa89b917640 10 monclient(hunting): authenticate will time out at 1057.468717s 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa8996b3640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fa8940a8340 0x7fa8941ce570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:59196/0 (socket says 172.21.15.181:59196) 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa898eb2640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fa89413f750 0x7fa8941d3510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54480/0 (socket says 172.21.15.181:54480) 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.962+0000 7fa8996b3640 1 -- 172.21.15.181:0/1856003383 learned_addr learned my addr 172.21.15.181:0/1856003383 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.964+0000 7fa898eb2640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.181:6793/0 conn(0x7fa89413f750 legacy=0x7fa8941d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.964+0000 7fa8996b3640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.181:6790/0 conn(0x7fa8940a8340 legacy=0x7fa8941ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.964+0000 7fa899eb4640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.181:6789/0 conn(0x7fa894142140 legacy=0x7fa8941d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 410319127 0 0) 0x7fa8940a9f20 con 0x7fa89413f750 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): my global_id is 104183 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa878003550 con 0x7fa89413f750 2024-09-13T10:35:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3849123819 0 0) 0x7fa89413c370 con 0x7fa894142140 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): my global_id is 104130 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8940a9f20 con 0x7fa894142140 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283622400 0 0) 0x7fa89413c650 con 0x7fa8940a8340 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): my global_id is 94421 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa89413c370 con 0x7fa8940a8340 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2128918739 0 0) 0x7fa89413c370 con 0x7fa8940a8340 2024-09-13T10:35:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa89413c650 con 0x7fa8940a8340 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa890003610 con 0x7fa8940a8340 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): dump: 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 370772522 0 0) 0x7fa878003550 con 0x7fa89413f750 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa89413c370 con 0x7fa89413f750 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 662982108 0 0) 0x7fa8940a9f20 con 0x7fa894142140 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa878003550 con 0x7fa894142140 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa884004cd0 con 0x7fa89413f750 2024-09-13T10:35:17.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): dump: 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.984 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa88c0020b0 con 0x7fa894142140 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient(hunting): dump: 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.985 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1615932759 0 0) 0x7fa89413c650 con 0x7fa8940a8340 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.181:6793/0 conn(0x7fa89413f750 legacy=0x7fa8941d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.181:6789/0 conn(0x7fa894142140 legacy=0x7fa8941d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 monclient: found mon.b 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89413ae50 con 0x7fa8940a8340 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient: _finish_auth 0 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa89b917640 5 monclient: authenticate success, global_id 94421 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa89b917640 10 monclient: _renew_subs 2024-09-13T10:35:17.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa89b917640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa89b917640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa89413c090 con 0x7fa8940a8340 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa890003ae0 con 0x7fa8940a8340 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa890004010 con 0x7fa8940a8340 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa889ffb640 10 monclient: dump: 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.988 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa88b7fe640 4 set_mon_vals no callback set 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa89b917640 10 monclient: _renew_subs 2024-09-13T10:35:17.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa89b917640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:35:17.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.965+0000 7fa89b917640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa8941cee60 con 0x7fa8940a8340 2024-09-13T10:35:17.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.966+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa890004260 con 0x7fa8940a8340 2024-09-13T10:35:17.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.966+0000 7fa89b917640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:17.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.966+0000 7fa89b917640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa8940abff0 con 0x7fa894077170 2024-09-13T10:35:17.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.966+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(170..170 src has 1..170) ==== 3506+0+0 (unknown 3052054584 0 0) 0x7fa89004e1d0 con 0x7fa8940a8340 2024-09-13T10:35:17.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.967+0000 7fa899eb4640 10 monclient: get_auth_request con 0x7fa878040610 auth_method 0 2024-09-13T10:35:17.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa898eb2640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.195:6790/0 conn(0x7fa894077170 legacy=0x7fa894130a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 878859179 0 0) 0x7fa8940a48e0 con 0x7fa894077170 2024-09-13T10:35:17.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 10 monclient(hunting): my global_id is 6078 2024-09-13T10:35:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa89413c650 con 0x7fa894077170 2024-09-13T10:35:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3208113480 0 0) 0x7fa89413c650 con 0x7fa894077170 2024-09-13T10:35:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8940a48e0 con 0x7fa894077170 2024-09-13T10:35:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa8840047e0 con 0x7fa894077170 2024-09-13T10:35:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:35:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 10 monclient: dump: 2024-09-13T10:35:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.994 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 636672597 0 0) 0x7fa8940a48e0 con 0x7fa894077170 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.969+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa89413a550 con 0x7fa894077170 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.970+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa884005680 con 0x7fa894077170 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.970+0000 7fa889ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.970+0000 7fa889ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.970+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.195:6790/0 conn(0x7fa894077170 legacy=0x7fa894130a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.970+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.195:6790/0 conn(0x7fa894077170 legacy=0x7fa894130a30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.976+0000 7fa89b917640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.976+0000 7fa89b917640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa894143260 con 0x7fa894069b40 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.978+0000 7fa898eb2640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.195:6790/0 conn(0x7fa894069b40 legacy=0x7fa894131140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.978+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653274862 0 0) 0x7fa894143260 con 0x7fa894069b40 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.978+0000 7fa889ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:17.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.978+0000 7fa889ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:17.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.978+0000 7fa889ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:17.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.978+0000 7fa889ffb640 10 monclient(hunting): my global_id is 6087 2024-09-13T10:35:17.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.978+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8940a48e0 con 0x7fa894069b40 2024-09-13T10:35:17.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1486820780 0 0) 0x7fa8940a48e0 con 0x7fa894069b40 2024-09-13T10:35:17.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa894143260 con 0x7fa894069b40 2024-09-13T10:35:17.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa884005d60 con 0x7fa894069b40 2024-09-13T10:35:17.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:17.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:35:17.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 10 monclient: dump: 2024-09-13T10:35:17.996 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:17.996 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:17.996 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:17.997 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:17.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4074207268 0 0) 0x7fa894143260 con 0x7fa894069b40 2024-09-13T10:35:17.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa894131850 con 0x7fa894069b40 2024-09-13T10:35:17.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7728 (unknown 0 0 2977236907) 0x7fa8840080a0 con 0x7fa894069b40 2024-09-13T10:35:17.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:17.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:17.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.195:6790/0 conn(0x7fa894069b40 legacy=0x7fa894131140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:17.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.979+0000 7fa889ffb640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.195:6790/0 conn(0x7fa894069b40 legacy=0x7fa894131140 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:17.998 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:17.998 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:17.998 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 332395, 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:17.999 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:18.000 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:18.001 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:18.002 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:18.003 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.004 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:18.005 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.006 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.008 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:18.009 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.010 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.011 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:18.013 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.014 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.015 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.016 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.017 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:18.018 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:18.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.980+0000 7fa89b917640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa878040610 legacy=0x7fa878042ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.980+0000 7fa89b917640 10 monclient: shutdown 2024-09-13T10:35:18.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.980+0000 7fa89b917640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:18.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.980+0000 7fa89b917640 1 -- 172.21.15.181:0/1856003383 >> v1:172.21.15.181:6790/0 conn(0x7fa8940a8340 legacy=0x7fa8941ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.980+0000 7fa899eb4640 1 -- 172.21.15.181:0/1856003383 reap_dead start 2024-09-13T10:35:18.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.980+0000 7fa899eb4640 1 -- 172.21.15.181:0/1856003383 reap_dead start 2024-09-13T10:35:18.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.980+0000 7fa89b917640 1 -- 172.21.15.181:0/1856003383 shutdown_connections 2024-09-13T10:35:18.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.980+0000 7fa89b917640 1 -- 172.21.15.181:0/1856003383 >> 172.21.15.181:0/1856003383 conn(0x7fa8940a6640 msgr2=0x7fa8940a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:18.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.980+0000 7fa89b917640 1 -- 172.21.15.181:0/1856003383 shutdown_connections 2024-09-13T10:35:18.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:17.980+0000 7fa89b917640 1 -- 172.21.15.181:0/1856003383 wait complete. 2024-09-13T10:35:18.021 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:18.021 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:35:18.021 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:35:18.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.117+0000 7febb6640640 10 monclient: get_monmap_and_config 2024-09-13T10:35:18.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.117+0000 7febb6640640 10 monclient: build_initial_monmap 2024-09-13T10:35:18.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.117+0000 7febb6640640 10 monclient: monmap: 2024-09-13T10:35:18.120 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:18.120 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.120 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:18.118855+0000 2024-09-13T10:35:18.120 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:18.118855+0000 2024-09-13T10:35:18.120 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:18.120 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.120 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:18.120 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:18.120 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:18.120 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:18.120 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:18.120 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:18.121 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:18.121 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:18.121 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:18.121 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.117+0000 7febb6640640 1 Processor -- start 2024-09-13T10:35:18.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febb6640640 1 -- start start 2024-09-13T10:35:18.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febb6640640 10 monclient: init 2024-09-13T10:35:18.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febb6640640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:18.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febb6640640 10 monclient: _add_conns ranks=[6,0,5,2,7,4,1,3,8] 2024-09-13T10:35:18.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febb6640640 10 monclient(hunting): picked mon.noname-d con 0x7febb00a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:18.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febb6640640 10 monclient(hunting): picked mon.noname-a con 0x7febb00a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:18.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febb6640640 10 monclient(hunting): picked mon.noname-h con 0x7febb013f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:18.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febb6640640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb00a4bc0 con 0x7febb00a8340 2024-09-13T10:35:18.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febb6640640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb013a320 con 0x7febb013f750 2024-09-13T10:35:18.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febb6640640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb00a8100 con 0x7febb00a6640 2024-09-13T10:35:18.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febb6640640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:18.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febb6640640 10 monclient(hunting): authenticate will time out at 1057.624573s 2024-09-13T10:35:18.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febaf7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7febb00a8340 0x7febb0139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43500/0 (socket says 172.21.15.181:43500) 2024-09-13T10:35:18.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febaffff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7febb00a6640 0x7febb0139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:40260/0 (socket says 172.21.15.181:40260) 2024-09-13T10:35:18.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.118+0000 7febaf7fe640 1 -- 172.21.15.181:0/2573327708 learned_addr learned my addr 172.21.15.181:0/2573327708 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:18.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.120+0000 7febaf7fe640 1 -- 172.21.15.181:0/2573327708 >> v1:172.21.15.181:6789/0 conn(0x7febb00a8340 legacy=0x7febb0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.120+0000 7febaffff640 1 -- 172.21.15.181:0/2573327708 >> v1:172.21.15.181:6792/0 conn(0x7febb00a6640 legacy=0x7febb0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 1 -- 172.21.15.181:0/2573327708 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3234276837 0 0) 0x7febb00a4bc0 con 0x7febb00a8340 2024-09-13T10:35:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient(hunting): my global_id is 104139 2024-09-13T10:35:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 1 -- 172.21.15.181:0/2573327708 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb9c003520 con 0x7febb00a8340 2024-09-13T10:35:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 1 -- 172.21.15.181:0/2573327708 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 386030021 0 0) 0x7febb00a8100 con 0x7febb00a6640 2024-09-13T10:35:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient(hunting): my global_id is 6072 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 1 -- 172.21.15.181:0/2573327708 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febb00a4bc0 con 0x7febb00a6640 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febb4bdd640 1 -- 172.21.15.181:0/2573327708 >> v1:172.21.15.195:6791/0 conn(0x7febb013f750 legacy=0x7febb0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 1 -- 172.21.15.181:0/2573327708 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2211307445 0 0) 0x7febb00a4bc0 con 0x7febb00a6640 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 1 -- 172.21.15.181:0/2573327708 >> v1:172.21.15.195:6791/0 conn(0x7febb013f750 legacy=0x7febb0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 1 -- 172.21.15.181:0/2573327708 >> v1:172.21.15.181:6789/0 conn(0x7febb00a8340 legacy=0x7febb0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient: _finish_hunting 0 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 1 monclient: found mon.noname-d 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 1 -- 172.21.15.181:0/2573327708 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb00a48e0 con 0x7febb00a6640 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient: _finish_auth 0 2024-09-13T10:35:18.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient: _check_auth_tickets 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 1 -- 172.21.15.181:0/2573327708 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feba0001970 con 0x7febb00a6640 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febb6640640 5 monclient: authenticate success, global_id 6072 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febb6640640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient: dump: 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.129 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febb6640640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 1 -- 172.21.15.181:0/2573327708 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feba0001c40 con 0x7febb00a6640 2024-09-13T10:35:18.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:18.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 1 -- 172.21.15.181:0/2573327708 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feba0004b20 con 0x7febb00a6640 2024-09-13T10:35:18.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febb6640640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:18.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febb6640640 4 set_mon_vals no callback set 2024-09-13T10:35:18.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:18.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:18.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febaeffd640 10 monclient: dump: 2024-09-13T10:35:18.131 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.131 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.131 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.131 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.131 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.131 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febb6640640 10 monclient: shutdown 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febb6640640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:18.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.121+0000 7febb6640640 1 -- 172.21.15.181:0/2573327708 >> v1:172.21.15.181:6792/0 conn(0x7febb00a6640 legacy=0x7febb0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.122+0000 7febb6640640 1 -- 172.21.15.181:0/2573327708 shutdown_connections 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.122+0000 7febb6640640 1 -- 172.21.15.181:0/2573327708 >> 172.21.15.181:0/2573327708 conn(0x7febb0077170 msgr2=0x7febb00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.122+0000 7febb6640640 1 -- 172.21.15.181:0/2573327708 shutdown_connections 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.122+0000 7febb6640640 1 -- 172.21.15.181:0/2573327708 wait complete. 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.122+0000 7febb6640640 10 monclient: build_initial_monmap 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.122+0000 7febb6640640 10 monclient: monmap: 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:18.133 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:18.134 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.122+0000 7febb6640640 1 Processor -- start 2024-09-13T10:35:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febb6640640 1 -- start start 2024-09-13T10:35:18.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febb6640640 10 monclient: init 2024-09-13T10:35:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febb6640640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febb6640640 10 monclient: _add_conns ranks=[5,0,3,2,7,6,8,4,1] 2024-09-13T10:35:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febb6640640 10 monclient(hunting): picked mon.noname-h con 0x7febb00a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febb6640640 10 monclient(hunting): picked mon.noname-a con 0x7febb013f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febb6640640 10 monclient(hunting): picked mon.noname-g con 0x7febb01d4310 addr v1:172.21.15.195:6790/0 2024-09-13T10:35:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febb6640640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb00a1100 con 0x7febb013f750 2024-09-13T10:35:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febb6640640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb009e100 con 0x7febb01d4310 2024-09-13T10:35:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febb6640640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb00a9db0 con 0x7febb00a8340 2024-09-13T10:35:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febb6640640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febb6640640 10 monclient(hunting): authenticate will time out at 1057.629583s 2024-09-13T10:35:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febaf7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7febb013f750 0x7febb009d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43510/0 (socket says 172.21.15.181:43510) 2024-09-13T10:35:18.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.123+0000 7febaf7fe640 1 -- 172.21.15.181:0/1395714955 learned_addr learned my addr 172.21.15.181:0/1395714955 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.125+0000 7febaf7fe640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.181:6789/0 conn(0x7febb013f750 legacy=0x7febb009d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.125+0000 7febaffff640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.195:6791/0 conn(0x7febb00a8340 legacy=0x7febb009d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.125+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4223776153 0 0) 0x7febb00a1100 con 0x7febb013f750 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.125+0000 7febacff9640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.125+0000 7febacff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.125+0000 7febacff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.125+0000 7febacff9640 10 monclient(hunting): my global_id is 104148 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.125+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb90003520 con 0x7febb013f750 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.125+0000 7febb4bdd640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.195:6790/0 conn(0x7febb01d4310 legacy=0x7febb01d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793859463 0 0) 0x7febb00a9db0 con 0x7febb00a8340 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient(hunting): my global_id is 104144 2024-09-13T10:35:18.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febb00a1100 con 0x7febb00a8340 2024-09-13T10:35:18.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1562509007 0 0) 0x7feb90003520 con 0x7febb013f750 2024-09-13T10:35:18.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7febb00a9db0 con 0x7febb013f750 2024-09-13T10:35:18.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb98001a60 con 0x7febb013f750 2024-09-13T10:35:18.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:18.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:35:18.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient(hunting): dump: 2024-09-13T10:35:18.141 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.141 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.141 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.141 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.141 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.141 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501803852 0 0) 0x7febb009e100 con 0x7febb01d4310 2024-09-13T10:35:18.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient(hunting): my global_id is 6096 2024-09-13T10:35:18.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb90003520 con 0x7febb01d4310 2024-09-13T10:35:18.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 568341504 0 0) 0x7febb00a9db0 con 0x7febb013f750 2024-09-13T10:35:18.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.195:6791/0 conn(0x7febb00a8340 legacy=0x7febb009d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.195:6790/0 conn(0x7febb01d4310 legacy=0x7febb01d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient: _finish_hunting 0 2024-09-13T10:35:18.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 monclient: found mon.a 2024-09-13T10:35:18.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:18.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:35:18.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb0142e60 con 0x7febb013f750 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient: _finish_auth 0 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient: _check_auth_tickets 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febb6640640 5 monclient: authenticate success, global_id 104148 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febb6640640 10 monclient: _renew_subs 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febb6640640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febb6640640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7febb00a0290 con 0x7febb013f750 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febb6640640 10 monclient: _renew_subs 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febb6640640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febb6640640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7febb00a0e20 con 0x7febb013f750 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb98004dd0 con 0x7febb013f750 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:18.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feb980052c0 con 0x7febb013f750 2024-09-13T10:35:18.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:18.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:18.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febae7fc640 4 set_mon_vals no callback set 2024-09-13T10:35:18.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.126+0000 7febacff9640 10 monclient: dump: 2024-09-13T10:35:18.145 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.145 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.145 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.145 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.145 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.145 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.145 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.145 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.127+0000 7febb6640640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.127+0000 7febb6640640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feb940065c0 con 0x7feb94002860 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.127+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7feb98011940 con 0x7febb013f750 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.127+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(170..170 src has 1..170) ==== 3506+0+0 (unknown 3052054584 0 0) 0x7feb9804e340 con 0x7febb013f750 2024-09-13T10:35:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.127+0000 7febb4bdd640 10 monclient: get_auth_request con 0x7feb9003fcb0 auth_method 0 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febaffff640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.195:6791/0 conn(0x7feb94002860 legacy=0x7feb94004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 573406044 0 0) 0x7feb940065c0 con 0x7feb94002860 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 10 monclient(hunting): my global_id is 104153 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febb00a9db0 con 0x7feb94002860 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3123405443 0 0) 0x7febb00a9db0 con 0x7feb94002860 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb940065c0 con 0x7feb94002860 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feba0001970 con 0x7feb94002860 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:35:18.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 10 monclient: dump: 2024-09-13T10:35:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.148 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.149 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 899832648 0 0) 0x7feb940065c0 con 0x7feb94002860 2024-09-13T10:35:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.129+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb9400a160 con 0x7feb94002860 2024-09-13T10:35:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.130+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7feba00047e0 con 0x7feb94002860 2024-09-13T10:35:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.130+0000 7febacff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.130+0000 7febacff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.130+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.195:6791/0 conn(0x7feb94002860 legacy=0x7feb94004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.130+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.195:6791/0 conn(0x7feb94002860 legacy=0x7feb94004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:18.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.136+0000 7febb6640640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:18.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.136+0000 7febb6640640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feb94009e70 con 0x7feb94009130 2024-09-13T10:35:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.138+0000 7febaffff640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.195:6791/0 conn(0x7feb94009130 legacy=0x7feb940095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957333588 0 0) 0x7feb94009e70 con 0x7feb94009130 2024-09-13T10:35:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 10 monclient(hunting): my global_id is 104162 2024-09-13T10:35:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb940065c0 con 0x7feb94009130 2024-09-13T10:35:18.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3759728472 0 0) 0x7feb940065c0 con 0x7feb94009130 2024-09-13T10:35:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb94009e70 con 0x7feb94009130 2024-09-13T10:35:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feba0004e60 con 0x7feb94009130 2024-09-13T10:35:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:35:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 10 monclient: dump: 2024-09-13T10:35:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.152 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3407301810 0 0) 0x7feb94009e70 con 0x7feb94009130 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feb9400c410 con 0x7feb94009130 2024-09-13T10:35:18.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7557 (unknown 0 0 987217414) 0x7feba0005340 con 0x7feb94009130 2024-09-13T10:35:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.195:6791/0 conn(0x7feb94009130 legacy=0x7feb940095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.139+0000 7febacff9640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.195:6791/0 conn(0x7feb94009130 legacy=0x7feb940095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:18.154 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:18.154 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:18.154 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:18.154 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 1839, 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:18.155 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.156 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:35:18.156 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:18.156 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:18.156 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:18.156 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:18.156 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:18.156 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:18.156 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:18.156 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:18.156 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:18.156 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:18.156 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:18.157 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:18.158 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:18.158 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:18.158 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:18.158 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.158 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:18.158 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:18.158 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:18.158 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:18.158 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:18.158 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:18.158 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:18.159 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:18.159 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:18.159 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:18.159 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:18.159 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:18.159 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:18.159 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:18.159 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:18.159 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:18.159 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:18.159 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:18.159 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:18.160 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:18.160 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:18.160 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:18.160 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:18.160 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:18.160 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:18.160 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:18.160 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:18.160 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:18.160 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.160 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:18.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.162 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.163 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:18.164 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:18.165 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:18.166 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.167 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.168 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.170 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:18.171 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:18.172 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:18.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.174 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:18.175 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:18.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.140+0000 7febb6640640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.195:6800/1839191919 conn(0x7feb9003fcb0 legacy=0x7feb90042170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.140+0000 7febb6640640 10 monclient: shutdown 2024-09-13T10:35:18.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.140+0000 7febb6640640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:18.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.140+0000 7febb6640640 1 -- 172.21.15.181:0/1395714955 >> v1:172.21.15.181:6789/0 conn(0x7febb013f750 legacy=0x7febb009d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.140+0000 7febb4bdd640 1 -- 172.21.15.181:0/1395714955 reap_dead start 2024-09-13T10:35:18.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.140+0000 7febb4bdd640 1 -- 172.21.15.181:0/1395714955 reap_dead start 2024-09-13T10:35:18.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.140+0000 7febb6640640 1 -- 172.21.15.181:0/1395714955 shutdown_connections 2024-09-13T10:35:18.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.140+0000 7febb6640640 1 -- 172.21.15.181:0/1395714955 >> 172.21.15.181:0/1395714955 conn(0x7febb00a6640 msgr2=0x7febb013efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:18.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.140+0000 7febb6640640 1 -- 172.21.15.181:0/1395714955 shutdown_connections 2024-09-13T10:35:18.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.140+0000 7febb6640640 1 -- 172.21.15.181:0/1395714955 wait complete. 2024-09-13T10:35:18.177 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:18.177 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:35:18.177 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:35:18.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.273+0000 7f4421e0f640 10 monclient: get_monmap_and_config 2024-09-13T10:35:18.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.273+0000 7f4421e0f640 10 monclient: build_initial_monmap 2024-09-13T10:35:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.273+0000 7f4421e0f640 10 monclient: monmap: 2024-09-13T10:35:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:18.274840+0000 2024-09-13T10:35:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:18.274840+0000 2024-09-13T10:35:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:18.315 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:18.316 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:18.316 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.273+0000 7f4421e0f640 1 Processor -- start 2024-09-13T10:35:18.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f4421e0f640 1 -- start start 2024-09-13T10:35:18.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f4421e0f640 10 monclient: init 2024-09-13T10:35:18.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f4421e0f640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:18.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f4421e0f640 10 monclient: _add_conns ranks=[7,4,1,6,2,8,5,0,3] 2024-09-13T10:35:18.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f4421e0f640 10 monclient(hunting): picked mon.noname-i con 0x7f441c0a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:18.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f4421e0f640 10 monclient(hunting): picked mon.noname-c con 0x7f441c0a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:18.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f4421e0f640 10 monclient(hunting): picked mon.noname-f con 0x7f441c13f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:18.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f4421e0f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441c0a5fe0 con 0x7f441c13f9a0 2024-09-13T10:35:18.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f4421e0f640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441c0a8080 con 0x7f441c0a6ab0 2024-09-13T10:35:18.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f4421e0f640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441c0a42c0 con 0x7f441c0a66d0 2024-09-13T10:35:18.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f4421e0f640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:18.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f4421e0f640 10 monclient(hunting): authenticate will time out at 1057.780531s 2024-09-13T10:35:18.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f441affd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f441c0a6ab0 0x7f441c0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42598/0 (socket says 172.21.15.181:42598) 2024-09-13T10:35:18.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.274+0000 7f441affd640 1 -- 172.21.15.181:0/1543319203 learned_addr learned my addr 172.21.15.181:0/1543319203 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.276+0000 7f441affd640 1 -- 172.21.15.181:0/1543319203 >> v1:172.21.15.181:6791/0 conn(0x7f441c0a6ab0 legacy=0x7f441c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.276+0000 7f441a7fc640 1 -- 172.21.15.181:0/1543319203 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429947821 0 0) 0x7f441c0a8080 con 0x7f441c0a6ab0 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.276+0000 7f441a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.276+0000 7f441a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.276+0000 7f441a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.276+0000 7f441a7fc640 10 monclient(hunting): my global_id is 6151 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.276+0000 7f441a7fc640 1 -- 172.21.15.181:0/1543319203 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4404003520 con 0x7f441c0a6ab0 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441b7fe640 1 -- 172.21.15.181:0/1543319203 >> v1:172.21.15.195:6792/0 conn(0x7f441c0a66d0 legacy=0x7f441c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441bfff640 1 -- 172.21.15.181:0/1543319203 >> v1:172.21.15.195:6789/0 conn(0x7f441c13f9a0 legacy=0x7f441c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 1 -- 172.21.15.181:0/1543319203 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 457386718 0 0) 0x7f4404003520 con 0x7f441c0a6ab0 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 1 -- 172.21.15.181:0/1543319203 >> v1:172.21.15.195:6792/0 conn(0x7f441c0a66d0 legacy=0x7f441c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 1 -- 172.21.15.181:0/1543319203 >> v1:172.21.15.195:6789/0 conn(0x7f441c13f9a0 legacy=0x7f441c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 1 monclient: found mon.noname-c 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 1 -- 172.21.15.181:0/1543319203 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441c1464e0 con 0x7f441c0a6ab0 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 1 -- 172.21.15.181:0/1543319203 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4410001e60 con 0x7f441c0a6ab0 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f4421e0f640 5 monclient: authenticate success, global_id 6151 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f4421e0f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:35:18.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 10 monclient: dump: 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.330 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f4421e0f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 1 -- 172.21.15.181:0/1543319203 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4410004c20 con 0x7f441c0a6ab0 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 1 -- 172.21.15.181:0/1543319203 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4410005150 con 0x7f441c0a6ab0 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f4421e0f640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f4421e0f640 4 set_mon_vals no callback set 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f441a7fc640 10 monclient: dump: 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.331 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f4421e0f640 10 monclient: shutdown 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f4421e0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f4421e0f640 1 -- 172.21.15.181:0/1543319203 >> v1:172.21.15.181:6791/0 conn(0x7f441c0a6ab0 legacy=0x7f441c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f4421e0f640 1 -- 172.21.15.181:0/1543319203 shutdown_connections 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f4421e0f640 1 -- 172.21.15.181:0/1543319203 >> 172.21.15.181:0/1543319203 conn(0x7f441c0abcd0 msgr2=0x7f441c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f4421e0f640 1 -- 172.21.15.181:0/1543319203 shutdown_connections 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.277+0000 7f4421e0f640 1 -- 172.21.15.181:0/1543319203 wait complete. 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.278+0000 7f4421e0f640 10 monclient: build_initial_monmap 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.278+0000 7f4421e0f640 10 monclient: monmap: 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:18.333 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.278+0000 7f4421e0f640 1 Processor -- start 2024-09-13T10:35:18.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f4421e0f640 1 -- start start 2024-09-13T10:35:18.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f4421e0f640 10 monclient: init 2024-09-13T10:35:18.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f4421e0f640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:18.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f4421e0f640 10 monclient: _add_conns ranks=[8,6,0,7,2,3,4,5,1] 2024-09-13T10:35:18.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f4421e0f640 10 monclient(hunting): picked mon.noname-e con 0x7f441c0a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:18.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f4421e0f640 10 monclient(hunting): picked mon.noname-d con 0x7f441c0a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:18.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f4421e0f640 10 monclient(hunting): picked mon.noname-a con 0x7f441c13f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:18.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f4421e0f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441c13ef90 con 0x7f441c13f9a0 2024-09-13T10:35:18.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f4421e0f640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441c13f270 con 0x7f441c0a6ab0 2024-09-13T10:35:18.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f4421e0f640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441c0a28c0 con 0x7f441c0a66d0 2024-09-13T10:35:18.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f4421e0f640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:18.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f4421e0f640 10 monclient(hunting): authenticate will time out at 1057.785458s 2024-09-13T10:35:18.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f441b7fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f441c0a66d0 0x7f441c1ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54496/0 (socket says 172.21.15.181:54496) 2024-09-13T10:35:18.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.279+0000 7f441b7fe640 1 -- 172.21.15.181:0/2932992212 learned_addr learned my addr 172.21.15.181:0/2932992212 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:18.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f441affd640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.181:6792/0 conn(0x7f441c0a6ab0 legacy=0x7f441c1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f441bfff640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.181:6789/0 conn(0x7f441c13f9a0 legacy=0x7f441c1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f441b7fe640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.181:6793/0 conn(0x7f441c0a66d0 legacy=0x7f441c1ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2075954978 0 0) 0x7f441c13f270 con 0x7f441c0a6ab0 2024-09-13T10:35:18.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 10 monclient(hunting): my global_id is 6081 2024-09-13T10:35:18.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4408003520 con 0x7f441c0a6ab0 2024-09-13T10:35:18.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961652783 0 0) 0x7f441c13ef90 con 0x7f441c13f9a0 2024-09-13T10:35:18.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 10 monclient(hunting): my global_id is 104157 2024-09-13T10:35:18.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f441c13f270 con 0x7f441c13f9a0 2024-09-13T10:35:18.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2002810676 0 0) 0x7f441c0a28c0 con 0x7f441c0a66d0 2024-09-13T10:35:18.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 10 monclient(hunting): my global_id is 104192 2024-09-13T10:35:18.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.281+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f441c13ef90 con 0x7f441c0a66d0 2024-09-13T10:35:18.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 97808580 0 0) 0x7f4408003520 con 0x7f441c0a6ab0 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f441c0a28c0 con 0x7f441c0a6ab0 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4410005110 con 0x7f441c0a6ab0 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient(hunting): dump: 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.338 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1156663501 0 0) 0x7f441c13f270 con 0x7f441c13f9a0 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4408003520 con 0x7f441c13f9a0 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3481346386 0 0) 0x7f441c13ef90 con 0x7f441c0a66d0 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f441c13f270 con 0x7f441c0a66d0 2024-09-13T10:35:18.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4414001b30 con 0x7f441c13f9a0 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient(hunting): dump: 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.340 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f440c003610 con 0x7f441c0a66d0 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient(hunting): dump: 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.341 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 18339526 0 0) 0x7f441c0a28c0 con 0x7f441c0a6ab0 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.181:6793/0 conn(0x7f441c0a66d0 legacy=0x7f441c1ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.181:6789/0 conn(0x7f441c13f9a0 legacy=0x7f441c1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient: _finish_hunting 0 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 monclient: found mon.d 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441c13cf10 con 0x7f441c0a6ab0 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient: _finish_auth 0 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient: _check_auth_tickets 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4421e0f640 5 monclient: authenticate success, global_id 6081 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4421e0f640 10 monclient: _renew_subs 2024-09-13T10:35:18.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4421e0f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4421e0f640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f441c13e9d0 con 0x7f441c0a6ab0 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4421e0f640 10 monclient: _renew_subs 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4421e0f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4421e0f640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f441c137600 con 0x7f441c0a6ab0 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44100020b0 con 0x7f441c0a6ab0 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4410005a80 con 0x7f441c0a6ab0 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4419ffb640 4 set_mon_vals no callback set 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.282+0000 7f4403fff640 10 monclient: dump: 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.344 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.345 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.283+0000 7f4421e0f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.283+0000 7f4421e0f640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f43fc0065c0 con 0x7f43fc002860 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.283+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4410012100 con 0x7f441c0a6ab0 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.283+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(170..170 src has 1..170) ==== 3506+0+0 (unknown 3052054584 0 0) 0x7f441004e620 con 0x7f441c0a6ab0 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.283+0000 7f441bfff640 10 monclient: get_auth_request con 0x7f4408040590 auth_method 0 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.285+0000 7f441b7fe640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.195:6792/0 conn(0x7f43fc002860 legacy=0x7f43fc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.285+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871439165 0 0) 0x7f43fc0065c0 con 0x7f43fc002860 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.285+0000 7f4403fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.285+0000 7f4403fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.285+0000 7f4403fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.285+0000 7f4403fff640 10 monclient(hunting): my global_id is 56203 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.285+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f441c0a28c0 con 0x7f43fc002860 2024-09-13T10:35:18.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2283081763 0 0) 0x7f441c0a28c0 con 0x7f43fc002860 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43fc0065c0 con 0x7f43fc002860 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f440c003e50 con 0x7f43fc002860 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 10 monclient: dump: 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.347 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2983026111 0 0) 0x7f43fc0065c0 con 0x7f43fc002860 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43fc00a160 con 0x7f43fc002860 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f440c004100 con 0x7f43fc002860 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:18.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.195:6792/0 conn(0x7f43fc002860 legacy=0x7f43fc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.286+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.195:6792/0 conn(0x7f43fc002860 legacy=0x7f43fc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:18.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.292+0000 7f4421e0f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:18.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.292+0000 7f4421e0f640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f43fc009e70 con 0x7f43fc009130 2024-09-13T10:35:18.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f441b7fe640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.195:6792/0 conn(0x7f43fc009130 legacy=0x7f43fc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513796184 0 0) 0x7f43fc009e70 con 0x7f43fc009130 2024-09-13T10:35:18.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:18.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:18.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:18.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 10 monclient(hunting): my global_id is 56212 2024-09-13T10:35:18.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43fc0065c0 con 0x7f43fc009130 2024-09-13T10:35:18.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1590692665 0 0) 0x7f43fc0065c0 con 0x7f43fc009130 2024-09-13T10:35:18.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43fc009e70 con 0x7f43fc009130 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f440c005b00 con 0x7f43fc009130 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 10 monclient: dump: 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:18.350 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:18.351 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 545197983 0 0) 0x7f43fc009e70 con 0x7f43fc009130 2024-09-13T10:35:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.295+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f43fc00c410 con 0x7f43fc009130 2024-09-13T10:35:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 4054097698) 0x7f440c007e40 con 0x7f43fc009130 2024-09-13T10:35:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f4403fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:18.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f4403fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:18.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.195:6792/0 conn(0x7f43fc009130 legacy=0x7f43fc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f4403fff640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.195:6792/0 conn(0x7f43fc009130 legacy=0x7f43fc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:18.352 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:18.352 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:18.352 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:18.352 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:18.352 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:18.352 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 332716, 2024-09-13T10:35:18.352 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:18.353 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:18.354 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:18.354 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:18.354 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:18.354 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:18.354 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:18.354 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:18.354 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:18.354 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:18.354 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:18.354 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:18.354 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:18.354 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:18.355 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:18.356 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:18.357 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:18.357 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:18.357 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:18.357 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:18.357 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:18.357 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:18.357 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:18.357 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:18.357 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:18.357 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:18.357 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:18.357 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.360 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:18.360 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:18.360 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.360 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.360 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.360 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:18.360 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.360 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.360 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.360 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.361 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:18.362 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.362 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.362 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.362 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:18.362 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:18.362 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.362 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.362 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.363 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.364 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.364 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:18.364 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:18.364 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.364 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.364 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.364 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:18.364 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.364 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:18.366 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.367 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.369 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:18.370 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:18.370 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:18.370 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.370 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.370 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:18.370 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:18.370 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:18.370 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:18.370 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:18.370 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.370 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:18.371 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:18.372 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.372 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:18.372 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:18.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:18.372 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:18.372 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:18.372 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:18.372 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:18.372 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:18.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:18.372 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:18.373 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f4421e0f640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4408040590 legacy=0x7f4408042a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f4421e0f640 10 monclient: shutdown 2024-09-13T10:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f4421e0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f4421e0f640 1 -- 172.21.15.181:0/2932992212 >> v1:172.21.15.181:6792/0 conn(0x7f441c0a6ab0 legacy=0x7f441c1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f441bfff640 1 -- 172.21.15.181:0/2932992212 reap_dead start 2024-09-13T10:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f441bfff640 1 -- 172.21.15.181:0/2932992212 reap_dead start 2024-09-13T10:35:18.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f4421e0f640 1 -- 172.21.15.181:0/2932992212 shutdown_connections 2024-09-13T10:35:18.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.296+0000 7f4421e0f640 1 -- 172.21.15.181:0/2932992212 >> 172.21.15.181:0/2932992212 conn(0x7f441c0abcd0 msgr2=0x7f441c0a3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:18.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.297+0000 7f4421e0f640 1 -- 172.21.15.181:0/2932992212 shutdown_connections 2024-09-13T10:35:18.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.297+0000 7f4421e0f640 1 -- 172.21.15.181:0/2932992212 wait complete. 2024-09-13T10:35:18.375 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:18.375 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T10:35:18.375 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T10:35:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.470+0000 7f28c3031640 10 monclient: get_monmap_and_config 2024-09-13T10:35:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.470+0000 7f28c3031640 10 monclient: build_initial_monmap 2024-09-13T10:35:18.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.470+0000 7f28c3031640 10 monclient: monmap: 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:18.471757+0000 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:18.471757+0000 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:18.473 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:18.474 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:18.474 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:18.474 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:18.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.470+0000 7f28c3031640 1 Processor -- start 2024-09-13T10:35:18.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.470+0000 7f28c3031640 1 -- start start 2024-09-13T10:35:18.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.470+0000 7f28c3031640 10 monclient: init 2024-09-13T10:35:18.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.471+0000 7f28c3031640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:18.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.471+0000 7f28c3031640 10 monclient: _add_conns ranks=[2,6,0,5,3,4,8,7,1] 2024-09-13T10:35:18.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.471+0000 7f28c3031640 10 monclient(hunting): picked mon.noname-b con 0x7f28bc0a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:18.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.471+0000 7f28c3031640 10 monclient(hunting): picked mon.noname-d con 0x7f28bc0a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:18.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.471+0000 7f28c3031640 10 monclient(hunting): picked mon.noname-a con 0x7f28bc13f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.471+0000 7f28c3031640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc0a5fe0 con 0x7f28bc13f9a0 2024-09-13T10:35:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.471+0000 7f28c3031640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc0a8080 con 0x7f28bc0a66d0 2024-09-13T10:35:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.471+0000 7f28c3031640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc0a42c0 con 0x7f28bc0a6ab0 2024-09-13T10:35:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.471+0000 7f28c3031640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.471+0000 7f28c3031640 10 monclient(hunting): authenticate will time out at 1057.977486s 2024-09-13T10:35:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.471+0000 7f28bbfff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f28bc0a6ab0 0x7f28bc0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:40274/0 (socket says 172.21.15.181:40274) 2024-09-13T10:35:18.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.471+0000 7f28bbfff640 1 -- 172.21.15.181:0/3702129377 learned_addr learned my addr 172.21.15.181:0/3702129377 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.473+0000 7f28c0dcd640 1 -- 172.21.15.181:0/3702129377 >> v1:172.21.15.181:6790/0 conn(0x7f28bc0a66d0 legacy=0x7f28bc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.473+0000 7f28bbfff640 1 -- 172.21.15.181:0/3702129377 >> v1:172.21.15.181:6792/0 conn(0x7f28bc0a6ab0 legacy=0x7f28bc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:18.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:18.473+0000 7f28c15ce640 1 -- 172.21.15.181:0/3702129377 >> v1:172.21.15.181:6789/0 conn(0x7f28bc13f9a0 legacy=0x7f28bc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:19.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772121807 0 0) 0x7f28bc0a5fe0 con 0x7f28bc13f9a0 2024-09-13T10:35:19.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:19.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:19.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:19.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 10 monclient(hunting): my global_id is 104166 2024-09-13T10:35:19.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28a4003520 con 0x7f28bc13f9a0 2024-09-13T10:35:19.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201512756 0 0) 0x7f28bc0a8080 con 0x7f28bc0a66d0 2024-09-13T10:35:19.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:19.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:19.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:19.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 10 monclient(hunting): my global_id is 94430 2024-09-13T10:35:19.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28bc0a5fe0 con 0x7f28bc0a66d0 2024-09-13T10:35:19.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2091972865 0 0) 0x7f28bc0a42c0 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:19.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:19.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:19.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 10 monclient(hunting): my global_id is 6090 2024-09-13T10:35:19.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28bc0a8080 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.256+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1209076236 0 0) 0x7f28bc0a8080 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 >> v1:172.21.15.181:6790/0 conn(0x7f28bc0a66d0 legacy=0x7f28bc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:19.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 >> v1:172.21.15.181:6789/0 conn(0x7f28bc13f9a0 legacy=0x7f28bc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:19.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:35:19.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 1 monclient: found mon.noname-d 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc1464e0 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 10 monclient: _finish_auth 0 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28b0001db0 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 10 monclient: dump: 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:19.262 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:19.263 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28c3031640 5 monclient: authenticate success, global_id 6090 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28c3031640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28b0001fd0 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 1 -- 172.21.15.181:0/3702129377 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28b0004f60 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28bb7fe640 10 monclient: dump: 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:19.264 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28c3031640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:19.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.257+0000 7f28c3031640 4 set_mon_vals no callback set 2024-09-13T10:35:19.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.258+0000 7f28c3031640 10 monclient: shutdown 2024-09-13T10:35:19.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.258+0000 7f28c3031640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:19.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.258+0000 7f28c3031640 1 -- 172.21.15.181:0/3702129377 >> v1:172.21.15.181:6792/0 conn(0x7f28bc0a6ab0 legacy=0x7f28bc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:19.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.258+0000 7f28c3031640 1 -- 172.21.15.181:0/3702129377 shutdown_connections 2024-09-13T10:35:19.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.258+0000 7f28c3031640 1 -- 172.21.15.181:0/3702129377 >> 172.21.15.181:0/3702129377 conn(0x7f28bc0abcd0 msgr2=0x7f28bc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:19.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.258+0000 7f28c3031640 1 -- 172.21.15.181:0/3702129377 shutdown_connections 2024-09-13T10:35:19.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.258+0000 7f28c3031640 1 -- 172.21.15.181:0/3702129377 wait complete. 2024-09-13T10:35:19.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.259+0000 7f28c3031640 10 monclient: build_initial_monmap 2024-09-13T10:35:19.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.259+0000 7f28c3031640 10 monclient: monmap: 2024-09-13T10:35:19.267 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:19.267 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:19.267 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:19.267 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.260+0000 7f28c3031640 1 Processor -- start 2024-09-13T10:35:19.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.260+0000 7f28c3031640 1 -- start start 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.260+0000 7f28c3031640 10 monclient: init 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.262+0000 7f28c3031640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.262+0000 7f28c3031640 10 monclient: _add_conns ranks=[0,1,5,4,3,8,7,6,2] 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.262+0000 7f28c3031640 10 monclient(hunting): picked mon.noname-a con 0x7f28bc0a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.262+0000 7f28c3031640 10 monclient(hunting): picked mon.noname-f con 0x7f28bc0a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.262+0000 7f28c3031640 10 monclient(hunting): picked mon.noname-h con 0x7f28bc13f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.262+0000 7f28c3031640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc13b380 con 0x7f28bc0a66d0 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.262+0000 7f28c3031640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc13b660 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.262+0000 7f28c3031640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc073950 con 0x7f28bc13f9a0 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.262+0000 7f28c3031640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.262+0000 7f28c3031640 10 monclient(hunting): authenticate will time out at 1058.768226s 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.262+0000 7f28c0dcd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f28bc0a66d0 0x7f28bc071b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43530/0 (socket says 172.21.15.181:43530) 2024-09-13T10:35:19.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.262+0000 7f28c0dcd640 1 -- 172.21.15.181:0/3540167105 learned_addr learned my addr 172.21.15.181:0/3540167105 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:19.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.265+0000 7f28c0dcd640 1 -- 172.21.15.181:0/3540167105 >> v1:172.21.15.181:6789/0 conn(0x7f28bc0a66d0 legacy=0x7f28bc071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:19.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.265+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:35:19.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.265+0000 7f28c15ce640 1 -- 172.21.15.181:0/3540167105 >> v1:172.21.15.195:6791/0 conn(0x7f28bc13f9a0 legacy=0x7f28bc072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:19.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.266+0000 7f28bbfff640 1 -- 172.21.15.181:0/3540167105 >> v1:172.21.15.195:6789/0 conn(0x7f28bc0a6ab0 legacy=0x7f28bc072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:19.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 540953257 0 0) 0x7f28bc073950 con 0x7f28bc13f9a0 2024-09-13T10:35:19.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:19.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:19.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:19.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 10 monclient(hunting): my global_id is 104171 2024-09-13T10:35:19.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28a8003520 con 0x7f28bc13f9a0 2024-09-13T10:35:19.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2135646975 0 0) 0x7f28bc13b380 con 0x7f28bc0a66d0 2024-09-13T10:35:19.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 10 monclient(hunting): my global_id is 104175 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28bc073950 con 0x7f28bc0a66d0 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1134293560 0 0) 0x7f28bc13b660 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 10 monclient(hunting): my global_id is 56260 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28bc13b380 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2347248873 0 0) 0x7f28a8003520 con 0x7f28bc13f9a0 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.267+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28bc13b660 con 0x7f28bc13f9a0 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28b4003610 con 0x7f28bc13f9a0 2024-09-13T10:35:19.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient(hunting): dump: 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:19.275 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2276023695 0 0) 0x7f28bc073950 con 0x7f28bc0a66d0 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28a8003520 con 0x7f28bc0a66d0 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28ac003610 con 0x7f28bc0a66d0 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient(hunting): dump: 2024-09-13T10:35:19.276 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:19.277 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2528545 0 0) 0x7f28bc13b380 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28bc073950 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28b0004ea0 con 0x7f28bc0a6ab0 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient(hunting): dump: 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:19.278 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1834545966 0 0) 0x7f28bc13b660 con 0x7f28bc13f9a0 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 >> v1:172.21.15.195:6789/0 conn(0x7f28bc0a6ab0 legacy=0x7f28bc072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:19.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 >> v1:172.21.15.181:6789/0 conn(0x7f28bc0a66d0 legacy=0x7f28bc071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:19.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient: _finish_hunting 0 2024-09-13T10:35:19.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 monclient: found mon.h 2024-09-13T10:35:19.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:19.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:19.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc068e00 con 0x7f28bc13f9a0 2024-09-13T10:35:19.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient: _finish_auth 0 2024-09-13T10:35:19.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient: _check_auth_tickets 2024-09-13T10:35:19.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:19.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28c3031640 5 monclient: authenticate success, global_id 104171 2024-09-13T10:35:19.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28c3031640 10 monclient: _renew_subs 2024-09-13T10:35:19.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28c3031640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:19.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28c3031640 1 -- 172.21.15.181:0/3540167105 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f28bc068ad0 con 0x7f28bc13f9a0 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28b4003b60 con 0x7f28bc13f9a0 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28b40040d0 con 0x7f28bc13f9a0 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28b97fa640 10 monclient: dump: 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:19.281 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28baffd640 4 set_mon_vals no callback set 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28c3031640 10 monclient: _renew_subs 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28c3031640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.268+0000 7f28c3031640 1 -- 172.21.15.181:0/3540167105 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f28bc13f510 con 0x7f28bc13f9a0 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.269+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f28b4004270 con 0x7f28bc13f9a0 2024-09-13T10:35:19.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.269+0000 7f28c3031640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:19.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.269+0000 7f28c3031640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:19.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.269+0000 7f28c3031640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:19.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.269+0000 7f28c3031640 1 -- 172.21.15.181:0/3540167105 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28bc068850 con 0x7f28bc13f9a0 2024-09-13T10:35:19.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.270+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(171..171 src has 1..171) ==== 3898+0+0 (unknown 4248238767 0 0) 0x7f28b404e210 con 0x7f28bc13f9a0 2024-09-13T10:35:19.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.270+0000 7f28c0dcd640 10 monclient: get_auth_request con 0x7f28a8040660 auth_method 0 2024-09-13T10:35:19.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.274+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.5 v1:172.21.15.195:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f28bc068850 con 0x7f28bc13f9a0 2024-09-13T10:35:19.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.274+0000 7f28b97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:19.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.274+0000 7f28b97fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:19.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.522+0000 7f28c3031640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-13T10:35:19.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.522+0000 7f28c3031640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-13T10:35:19.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.522+0000 7f28c3031640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:19.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.522+0000 7f28c3031640 1 -- 172.21.15.181:0/3540167105 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f28bc06cab0 con 0x7f28bc13f9a0 2024-09-13T10:35:19.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3534943087,config=2586702516,health=3173122636,kv=760235678,logm=2661346885}) 2024-09-13T10:35:19.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=2,health=12,kv=11,logm=59} crc {auth=1714442610,config=2586702516,health=1012707849,kv=1699477856,logm=2049013771}) 2024-09-13T10:35:19.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3534943087,config=2586702516,health=3173122636,kv=760235678,logm=2661346885}) 2024-09-13T10:35:19.536 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=16,config=2,health=11,kv=11,logm=60} crc {auth=2205372535,config=2586702516,health=1295987503,kv=775579436,logm=132934329}) 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3534943087,config=2586702516,health=3173122636,kv=760235678,logm=2661346885}) 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=16,config=2,health=11,kv=12,logm=59} crc {auth=1714442610,config=2586702516,health=2423699754,kv=3467323233,logm=1365202913}) 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3534943087,config=2586702516,health=3173122636,kv=760235678,logm=2661346885}) 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=16,config=2,health=12,kv=11,logm=59} crc {auth=1588403381,config=2586702516,health=1012707849,kv=775579436,logm=675801290}) 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3534943087,config=2586702516,health=3173122636,kv=760235678,logm=2661346885}) 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=17,config=2,health=12,kv=12,logm=57} crc {auth=3534943087,config=2586702516,health=1012707849,kv=52370682,logm=723206626}) 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3534943087,config=2586702516,health=3173122636,kv=760235678,logm=2661346885}) 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=16,config=1,health=11,kv=12,logm=60} crc {auth=2259202737,config=1747058506,health=1295987503,kv=3467323233,logm=3447377614}) 2024-09-13T10:35:19.537 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3534943087,config=2586702516,health=3173122636,kv=760235678,logm=2661346885}) 2024-09-13T10:35:19.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=16,config=2,health=12,kv=12,logm=58} crc {auth=2607951097,config=2586702516,health=1012707849,kv=3467323233,logm=2578694864}) 2024-09-13T10:35:19.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3534943087,config=2586702516,health=3173122636,kv=760235678,logm=2661346885}) 2024-09-13T10:35:19.538 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.533+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=17,config=2,health=12,kv=11,logm=58} crc {auth=1681524544,config=2586702516,health=1012707849,kv=3274111459,logm=1065691883}) 2024-09-13T10:35:19.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.532+0000 7f28b97fa640 1 -- 172.21.15.181:0/3540167105 <== mon.5 v1:172.21.15.195:6791/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f28bc06cab0 con 0x7f28bc13f9a0 2024-09-13T10:35:19.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.532+0000 7f28b97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-13T10:35:19.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.532+0000 7f28b97fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:19.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.535+0000 7f28c3031640 1 -- 172.21.15.181:0/3540167105 >> v1:172.21.15.195:6800/1839191919 conn(0x7f28a8040660 legacy=0x7f28a8042b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:19.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.535+0000 7f28c3031640 10 monclient: shutdown 2024-09-13T10:35:19.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.535+0000 7f28c3031640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:19.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.535+0000 7f28c3031640 1 -- 172.21.15.181:0/3540167105 >> v1:172.21.15.195:6791/0 conn(0x7f28bc13f9a0 legacy=0x7f28bc072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:19.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.535+0000 7f28c3031640 1 -- 172.21.15.181:0/3540167105 shutdown_connections 2024-09-13T10:35:19.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.535+0000 7f28c3031640 1 -- 172.21.15.181:0/3540167105 >> 172.21.15.181:0/3540167105 conn(0x7f28bc0abcd0 msgr2=0x7f28bc145ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:19.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.535+0000 7f28c3031640 1 -- 172.21.15.181:0/3540167105 shutdown_connections 2024-09-13T10:35:19.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:19.535+0000 7f28c3031640 1 -- 172.21.15.181:0/3540167105 wait complete. 2024-09-13T10:35:19.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3411146199}) 2024-09-13T10:35:19.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1137129333}) 2024-09-13T10:35:19.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3411146199}) 2024-09-13T10:35:19.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=364918549}) 2024-09-13T10:35:19.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.543 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3411146199}) 2024-09-13T10:35:19.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4155006815}) 2024-09-13T10:35:19.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3411146199}) 2024-09-13T10:35:19.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=945507212}) 2024-09-13T10:35:19.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3411146199}) 2024-09-13T10:35:19.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1556286269}) 2024-09-13T10:35:19.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3411146199}) 2024-09-13T10:35:19.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=608514530}) 2024-09-13T10:35:19.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.544 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3411146199}) 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2795920857}) 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3411146199}) 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.535+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3972991344}) 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.536+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.536+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3690437120}) 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.536+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2987513469}) 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.536+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.536+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3690437120}) 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.536+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2859741035}) 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.536+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.536+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3690437120}) 2024-09-13T10:35:19.545 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.536+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=758249484}) 2024-09-13T10:35:19.546 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.536+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.546 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.536+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3690437120}) 2024-09-13T10:35:19.546 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.536+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=985644690}) 2024-09-13T10:35:19.546 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.537+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.546 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.537+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3690437120}) 2024-09-13T10:35:19.546 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.537+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2450355218}) 2024-09-13T10:35:19.546 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.537+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.546 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.537+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3690437120}) 2024-09-13T10:35:19.547 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.537+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4082578733}) 2024-09-13T10:35:19.547 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.537+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.547 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.537+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3690437120}) 2024-09-13T10:35:19.547 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.537+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=353566108}) 2024-09-13T10:35:19.547 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.537+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.547 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.537+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3690437120}) 2024-09-13T10:35:19.547 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.537+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=236410887}) 2024-09-13T10:35:19.548 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-13T10:35:19.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3309708690}) 2024-09-13T10:35:19.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4025544017}) 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3309708690}) 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3639174806}) 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3309708690}) 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2753401152}) 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3309708690}) 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=331788326}) 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3309708690}) 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3545771559}) 2024-09-13T10:35:19.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.554 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3309708690}) 2024-09-13T10:35:19.554 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1390327097}) 2024-09-13T10:35:19.554 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.554 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3309708690}) 2024-09-13T10:35:19.554 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3255374168}) 2024-09-13T10:35:19.554 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.554 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3309708690}) 2024-09-13T10:35:19.554 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.549+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2656695907}) 2024-09-13T10:35:19.561 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.561 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3079592358}) 2024-09-13T10:35:19.561 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=389161179}) 2024-09-13T10:35:19.561 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.561 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3079592358}) 2024-09-13T10:35:19.561 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=495867175}) 2024-09-13T10:35:19.561 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.561 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3079592358}) 2024-09-13T10:35:19.561 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3865225819}) 2024-09-13T10:35:19.561 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3079592358}) 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1891763495}) 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3079592358}) 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=539217353}) 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3079592358}) 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1849330411}) 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3079592358}) 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1850025629}) 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.558+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3079592358}) 2024-09-13T10:35:19.562 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.559+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2526999304}) 2024-09-13T10:35:19.566 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.566 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3614813761}) 2024-09-13T10:35:19.566 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2318567537}) 2024-09-13T10:35:19.566 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.566 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3614813761}) 2024-09-13T10:35:19.566 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3354261404}) 2024-09-13T10:35:19.566 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.566 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3614813761}) 2024-09-13T10:35:19.566 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3794883184}) 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3614813761}) 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1878708304}) 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3614813761}) 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4104971686}) 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3614813761}) 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4294703126}) 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3614813761}) 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1402012677}) 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.567 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3614813761}) 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.560+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2138181007}) 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3224857110}) 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4005272504}) 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3224857110}) 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2975641949}) 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3224857110}) 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1995617454}) 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3224857110}) 2024-09-13T10:35:19.568 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3477170822}) 2024-09-13T10:35:19.569 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.569 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3224857110}) 2024-09-13T10:35:19.569 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3557638474}) 2024-09-13T10:35:19.569 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.569 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3224857110}) 2024-09-13T10:35:19.569 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2229268536}) 2024-09-13T10:35:19.569 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.569 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3224857110}) 2024-09-13T10:35:19.569 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2273107096}) 2024-09-13T10:35:19.569 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.569 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3224857110}) 2024-09-13T10:35:19.569 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.561+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=15733902}) 2024-09-13T10:35:19.622 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.610+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.622 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.610+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2142319965}) 2024-09-13T10:35:19.622 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.610+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1157203841}) 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.610+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.610+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2142319965}) 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=15748878}) 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2142319965}) 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2520980430}) 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2142319965}) 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3768301936}) 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2142319965}) 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1048804115}) 2024-09-13T10:35:19.623 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2142319965}) 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1831938717}) 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2142319965}) 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3377267442}) 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2142319965}) 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.611+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=305969701}) 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=261540496}) 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=400141111}) 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.624 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=261540496}) 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2535028118}) 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=261540496}) 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3063183862}) 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=261540496}) 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=327423619}) 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=261540496}) 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1120412689}) 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=261540496}) 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2841283689}) 2024-09-13T10:35:19.625 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=261540496}) 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1008183738}) 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=261540496}) 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.612+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3611067703}) 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.613+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.613+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2048484876}) 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.613+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2082892607}) 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.613+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.613+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2048484876}) 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.613+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1329550722}) 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2048484876}) 2024-09-13T10:35:19.626 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1109728247}) 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2048484876}) 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2767082840}) 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2048484876}) 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2326998334}) 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2048484876}) 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=39948088}) 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2048484876}) 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3143962022}) 2024-09-13T10:35:19.627 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2048484876}) 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.614+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3953064661}) 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011474785}) 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2911358302}) 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011474785}) 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=105392731}) 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011474785}) 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3244948569}) 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011474785}) 2024-09-13T10:35:19.628 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=805681881}) 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011474785}) 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4196231955}) 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011474785}) 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=691078861}) 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011474785}) 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3541926868}) 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011474785}) 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.615+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=837765170}) 2024-09-13T10:35:19.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.616+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.616+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607520131}) 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.616+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2715087347}) 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.616+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.616+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607520131}) 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.616+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2851744809}) 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.616+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.616+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607520131}) 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3012732312}) 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607520131}) 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2545892125}) 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607520131}) 2024-09-13T10:35:19.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2650443924}) 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607520131}) 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2694319978}) 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607520131}) 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3900412798}) 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607520131}) 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.617+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4196169422}) 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1450743836}) 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4169822682}) 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1450743836}) 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3603798433}) 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1450743836}) 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2834400371}) 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1450743836}) 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2475284446}) 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1450743836}) 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2059443018}) 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1450743836}) 2024-09-13T10:35:19.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1371417246}) 2024-09-13T10:35:19.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1450743836}) 2024-09-13T10:35:19.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2383705696}) 2024-09-13T10:35:19.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1450743836}) 2024-09-13T10:35:19.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.618+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1899650664}) 2024-09-13T10:35:19.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1390091044}) 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3889329595}) 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1390091044}) 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3633716754}) 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1390091044}) 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2414434913}) 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1390091044}) 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3389407068}) 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.642 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1390091044}) 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2048860245}) 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1390091044}) 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2671051680}) 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1390091044}) 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=98505641}) 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1390091044}) 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.631+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1182062327}) 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296978243}) 2024-09-13T10:35:19.643 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=622935370}) 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296978243}) 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2641524896}) 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296978243}) 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2504117248}) 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296978243}) 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1142389842}) 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296978243}) 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2780249160}) 2024-09-13T10:35:19.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296978243}) 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3220106422}) 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296978243}) 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1334717023}) 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296978243}) 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2708142282}) 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2318669419}) 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1565727054}) 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2318669419}) 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2902098507}) 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2318669419}) 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=513799269}) 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2318669419}) 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1947223887}) 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2318669419}) 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1718404715}) 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2318669419}) 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1987776264}) 2024-09-13T10:35:19.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2318669419}) 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3362495698}) 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.634+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.635+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2318669419}) 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.635+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2777895852}) 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3642857772}) 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1264972674}) 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3642857772}) 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1353518380}) 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.647 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3642857772}) 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1393645724}) 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3642857772}) 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3145976707}) 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3642857772}) 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3186346075}) 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3642857772}) 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1818769458}) 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3642857772}) 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3412482613}) 2024-09-13T10:35:19.648 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.649 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3642857772}) 2024-09-13T10:35:19.649 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1841057757}) 2024-09-13T10:35:19.863 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.863 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=534123353}) 2024-09-13T10:35:19.863 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1048296552}) 2024-09-13T10:35:19.863 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.863 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=534123353}) 2024-09-13T10:35:19.863 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1632852759}) 2024-09-13T10:35:19.863 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.863 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=534123353}) 2024-09-13T10:35:19.863 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=577069942}) 2024-09-13T10:35:19.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=534123353}) 2024-09-13T10:35:19.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1471568551}) 2024-09-13T10:35:19.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=534123353}) 2024-09-13T10:35:19.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1579184443}) 2024-09-13T10:35:19.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=534123353}) 2024-09-13T10:35:19.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1083702550}) 2024-09-13T10:35:19.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=534123353}) 2024-09-13T10:35:19.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=897485084}) 2024-09-13T10:35:19.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=534123353}) 2024-09-13T10:35:19.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3673166279}) 2024-09-13T10:35:19.918 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.918 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=225174588}) 2024-09-13T10:35:19.918 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=135471486}) 2024-09-13T10:35:19.918 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.918 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=225174588}) 2024-09-13T10:35:19.918 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=833727244}) 2024-09-13T10:35:19.918 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.918 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=225174588}) 2024-09-13T10:35:19.918 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=725876425}) 2024-09-13T10:35:19.918 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=225174588}) 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2023982147}) 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=225174588}) 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=885142283}) 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=225174588}) 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1655012812}) 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=225174588}) 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2853945280}) 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:19.919 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=225174588}) 2024-09-13T10:35:19.920 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:19.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3822552882}) 2024-09-13T10:35:20.264 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.260+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.264 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.260+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2102398216}) 2024-09-13T10:35:20.264 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.260+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1599490933}) 2024-09-13T10:35:20.264 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.260+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.264 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.260+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2102398216}) 2024-09-13T10:35:20.264 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.260+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3903187204}) 2024-09-13T10:35:20.264 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.260+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.264 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.260+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2102398216}) 2024-09-13T10:35:20.264 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.260+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2635697738}) 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.260+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.260+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2102398216}) 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=714687577}) 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2102398216}) 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4085266319}) 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2102398216}) 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3360566796}) 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2102398216}) 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=492873869}) 2024-09-13T10:35:20.265 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.266 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2102398216}) 2024-09-13T10:35:20.266 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.261+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2017297517}) 2024-09-13T10:35:20.270 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.271 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3509718792}) 2024-09-13T10:35:20.271 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2093243979}) 2024-09-13T10:35:20.271 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.271 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3509718792}) 2024-09-13T10:35:20.271 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3494688233}) 2024-09-13T10:35:20.271 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.271 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3509718792}) 2024-09-13T10:35:20.271 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1928184753}) 2024-09-13T10:35:20.271 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.271 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3509718792}) 2024-09-13T10:35:20.271 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3204303933}) 2024-09-13T10:35:20.271 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.272 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3509718792}) 2024-09-13T10:35:20.272 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2516308181}) 2024-09-13T10:35:20.272 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.272 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3509718792}) 2024-09-13T10:35:20.272 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3983159902}) 2024-09-13T10:35:20.272 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.272 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3509718792}) 2024-09-13T10:35:20.272 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1393067629}) 2024-09-13T10:35:20.272 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.272 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3509718792}) 2024-09-13T10:35:20.272 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.268+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1527949833}) 2024-09-13T10:35:20.298 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.298 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2128839455}) 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2701575383}) 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2128839455}) 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=769547609}) 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2128839455}) 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=306691970}) 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2128839455}) 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1955314833}) 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2128839455}) 2024-09-13T10:35:20.299 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2132119600}) 2024-09-13T10:35:20.300 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.300 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2128839455}) 2024-09-13T10:35:20.300 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1651123381}) 2024-09-13T10:35:20.300 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.300 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2128839455}) 2024-09-13T10:35:20.300 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2286960122}) 2024-09-13T10:35:20.300 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.295+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.300 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.296+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2128839455}) 2024-09-13T10:35:20.300 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.296+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=756825585}) 2024-09-13T10:35:20.385 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38267]: starting. 2024-09-13T10:35:20.385 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38267]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38266 2024-09-13T10:35:20.385 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38267]: created object 0... 2024-09-13T10:35:20.385 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38267]: created object 25... 2024-09-13T10:35:20.385 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38267]: created object 49... 2024-09-13T10:35:20.385 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38267]: finishing. 2024-09-13T10:35:20.385 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38267]: shutting down. 2024-09-13T10:35:20.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=745348889}) 2024-09-13T10:35:20.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2565040318}) 2024-09-13T10:35:20.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=745348889}) 2024-09-13T10:35:20.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=172221661}) 2024-09-13T10:35:20.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=745348889}) 2024-09-13T10:35:20.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=376838970}) 2024-09-13T10:35:20.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=745348889}) 2024-09-13T10:35:20.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2038379631}) 2024-09-13T10:35:20.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=745348889}) 2024-09-13T10:35:20.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=400021449}) 2024-09-13T10:35:20.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=745348889}) 2024-09-13T10:35:20.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2599764638}) 2024-09-13T10:35:20.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=745348889}) 2024-09-13T10:35:20.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2150536683}) 2024-09-13T10:35:20.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=745348889}) 2024-09-13T10:35:20.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.398+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2773661162}) 2024-09-13T10:35:20.550 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:35:20.550 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:35:20.629 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.626+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2651167034}) 2024-09-13T10:35:20.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1288060208}) 2024-09-13T10:35:20.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2651167034}) 2024-09-13T10:35:20.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4287613875}) 2024-09-13T10:35:20.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2651167034}) 2024-09-13T10:35:20.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=33034334}) 2024-09-13T10:35:20.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2651167034}) 2024-09-13T10:35:20.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1924928303}) 2024-09-13T10:35:20.630 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2651167034}) 2024-09-13T10:35:20.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=60725095}) 2024-09-13T10:35:20.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2651167034}) 2024-09-13T10:35:20.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1709663362}) 2024-09-13T10:35:20.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2651167034}) 2024-09-13T10:35:20.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3530000503}) 2024-09-13T10:35:20.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2651167034}) 2024-09-13T10:35:20.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.627+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=150417804}) 2024-09-13T10:35:20.634 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.634 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=167675623}) 2024-09-13T10:35:20.635 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1072477309}) 2024-09-13T10:35:20.637 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.637 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=167675623}) 2024-09-13T10:35:20.637 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1708908876}) 2024-09-13T10:35:20.637 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.637 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=167675623}) 2024-09-13T10:35:20.638 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4292469227}) 2024-09-13T10:35:20.638 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.638 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=167675623}) 2024-09-13T10:35:20.638 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2923681232}) 2024-09-13T10:35:20.638 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=167675623}) 2024-09-13T10:35:20.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2930572534}) 2024-09-13T10:35:20.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.632+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=167675623}) 2024-09-13T10:35:20.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=473341915}) 2024-09-13T10:35:20.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=167675623}) 2024-09-13T10:35:20.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3100738839}) 2024-09-13T10:35:20.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=167675623}) 2024-09-13T10:35:20.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.633+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=78118311}) 2024-09-13T10:35:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38268]: starting. 2024-09-13T10:35:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38268]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38266 2024-09-13T10:35:20.642 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38268]: shutting down. 2024-09-13T10:35:20.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.651+0000 7fd8904c6640 10 monclient: get_monmap_and_config 2024-09-13T10:35:20.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.651+0000 7fd8904c6640 10 monclient: build_initial_monmap 2024-09-13T10:35:20.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.651+0000 7fd8904c6640 10 monclient: monmap: 2024-09-13T10:35:20.654 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:20.654 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:20.654 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:20.653251+0000 2024-09-13T10:35:20.654 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:20.653251+0000 2024-09-13T10:35:20.654 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:20.654 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:20.654 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:20.654 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:20.655 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:20.655 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:20.655 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:20.655 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:20.655 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:20.655 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:20.655 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:20.655 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:20.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 1 Processor -- start 2024-09-13T10:35:20.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 1 -- start start 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 10 monclient: init 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 10 monclient: _add_conns ranks=[8,1,3,4,6,5,7,0,2] 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 10 monclient(hunting): picked mon.noname-e con 0x7fd8880a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 10 monclient(hunting): picked mon.noname-f con 0x7fd8880a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 10 monclient(hunting): picked mon.noname-g con 0x7fd88813f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8880a5fe0 con 0x7fd8880a6ab0 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8880a8080 con 0x7fd88813f9a0 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8880a42c0 con 0x7fd8880a66d0 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.652+0000 7fd8904c6640 10 monclient(hunting): authenticate will time out at 1060.158922s 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.653+0000 7fd88e262640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fd8880a66d0 0x7fd8880a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54508/0 (socket says 172.21.15.181:54508) 2024-09-13T10:35:20.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.653+0000 7fd88e262640 1 -- 172.21.15.181:0/4287011589 learned_addr learned my addr 172.21.15.181:0/4287011589 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:20.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88e262640 1 -- 172.21.15.181:0/4287011589 >> v1:172.21.15.181:6793/0 conn(0x7fd8880a66d0 legacy=0x7fd8880a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:20.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88ea63640 1 -- 172.21.15.181:0/4287011589 >> v1:172.21.15.195:6790/0 conn(0x7fd88813f9a0 legacy=0x7fd888141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:20.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88da61640 1 -- 172.21.15.181:0/4287011589 >> v1:172.21.15.195:6789/0 conn(0x7fd8880a6ab0 legacy=0x7fd8880a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:20.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 1 -- 172.21.15.181:0/4287011589 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150157057 0 0) 0x7fd8880a8080 con 0x7fd88813f9a0 2024-09-13T10:35:20.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient(hunting): _negotiate 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient(hunting): my global_id is 6114 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 1 -- 172.21.15.181:0/4287011589 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd874003520 con 0x7fd88813f9a0 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 1 -- 172.21.15.181:0/4287011589 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2780446069 0 0) 0x7fd8880a5fe0 con 0x7fd8880a6ab0 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient(hunting): _negotiate 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient(hunting): my global_id is 56278 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 1 -- 172.21.15.181:0/4287011589 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8880a8080 con 0x7fd8880a6ab0 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 1 -- 172.21.15.181:0/4287011589 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1917145127 0 0) 0x7fd8880a8080 con 0x7fd8880a6ab0 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 1 -- 172.21.15.181:0/4287011589 >> v1:172.21.15.181:6793/0 conn(0x7fd8880a66d0 legacy=0x7fd8880a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:20.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 1 -- 172.21.15.181:0/4287011589 >> v1:172.21.15.195:6790/0 conn(0x7fd88813f9a0 legacy=0x7fd888141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient: _finish_hunting 0 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 1 monclient: found mon.noname-f 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 1 -- 172.21.15.181:0/4287011589 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8881464e0 con 0x7fd8880a6ab0 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient: _finish_auth 0 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient: _check_auth_tickets 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 1 -- 172.21.15.181:0/4287011589 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd878001b60 con 0x7fd8880a6ab0 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd8904c6640 5 monclient: authenticate success, global_id 56278 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd8904c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:20.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient: dump: 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:20.664 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd8904c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 1 -- 172.21.15.181:0/4287011589 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd878003610 con 0x7fd8880a6ab0 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd8904c6640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd8904c6640 4 set_mon_vals no callback set 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 1 -- 172.21.15.181:0/4287011589 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd878003bc0 con 0x7fd8880a6ab0 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.655+0000 7fd88d260640 10 monclient: dump: 2024-09-13T10:35:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.656+0000 7fd8904c6640 10 monclient: shutdown 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.656+0000 7fd8904c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.656+0000 7fd8904c6640 1 -- 172.21.15.181:0/4287011589 >> v1:172.21.15.195:6789/0 conn(0x7fd8880a6ab0 legacy=0x7fd8880a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.656+0000 7fd8904c6640 1 -- 172.21.15.181:0/4287011589 shutdown_connections 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.656+0000 7fd8904c6640 1 -- 172.21.15.181:0/4287011589 >> 172.21.15.181:0/4287011589 conn(0x7fd8880abcd0 msgr2=0x7fd8880ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.656+0000 7fd8904c6640 1 -- 172.21.15.181:0/4287011589 shutdown_connections 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.656+0000 7fd8904c6640 1 -- 172.21.15.181:0/4287011589 wait complete. 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 10 monclient: build_initial_monmap 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 10 monclient: monmap: 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:20.668 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 1 Processor -- start 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 1 -- start start 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 10 monclient: init 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 10 monclient: _add_conns ranks=[7,4,0,1,2,8,5,6,3] 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 10 monclient(hunting): picked mon.noname-i con 0x7fd8880a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 10 monclient(hunting): picked mon.noname-c con 0x7fd8880a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 10 monclient(hunting): picked mon.noname-a con 0x7fd88813f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88813ee60 con 0x7fd88813f9a0 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88813f140 con 0x7fd8880a6ab0 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd888142db0 con 0x7fd8880a66d0 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.657+0000 7fd8904c6640 10 monclient(hunting): authenticate will time out at 1060.163944s 2024-09-13T10:35:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.658+0000 7fd88da61640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fd8880a6ab0 0x7fd8881d3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42606/0 (socket says 172.21.15.181:42606) 2024-09-13T10:35:20.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.658+0000 7fd88da61640 1 -- 172.21.15.181:0/3492037197 learned_addr learned my addr 172.21.15.181:0/3492037197 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd88da61640 1 -- 172.21.15.181:0/3492037197 >> v1:172.21.15.181:6791/0 conn(0x7fd8880a6ab0 legacy=0x7fd8881d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd88ea63640 1 -- 172.21.15.181:0/3492037197 >> v1:172.21.15.181:6789/0 conn(0x7fd88813f9a0 legacy=0x7fd8881d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd88e262640 1 -- 172.21.15.181:0/3492037197 >> v1:172.21.15.195:6792/0 conn(0x7fd8880a66d0 legacy=0x7fd888136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1601100071 0 0) 0x7fd88813f140 con 0x7fd8880a6ab0 2024-09-13T10:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): my global_id is 6169 2024-09-13T10:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd86c003520 con 0x7fd8880a6ab0 2024-09-13T10:35:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608987681 0 0) 0x7fd88813ee60 con 0x7fd88813f9a0 2024-09-13T10:35:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): my global_id is 104202 2024-09-13T10:35:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd88813f140 con 0x7fd88813f9a0 2024-09-13T10:35:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460034111 0 0) 0x7fd888142db0 con 0x7fd8880a66d0 2024-09-13T10:35:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): my global_id is 56221 2024-09-13T10:35:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd88813ee60 con 0x7fd8880a66d0 2024-09-13T10:35:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1189444068 0 0) 0x7fd88813f140 con 0x7fd88813f9a0 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd888142db0 con 0x7fd88813f9a0 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd8800020b0 con 0x7fd88813f9a0 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): dump: 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:20.676 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 293154399 0 0) 0x7fd86c003520 con 0x7fd8880a6ab0 2024-09-13T10:35:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd88813f140 con 0x7fd8880a6ab0 2024-09-13T10:35:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd878003c40 con 0x7fd8880a6ab0 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient(hunting): dump: 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3614081080 0 0) 0x7fd88813ee60 con 0x7fd8880a66d0 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd86c003520 con 0x7fd8880a66d0 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3232299836 0 0) 0x7fd888142db0 con 0x7fd88813f9a0 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 >> v1:172.21.15.195:6792/0 conn(0x7fd8880a66d0 legacy=0x7fd888136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 >> v1:172.21.15.181:6791/0 conn(0x7fd8880a6ab0 legacy=0x7fd8881d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient: _finish_hunting 0 2024-09-13T10:35:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 monclient: found mon.a 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd888137640 con 0x7fd88813f9a0 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient: _finish_auth 0 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 10 monclient: _check_auth_tickets 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd87effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd8904c6640 5 monclient: authenticate success, global_id 104202 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd8904c6640 10 monclient: _renew_subs 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd8904c6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.660+0000 7fd8904c6640 1 -- 172.21.15.181:0/3492037197 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd88813f420 con 0x7fd88813f9a0 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.661+0000 7fd8904c6640 10 monclient: _renew_subs 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.661+0000 7fd8904c6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.661+0000 7fd8904c6640 1 -- 172.21.15.181:0/3492037197 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd88813d9a0 con 0x7fd88813f9a0 2024-09-13T10:35:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.661+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd880003c40 con 0x7fd88813f9a0 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.661+0000 7fd87effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.661+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd8800041f0 con 0x7fd88813f9a0 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.661+0000 7fd87effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.661+0000 7fd88ca5f640 4 set_mon_vals no callback set 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.661+0000 7fd87effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.661+0000 7fd87effd640 10 monclient: dump: 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:20.680 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.661+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fd880004410 con 0x7fd88813f9a0 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.662+0000 7fd8904c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.662+0000 7fd8904c6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.662+0000 7fd8904c6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:35:20.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.662+0000 7fd8904c6640 1 -- 172.21.15.181:0/3492037197 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8880a5cb0 con 0x7fd88813f9a0 2024-09-13T10:35:20.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.662+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(173..173 src has 1..173) ==== 3506+0+0 (unknown 664712439 0 0) 0x7fd88004e480 con 0x7fd88813f9a0 2024-09-13T10:35:20.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.662+0000 7fd88e262640 10 monclient: get_auth_request con 0x7fd86c0404c0 auth_method 0 2024-09-13T10:35:20.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.666+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fd8880a5cb0 con 0x7fd88813f9a0 2024-09-13T10:35:20.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.666+0000 7fd87effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:20.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.666+0000 7fd87effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:20.779 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.779 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1425168387}) 2024-09-13T10:35:20.779 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2269187731}) 2024-09-13T10:35:20.779 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.779 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1425168387}) 2024-09-13T10:35:20.779 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1355872064}) 2024-09-13T10:35:20.779 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.779 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1425168387}) 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2029852012}) 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1425168387}) 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1195236069}) 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1425168387}) 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=358840293}) 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1425168387}) 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=835295766}) 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1425168387}) 2024-09-13T10:35:20.780 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=638294646}) 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1425168387}) 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.770+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1046199439}) 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2188474749}) 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2285012359}) 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2188474749}) 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=403725875}) 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2188474749}) 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2938959502}) 2024-09-13T10:35:20.781 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2188474749}) 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2253658511}) 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2188474749}) 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=206896281}) 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2188474749}) 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2134001266}) 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2188474749}) 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2465097429}) 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2188474749}) 2024-09-13T10:35:20.782 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.772+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=454405561}) 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1337203464}) 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1407741607}) 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1337203464}) 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1749761796}) 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1337203464}) 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3360499447}) 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1337203464}) 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3832614783}) 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1337203464}) 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3499880799}) 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1337203464}) 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1101341458}) 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1337203464}) 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2442830631}) 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1337203464}) 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.773+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=834553087}) 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3280233067}) 2024-09-13T10:35:20.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1608479080}) 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3280233067}) 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1889260809}) 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3280233067}) 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3593461689}) 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3280233067}) 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3074775387}) 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3280233067}) 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3749522664}) 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3280233067}) 2024-09-13T10:35:20.786 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1752473434}) 2024-09-13T10:35:20.786 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.786 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3280233067}) 2024-09-13T10:35:20.786 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3934953280}) 2024-09-13T10:35:20.786 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.786 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3280233067}) 2024-09-13T10:35:20.786 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.775+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1748521182}) 2024-09-13T10:35:20.863 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3445929029}) 2024-09-13T10:35:20.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3362319954}) 2024-09-13T10:35:20.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3445929029}) 2024-09-13T10:35:20.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1554610843}) 2024-09-13T10:35:20.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.859+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3445929029}) 2024-09-13T10:35:20.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=48280703}) 2024-09-13T10:35:20.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3445929029}) 2024-09-13T10:35:20.864 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2524489562}) 2024-09-13T10:35:20.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3445929029}) 2024-09-13T10:35:20.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2528482123}) 2024-09-13T10:35:20.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3445929029}) 2024-09-13T10:35:20.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1730613270}) 2024-09-13T10:35:20.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3445929029}) 2024-09-13T10:35:20.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1403150023}) 2024-09-13T10:35:20.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:20.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3445929029}) 2024-09-13T10:35:20.865 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:20.860+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3886688868}) 2024-09-13T10:35:20.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.909+0000 7fd8904c6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:35:20.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.910+0000 7fd8904c6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:35:20.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.910+0000 7fd8904c6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:35:20.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.910+0000 7fd8904c6640 1 -- 172.21.15.181:0/3492037197 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd8880a3240 con 0x7fd88813f9a0 2024-09-13T10:35:20.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.910+0000 7fd87effd640 1 -- 172.21.15.181:0/3492037197 <== mon.0 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 3544623012) 0x7fd880017a90 con 0x7fd88813f9a0 2024-09-13T10:35:20.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.910+0000 7fd87effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:35:20.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.910+0000 7fd87effd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:20.913 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":90,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:35:20.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.912+0000 7fd8904c6640 1 -- 172.21.15.181:0/3492037197 >> v1:172.21.15.195:6800/1839191919 conn(0x7fd86c0404c0 legacy=0x7fd86c042980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:20.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.912+0000 7fd8904c6640 10 monclient: shutdown 2024-09-13T10:35:20.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.912+0000 7fd8904c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:20.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.912+0000 7fd8904c6640 1 -- 172.21.15.181:0/3492037197 >> v1:172.21.15.181:6789/0 conn(0x7fd88813f9a0 legacy=0x7fd8881d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:20.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.912+0000 7fd8904c6640 1 -- 172.21.15.181:0/3492037197 shutdown_connections 2024-09-13T10:35:20.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.912+0000 7fd8904c6640 1 -- 172.21.15.181:0/3492037197 >> 172.21.15.181:0/3492037197 conn(0x7fd8880abcd0 msgr2=0x7fd8880a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:20.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.912+0000 7fd8904c6640 1 -- 172.21.15.181:0/3492037197 shutdown_connections 2024-09-13T10:35:20.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:20.912+0000 7fd8904c6640 1 -- 172.21.15.181:0/3492037197 wait complete. 2024-09-13T10:35:20.925 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:35:20.925 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T10:35:20.926 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:35:20.926 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:35:21.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.022+0000 7fae93268640 10 monclient: get_monmap_and_config 2024-09-13T10:35:21.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.022+0000 7fae93268640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.022+0000 7fae93268640 10 monclient: monmap: 2024-09-13T10:35:21.024 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:21.023771+0000 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:21.023771+0000 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.025 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.026 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.022+0000 7fae93268640 1 Processor -- start 2024-09-13T10:35:21.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae93268640 1 -- start start 2024-09-13T10:35:21.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae93268640 10 monclient: init 2024-09-13T10:35:21.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae93268640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae93268640 10 monclient: _add_conns ranks=[5,1,2,7,4,6,8,0,3] 2024-09-13T10:35:21.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae93268640 10 monclient(hunting): picked mon.noname-h con 0x7fae8c0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:21.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae93268640 10 monclient(hunting): picked mon.noname-f con 0x7fae8c0a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:21.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae93268640 10 monclient(hunting): picked mon.noname-b con 0x7fae8c13f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:21.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae93268640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8c0a5fe0 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae93268640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8c0a8080 con 0x7fae8c13f9a0 2024-09-13T10:35:21.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae93268640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8c0a42c0 con 0x7fae8c0a66d0 2024-09-13T10:35:21.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae93268640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae93268640 10 monclient(hunting): authenticate will time out at 1060.529567s 2024-09-13T10:35:21.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae91805640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fae8c13f9a0 0x7fae8c141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:59216/0 (socket says 172.21.15.181:59216) 2024-09-13T10:35:21.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.023+0000 7fae91805640 1 -- 172.21.15.181:0/3839901330 learned_addr learned my addr 172.21.15.181:0/3839901330 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.025+0000 7fae91805640 1 -- 172.21.15.181:0/3839901330 >> v1:172.21.15.181:6790/0 conn(0x7fae8c13f9a0 legacy=0x7fae8c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.025+0000 7fae83fff640 1 -- 172.21.15.181:0/3839901330 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3397598309 0 0) 0x7fae8c0a8080 con 0x7fae8c13f9a0 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.025+0000 7fae83fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.025+0000 7fae83fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.025+0000 7fae83fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.025+0000 7fae83fff640 10 monclient(hunting): my global_id is 94448 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 1 -- 172.21.15.181:0/3839901330 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae78003520 con 0x7fae8c13f9a0 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae91004640 1 -- 172.21.15.181:0/3839901330 >> v1:172.21.15.195:6791/0 conn(0x7fae8c0a66d0 legacy=0x7fae8c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae90803640 1 -- 172.21.15.181:0/3839901330 >> v1:172.21.15.195:6789/0 conn(0x7fae8c0a6ab0 legacy=0x7fae8c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 1 -- 172.21.15.181:0/3839901330 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 491174788 0 0) 0x7fae78003520 con 0x7fae8c13f9a0 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 1 -- 172.21.15.181:0/3839901330 >> v1:172.21.15.195:6791/0 conn(0x7fae8c0a66d0 legacy=0x7fae8c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 1 -- 172.21.15.181:0/3839901330 >> v1:172.21.15.195:6789/0 conn(0x7fae8c0a6ab0 legacy=0x7fae8c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 10 monclient: _finish_hunting 0 2024-09-13T10:35:21.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 1 monclient: found mon.noname-b 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 1 -- 172.21.15.181:0/3839901330 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8c1464e0 con 0x7fae8c13f9a0 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 10 monclient: _finish_auth 0 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 10 monclient: _check_auth_tickets 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 1 -- 172.21.15.181:0/3839901330 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae84001e60 con 0x7fae8c13f9a0 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae93268640 5 monclient: authenticate success, global_id 94448 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae93268640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 10 monclient: dump: 2024-09-13T10:35:21.033 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.034 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae93268640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 1 -- 172.21.15.181:0/3839901330 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae84004c20 con 0x7fae8c13f9a0 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 1 -- 172.21.15.181:0/3839901330 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae84005190 con 0x7fae8c13f9a0 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae93268640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae93268640 4 set_mon_vals no callback set 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae83fff640 10 monclient: dump: 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.035 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae93268640 10 monclient: shutdown 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae93268640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae93268640 1 -- 172.21.15.181:0/3839901330 >> v1:172.21.15.181:6790/0 conn(0x7fae8c13f9a0 legacy=0x7fae8c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae93268640 1 -- 172.21.15.181:0/3839901330 shutdown_connections 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.026+0000 7fae93268640 1 -- 172.21.15.181:0/3839901330 >> 172.21.15.181:0/3839901330 conn(0x7fae8c0abcd0 msgr2=0x7fae8c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.027+0000 7fae93268640 1 -- 172.21.15.181:0/3839901330 shutdown_connections 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.027+0000 7fae93268640 1 -- 172.21.15.181:0/3839901330 wait complete. 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.027+0000 7fae93268640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.027+0000 7fae93268640 10 monclient: monmap: 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:21.037 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.027+0000 7fae93268640 1 Processor -- start 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.027+0000 7fae93268640 1 -- start start 2024-09-13T10:35:21.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.027+0000 7fae93268640 10 monclient: init 2024-09-13T10:35:21.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.028+0000 7fae93268640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.028+0000 7fae93268640 10 monclient: _add_conns ranks=[5,2,6,8,1,3,0,4,7] 2024-09-13T10:35:21.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.028+0000 7fae93268640 10 monclient(hunting): picked mon.noname-h con 0x7fae8c0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:21.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.028+0000 7fae93268640 10 monclient(hunting): picked mon.noname-b con 0x7fae8c0a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:21.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.028+0000 7fae93268640 10 monclient(hunting): picked mon.noname-d con 0x7fae8c13f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:21.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.028+0000 7fae93268640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8c142f20 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.028+0000 7fae93268640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8c13efa0 con 0x7fae8c0a66d0 2024-09-13T10:35:21.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.028+0000 7fae93268640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8c13f280 con 0x7fae8c13f9a0 2024-09-13T10:35:21.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.028+0000 7fae93268640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.028+0000 7fae93268640 10 monclient(hunting): authenticate will time out at 1060.534464s 2024-09-13T10:35:21.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.028+0000 7fae90803640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fae8c0a6ab0 0x7fae8c1d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:59222/0 (socket says 172.21.15.181:59222) 2024-09-13T10:35:21.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.028+0000 7fae90803640 1 -- 172.21.15.181:0/1696605899 learned_addr learned my addr 172.21.15.181:0/1696605899 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae91805640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.181:6792/0 conn(0x7fae8c13f9a0 legacy=0x7fae8c1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae90803640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.181:6790/0 conn(0x7fae8c0a6ab0 legacy=0x7fae8c1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae91004640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.195:6791/0 conn(0x7fae8c0a66d0 legacy=0x7fae8c1ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88200968 0 0) 0x7fae8c0a5fe0 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 10 monclient(hunting): my global_id is 94457 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae70003520 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149328892 0 0) 0x7fae8c13f280 con 0x7fae8c13f9a0 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 10 monclient(hunting): my global_id is 6135 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae8c0a5fe0 con 0x7fae8c13f9a0 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 410698603 0 0) 0x7fae8c13efa0 con 0x7fae8c0a66d0 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 10 monclient(hunting): my global_id is 104189 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.030+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae8c13f280 con 0x7fae8c0a66d0 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2429114423 0 0) 0x7fae70003520 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae8c13efa0 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae7c003610 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient(hunting): dump: 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.046 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.047 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.048 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.048 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.048 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.048 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.048 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.048 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.048 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.048 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.049 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.049 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:21.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1986767002 0 0) 0x7fae8c0a5fe0 con 0x7fae8c13f9a0 2024-09-13T10:35:21.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae70003520 con 0x7fae8c13f9a0 2024-09-13T10:35:21.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae840020b0 con 0x7fae8c13f9a0 2024-09-13T10:35:21.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:21.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient(hunting): dump: 2024-09-13T10:35:21.049 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.049 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.049 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 981195338 0 0) 0x7fae8c13f280 con 0x7fae8c0a66d0 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae8c0a5fe0 con 0x7fae8c0a66d0 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae88001ca0 con 0x7fae8c0a66d0 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient(hunting): dump: 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.051 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3882393491 0 0) 0x7fae8c13efa0 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.181:6792/0 conn(0x7fae8c13f9a0 legacy=0x7fae8c1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.195:6791/0 conn(0x7fae8c0a66d0 legacy=0x7fae8c1ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 monclient: found mon.b 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:21.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8c0a28e0 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient: _finish_auth 0 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae93268640 5 monclient: authenticate success, global_id 94457 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae93268640 10 monclient: _renew_subs 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae93268640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae93268640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fae8c13da80 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae7c003b90 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae7c0040c0 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae81ffb640 10 monclient: dump: 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.054 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae837fe640 4 set_mon_vals no callback set 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae93268640 10 monclient: _renew_subs 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae93268640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.031+0000 7fae93268640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fae8c13e9e0 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.032+0000 7fae93268640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.032+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fae7c004260 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.032+0000 7fae93268640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fae8c13c820 con 0x7fae8c13c440 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.032+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(173..173 src has 1..173) ==== 3506+0+0 (unknown 664712439 0 0) 0x7fae7c04e280 con 0x7fae8c0a6ab0 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.032+0000 7fae91805640 10 monclient: get_auth_request con 0x7fae70040730 auth_method 0 2024-09-13T10:35:21.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.034+0000 7fae91004640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.181:6789/0 conn(0x7fae8c13c440 legacy=0x7fae8c13fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.034+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235112278 0 0) 0x7fae8c13c820 con 0x7fae8c13c440 2024-09-13T10:35:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.034+0000 7fae81ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.034+0000 7fae81ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.034+0000 7fae81ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.034+0000 7fae81ffb640 10 monclient(hunting): my global_id is 104211 2024-09-13T10:35:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.034+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae8c13efa0 con 0x7fae8c13c440 2024-09-13T10:35:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2234737486 0 0) 0x7fae8c13efa0 con 0x7fae8c13c440 2024-09-13T10:35:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae8c13c820 con 0x7fae8c13c440 2024-09-13T10:35:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae88003b80 con 0x7fae8c13c440 2024-09-13T10:35:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:21.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 10 monclient: dump: 2024-09-13T10:35:21.057 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.057 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.057 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.057 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.057 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.057 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.057 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.057 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.057 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.057 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.057 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.057 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.058 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.058 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.058 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.058 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1841150791 0 0) 0x7fae8c13c820 con 0x7fae8c13c440 2024-09-13T10:35:21.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae8c0a3240 con 0x7fae8c13c440 2024-09-13T10:35:21.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fae88003ec0 con 0x7fae8c13c440 2024-09-13T10:35:21.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:21.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:21.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.181:6789/0 conn(0x7fae8c13c440 legacy=0x7fae8c13fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.035+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.181:6789/0 conn(0x7fae8c13c440 legacy=0x7fae8c13fd80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:21.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.041+0000 7fae93268640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:21.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.041+0000 7fae93268640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fae8c069af0 con 0x7fae8c1ced70 2024-09-13T10:35:21.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.043+0000 7fae91004640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.181:6789/0 conn(0x7fae8c1ced70 legacy=0x7fae8c140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788755424 0 0) 0x7fae8c069af0 con 0x7fae8c1ced70 2024-09-13T10:35:21.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 10 monclient(hunting): my global_id is 104220 2024-09-13T10:35:21.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae8c13c820 con 0x7fae8c1ced70 2024-09-13T10:35:21.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2551353873 0 0) 0x7fae8c13c820 con 0x7fae8c1ced70 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae8c069af0 con 0x7fae8c1ced70 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae880043a0 con 0x7fae8c1ced70 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 10 monclient: dump: 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.061 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2546878621 0 0) 0x7fae8c069af0 con 0x7fae8c1ced70 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fae8c0a4910 con 0x7fae8c1ced70 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7557 (unknown 0 0 766792771) 0x7fae88007b60 con 0x7fae8c1ced70 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.181:6789/0 conn(0x7fae8c1ced70 legacy=0x7fae8c140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.044+0000 7fae81ffb640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.181:6789/0 conn(0x7fae8c1ced70 legacy=0x7fae8c140490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:21.063 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:21.063 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:21.063 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:21.063 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:21.063 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:21.063 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 4747, 2024-09-13T10:35:21.063 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:21.063 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:21.064 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.065 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.067 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:21.067 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:21.067 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:21.067 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:21.067 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:21.067 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:21.067 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:21.067 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:21.067 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:21.068 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:21.068 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:21.068 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:21.068 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:21.068 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:21.068 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:21.068 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:21.068 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:21.068 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.068 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.068 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.068 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:21.069 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.070 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.071 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:21.071 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:21.071 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.071 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.071 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.071 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:21.071 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.071 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.071 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.072 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:21.073 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.074 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.076 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:21.077 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.078 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.079 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.080 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.082 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.083 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:21.083 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.045+0000 7fae93268640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.195:6800/1839191919 conn(0x7fae70040730 legacy=0x7fae70042bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.045+0000 7fae93268640 10 monclient: shutdown 2024-09-13T10:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.045+0000 7fae93268640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.045+0000 7fae93268640 1 -- 172.21.15.181:0/1696605899 >> v1:172.21.15.181:6790/0 conn(0x7fae8c0a6ab0 legacy=0x7fae8c1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.045+0000 7fae91805640 1 -- 172.21.15.181:0/1696605899 reap_dead start 2024-09-13T10:35:21.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.045+0000 7fae91805640 1 -- 172.21.15.181:0/1696605899 reap_dead start 2024-09-13T10:35:21.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.045+0000 7fae93268640 1 -- 172.21.15.181:0/1696605899 shutdown_connections 2024-09-13T10:35:21.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.045+0000 7fae93268640 1 -- 172.21.15.181:0/1696605899 >> 172.21.15.181:0/1696605899 conn(0x7fae8c0abcd0 msgr2=0x7fae8c0a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:21.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.045+0000 7fae93268640 1 -- 172.21.15.181:0/1696605899 shutdown_connections 2024-09-13T10:35:21.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.045+0000 7fae93268640 1 -- 172.21.15.181:0/1696605899 wait complete. 2024-09-13T10:35:21.085 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:21.085 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:35:21.086 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:35:21.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.181+0000 7fba8fa48640 10 monclient: get_monmap_and_config 2024-09-13T10:35:21.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.181+0000 7fba8fa48640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.181+0000 7fba8fa48640 10 monclient: monmap: 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:21.182785+0000 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:21.182785+0000 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.184 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.185 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.185 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.181+0000 7fba8fa48640 1 Processor -- start 2024-09-13T10:35:21.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8fa48640 1 -- start start 2024-09-13T10:35:21.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8fa48640 10 monclient: init 2024-09-13T10:35:21.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8fa48640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8fa48640 10 monclient: _add_conns ranks=[5,8,1,3,0,7,6,2,4] 2024-09-13T10:35:21.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8fa48640 10 monclient(hunting): picked mon.noname-h con 0x7fba880a6740 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:21.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8fa48640 10 monclient(hunting): picked mon.noname-e con 0x7fba880a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:21.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8fa48640 10 monclient(hunting): picked mon.noname-f con 0x7fba8813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:21.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8fa48640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba880a2f40 con 0x7fba8813f750 2024-09-13T10:35:21.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8fa48640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba880a4bc0 con 0x7fba880a6740 2024-09-13T10:35:21.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8fa48640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba880a5360 con 0x7fba880a8340 2024-09-13T10:35:21.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8fa48640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8fa48640 10 monclient(hunting): authenticate will time out at 1060.688538s 2024-09-13T10:35:21.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8cfe3640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fba880a8340 0x7fba880a7230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54520/0 (socket says 172.21.15.181:54520) 2024-09-13T10:35:21.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.182+0000 7fba8cfe3640 1 -- 172.21.15.181:0/2110233306 learned_addr learned my addr 172.21.15.181:0/2110233306 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.184+0000 7fba8cfe3640 1 -- 172.21.15.181:0/2110233306 >> v1:172.21.15.181:6793/0 conn(0x7fba880a8340 legacy=0x7fba880a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.184+0000 7fba8d7e4640 1 -- 172.21.15.181:0/2110233306 >> v1:172.21.15.195:6791/0 conn(0x7fba880a6740 legacy=0x7fba880a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.184+0000 7fba8dfe5640 1 -- 172.21.15.181:0/2110233306 >> v1:172.21.15.195:6789/0 conn(0x7fba8813f750 legacy=0x7fba88141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 1 -- 172.21.15.181:0/2110233306 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143258637 0 0) 0x7fba880a5360 con 0x7fba880a8340 2024-09-13T10:35:21.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient(hunting): my global_id is 104228 2024-09-13T10:35:21.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 1 -- 172.21.15.181:0/2110233306 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba74003520 con 0x7fba880a8340 2024-09-13T10:35:21.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 1 -- 172.21.15.181:0/2110233306 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3101081086 0 0) 0x7fba74003520 con 0x7fba880a8340 2024-09-13T10:35:21.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 1 -- 172.21.15.181:0/2110233306 >> v1:172.21.15.195:6791/0 conn(0x7fba880a6740 legacy=0x7fba880a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 1 -- 172.21.15.181:0/2110233306 >> v1:172.21.15.195:6789/0 conn(0x7fba8813f750 legacy=0x7fba88141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 1 monclient: found mon.noname-e 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 1 -- 172.21.15.181:0/2110233306 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba88146290 con 0x7fba880a8340 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient: _finish_auth 0 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba8fa48640 5 monclient: authenticate success, global_id 104228 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba8fa48640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 1 -- 172.21.15.181:0/2110233306 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba78001ae0 con 0x7fba880a8340 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient: dump: 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.193 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba8fa48640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 1 -- 172.21.15.181:0/2110233306 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba780048a0 con 0x7fba880a8340 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 1 -- 172.21.15.181:0/2110233306 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba78004e10 con 0x7fba880a8340 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba8fa48640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba8fa48640 4 set_mon_vals no callback set 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba7ffff640 10 monclient: dump: 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.194 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.195 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.195 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.195 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.195 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.195 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.195 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.195 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.195 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.195 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.196 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.196 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.196 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.196 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.196 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba8fa48640 10 monclient: shutdown 2024-09-13T10:35:21.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba8fa48640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:21.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba8fa48640 1 -- 172.21.15.181:0/2110233306 >> v1:172.21.15.181:6793/0 conn(0x7fba880a8340 legacy=0x7fba880a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.185+0000 7fba8fa48640 1 -- 172.21.15.181:0/2110233306 shutdown_connections 2024-09-13T10:35:21.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.186+0000 7fba8fa48640 1 -- 172.21.15.181:0/2110233306 >> 172.21.15.181:0/2110233306 conn(0x7fba880abd40 msgr2=0x7fba880ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:21.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.186+0000 7fba8fa48640 1 -- 172.21.15.181:0/2110233306 shutdown_connections 2024-09-13T10:35:21.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.186+0000 7fba8fa48640 1 -- 172.21.15.181:0/2110233306 wait complete. 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.186+0000 7fba8fa48640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.186+0000 7fba8fa48640 10 monclient: monmap: 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.197 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.186+0000 7fba8fa48640 1 Processor -- start 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.186+0000 7fba8fa48640 1 -- start start 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.186+0000 7fba8fa48640 10 monclient: init 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8fa48640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8fa48640 10 monclient: _add_conns ranks=[4,6,8,5,1,3,2,7,0] 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8fa48640 10 monclient(hunting): picked mon.noname-c con 0x7fba880a6740 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8fa48640 10 monclient(hunting): picked mon.noname-d con 0x7fba880a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8fa48640 10 monclient(hunting): picked mon.noname-e con 0x7fba8813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:21.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8fa48640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba8813e550 con 0x7fba880a6740 2024-09-13T10:35:21.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8fa48640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba88122850 con 0x7fba880a8340 2024-09-13T10:35:21.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8fa48640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba880a1580 con 0x7fba8813f750 2024-09-13T10:35:21.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8fa48640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8fa48640 10 monclient(hunting): authenticate will time out at 1060.693425s 2024-09-13T10:35:21.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8d7e4640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fba880a6740 0x7fba881ce410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42622/0 (socket says 172.21.15.181:42622) 2024-09-13T10:35:21.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8cfe3640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fba880a8340 0x7fba881d33e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:40296/0 (socket says 172.21.15.181:40296) 2024-09-13T10:35:21.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8dfe5640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fba8813f750 0x7fba881d6b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54528/0 (socket says 172.21.15.181:54528) 2024-09-13T10:35:21.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.187+0000 7fba8d7e4640 1 -- 172.21.15.181:0/3860279872 learned_addr learned my addr 172.21.15.181:0/3860279872 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba8dfe5640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.181:6793/0 conn(0x7fba8813f750 legacy=0x7fba881d6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba8d7e4640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.181:6791/0 conn(0x7fba880a6740 legacy=0x7fba881ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba8cfe3640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.181:6792/0 conn(0x7fba880a8340 legacy=0x7fba881d33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606032152 0 0) 0x7fba880a1580 con 0x7fba8813f750 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 10 monclient(hunting): my global_id is 104237 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba6c003520 con 0x7fba8813f750 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127743298 0 0) 0x7fba88122850 con 0x7fba880a8340 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 10 monclient(hunting): my global_id is 6144 2024-09-13T10:35:21.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba880a1580 con 0x7fba880a8340 2024-09-13T10:35:21.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194309641 0 0) 0x7fba880a4bc0 con 0x7fba880a6740 2024-09-13T10:35:21.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 10 monclient(hunting): my global_id is 6178 2024-09-13T10:35:21.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.189+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba88122850 con 0x7fba880a6740 2024-09-13T10:35:21.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 369570804 0 0) 0x7fba6c003520 con 0x7fba8813f750 2024-09-13T10:35:21.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba880a4bc0 con 0x7fba8813f750 2024-09-13T10:35:21.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba80001c70 con 0x7fba8813f750 2024-09-13T10:35:21.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:35:21.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient(hunting): dump: 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.208 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3505074977 0 0) 0x7fba88122850 con 0x7fba880a6740 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba6c003520 con 0x7fba880a6740 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba84003990 con 0x7fba880a6740 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient(hunting): dump: 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.209 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3794381100 0 0) 0x7fba880a1580 con 0x7fba880a8340 2024-09-13T10:35:21.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba88122850 con 0x7fba880a8340 2024-09-13T10:35:21.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba78004d90 con 0x7fba880a8340 2024-09-13T10:35:21.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:21.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient(hunting): dump: 2024-09-13T10:35:21.211 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.211 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.211 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.211 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.211 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.211 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.211 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.211 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2885563925 0 0) 0x7fba880a4bc0 con 0x7fba8813f750 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.181:6792/0 conn(0x7fba880a8340 legacy=0x7fba881d33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.181:6791/0 conn(0x7fba880a6740 legacy=0x7fba881ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient: _finish_hunting 0 2024-09-13T10:35:21.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 monclient: found mon.e 2024-09-13T10:35:21.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:21.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:21.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba88122b30 con 0x7fba8813f750 2024-09-13T10:35:21.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient: _finish_auth 0 2024-09-13T10:35:21.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient: _check_auth_tickets 2024-09-13T10:35:21.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:21.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba8fa48640 5 monclient: authenticate success, global_id 104237 2024-09-13T10:35:21.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba8fa48640 10 monclient: _renew_subs 2024-09-13T10:35:21.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba8fa48640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:21.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba8fa48640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fba88142e60 con 0x7fba8813f750 2024-09-13T10:35:21.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba800038c0 con 0x7fba8813f750 2024-09-13T10:35:21.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba80003e30 con 0x7fba8813f750 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7dffb640 10 monclient: dump: 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.214 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba8fa48640 10 monclient: _renew_subs 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba7f7fe640 4 set_mon_vals no callback set 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba8fa48640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.190+0000 7fba8fa48640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fba880a06d0 con 0x7fba8813f750 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.191+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fba80003fd0 con 0x7fba8813f750 2024-09-13T10:35:21.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.191+0000 7fba8fa48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.191+0000 7fba8fa48640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba880a2810 con 0x7fba881ceb20 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.191+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(173..173 src has 1..173) ==== 3506+0+0 (unknown 664712439 0 0) 0x7fba8004e020 con 0x7fba8813f750 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.191+0000 7fba8cfe3640 10 monclient: get_auth_request con 0x7fba6c0404d0 auth_method 0 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba8d7e4640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.181:6790/0 conn(0x7fba881ceb20 legacy=0x7fba881439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2259874220 0 0) 0x7fba880a2810 con 0x7fba881ceb20 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba7dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba7dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba7dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba7dffb640 10 monclient(hunting): my global_id is 94466 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba880a4bc0 con 0x7fba881ceb20 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3601377652 0 0) 0x7fba880a4bc0 con 0x7fba881ceb20 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba880a2810 con 0x7fba881ceb20 2024-09-13T10:35:21.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba84004480 con 0x7fba881ceb20 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba7dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba7dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.193+0000 7fba7dffb640 10 monclient: dump: 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.217 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.194+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2464345133 0 0) 0x7fba880a2810 con 0x7fba881ceb20 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.194+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba880ac290 con 0x7fba881ceb20 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.194+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fba84004720 con 0x7fba881ceb20 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.194+0000 7fba7dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.194+0000 7fba7dffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.194+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.181:6790/0 conn(0x7fba881ceb20 legacy=0x7fba881439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.194+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.181:6790/0 conn(0x7fba881ceb20 legacy=0x7fba881439c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:21.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.200+0000 7fba8fa48640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.200+0000 7fba8fa48640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba8806d240 con 0x7fba8802e200 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba8d7e4640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.181:6790/0 conn(0x7fba8802e200 legacy=0x7fba881440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501149360 0 0) 0x7fba8806d240 con 0x7fba8802e200 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba7dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba7dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba7dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba7dffb640 10 monclient(hunting): my global_id is 94475 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba880a2810 con 0x7fba8802e200 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 915127043 0 0) 0x7fba880a2810 con 0x7fba8802e200 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba8806d240 con 0x7fba8802e200 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fba84006070 con 0x7fba8802e200 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba7dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba7dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.202+0000 7fba7dffb640 10 monclient: dump: 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.220 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.221 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.221 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.221 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2234295930 0 0) 0x7fba8806d240 con 0x7fba8802e200 2024-09-13T10:35:21.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba881cef00 con 0x7fba8802e200 2024-09-13T10:35:21.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7725 (unknown 0 0 3846128997) 0x7fba84008350 con 0x7fba8802e200 2024-09-13T10:35:21.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba7dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:21.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba7dffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:21.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.181:6790/0 conn(0x7fba8802e200 legacy=0x7fba881440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba7dffb640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.181:6790/0 conn(0x7fba8802e200 legacy=0x7fba881440d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:21.221 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 61228, 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:21.222 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.223 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.224 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.224 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.224 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.224 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.224 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.224 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:21.224 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:21.224 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.224 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.224 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.224 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.224 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.225 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.225 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.225 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.225 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.225 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.225 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.225 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.225 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:21.225 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:21.226 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:21.227 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:21.227 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:21.227 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.227 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.227 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.227 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.227 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.227 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:21.228 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.229 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.229 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.229 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:21.229 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.229 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.229 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.229 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:21.229 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:21.229 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.230 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.230 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.230 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:21.230 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:21.230 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.230 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.230 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.230 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:21.230 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.231 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.231 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.231 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:21.231 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:21.231 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.231 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.231 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:21.232 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.233 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.235 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:21.235 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.235 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:21.235 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:21.235 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.235 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.236 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.236 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:21.236 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:21.236 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.236 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:21.236 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.236 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:21.239 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:21.240 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:21.241 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.242 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:21.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.243 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.243 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.243 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:21.243 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.243 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.243 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:21.243 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:21.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba8fa48640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.195:6800/1839191919 conn(0x7fba6c0404d0 legacy=0x7fba6c042990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba8fa48640 10 monclient: shutdown 2024-09-13T10:35:21.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba8fa48640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:21.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba8fa48640 1 -- 172.21.15.181:0/3860279872 >> v1:172.21.15.181:6793/0 conn(0x7fba8813f750 legacy=0x7fba881d6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba8dfe5640 1 -- 172.21.15.181:0/3860279872 reap_dead start 2024-09-13T10:35:21.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba8dfe5640 1 -- 172.21.15.181:0/3860279872 reap_dead start 2024-09-13T10:35:21.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba8fa48640 1 -- 172.21.15.181:0/3860279872 shutdown_connections 2024-09-13T10:35:21.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba8fa48640 1 -- 172.21.15.181:0/3860279872 >> 172.21.15.181:0/3860279872 conn(0x7fba880abd40 msgr2=0x7fba88141b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:21.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba8fa48640 1 -- 172.21.15.181:0/3860279872 shutdown_connections 2024-09-13T10:35:21.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.203+0000 7fba8fa48640 1 -- 172.21.15.181:0/3860279872 wait complete. 2024-09-13T10:35:21.245 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:21.246 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:35:21.246 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:35:21.279 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.279 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=655453415}) 2024-09-13T10:35:21.279 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3029003952}) 2024-09-13T10:35:21.279 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.279 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=655453415}) 2024-09-13T10:35:21.279 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1479055997}) 2024-09-13T10:35:21.279 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.279 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.275+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=655453415}) 2024-09-13T10:35:21.279 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=652683317}) 2024-09-13T10:35:21.279 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.279 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=655453415}) 2024-09-13T10:35:21.279 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=190182343}) 2024-09-13T10:35:21.280 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.280 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=655453415}) 2024-09-13T10:35:21.280 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=640066372}) 2024-09-13T10:35:21.280 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.280 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=655453415}) 2024-09-13T10:35:21.280 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1652030389}) 2024-09-13T10:35:21.280 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.280 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=655453415}) 2024-09-13T10:35:21.280 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=8205861}) 2024-09-13T10:35:21.280 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.280 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=655453415}) 2024-09-13T10:35:21.280 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.276+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2431306267}) 2024-09-13T10:35:21.295 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.296 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2994340611}) 2024-09-13T10:35:21.296 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3116286120}) 2024-09-13T10:35:21.296 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.296 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2994340611}) 2024-09-13T10:35:21.296 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2062066876}) 2024-09-13T10:35:21.296 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.296 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2994340611}) 2024-09-13T10:35:21.297 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1534791201}) 2024-09-13T10:35:21.297 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.297 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2994340611}) 2024-09-13T10:35:21.297 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=878344201}) 2024-09-13T10:35:21.297 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.297 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2994340611}) 2024-09-13T10:35:21.297 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2767842275}) 2024-09-13T10:35:21.297 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.297 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2994340611}) 2024-09-13T10:35:21.297 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4226491223}) 2024-09-13T10:35:21.297 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.297 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2994340611}) 2024-09-13T10:35:21.298 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787401239}) 2024-09-13T10:35:21.298 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.298 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2994340611}) 2024-09-13T10:35:21.298 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.293+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=223474095}) 2024-09-13T10:35:21.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.347+0000 7f478c95d640 10 monclient: get_monmap_and_config 2024-09-13T10:35:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.347+0000 7f478c95d640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.347+0000 7f478c95d640 10 monclient: monmap: 2024-09-13T10:35:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:21.349175+0000 2024-09-13T10:35:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:21.349175+0000 2024-09-13T10:35:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.351 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 1 Processor -- start 2024-09-13T10:35:21.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 1 -- start start 2024-09-13T10:35:21.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 10 monclient: init 2024-09-13T10:35:21.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 10 monclient: _add_conns ranks=[7,4,2,5,0,8,1,6,3] 2024-09-13T10:35:21.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 10 monclient(hunting): picked mon.noname-i con 0x7f47881306c0 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:21.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 10 monclient(hunting): picked mon.noname-c con 0x7f478813a0c0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:21.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 10 monclient(hunting): picked mon.noname-b con 0x7f478813dbd0 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:21.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47881311b0 con 0x7f478813dbd0 2024-09-13T10:35:21.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4788072310 con 0x7f478813a0c0 2024-09-13T10:35:21.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4788072590 con 0x7f47881306c0 2024-09-13T10:35:21.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f478c95d640 10 monclient(hunting): authenticate will time out at 1060.854916s 2024-09-13T10:35:21.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f4785d9b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f478813a0c0 0x7f478813c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42638/0 (socket says 172.21.15.181:42638) 2024-09-13T10:35:21.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.348+0000 7f4785d9b640 1 -- 172.21.15.181:0/1699702683 learned_addr learned my addr 172.21.15.181:0/1699702683 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f4785d9b640 1 -- 172.21.15.181:0/1699702683 >> v1:172.21.15.181:6791/0 conn(0x7f478813a0c0 legacy=0x7f478813c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f4786d9d640 1 -- 172.21.15.181:0/1699702683 >> v1:172.21.15.181:6790/0 conn(0x7f478813dbd0 legacy=0x7f478813ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 1 -- 172.21.15.181:0/1699702683 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4070970086 0 0) 0x7f4788072310 con 0x7f478813a0c0 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient(hunting): my global_id is 6187 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 1 -- 172.21.15.181:0/1699702683 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4770003520 con 0x7f478813a0c0 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 1 -- 172.21.15.181:0/1699702683 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884676345 0 0) 0x7f47881311b0 con 0x7f478813dbd0 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient(hunting): my global_id is 94484 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 1 -- 172.21.15.181:0/1699702683 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4788072310 con 0x7f478813dbd0 2024-09-13T10:35:21.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478659c640 1 -- 172.21.15.181:0/1699702683 >> v1:172.21.15.195:6792/0 conn(0x7f47881306c0 legacy=0x7f4788130aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 1 -- 172.21.15.181:0/1699702683 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3992047076 0 0) 0x7f4788072310 con 0x7f478813dbd0 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 1 -- 172.21.15.181:0/1699702683 >> v1:172.21.15.195:6792/0 conn(0x7f47881306c0 legacy=0x7f4788130aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 1 -- 172.21.15.181:0/1699702683 >> v1:172.21.15.181:6791/0 conn(0x7f478813a0c0 legacy=0x7f478813c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient: _finish_hunting 0 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 1 monclient: found mon.noname-b 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 1 -- 172.21.15.181:0/1699702683 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4788073630 con 0x7f478813dbd0 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient: _finish_auth 0 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient: _check_auth_tickets 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 1 -- 172.21.15.181:0/1699702683 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4780001e90 con 0x7f478813dbd0 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient: dump: 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.360 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478c95d640 5 monclient: authenticate success, global_id 94484 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478c95d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 1 -- 172.21.15.181:0/1699702683 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4780003990 con 0x7f478813dbd0 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 1 -- 172.21.15.181:0/1699702683 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4780003f00 con 0x7f478813dbd0 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478c95d640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478c95d640 4 set_mon_vals no callback set 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.351+0000 7f478559a640 10 monclient: dump: 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.362 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.352+0000 7f478c95d640 10 monclient: shutdown 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.352+0000 7f478c95d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.352+0000 7f478c95d640 1 -- 172.21.15.181:0/1699702683 >> v1:172.21.15.181:6790/0 conn(0x7f478813dbd0 legacy=0x7f478813ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.352+0000 7f478c95d640 1 -- 172.21.15.181:0/1699702683 shutdown_connections 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.352+0000 7f478c95d640 1 -- 172.21.15.181:0/1699702683 >> 172.21.15.181:0/1699702683 conn(0x7f47880aa340 msgr2=0x7f47880a6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.352+0000 7f478c95d640 1 -- 172.21.15.181:0/1699702683 shutdown_connections 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.352+0000 7f478c95d640 1 -- 172.21.15.181:0/1699702683 wait complete. 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.352+0000 7f478c95d640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.352+0000 7f478c95d640 10 monclient: monmap: 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.363 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.364 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 1 Processor -- start 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 1 -- start start 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 10 monclient: init 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 10 monclient: _add_conns ranks=[0,4,8,2,5,7,1,6,3] 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 10 monclient(hunting): picked mon.noname-a con 0x7f47881306c0 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 10 monclient(hunting): picked mon.noname-c con 0x7f478813a0c0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 10 monclient(hunting): picked mon.noname-e con 0x7f478813dbd0 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478813c530 con 0x7f47881306c0 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478813c810 con 0x7f478813a0c0 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478813b5d0 con 0x7f478813dbd0 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f478c95d640 10 monclient(hunting): authenticate will time out at 1060.859814s 2024-09-13T10:35:21.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f4785d9b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f478813a0c0 0x7f47881d31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42646/0 (socket says 172.21.15.181:42646) 2024-09-13T10:35:21.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.353+0000 7f4785d9b640 1 -- 172.21.15.181:0/2436835973 learned_addr learned my addr 172.21.15.181:0/2436835973 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4785d9b640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.181:6791/0 conn(0x7f478813a0c0 legacy=0x7f47881d31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4786d9d640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.181:6793/0 conn(0x7f478813dbd0 legacy=0x7f47881d68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f478659c640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.181:6789/0 conn(0x7f47881306c0 legacy=0x7f478812f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2826836071 0 0) 0x7f478813c810 con 0x7f478813a0c0 2024-09-13T10:35:21.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): my global_id is 6196 2024-09-13T10:35:21.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4768003520 con 0x7f478813a0c0 2024-09-13T10:35:21.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552850553 0 0) 0x7f478813b5d0 con 0x7f478813dbd0 2024-09-13T10:35:21.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): my global_id is 104246 2024-09-13T10:35:21.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f478813c810 con 0x7f478813dbd0 2024-09-13T10:35:21.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 554515397 0 0) 0x7f478813c530 con 0x7f47881306c0 2024-09-13T10:35:21.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): my global_id is 104229 2024-09-13T10:35:21.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f478813b5d0 con 0x7f47881306c0 2024-09-13T10:35:21.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 442689301 0 0) 0x7f4768003520 con 0x7f478813a0c0 2024-09-13T10:35:21.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f478813c530 con 0x7f478813a0c0 2024-09-13T10:35:21.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f477c001a60 con 0x7f478813a0c0 2024-09-13T10:35:21.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:35:21.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): dump: 2024-09-13T10:35:21.372 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 894946830 0 0) 0x7f478813c810 con 0x7f478813dbd0 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4768003520 con 0x7f478813dbd0 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3560419093 0 0) 0x7f478813b5d0 con 0x7f47881306c0 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f478813c810 con 0x7f47881306c0 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4780003e80 con 0x7f478813dbd0 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): dump: 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.374 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4778001cd0 con 0x7f47881306c0 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient(hunting): dump: 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.376 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3154997849 0 0) 0x7f478813c530 con 0x7f478813a0c0 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.181:6793/0 conn(0x7f478813dbd0 legacy=0x7f47881d68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.181:6789/0 conn(0x7f47881306c0 legacy=0x7f478812f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 monclient: found mon.c 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:35:21.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47880a3a50 con 0x7f478813a0c0 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient: _finish_auth 0 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f4776ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f478c95d640 5 monclient: authenticate success, global_id 6196 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f478c95d640 10 monclient: _renew_subs 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f478c95d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f478c95d640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f478813d1f0 con 0x7f478813a0c0 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f478c95d640 10 monclient: _renew_subs 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f478c95d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.356+0000 7f478c95d640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f478806f910 con 0x7f478813a0c0 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.357+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f477c004dd0 con 0x7f478813a0c0 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.357+0000 7f4776ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.357+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f477c0052c0 con 0x7f478813a0c0 2024-09-13T10:35:21.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.357+0000 7f4776ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.357+0000 7f4784d99640 4 set_mon_vals no callback set 2024-09-13T10:35:21.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.357+0000 7f4776ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:21.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.357+0000 7f4776ffd640 10 monclient: dump: 2024-09-13T10:35:21.379 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.379 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.379 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.379 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.379 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.379 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.357+0000 7f478c95d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.357+0000 7f478c95d640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f476c0065c0 con 0x7f476c002860 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.357+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f477c011940 con 0x7f478813a0c0 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.358+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(173..173 src has 1..173) ==== 3506+0+0 (unknown 664712439 0 0) 0x7f477c04e260 con 0x7f478813a0c0 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.358+0000 7f4786d9d640 10 monclient: get_auth_request con 0x7f47680404e0 auth_method 0 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.359+0000 7f478659c640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.181:6791/0 conn(0x7f476c002860 legacy=0x7f476c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.359+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072561202 0 0) 0x7f476c0065c0 con 0x7f476c002860 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.359+0000 7f4776ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.359+0000 7f4776ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.359+0000 7f4776ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 10 monclient(hunting): my global_id is 6205 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f478813c530 con 0x7f476c002860 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2801082674 0 0) 0x7f478813c530 con 0x7f476c002860 2024-09-13T10:35:21.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f476c0065c0 con 0x7f476c002860 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4778003c50 con 0x7f476c002860 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 10 monclient: dump: 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.382 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 759591467 0 0) 0x7f476c0065c0 con 0x7f476c002860 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f476c00a160 con 0x7f476c002860 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4778003f00 con 0x7f476c002860 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.181:6791/0 conn(0x7f476c002860 legacy=0x7f476c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.360+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.181:6791/0 conn(0x7f476c002860 legacy=0x7f476c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:21.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.366+0000 7f478c95d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:21.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.366+0000 7f478c95d640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f476c009e40 con 0x7f476c009100 2024-09-13T10:35:21.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f478659c640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.181:6791/0 conn(0x7f476c009100 legacy=0x7f476c009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 400832079 0 0) 0x7f476c009e40 con 0x7f476c009100 2024-09-13T10:35:21.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 10 monclient(hunting): my global_id is 6214 2024-09-13T10:35:21.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f476c0065c0 con 0x7f476c009100 2024-09-13T10:35:21.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1205091839 0 0) 0x7f476c0065c0 con 0x7f476c009100 2024-09-13T10:35:21.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f476c009e40 con 0x7f476c009100 2024-09-13T10:35:21.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f47780043b0 con 0x7f476c009100 2024-09-13T10:35:21.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:21.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 10 monclient: dump: 2024-09-13T10:35:21.386 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.386 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.386 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.386 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.386 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 552622793 0 0) 0x7f476c009e40 con 0x7f476c009100 2024-09-13T10:35:21.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f476c00c3a0 con 0x7f476c009100 2024-09-13T10:35:21.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7893 (unknown 0 0 4139728023) 0x7f4778005b00 con 0x7f476c009100 2024-09-13T10:35:21.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:21.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:21.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.181:6791/0 conn(0x7f476c009100 legacy=0x7f476c009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.369+0000 7f4776ffd640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.181:6791/0 conn(0x7f476c009100 legacy=0x7f476c009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:21.388 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:21.388 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:21.388 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:21.388 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:21.388 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 335819, 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:35:21.389 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.390 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.391 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.392 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.392 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.392 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:21.392 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:21.392 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:21.392 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:21.392 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:21.392 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:21.392 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:21.392 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:21.392 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.393 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:21.394 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.396 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:21.396 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:21.396 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.396 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:21.396 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.396 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.396 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.397 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.398 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.399 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.400 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.400 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:21.400 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:21.400 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.400 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.400 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.400 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:21.400 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.400 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.402 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.403 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.404 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.404 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:21.404 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:21.404 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.404 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.404 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.404 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:21.404 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.404 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.406 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.407 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.408 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.409 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:21.409 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.409 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.409 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:21.409 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:21.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.370+0000 7f478c95d640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.195:6800/1839191919 conn(0x7f47680404e0 legacy=0x7f47680429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.370+0000 7f478c95d640 10 monclient: shutdown 2024-09-13T10:35:21.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.370+0000 7f478c95d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:21.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.370+0000 7f478c95d640 1 -- 172.21.15.181:0/2436835973 >> v1:172.21.15.181:6791/0 conn(0x7f478813a0c0 legacy=0x7f47881d31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.370+0000 7f4786d9d640 1 -- 172.21.15.181:0/2436835973 reap_dead start 2024-09-13T10:35:21.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.370+0000 7f4786d9d640 1 -- 172.21.15.181:0/2436835973 reap_dead start 2024-09-13T10:35:21.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.370+0000 7f478c95d640 1 -- 172.21.15.181:0/2436835973 shutdown_connections 2024-09-13T10:35:21.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.370+0000 7f478c95d640 1 -- 172.21.15.181:0/2436835973 >> 172.21.15.181:0/2436835973 conn(0x7f47880aa340 msgr2=0x7f4788138c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:21.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.370+0000 7f478c95d640 1 -- 172.21.15.181:0/2436835973 shutdown_connections 2024-09-13T10:35:21.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.370+0000 7f478c95d640 1 -- 172.21.15.181:0/2436835973 wait complete. 2024-09-13T10:35:21.411 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:21.411 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:35:21.411 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:35:21.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.507+0000 7f63c9189640 10 monclient: get_monmap_and_config 2024-09-13T10:35:21.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.507+0000 7f63c9189640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.507+0000 7f63c9189640 10 monclient: monmap: 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:21.508765+0000 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:21.508765+0000 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.510 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.511 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.511 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.511 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.511 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.507+0000 7f63c9189640 1 Processor -- start 2024-09-13T10:35:21.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.507+0000 7f63c9189640 1 -- start start 2024-09-13T10:35:21.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.507+0000 7f63c9189640 10 monclient: init 2024-09-13T10:35:21.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c9189640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c9189640 10 monclient: _add_conns ranks=[2,1,4,5,7,6,8,3,0] 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c9189640 10 monclient(hunting): picked mon.noname-b con 0x7f63c40a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c9189640 10 monclient(hunting): picked mon.noname-f con 0x7f63c40a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c9189640 10 monclient(hunting): picked mon.noname-c con 0x7f63c413f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c9189640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c40a5fe0 con 0x7f63c40a6ab0 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c9189640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c40a8080 con 0x7f63c40a66d0 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c9189640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c40a42c0 con 0x7f63c413f9a0 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c9189640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c9189640 10 monclient(hunting): authenticate will time out at 1061.014512s 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c2d9d640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f63c40a66d0 0x7f63c40a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:59262/0 (socket says 172.21.15.181:59262) 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c2d9d640 1 -- 172.21.15.181:0/1680475375 learned_addr learned my addr 172.21.15.181:0/1680475375 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.508+0000 7f63c359e640 1 --1- 172.21.15.181:0/1680475375 >> v1:172.21.15.181:6791/0 conn(0x7f63c413f9a0 0x7f63c4141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42668/0 (socket says 172.21.15.181:42668) 2024-09-13T10:35:21.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c359e640 1 -- 172.21.15.181:0/1680475375 >> v1:172.21.15.181:6791/0 conn(0x7f63c413f9a0 legacy=0x7f63c4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c2d9d640 1 -- 172.21.15.181:0/1680475375 >> v1:172.21.15.181:6790/0 conn(0x7f63c40a66d0 legacy=0x7f63c40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c1d9b640 1 -- 172.21.15.181:0/1680475375 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3759570964 0 0) 0x7f63c40a8080 con 0x7f63c40a66d0 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c1d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c1d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c1d9b640 10 monclient(hunting): my global_id is 94493 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c1d9b640 1 -- 172.21.15.181:0/1680475375 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63ac003520 con 0x7f63c40a66d0 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c1d9b640 1 -- 172.21.15.181:0/1680475375 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 452432682 0 0) 0x7f63c40a42c0 con 0x7f63c413f9a0 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c1d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c1d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c1d9b640 10 monclient(hunting): my global_id is 6223 2024-09-13T10:35:21.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c1d9b640 1 -- 172.21.15.181:0/1680475375 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63c40a8080 con 0x7f63c413f9a0 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.510+0000 7f63c259c640 1 -- 172.21.15.181:0/1680475375 >> v1:172.21.15.195:6789/0 conn(0x7f63c40a6ab0 legacy=0x7f63c40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 1 -- 172.21.15.181:0/1680475375 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2568586209 0 0) 0x7f63ac003520 con 0x7f63c40a66d0 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 1 -- 172.21.15.181:0/1680475375 >> v1:172.21.15.181:6791/0 conn(0x7f63c413f9a0 legacy=0x7f63c4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 1 -- 172.21.15.181:0/1680475375 >> v1:172.21.15.195:6789/0 conn(0x7f63c40a6ab0 legacy=0x7f63c40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 1 monclient: found mon.noname-b 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 1 -- 172.21.15.181:0/1680475375 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c41464e0 con 0x7f63c40a66d0 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 10 monclient: _finish_auth 0 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 1 -- 172.21.15.181:0/1680475375 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63b4001ba0 con 0x7f63c40a66d0 2024-09-13T10:35:21.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 10 monclient: dump: 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.518 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c9189640 5 monclient: authenticate success, global_id 94493 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c9189640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 1 -- 172.21.15.181:0/1680475375 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63b40048a0 con 0x7f63c40a66d0 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c9189640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 1 -- 172.21.15.181:0/1680475375 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63b4001d40 con 0x7f63c40a66d0 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c9189640 4 set_mon_vals no callback set 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c1d9b640 10 monclient: dump: 2024-09-13T10:35:21.519 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.520 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.520 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.520 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.520 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.520 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.520 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.520 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.520 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.520 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.520 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c9189640 10 monclient: shutdown 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c9189640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c9189640 1 -- 172.21.15.181:0/1680475375 >> v1:172.21.15.181:6790/0 conn(0x7f63c40a66d0 legacy=0x7f63c40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c9189640 1 -- 172.21.15.181:0/1680475375 shutdown_connections 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c9189640 1 -- 172.21.15.181:0/1680475375 >> 172.21.15.181:0/1680475375 conn(0x7f63c40abcd0 msgr2=0x7f63c40ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c9189640 1 -- 172.21.15.181:0/1680475375 shutdown_connections 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.511+0000 7f63c9189640 1 -- 172.21.15.181:0/1680475375 wait complete. 2024-09-13T10:35:21.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.512+0000 7f63c9189640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.512+0000 7f63c9189640 10 monclient: monmap: 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.522 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.523 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.523 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.523 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.512+0000 7f63c9189640 1 Processor -- start 2024-09-13T10:35:21.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c9189640 1 -- start start 2024-09-13T10:35:21.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c9189640 10 monclient: init 2024-09-13T10:35:21.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c9189640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c9189640 10 monclient: _add_conns ranks=[4,7,5,8,1,6,0,2,3] 2024-09-13T10:35:21.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c9189640 10 monclient(hunting): picked mon.noname-c con 0x7f63c40a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:21.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c9189640 10 monclient(hunting): picked mon.noname-i con 0x7f63c40a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:21.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c9189640 10 monclient(hunting): picked mon.noname-h con 0x7f63c413f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:21.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c9189640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c413e220 con 0x7f63c40a66d0 2024-09-13T10:35:21.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c9189640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c4068bd0 con 0x7f63c413f9a0 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c9189640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c413c1d0 con 0x7f63c40a6ab0 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c9189640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c9189640 10 monclient(hunting): authenticate will time out at 1061.019489s 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c2d9d640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f63c40a66d0 0x7f63c413b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42678/0 (socket says 172.21.15.181:42678) 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.513+0000 7f63c2d9d640 1 -- 172.21.15.181:0/185586705 learned_addr learned my addr 172.21.15.181:0/185586705 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.515+0000 7f63c2d9d640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.181:6791/0 conn(0x7f63c40a66d0 legacy=0x7f63c413b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.515+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2737134523 0 0) 0x7f63c413e220 con 0x7f63c40a66d0 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.515+0000 7f63ab7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.515+0000 7f63ab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.515+0000 7f63ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.515+0000 7f63ab7fe640 10 monclient(hunting): my global_id is 6232 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.515+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b0003520 con 0x7f63c40a66d0 2024-09-13T10:35:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.515+0000 7f63c259c640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.195:6792/0 conn(0x7f63c40a6ab0 legacy=0x7f63c413bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.515+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.515+0000 7f63c359e640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.195:6791/0 conn(0x7f63c413f9a0 legacy=0x7f63c41d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.517+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2676700729 0 0) 0x7f63b0003520 con 0x7f63c40a66d0 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63c413e220 con 0x7f63c40a66d0 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228271891 0 0) 0x7f63c413c1d0 con 0x7f63c40a6ab0 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient(hunting): my global_id is 56239 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b0003520 con 0x7f63c40a6ab0 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4110678248 0 0) 0x7f63c4068bd0 con 0x7f63c413f9a0 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient(hunting): my global_id is 104207 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63c413c1d0 con 0x7f63c413f9a0 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63b4001b60 con 0x7f63c40a66d0 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient(hunting): dump: 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.531 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2830264386 0 0) 0x7f63c413e220 con 0x7f63c40a66d0 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.195:6792/0 conn(0x7f63c40a6ab0 legacy=0x7f63c413bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.195:6791/0 conn(0x7f63c413f9a0 legacy=0x7f63c41d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 monclient: found mon.c 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c413cd30 con 0x7f63c40a66d0 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient: _finish_auth 0 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63c9189640 5 monclient: authenticate success, global_id 6232 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63c9189640 10 monclient: _renew_subs 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63c9189640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63c9189640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63c413f090 con 0x7f63c40a66d0 2024-09-13T10:35:21.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63c9189640 10 monclient: _renew_subs 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63c9189640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63c9189640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f63c41374e0 con 0x7f63c40a66d0 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63b4001d00 con 0x7f63c40a66d0 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63b4005650 con 0x7f63c40a66d0 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63c159a640 4 set_mon_vals no callback set 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.518+0000 7f63ab7fe640 10 monclient: dump: 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.534 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.519+0000 7f63c9189640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:21.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.519+0000 7f63c9189640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f63c40a3240 con 0x7f63c413fd80 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.519+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f63b4011cd0 con 0x7f63c40a66d0 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.519+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(173..173 src has 1..173) ==== 3506+0+0 (unknown 664712439 0 0) 0x7f63b404e370 con 0x7f63c40a66d0 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.519+0000 7f63c359e640 10 monclient: get_auth_request con 0x7f63b003fd80 auth_method 0 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63c259c640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.181:6792/0 conn(0x7f63c413fd80 legacy=0x7f63c4140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2187475193 0 0) 0x7f63c40a3240 con 0x7f63c413fd80 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63ab7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63ab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63ab7fe640 10 monclient(hunting): my global_id is 6153 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63c413e220 con 0x7f63c413fd80 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1918888995 0 0) 0x7f63c413e220 con 0x7f63c413fd80 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63c40a3240 con 0x7f63c413fd80 2024-09-13T10:35:21.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63b8001ba0 con 0x7f63c413fd80 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63ab7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.521+0000 7f63ab7fe640 10 monclient: dump: 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.537 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.538 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.538 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.538 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.538 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.538 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.522+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1690688344 0 0) 0x7f63c40a3240 con 0x7f63c413fd80 2024-09-13T10:35:21.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.522+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63c40a2a20 con 0x7f63c413fd80 2024-09-13T10:35:21.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.522+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f63b80057c0 con 0x7f63c413fd80 2024-09-13T10:35:21.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.522+0000 7f63ab7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:21.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.522+0000 7f63ab7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:21.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.522+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.181:6792/0 conn(0x7f63c413fd80 legacy=0x7f63c4140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.522+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.181:6792/0 conn(0x7f63c413fd80 legacy=0x7f63c4140160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:21.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.528+0000 7f63c9189640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:21.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.528+0000 7f63c9189640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f63c4069af0 con 0x7f63c4140870 2024-09-13T10:35:21.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.530+0000 7f63c259c640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.181:6792/0 conn(0x7f63c4140870 legacy=0x7f63c41dbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.530+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101467740 0 0) 0x7f63c4069af0 con 0x7f63c4140870 2024-09-13T10:35:21.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 10 monclient(hunting): my global_id is 6162 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63c40a3240 con 0x7f63c4140870 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2957140563 0 0) 0x7f63c40a3240 con 0x7f63c4140870 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63c4069af0 con 0x7f63c4140870 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f63b8003d40 con 0x7f63c4140870 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 10 monclient: dump: 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.541 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 465359775 0 0) 0x7f63c4069af0 con 0x7f63c4140870 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63c4140c50 con 0x7f63c4140870 2024-09-13T10:35:21.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 3127600097) 0x7f63b8005a70 con 0x7f63c4140870 2024-09-13T10:35:21.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:21.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:21.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.181:6792/0 conn(0x7f63c4140870 legacy=0x7f63c41dbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63ab7fe640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.181:6792/0 conn(0x7f63c4140870 legacy=0x7f63c41dbb80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:21.543 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:21.543 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:21.543 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:21.543 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:21.543 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:21.544 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 335975, 2024-09-13T10:35:21.544 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:21.544 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:21.544 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:21.544 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:21.544 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:21.544 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:21.544 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:21.544 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:21.544 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:21.544 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:21.544 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.545 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.546 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.546 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.546 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.546 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:21.546 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:21.546 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.546 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.546 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.546 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.546 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.546 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.547 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.547 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.547 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.547 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.547 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.547 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.547 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:21.547 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:21.548 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:21.548 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:21.548 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:21.548 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:21.548 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:21.548 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:21.548 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:21.548 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:21.548 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:21.548 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:21.548 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:21.548 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.549 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:21.551 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.553 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:21.553 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:21.553 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.553 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:21.553 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.553 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.553 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:21.554 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:21.554 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.554 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.554 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.554 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:21.554 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:21.554 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:21.556 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:21.557 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.557 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.557 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.557 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:21.557 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:21.557 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.557 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:21.558 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.559 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.560 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.560 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:21.560 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:21.560 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.560 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:21.560 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:21.561 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.562 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.563 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.564 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:21.564 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.564 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.564 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:21.564 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:21.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63c9189640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.195:6800/1839191919 conn(0x7f63b003fd80 legacy=0x7f63b0042240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63c9189640 10 monclient: shutdown 2024-09-13T10:35:21.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63c9189640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:21.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63c9189640 1 -- 172.21.15.181:0/185586705 >> v1:172.21.15.181:6791/0 conn(0x7f63c40a66d0 legacy=0x7f63c413b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63c359e640 1 -- 172.21.15.181:0/185586705 reap_dead start 2024-09-13T10:35:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.531+0000 7f63c359e640 1 -- 172.21.15.181:0/185586705 reap_dead start 2024-09-13T10:35:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.532+0000 7f63c9189640 1 -- 172.21.15.181:0/185586705 shutdown_connections 2024-09-13T10:35:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.532+0000 7f63c9189640 1 -- 172.21.15.181:0/185586705 >> 172.21.15.181:0/185586705 conn(0x7f63c40abcd0 msgr2=0x7f63c40a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.532+0000 7f63c9189640 1 -- 172.21.15.181:0/185586705 shutdown_connections 2024-09-13T10:35:21.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.532+0000 7f63c9189640 1 -- 172.21.15.181:0/185586705 wait complete. 2024-09-13T10:35:21.566 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:21.566 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:35:21.566 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:35:21.631 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1715267001}) 2024-09-13T10:35:21.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=222621279}) 2024-09-13T10:35:21.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1715267001}) 2024-09-13T10:35:21.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1724637219}) 2024-09-13T10:35:21.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1715267001}) 2024-09-13T10:35:21.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3247958756}) 2024-09-13T10:35:21.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1715267001}) 2024-09-13T10:35:21.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=486810601}) 2024-09-13T10:35:21.632 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1715267001}) 2024-09-13T10:35:21.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3069680370}) 2024-09-13T10:35:21.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1715267001}) 2024-09-13T10:35:21.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2635011023}) 2024-09-13T10:35:21.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1715267001}) 2024-09-13T10:35:21.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=654763474}) 2024-09-13T10:35:21.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1715267001}) 2024-09-13T10:35:21.633 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.629+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2824904696}) 2024-09-13T10:35:21.639 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.639 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1219522442}) 2024-09-13T10:35:21.639 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3653390492}) 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1219522442}) 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4031471665}) 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1219522442}) 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3393877506}) 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1219522442}) 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=922870004}) 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1219522442}) 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3521036542}) 2024-09-13T10:35:21.640 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1219522442}) 2024-09-13T10:35:21.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.636+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=117598004}) 2024-09-13T10:35:21.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.637+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.637+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1219522442}) 2024-09-13T10:35:21.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.637+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4183092717}) 2024-09-13T10:35:21.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.637+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.637+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1219522442}) 2024-09-13T10:35:21.641 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.637+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2037281502}) 2024-09-13T10:35:21.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.644 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2665450270}) 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1849552268}) 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2665450270}) 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2869355184}) 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2665450270}) 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3139540711}) 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2665450270}) 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3073441863}) 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2665450270}) 2024-09-13T10:35:21.645 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3361356160}) 2024-09-13T10:35:21.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2665450270}) 2024-09-13T10:35:21.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2049143188}) 2024-09-13T10:35:21.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2665450270}) 2024-09-13T10:35:21.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4288066729}) 2024-09-13T10:35:21.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2665450270}) 2024-09-13T10:35:21.646 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.642+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3484257918}) 2024-09-13T10:35:21.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.669+0000 7f1f23840640 10 monclient: get_monmap_and_config 2024-09-13T10:35:21.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.669+0000 7f1f23840640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.669+0000 7f1f23840640 10 monclient: monmap: 2024-09-13T10:35:21.672 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.672 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.672 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:21.671273+0000 2024-09-13T10:35:21.672 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:21.671273+0000 2024-09-13T10:35:21.672 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.672 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.672 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.673 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.673 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.673 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.673 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.673 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.673 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.673 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.673 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.673 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 1 Processor -- start 2024-09-13T10:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 1 -- start start 2024-09-13T10:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 10 monclient: init 2024-09-13T10:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 10 monclient: _add_conns ranks=[0,2,1,3,5,4,8,7,6] 2024-09-13T10:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 10 monclient(hunting): picked mon.noname-a con 0x7f1f1c0a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 10 monclient(hunting): picked mon.noname-b con 0x7f1f1c0a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 10 monclient(hunting): picked mon.noname-f con 0x7f1f1c13f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c0a4bc0 con 0x7f1f1c0a6640 2024-09-13T10:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c13a320 con 0x7f1f1c13f750 2024-09-13T10:35:21.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c0a8100 con 0x7f1f1c0a8340 2024-09-13T10:35:21.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.670+0000 7f1f23840640 10 monclient(hunting): authenticate will time out at 1061.176963s 2024-09-13T10:35:21.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.671+0000 7f1f215dc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1f1c0a6640 0x7f1f1c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43580/0 (socket says 172.21.15.181:43580) 2024-09-13T10:35:21.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.671+0000 7f1f20ddb640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f1f1c0a8340 0x7f1f1c139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:59276/0 (socket says 172.21.15.181:59276) 2024-09-13T10:35:21.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.671+0000 7f1f215dc640 1 -- 172.21.15.181:0/3443063914 learned_addr learned my addr 172.21.15.181:0/3443063914 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f215dc640 1 -- 172.21.15.181:0/3443063914 >> v1:172.21.15.181:6789/0 conn(0x7f1f1c0a6640 legacy=0x7f1f1c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f20ddb640 1 -- 172.21.15.181:0/3443063914 >> v1:172.21.15.181:6790/0 conn(0x7f1f1c0a8340 legacy=0x7f1f1c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 1 -- 172.21.15.181:0/3443063914 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231892475 0 0) 0x7f1f1c0a8100 con 0x7f1f1c0a8340 2024-09-13T10:35:21.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient(hunting): my global_id is 94502 2024-09-13T10:35:21.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 1 -- 172.21.15.181:0/3443063914 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f08003520 con 0x7f1f1c0a8340 2024-09-13T10:35:21.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 1 -- 172.21.15.181:0/3443063914 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136350959 0 0) 0x7f1f1c0a4bc0 con 0x7f1f1c0a6640 2024-09-13T10:35:21.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient(hunting): my global_id is 104238 2024-09-13T10:35:21.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 1 -- 172.21.15.181:0/3443063914 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f1c0a8100 con 0x7f1f1c0a6640 2024-09-13T10:35:21.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f21ddd640 1 -- 172.21.15.181:0/3443063914 >> v1:172.21.15.195:6789/0 conn(0x7f1f1c13f750 legacy=0x7f1f1c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 1 -- 172.21.15.181:0/3443063914 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 25824621 0 0) 0x7f1f08003520 con 0x7f1f1c0a8340 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 1 -- 172.21.15.181:0/3443063914 >> v1:172.21.15.195:6789/0 conn(0x7f1f1c13f750 legacy=0x7f1f1c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 1 -- 172.21.15.181:0/3443063914 >> v1:172.21.15.181:6789/0 conn(0x7f1f1c0a6640 legacy=0x7f1f1c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient: _finish_hunting 0 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 1 monclient: found mon.noname-b 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 1 -- 172.21.15.181:0/3443063914 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c0a48e0 con 0x7f1f1c0a8340 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient: _finish_auth 0 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient: _check_auth_tickets 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f23840640 5 monclient: authenticate success, global_id 94502 2024-09-13T10:35:21.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 1 -- 172.21.15.181:0/3443063914 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f0c001ae0 con 0x7f1f1c0a8340 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient: dump: 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.682 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f23840640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 1 -- 172.21.15.181:0/3443063914 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f0c0047e0 con 0x7f1f1c0a8340 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 1 -- 172.21.15.181:0/3443063914 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f0c004cd0 con 0x7f1f1c0a8340 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f23840640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f23840640 4 set_mon_vals no callback set 2024-09-13T10:35:21.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:21.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.673+0000 7f1f13fff640 10 monclient: dump: 2024-09-13T10:35:21.684 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.684 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.684 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.684 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.684 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.684 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.684 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.684 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.684 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.684 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.674+0000 7f1f23840640 10 monclient: shutdown 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.674+0000 7f1f23840640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.674+0000 7f1f23840640 1 -- 172.21.15.181:0/3443063914 >> v1:172.21.15.181:6790/0 conn(0x7f1f1c0a8340 legacy=0x7f1f1c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.674+0000 7f1f23840640 1 -- 172.21.15.181:0/3443063914 shutdown_connections 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.674+0000 7f1f23840640 1 -- 172.21.15.181:0/3443063914 >> 172.21.15.181:0/3443063914 conn(0x7f1f1c077170 msgr2=0x7f1f1c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.674+0000 7f1f23840640 1 -- 172.21.15.181:0/3443063914 shutdown_connections 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.674+0000 7f1f23840640 1 -- 172.21.15.181:0/3443063914 wait complete. 2024-09-13T10:35:21.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.674+0000 7f1f23840640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.674+0000 7f1f23840640 10 monclient: monmap: 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.686 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 1 Processor -- start 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 1 -- start start 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 10 monclient: init 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 10 monclient: _add_conns ranks=[0,2,8,6,7,4,1,3,5] 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 10 monclient(hunting): picked mon.noname-a con 0x7f1f1c0a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 10 monclient(hunting): picked mon.noname-b con 0x7f1f1c13f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 10 monclient(hunting): picked mon.noname-e con 0x7f1f1c13ca50 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c13d500 con 0x7f1f1c0a8340 2024-09-13T10:35:21.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c1cf0f0 con 0x7f1f1c13f750 2024-09-13T10:35:21.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c139220 con 0x7f1f1c13ca50 2024-09-13T10:35:21.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f20ddb640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f1f1c13f750 0x7f1f1c1ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:59284/0 (socket says 172.21.15.181:59284) 2024-09-13T10:35:21.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f215dc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1f1c0a8340 0x7f1f1c1ce2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43586/0 (socket says 172.21.15.181:43586) 2024-09-13T10:35:21.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f20ddb640 1 -- 172.21.15.181:0/67043579 learned_addr learned my addr 172.21.15.181:0/67043579 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.675+0000 7f1f23840640 10 monclient(hunting): authenticate will time out at 1061.181891s 2024-09-13T10:35:21.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f215dc640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.181:6789/0 conn(0x7f1f1c0a8340 legacy=0x7f1f1c1ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f20ddb640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.181:6790/0 conn(0x7f1f1c13f750 legacy=0x7f1f1c1ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f21ddd640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.181:6793/0 conn(0x7f1f1c13ca50 legacy=0x7f1f1c1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8198277 0 0) 0x7f1f1c1cf0f0 con 0x7f1f1c13f750 2024-09-13T10:35:21.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): my global_id is 94511 2024-09-13T10:35:21.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f00003550 con 0x7f1f1c13f750 2024-09-13T10:35:21.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202219887 0 0) 0x7f1f1c13d500 con 0x7f1f1c0a8340 2024-09-13T10:35:21.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): my global_id is 104247 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f1c1cf0f0 con 0x7f1f1c0a8340 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175802463 0 0) 0x7f1f1c139220 con 0x7f1f1c13ca50 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): my global_id is 104255 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f1c13d500 con 0x7f1f1c13ca50 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3134299230 0 0) 0x7f1f00003550 con 0x7f1f1c13f750 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f1c139220 con 0x7f1f1c13f750 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1251843234 0 0) 0x7f1f1c1cf0f0 con 0x7f1f1c0a8340 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f00003550 con 0x7f1f1c0a8340 2024-09-13T10:35:21.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f0c004cd0 con 0x7f1f1c13f750 2024-09-13T10:35:21.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:35:21.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): dump: 2024-09-13T10:35:21.695 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.695 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.695 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.695 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.695 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.695 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.695 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.695 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.695 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1035095709 0 0) 0x7f1f1c13d500 con 0x7f1f1c13ca50 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f1c1cf0f0 con 0x7f1f1c13ca50 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f18001320 con 0x7f1f1c0a8340 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:21.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): dump: 2024-09-13T10:35:21.697 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.697 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.697 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.697 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.697 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.697 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.697 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.697 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.697 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f14001f60 con 0x7f1f1c13ca50 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient(hunting): dump: 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.698 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3439367137 0 0) 0x7f1f1c139220 con 0x7f1f1c13f750 2024-09-13T10:35:21.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.181:6793/0 conn(0x7f1f1c13ca50 legacy=0x7f1f1c1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.181:6789/0 conn(0x7f1f1c0a8340 legacy=0x7f1f1c1ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:35:21.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 monclient: found mon.b 2024-09-13T10:35:21.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:21.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:35:21.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c142ed0 con 0x7f1f1c13f750 2024-09-13T10:35:21.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient: _finish_auth 0 2024-09-13T10:35:21.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:35:21.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:21.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f23840640 5 monclient: authenticate success, global_id 94511 2024-09-13T10:35:21.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f23840640 10 monclient: _renew_subs 2024-09-13T10:35:21.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f23840640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:35:21.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f23840640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c13e060 con 0x7f1f1c13f750 2024-09-13T10:35:21.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f0c0052c0 con 0x7f1f1c13f750 2024-09-13T10:35:21.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:21.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f0c001b60 con 0x7f1f1c13f750 2024-09-13T10:35:21.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:21.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f11ffb640 10 monclient: dump: 2024-09-13T10:35:21.701 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.701 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.701 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.701 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f137fe640 4 set_mon_vals no callback set 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f23840640 10 monclient: _renew_subs 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f23840640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.678+0000 7f1f23840640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1f1c13e720 con 0x7f1f1c13f750 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.679+0000 7f1f23840640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.679+0000 7f1f23840640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1f1c1344a0 con 0x7f1f1c077170 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.679+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1f0c011c90 con 0x7f1f1c13f750 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.680+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(174..174 src has 1..174) ==== 3898+0+0 (unknown 3187678074 0 0) 0x7f1f0c04e390 con 0x7f1f1c13f750 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.680+0000 7f1f21ddd640 10 monclient: get_auth_request con 0x7f1f00040800 auth_method 0 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f215dc640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.181:6793/0 conn(0x7f1f1c077170 legacy=0x7f1f1c130680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841594603 0 0) 0x7f1f1c1344a0 con 0x7f1f1c077170 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 10 monclient(hunting): my global_id is 104264 2024-09-13T10:35:21.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f1c139220 con 0x7f1f1c077170 2024-09-13T10:35:21.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2456170664 0 0) 0x7f1f1c139220 con 0x7f1f1c077170 2024-09-13T10:35:21.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f1c1344a0 con 0x7f1f1c077170 2024-09-13T10:35:21.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f180050d0 con 0x7f1f1c077170 2024-09-13T10:35:21.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:21.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 10 monclient: dump: 2024-09-13T10:35:21.704 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.704 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.704 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.705 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 266819294 0 0) 0x7f1f1c1344a0 con 0x7f1f1c077170 2024-09-13T10:35:21.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.682+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f1c13ce30 con 0x7f1f1c077170 2024-09-13T10:35:21.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.683+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1f180073b0 con 0x7f1f1c077170 2024-09-13T10:35:21.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.683+0000 7f1f11ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:21.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.683+0000 7f1f11ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:21.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.683+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.181:6793/0 conn(0x7f1f1c077170 legacy=0x7f1f1c130680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.683+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.181:6793/0 conn(0x7f1f1c077170 legacy=0x7f1f1c130680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:21.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.689+0000 7f1f23840640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:21.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.689+0000 7f1f23840640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1f1c143200 con 0x7f1f1c069b40 2024-09-13T10:35:21.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f215dc640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.181:6793/0 conn(0x7f1f1c069b40 legacy=0x7f1f1c130d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 195472725 0 0) 0x7f1f1c143200 con 0x7f1f1c069b40 2024-09-13T10:35:21.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 10 monclient(hunting): my global_id is 104273 2024-09-13T10:35:21.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f1c1344a0 con 0x7f1f1c069b40 2024-09-13T10:35:21.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1718609414 0 0) 0x7f1f1c1344a0 con 0x7f1f1c069b40 2024-09-13T10:35:21.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f1c143200 con 0x7f1f1c069b40 2024-09-13T10:35:21.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f18005a30 con 0x7f1f1c069b40 2024-09-13T10:35:21.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 10 monclient: dump: 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.709 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.710 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.710 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.710 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.710 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2928716006 0 0) 0x7f1f1c143200 con 0x7f1f1c069b40 2024-09-13T10:35:21.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.691+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1f1c1314a0 con 0x7f1f1c069b40 2024-09-13T10:35:21.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7557 (unknown 0 0 3609309372) 0x7f1f18007040 con 0x7f1f1c069b40 2024-09-13T10:35:21.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f11ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:21.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f11ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:21.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.181:6793/0 conn(0x7f1f1c069b40 legacy=0x7f1f1c130d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f11ffb640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.181:6793/0 conn(0x7f1f1c069b40 legacy=0x7f1f1c130d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:21.711 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:21.711 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:21.711 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:21.711 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:21.711 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:21.711 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 5394, 2024-09-13T10:35:21.711 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:21.711 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:21.711 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:21.711 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:21.711 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:21.711 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:21.712 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:21.712 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:21.712 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:21.712 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:21.712 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.712 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:35:21.712 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:21.712 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:21.712 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:21.712 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.712 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.712 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.713 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:21.714 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:21.715 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.716 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:21.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:21.718 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.718 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.718 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.718 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:21.718 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:21.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:21.721 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:21.721 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.721 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.721 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.721 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:21.721 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:21.721 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.721 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.722 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:21.723 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:21.727 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.728 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.729 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.730 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:21.731 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:21.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f23840640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1f00040800 legacy=0x7f1f00042cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f23840640 10 monclient: shutdown 2024-09-13T10:35:21.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f23840640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:21.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f23840640 1 -- 172.21.15.181:0/67043579 >> v1:172.21.15.181:6790/0 conn(0x7f1f1c13f750 legacy=0x7f1f1c1ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f21ddd640 1 -- 172.21.15.181:0/67043579 reap_dead start 2024-09-13T10:35:21.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f21ddd640 1 -- 172.21.15.181:0/67043579 reap_dead start 2024-09-13T10:35:21.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f23840640 1 -- 172.21.15.181:0/67043579 shutdown_connections 2024-09-13T10:35:21.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f23840640 1 -- 172.21.15.181:0/67043579 >> 172.21.15.181:0/67043579 conn(0x7f1f1c0a6640 msgr2=0x7f1f1c0a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:21.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f23840640 1 -- 172.21.15.181:0/67043579 shutdown_connections 2024-09-13T10:35:21.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.692+0000 7f1f23840640 1 -- 172.21.15.181:0/67043579 wait complete. 2024-09-13T10:35:21.733 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:21.733 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:35:21.733 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:35:21.753 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.753 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4236709170}) 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1793376180}) 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4236709170}) 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=751799243}) 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4236709170}) 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2335436380}) 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4236709170}) 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1963935976}) 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4236709170}) 2024-09-13T10:35:21.754 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1256674440}) 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4236709170}) 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2404463465}) 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4236709170}) 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1530623046}) 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4236709170}) 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.745+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4284146964}) 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3823621508}) 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3552351780}) 2024-09-13T10:35:21.755 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.756 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3823621508}) 2024-09-13T10:35:21.756 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2490712934}) 2024-09-13T10:35:21.756 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.756 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3823621508}) 2024-09-13T10:35:21.756 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1573781903}) 2024-09-13T10:35:21.756 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.756 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3823621508}) 2024-09-13T10:35:21.756 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2478062518}) 2024-09-13T10:35:21.756 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.756 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3823621508}) 2024-09-13T10:35:21.756 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1029260343}) 2024-09-13T10:35:21.756 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3823621508}) 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2907575706}) 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3823621508}) 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.746+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1383675515}) 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.747+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.747+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3823621508}) 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.747+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=950298765}) 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=2,osd_metadata=2} crc {logm=2529833073,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=446314538,mon_config_key=1720724073,monmap=2763160955,nvmeofgw=3140514009,osd_metadata=1984745035}) 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=54,mdsmap=3,mgr=7,mgr_command_descs=1,mgrstat=12,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=1} crc {logm=2521099699,mdsmap=2874252693,mgr=1942657901,mgr_command_descs=3192186153,mgrstat=2570524904,mon_config_key=647513981,monmap=2763160955,nvmeofgw=598337686,osd_metadata=812398120}) 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.757 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=2,osd_metadata=2} crc {logm=2529833073,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=446314538,mon_config_key=1720724073,monmap=2763160955,nvmeofgw=3140514009,osd_metadata=1984745035}) 2024-09-13T10:35:21.758 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=54,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=15,monmap=3,nvmeofgw=2,osd_metadata=3} crc {logm=2860690733,mdsmap=2874252694,mgr=1217433390,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=51118435,mon_config_key=1286216225,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=3882865394}) 2024-09-13T10:35:21.758 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.758 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=2,osd_metadata=2} crc {logm=2529833073,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=446314538,mon_config_key=1720724073,monmap=2763160955,nvmeofgw=3140514009,osd_metadata=1984745035}) 2024-09-13T10:35:21.758 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=57,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=15,monmap=3,nvmeofgw=1} crc {logm=3725158904,mdsmap=2874252693,mgr=1389828352,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2570524904,mon_config_key=1994674999,monmap=2763160955,nvmeofgw=773687688}) 2024-09-13T10:35:21.758 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.758 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=2,osd_metadata=2} crc {logm=2529833073,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=446314538,mon_config_key=1720724073,monmap=2763160955,nvmeofgw=3140514009,osd_metadata=1984745035}) 2024-09-13T10:35:21.758 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=16,monmap=3,nvmeofgw=3} crc {logm=301269145,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2570524904,mon_config_key=4205412538,monmap=2763160955,nvmeofgw=598337686}) 2024-09-13T10:35:21.758 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.760 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=2,osd_metadata=2} crc {logm=2529833073,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=446314538,mon_config_key=1720724073,monmap=2763160955,nvmeofgw=3140514009,osd_metadata=1984745035}) 2024-09-13T10:35:21.760 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=3} crc {logm=2960114320,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=4240939963,mon_config_key=2186132325,monmap=2763160955,nvmeofgw=598337686,osd_metadata=3882865394}) 2024-09-13T10:35:21.760 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.760 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=2,osd_metadata=2} crc {logm=2529833073,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=446314538,mon_config_key=1720724073,monmap=2763160955,nvmeofgw=3140514009,osd_metadata=1984745035}) 2024-09-13T10:35:21.760 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=17,monmap=3,nvmeofgw=1} crc {logm=2665919313,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1034881802,mon_config_key=4256284388,monmap=2763160955,nvmeofgw=773687688}) 2024-09-13T10:35:21.760 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.760 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=2,osd_metadata=2} crc {logm=2529833073,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=446314538,mon_config_key=1720724073,monmap=2763160955,nvmeofgw=3140514009,osd_metadata=1984745035}) 2024-09-13T10:35:21.760 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=54,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=16,monmap=2,nvmeofgw=3,osd_metadata=2} crc {logm=2792174486,mdsmap=3140514009,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1034881802,mon_config_key=3801316187,monmap=2232244610,nvmeofgw=598337686,osd_metadata=1984745035}) 2024-09-13T10:35:21.760 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.760 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=55,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=2,osd_metadata=2} crc {logm=2529833073,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=446314538,mon_config_key=1720724073,monmap=2763160955,nvmeofgw=3140514009,osd_metadata=1984745035}) 2024-09-13T10:35:21.760 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.748+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=54,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=17,monmap=2,nvmeofgw=2,osd_metadata=2} crc {logm=3000096450,mdsmap=3985170090,mgr=2043909638,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1595269724,mon_config_key=4256284388,monmap=2232244610,nvmeofgw=1596038039,osd_metadata=1984745035}) 2024-09-13T10:35:21.760 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.761 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=1497255328}) 2024-09-13T10:35:21.761 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=3424950110}) 2024-09-13T10:35:21.761 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.761 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=1497255328}) 2024-09-13T10:35:21.761 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osd_snap=2,osdmap=94} crc {osd_metadata=407322943,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=1903652977}) 2024-09-13T10:35:21.761 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.761 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=1497255328}) 2024-09-13T10:35:21.761 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_metadata=4,osd_snap=2,osdmap=94} crc {osd_metadata=1410061313,osd_snap=4133920409,osdmap=125365485}) 2024-09-13T10:35:21.761 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.761 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=1497255328}) 2024-09-13T10:35:21.761 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=2447994267}) 2024-09-13T10:35:21.762 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.762 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=1497255328}) 2024-09-13T10:35:21.762 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=184302933}) 2024-09-13T10:35:21.762 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.749+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.762 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.750+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=1497255328}) 2024-09-13T10:35:21.762 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.750+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=2529672124}) 2024-09-13T10:35:21.762 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.750+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.762 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.750+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=1497255328}) 2024-09-13T10:35:21.762 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.750+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=1862034239}) 2024-09-13T10:35:21.762 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.750+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.762 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.750+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=1497255328}) 2024-09-13T10:35:21.762 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.750+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=93} crc {osd_metadata=1410061313,osd_pg_creating=3756711068,osd_snap=4133920409,osdmap=1405210714}) 2024-09-13T10:35:21.765 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.765 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2045335511}) 2024-09-13T10:35:21.765 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=747530802}) 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2045335511}) 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3317043813}) 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2045335511}) 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4265643949}) 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2045335511}) 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=2738861718}) 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2045335511}) 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=3142783756}) 2024-09-13T10:35:21.766 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2045335511}) 2024-09-13T10:35:21.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=673856584}) 2024-09-13T10:35:21.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2045335511}) 2024-09-13T10:35:21.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1168380087}) 2024-09-13T10:35:21.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2045335511}) 2024-09-13T10:35:21.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.762+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=1973992151}) 2024-09-13T10:35:21.771 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.771 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=70} crc {osdmap=3332632592}) 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=67} crc {osdmap=1227556798}) 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=70} crc {osdmap=3332632592}) 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=71} crc {osdmap=2229297262}) 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=70} crc {osdmap=3332632592}) 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=71} crc {osdmap=2805255315}) 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=70} crc {osdmap=3332632592}) 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=71} crc {osdmap=488701738}) 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=70} crc {osdmap=3332632592}) 2024-09-13T10:35:21.772 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=70} crc {osdmap=486844656}) 2024-09-13T10:35:21.773 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.773 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=70} crc {osdmap=3332632592}) 2024-09-13T10:35:21.773 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=68} crc {osdmap=1577970963}) 2024-09-13T10:35:21.773 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.773 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=70} crc {osdmap=3332632592}) 2024-09-13T10:35:21.773 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=71} crc {osdmap=712357567}) 2024-09-13T10:35:21.773 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:35:21.773 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=70} crc {osdmap=3332632592}) 2024-09-13T10:35:21.773 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:35:21.768+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=70} crc {osdmap=215204993}) 2024-09-13T10:35:21.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.833+0000 7f7349753640 10 monclient: get_monmap_and_config 2024-09-13T10:35:21.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.833+0000 7f7349753640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.833+0000 7f7349753640 10 monclient: monmap: 2024-09-13T10:35:21.835 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.835 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:21.834733+0000 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:21.834733+0000 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.836 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.833+0000 7f7349753640 1 Processor -- start 2024-09-13T10:35:21.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.833+0000 7f7349753640 1 -- start start 2024-09-13T10:35:21.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.833+0000 7f7349753640 10 monclient: init 2024-09-13T10:35:21.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f7349753640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f7349753640 10 monclient: _add_conns ranks=[1,4,0,8,7,2,6,5,3] 2024-09-13T10:35:21.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f7349753640 10 monclient(hunting): picked mon.noname-f con 0x7f73440a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:21.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f7349753640 10 monclient(hunting): picked mon.noname-c con 0x7f73440a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:21.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f7349753640 10 monclient(hunting): picked mon.noname-a con 0x7f734413f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:21.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f7349753640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73440a5fe0 con 0x7f734413f9a0 2024-09-13T10:35:21.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f7349753640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73440a8080 con 0x7f73440a66d0 2024-09-13T10:35:21.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f7349753640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73440a42c0 con 0x7f73440a6ab0 2024-09-13T10:35:21.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f7349753640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f7349753640 10 monclient(hunting): authenticate will time out at 1061.340299s 2024-09-13T10:35:21.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f73427fc640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f73440a6ab0 0x7f73440a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42688/0 (socket says 172.21.15.181:42688) 2024-09-13T10:35:21.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f73427fc640 1 -- 172.21.15.181:0/3041149695 learned_addr learned my addr 172.21.15.181:0/3041149695 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.834+0000 7f73437fe640 1 --1- 172.21.15.181:0/3041149695 >> v1:172.21.15.181:6789/0 conn(0x7f734413f9a0 0x7f7344141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43596/0 (socket says 172.21.15.181:43596) 2024-09-13T10:35:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f73437fe640 1 -- 172.21.15.181:0/3041149695 >> v1:172.21.15.181:6789/0 conn(0x7f734413f9a0 legacy=0x7f7344141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f73427fc640 1 -- 172.21.15.181:0/3041149695 >> v1:172.21.15.181:6791/0 conn(0x7f73440a6ab0 legacy=0x7f73440a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 1 -- 172.21.15.181:0/3041149695 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643098861 0 0) 0x7f73440a5fe0 con 0x7f734413f9a0 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient(hunting): my global_id is 104256 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 1 -- 172.21.15.181:0/3041149695 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f732c003520 con 0x7f734413f9a0 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 1 -- 172.21.15.181:0/3041149695 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656122058 0 0) 0x7f73440a42c0 con 0x7f73440a6ab0 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient(hunting): my global_id is 6241 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 1 -- 172.21.15.181:0/3041149695 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73440a5fe0 con 0x7f73440a6ab0 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7342ffd640 1 -- 172.21.15.181:0/3041149695 >> v1:172.21.15.195:6789/0 conn(0x7f73440a66d0 legacy=0x7f73440a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 1 -- 172.21.15.181:0/3041149695 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 509143126 0 0) 0x7f732c003520 con 0x7f734413f9a0 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 1 -- 172.21.15.181:0/3041149695 >> v1:172.21.15.181:6791/0 conn(0x7f73440a6ab0 legacy=0x7f73440a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 1 -- 172.21.15.181:0/3041149695 >> v1:172.21.15.195:6789/0 conn(0x7f73440a66d0 legacy=0x7f73440a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 1 monclient: found mon.noname-a 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 1 -- 172.21.15.181:0/3041149695 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73441464e0 con 0x7f734413f9a0 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient: _finish_auth 0 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7349753640 5 monclient: authenticate success, global_id 104256 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 1 -- 172.21.15.181:0/3041149695 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f733c001ad0 con 0x7f734413f9a0 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7349753640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:21.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.836+0000 7f7341ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7341ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7341ffb640 10 monclient: dump: 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.845 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7349753640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7341ffb640 1 -- 172.21.15.181:0/3041149695 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f733c0047e0 con 0x7f734413f9a0 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7341ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7341ffb640 1 -- 172.21.15.181:0/3041149695 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f733c004d10 con 0x7f734413f9a0 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7349753640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7349753640 4 set_mon_vals no callback set 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7341ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7341ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:21.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7341ffb640 10 monclient: dump: 2024-09-13T10:35:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.847 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.848 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7349753640 10 monclient: shutdown 2024-09-13T10:35:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7349753640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7349753640 1 -- 172.21.15.181:0/3041149695 >> v1:172.21.15.181:6789/0 conn(0x7f734413f9a0 legacy=0x7f7344141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7349753640 1 -- 172.21.15.181:0/3041149695 shutdown_connections 2024-09-13T10:35:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7349753640 1 -- 172.21.15.181:0/3041149695 >> 172.21.15.181:0/3041149695 conn(0x7f73440abcd0 msgr2=0x7f73440ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7349753640 1 -- 172.21.15.181:0/3041149695 shutdown_connections 2024-09-13T10:35:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.837+0000 7f7349753640 1 -- 172.21.15.181:0/3041149695 wait complete. 2024-09-13T10:35:21.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.838+0000 7f7349753640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.838+0000 7f7349753640 10 monclient: monmap: 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.849 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.838+0000 7f7349753640 1 Processor -- start 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.838+0000 7f7349753640 1 -- start start 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.838+0000 7f7349753640 10 monclient: init 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.839+0000 7f7349753640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.839+0000 7f7349753640 10 monclient: _add_conns ranks=[5,8,7,0,3,1,4,6,2] 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.839+0000 7f7349753640 10 monclient(hunting): picked mon.noname-h con 0x7f73440a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.839+0000 7f7349753640 10 monclient(hunting): picked mon.noname-e con 0x7f73440a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.839+0000 7f7349753640 10 monclient(hunting): picked mon.noname-i con 0x7f734413f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:21.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.839+0000 7f7349753640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734413ec40 con 0x7f73440a66d0 2024-09-13T10:35:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.839+0000 7f7349753640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734413ef20 con 0x7f734413f9a0 2024-09-13T10:35:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.839+0000 7f7349753640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73441392c0 con 0x7f73440a6ab0 2024-09-13T10:35:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.839+0000 7f7349753640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.839+0000 7f7349753640 10 monclient(hunting): authenticate will time out at 1061.345314s 2024-09-13T10:35:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.839+0000 7f73427fc640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f73440a6ab0 0x7f73441d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54584/0 (socket says 172.21.15.181:54584) 2024-09-13T10:35:21.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.839+0000 7f73427fc640 1 -- 172.21.15.181:0/3388189765 learned_addr learned my addr 172.21.15.181:0/3388189765 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f73427fc640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.181:6793/0 conn(0x7f73440a6ab0 legacy=0x7f73441d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f7342ffd640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.195:6791/0 conn(0x7f73440a66d0 legacy=0x7f73441ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f73437fe640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.195:6792/0 conn(0x7f734413f9a0 legacy=0x7f73441d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466135804 0 0) 0x7f73441392c0 con 0x7f73440a6ab0 2024-09-13T10:35:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): my global_id is 104282 2024-09-13T10:35:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7330003520 con 0x7f73440a6ab0 2024-09-13T10:35:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 160354753 0 0) 0x7f7330003520 con 0x7f73440a6ab0 2024-09-13T10:35:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73441392c0 con 0x7f73440a6ab0 2024-09-13T10:35:21.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7338001940 con 0x7f73440a6ab0 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): dump: 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.857 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062226715 0 0) 0x7f734413ec40 con 0x7f73440a66d0 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): my global_id is 104216 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7330003520 con 0x7f73440a66d0 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494544714 0 0) 0x7f734413ef20 con 0x7f734413f9a0 2024-09-13T10:35:21.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 10 monclient(hunting): my global_id is 56248 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.841+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f734413ec40 con 0x7f734413f9a0 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3391887522 0 0) 0x7f73441392c0 con 0x7f73440a6ab0 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.195:6792/0 conn(0x7f734413f9a0 legacy=0x7f73441d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.195:6791/0 conn(0x7f73440a66d0 legacy=0x7f73441ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 1 monclient: found mon.e 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7344068e00 con 0x7f73440a6ab0 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:35:21.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f7349753640 5 monclient: authenticate success, global_id 104282 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f7349753640 10 monclient: _renew_subs 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f7349753640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f7349753640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7344068a40 con 0x7f73440a6ab0 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f7349753640 10 monclient: _renew_subs 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f7349753640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f7349753640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f734413d580 con 0x7f73440a6ab0 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7338004dd0 con 0x7f73440a6ab0 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f73380052c0 con 0x7f73440a6ab0 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f73417fa640 4 set_mon_vals no callback set 2024-09-13T10:35:21.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.842+0000 7f732b7fe640 10 monclient: dump: 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.861 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.843+0000 7f7349753640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.843+0000 7f7349753640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f73240065c0 con 0x7f7324002860 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.843+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f73380119c0 con 0x7f73440a6ab0 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.843+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(174..174 src has 1..174) ==== 3898+0+0 (unknown 3187678074 0 0) 0x7f733804e490 con 0x7f73440a6ab0 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.843+0000 7f73437fe640 10 monclient: get_auth_request con 0x7f733003fc90 auth_method 0 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f7342ffd640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.195:6789/0 conn(0x7f7324002860 legacy=0x7f7324004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3813034682 0 0) 0x7f73240065c0 con 0x7f7324002860 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 10 monclient(hunting): my global_id is 56341 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73441392c0 con 0x7f7324002860 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3814317827 0 0) 0x7f73441392c0 con 0x7f7324002860 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73240065c0 con 0x7f7324002860 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7334002030 con 0x7f7324002860 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 10 monclient: dump: 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.863 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3304025867 0 0) 0x7f73240065c0 con 0x7f7324002860 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.845+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f732400a160 con 0x7f7324002860 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.846+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7334006bd0 con 0x7f7324002860 2024-09-13T10:35:21.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.846+0000 7f732b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:21.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.846+0000 7f732b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:21.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.846+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.195:6789/0 conn(0x7f7324002860 legacy=0x7f7324004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.846+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.195:6789/0 conn(0x7f7324002860 legacy=0x7f7324004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:21.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.852+0000 7f7349753640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:21.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.852+0000 7f7349753640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7324009e50 con 0x7f7324009110 2024-09-13T10:35:21.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f7342ffd640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.195:6789/0 conn(0x7f7324009110 legacy=0x7f73240095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3407764122 0 0) 0x7f7324009e50 con 0x7f7324009110 2024-09-13T10:35:21.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 10 monclient(hunting): my global_id is 56350 2024-09-13T10:35:21.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73240065c0 con 0x7f7324009110 2024-09-13T10:35:21.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2877195736 0 0) 0x7f73240065c0 con 0x7f7324009110 2024-09-13T10:35:21.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7324009e50 con 0x7f7324009110 2024-09-13T10:35:21.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f73340040c0 con 0x7f7324009110 2024-09-13T10:35:21.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:21.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:21.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 10 monclient: dump: 2024-09-13T10:35:21.868 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:21.868 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.868 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:21.869 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2201319255 0 0) 0x7f7324009e50 con 0x7f7324009110 2024-09-13T10:35:21.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f732400c3f0 con 0x7f7324009110 2024-09-13T10:35:21.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 1289681842) 0x7f73340043f0 con 0x7f7324009110 2024-09-13T10:35:21.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:21.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:21.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.195:6789/0 conn(0x7f7324009110 legacy=0x7f73240095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.855+0000 7f732b7fe640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.195:6789/0 conn(0x7f7324009110 legacy=0x7f73240095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:21.870 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:21.870 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:21.870 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:21.870 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:21.871 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:21.871 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 336265, 2024-09-13T10:35:21.871 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:21.871 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:21.871 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:21.871 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:21.871 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:21.871 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:21.871 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:21.871 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:21.871 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:21.871 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.872 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.873 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:21.874 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:21.875 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.876 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:21.877 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.878 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.879 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:21.879 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:21.879 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.879 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.879 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.879 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:21.879 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:21.879 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.879 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:21.881 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.882 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.883 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.884 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:21.886 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:21.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.888 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:21.889 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:21.890 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:35:21.890 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:21.890 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:21.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:21.890 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:21.890 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:21.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.856+0000 7f7349753640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.195:6800/1839191919 conn(0x7f733003fc90 legacy=0x7f7330042150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.856+0000 7f7349753640 10 monclient: shutdown 2024-09-13T10:35:21.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.856+0000 7f7349753640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:21.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.856+0000 7f7349753640 1 -- 172.21.15.181:0/3388189765 >> v1:172.21.15.181:6793/0 conn(0x7f73440a6ab0 legacy=0x7f73441d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:21.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.856+0000 7f73437fe640 1 -- 172.21.15.181:0/3388189765 reap_dead start 2024-09-13T10:35:21.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.856+0000 7f73437fe640 1 -- 172.21.15.181:0/3388189765 reap_dead start 2024-09-13T10:35:21.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.856+0000 7f7349753640 1 -- 172.21.15.181:0/3388189765 shutdown_connections 2024-09-13T10:35:21.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.856+0000 7f7349753640 1 -- 172.21.15.181:0/3388189765 >> 172.21.15.181:0/3388189765 conn(0x7f73440abcd0 msgr2=0x7f7344145ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:21.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.856+0000 7f7349753640 1 -- 172.21.15.181:0/3388189765 shutdown_connections 2024-09-13T10:35:21.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.856+0000 7f7349753640 1 -- 172.21.15.181:0/3388189765 wait complete. 2024-09-13T10:35:21.892 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:21.892 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:35:21.892 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.988+0000 7f1114aef640 10 monclient: get_monmap_and_config 2024-09-13T10:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.988+0000 7f1114aef640 10 monclient: build_initial_monmap 2024-09-13T10:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.988+0000 7f1114aef640 10 monclient: monmap: 2024-09-13T10:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:21.989745+0000 2024-09-13T10:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:21.989745+0000 2024-09-13T10:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:21.991 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.988+0000 7f1114aef640 1 Processor -- start 2024-09-13T10:35:21.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.988+0000 7f1114aef640 1 -- start start 2024-09-13T10:35:21.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.988+0000 7f1114aef640 10 monclient: init 2024-09-13T10:35:21.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.989+0000 7f1114aef640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:21.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.989+0000 7f1114aef640 10 monclient: _add_conns ranks=[0,5,7,6,4,8,1,3,2] 2024-09-13T10:35:21.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.989+0000 7f1114aef640 10 monclient(hunting): picked mon.noname-a con 0x7f11100a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:21.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.989+0000 7f1114aef640 10 monclient(hunting): picked mon.noname-h con 0x7f11100a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:21.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.989+0000 7f1114aef640 10 monclient(hunting): picked mon.noname-i con 0x7f111013f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:21.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.989+0000 7f1114aef640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11100a5fe0 con 0x7f11100a66d0 2024-09-13T10:35:21.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.989+0000 7f1114aef640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11100a8080 con 0x7f11100a6ab0 2024-09-13T10:35:21.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.989+0000 7f1114aef640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11100a42c0 con 0x7f111013f9a0 2024-09-13T10:35:21.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.989+0000 7f1114aef640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:21.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.989+0000 7f1114aef640 10 monclient(hunting): authenticate will time out at 1061.495449s 2024-09-13T10:35:21.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.989+0000 7f110e59c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f11100a66d0 0x7f11100a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43604/0 (socket says 172.21.15.181:43604) 2024-09-13T10:35:21.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.989+0000 7f110e59c640 1 -- 172.21.15.181:0/1036944602 learned_addr learned my addr 172.21.15.181:0/1036944602 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:21.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110e59c640 1 -- 172.21.15.181:0/1036944602 >> v1:172.21.15.181:6789/0 conn(0x7f11100a66d0 legacy=0x7f11100a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110dd9b640 1 -- 172.21.15.181:0/1036944602 >> v1:172.21.15.195:6791/0 conn(0x7f11100a6ab0 legacy=0x7f11100a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161929099 0 0) 0x7f11100a5fe0 con 0x7f11100a66d0 2024-09-13T10:35:21.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:21.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:21.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110d59a640 10 monclient(hunting): my global_id is 104265 2024-09-13T10:35:21.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10f8003520 con 0x7f11100a66d0 2024-09-13T10:35:21.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110ed9d640 1 -- 172.21.15.181:0/1036944602 >> v1:172.21.15.195:6792/0 conn(0x7f111013f9a0 legacy=0x7f1110141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:21.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858603358 0 0) 0x7f11100a8080 con 0x7f11100a6ab0 2024-09-13T10:35:21.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:35:21.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.991+0000 7f110d59a640 10 monclient(hunting): my global_id is 104225 2024-09-13T10:35:22.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11100a5fe0 con 0x7f11100a6ab0 2024-09-13T10:35:22.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924387270 0 0) 0x7f11100a42c0 con 0x7f111013f9a0 2024-09-13T10:35:22.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient(hunting): my global_id is 56257 2024-09-13T10:35:22.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11100a8080 con 0x7f111013f9a0 2024-09-13T10:35:22.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4109440813 0 0) 0x7f10f8003520 con 0x7f11100a66d0 2024-09-13T10:35:22.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 >> v1:172.21.15.195:6792/0 conn(0x7f111013f9a0 legacy=0x7f1110141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 >> v1:172.21.15.195:6791/0 conn(0x7f11100a6ab0 legacy=0x7f11100a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient: _finish_hunting 0 2024-09-13T10:35:22.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 1 monclient: found mon.noname-a 2024-09-13T10:35:22.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:22.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:35:22.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11101464e0 con 0x7f11100a66d0 2024-09-13T10:35:22.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient: _finish_auth 0 2024-09-13T10:35:22.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient: _check_auth_tickets 2024-09-13T10:35:22.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:22.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1100001ad0 con 0x7f11100a66d0 2024-09-13T10:35:22.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f1114aef640 5 monclient: authenticate success, global_id 104265 2024-09-13T10:35:22.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f1114aef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:22.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:35:22.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient: dump: 2024-09-13T10:35:22.002 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.002 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.002 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.002 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.002 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.002 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.002 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.002 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.002 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.003 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.003 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.003 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.003 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.003 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.003 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.003 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f1114aef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:22.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11000048a0 con 0x7f11100a66d0 2024-09-13T10:35:22.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:22.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 1 -- 172.21.15.181:0/1036944602 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1100004e10 con 0x7f11100a66d0 2024-09-13T10:35:22.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f1114aef640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:22.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f1114aef640 4 set_mon_vals no callback set 2024-09-13T10:35:22.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:35:22.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f110d59a640 10 monclient: dump: 2024-09-13T10:35:22.004 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.004 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.004 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.004 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.004 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.004 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.005 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.005 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.005 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.005 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.005 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.005 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.005 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.005 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.005 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.005 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f1114aef640 10 monclient: shutdown 2024-09-13T10:35:22.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f1114aef640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:22.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f1114aef640 1 -- 172.21.15.181:0/1036944602 >> v1:172.21.15.181:6789/0 conn(0x7f11100a66d0 legacy=0x7f11100a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f1114aef640 1 -- 172.21.15.181:0/1036944602 shutdown_connections 2024-09-13T10:35:22.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f1114aef640 1 -- 172.21.15.181:0/1036944602 >> 172.21.15.181:0/1036944602 conn(0x7f11100abcd0 msgr2=0x7f11100ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:22.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f1114aef640 1 -- 172.21.15.181:0/1036944602 shutdown_connections 2024-09-13T10:35:22.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.992+0000 7f1114aef640 1 -- 172.21.15.181:0/1036944602 wait complete. 2024-09-13T10:35:22.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.993+0000 7f1114aef640 10 monclient: build_initial_monmap 2024-09-13T10:35:22.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.993+0000 7f1114aef640 10 monclient: monmap: 2024-09-13T10:35:22.006 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:22.006 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:22.006 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:22.006 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:22.007 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:22.007 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:22.007 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:22.007 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:22.007 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:22.007 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:22.007 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:22.007 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:22.007 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:22.007 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:22.007 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:22.007 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.993+0000 7f1114aef640 1 Processor -- start 2024-09-13T10:35:22.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.993+0000 7f1114aef640 1 -- start start 2024-09-13T10:35:22.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.993+0000 7f1114aef640 10 monclient: init 2024-09-13T10:35:22.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.994+0000 7f1114aef640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:22.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.994+0000 7f1114aef640 10 monclient: _add_conns ranks=[6,8,3,4,2,1,7,5,0] 2024-09-13T10:35:22.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.994+0000 7f1114aef640 10 monclient(hunting): picked mon.noname-d con 0x7f11100a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:22.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.994+0000 7f1114aef640 10 monclient(hunting): picked mon.noname-e con 0x7f11100a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:22.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.994+0000 7f1114aef640 10 monclient(hunting): picked mon.noname-g con 0x7f111013f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:35:22.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.994+0000 7f1114aef640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11100a2a90 con 0x7f111013f9a0 2024-09-13T10:35:22.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.994+0000 7f1114aef640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11101cf210 con 0x7f11100a66d0 2024-09-13T10:35:22.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.994+0000 7f1114aef640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f111013ce80 con 0x7f11100a6ab0 2024-09-13T10:35:22.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.994+0000 7f1114aef640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:22.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.994+0000 7f1114aef640 10 monclient(hunting): authenticate will time out at 1061.500440s 2024-09-13T10:35:22.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.994+0000 7f110e59c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f11100a66d0 0x7f11101ce3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:40324/0 (socket says 172.21.15.181:40324) 2024-09-13T10:35:22.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.994+0000 7f110e59c640 1 -- 172.21.15.181:0/579265052 learned_addr learned my addr 172.21.15.181:0/579265052 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:22.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f110e59c640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.181:6792/0 conn(0x7f11100a66d0 legacy=0x7f11101ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f110dd9b640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.181:6793/0 conn(0x7f11100a6ab0 legacy=0x7f11101ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532652983 0 0) 0x7f111013ce80 con 0x7f11100a6ab0 2024-09-13T10:35:22.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 10 monclient(hunting): my global_id is 104291 2024-09-13T10:35:22.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10f0003520 con 0x7f11100a6ab0 2024-09-13T10:35:22.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105052831 0 0) 0x7f11101cf210 con 0x7f11100a66d0 2024-09-13T10:35:22.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 10 monclient(hunting): my global_id is 6171 2024-09-13T10:35:22.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f111013ce80 con 0x7f11100a66d0 2024-09-13T10:35:22.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f110ed9d640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.195:6790/0 conn(0x7f111013f9a0 legacy=0x7f11101d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2743887550 0 0) 0x7f10f0003520 con 0x7f11100a6ab0 2024-09-13T10:35:22.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.996+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11101cf210 con 0x7f11100a6ab0 2024-09-13T10:35:22.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1104003610 con 0x7f11100a6ab0 2024-09-13T10:35:22.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:22.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:35:22.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient(hunting): dump: 2024-09-13T10:35:22.017 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.017 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.017 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.017 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.017 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.017 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.017 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.017 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.018 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.018 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.018 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.018 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.018 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.018 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.018 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.018 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:22.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616609858 0 0) 0x7f11100a2a90 con 0x7f111013f9a0 2024-09-13T10:35:22.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient(hunting): my global_id is 6123 2024-09-13T10:35:22.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10f0003520 con 0x7f111013f9a0 2024-09-13T10:35:22.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2778220323 0 0) 0x7f111013ce80 con 0x7f11100a66d0 2024-09-13T10:35:22.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11100a2a90 con 0x7f11100a66d0 2024-09-13T10:35:22.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1100004d90 con 0x7f11100a66d0 2024-09-13T10:35:22.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:22.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:22.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient(hunting): dump: 2024-09-13T10:35:22.019 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.020 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.020 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.020 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.020 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.020 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.020 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.020 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.020 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.020 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.020 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.020 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.021 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.021 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.021 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.021 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3834768332 0 0) 0x7f11101cf210 con 0x7f11100a6ab0 2024-09-13T10:35:22.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.181:6792/0 conn(0x7f11100a66d0 legacy=0x7f11101ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.195:6790/0 conn(0x7f111013f9a0 legacy=0x7f11101d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient: _finish_hunting 0 2024-09-13T10:35:22.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 monclient: found mon.e 2024-09-13T10:35:22.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:22.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1110068960 con 0x7f11100a6ab0 2024-09-13T10:35:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient: _finish_auth 0 2024-09-13T10:35:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient: _check_auth_tickets 2024-09-13T10:35:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f1114aef640 5 monclient: authenticate success, global_id 104291 2024-09-13T10:35:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f1114aef640 10 monclient: _renew_subs 2024-09-13T10:35:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f1114aef640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f1114aef640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f111013e370 con 0x7f11100a6ab0 2024-09-13T10:35:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f1114aef640 10 monclient: _renew_subs 2024-09-13T10:35:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f1114aef640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:22.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f1114aef640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f111013f690 con 0x7f11100a6ab0 2024-09-13T10:35:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1104003ae0 con 0x7f11100a6ab0 2024-09-13T10:35:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1104004050 con 0x7f11100a6ab0 2024-09-13T10:35:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f110cd99640 4 set_mon_vals no callback set 2024-09-13T10:35:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.997+0000 7f10feffd640 10 monclient: dump: 2024-09-13T10:35:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.023 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.024 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.024 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.024 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.024 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.024 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.024 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.024 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.024 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.024 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.024 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.024 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.025 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.998+0000 7f1114aef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:22.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.998+0000 7f1114aef640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f10f40065c0 con 0x7f10f4002860 2024-09-13T10:35:22.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.998+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f11040041f0 con 0x7f11100a6ab0 2024-09-13T10:35:22.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.998+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(174..174 src has 1..174) ==== 3898+0+0 (unknown 3187678074 0 0) 0x7f110404e340 con 0x7f11100a6ab0 2024-09-13T10:35:22.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:21.998+0000 7f110ed9d640 10 monclient: get_auth_request con 0x7f10f0040330 auth_method 0 2024-09-13T10:35:22.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f110e59c640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.195:6790/0 conn(0x7f10f4002860 legacy=0x7f10f4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2633173148 0 0) 0x7f10f40065c0 con 0x7f10f4002860 2024-09-13T10:35:22.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f10feffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f10feffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f10feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f10feffd640 10 monclient(hunting): my global_id is 6132 2024-09-13T10:35:22.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11101cf210 con 0x7f10f4002860 2024-09-13T10:35:22.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 187243765 0 0) 0x7f11101cf210 con 0x7f10f4002860 2024-09-13T10:35:22.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10f40065c0 con 0x7f10f4002860 2024-09-13T10:35:22.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f11000048a0 con 0x7f10f4002860 2024-09-13T10:35:22.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f10feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f10feffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:35:22.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.000+0000 7f10feffd640 10 monclient: dump: 2024-09-13T10:35:22.026 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.026 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.027 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.027 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.027 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.027 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.027 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.027 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.027 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.027 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.027 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.027 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.027 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.028 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.028 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.028 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.001+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3597287212 0 0) 0x7f10f40065c0 con 0x7f10f4002860 2024-09-13T10:35:22.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.001+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10f400a160 con 0x7f10f4002860 2024-09-13T10:35:22.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.001+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1100005490 con 0x7f10f4002860 2024-09-13T10:35:22.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.001+0000 7f10feffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:22.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.001+0000 7f10feffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:22.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.001+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.195:6790/0 conn(0x7f10f4002860 legacy=0x7f10f4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.001+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.195:6790/0 conn(0x7f10f4002860 legacy=0x7f10f4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:22.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.007+0000 7f1114aef640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:22.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.007+0000 7f1114aef640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f10f4009e50 con 0x7f10f4009110 2024-09-13T10:35:22.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f110e59c640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.195:6790/0 conn(0x7f10f4009110 legacy=0x7f10f40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2060590652 0 0) 0x7f10f4009e50 con 0x7f10f4009110 2024-09-13T10:35:22.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 10 monclient(hunting): my global_id is 6141 2024-09-13T10:35:22.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10f40065c0 con 0x7f10f4009110 2024-09-13T10:35:22.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1820535536 0 0) 0x7f10f40065c0 con 0x7f10f4009110 2024-09-13T10:35:22.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10f4009e50 con 0x7f10f4009110 2024-09-13T10:35:22.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1100005c90 con 0x7f10f4009110 2024-09-13T10:35:22.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:35:22.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 10 monclient: dump: 2024-09-13T10:35:22.030 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.030 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.030 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.030 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.030 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.030 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.030 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.030 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.031 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.031 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.031 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.031 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.031 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.031 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.031 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.031 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4186568740 0 0) 0x7f10f4009e50 con 0x7f10f4009110 2024-09-13T10:35:22.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.010+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f10f400c3a0 con 0x7f10f4009110 2024-09-13T10:35:22.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7728 (unknown 0 0 3460280317) 0x7f1100007ff0 con 0x7f10f4009110 2024-09-13T10:35:22.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f10feffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:22.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f10feffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:22.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.195:6790/0 conn(0x7f10f4009110 legacy=0x7f10f40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f10feffd640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.195:6790/0 conn(0x7f10f4009110 legacy=0x7f10f40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:22.032 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:22.032 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:22.032 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:22.032 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:35:22.032 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:22.033 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 336426, 2024-09-13T10:35:22.033 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:22.033 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:22.033 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:22.033 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:22.033 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:22.033 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:22.033 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:22.033 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:22.033 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:22.033 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:22.034 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.034 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:35:22.034 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:22.034 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:22.034 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:22.034 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:22.034 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:22.034 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:22.034 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:22.034 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:22.034 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:22.034 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:22.035 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:22.035 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:22.035 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:22.035 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:22.035 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.035 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:22.035 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:22.035 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:22.035 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:22.035 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:22.035 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:22.036 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:22.036 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:22.036 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:22.036 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:22.036 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:22.036 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:22.036 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:22.036 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.036 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:22.036 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:22.036 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:22.037 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:22.037 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:22.037 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:22.037 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:22.037 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:22.037 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:22.037 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:22.037 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:22.037 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:22.037 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:22.037 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:22.038 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:22.038 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:22.038 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:22.038 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:22.038 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:22.038 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:22.038 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:22.038 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:22.038 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:22.038 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:22.038 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:22.039 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:22.039 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:22.039 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:22.039 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.039 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:22.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.039 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:22.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.039 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:22.039 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:22.039 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.039 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.040 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.040 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:22.040 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.040 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.040 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.040 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:22.040 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:22.040 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.040 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.041 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.041 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:22.041 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:22.041 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.041 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.041 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.041 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:22.041 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.041 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.042 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:22.042 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:22.042 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.042 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.042 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.042 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:22.042 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:22.043 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.043 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.043 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.043 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:22.043 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.043 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.043 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.043 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:22.043 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:22.043 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.044 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.044 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.044 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:22.044 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:22.044 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.044 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.044 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.044 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:22.044 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.045 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.045 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.045 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:22.045 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:22.045 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.045 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.045 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.045 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:22.046 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:22.046 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.046 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.046 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.046 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:22.046 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.046 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.046 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.046 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:22.046 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:22.047 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.047 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.047 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.047 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:22.047 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:22.047 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.047 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.047 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.047 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:22.048 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.048 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.048 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.048 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:22.048 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:22.048 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.048 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.048 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.049 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:22.049 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:22.049 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.049 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.049 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.049 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:22.049 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.049 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.049 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.049 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:22.050 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:22.050 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.050 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.050 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.050 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:22.050 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:22.050 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.050 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.050 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.051 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:22.051 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.051 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.051 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.051 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:22.051 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:22.051 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.051 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.051 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.052 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:22.052 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:22.052 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.052 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.052 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.052 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:22.052 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.052 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.052 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.053 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:22.053 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:22.053 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.053 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.053 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.053 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.053 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.053 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:22.053 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:22.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.053 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:22.054 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:22.054 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:22.054 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.054 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.054 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:22.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.054 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:22.054 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:22.054 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:22.054 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.054 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.054 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:22.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.055 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:22.055 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:22.055 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:22.055 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.055 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.055 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:22.055 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:22.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f1114aef640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.195:6800/1839191919 conn(0x7f10f0040330 legacy=0x7f10f00427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f1114aef640 10 monclient: shutdown 2024-09-13T10:35:22.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f1114aef640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:22.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f1114aef640 1 -- 172.21.15.181:0/579265052 >> v1:172.21.15.181:6793/0 conn(0x7f11100a6ab0 legacy=0x7f11101ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f110ed9d640 1 -- 172.21.15.181:0/579265052 reap_dead start 2024-09-13T10:35:22.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f110ed9d640 1 -- 172.21.15.181:0/579265052 reap_dead start 2024-09-13T10:35:22.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f1114aef640 1 -- 172.21.15.181:0/579265052 shutdown_connections 2024-09-13T10:35:22.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f1114aef640 1 -- 172.21.15.181:0/579265052 >> 172.21.15.181:0/579265052 conn(0x7f11100abcd0 msgr2=0x7f11100a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:22.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f1114aef640 1 -- 172.21.15.181:0/579265052 shutdown_connections 2024-09-13T10:35:22.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.011+0000 7f1114aef640 1 -- 172.21.15.181:0/579265052 wait complete. 2024-09-13T10:35:22.058 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:22.058 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:35:22.058 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:35:22.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.153+0000 7f75882be640 10 monclient: get_monmap_and_config 2024-09-13T10:35:22.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.153+0000 7f75882be640 10 monclient: build_initial_monmap 2024-09-13T10:35:22.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.153+0000 7f75882be640 10 monclient: monmap: 2024-09-13T10:35:22.156 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:22.156 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.157 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:22.155459+0000 2024-09-13T10:35:22.157 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:22.155459+0000 2024-09-13T10:35:22.157 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:22.157 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.157 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:22.157 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:22.157 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:22.157 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:22.157 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:22.157 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:22.157 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:22.157 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:22.158 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:22.158 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.154+0000 7f75882be640 1 Processor -- start 2024-09-13T10:35:22.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.154+0000 7f75882be640 1 -- start start 2024-09-13T10:35:22.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.154+0000 7f75882be640 10 monclient: init 2024-09-13T10:35:22.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.155+0000 7f75882be640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:22.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.155+0000 7f75882be640 10 monclient: _add_conns ranks=[7,8,6,5,2,1,3,0,4] 2024-09-13T10:35:22.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.155+0000 7f75882be640 10 monclient(hunting): picked mon.noname-i con 0x7f75800a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:22.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.155+0000 7f75882be640 10 monclient(hunting): picked mon.noname-e con 0x7f75800a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:22.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.155+0000 7f75882be640 10 monclient(hunting): picked mon.noname-d con 0x7f758013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:22.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.155+0000 7f75882be640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75800a4bc0 con 0x7f758013f750 2024-09-13T10:35:22.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.155+0000 7f75882be640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758013a320 con 0x7f75800a6640 2024-09-13T10:35:22.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.155+0000 7f75882be640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75800a8100 con 0x7f75800a8340 2024-09-13T10:35:22.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.155+0000 7f75882be640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:22.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.155+0000 7f75882be640 10 monclient(hunting): authenticate will time out at 1061.661317s 2024-09-13T10:35:22.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.155+0000 7f7585859640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f75800a8340 0x7f7580139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54600/0 (socket says 172.21.15.181:54600) 2024-09-13T10:35:22.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.155+0000 7f7585859640 1 -- 172.21.15.181:0/182679071 learned_addr learned my addr 172.21.15.181:0/182679071 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:22.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585859640 1 -- 172.21.15.181:0/182679071 >> v1:172.21.15.181:6793/0 conn(0x7f75800a8340 legacy=0x7f7580139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f758685b640 1 -- 172.21.15.181:0/182679071 >> v1:172.21.15.181:6792/0 conn(0x7f758013f750 legacy=0x7f7580141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 1 -- 172.21.15.181:0/182679071 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297115329 0 0) 0x7f75800a8100 con 0x7f75800a8340 2024-09-13T10:35:22.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 10 monclient(hunting): my global_id is 104300 2024-09-13T10:35:22.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 1 -- 172.21.15.181:0/182679071 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f756c003520 con 0x7f75800a8340 2024-09-13T10:35:22.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 1 -- 172.21.15.181:0/182679071 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919825660 0 0) 0x7f75800a4bc0 con 0x7f758013f750 2024-09-13T10:35:22.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 10 monclient(hunting): my global_id is 6180 2024-09-13T10:35:22.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 1 -- 172.21.15.181:0/182679071 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75800a8100 con 0x7f758013f750 2024-09-13T10:35:22.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f758605a640 1 -- 172.21.15.181:0/182679071 >> v1:172.21.15.195:6792/0 conn(0x7f75800a6640 legacy=0x7f7580139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 1 -- 172.21.15.181:0/182679071 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4047443421 0 0) 0x7f756c003520 con 0x7f75800a8340 2024-09-13T10:35:22.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 1 -- 172.21.15.181:0/182679071 >> v1:172.21.15.195:6792/0 conn(0x7f75800a6640 legacy=0x7f7580139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 1 -- 172.21.15.181:0/182679071 >> v1:172.21.15.181:6792/0 conn(0x7f758013f750 legacy=0x7f7580141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 10 monclient: _finish_hunting 0 2024-09-13T10:35:22.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 1 monclient: found mon.noname-e 2024-09-13T10:35:22.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:22.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:35:22.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 1 -- 172.21.15.181:0/182679071 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75800a48e0 con 0x7f75800a8340 2024-09-13T10:35:22.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 10 monclient: _finish_auth 0 2024-09-13T10:35:22.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 10 monclient: _check_auth_tickets 2024-09-13T10:35:22.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:22.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.157+0000 7f7585058640 1 -- 172.21.15.181:0/182679071 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7570001ae0 con 0x7f75800a8340 2024-09-13T10:35:22.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f75882be640 5 monclient: authenticate success, global_id 104300 2024-09-13T10:35:22.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f75882be640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:22.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f7585058640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f7585058640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:35:22.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f7585058640 10 monclient: dump: 2024-09-13T10:35:22.170 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.170 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.170 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.170 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.170 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.170 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.170 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.170 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.170 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f75882be640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f7585058640 1 -- 172.21.15.181:0/182679071 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f75700048a0 con 0x7f75800a8340 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f7585058640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f75882be640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f7585058640 1 -- 172.21.15.181:0/182679071 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7570004e10 con 0x7f75800a8340 2024-09-13T10:35:22.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f7585058640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f75882be640 4 set_mon_vals no callback set 2024-09-13T10:35:22.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f7585058640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:22.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f7585058640 10 monclient: dump: 2024-09-13T10:35:22.172 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.172 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.172 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.172 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.172 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.172 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.172 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.172 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f75882be640 10 monclient: shutdown 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f75882be640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f75882be640 1 -- 172.21.15.181:0/182679071 >> v1:172.21.15.181:6793/0 conn(0x7f75800a8340 legacy=0x7f7580139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f75882be640 1 -- 172.21.15.181:0/182679071 shutdown_connections 2024-09-13T10:35:22.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f75882be640 1 -- 172.21.15.181:0/182679071 >> 172.21.15.181:0/182679071 conn(0x7f7580077170 msgr2=0x7f75800abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:22.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f75882be640 1 -- 172.21.15.181:0/182679071 shutdown_connections 2024-09-13T10:35:22.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.158+0000 7f75882be640 1 -- 172.21.15.181:0/182679071 wait complete. 2024-09-13T10:35:22.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.159+0000 7f75882be640 10 monclient: build_initial_monmap 2024-09-13T10:35:22.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.159+0000 7f75882be640 10 monclient: monmap: 2024-09-13T10:35:22.174 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:22.174 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:22.174 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:22.174 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:22.174 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:22.174 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:22.174 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:22.174 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:22.175 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:22.175 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:22.175 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:22.175 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:22.175 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:22.175 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:22.175 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:22.175 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.159+0000 7f75882be640 1 Processor -- start 2024-09-13T10:35:22.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.159+0000 7f75882be640 1 -- start start 2024-09-13T10:35:22.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.159+0000 7f75882be640 10 monclient: init 2024-09-13T10:35:22.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.160+0000 7f75882be640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:22.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.160+0000 7f75882be640 10 monclient: _add_conns ranks=[6,1,7,5,2,4,3,8,0] 2024-09-13T10:35:22.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.160+0000 7f75882be640 10 monclient(hunting): picked mon.noname-d con 0x7f75800a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:22.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.160+0000 7f75882be640 10 monclient(hunting): picked mon.noname-f con 0x7f758013f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:22.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.160+0000 7f75882be640 10 monclient(hunting): picked mon.noname-i con 0x7f75801d4520 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:22.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.160+0000 7f75882be640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75800a1220 con 0x7f758013f750 2024-09-13T10:35:22.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.160+0000 7f75882be640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75801cf0f0 con 0x7f75800a8340 2024-09-13T10:35:22.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.160+0000 7f75882be640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75800a9db0 con 0x7f75801d4520 2024-09-13T10:35:22.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.160+0000 7f75882be640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:22.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.160+0000 7f75882be640 10 monclient(hunting): authenticate will time out at 1061.666143s 2024-09-13T10:35:22.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.160+0000 7f758605a640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f75800a8340 0x7f75801ce2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:40344/0 (socket says 172.21.15.181:40344) 2024-09-13T10:35:22.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.160+0000 7f758605a640 1 -- 172.21.15.181:0/2425050012 learned_addr learned my addr 172.21.15.181:0/2425050012 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:22.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f758605a640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.181:6792/0 conn(0x7f75800a8340 legacy=0x7f75801ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253453204 0 0) 0x7f75801cf0f0 con 0x7f75800a8340 2024-09-13T10:35:22.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): my global_id is 6189 2024-09-13T10:35:22.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7564003550 con 0x7f75800a8340 2024-09-13T10:35:22.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f758685b640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.195:6792/0 conn(0x7f75801d4520 legacy=0x7f75801d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7585859640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.195:6789/0 conn(0x7f758013f750 legacy=0x7f75801ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3158708145 0 0) 0x7f7564003550 con 0x7f75800a8340 2024-09-13T10:35:22.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75801cf0f0 con 0x7f75800a8340 2024-09-13T10:35:22.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f757c003610 con 0x7f75800a8340 2024-09-13T10:35:22.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:22.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:35:22.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): dump: 2024-09-13T10:35:22.178 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.178 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.178 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.178 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.178 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.178 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.178 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.178 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.178 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.179 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.179 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.179 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.179 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.179 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.179 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.179 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:22.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3952220772 0 0) 0x7f75800a9db0 con 0x7f75801d4520 2024-09-13T10:35:22.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): my global_id is 56275 2024-09-13T10:35:22.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7564003550 con 0x7f75801d4520 2024-09-13T10:35:22.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1695073611 0 0) 0x7f75800a1220 con 0x7f758013f750 2024-09-13T10:35:22.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 10 monclient(hunting): my global_id is 56359 2024-09-13T10:35:22.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75800a9db0 con 0x7f758013f750 2024-09-13T10:35:22.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.162+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2583107952 0 0) 0x7f75801cf0f0 con 0x7f75800a8340 2024-09-13T10:35:22.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.195:6792/0 conn(0x7f75801d4520 legacy=0x7f75801d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.195:6789/0 conn(0x7f758013f750 legacy=0x7f75801ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:35:22.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 1 monclient: found mon.d 2024-09-13T10:35:22.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:22.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:22.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7580142e60 con 0x7f75800a8340 2024-09-13T10:35:22.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 10 monclient: _finish_auth 0 2024-09-13T10:35:22.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:35:22.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:22.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f75882be640 5 monclient: authenticate success, global_id 6189 2024-09-13T10:35:22.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f75882be640 10 monclient: _renew_subs 2024-09-13T10:35:22.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f75882be640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:22.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f75882be640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f75800a03b0 con 0x7f75800a8340 2024-09-13T10:35:22.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f75882be640 10 monclient: _renew_subs 2024-09-13T10:35:22.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f75882be640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:22.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f75882be640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f758009ef10 con 0x7f75800a8340 2024-09-13T10:35:22.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f757c003c00 con 0x7f75800a8340 2024-09-13T10:35:22.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:22.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f757c004130 con 0x7f75800a8340 2024-09-13T10:35:22.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7584857640 4 set_mon_vals no callback set 2024-09-13T10:35:22.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:22.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f7576ffd640 10 monclient: dump: 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.183 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.184 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.184 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.184 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f75882be640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:22.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.163+0000 7f75882be640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f75680065c0 con 0x7f7568002860 2024-09-13T10:35:22.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.164+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f757c011ca0 con 0x7f75800a8340 2024-09-13T10:35:22.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.164+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(174..174 src has 1..174) ==== 3898+0+0 (unknown 3187678074 0 0) 0x7f757c04e480 con 0x7f75800a8340 2024-09-13T10:35:22.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.164+0000 7f758685b640 10 monclient: get_auth_request con 0x7f756403fd40 auth_method 0 2024-09-13T10:35:22.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7585859640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.195:6791/0 conn(0x7f7568002860 legacy=0x7f7568004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855903929 0 0) 0x7f75680065c0 con 0x7f7568002860 2024-09-13T10:35:22.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 10 monclient(hunting): my global_id is 104234 2024-09-13T10:35:22.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75801cf0f0 con 0x7f7568002860 2024-09-13T10:35:22.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3565929421 0 0) 0x7f75801cf0f0 con 0x7f7568002860 2024-09-13T10:35:22.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75680065c0 con 0x7f7568002860 2024-09-13T10:35:22.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7570001320 con 0x7f7568002860 2024-09-13T10:35:22.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:35:22.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 10 monclient: dump: 2024-09-13T10:35:22.189 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.189 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.189 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.189 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.189 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.189 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.189 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.189 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.189 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.190 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.190 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.190 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.190 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.190 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.190 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.190 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3188691028 0 0) 0x7f75680065c0 con 0x7f7568002860 2024-09-13T10:35:22.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.166+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f756800a160 con 0x7f7568002860 2024-09-13T10:35:22.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.167+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7570004b20 con 0x7f7568002860 2024-09-13T10:35:22.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.167+0000 7f7576ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:22.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.167+0000 7f7576ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:22.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.167+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.195:6791/0 conn(0x7f7568002860 legacy=0x7f7568004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.167+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.195:6791/0 conn(0x7f7568002860 legacy=0x7f7568004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:22.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.173+0000 7f75882be640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:22.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.173+0000 7f75882be640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7568009e70 con 0x7f7568009130 2024-09-13T10:35:22.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7585859640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.195:6791/0 conn(0x7f7568009130 legacy=0x7f75680095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2604151547 0 0) 0x7f7568009e70 con 0x7f7568009130 2024-09-13T10:35:22.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7576ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7576ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7576ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7576ffd640 10 monclient(hunting): my global_id is 104243 2024-09-13T10:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75680065c0 con 0x7f7568009130 2024-09-13T10:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 246002689 0 0) 0x7f75680065c0 con 0x7f7568009130 2024-09-13T10:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7568009e70 con 0x7f7568009130 2024-09-13T10:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7570005490 con 0x7f7568009130 2024-09-13T10:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7576ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7576ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.175+0000 7f7576ffd640 10 monclient: dump: 2024-09-13T10:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.192 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.193 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.193 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.193 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.193 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.193 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.193 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.193 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.193 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.193 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.193 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.193 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.193 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.194 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3595619196 0 0) 0x7f7568009e70 con 0x7f7568009130 2024-09-13T10:35:22.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f756800c410 con 0x7f7568009130 2024-09-13T10:35:22.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7557 (unknown 0 0 772386417) 0x7f7570008600 con 0x7f7568009130 2024-09-13T10:35:22.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f7576ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:22.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f7576ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:22.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.195:6791/0 conn(0x7f7568009130 legacy=0x7f75680095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f7576ffd640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.195:6791/0 conn(0x7f7568009130 legacy=0x7f75680095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:22.194 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:22.195 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:22.195 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:22.195 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:22.195 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:22.195 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 5876, 2024-09-13T10:35:22.195 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:22.195 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:22.195 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:22.195 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:22.195 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:22.195 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:22.196 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:22.196 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:22.196 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:22.196 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:22.196 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.196 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:35:22.196 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:22.196 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:22.196 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:22.196 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:22.196 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:22.197 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:22.198 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:22.199 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:22.200 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.201 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.202 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.203 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.204 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.205 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.206 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.207 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.208 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.209 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.210 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:22.210 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:22.210 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.210 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.210 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.210 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:22.210 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.210 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.211 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.211 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:22.211 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:22.211 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.211 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.211 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.211 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:22.211 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:22.212 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.212 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.212 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.212 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:22.212 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.212 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.212 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:22.212 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:22.213 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.213 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.213 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.213 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:22.213 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:22.213 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.213 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.213 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.214 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:22.214 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.214 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.214 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.214 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:22.214 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:22.214 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.214 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.214 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.215 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:22.215 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:22.215 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.215 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.215 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.215 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:22.215 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.215 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.215 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.216 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:22.216 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:22.216 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.216 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.216 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.216 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.216 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.216 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:22.216 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:22.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.216 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:22.217 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:22.217 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:22.217 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.217 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.217 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:22.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.217 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:22.217 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:22.217 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:22.217 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.217 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.218 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:22.218 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:22.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f75882be640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.195:6800/1839191919 conn(0x7f756403fd40 legacy=0x7f7564042200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f75882be640 10 monclient: shutdown 2024-09-13T10:35:22.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f75882be640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:22.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f75882be640 1 -- 172.21.15.181:0/2425050012 >> v1:172.21.15.181:6792/0 conn(0x7f75800a8340 legacy=0x7f75801ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f758685b640 1 -- 172.21.15.181:0/2425050012 reap_dead start 2024-09-13T10:35:22.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f758685b640 1 -- 172.21.15.181:0/2425050012 reap_dead start 2024-09-13T10:35:22.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f75882be640 1 -- 172.21.15.181:0/2425050012 shutdown_connections 2024-09-13T10:35:22.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f75882be640 1 -- 172.21.15.181:0/2425050012 >> 172.21.15.181:0/2425050012 conn(0x7f75800a6640 msgr2=0x7f7580141e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:22.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f75882be640 1 -- 172.21.15.181:0/2425050012 shutdown_connections 2024-09-13T10:35:22.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.176+0000 7f75882be640 1 -- 172.21.15.181:0/2425050012 wait complete. 2024-09-13T10:35:22.220 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:22.220 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:35:22.221 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:35:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.320+0000 7fa5a133a640 10 monclient: get_monmap_and_config 2024-09-13T10:35:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.320+0000 7fa5a133a640 10 monclient: build_initial_monmap 2024-09-13T10:35:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.320+0000 7fa5a133a640 10 monclient: monmap: 2024-09-13T10:35:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:22.322101+0000 2024-09-13T10:35:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:22.322101+0000 2024-09-13T10:35:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:22.323 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:22.324 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:22.324 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:22.324 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:22.324 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:22.324 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:22.324 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:22.324 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 1 Processor -- start 2024-09-13T10:35:22.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 1 -- start start 2024-09-13T10:35:22.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 10 monclient: init 2024-09-13T10:35:22.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:22.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 10 monclient: _add_conns ranks=[5,1,2,8,4,0,6,7,3] 2024-09-13T10:35:22.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 10 monclient(hunting): picked mon.noname-h con 0x7fa59c070b10 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:22.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 10 monclient(hunting): picked mon.noname-f con 0x7fa59c071600 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:22.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 10 monclient(hunting): picked mon.noname-b con 0x7fa59c13cbe0 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:22.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa59c0a1cc0 con 0x7fa59c071600 2024-09-13T10:35:22.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa59c0722b0 con 0x7fa59c13cbe0 2024-09-13T10:35:22.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa59c072590 con 0x7fa59c070b10 2024-09-13T10:35:22.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:22.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.321+0000 7fa5a133a640 10 monclient(hunting): authenticate will time out at 1061.827960s 2024-09-13T10:35:22.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.322+0000 7fa59b7fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fa59c13cbe0 0x7fa59c13efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:59298/0 (socket says 172.21.15.181:59298) 2024-09-13T10:35:22.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.322+0000 7fa59b7fe640 1 -- 172.21.15.181:0/1471166134 learned_addr learned my addr 172.21.15.181:0/1471166134 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:22.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa59b7fe640 1 -- 172.21.15.181:0/1471166134 >> v1:172.21.15.181:6790/0 conn(0x7fa59c13cbe0 legacy=0x7fa59c13efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.330 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa59a7fc640 1 -- 172.21.15.181:0/1471166134 >> v1:172.21.15.195:6789/0 conn(0x7fa59c071600 legacy=0x7fa59c13b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa59affd640 1 -- 172.21.15.181:0/1471166134 >> v1:172.21.15.195:6791/0 conn(0x7fa59c070b10 legacy=0x7fa59c070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354996645 0 0) 0x7fa59c0722b0 con 0x7fa59c13cbe0 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient(hunting): my global_id is 94520 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa584003520 con 0x7fa59c13cbe0 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 242105339 0 0) 0x7fa59c0a1cc0 con 0x7fa59c071600 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient(hunting): my global_id is 56368 2024-09-13T10:35:22.331 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa59c0722b0 con 0x7fa59c071600 2024-09-13T10:35:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4106201615 0 0) 0x7fa59c072590 con 0x7fa59c070b10 2024-09-13T10:35:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient(hunting): my global_id is 104252 2024-09-13T10:35:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa59c0a1cc0 con 0x7fa59c070b10 2024-09-13T10:35:22.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 605585335 0 0) 0x7fa584003520 con 0x7fa59c13cbe0 2024-09-13T10:35:22.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 >> v1:172.21.15.195:6791/0 conn(0x7fa59c070b10 legacy=0x7fa59c070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 >> v1:172.21.15.195:6789/0 conn(0x7fa59c071600 legacy=0x7fa59c13b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:35:22.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 monclient: found mon.noname-b 2024-09-13T10:35:22.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:22.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:35:22.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c072870 con 0x7fa59c13cbe0 2024-09-13T10:35:22.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient: _finish_auth 0 2024-09-13T10:35:22.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:35:22.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:22.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa594001e60 con 0x7fa59c13cbe0 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa5a133a640 5 monclient: authenticate success, global_id 94520 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa5a133a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient: dump: 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.334 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa5a133a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa594004c20 con 0x7fa59c13cbe0 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa5a133a640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 1 -- 172.21.15.181:0/1471166134 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa594005190 con 0x7fa59c13cbe0 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa5a133a640 4 set_mon_vals no callback set 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.324+0000 7fa599ffb640 10 monclient: dump: 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.336 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.325+0000 7fa5a133a640 10 monclient: shutdown 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.325+0000 7fa5a133a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.325+0000 7fa5a133a640 1 -- 172.21.15.181:0/1471166134 >> v1:172.21.15.181:6790/0 conn(0x7fa59c13cbe0 legacy=0x7fa59c13efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.325+0000 7fa5a133a640 1 -- 172.21.15.181:0/1471166134 shutdown_connections 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.325+0000 7fa5a133a640 1 -- 172.21.15.181:0/1471166134 >> 172.21.15.181:0/1471166134 conn(0x7fa59c0a45b0 msgr2=0x7fa59c0a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.325+0000 7fa5a133a640 1 -- 172.21.15.181:0/1471166134 shutdown_connections 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.325+0000 7fa5a133a640 1 -- 172.21.15.181:0/1471166134 wait complete. 2024-09-13T10:35:22.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.325+0000 7fa5a133a640 10 monclient: build_initial_monmap 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.325+0000 7fa5a133a640 10 monclient: monmap: 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:22.338 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.326+0000 7fa5a133a640 1 Processor -- start 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.326+0000 7fa5a133a640 1 -- start start 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.326+0000 7fa5a133a640 10 monclient: init 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.326+0000 7fa5a133a640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.326+0000 7fa5a133a640 10 monclient: _add_conns ranks=[1,7,4,8,0,5,6,3,2] 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.326+0000 7fa5a133a640 10 monclient(hunting): picked mon.noname-f con 0x7fa59c070b10 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.326+0000 7fa5a133a640 10 monclient(hunting): picked mon.noname-i con 0x7fa59c071600 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.326+0000 7fa5a133a640 10 monclient(hunting): picked mon.noname-c con 0x7fa59c13cbe0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.326+0000 7fa5a133a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa59c0a2c90 con 0x7fa59c070b10 2024-09-13T10:35:22.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.326+0000 7fa5a133a640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa59c09f770 con 0x7fa59c13cbe0 2024-09-13T10:35:22.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.326+0000 7fa5a133a640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa59c138c70 con 0x7fa59c071600 2024-09-13T10:35:22.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.327+0000 7fa5a133a640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:22.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.327+0000 7fa5a133a640 10 monclient(hunting): authenticate will time out at 1061.833015s 2024-09-13T10:35:22.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.327+0000 7fa59b7fe640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fa59c13cbe0 0x7fa59c1d6980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:42702/0 (socket says 172.21.15.181:42702) 2024-09-13T10:35:22.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.327+0000 7fa59b7fe640 1 -- 172.21.15.181:0/2517453820 learned_addr learned my addr 172.21.15.181:0/2517453820 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa59b7fe640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.181:6791/0 conn(0x7fa59c13cbe0 legacy=0x7fa59c1d6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa59affd640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.195:6789/0 conn(0x7fa59c070b10 legacy=0x7fa59c12c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa59a7fc640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.195:6792/0 conn(0x7fa59c071600 legacy=0x7fa59c1d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2978759352 0 0) 0x7fa59c09f770 con 0x7fa59c13cbe0 2024-09-13T10:35:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): my global_id is 6250 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa588003550 con 0x7fa59c13cbe0 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4172404120 0 0) 0x7fa59c138c70 con 0x7fa59c071600 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): my global_id is 56284 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa59c09f770 con 0x7fa59c071600 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2036907871 0 0) 0x7fa588003550 con 0x7fa59c13cbe0 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa59c138c70 con 0x7fa59c13cbe0 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa5940020b0 con 0x7fa59c13cbe0 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:35:22.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): dump: 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.348 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.349 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847959729 0 0) 0x7fa59c0a1cc0 con 0x7fa59c070b10 2024-09-13T10:35:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): my global_id is 56377 2024-09-13T10:35:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa588003550 con 0x7fa59c070b10 2024-09-13T10:35:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 234976280 0 0) 0x7fa59c09f770 con 0x7fa59c071600 2024-09-13T10:35:22.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa59c0a1cc0 con 0x7fa59c071600 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa590003610 con 0x7fa59c071600 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient(hunting): dump: 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.350 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3547271787 0 0) 0x7fa59c138c70 con 0x7fa59c13cbe0 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.195:6792/0 conn(0x7fa59c071600 legacy=0x7fa59c1d3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.195:6789/0 conn(0x7fa59c070b10 legacy=0x7fa59c12c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient: _finish_hunting 0 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 monclient: found mon.c 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:22.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c0a02d0 con 0x7fa59c13cbe0 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient: _finish_auth 0 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient: _check_auth_tickets 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5a133a640 5 monclient: authenticate success, global_id 6250 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5a133a640 10 monclient: _renew_subs 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5a133a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5a133a640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa59c0a0cd0 con 0x7fa59c13cbe0 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5a133a640 10 monclient: _renew_subs 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5a133a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5a133a640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa59c09ef50 con 0x7fa59c13cbe0 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa594004c20 con 0x7fa59c13cbe0 2024-09-13T10:35:22.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa594005700 con 0x7fa59c13cbe0 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.329+0000 7fa5997fa640 4 set_mon_vals no callback set 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.330+0000 7fa5837fe640 10 monclient: dump: 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.353 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.330+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa594011d80 con 0x7fa59c13cbe0 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.330+0000 7fa5a133a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.330+0000 7fa5a133a640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa57c0065c0 con 0x7fa57c002860 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.331+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(174..174 src has 1..174) ==== 3898+0+0 (unknown 3187678074 0 0) 0x7fa59404e590 con 0x7fa59c13cbe0 2024-09-13T10:35:22.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.331+0000 7fa59a7fc640 10 monclient: get_auth_request con 0x7fa588040570 auth_method 0 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa59affd640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.195:6792/0 conn(0x7fa57c002860 legacy=0x7fa57c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2203587508 0 0) 0x7fa57c0065c0 con 0x7fa57c002860 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 10 monclient(hunting): my global_id is 56293 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa59c138c70 con 0x7fa57c002860 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1569622173 0 0) 0x7fa59c138c70 con 0x7fa57c002860 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa57c0065c0 con 0x7fa57c002860 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa58c001bd0 con 0x7fa57c002860 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:35:22.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 10 monclient: dump: 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.356 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2169781897 0 0) 0x7fa57c0065c0 con 0x7fa57c002860 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.333+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa57c00a160 con 0x7fa57c002860 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.334+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa58c0067f0 con 0x7fa57c002860 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.334+0000 7fa5837fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.334+0000 7fa5837fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.334+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.195:6792/0 conn(0x7fa57c002860 legacy=0x7fa57c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.334+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.195:6792/0 conn(0x7fa57c002860 legacy=0x7fa57c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.340+0000 7fa5a133a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.340+0000 7fa5a133a640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa57c009e50 con 0x7fa57c009110 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.342+0000 7fa59affd640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.195:6792/0 conn(0x7fa57c009110 legacy=0x7fa57c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:22.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 965808913 0 0) 0x7fa57c009e50 con 0x7fa57c009110 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 10 monclient(hunting): my global_id is 56302 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa57c0065c0 con 0x7fa57c009110 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1021110997 0 0) 0x7fa57c0065c0 con 0x7fa57c009110 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa57c009e50 con 0x7fa57c009110 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa58c003d40 con 0x7fa57c009110 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 10 monclient: dump: 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:22.358 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:22.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2992506522 0 0) 0x7fa57c009e50 con 0x7fa57c009110 2024-09-13T10:35:22.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa57c00c3f0 con 0x7fa57c009110 2024-09-13T10:35:22.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 2416608979) 0x7fa58c006a60 con 0x7fa57c009110 2024-09-13T10:35:22.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:22.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:22.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.195:6792/0 conn(0x7fa57c009110 legacy=0x7fa57c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.343+0000 7fa5837fe640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.195:6792/0 conn(0x7fa57c009110 legacy=0x7fa57c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:22.360 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:22.360 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:22.360 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 90, 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 336764, 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:22.361 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 6, 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:22.362 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:22.363 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:22.364 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:22.365 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:22.366 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.367 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.368 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.369 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.370 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:22.371 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.372 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:22.374 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.376 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:22.377 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.378 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.379 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:22.380 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:22.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:22.380 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:22.380 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:22.380 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:22.380 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:22.380 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:22.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:22.380 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:22.380 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:22.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.344+0000 7fa5a133a640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa588040570 legacy=0x7fa588042a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.344+0000 7fa5a133a640 10 monclient: shutdown 2024-09-13T10:35:22.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.344+0000 7fa5a133a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:22.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.344+0000 7fa5a133a640 1 -- 172.21.15.181:0/2517453820 >> v1:172.21.15.181:6791/0 conn(0x7fa59c13cbe0 legacy=0x7fa59c1d6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:22.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.344+0000 7fa59b7fe640 1 -- 172.21.15.181:0/2517453820 reap_dead start 2024-09-13T10:35:22.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.344+0000 7fa59b7fe640 1 -- 172.21.15.181:0/2517453820 reap_dead start 2024-09-13T10:35:22.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.344+0000 7fa5a133a640 1 -- 172.21.15.181:0/2517453820 shutdown_connections 2024-09-13T10:35:22.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.344+0000 7fa5a133a640 1 -- 172.21.15.181:0/2517453820 >> 172.21.15.181:0/2517453820 conn(0x7fa59c0a45b0 msgr2=0x7fa59c0a5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:22.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.344+0000 7fa5a133a640 1 -- 172.21.15.181:0/2517453820 shutdown_connections 2024-09-13T10:35:22.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:22.344+0000 7fa5a133a640 1 -- 172.21.15.181:0/2517453820 wait complete. 2024-09-13T10:35:22.383 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:35:22.383 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a', 'c', 'b'] 2024-09-13T10:35:22.383 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['h'] 2024-09-13T10:35:22.383 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-13T10:35:22.383 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-13T10:35:22.383 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T10:35:22.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:35:22.393 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T10:35:22.393 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-13T10:35:22.394 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-13T10:35:22.394 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T10:35:22.394 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:35:22.446 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T10:35:22.446 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-13T10:35:22.446 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-13T10:35:22.446 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T10:35:22.446 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:35:22.497 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T10:35:22.497 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-09-13T10:35:22.498 INFO:tasks.ceph.mon.h:Sent signal 19 2024-09-13T10:35:22.498 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-13T10:35:37.499 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-09-13T10:35:37.500 INFO:tasks.ceph.mon.h:Sent signal 18 2024-09-13T10:35:37.500 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 6 2024-09-13T10:35:37.500 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:35:37.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.606+0000 7fb609e47640 10 monclient: get_monmap_and_config 2024-09-13T10:35:37.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.606+0000 7fb609e47640 10 monclient: build_initial_monmap 2024-09-13T10:35:37.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.606+0000 7fb609e47640 10 monclient: monmap: 2024-09-13T10:35:37.609 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:37.609 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:37.609 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:37.607737+0000 2024-09-13T10:35:37.609 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:37.607737+0000 2024-09-13T10:35:37.609 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:37.609 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:37.609 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:37.609 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:37.609 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:37.610 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:37.610 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:37.610 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:37.610 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:37.610 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:37.610 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:37.610 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:37.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.606+0000 7fb609e47640 1 Processor -- start 2024-09-13T10:35:37.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb609e47640 1 -- start start 2024-09-13T10:35:37.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb609e47640 10 monclient: init 2024-09-13T10:35:37.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb609e47640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:37.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb609e47640 10 monclient: _add_conns ranks=[5,7,4,8,0,3,2,1,6] 2024-09-13T10:35:37.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb609e47640 10 monclient(hunting): picked mon.noname-h con 0x7fb6040a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:37.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb609e47640 10 monclient(hunting): picked mon.noname-i con 0x7fb6040a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:37.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb609e47640 10 monclient(hunting): picked mon.noname-c con 0x7fb60413f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:37.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb609e47640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6040a5fe0 con 0x7fb60413f9a0 2024-09-13T10:35:37.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb609e47640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6040a8080 con 0x7fb6040a66d0 2024-09-13T10:35:37.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb609e47640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6040a42c0 con 0x7fb6040a6ab0 2024-09-13T10:35:37.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb609e47640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:37.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb609e47640 10 monclient(hunting): authenticate will time out at 1077.113633s 2024-09-13T10:35:37.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb603fff640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7fb60413f9a0 legacy=0x7fb604141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:35:37.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb6037fe640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7fb6040a66d0 0x7fb6040a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:59188/0 (socket says 172.21.15.181:59188) 2024-09-13T10:35:37.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb6037fe640 1 -- 172.21.15.181:0/2550968727 learned_addr learned my addr 172.21.15.181:0/2550968727 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:37.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.607+0000 7fb602ffd640 1 --1- 172.21.15.181:0/2550968727 >> v1:172.21.15.195:6792/0 conn(0x7fb6040a6ab0 0x7fb6040a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:39382/0 (socket says 172.21.15.181:39382) 2024-09-13T10:35:37.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.610+0000 7fb602ffd640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.195:6792/0 conn(0x7fb6040a6ab0 legacy=0x7fb6040a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:37.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.610+0000 7fb6037fe640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.195:6791/0 conn(0x7fb6040a66d0 legacy=0x7fb6040a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:37.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:37.808+0000 7fb603fff640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.181:6791/0 conn(0x7fb60413f9a0 legacy=0x7fb604141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:35:38.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:38.209+0000 7fb603fff640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.181:6791/0 conn(0x7fb60413f9a0 legacy=0x7fb604141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:35:39.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:39.010+0000 7fb603fff640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.181:6791/0 conn(0x7fb60413f9a0 legacy=0x7fb604141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:35:40.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 10 monclient(hunting): tick 2024-09-13T10:35:40.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:35:40.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:35:40.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:35:40.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.195:6792/0 conn(0x7fb6040a6ab0 legacy=0x7fb6040a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:40.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.195:6791/0 conn(0x7fb6040a66d0 legacy=0x7fb6040a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:40.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.181:6791/0 conn(0x7fb60413f9a0 legacy=0x7fb604141d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:35:40.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 10 monclient: _add_conns ranks=[2,1,3,8,6,0] 2024-09-13T10:35:40.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 10 monclient(hunting): picked mon.noname-b con 0x7fb5e40038b0 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:40.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 10 monclient(hunting): picked mon.noname-f con 0x7fb5e4007540 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:40.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 10 monclient(hunting): picked mon.noname-g con 0x7fb5e400b2d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:35:40.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 1 -- 172.21.15.181:0/2550968727 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6041464e0 con 0x7fb5e4007540 2024-09-13T10:35:40.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 1 -- 172.21.15.181:0/2550968727 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6040a5fe0 con 0x7fb5e40038b0 2024-09-13T10:35:40.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 1 -- 172.21.15.181:0/2550968727 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e4011100 con 0x7fb5e400b2d0 2024-09-13T10:35:40.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6017fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:40.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.608+0000 7fb6037fe640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.181:6790/0 conn(0x7fb5e40038b0 legacy=0x7fb5e4005d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:35:40.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.610+0000 7fb602ffd640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.195:6789/0 conn(0x7fb5e4007540 legacy=0x7fb5e4009a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:40.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.610+0000 7fb603fff640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.195:6790/0 conn(0x7fb5e400b2d0 legacy=0x7fb5e400d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:40.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:40.809+0000 7fb6037fe640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.181:6790/0 conn(0x7fb5e40038b0 legacy=0x7fb5e4005d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:35:41.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:41.210+0000 7fb6037fe640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.181:6790/0 conn(0x7fb5e40038b0 legacy=0x7fb5e4005d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:35:42.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.011+0000 7fb6037fe640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.181:6790/0 conn(0x7fb5e40038b0 legacy=0x7fb5e4005d00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:35:42.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.507+0000 7fb6027fc640 1 -- 172.21.15.181:0/2550968727 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1211915263 0 0) 0x7fb6041464e0 con 0x7fb5e4007540 2024-09-13T10:35:42.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.507+0000 7fb6027fc640 10 monclient(hunting): _negotiate 2024-09-13T10:35:42.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.507+0000 7fb6027fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:42.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.507+0000 7fb6027fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:42.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.507+0000 7fb6027fc640 10 monclient(hunting): my global_id is 56386 2024-09-13T10:35:42.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.507+0000 7fb6027fc640 1 -- 172.21.15.181:0/2550968727 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5f0003520 con 0x7fb5e4007540 2024-09-13T10:35:42.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 1 -- 172.21.15.181:0/2550968727 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3011056383 0 0) 0x7fb5f0003520 con 0x7fb5e4007540 2024-09-13T10:35:42.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.195:6790/0 conn(0x7fb5e400b2d0 legacy=0x7fb5e400d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:42.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.181:6790/0 conn(0x7fb5e40038b0 legacy=0x7fb5e4005d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:35:42.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 10 monclient: _finish_hunting 0 2024-09-13T10:35:42.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 1 monclient: found mon.noname-f 2024-09-13T10:35:42.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:42.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:35:42.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 1 -- 172.21.15.181:0/2550968727 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e40123a0 con 0x7fb5e4007540 2024-09-13T10:35:42.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 10 monclient: _finish_auth 0 2024-09-13T10:35:42.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 10 monclient: _check_auth_tickets 2024-09-13T10:35:42.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:42.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 1 -- 172.21.15.181:0/2550968727 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb5ec0019f0 con 0x7fb5e4007540 2024-09-13T10:35:42.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:42.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb603fff640 1 -- 172.21.15.181:0/2550968727 reap_dead start 2024-09-13T10:35:42.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:35:42.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 10 monclient: dump: 2024-09-13T10:35:42.513 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:42.513 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:42.513 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:42.513 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:42.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb609e47640 5 monclient: authenticate success, global_id 56386 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb609e47640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 1 -- 172.21.15.181:0/2550968727 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5ec001c90 con 0x7fb5e4007540 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 1 -- 172.21.15.181:0/2550968727 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb5ec004b20 con 0x7fb5e4007540 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb6027fc640 10 monclient: dump: 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:42.515 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:42.516 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:42.516 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:42.516 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:42.516 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:42.516 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:42.516 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:42.516 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:42.516 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:42.516 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:42.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb609e47640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:42.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.508+0000 7fb609e47640 4 set_mon_vals no callback set 2024-09-13T10:35:42.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.509+0000 7fb609e47640 10 monclient: shutdown 2024-09-13T10:35:42.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.509+0000 7fb609e47640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:42.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.509+0000 7fb609e47640 1 -- 172.21.15.181:0/2550968727 >> v1:172.21.15.195:6789/0 conn(0x7fb5e4007540 legacy=0x7fb5e4009a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:42.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.509+0000 7fb609e47640 1 -- 172.21.15.181:0/2550968727 shutdown_connections 2024-09-13T10:35:42.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.509+0000 7fb609e47640 1 -- 172.21.15.181:0/2550968727 >> 172.21.15.181:0/2550968727 conn(0x7fb6040abcd0 msgr2=0x7fb6040ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:42.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.509+0000 7fb609e47640 1 -- 172.21.15.181:0/2550968727 shutdown_connections 2024-09-13T10:35:42.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.509+0000 7fb609e47640 1 -- 172.21.15.181:0/2550968727 wait complete. 2024-09-13T10:35:42.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.510+0000 7fb609e47640 10 monclient: build_initial_monmap 2024-09-13T10:35:42.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.510+0000 7fb609e47640 10 monclient: monmap: 2024-09-13T10:35:42.519 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:42.519 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:42.519 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:42.519 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:42.519 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:42.519 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:42.519 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:42.519 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:42.519 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:42.519 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:42.519 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.510+0000 7fb609e47640 1 Processor -- start 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb609e47640 1 -- start start 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb609e47640 10 monclient: init 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb609e47640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb609e47640 10 monclient: _add_conns ranks=[0,4,6,1,7,2,8,5,3] 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb609e47640 10 monclient(hunting): picked mon.noname-a con 0x7fb5e4007540 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb609e47640 10 monclient(hunting): picked mon.noname-c con 0x7fb6040a1860 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb609e47640 10 monclient(hunting): picked mon.noname-d con 0x7fb604137230 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:42.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb609e47640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb604138250 con 0x7fb5e4007540 2024-09-13T10:35:42.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb6037fe640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fb5e4007540 legacy=0x7fb604136b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:35:42.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb609e47640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb604137d20 con 0x7fb6040a1860 2024-09-13T10:35:42.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb602ffd640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7fb6040a1860 legacy=0x7fb6041d33b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:35:42.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb609e47640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6040a0d00 con 0x7fb604137230 2024-09-13T10:35:42.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb609e47640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:42.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb609e47640 10 monclient(hunting): authenticate will time out at 1082.017763s 2024-09-13T10:35:42.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb603fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fb604137230 0x7fb6041d6ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46018/0 (socket says 172.21.15.181:46018) 2024-09-13T10:35:42.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.511+0000 7fb603fff640 1 -- 172.21.15.181:0/2782739914 learned_addr learned my addr 172.21.15.181:0/2782739914 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:42.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.514+0000 7fb603fff640 1 -- 172.21.15.181:0/2782739914 >> v1:172.21.15.181:6792/0 conn(0x7fb604137230 legacy=0x7fb6041d6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:42.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.686+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919588719 0 0) 0x7fb6040a0d00 con 0x7fb604137230 2024-09-13T10:35:42.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.686+0000 7fb5fbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:42.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.686+0000 7fb5fbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.686+0000 7fb5fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.686+0000 7fb5fbfff640 10 monclient(hunting): my global_id is 6198 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.686+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e4010730 con 0x7fb604137230 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.687+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 704561158 0 0) 0x7fb5e4010730 con 0x7fb604137230 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.687+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6040a0d00 con 0x7fb604137230 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.687+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb5f4004700 con 0x7fb604137230 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.687+0000 7fb5fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.687+0000 7fb5fbfff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.687+0000 7fb5fbfff640 10 monclient(hunting): dump: 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:42.690 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:42.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.687+0000 7fb5fbfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:42.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2589342094 0 0) 0x7fb6040a0d00 con 0x7fb604137230 2024-09-13T10:35:42.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 >> v1:172.21.15.181:6791/0 conn(0x7fb6040a1860 legacy=0x7fb6041d33b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:35:42.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 >> v1:172.21.15.181:6789/0 conn(0x7fb5e4007540 legacy=0x7fb604136b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:35:42.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb5fbfff640 10 monclient: _finish_hunting 0 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb5fbfff640 1 monclient: found mon.d 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb5fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb5fbfff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6040a27c0 con 0x7fb604137230 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb5fbfff640 10 monclient: _finish_auth 0 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb5fbfff640 10 monclient: _check_auth_tickets 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb5fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb609e47640 5 monclient: authenticate success, global_id 6198 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb609e47640 10 monclient: _renew_subs 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb609e47640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.693+0000 7fb609e47640 1 -- 172.21.15.181:0/2782739914 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb604122600 con 0x7fb604137230 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.694+0000 7fb609e47640 10 monclient: _renew_subs 2024-09-13T10:35:42.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.694+0000 7fb609e47640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:42.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.694+0000 7fb609e47640 1 -- 172.21.15.181:0/2782739914 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6041d8200 con 0x7fb604137230 2024-09-13T10:35:42.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.694+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5f4004b50 con 0x7fb604137230 2024-09-13T10:35:42.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.694+0000 7fb5fbfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:42.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.694+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb5f4005040 con 0x7fb604137230 2024-09-13T10:35:42.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.694+0000 7fb5fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.694+0000 7fb5fbfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.694+0000 7fb601ffb640 4 set_mon_vals no callback set 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.694+0000 7fb5fbfff640 10 monclient: dump: 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:42.699 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:42.700 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:42.700 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:42.700 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:42.700 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:42.700 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:42.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.695+0000 7fb609e47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:42.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.696+0000 7fb609e47640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:42.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.696+0000 7fb609e47640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:42.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.696+0000 7fb609e47640 1 -- 172.21.15.181:0/2782739914 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e8005080 con 0x7fb604137230 2024-09-13T10:35:42.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.696+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb5f40052a0 con 0x7fb604137230 2024-09-13T10:35:42.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.697+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(175..175 src has 1..175) ==== 3898+0+0 (unknown 1459661124 0 0) 0x7fb5f404e220 con 0x7fb604137230 2024-09-13T10:35:42.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.699+0000 7fb6037fe640 10 monclient: get_auth_request con 0x7fb5e4040f20 auth_method 0 2024-09-13T10:35:42.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.705+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fb5f40175f0 con 0x7fb604137230 2024-09-13T10:35:42.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.705+0000 7fb5fbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:42.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.705+0000 7fb5fbfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:42.808 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:42.808 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38303]: starting. 2024-09-13T10:35:42.808 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38303]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38266 2024-09-13T10:35:42.809 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38303]: created object 0... 2024-09-13T10:35:42.809 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38303]: created object 25... 2024-09-13T10:35:42.809 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38303]: created object 49... 2024-09-13T10:35:42.809 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38303]: finishing. 2024-09-13T10:35:42.809 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38303]: shutting down. 2024-09-13T10:35:42.845 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:42.845 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38305]: starting. 2024-09-13T10:35:42.845 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38305]: listing objects. 2024-09-13T10:35:42.845 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38305]: listed object 0... 2024-09-13T10:35:42.845 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38305]: listed object 25... 2024-09-13T10:35:42.846 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38305]: saw 50 objects 2024-09-13T10:35:42.846 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38305]: shutting down. 2024-09-13T10:35:42.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.962+0000 7fb609e47640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:35:42.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.962+0000 7fb609e47640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:35:42.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.962+0000 7fb609e47640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:35:42.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.962+0000 7fb609e47640 1 -- 172.21.15.181:0/2782739914 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb5e8005370 con 0x7fb604137230 2024-09-13T10:35:42.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.962+0000 7fb5fbfff640 1 -- 172.21.15.181:0/2782739914 <== mon.6 v1:172.21.15.181:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2726 (unknown 254746657 0 1865056337) 0x7fb5f401b760 con 0x7fb604137230 2024-09-13T10:35:42.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.962+0000 7fb5fbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:35:42.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.962+0000 7fb5fbfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:42.965 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":96,"quorum":[1,3,5,6,7,8],"quorum_names":["f","g","h","d","i","e"],"quorum_leader_name":"g","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:35:42.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.964+0000 7fb609e47640 1 -- 172.21.15.181:0/2782739914 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb5e4040f20 legacy=0x7fb5e40433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:42.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.964+0000 7fb609e47640 10 monclient: shutdown 2024-09-13T10:35:42.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.964+0000 7fb609e47640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:42.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.964+0000 7fb609e47640 1 -- 172.21.15.181:0/2782739914 >> v1:172.21.15.181:6792/0 conn(0x7fb604137230 legacy=0x7fb6041d6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:42.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.964+0000 7fb609e47640 1 -- 172.21.15.181:0/2782739914 shutdown_connections 2024-09-13T10:35:42.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.964+0000 7fb609e47640 1 -- 172.21.15.181:0/2782739914 >> 172.21.15.181:0/2782739914 conn(0x7fb6040abcd0 msgr2=0x7fb604138480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:42.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.964+0000 7fb609e47640 1 -- 172.21.15.181:0/2782739914 shutdown_connections 2024-09-13T10:35:42.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:42.965+0000 7fb609e47640 1 -- 172.21.15.181:0/2782739914 wait complete. 2024-09-13T10:35:42.978 INFO:tasks.mon_thrash.ceph_manager:quorum is size 6 2024-09-13T10:35:42.978 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon d 2024-09-13T10:35:42.978 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:35:43.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.073+0000 7f84d8bf5640 10 monclient: get_monmap_and_config 2024-09-13T10:35:43.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.073+0000 7f84d8bf5640 10 monclient: build_initial_monmap 2024-09-13T10:35:43.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.073+0000 7f84d8bf5640 10 monclient: monmap: 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:43.074785+0000 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:43.074785+0000 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:43.076 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:43.077 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:43.077 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:43.077 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.073+0000 7f84d8bf5640 1 Processor -- start 2024-09-13T10:35:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.073+0000 7f84d8bf5640 1 -- start start 2024-09-13T10:35:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.073+0000 7f84d8bf5640 10 monclient: init 2024-09-13T10:35:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d8bf5640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d8bf5640 10 monclient: _add_conns ranks=[6,8,2,5,3,7,0,1,4] 2024-09-13T10:35:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d8bf5640 10 monclient(hunting): picked mon.noname-d con 0x7f84d4139500 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d8bf5640 10 monclient(hunting): picked mon.noname-e con 0x7f84d4139ff0 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d8bf5640 10 monclient(hunting): picked mon.noname-b con 0x7f84d413fe60 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d8bf5640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d40a8070 con 0x7f84d413fe60 2024-09-13T10:35:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d8bf5640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d40a2f20 con 0x7f84d4139500 2024-09-13T10:35:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d8bf5640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d40a84b0 con 0x7f84d4139ff0 2024-09-13T10:35:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d8bf5640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d8bf5640 10 monclient(hunting): authenticate will time out at 1082.580455s 2024-09-13T10:35:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d2d9d640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f84d413fe60 legacy=0x7f84d4142250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:35:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d259c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f84d4139500 0x7f84d41398e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46032/0 (socket says 172.21.15.181:46032) 2024-09-13T10:35:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d259c640 1 -- 172.21.15.181:0/1314001176 learned_addr learned my addr 172.21.15.181:0/1314001176 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.074+0000 7f84d1d9b640 1 --1- 172.21.15.181:0/1314001176 >> v1:172.21.15.181:6793/0 conn(0x7f84d4139ff0 0x7f84d413e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:60698/0 (socket says 172.21.15.181:60698) 2024-09-13T10:35:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.076+0000 7f84d259c640 1 -- 172.21.15.181:0/1314001176 >> v1:172.21.15.181:6792/0 conn(0x7f84d4139500 legacy=0x7f84d41398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.076+0000 7f84d1d9b640 1 -- 172.21.15.181:0/1314001176 >> v1:172.21.15.181:6793/0 conn(0x7f84d4139ff0 legacy=0x7f84d413e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 1 -- 172.21.15.181:0/1314001176 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 408396104 0 0) 0x7f84d40a84b0 con 0x7f84d4139ff0 2024-09-13T10:35:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient(hunting): my global_id is 104309 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 1 -- 172.21.15.181:0/1314001176 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84c0003520 con 0x7f84d4139ff0 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 1 -- 172.21.15.181:0/1314001176 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1672551704 0 0) 0x7f84d40a2f20 con 0x7f84d4139500 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient(hunting): my global_id is 6207 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 1 -- 172.21.15.181:0/1314001176 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84d40a84b0 con 0x7f84d4139500 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 1 -- 172.21.15.181:0/1314001176 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2573756657 0 0) 0x7f84c0003520 con 0x7f84d4139ff0 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 1 -- 172.21.15.181:0/1314001176 >> v1:172.21.15.181:6792/0 conn(0x7f84d4139500 legacy=0x7f84d41398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 1 -- 172.21.15.181:0/1314001176 >> v1:172.21.15.181:6790/0 conn(0x7f84d413fe60 legacy=0x7f84d4142250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient: _finish_hunting 0 2024-09-13T10:35:43.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 1 monclient: found mon.noname-e 2024-09-13T10:35:43.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:43.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:35:43.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 1 -- 172.21.15.181:0/1314001176 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d40a42a0 con 0x7f84d4139ff0 2024-09-13T10:35:43.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient: _finish_auth 0 2024-09-13T10:35:43.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient: _check_auth_tickets 2024-09-13T10:35:43.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:43.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 1 -- 172.21.15.181:0/1314001176 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f84bc001ae0 con 0x7f84d4139ff0 2024-09-13T10:35:43.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:35:43.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient: dump: 2024-09-13T10:35:43.088 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.088 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.089 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d8bf5640 5 monclient: authenticate success, global_id 104309 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d8bf5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 1 -- 172.21.15.181:0/1314001176 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f84bc0047e0 con 0x7f84d4139ff0 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d8bf5640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 1 -- 172.21.15.181:0/1314001176 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f84bc004d50 con 0x7f84d4139ff0 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d8bf5640 4 set_mon_vals no callback set 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d159a640 10 monclient: dump: 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.090 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d8bf5640 10 monclient: shutdown 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d8bf5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.077+0000 7f84d8bf5640 1 -- 172.21.15.181:0/1314001176 >> v1:172.21.15.181:6793/0 conn(0x7f84d4139ff0 legacy=0x7f84d413e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.078+0000 7f84d8bf5640 1 -- 172.21.15.181:0/1314001176 shutdown_connections 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.078+0000 7f84d8bf5640 1 -- 172.21.15.181:0/1314001176 >> 172.21.15.181:0/1314001176 conn(0x7f84d40abf20 msgr2=0x7f84d40ac330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.078+0000 7f84d8bf5640 1 -- 172.21.15.181:0/1314001176 shutdown_connections 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.078+0000 7f84d8bf5640 1 -- 172.21.15.181:0/1314001176 wait complete. 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.078+0000 7f84d8bf5640 10 monclient: build_initial_monmap 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.078+0000 7f84d8bf5640 10 monclient: monmap: 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:43.093 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 1 Processor -- start 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 1 -- start start 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 10 monclient: init 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 10 monclient: _add_conns ranks=[5,0,4,6,1,7,2,3,8] 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 10 monclient(hunting): picked mon.noname-h con 0x7f84d4139500 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 10 monclient(hunting): picked mon.noname-a con 0x7f84d4139ff0 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 10 monclient(hunting): picked mon.noname-c con 0x7f84d413fe60 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d413af60 con 0x7f84d4139ff0 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d40a8e80 con 0x7f84d413fe60 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d413a830 con 0x7f84d4139500 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d8bf5640 10 monclient(hunting): authenticate will time out at 1082.585572s 2024-09-13T10:35:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d1d9b640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f84d4139ff0 legacy=0x7f84d4138160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:35:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d2d9d640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f84d413fe60 legacy=0x7f84d41d6030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:35:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d259c640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f84d4139500 0x7f84d4137a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:59210/0 (socket says 172.21.15.181:59210) 2024-09-13T10:35:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.079+0000 7f84d259c640 1 -- 172.21.15.181:0/2958498140 learned_addr learned my addr 172.21.15.181:0/2958498140 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84d259c640 1 -- 172.21.15.181:0/2958498140 >> v1:172.21.15.195:6791/0 conn(0x7f84d4139500 legacy=0x7f84d4137a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627489394 0 0) 0x7f84d413a830 con 0x7f84d4139500 2024-09-13T10:35:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient(hunting): my global_id is 104261 2024-09-13T10:35:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84b4003520 con 0x7f84d4139500 2024-09-13T10:35:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3125116378 0 0) 0x7f84b4003520 con 0x7f84d4139500 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f84d413a830 con 0x7f84d4139500 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f84cc001d20 con 0x7f84d4139500 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient(hunting): dump: 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1628554821 0 0) 0x7f84d413a830 con 0x7f84d4139500 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 >> v1:172.21.15.181:6791/0 conn(0x7f84d413fe60 legacy=0x7f84d41d6030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 >> v1:172.21.15.181:6789/0 conn(0x7f84d4139ff0 legacy=0x7f84d4138160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient: _finish_hunting 0 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 1 monclient: found mon.h 2024-09-13T10:35:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d4138870 con 0x7f84d4139500 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient: _finish_auth 0 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient: _check_auth_tickets 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84d8bf5640 5 monclient: authenticate success, global_id 104261 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84d8bf5640 10 monclient: _renew_subs 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84d8bf5640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84d8bf5640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f84d413c890 con 0x7f84d4139500 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84d8bf5640 10 monclient: _renew_subs 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84d8bf5640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84d8bf5640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f84d413b640 con 0x7f84d4139500 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f84cc005150 con 0x7f84d4139500 2024-09-13T10:35:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f84cc005640 con 0x7f84d4139500 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84d0d99640 4 set_mon_vals no callback set 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.082+0000 7f84caffd640 10 monclient: dump: 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.083+0000 7f84d8bf5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.083+0000 7f84d8bf5640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f84b80065c0 con 0x7f84b8002860 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.083+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f84cc011cc0 con 0x7f84d4139500 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.084+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(175..175 src has 1..175) ==== 3898+0+0 (unknown 1459661124 0 0) 0x7f84cc04e760 con 0x7f84d4139500 2024-09-13T10:35:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.084+0000 7f84d2d9d640 10 monclient: get_auth_request con 0x7f84b403f920 auth_method 0 2024-09-13T10:35:43.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.085+0000 7f84d1d9b640 1 -- 172.21.15.181:0/2958498140 >> v1:172.21.15.181:6792/0 conn(0x7f84b8002860 legacy=0x7f84b8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.085+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737569409 0 0) 0x7f84b80065c0 con 0x7f84b8002860 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.085+0000 7f84caffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.085+0000 7f84caffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.085+0000 7f84caffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.085+0000 7f84caffd640 10 monclient(hunting): my global_id is 6216 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.085+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84d413a830 con 0x7f84b8002860 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3880694501 0 0) 0x7f84d413a830 con 0x7f84b8002860 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f84b80065c0 con 0x7f84b8002860 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f84bc0047e0 con 0x7f84b8002860 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 10 monclient: dump: 2024-09-13T10:35:43.103 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3584190148 0 0) 0x7f84b80065c0 con 0x7f84b8002860 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84b800a160 con 0x7f84b8002860 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f84bc0017a0 con 0x7f84b8002860 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 >> v1:172.21.15.181:6792/0 conn(0x7f84b8002860 legacy=0x7f84b8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.086+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 >> v1:172.21.15.181:6792/0 conn(0x7f84b8002860 legacy=0x7f84b8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.092+0000 7f84d8bf5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.092+0000 7f84d8bf5640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f84b8009e50 con 0x7f84b8009110 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.094+0000 7f84d1d9b640 1 -- 172.21.15.181:0/2958498140 >> v1:172.21.15.181:6792/0 conn(0x7f84b8009110 legacy=0x7f84b80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4002749293 0 0) 0x7f84b8009e50 con 0x7f84b8009110 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 10 monclient(hunting): my global_id is 6225 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84b80065c0 con 0x7f84b8009110 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3023731473 0 0) 0x7f84b80065c0 con 0x7f84b8009110 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f84b8009e50 con 0x7f84b8009110 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f84bc0053d0 con 0x7f84b8009110 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 10 monclient: dump: 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 599132446 0 0) 0x7f84b8009e50 con 0x7f84b8009110 2024-09-13T10:35:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f84b800c3f0 con 0x7f84b8009110 2024-09-13T10:35:43.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7526 (unknown 0 0 1445155750) 0x7f84bc007d70 con 0x7f84b8009110 2024-09-13T10:35:43.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:43.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:43.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 >> v1:172.21.15.181:6792/0 conn(0x7f84b8009110 legacy=0x7f84b80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84caffd640 1 -- 172.21.15.181:0/2958498140 >> v1:172.21.15.181:6792/0 conn(0x7f84b8009110 legacy=0x7f84b80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:43.108 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 96, 2024-09-13T10:35:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 357539, 2024-09-13T10:35:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:35:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.127 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.128 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.130 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:43.130 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:43.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.130 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.130 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.130 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:43.130 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.130 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.130 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:43.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.130 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.130 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.131 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:43.131 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.131 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.131 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:43.131 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:43.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84d8bf5640 1 -- 172.21.15.181:0/2958498140 >> v1:172.21.15.195:6800/1839191919 conn(0x7f84b403f920 legacy=0x7f84b4041de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84d8bf5640 10 monclient: shutdown 2024-09-13T10:35:43.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84d8bf5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:43.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84d8bf5640 1 -- 172.21.15.181:0/2958498140 >> v1:172.21.15.195:6791/0 conn(0x7f84d4139500 legacy=0x7f84d4137a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84d2d9d640 1 -- 172.21.15.181:0/2958498140 reap_dead start 2024-09-13T10:35:43.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84d2d9d640 1 -- 172.21.15.181:0/2958498140 reap_dead start 2024-09-13T10:35:43.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84d8bf5640 1 -- 172.21.15.181:0/2958498140 shutdown_connections 2024-09-13T10:35:43.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.095+0000 7f84d8bf5640 1 -- 172.21.15.181:0/2958498140 >> 172.21.15.181:0/2958498140 conn(0x7f84d40abf20 msgr2=0x7f84d40a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:43.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.096+0000 7f84d8bf5640 1 -- 172.21.15.181:0/2958498140 shutdown_connections 2024-09-13T10:35:43.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.096+0000 7f84d8bf5640 1 -- 172.21.15.181:0/2958498140 wait complete. 2024-09-13T10:35:43.133 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:35:43.133 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon e 2024-09-13T10:35:43.134 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:35:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.228+0000 7f9913450640 10 monclient: get_monmap_and_config 2024-09-13T10:35:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.228+0000 7f9913450640 10 monclient: build_initial_monmap 2024-09-13T10:35:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.228+0000 7f9913450640 10 monclient: monmap: 2024-09-13T10:35:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:43.230356+0000 2024-09-13T10:35:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:43.230356+0000 2024-09-13T10:35:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.232 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:43.232 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:43.232 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:43.232 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:43.232 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:43.232 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:43.232 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:43.232 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:43.232 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:43.232 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.229+0000 7f9913450640 1 Processor -- start 2024-09-13T10:35:43.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.229+0000 7f9913450640 1 -- start start 2024-09-13T10:35:43.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.229+0000 7f9913450640 10 monclient: init 2024-09-13T10:35:43.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.229+0000 7f9913450640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:43.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.229+0000 7f9913450640 10 monclient: _add_conns ranks=[6,8,1,2,7,4,0,3,5] 2024-09-13T10:35:43.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.230+0000 7f9913450640 10 monclient(hunting): picked mon.noname-d con 0x7f990c0739c0 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:43.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.230+0000 7f9913450640 10 monclient(hunting): picked mon.noname-e con 0x7f990c135980 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:43.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.230+0000 7f9913450640 10 monclient(hunting): picked mon.noname-f con 0x7f990c13bf10 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:43.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.230+0000 7f9913450640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f990c071aa0 con 0x7f990c13bf10 2024-09-13T10:35:43.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.230+0000 7f9913450640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f990c071d10 con 0x7f990c0739c0 2024-09-13T10:35:43.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.230+0000 7f9913450640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f990c071ff0 con 0x7f990c135980 2024-09-13T10:35:43.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.230+0000 7f9913450640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:43.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.230+0000 7f9913450640 10 monclient(hunting): authenticate will time out at 1082.736150s 2024-09-13T10:35:43.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.230+0000 7f99109eb640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f990c135980 0x7f990c13a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:60704/0 (socket says 172.21.15.181:60704) 2024-09-13T10:35:43.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.230+0000 7f99111ec640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f990c0739c0 0x7f990c073da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46054/0 (socket says 172.21.15.181:46054) 2024-09-13T10:35:43.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.230+0000 7f99109eb640 1 -- 172.21.15.181:0/2928217538 learned_addr learned my addr 172.21.15.181:0/2928217538 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f99111ec640 1 -- 172.21.15.181:0/2928217538 >> v1:172.21.15.181:6792/0 conn(0x7f990c0739c0 legacy=0x7f990c073da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f99109eb640 1 -- 172.21.15.181:0/2928217538 >> v1:172.21.15.181:6793/0 conn(0x7f990c135980 legacy=0x7f990c13a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f99119ed640 1 -- 172.21.15.181:0/2928217538 >> v1:172.21.15.195:6789/0 conn(0x7f990c13bf10 legacy=0x7f990c13e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 557104388 0 0) 0x7f990c071ff0 con 0x7f990c135980 2024-09-13T10:35:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient(hunting): my global_id is 104318 2024-09-13T10:35:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98f8003520 con 0x7f990c135980 2024-09-13T10:35:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 255747460 0 0) 0x7f990c071d10 con 0x7f990c0739c0 2024-09-13T10:35:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient(hunting): my global_id is 6234 2024-09-13T10:35:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f990c071ff0 con 0x7f990c0739c0 2024-09-13T10:35:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3573885932 0 0) 0x7f990c071aa0 con 0x7f990c13bf10 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient(hunting): my global_id is 56395 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f990c071d10 con 0x7f990c13bf10 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4044132826 0 0) 0x7f990c071ff0 con 0x7f990c0739c0 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 >> v1:172.21.15.181:6793/0 conn(0x7f990c135980 legacy=0x7f990c13a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 >> v1:172.21.15.195:6789/0 conn(0x7f990c13bf10 legacy=0x7f990c13e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient: _finish_hunting 0 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 monclient: found mon.noname-d 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c0722d0 con 0x7f990c0739c0 2024-09-13T10:35:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient: _finish_auth 0 2024-09-13T10:35:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient: _check_auth_tickets 2024-09-13T10:35:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9908001a40 con 0x7f990c0739c0 2024-09-13T10:35:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9913450640 5 monclient: authenticate success, global_id 6234 2024-09-13T10:35:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9913450640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:35:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient: dump: 2024-09-13T10:35:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9913450640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9908001d10 con 0x7f990c0739c0 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9913450640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 1 -- 172.21.15.181:0/2928217538 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9908004b20 con 0x7f990c0739c0 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9913450640 4 set_mon_vals no callback set 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.232+0000 7f9903fff640 10 monclient: dump: 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.246 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.233+0000 7f9913450640 10 monclient: shutdown 2024-09-13T10:35:43.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.233+0000 7f9913450640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.233+0000 7f9913450640 1 -- 172.21.15.181:0/2928217538 >> v1:172.21.15.181:6792/0 conn(0x7f990c0739c0 legacy=0x7f990c073da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.233+0000 7f9913450640 1 -- 172.21.15.181:0/2928217538 shutdown_connections 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.233+0000 7f9913450640 1 -- 172.21.15.181:0/2928217538 >> 172.21.15.181:0/2928217538 conn(0x7f990c0a45b0 msgr2=0x7f990c0a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.233+0000 7f9913450640 1 -- 172.21.15.181:0/2928217538 shutdown_connections 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.233+0000 7f9913450640 1 -- 172.21.15.181:0/2928217538 wait complete. 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 10 monclient: build_initial_monmap 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 10 monclient: monmap: 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:43.248 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 1 Processor -- start 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 1 -- start start 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 10 monclient: init 2024-09-13T10:35:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 10 monclient: _add_conns ranks=[5,4,2,7,8,1,6,3,0] 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 10 monclient(hunting): picked mon.noname-h con 0x7f990c0739c0 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 10 monclient(hunting): picked mon.noname-c con 0x7f990c135980 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 10 monclient(hunting): picked mon.noname-b con 0x7f990c13bf10 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f990c09ef60 con 0x7f990c13bf10 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f990c13b4c0 con 0x7f990c135980 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f990c0a2ec0 con 0x7f990c0739c0 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f9913450640 10 monclient(hunting): authenticate will time out at 1082.740909s 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f99109eb640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f990c135980 legacy=0x7f990c13a280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.234+0000 7f99119ed640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f990c13bf10 legacy=0x7f990c1d4100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.235+0000 7f99111ec640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f990c0739c0 0x7f990c139b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:59222/0 (socket says 172.21.15.181:59222) 2024-09-13T10:35:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.235+0000 7f99111ec640 1 -- 172.21.15.181:0/4227106168 learned_addr learned my addr 172.21.15.181:0/4227106168 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f99111ec640 1 -- 172.21.15.181:0/4227106168 >> v1:172.21.15.195:6791/0 conn(0x7f990c0739c0 legacy=0x7f990c139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1882443727 0 0) 0x7f990c0a2ec0 con 0x7f990c0739c0 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient(hunting): my global_id is 104270 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98f0003550 con 0x7f990c0739c0 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3714512507 0 0) 0x7f98f0003550 con 0x7f990c0739c0 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f990c0a2ec0 con 0x7f990c0739c0 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9908004b20 con 0x7f990c0739c0 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:35:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient(hunting): dump: 2024-09-13T10:35:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.253 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4238580518 0 0) 0x7f990c0a2ec0 con 0x7f990c0739c0 2024-09-13T10:35:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 >> v1:172.21.15.181:6791/0 conn(0x7f990c135980 legacy=0x7f990c13a280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:35:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 >> v1:172.21.15.181:6790/0 conn(0x7f990c13bf10 legacy=0x7f990c1d4100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:35:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:35:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 1 monclient: found mon.h 2024-09-13T10:35:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c09e0f0 con 0x7f990c0739c0 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient: _finish_auth 0 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9913450640 5 monclient: authenticate success, global_id 104270 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9913450640 10 monclient: _renew_subs 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9913450640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9913450640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f990c09cc00 con 0x7f990c0739c0 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9908005150 con 0x7f990c0739c0 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9908005640 con 0x7f990c0739c0 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f9901ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.238+0000 7f9901ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.238+0000 7f9901ffb640 10 monclient: dump: 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.238+0000 7f9913450640 10 monclient: _renew_subs 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.238+0000 7f9913450640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.237+0000 7f99037fe640 4 set_mon_vals no callback set 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.238+0000 7f9913450640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f990c09ec80 con 0x7f990c0739c0 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.238+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9908011cc0 con 0x7f990c0739c0 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.238+0000 7f9913450640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.239+0000 7f9913450640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f990c06efd0 con 0x7f990c132960 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.239+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(175..175 src has 1..175) ==== 3898+0+0 (unknown 1459661124 0 0) 0x7f990804e4c0 con 0x7f990c0739c0 2024-09-13T10:35:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.239+0000 7f99119ed640 10 monclient: get_auth_request con 0x7f98f003f960 auth_method 0 2024-09-13T10:35:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.241+0000 7f99109eb640 1 -- 172.21.15.181:0/4227106168 >> v1:172.21.15.181:6793/0 conn(0x7f990c132960 legacy=0x7f990c132d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479586368 0 0) 0x7f990c06efd0 con 0x7f990c132960 2024-09-13T10:35:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 10 monclient(hunting): my global_id is 104327 2024-09-13T10:35:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f990c0a2ec0 con 0x7f990c132960 2024-09-13T10:35:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1167682840 0 0) 0x7f990c0a2ec0 con 0x7f990c132960 2024-09-13T10:35:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f990c06efd0 con 0x7f990c132960 2024-09-13T10:35:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f98fc0019d0 con 0x7f990c132960 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 10 monclient: dump: 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.261 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2962595908 0 0) 0x7f990c06efd0 con 0x7f990c132960 2024-09-13T10:35:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.243+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f990c0008d0 con 0x7f990c132960 2024-09-13T10:35:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.244+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f98fc001990 con 0x7f990c132960 2024-09-13T10:35:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.244+0000 7f9901ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.244+0000 7f9901ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.244+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 >> v1:172.21.15.181:6793/0 conn(0x7f990c132960 legacy=0x7f990c132d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.244+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 >> v1:172.21.15.181:6793/0 conn(0x7f990c132960 legacy=0x7f990c132d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.250+0000 7f9913450640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.250+0000 7f9913450640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f990c133830 con 0x7f990c133450 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f99109eb640 1 -- 172.21.15.181:0/4227106168 >> v1:172.21.15.181:6793/0 conn(0x7f990c133450 legacy=0x7f990c1d9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2734401872 0 0) 0x7f990c133830 con 0x7f990c133450 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 10 monclient(hunting): my global_id is 104336 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f990c06efd0 con 0x7f990c133450 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 165613670 0 0) 0x7f990c06efd0 con 0x7f990c133450 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f990c133830 con 0x7f990c133450 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f98fc005050 con 0x7f990c133450 2024-09-13T10:35:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 10 monclient: dump: 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.264 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.264 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.264 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.264 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3309782191 0 0) 0x7f990c133830 con 0x7f990c133450 2024-09-13T10:35:43.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f990c09da30 con 0x7f990c133450 2024-09-13T10:35:43.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7525 (unknown 0 0 2634739416) 0x7f98fc0072b0 con 0x7f990c133450 2024-09-13T10:35:43.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:43.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:43.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 >> v1:172.21.15.181:6793/0 conn(0x7f990c133450 legacy=0x7f990c1d9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.252+0000 7f9901ffb640 1 -- 172.21.15.181:0/4227106168 >> v1:172.21.15.181:6793/0 conn(0x7f990c133450 legacy=0x7f990c1d9840 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:43.264 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 96, 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 26955, 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:43.283 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:43.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.253+0000 7f9913450640 1 -- 172.21.15.181:0/4227106168 >> v1:172.21.15.195:6800/1839191919 conn(0x7f98f003f960 legacy=0x7f98f0041e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.253+0000 7f9913450640 10 monclient: shutdown 2024-09-13T10:35:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.253+0000 7f9913450640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.253+0000 7f9913450640 1 -- 172.21.15.181:0/4227106168 >> v1:172.21.15.195:6791/0 conn(0x7f990c0739c0 legacy=0x7f990c139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.253+0000 7f99119ed640 1 -- 172.21.15.181:0/4227106168 reap_dead start 2024-09-13T10:35:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.253+0000 7f99119ed640 1 -- 172.21.15.181:0/4227106168 reap_dead start 2024-09-13T10:35:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.253+0000 7f9913450640 1 -- 172.21.15.181:0/4227106168 shutdown_connections 2024-09-13T10:35:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.253+0000 7f9913450640 1 -- 172.21.15.181:0/4227106168 >> 172.21.15.181:0/4227106168 conn(0x7f990c0a45b0 msgr2=0x7f990c070220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.253+0000 7f9913450640 1 -- 172.21.15.181:0/4227106168 shutdown_connections 2024-09-13T10:35:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.253+0000 7f9913450640 1 -- 172.21.15.181:0/4227106168 wait complete. 2024-09-13T10:35:43.285 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:35:43.286 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon f 2024-09-13T10:35:43.286 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:35:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.382+0000 7fdb98507640 10 monclient: get_monmap_and_config 2024-09-13T10:35:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.382+0000 7fdb98507640 10 monclient: build_initial_monmap 2024-09-13T10:35:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.382+0000 7fdb98507640 10 monclient: monmap: 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:43.383668+0000 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:43.383668+0000 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:43.386 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:43.386 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.382+0000 7fdb98507640 1 Processor -- start 2024-09-13T10:35:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.382+0000 7fdb98507640 1 -- start start 2024-09-13T10:35:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.382+0000 7fdb98507640 10 monclient: init 2024-09-13T10:35:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb98507640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb98507640 10 monclient: _add_conns ranks=[1,4,8,3,7,2,5,0,6] 2024-09-13T10:35:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb98507640 10 monclient(hunting): picked mon.noname-f con 0x7fdb900a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb98507640 10 monclient(hunting): picked mon.noname-c con 0x7fdb900a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb98507640 10 monclient(hunting): picked mon.noname-e con 0x7fdb9013f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb98507640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb900a5fe0 con 0x7fdb900a66d0 2024-09-13T10:35:43.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb98507640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb900a8080 con 0x7fdb900a6ab0 2024-09-13T10:35:43.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb98507640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb900a42c0 con 0x7fdb9013f9a0 2024-09-13T10:35:43.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb98507640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:43.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb98507640 10 monclient(hunting): authenticate will time out at 1082.889454s 2024-09-13T10:35:43.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb95aa2640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7fdb900a6ab0 legacy=0x7fdb900a6ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:35:43.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb96aa4640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fdb9013f9a0 0x7fdb90141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:51100/0 (socket says 172.21.15.181:51100) 2024-09-13T10:35:43.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.383+0000 7fdb96aa4640 1 -- 172.21.15.181:0/281757097 learned_addr learned my addr 172.21.15.181:0/281757097 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:43.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.385+0000 7fdb96aa4640 1 -- 172.21.15.181:0/281757097 >> v1:172.21.15.181:6793/0 conn(0x7fdb9013f9a0 legacy=0x7fdb90141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.385+0000 7fdb962a3640 1 -- 172.21.15.181:0/281757097 >> v1:172.21.15.195:6789/0 conn(0x7fdb900a66d0 legacy=0x7fdb900a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 1 -- 172.21.15.181:0/281757097 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1810470585 0 0) 0x7fdb900a42c0 con 0x7fdb9013f9a0 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient(hunting): my global_id is 104345 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 1 -- 172.21.15.181:0/281757097 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb7c003520 con 0x7fdb9013f9a0 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 1 -- 172.21.15.181:0/281757097 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710530553 0 0) 0x7fdb900a5fe0 con 0x7fdb900a66d0 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient(hunting): my global_id is 56404 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 1 -- 172.21.15.181:0/281757097 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb900a42c0 con 0x7fdb900a66d0 2024-09-13T10:35:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 1 -- 172.21.15.181:0/281757097 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 185392429 0 0) 0x7fdb900a42c0 con 0x7fdb900a66d0 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 1 -- 172.21.15.181:0/281757097 >> v1:172.21.15.181:6793/0 conn(0x7fdb9013f9a0 legacy=0x7fdb90141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 1 -- 172.21.15.181:0/281757097 >> v1:172.21.15.181:6791/0 conn(0x7fdb900a6ab0 legacy=0x7fdb900a6ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient: _finish_hunting 0 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 1 monclient: found mon.noname-f 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 1 -- 172.21.15.181:0/281757097 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb901464e0 con 0x7fdb900a66d0 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient: _finish_auth 0 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient: _check_auth_tickets 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 1 -- 172.21.15.181:0/281757097 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdb8c001aa0 con 0x7fdb900a66d0 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb98507640 5 monclient: authenticate success, global_id 56404 2024-09-13T10:35:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb98507640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient: dump: 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb98507640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 1 -- 172.21.15.181:0/281757097 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb8c003610 con 0x7fdb900a66d0 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb98507640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb98507640 4 set_mon_vals no callback set 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 1 -- 172.21.15.181:0/281757097 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdb8c003b80 con 0x7fdb900a66d0 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb952a1640 10 monclient: dump: 2024-09-13T10:35:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.386+0000 7fdb98507640 10 monclient: shutdown 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.387+0000 7fdb98507640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.387+0000 7fdb98507640 1 -- 172.21.15.181:0/281757097 >> v1:172.21.15.195:6789/0 conn(0x7fdb900a66d0 legacy=0x7fdb900a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.387+0000 7fdb98507640 1 -- 172.21.15.181:0/281757097 shutdown_connections 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.387+0000 7fdb98507640 1 -- 172.21.15.181:0/281757097 >> 172.21.15.181:0/281757097 conn(0x7fdb900abcd0 msgr2=0x7fdb900ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.387+0000 7fdb98507640 1 -- 172.21.15.181:0/281757097 shutdown_connections 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.387+0000 7fdb98507640 1 -- 172.21.15.181:0/281757097 wait complete. 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.387+0000 7fdb98507640 10 monclient: build_initial_monmap 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.387+0000 7fdb98507640 10 monclient: monmap: 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 1 Processor -- start 2024-09-13T10:35:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 1 -- start start 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 10 monclient: init 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 10 monclient: _add_conns ranks=[5,8,0,1,4,6,3,7,2] 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 10 monclient(hunting): picked mon.noname-h con 0x7fdb900a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 10 monclient(hunting): picked mon.noname-e con 0x7fdb900a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 10 monclient(hunting): picked mon.noname-a con 0x7fdb9013f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9009d170 con 0x7fdb9013f9a0 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb90138ed0 con 0x7fdb900a66d0 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb90142eb0 con 0x7fdb900a6ab0 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb98507640 10 monclient(hunting): authenticate will time out at 1082.894581s 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb96aa4640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fdb9013f9a0 legacy=0x7fdb901d6440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb95aa2640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fdb900a6ab0 0x7fdb9013cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:51106/0 (socket says 172.21.15.181:51106) 2024-09-13T10:35:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.388+0000 7fdb95aa2640 1 -- 172.21.15.181:0/2751776148 learned_addr learned my addr 172.21.15.181:0/2751776148 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.390+0000 7fdb95aa2640 1 -- 172.21.15.181:0/2751776148 >> v1:172.21.15.181:6793/0 conn(0x7fdb900a6ab0 legacy=0x7fdb9013cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.390+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854299155 0 0) 0x7fdb90142eb0 con 0x7fdb900a6ab0 2024-09-13T10:35:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.390+0000 7fdb86ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.390+0000 7fdb86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.390+0000 7fdb86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.390+0000 7fdb86ffd640 10 monclient(hunting): my global_id is 104354 2024-09-13T10:35:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.390+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb74003550 con 0x7fdb900a6ab0 2024-09-13T10:35:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.390+0000 7fdb962a3640 1 -- 172.21.15.181:0/2751776148 >> v1:172.21.15.195:6791/0 conn(0x7fdb900a66d0 legacy=0x7fdb9013c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 86944456 0 0) 0x7fdb74003550 con 0x7fdb900a6ab0 2024-09-13T10:35:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb90142eb0 con 0x7fdb900a6ab0 2024-09-13T10:35:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdb800046a0 con 0x7fdb900a6ab0 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient(hunting): dump: 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239748839 0 0) 0x7fdb90138ed0 con 0x7fdb900a66d0 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient(hunting): my global_id is 104279 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb74003550 con 0x7fdb900a66d0 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 430392794 0 0) 0x7fdb90142eb0 con 0x7fdb900a6ab0 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 >> v1:172.21.15.195:6791/0 conn(0x7fdb900a66d0 legacy=0x7fdb9013c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 >> v1:172.21.15.181:6789/0 conn(0x7fdb9013f9a0 legacy=0x7fdb901d6440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 1 monclient: found mon.e 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9009ce90 con 0x7fdb900a6ab0 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient: _finish_auth 0 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb98507640 5 monclient: authenticate success, global_id 104354 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb98507640 10 monclient: _renew_subs 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb98507640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb98507640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9013e520 con 0x7fdb900a6ab0 2024-09-13T10:35:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb98507640 10 monclient: _renew_subs 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb98507640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb98507640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fdb9013d270 con 0x7fdb900a6ab0 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb800049b0 con 0x7fdb900a6ab0 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdb80004f20 con 0x7fdb900a6ab0 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb94aa0640 4 set_mon_vals no callback set 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.391+0000 7fdb86ffd640 10 monclient: dump: 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.392+0000 7fdb98507640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.392+0000 7fdb98507640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdb780065c0 con 0x7fdb78002860 2024-09-13T10:35:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.392+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fdb800050c0 con 0x7fdb900a6ab0 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.392+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(175..175 src has 1..175) ==== 3898+0+0 (unknown 1459661124 0 0) 0x7fdb8004e470 con 0x7fdb900a6ab0 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.392+0000 7fdb96aa4640 10 monclient: get_auth_request con 0x7fdb7403fb00 auth_method 0 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb962a3640 1 -- 172.21.15.181:0/2751776148 >> v1:172.21.15.195:6789/0 conn(0x7fdb78002860 legacy=0x7fdb78004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315023035 0 0) 0x7fdb780065c0 con 0x7fdb78002860 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb86ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb86ffd640 10 monclient(hunting): my global_id is 56413 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb90142eb0 con 0x7fdb78002860 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3746310363 0 0) 0x7fdb90142eb0 con 0x7fdb78002860 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb780065c0 con 0x7fdb78002860 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdb8c003610 con 0x7fdb78002860 2024-09-13T10:35:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb86ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.394+0000 7fdb86ffd640 10 monclient: dump: 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.395+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 277450566 0 0) 0x7fdb780065c0 con 0x7fdb78002860 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.395+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb7800a160 con 0x7fdb78002860 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.395+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fdb8c003830 con 0x7fdb78002860 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.395+0000 7fdb86ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.395+0000 7fdb86ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.395+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 >> v1:172.21.15.195:6789/0 conn(0x7fdb78002860 legacy=0x7fdb78004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.395+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 >> v1:172.21.15.195:6789/0 conn(0x7fdb78002860 legacy=0x7fdb78004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.401+0000 7fdb98507640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.401+0000 7fdb98507640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdb78009e70 con 0x7fdb78009130 2024-09-13T10:35:43.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb962a3640 1 -- 172.21.15.181:0/2751776148 >> v1:172.21.15.195:6789/0 conn(0x7fdb78009130 legacy=0x7fdb780095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3281882635 0 0) 0x7fdb78009e70 con 0x7fdb78009130 2024-09-13T10:35:43.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb86ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb86ffd640 10 monclient(hunting): my global_id is 56422 2024-09-13T10:35:43.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb780065c0 con 0x7fdb78009130 2024-09-13T10:35:43.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 327087890 0 0) 0x7fdb780065c0 con 0x7fdb78009130 2024-09-13T10:35:43.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb78009e70 con 0x7fdb78009130 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdb8c004180 con 0x7fdb78009130 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb86ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.404+0000 7fdb86ffd640 10 monclient: dump: 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.415 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2615689389 0 0) 0x7fdb78009e70 con 0x7fdb78009130 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdb7800c410 con 0x7fdb78009130 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7693 (unknown 0 0 2700607661) 0x7fdb8c004320 con 0x7fdb78009130 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb86ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb86ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 >> v1:172.21.15.195:6789/0 conn(0x7fdb78009130 legacy=0x7fdb780095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb86ffd640 1 -- 172.21.15.181:0/2751776148 >> v1:172.21.15.195:6789/0 conn(0x7fdb78009130 legacy=0x7fdb780095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:43.417 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:43.417 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:43.417 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:43.417 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:43.417 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 96, 2024-09-13T10:35:43.417 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 357815, 2024-09-13T10:35:43.417 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:43.417 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:43.417 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:43.417 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:43.417 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.418 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.419 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:43.420 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.421 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.422 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.423 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.424 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:43.427 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.428 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:43.431 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:43.432 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.432 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.432 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.432 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:43.432 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:43.432 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.432 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.432 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.432 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:43.433 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.434 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:43.435 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.436 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.436 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:43.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.436 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.436 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.436 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:43.436 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.436 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.436 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:43.436 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:43.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb98507640 1 -- 172.21.15.181:0/2751776148 >> v1:172.21.15.195:6800/1839191919 conn(0x7fdb7403fb00 legacy=0x7fdb74041fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb98507640 10 monclient: shutdown 2024-09-13T10:35:43.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb98507640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:43.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb98507640 1 -- 172.21.15.181:0/2751776148 >> v1:172.21.15.181:6793/0 conn(0x7fdb900a6ab0 legacy=0x7fdb9013cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb96aa4640 1 -- 172.21.15.181:0/2751776148 reap_dead start 2024-09-13T10:35:43.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb96aa4640 1 -- 172.21.15.181:0/2751776148 reap_dead start 2024-09-13T10:35:43.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb98507640 1 -- 172.21.15.181:0/2751776148 shutdown_connections 2024-09-13T10:35:43.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb98507640 1 -- 172.21.15.181:0/2751776148 >> 172.21.15.181:0/2751776148 conn(0x7fdb900abcd0 msgr2=0x7fdb900a9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:43.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb98507640 1 -- 172.21.15.181:0/2751776148 shutdown_connections 2024-09-13T10:35:43.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.405+0000 7fdb98507640 1 -- 172.21.15.181:0/2751776148 wait complete. 2024-09-13T10:35:43.439 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:35:43.439 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon g 2024-09-13T10:35:43.439 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:35:43.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.534+0000 7f3f0b3d5640 10 monclient: get_monmap_and_config 2024-09-13T10:35:43.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.534+0000 7f3f0b3d5640 10 monclient: build_initial_monmap 2024-09-13T10:35:43.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.534+0000 7f3f0b3d5640 10 monclient: monmap: 2024-09-13T10:35:43.537 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:43.537 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.537 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:43.536229+0000 2024-09-13T10:35:43.537 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:43.536229+0000 2024-09-13T10:35:43.537 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:43.537 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.537 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:43.537 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:43.538 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:43.538 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:43.538 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:43.538 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:43.538 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:43.538 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:43.538 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:43.538 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 1 Processor -- start 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 1 -- start start 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 10 monclient: init 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 10 monclient: _add_conns ranks=[2,3,4,5,8,6,1,7,0] 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 10 monclient(hunting): picked mon.noname-b con 0x7f3f040a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 10 monclient(hunting): picked mon.noname-g con 0x7f3f040a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 10 monclient(hunting): picked mon.noname-c con 0x7f3f0413f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f040a4bc0 con 0x7f3f040a6640 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f0413a320 con 0x7f3f040a8340 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f09171640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f3f040a6640 legacy=0x7f3f04139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f040a8100 con 0x7f3f0413f750 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f0b3d5640 10 monclient(hunting): authenticate will time out at 1083.041955s 2024-09-13T10:35:43.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.535+0000 7f3f09972640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f3f0413f750 legacy=0x7f3f04141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:35:43.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.536+0000 7f3f08970640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f3f040a8340 0x7f3f04139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:37254/0 (socket says 172.21.15.181:37254) 2024-09-13T10:35:43.541 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.536+0000 7f3f08970640 1 -- 172.21.15.181:0/163763069 learned_addr learned my addr 172.21.15.181:0/163763069 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:43.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3f08970640 1 -- 172.21.15.181:0/163763069 >> v1:172.21.15.195:6790/0 conn(0x7f3f040a8340 legacy=0x7f3f04139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 1 -- 172.21.15.181:0/163763069 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2551402133 0 0) 0x7f3f0413a320 con 0x7f3f040a8340 2024-09-13T10:35:43.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 10 monclient(hunting): my global_id is 6150 2024-09-13T10:35:43.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 1 -- 172.21.15.181:0/163763069 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ef0003520 con 0x7f3f040a8340 2024-09-13T10:35:43.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 1 -- 172.21.15.181:0/163763069 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3964743002 0 0) 0x7f3ef0003520 con 0x7f3f040a8340 2024-09-13T10:35:43.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 1 -- 172.21.15.181:0/163763069 >> v1:172.21.15.181:6791/0 conn(0x7f3f0413f750 legacy=0x7f3f04141b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 1 -- 172.21.15.181:0/163763069 >> v1:172.21.15.181:6790/0 conn(0x7f3f040a6640 legacy=0x7f3f04139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 10 monclient: _finish_hunting 0 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 1 monclient: found mon.noname-g 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 1 -- 172.21.15.181:0/163763069 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f040a48e0 con 0x7f3f040a8340 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 10 monclient: _finish_auth 0 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 10 monclient: _check_auth_tickets 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 1 -- 172.21.15.181:0/163763069 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3ef4001ae0 con 0x7f3f040a8340 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3f0b3d5640 5 monclient: authenticate success, global_id 6150 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3f0b3d5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:43.545 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.538+0000 7f3efbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3efbfff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3efbfff640 10 monclient: dump: 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.546 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3f0b3d5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3efbfff640 1 -- 172.21.15.181:0/163763069 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ef40048a0 con 0x7f3f040a8340 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3efbfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3f0b3d5640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3f0b3d5640 4 set_mon_vals no callback set 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3efbfff640 1 -- 172.21.15.181:0/163763069 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3ef4004e50 con 0x7f3f040a8340 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3efbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3efbfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:35:43.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3efbfff640 10 monclient: dump: 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.548 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3f0b3d5640 10 monclient: shutdown 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3f0b3d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/163763069 >> v1:172.21.15.195:6790/0 conn(0x7f3f040a8340 legacy=0x7f3f04139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/163763069 shutdown_connections 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/163763069 >> 172.21.15.181:0/163763069 conn(0x7f3f04077170 msgr2=0x7f3f040abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/163763069 shutdown_connections 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.539+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/163763069 wait complete. 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.540+0000 7f3f0b3d5640 10 monclient: build_initial_monmap 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.540+0000 7f3f0b3d5640 10 monclient: monmap: 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:43.549 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:43.550 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.540+0000 7f3f0b3d5640 1 Processor -- start 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.540+0000 7f3f0b3d5640 1 -- start start 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.540+0000 7f3f0b3d5640 10 monclient: init 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.540+0000 7f3f0b3d5640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.540+0000 7f3f0b3d5640 10 monclient: _add_conns ranks=[2,5,1,3,0,7,6,4,8] 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.540+0000 7f3f0b3d5640 10 monclient(hunting): picked mon.noname-b con 0x7f3f040a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.540+0000 7f3f0b3d5640 10 monclient(hunting): picked mon.noname-h con 0x7f3f0413f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.540+0000 7f3f0b3d5640 10 monclient(hunting): picked mon.noname-f con 0x7f3f041d43a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.540+0000 7f3f0b3d5640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f040a15a0 con 0x7f3f041d43a0 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.540+0000 7f3f09171640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f3f040a8340 legacy=0x7f3f0409d330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.541+0000 7f3f0b3d5640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f040a1180 con 0x7f3f040a8340 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.541+0000 7f3f0b3d5640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f040aa100 con 0x7f3f0413f750 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.541+0000 7f3f0b3d5640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.541+0000 7f3f0b3d5640 10 monclient(hunting): authenticate will time out at 1083.047055s 2024-09-13T10:35:43.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.541+0000 7f3f08970640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f3f0413f750 0x7f3f0409da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:57698/0 (socket says 172.21.15.181:57698) 2024-09-13T10:35:43.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.541+0000 7f3f09972640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f3f041d43a0 0x7f3f041d6790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:42122/0 (socket says 172.21.15.181:42122) 2024-09-13T10:35:43.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.541+0000 7f3f08970640 1 -- 172.21.15.181:0/3730964761 learned_addr learned my addr 172.21.15.181:0/3730964761 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:43.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3f08970640 1 -- 172.21.15.181:0/3730964761 >> v1:172.21.15.195:6791/0 conn(0x7f3f0413f750 legacy=0x7f3f0409da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3f09972640 1 -- 172.21.15.181:0/3730964761 >> v1:172.21.15.195:6789/0 conn(0x7f3f041d43a0 legacy=0x7f3f041d6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2152793178 0 0) 0x7f3f040aa100 con 0x7f3f0413f750 2024-09-13T10:35:43.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 10 monclient(hunting): my global_id is 104288 2024-09-13T10:35:43.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ee8003520 con 0x7f3f0413f750 2024-09-13T10:35:43.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3f09972640 1 --1- 172.21.15.181:0/3730964761 >> v1:172.21.15.195:6789/0 conn(0x7f3f041d43a0 0x7f3f041d6790 :-1 s=OPENED pgs=475 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f3efc004020 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:35:43.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4232592479 0 0) 0x7f3ee8003520 con 0x7f3f0413f750 2024-09-13T10:35:43.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f040aa100 con 0x7f3f0413f750 2024-09-13T10:35:43.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3ef4001a60 con 0x7f3f0413f750 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 10 monclient(hunting): dump: 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.557 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2602275117 0 0) 0x7f3f040aa100 con 0x7f3f0413f750 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 >> v1:172.21.15.181:6790/0 conn(0x7f3f040a8340 legacy=0x7f3f0409d330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 >> v1:172.21.15.195:6789/0 conn(0x7f3f041d43a0 legacy=0x7f3f041d6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 1 monclient: found mon.h 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.543+0000 7f3ef9ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f040a0310 con 0x7f3f0413f750 2024-09-13T10:35:43.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 10 monclient: _finish_auth 0 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3f0b3d5640 5 monclient: authenticate success, global_id 104288 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3f0b3d5640 10 monclient: _renew_subs 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052863872 0 0) 0x7f3efc004020 con 0x7f3f041d43a0 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3f0b3d5640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0409ee20 con 0x7f3f0413f750 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ef4001d30 con 0x7f3f0413f750 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3ef4005680 con 0x7f3f0413f750 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 10 monclient: dump: 2024-09-13T10:35:43.559 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.560 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3f0b3d5640 10 monclient: _renew_subs 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3efb7fe640 4 set_mon_vals no callback set 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3f0b3d5640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f3f040a29e0 con 0x7f3f0413f750 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3ef4011d00 con 0x7f3f0413f750 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3f0b3d5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.544+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3f04142a80 con 0x7f3f04077170 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.545+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(175..175 src has 1..175) ==== 3898+0+0 (unknown 1459661124 0 0) 0x7f3ef404e4a0 con 0x7f3f0413f750 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.545+0000 7f3f09972640 10 monclient: get_auth_request con 0x7f3ee803f940 auth_method 0 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3f09171640 1 -- 172.21.15.181:0/3730964761 >> v1:172.21.15.195:6790/0 conn(0x7f3f04077170 legacy=0x7f3f0413a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 864908734 0 0) 0x7f3f00003d80 con 0x7f3f04077170 2024-09-13T10:35:43.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 10 monclient(hunting): my global_id is 6159 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3efc004020 con 0x7f3f04077170 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1627435546 0 0) 0x7f3efc004020 con 0x7f3f04077170 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f00003d80 con 0x7f3f04077170 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3f00004680 con 0x7f3f04077170 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 10 monclient: dump: 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.562 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2424616237 0 0) 0x7f3f00003d80 con 0x7f3f04077170 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.547+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f0409e1b0 con 0x7f3f04077170 2024-09-13T10:35:43.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.548+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3f000069c0 con 0x7f3f04077170 2024-09-13T10:35:43.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.548+0000 7f3ef9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:43.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.548+0000 7f3ef9ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:43.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.548+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 >> v1:172.21.15.195:6790/0 conn(0x7f3f04077170 legacy=0x7f3f0413a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.548+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 >> v1:172.21.15.195:6790/0 conn(0x7f3f04077170 legacy=0x7f3f0413a4e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.554+0000 7f3f0b3d5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:43.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.554+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3f04143260 con 0x7f3f04069b40 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.556+0000 7f3f09171640 1 -- 172.21.15.181:0/3730964761 >> v1:172.21.15.195:6790/0 conn(0x7f3f04069b40 legacy=0x7f3f0413abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.556+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4067443123 0 0) 0x7f3f04143260 con 0x7f3f04069b40 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.556+0000 7f3ef9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.556+0000 7f3ef9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.556+0000 7f3ef9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.556+0000 7f3ef9ffb640 10 monclient(hunting): my global_id is 6168 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.556+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f00003d80 con 0x7f3f04069b40 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3325955698 0 0) 0x7f3f00003d80 con 0x7f3f04069b40 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f04143260 con 0x7f3f04069b40 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3f00005020 con 0x7f3f04069b40 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 10 monclient: dump: 2024-09-13T10:35:43.566 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.567 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1280222834 0 0) 0x7f3f04143260 con 0x7f3f04069b40 2024-09-13T10:35:43.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3f0409fbf0 con 0x7f3f04069b40 2024-09-13T10:35:43.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7695 (unknown 0 0 3322667431) 0x7f3f00006570 con 0x7f3f04069b40 2024-09-13T10:35:43.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:43.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:43.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 >> v1:172.21.15.195:6790/0 conn(0x7f3f04069b40 legacy=0x7f3f0413abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.557+0000 7f3ef9ffb640 1 -- 172.21.15.181:0/3730964761 >> v1:172.21.15.195:6790/0 conn(0x7f3f04069b40 legacy=0x7f3f0413abf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:43.568 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:43.568 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:43.568 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:43.568 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 96, 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 357973, 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:43.569 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:43.570 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:43.571 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:43.572 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:43.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.575 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:43.576 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.578 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.579 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:43.580 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.581 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.582 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.583 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.584 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.585 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.586 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:43.587 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:43.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.558+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/3730964761 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3ee803f940 legacy=0x7f3ee8041e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.558+0000 7f3f0b3d5640 10 monclient: shutdown 2024-09-13T10:35:43.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.558+0000 7f3f0b3d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:43.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.558+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/3730964761 >> v1:172.21.15.195:6791/0 conn(0x7f3f0413f750 legacy=0x7f3f0409da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.558+0000 7f3f09972640 1 -- 172.21.15.181:0/3730964761 reap_dead start 2024-09-13T10:35:43.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.558+0000 7f3f09972640 1 -- 172.21.15.181:0/3730964761 reap_dead start 2024-09-13T10:35:43.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.558+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/3730964761 shutdown_connections 2024-09-13T10:35:43.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.558+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/3730964761 >> 172.21.15.181:0/3730964761 conn(0x7f3f040a6640 msgr2=0x7f3f04141b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:43.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.558+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/3730964761 shutdown_connections 2024-09-13T10:35:43.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.558+0000 7f3f0b3d5640 1 -- 172.21.15.181:0/3730964761 wait complete. 2024-09-13T10:35:43.590 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:35:43.590 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon h 2024-09-13T10:35:43.590 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:35:43.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.685+0000 7f3fd53bb640 10 monclient: get_monmap_and_config 2024-09-13T10:35:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.685+0000 7f3fd53bb640 10 monclient: build_initial_monmap 2024-09-13T10:35:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.685+0000 7f3fd53bb640 10 monclient: monmap: 2024-09-13T10:35:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:43.687134+0000 2024-09-13T10:35:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:43.687134+0000 2024-09-13T10:35:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:43.688 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:43.689 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:43.689 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:43.689 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:43.689 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:43.689 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:43.689 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 1 Processor -- start 2024-09-13T10:35:43.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 1 -- start start 2024-09-13T10:35:43.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 10 monclient: init 2024-09-13T10:35:43.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:43.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 10 monclient: _add_conns ranks=[1,7,2,0,6,5,8,3,4] 2024-09-13T10:35:43.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 10 monclient(hunting): picked mon.noname-f con 0x7f3fd00a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:43.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 10 monclient(hunting): picked mon.noname-i con 0x7f3fd00a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:43.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 10 monclient(hunting): picked mon.noname-b con 0x7f3fd013f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:43.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd00a5fe0 con 0x7f3fd00a66d0 2024-09-13T10:35:43.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd00a8080 con 0x7f3fd013f9a0 2024-09-13T10:35:43.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd00a42c0 con 0x7f3fd00a6ab0 2024-09-13T10:35:43.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:43.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fcf7fe640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f3fd013f9a0 legacy=0x7f3fd0141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:35:43.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.686+0000 7f3fd53bb640 10 monclient(hunting): authenticate will time out at 1083.192767s 2024-09-13T10:35:43.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.687+0000 7f3fce7fc640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f3fd00a6ab0 0x7f3fd00a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:54692/0 (socket says 172.21.15.181:54692) 2024-09-13T10:35:43.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.687+0000 7f3fce7fc640 1 -- 172.21.15.181:0/1532346215 learned_addr learned my addr 172.21.15.181:0/1532346215 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:43.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.689+0000 7f3fceffd640 1 -- 172.21.15.181:0/1532346215 >> v1:172.21.15.195:6789/0 conn(0x7f3fd00a66d0 legacy=0x7f3fd00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.689+0000 7f3fce7fc640 1 -- 172.21.15.181:0/1532346215 >> v1:172.21.15.195:6792/0 conn(0x7f3fd00a6ab0 legacy=0x7f3fd00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.693+0000 7f3fcdffb640 1 -- 172.21.15.181:0/1532346215 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1805330514 0 0) 0x7f3fd00a5fe0 con 0x7f3fd00a66d0 2024-09-13T10:35:43.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.693+0000 7f3fcdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.693+0000 7f3fcdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.693+0000 7f3fcdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.693+0000 7f3fcdffb640 10 monclient(hunting): my global_id is 56440 2024-09-13T10:35:43.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.693+0000 7f3fcdffb640 1 -- 172.21.15.181:0/1532346215 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fbc003520 con 0x7f3fd00a66d0 2024-09-13T10:35:43.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.696+0000 7f3fcdffb640 1 -- 172.21.15.181:0/1532346215 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177794279 0 0) 0x7f3fd00a42c0 con 0x7f3fd00a6ab0 2024-09-13T10:35:43.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.696+0000 7f3fcdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.696+0000 7f3fcdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.696+0000 7f3fcdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.696+0000 7f3fcdffb640 10 monclient(hunting): my global_id is 56311 2024-09-13T10:35:43.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.696+0000 7f3fcdffb640 1 -- 172.21.15.181:0/1532346215 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd00a5fe0 con 0x7f3fd00a6ab0 2024-09-13T10:35:43.700 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:43.700 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38304]: starting. 2024-09-13T10:35:43.700 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38304]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38266 2024-09-13T10:35:43.700 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38304]: shutting down. 2024-09-13T10:35:43.702 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:43.702 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:43.702 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:35:43.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 1 -- 172.21.15.181:0/1532346215 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2065449597 0 0) 0x7f3fbc003520 con 0x7f3fd00a66d0 2024-09-13T10:35:43.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 1 -- 172.21.15.181:0/1532346215 >> v1:172.21.15.195:6792/0 conn(0x7f3fd00a6ab0 legacy=0x7f3fd00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 1 -- 172.21.15.181:0/1532346215 >> v1:172.21.15.181:6790/0 conn(0x7f3fd013f9a0 legacy=0x7f3fd0141d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:35:43.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 10 monclient: _finish_hunting 0 2024-09-13T10:35:43.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 1 monclient: found mon.noname-f 2024-09-13T10:35:43.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:43.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:35:43.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 1 -- 172.21.15.181:0/1532346215 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd01464e0 con 0x7f3fd00a66d0 2024-09-13T10:35:43.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 10 monclient: _finish_auth 0 2024-09-13T10:35:43.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 10 monclient: _check_auth_tickets 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 1 -- 172.21.15.181:0/1532346215 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3fc0001b20 con 0x7f3fd00a66d0 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fd53bb640 5 monclient: authenticate success, global_id 56440 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fd53bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 10 monclient: dump: 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.707 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fd53bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 1 -- 172.21.15.181:0/1532346215 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fc0003610 con 0x7f3fd00a66d0 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:43.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 1 -- 172.21.15.181:0/1532346215 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3fc0003b80 con 0x7f3fd00a66d0 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fd53bb640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fd53bb640 4 set_mon_vals no callback set 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.702+0000 7f3fcdffb640 10 monclient: dump: 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.709 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.703+0000 7f3fd53bb640 10 monclient: shutdown 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.703+0000 7f3fd53bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.703+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1532346215 >> v1:172.21.15.195:6789/0 conn(0x7f3fd00a66d0 legacy=0x7f3fd00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.703+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1532346215 shutdown_connections 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.703+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1532346215 >> 172.21.15.181:0/1532346215 conn(0x7f3fd00abcd0 msgr2=0x7f3fd00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.703+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1532346215 shutdown_connections 2024-09-13T10:35:43.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.703+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1532346215 wait complete. 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.704+0000 7f3fd53bb640 10 monclient: build_initial_monmap 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.704+0000 7f3fd53bb640 10 monclient: monmap: 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:43.711 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:43.712 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:43.712 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:43.712 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.713 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:35:43.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.704+0000 7f3fd53bb640 1 Processor -- start 2024-09-13T10:35:43.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.704+0000 7f3fd53bb640 1 -- start start 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.704+0000 7f3fd53bb640 10 monclient: init 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fd53bb640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fd53bb640 10 monclient: _add_conns ranks=[2,7,8,1,0,5,4,6,3] 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fd53bb640 10 monclient(hunting): picked mon.noname-b con 0x7f3fd00a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fd53bb640 10 monclient(hunting): picked mon.noname-i con 0x7f3fd00a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fd53bb640 10 monclient(hunting): picked mon.noname-e con 0x7f3fd013f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fd53bb640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd013ea70 con 0x7f3fd00a66d0 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fd53bb640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd013ed50 con 0x7f3fd00a6ab0 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fd53bb640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd013f310 con 0x7f3fd013f9a0 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fceffd640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f3fd00a66d0 legacy=0x7f3fd01ce6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fd53bb640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fd53bb640 10 monclient(hunting): authenticate will time out at 1083.211617s 2024-09-13T10:35:43.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fcf7fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f3fd013f9a0 0x7f3fd01d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:51122/0 (socket says 172.21.15.181:51122) 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.705+0000 7f3fcf7fe640 1 -- 172.21.15.181:0/1977703906 learned_addr learned my addr 172.21.15.181:0/1977703906 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.707+0000 7f3fcf7fe640 1 -- 172.21.15.181:0/1977703906 >> v1:172.21.15.181:6793/0 conn(0x7f3fd013f9a0 legacy=0x7f3fd01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.707+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455944720 0 0) 0x7f3fd013f310 con 0x7f3fd013f9a0 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.707+0000 7f3fc77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.707+0000 7f3fc77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.707+0000 7f3fc77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient(hunting): my global_id is 104363 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fb0003520 con 0x7f3fd013f9a0 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fce7fc640 1 -- 172.21.15.181:0/1977703906 >> v1:172.21.15.195:6792/0 conn(0x7f3fd00a6ab0 legacy=0x7f3fd01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2082788525 0 0) 0x7f3fb0003520 con 0x7f3fd013f9a0 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fd013f310 con 0x7f3fd013f9a0 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3fc8004910 con 0x7f3fd013f9a0 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:43.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient(hunting): dump: 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.722 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383429877 0 0) 0x7f3fd013ed50 con 0x7f3fd00a6ab0 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient(hunting): my global_id is 56320 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fb0003520 con 0x7f3fd00a6ab0 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2671171622 0 0) 0x7f3fd013f310 con 0x7f3fd013f9a0 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 >> v1:172.21.15.195:6792/0 conn(0x7f3fd00a6ab0 legacy=0x7f3fd01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 >> v1:172.21.15.181:6790/0 conn(0x7f3fd00a66d0 legacy=0x7f3fd01ce6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:35:43.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient: _finish_hunting 0 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 monclient: found mon.e 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd00688a0 con 0x7f3fd013f9a0 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient: _finish_auth 0 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient: _check_auth_tickets 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fd53bb640 5 monclient: authenticate success, global_id 104363 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fd53bb640 10 monclient: _renew_subs 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fd53bb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd0142db0 con 0x7f3fd013f9a0 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fd53bb640 10 monclient: _renew_subs 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fd53bb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:35:43.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f3fd013d8e0 con 0x7f3fd013f9a0 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fc8004c20 con 0x7f3fd013f9a0 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fcd7fa640 4 set_mon_vals no callback set 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3fc8005110 con 0x7f3fd013f9a0 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.708+0000 7f3fc77fe640 10 monclient: dump: 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.725 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.709+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3fc80053b0 con 0x7f3fd013f9a0 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.709+0000 7f3fd53bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.709+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3fd0074d40 con 0x7f3fd013c680 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.709+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(176..176 src has 1..176) ==== 3506+0+0 (unknown 3784142957 0 0) 0x7f3fc804e600 con 0x7f3fd013f9a0 2024-09-13T10:35:43.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.709+0000 7f3fce7fc640 10 monclient: get_auth_request con 0x7f3fb003faa0 auth_method 0 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.711+0000 7f3fceffd640 1 -- 172.21.15.181:0/1977703906 >> v1:172.21.15.195:6791/0 conn(0x7f3fd013c680 legacy=0x7f3fd013fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.711+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4101456258 0 0) 0x7f3fd01464e0 con 0x7f3fd013c680 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.711+0000 7f3fc77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.711+0000 7f3fc77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.711+0000 7f3fc77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.711+0000 7f3fc77fe640 10 monclient(hunting): my global_id is 104297 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.711+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd013f310 con 0x7f3fd013c680 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1555058453 0 0) 0x7f3fd013f310 con 0x7f3fd013c680 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fd01464e0 con 0x7f3fd013c680 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3fc0003b40 con 0x7f3fd013c680 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 10 monclient: dump: 2024-09-13T10:35:43.727 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.728 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1276790590 0 0) 0x7f3fd01464e0 con 0x7f3fd013c680 2024-09-13T10:35:43.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fd00a4bf0 con 0x7f3fd013c680 2024-09-13T10:35:43.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3fc0001350 con 0x7f3fd013c680 2024-09-13T10:35:43.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:43.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:43.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 >> v1:172.21.15.195:6791/0 conn(0x7f3fd013c680 legacy=0x7f3fd013fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.712+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 >> v1:172.21.15.195:6791/0 conn(0x7f3fd013c680 legacy=0x7f3fd013fd80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:43.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.718+0000 7f3fd53bb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:43.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.718+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3fd00a3240 con 0x7f3fd01cedd0 2024-09-13T10:35:43.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.720+0000 7f3fceffd640 1 -- 172.21.15.181:0/1977703906 >> v1:172.21.15.195:6791/0 conn(0x7f3fd01cedd0 legacy=0x7f3fd0140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 715225798 0 0) 0x7f3fd00a3240 con 0x7f3fd01cedd0 2024-09-13T10:35:43.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 10 monclient(hunting): my global_id is 104306 2024-09-13T10:35:43.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd01464e0 con 0x7f3fd01cedd0 2024-09-13T10:35:43.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3661494223 0 0) 0x7f3fd01464e0 con 0x7f3fd01cedd0 2024-09-13T10:35:43.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fd00a3240 con 0x7f3fd01cedd0 2024-09-13T10:35:43.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3fc0003ec0 con 0x7f3fd01cedd0 2024-09-13T10:35:43.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:35:43.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 10 monclient: dump: 2024-09-13T10:35:43.738 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.739 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.739 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.739 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.739 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.739 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.739 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.739 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.739 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.739 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.740 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.740 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.740 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.740 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.740 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.740 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2782316508 0 0) 0x7f3fd00a3240 con 0x7f3fd01cedd0 2024-09-13T10:35:43.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3fd01cf1b0 con 0x7f3fd01cedd0 2024-09-13T10:35:43.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7692 (unknown 0 0 436866711) 0x7f3fc0003ff0 con 0x7f3fd01cedd0 2024-09-13T10:35:43.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:43.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:43.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 >> v1:172.21.15.195:6791/0 conn(0x7f3fd01cedd0 legacy=0x7f3fd0140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.721+0000 7f3fc77fe640 1 -- 172.21.15.181:0/1977703906 >> v1:172.21.15.195:6791/0 conn(0x7f3fd01cedd0 legacy=0x7f3fd0140490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:43.742 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:43.742 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:43.742 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:43.742 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:43.742 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 96, 2024-09-13T10:35:43.742 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 27422, 2024-09-13T10:35:43.743 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:43.743 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:43.743 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:43.743 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:43.743 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:43.743 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:43.743 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:43.743 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.744 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:35:43.744 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:43.744 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:43.744 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:43.744 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.744 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.744 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.744 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.744 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.745 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.745 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.745 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.745 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.745 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.745 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.746 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.746 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:43.746 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:43.746 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.746 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.747 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.747 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.747 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.747 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.747 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.747 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.747 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.748 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.748 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.748 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.748 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:43.748 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:43.748 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:43.748 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:43.748 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:43.748 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:43.748 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:43.749 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:43.749 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:43.749 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:43.749 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:43.749 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:43.749 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:43.749 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:43.749 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:43.749 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:43.749 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:43.749 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.749 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.750 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.750 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.750 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.750 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.750 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.750 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.750 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.750 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.750 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.750 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.750 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:43.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.751 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:43.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.751 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:43.751 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:43.751 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.751 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.752 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.752 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:43.752 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.752 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.752 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.753 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:43.753 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:43.753 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.754 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.754 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.754 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:43.754 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:43.754 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.755 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.755 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.755 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:43.755 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.755 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.755 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.755 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:43.755 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:43.755 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.755 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.756 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.756 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:43.756 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:43.756 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.756 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.756 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.756 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:43.756 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.756 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.757 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:43.757 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:43.757 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.757 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.757 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.757 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:43.758 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:43.758 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.758 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.758 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.758 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:43.758 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.758 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.758 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.759 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:43.760 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.761 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.762 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.762 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:43.762 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:43.762 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.762 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.762 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.762 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:43.762 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.762 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.763 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.763 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:43.763 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:43.763 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.763 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.763 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.763 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:43.763 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:43.763 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.764 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.765 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:43.765 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:43.765 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.765 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.765 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.765 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:43.765 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.765 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:43.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:43.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.768 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.768 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.768 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:43.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.768 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.768 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:43.768 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:43.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.722+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1977703906 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3fb003faa0 legacy=0x7f3fb0041f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.722+0000 7f3fd53bb640 10 monclient: shutdown 2024-09-13T10:35:43.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.722+0000 7f3fd53bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:43.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.722+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1977703906 >> v1:172.21.15.181:6793/0 conn(0x7f3fd013f9a0 legacy=0x7f3fd01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.722+0000 7f3fcf7fe640 1 -- 172.21.15.181:0/1977703906 reap_dead start 2024-09-13T10:35:43.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.722+0000 7f3fcf7fe640 1 -- 172.21.15.181:0/1977703906 reap_dead start 2024-09-13T10:35:43.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.722+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1977703906 shutdown_connections 2024-09-13T10:35:43.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.722+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1977703906 >> 172.21.15.181:0/1977703906 conn(0x7f3fd00abcd0 msgr2=0x7f3fd00a8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:43.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.722+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1977703906 shutdown_connections 2024-09-13T10:35:43.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.722+0000 7f3fd53bb640 1 -- 172.21.15.181:0/1977703906 wait complete. 2024-09-13T10:35:43.771 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:35:43.771 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon i 2024-09-13T10:35:43.771 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:35:43.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.867+0000 7f4b2c868640 10 monclient: get_monmap_and_config 2024-09-13T10:35:43.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.867+0000 7f4b2c868640 10 monclient: build_initial_monmap 2024-09-13T10:35:43.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.867+0000 7f4b2c868640 10 monclient: monmap: 2024-09-13T10:35:43.870 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:43.870 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.870 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:35:43.868930+0000 2024-09-13T10:35:43.870 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:35:43.868930+0000 2024-09-13T10:35:43.870 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:43.870 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.870 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:43.870 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:43.871 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:43.871 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:43.871 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:43.871 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:43.871 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:43.871 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:43.871 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:43.871 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.867+0000 7f4b2c868640 1 Processor -- start 2024-09-13T10:35:43.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.867+0000 7f4b2c868640 1 -- start start 2024-09-13T10:35:43.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.867+0000 7f4b2c868640 10 monclient: init 2024-09-13T10:35:43.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b2c868640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:43.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b2c868640 10 monclient: _add_conns ranks=[0,6,8,2,4,1,3,7,5] 2024-09-13T10:35:43.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b2c868640 10 monclient(hunting): picked mon.noname-a con 0x7f4b280a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:43.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b2c868640 10 monclient(hunting): picked mon.noname-d con 0x7f4b280a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:35:43.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b2c868640 10 monclient(hunting): picked mon.noname-e con 0x7f4b2813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:35:43.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b2c868640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b280a4bc0 con 0x7f4b280a6640 2024-09-13T10:35:43.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b2c868640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b2813a320 con 0x7f4b280a8340 2024-09-13T10:35:43.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b2c868640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b280a8100 con 0x7f4b2813f750 2024-09-13T10:35:43.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b2c868640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:43.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b2c868640 10 monclient(hunting): authenticate will time out at 1083.374611s 2024-09-13T10:35:43.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b2659c640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f4b280a6640 legacy=0x7f4b28139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:35:43.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b25d9b640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f4b280a8340 0x7f4b28139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:53664/0 (socket says 172.21.15.181:53664) 2024-09-13T10:35:43.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b25d9b640 1 -- 172.21.15.181:0/3454152497 learned_addr learned my addr 172.21.15.181:0/3454152497 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:43.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.868+0000 7f4b26d9d640 1 --1- 172.21.15.181:0/3454152497 >> v1:172.21.15.181:6793/0 conn(0x7f4b2813f750 0x7f4b28141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:51136/0 (socket says 172.21.15.181:51136) 2024-09-13T10:35:43.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.870+0000 7f4b26d9d640 1 -- 172.21.15.181:0/3454152497 >> v1:172.21.15.181:6793/0 conn(0x7f4b2813f750 legacy=0x7f4b28141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.870+0000 7f4b25d9b640 1 -- 172.21.15.181:0/3454152497 >> v1:172.21.15.181:6792/0 conn(0x7f4b280a8340 legacy=0x7f4b28139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 1 -- 172.21.15.181:0/3454152497 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879660598 0 0) 0x7f4b2813a320 con 0x7f4b280a8340 2024-09-13T10:35:43.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient(hunting): my global_id is 6243 2024-09-13T10:35:43.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 1 -- 172.21.15.181:0/3454152497 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b10003520 con 0x7f4b280a8340 2024-09-13T10:35:43.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 1 -- 172.21.15.181:0/3454152497 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3222631410 0 0) 0x7f4b280a8100 con 0x7f4b2813f750 2024-09-13T10:35:43.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient(hunting): my global_id is 104372 2024-09-13T10:35:43.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 1 -- 172.21.15.181:0/3454152497 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b2813a320 con 0x7f4b2813f750 2024-09-13T10:35:43.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 1 -- 172.21.15.181:0/3454152497 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2154850026 0 0) 0x7f4b10003520 con 0x7f4b280a8340 2024-09-13T10:35:43.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 1 -- 172.21.15.181:0/3454152497 >> v1:172.21.15.181:6793/0 conn(0x7f4b2813f750 legacy=0x7f4b28141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 1 -- 172.21.15.181:0/3454152497 >> v1:172.21.15.181:6789/0 conn(0x7f4b280a6640 legacy=0x7f4b28139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:35:43.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient: _finish_hunting 0 2024-09-13T10:35:43.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 1 monclient: found mon.noname-d 2024-09-13T10:35:43.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:43.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:35:43.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 1 -- 172.21.15.181:0/3454152497 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b280a48e0 con 0x7f4b280a8340 2024-09-13T10:35:43.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient: _finish_auth 0 2024-09-13T10:35:43.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient: _check_auth_tickets 2024-09-13T10:35:43.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:43.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2c868640 5 monclient: authenticate success, global_id 6243 2024-09-13T10:35:43.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2c868640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:43.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 1 -- 172.21.15.181:0/3454152497 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b1c001ae0 con 0x7f4b280a8340 2024-09-13T10:35:43.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:35:43.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient: dump: 2024-09-13T10:35:43.882 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.882 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.882 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.882 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.882 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.882 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.882 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.882 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.882 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.882 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.882 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.882 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2c868640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 1 -- 172.21.15.181:0/3454152497 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b1c0048a0 con 0x7f4b280a8340 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 1 -- 172.21.15.181:0/3454152497 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b1c004e10 con 0x7f4b280a8340 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2c868640 10 monclient: get_monmap_and_config success 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2c868640 4 set_mon_vals no callback set 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:35:43.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2559a640 10 monclient: dump: 2024-09-13T10:35:43.884 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.884 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.884 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.884 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.884 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.884 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.884 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.884 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.884 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.884 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.884 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.884 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2c868640 10 monclient: shutdown 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2c868640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2c868640 1 -- 172.21.15.181:0/3454152497 >> v1:172.21.15.181:6792/0 conn(0x7f4b280a8340 legacy=0x7f4b28139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2c868640 1 -- 172.21.15.181:0/3454152497 shutdown_connections 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2c868640 1 -- 172.21.15.181:0/3454152497 >> 172.21.15.181:0/3454152497 conn(0x7f4b28077170 msgr2=0x7f4b280abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.871+0000 7f4b2c868640 1 -- 172.21.15.181:0/3454152497 shutdown_connections 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.872+0000 7f4b2c868640 1 -- 172.21.15.181:0/3454152497 wait complete. 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.872+0000 7f4b2c868640 10 monclient: build_initial_monmap 2024-09-13T10:35:43.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.872+0000 7f4b2c868640 10 monclient: monmap: 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:35:43.886 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.872+0000 7f4b2c868640 1 Processor -- start 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2c868640 1 -- start start 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2c868640 10 monclient: init 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2c868640 10 monclient: _reopen_session rank -1 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2c868640 10 monclient: _add_conns ranks=[7,0,1,5,2,8,4,6,3] 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2c868640 10 monclient(hunting): picked mon.noname-i con 0x7f4b280a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2c868640 10 monclient(hunting): picked mon.noname-a con 0x7f4b2813f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2c868640 10 monclient(hunting): picked mon.noname-f con 0x7f4b2813e550 addr v1:172.21.15.195:6789/0 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2c868640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b2813d030 con 0x7f4b2813f750 2024-09-13T10:35:43.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2c868640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b28142df0 con 0x7f4b2813e550 2024-09-13T10:35:43.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2c868640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b2813c4d0 con 0x7f4b280a8340 2024-09-13T10:35:43.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2c868640 10 monclient(hunting): _renew_subs 2024-09-13T10:35:43.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b25d9b640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f4b2813f750 legacy=0x7f4b281d3580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:35:43.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2c868640 10 monclient(hunting): authenticate will time out at 1083.379520s 2024-09-13T10:35:43.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b26d9d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f4b2813e550 0x7f4b281d6cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:42128/0 (socket says 172.21.15.181:42128) 2024-09-13T10:35:43.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b2659c640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f4b280a8340 0x7f4b281ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:54712/0 (socket says 172.21.15.181:54712) 2024-09-13T10:35:43.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.873+0000 7f4b26d9d640 1 -- 172.21.15.181:0/1922540961 learned_addr learned my addr 172.21.15.181:0/1922540961 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:35:43.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.875+0000 7f4b26d9d640 1 -- 172.21.15.181:0/1922540961 >> v1:172.21.15.195:6789/0 conn(0x7f4b2813e550 legacy=0x7f4b281d6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.875+0000 7f4b2659c640 1 -- 172.21.15.181:0/1922540961 >> v1:172.21.15.195:6792/0 conn(0x7f4b280a8340 legacy=0x7f4b281ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2767446348 0 0) 0x7f4b28142df0 con 0x7f4b2813e550 2024-09-13T10:35:43.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): my global_id is 56467 2024-09-13T10:35:43.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b08003520 con 0x7f4b2813e550 2024-09-13T10:35:43.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826586175 0 0) 0x7f4b2813c4d0 con 0x7f4b280a8340 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): my global_id is 56338 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b28142df0 con 0x7f4b280a8340 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2630928235 0 0) 0x7f4b08003520 con 0x7f4b2813e550 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b2813c4d0 con 0x7f4b2813e550 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b20002050 con 0x7f4b2813e550 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): dump: 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.895 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.896 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 507085063 0 0) 0x7f4b28142df0 con 0x7f4b280a8340 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b08003520 con 0x7f4b280a8340 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b180046a0 con 0x7f4b280a8340 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient(hunting): dump: 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.897 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1262153715 0 0) 0x7f4b2813c4d0 con 0x7f4b2813e550 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 >> v1:172.21.15.195:6792/0 conn(0x7f4b280a8340 legacy=0x7f4b281ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 >> v1:172.21.15.181:6789/0 conn(0x7f4b2813f750 legacy=0x7f4b281d3580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:35:43.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 monclient: found mon.f 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2813bb60 con 0x7f4b2813e550 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient: _finish_auth 0 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b2c868640 5 monclient: authenticate success, global_id 56467 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b2c868640 10 monclient: _renew_subs 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b2c868640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b2c868640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2813bdf0 con 0x7f4b2813e550 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b2c868640 10 monclient: _renew_subs 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b2c868640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b2c868640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4b281cee30 con 0x7f4b2813e550 2024-09-13T10:35:43.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b20004e90 con 0x7f4b2813e550 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b20005480 con 0x7f4b2813e550 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b16ffd640 10 monclient: dump: 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.900 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.876+0000 7f4b24d99640 4 set_mon_vals no callback set 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.877+0000 7f4b2c868640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.877+0000 7f4b2c868640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4b280aa360 con 0x7f4b28077170 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.877+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4b200056a0 con 0x7f4b2813e550 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.877+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(176..176 src has 1..176) ==== 3506+0+0 (unknown 3784142957 0 0) 0x7f4b2004e550 con 0x7f4b2813e550 2024-09-13T10:35:43.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.877+0000 7f4b25d9b640 10 monclient: get_auth_request con 0x7f4b08040000 auth_method 0 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.879+0000 7f4b2659c640 1 -- 172.21.15.181:0/1922540961 >> v1:172.21.15.195:6792/0 conn(0x7f4b28077170 legacy=0x7f4b2813fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.879+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966595704 0 0) 0x7f4b08003520 con 0x7f4b28077170 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.879+0000 7f4b16ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.879+0000 7f4b16ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.879+0000 7f4b16ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.879+0000 7f4b16ffd640 10 monclient(hunting): my global_id is 56347 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.879+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b2813c4d0 con 0x7f4b28077170 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2033494232 0 0) 0x7f4b2813c4d0 con 0x7f4b28077170 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b08003520 con 0x7f4b28077170 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b18004e40 con 0x7f4b28077170 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:35:43.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 10 monclient: dump: 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.903 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.904 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.904 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.904 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4118366678 0 0) 0x7f4b08003520 con 0x7f4b28077170 2024-09-13T10:35:43.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b280a9d60 con 0x7f4b28077170 2024-09-13T10:35:43.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4b18007120 con 0x7f4b28077170 2024-09-13T10:35:43.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:35:43.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:35:43.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 >> v1:172.21.15.195:6792/0 conn(0x7f4b28077170 legacy=0x7f4b2813fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.880+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 >> v1:172.21.15.195:6792/0 conn(0x7f4b28077170 legacy=0x7f4b2813fb30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:43.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.886+0000 7f4b2c868640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:35:43.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.886+0000 7f4b2c868640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4b2806cab0 con 0x7f4b28069b40 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.888+0000 7f4b2659c640 1 -- 172.21.15.181:0/1922540961 >> v1:172.21.15.195:6792/0 conn(0x7f4b28069b40 legacy=0x7f4b28140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124273826 0 0) 0x7f4b18005270 con 0x7f4b28069b40 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 10 monclient(hunting): my global_id is 56356 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b08003520 con 0x7f4b28069b40 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1843145636 0 0) 0x7f4b08003520 con 0x7f4b28069b40 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b18005270 con 0x7f4b28069b40 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4b180059f0 con 0x7f4b28069b40 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:35:43.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 10 monclient: dump: 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:35:43.906 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:35:43.907 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:35:43.907 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:35:43.907 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:35:43.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3109709931 0 0) 0x7f4b18005270 con 0x7f4b28069b40 2024-09-13T10:35:43.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4b2813e1d0 con 0x7f4b28069b40 2024-09-13T10:35:43.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7860 (unknown 0 0 3823575245) 0x7f4b18006e60 con 0x7f4b28069b40 2024-09-13T10:35:43.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:35:43.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:35:43.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 >> v1:172.21.15.195:6792/0 conn(0x7f4b28069b40 legacy=0x7f4b28140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.889+0000 7f4b16ffd640 1 -- 172.21.15.181:0/1922540961 >> v1:172.21.15.195:6792/0 conn(0x7f4b28069b40 legacy=0x7f4b28140240 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:35:43.908 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:35:43.908 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:43.908 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:43.908 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:35:43.908 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 96, 2024-09-13T10:35:43.908 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 358310, 2024-09-13T10:35:43.908 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:35:43.908 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:35:43.908 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:35:43.908 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.909 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.910 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.910 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.910 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.910 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.910 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.910 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.910 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.910 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:35:43.910 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:35:43.910 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.910 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.910 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:35:43.911 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:35:43.912 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:35:43.912 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:35:43.912 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:35:43.912 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:43.912 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:35:43.912 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:35:43.912 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:35:43.912 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:35:43.912 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:35:43.912 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:35:43.912 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:35:43.912 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:35:43.913 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:35:43.914 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.914 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:35:43.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.914 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:35:43.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.914 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:35:43.914 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:35:43.914 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.914 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:35:43.915 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.916 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.917 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:35:43.918 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:35:43.918 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.918 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.918 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.918 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:35:43.919 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:35:43.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.919 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:35:43.919 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.919 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.919 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:35:43.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:35:43.920 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:35:43.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.922 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:35:43.922 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.922 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.922 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:35:43.922 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:35:43.922 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.922 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.923 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.923 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:35:43.923 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:35:43.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.923 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:35:43.923 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.923 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.924 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.926 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:43.927 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.928 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:35:43.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.929 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:35:43.929 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:35:43.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:35:43.929 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:35:43.929 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:35:43.929 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:35:43.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:35:43.929 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:35:43.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:35:43.929 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:35:43.929 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:35:43.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.890+0000 7f4b2c868640 1 -- 172.21.15.181:0/1922540961 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4b08040000 legacy=0x7f4b080424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.890+0000 7f4b2c868640 10 monclient: shutdown 2024-09-13T10:35:43.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.890+0000 7f4b2c868640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:35:43.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.890+0000 7f4b2c868640 1 -- 172.21.15.181:0/1922540961 >> v1:172.21.15.195:6789/0 conn(0x7f4b2813e550 legacy=0x7f4b281d6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:35:43.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.890+0000 7f4b26d9d640 1 -- 172.21.15.181:0/1922540961 reap_dead start 2024-09-13T10:35:43.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.890+0000 7f4b26d9d640 1 -- 172.21.15.181:0/1922540961 reap_dead start 2024-09-13T10:35:43.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.890+0000 7f4b2c868640 1 -- 172.21.15.181:0/1922540961 shutdown_connections 2024-09-13T10:35:43.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.890+0000 7f4b2c868640 1 -- 172.21.15.181:0/1922540961 >> 172.21.15.181:0/1922540961 conn(0x7f4b280a6640 msgr2=0x7f4b280a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:35:43.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.890+0000 7f4b2c868640 1 -- 172.21.15.181:0/1922540961 shutdown_connections 2024-09-13T10:35:43.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:35:43.890+0000 7f4b2c868640 1 -- 172.21.15.181:0/1922540961 wait complete. 2024-09-13T10:35:43.931 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:35:43.932 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T10:35:45.820 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38376]: starting. 2024-09-13T10:35:45.820 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38376]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38375 2024-09-13T10:35:45.821 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38376]: created object 0... 2024-09-13T10:35:45.821 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38376]: created object 25... 2024-09-13T10:35:45.821 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38376]: created object 49... 2024-09-13T10:35:45.821 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38376]: finishing. 2024-09-13T10:35:45.821 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38376]: shutting down. 2024-09-13T10:35:46.731 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38377]: starting. 2024-09-13T10:35:46.731 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38377]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38375 2024-09-13T10:35:46.731 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38377]: shutting down. 2024-09-13T10:35:48.849 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:48.849 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38412]: starting. 2024-09-13T10:35:48.849 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38412]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38375 2024-09-13T10:35:48.849 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38412]: created object 0... 2024-09-13T10:35:48.849 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38412]: created object 25... 2024-09-13T10:35:48.849 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38412]: created object 49... 2024-09-13T10:35:48.849 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38412]: finishing. 2024-09-13T10:35:48.849 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38412]: shutting down. 2024-09-13T10:35:48.885 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:48.885 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38414]: starting. 2024-09-13T10:35:48.885 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38414]: listing objects. 2024-09-13T10:35:48.886 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38414]: listed object 0... 2024-09-13T10:35:48.886 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38414]: listed object 25... 2024-09-13T10:35:48.886 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38414]: saw 50 objects 2024-09-13T10:35:48.886 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38414]: shutting down. 2024-09-13T10:35:49.754 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:49.755 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38413]: starting. 2024-09-13T10:35:49.755 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38413]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38375 2024-09-13T10:35:49.755 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38413]: shutting down. 2024-09-13T10:35:49.757 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:49.757 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:49.757 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:35:49.760 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:35:52.334 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38483]: starting. 2024-09-13T10:35:52.334 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38483]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38482 2024-09-13T10:35:52.334 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38483]: created object 0... 2024-09-13T10:35:52.334 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38483]: created object 25... 2024-09-13T10:35:52.335 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38483]: created object 49... 2024-09-13T10:35:52.335 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38483]: finishing. 2024-09-13T10:35:52.335 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38483]: shutting down. 2024-09-13T10:35:53.238 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38484]: starting. 2024-09-13T10:35:53.238 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38484]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38482 2024-09-13T10:35:53.238 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38484]: shutting down. 2024-09-13T10:35:55.733 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:55.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38519]: starting. 2024-09-13T10:35:55.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38519]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38482 2024-09-13T10:35:55.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38519]: created object 0... 2024-09-13T10:35:55.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38519]: created object 25... 2024-09-13T10:35:55.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38519]: created object 49... 2024-09-13T10:35:55.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38519]: finishing. 2024-09-13T10:35:55.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38519]: shutting down. 2024-09-13T10:35:56.105 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:56.105 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38521]: starting. 2024-09-13T10:35:56.105 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38521]: listing objects. 2024-09-13T10:35:56.106 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38521]: listed object 0... 2024-09-13T10:35:56.106 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38521]: listed object 25... 2024-09-13T10:35:56.106 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38521]: saw 50 objects 2024-09-13T10:35:56.106 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38521]: shutting down. 2024-09-13T10:35:58.781 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:58.782 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38520]: starting. 2024-09-13T10:35:58.782 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38520]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38482 2024-09-13T10:35:58.782 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38520]: shutting down. 2024-09-13T10:35:58.783 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:58.783 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:35:58.783 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:35:58.786 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:36:00.745 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38590]: starting. 2024-09-13T10:36:00.745 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38590]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38589 2024-09-13T10:36:00.746 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38590]: created object 0... 2024-09-13T10:36:00.746 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38590]: created object 25... 2024-09-13T10:36:00.746 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38590]: created object 49... 2024-09-13T10:36:00.746 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38590]: finishing. 2024-09-13T10:36:00.746 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38590]: shutting down. 2024-09-13T10:36:01.646 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38591]: starting. 2024-09-13T10:36:01.647 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38591]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38589 2024-09-13T10:36:01.647 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38591]: shutting down. 2024-09-13T10:36:03.746 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:03.746 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38626]: starting. 2024-09-13T10:36:03.746 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38626]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38589 2024-09-13T10:36:03.746 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38626]: created object 0... 2024-09-13T10:36:03.747 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38626]: created object 25... 2024-09-13T10:36:03.747 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38626]: created object 49... 2024-09-13T10:36:03.747 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38626]: finishing. 2024-09-13T10:36:03.747 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38626]: shutting down. 2024-09-13T10:36:03.783 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:03.783 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38628]: starting. 2024-09-13T10:36:03.783 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38628]: listing objects. 2024-09-13T10:36:03.783 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38628]: listed object 0... 2024-09-13T10:36:03.783 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38628]: listed object 25... 2024-09-13T10:36:03.783 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38628]: saw 50 objects 2024-09-13T10:36:03.783 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38628]: shutting down. 2024-09-13T10:36:03.932 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-13T10:36:03.933 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T10:36:03.933 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T10:36:03.936 INFO:tasks.ceph.mon.a:Started 2024-09-13T10:36:03.936 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-13T10:36:03.936 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T10:36:03.936 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T10:36:03.938 INFO:tasks.ceph.mon.c:Started 2024-09-13T10:36:03.938 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-13T10:36:03.938 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T10:36:03.938 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T10:36:03.940 INFO:tasks.ceph.mon.b:Started 2024-09-13T10:36:03.940 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-09-13T10:36:03.940 INFO:tasks.ceph.mon.h:Sent signal 19 2024-09-13T10:36:03.940 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-13T10:36:18.942 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-09-13T10:36:18.943 INFO:tasks.ceph.mon.h:Sent signal 18 2024-09-13T10:36:18.943 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:36:18.943 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:36:19.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.053+0000 7f26b653d640 10 monclient: get_monmap_and_config 2024-09-13T10:36:19.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.053+0000 7f26b653d640 10 monclient: build_initial_monmap 2024-09-13T10:36:19.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.053+0000 7f26b653d640 10 monclient: monmap: 2024-09-13T10:36:19.056 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:19.057 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.057 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:19.055289+0000 2024-09-13T10:36:19.057 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:19.055289+0000 2024-09-13T10:36:19.057 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:19.058 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.058 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:19.058 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:19.058 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:19.058 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:19.059 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:19.059 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:19.059 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:19.059 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:19.059 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:19.060 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.054+0000 7f26b653d640 1 Processor -- start 2024-09-13T10:36:19.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.054+0000 7f26b653d640 1 -- start start 2024-09-13T10:36:19.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.054+0000 7f26b653d640 10 monclient: init 2024-09-13T10:36:19.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.054+0000 7f26b653d640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:19.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.054+0000 7f26b653d640 10 monclient: _add_conns ranks=[1,3,8,6,7,2,4,5,0] 2024-09-13T10:36:19.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.054+0000 7f26b653d640 10 monclient(hunting): picked mon.noname-f con 0x7f26b00a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:19.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.054+0000 7f26b653d640 10 monclient(hunting): picked mon.noname-g con 0x7f26b00a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:19.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.054+0000 7f26b653d640 10 monclient(hunting): picked mon.noname-e con 0x7f26b013f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:19.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.055+0000 7f26b653d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b00a5fe0 con 0x7f26b00a66d0 2024-09-13T10:36:19.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.055+0000 7f26b653d640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b00a8080 con 0x7f26b00a6ab0 2024-09-13T10:36:19.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.055+0000 7f26b653d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b00a42c0 con 0x7f26b013f9a0 2024-09-13T10:36:19.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.055+0000 7f26b653d640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:19.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.055+0000 7f26b653d640 10 monclient(hunting): authenticate will time out at 1118.561059s 2024-09-13T10:36:19.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.055+0000 7f26b4ada640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f26b013f9a0 0x7f26b0141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33808/0 (socket says 172.21.15.181:33808) 2024-09-13T10:36:19.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.055+0000 7f26b4ada640 1 -- 172.21.15.181:0/4058393651 learned_addr learned my addr 172.21.15.181:0/4058393651 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:19.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26b4ada640 1 -- 172.21.15.181:0/4058393651 >> v1:172.21.15.181:6793/0 conn(0x7f26b013f9a0 legacy=0x7f26b0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26affff640 1 -- 172.21.15.181:0/4058393651 >> v1:172.21.15.195:6789/0 conn(0x7f26b00a66d0 legacy=0x7f26b00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26af7fe640 1 -- 172.21.15.181:0/4058393651 >> v1:172.21.15.195:6790/0 conn(0x7f26b00a6ab0 legacy=0x7f26b00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177518700 0 0) 0x7f26b00a42c0 con 0x7f26b013f9a0 2024-09-13T10:36:19.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient(hunting): my global_id is 104489 2024-09-13T10:36:19.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2698003520 con 0x7f26b013f9a0 2024-09-13T10:36:19.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396413930 0 0) 0x7f26b00a5fe0 con 0x7f26b00a66d0 2024-09-13T10:36:19.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient(hunting): my global_id is 56539 2024-09-13T10:36:19.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26b00a42c0 con 0x7f26b00a66d0 2024-09-13T10:36:19.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3581548579 0 0) 0x7f26b00a8080 con 0x7f26b00a6ab0 2024-09-13T10:36:19.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient(hunting): my global_id is 6240 2024-09-13T10:36:19.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26b00a5fe0 con 0x7f26b00a6ab0 2024-09-13T10:36:19.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 894555156 0 0) 0x7f2698003520 con 0x7f26b013f9a0 2024-09-13T10:36:19.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 >> v1:172.21.15.195:6790/0 conn(0x7f26b00a6ab0 legacy=0x7f26b00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 >> v1:172.21.15.195:6789/0 conn(0x7f26b00a66d0 legacy=0x7f26b00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient: _finish_hunting 0 2024-09-13T10:36:19.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 monclient: found mon.noname-e 2024-09-13T10:36:19.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:19.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b01464e0 con 0x7f26b013f9a0 2024-09-13T10:36:19.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient: _finish_auth 0 2024-09-13T10:36:19.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient: _check_auth_tickets 2024-09-13T10:36:19.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:19.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f26a8001e50 con 0x7f26b013f9a0 2024-09-13T10:36:19.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26b653d640 5 monclient: authenticate success, global_id 104489 2024-09-13T10:36:19.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26b653d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:19.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:19.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient: dump: 2024-09-13T10:36:19.093 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.093 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.093 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.093 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.093 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.093 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.094 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.094 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.094 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.094 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.094 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.094 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.094 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.094 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.094 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.094 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26b653d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26a8004c20 con 0x7f26b013f9a0 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 1 -- 172.21.15.181:0/4058393651 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f26a8005190 con 0x7f26b013f9a0 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26b653d640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26b653d640 4 set_mon_vals no callback set 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.057+0000 7f26aeffd640 10 monclient: dump: 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.095 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.058+0000 7f26b653d640 10 monclient: shutdown 2024-09-13T10:36:19.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.058+0000 7f26b653d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:19.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.058+0000 7f26b653d640 1 -- 172.21.15.181:0/4058393651 >> v1:172.21.15.181:6793/0 conn(0x7f26b013f9a0 legacy=0x7f26b0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.058+0000 7f26b653d640 1 -- 172.21.15.181:0/4058393651 shutdown_connections 2024-09-13T10:36:19.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.058+0000 7f26b653d640 1 -- 172.21.15.181:0/4058393651 >> 172.21.15.181:0/4058393651 conn(0x7f26b00abcd0 msgr2=0x7f26b00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:19.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.058+0000 7f26b653d640 1 -- 172.21.15.181:0/4058393651 shutdown_connections 2024-09-13T10:36:19.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.058+0000 7f26b653d640 1 -- 172.21.15.181:0/4058393651 wait complete. 2024-09-13T10:36:19.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.059+0000 7f26b653d640 10 monclient: build_initial_monmap 2024-09-13T10:36:19.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.059+0000 7f26b653d640 10 monclient: monmap: 2024-09-13T10:36:19.097 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:19.097 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:19.097 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:19.097 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:19.097 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:19.098 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:19.098 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:19.098 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:19.098 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:19.098 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:19.098 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:19.098 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:19.098 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:19.098 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:19.098 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:19.098 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.059+0000 7f26b653d640 1 Processor -- start 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.059+0000 7f26b653d640 1 -- start start 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.059+0000 7f26b653d640 10 monclient: init 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26b653d640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26b653d640 10 monclient: _add_conns ranks=[5,0,8,4,7,3,1,6,2] 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26b653d640 10 monclient(hunting): picked mon.noname-h con 0x7f26b00a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26b653d640 10 monclient(hunting): picked mon.noname-a con 0x7f26b00a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26b653d640 10 monclient(hunting): picked mon.noname-e con 0x7f26b013f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26b653d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b013ef70 con 0x7f26b00a6ab0 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26b653d640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b013f250 con 0x7f26b00a66d0 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26b653d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b013da50 con 0x7f26b013f9a0 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26b653d640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26b653d640 10 monclient(hunting): authenticate will time out at 1118.566175s 2024-09-13T10:36:19.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26af7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f26b00a6ab0 0x7f26b01d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60074/0 (socket says 172.21.15.181:60074) 2024-09-13T10:36:19.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26b4ada640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f26b013f9a0 0x7f26b01d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33824/0 (socket says 172.21.15.181:33824) 2024-09-13T10:36:19.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.060+0000 7f26af7fe640 1 -- 172.21.15.181:0/4276319126 learned_addr learned my addr 172.21.15.181:0/4276319126 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:19.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26af7fe640 1 -- 172.21.15.181:0/4276319126 >> v1:172.21.15.181:6789/0 conn(0x7f26b00a6ab0 legacy=0x7f26b01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26b4ada640 1 -- 172.21.15.181:0/4276319126 >> v1:172.21.15.181:6793/0 conn(0x7f26b013f9a0 legacy=0x7f26b01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26affff640 1 -- 172.21.15.181:0/4276319126 >> v1:172.21.15.195:6791/0 conn(0x7f26b00a66d0 legacy=0x7f26b01ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2204593272 0 0) 0x7f26b013da50 con 0x7f26b013f9a0 2024-09-13T10:36:19.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): my global_id is 104498 2024-09-13T10:36:19.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f269c003550 con 0x7f26b013f9a0 2024-09-13T10:36:19.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4221908928 0 0) 0x7f26b013ef70 con 0x7f26b00a6ab0 2024-09-13T10:36:19.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): my global_id is 114102 2024-09-13T10:36:19.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26b013da50 con 0x7f26b00a6ab0 2024-09-13T10:36:19.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656380705 0 0) 0x7f26b013f250 con 0x7f26b00a66d0 2024-09-13T10:36:19.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): my global_id is 104405 2024-09-13T10:36:19.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26b013ef70 con 0x7f26b00a66d0 2024-09-13T10:36:19.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3035909872 0 0) 0x7f269c003550 con 0x7f26b013f9a0 2024-09-13T10:36:19.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26b013f250 con 0x7f26b013f9a0 2024-09-13T10:36:19.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4268820616 0 0) 0x7f26b013da50 con 0x7f26b00a6ab0 2024-09-13T10:36:19.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f269c003550 con 0x7f26b00a6ab0 2024-09-13T10:36:19.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f26a80020a0 con 0x7f26b013f9a0 2024-09-13T10:36:19.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:19.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:19.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): dump: 2024-09-13T10:36:19.102 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.102 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.103 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.104 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:19.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f26a4003610 con 0x7f26b00a6ab0 2024-09-13T10:36:19.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:19.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:19.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): dump: 2024-09-13T10:36:19.104 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.104 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.104 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.104 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.104 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.104 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.105 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.105 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.105 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.105 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.105 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.105 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.105 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.105 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.105 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.105 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 670055469 0 0) 0x7f26b013ef70 con 0x7f26b00a66d0 2024-09-13T10:36:19.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26b013da50 con 0x7f26b00a66d0 2024-09-13T10:36:19.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f26a0003950 con 0x7f26b00a66d0 2024-09-13T10:36:19.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.062+0000 7f26acff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:19.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:36:19.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 10 monclient(hunting): dump: 2024-09-13T10:36:19.106 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.106 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.106 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.106 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.106 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.107 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.107 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.107 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.107 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.107 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.107 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.107 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.107 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.107 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.107 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.108 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 946782111 0 0) 0x7f26b013f250 con 0x7f26b013f9a0 2024-09-13T10:36:19.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 >> v1:172.21.15.195:6791/0 conn(0x7f26b00a66d0 legacy=0x7f26b01ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 >> v1:172.21.15.181:6789/0 conn(0x7f26b00a6ab0 legacy=0x7f26b01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 10 monclient: _finish_hunting 0 2024-09-13T10:36:19.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 1 monclient: found mon.e 2024-09-13T10:36:19.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:19.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b01390b0 con 0x7f26b013f9a0 2024-09-13T10:36:19.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 10 monclient: _finish_auth 0 2024-09-13T10:36:19.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 10 monclient: _check_auth_tickets 2024-09-13T10:36:19.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:19.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26b653d640 5 monclient: authenticate success, global_id 104498 2024-09-13T10:36:19.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26b653d640 10 monclient: _renew_subs 2024-09-13T10:36:19.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26b653d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26b653d640 1 -- 172.21.15.181:0/4276319126 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f26b00a28f0 con 0x7f26b013f9a0 2024-09-13T10:36:19.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26b653d640 10 monclient: _renew_subs 2024-09-13T10:36:19.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26b653d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26b653d640 1 -- 172.21.15.181:0/4276319126 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f26b013f670 con 0x7f26b013f9a0 2024-09-13T10:36:19.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26a8004c20 con 0x7f26b013f9a0 2024-09-13T10:36:19.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:19.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f26a8005700 con 0x7f26b013f9a0 2024-09-13T10:36:19.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:19.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26ae7fc640 4 set_mon_vals no callback set 2024-09-13T10:36:19.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 10 monclient: dump: 2024-09-13T10:36:19.110 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.110 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.110 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.110 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.110 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.110 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.110 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.111 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.111 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.111 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.111 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.111 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.111 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.111 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.111 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.111 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.063+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f26a8011d80 con 0x7f26b013f9a0 2024-09-13T10:36:19.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.064+0000 7f26b653d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:19.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.064+0000 7f26b653d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:19.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.064+0000 7f26b653d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.064+0000 7f26b653d640 1 -- 172.21.15.181:0/4276319126 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2690005080 con 0x7f26b013f9a0 2024-09-13T10:36:19.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.064+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(195..195 src has 1..195) ==== 3898+0+0 (unknown 1753709887 0 0) 0x7f26a804e4c0 con 0x7f26b013f9a0 2024-09-13T10:36:19.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.064+0000 7f26affff640 10 monclient: get_auth_request con 0x7f269c0404a0 auth_method 0 2024-09-13T10:36:19.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.069+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f26a8017a10 con 0x7f26b013f9a0 2024-09-13T10:36:19.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.069+0000 7f26acff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:19.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.069+0000 7f26acff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:19.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.310+0000 7f26b653d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:36:19.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.310+0000 7f26b653d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:36:19.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.310+0000 7f26b653d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.310+0000 7f26b653d640 1 -- 172.21.15.181:0/4276319126 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2690005370 con 0x7f26b013f9a0 2024-09-13T10:36:19.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.311+0000 7f26acff9640 1 -- 172.21.15.181:0/4276319126 <== mon.8 v1:172.21.15.181:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 1399771700) 0x7f26a8017310 con 0x7f26b013f9a0 2024-09-13T10:36:19.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.311+0000 7f26acff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:36:19.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.311+0000 7f26acff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:19.314 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":100,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:36:19.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.313+0000 7f26b653d640 1 -- 172.21.15.181:0/4276319126 >> v1:172.21.15.195:6800/1839191919 conn(0x7f269c0404a0 legacy=0x7f269c042960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.313+0000 7f26b653d640 10 monclient: shutdown 2024-09-13T10:36:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.313+0000 7f26b653d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.313+0000 7f26b653d640 1 -- 172.21.15.181:0/4276319126 >> v1:172.21.15.181:6793/0 conn(0x7f26b013f9a0 legacy=0x7f26b01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.313+0000 7f26b653d640 1 -- 172.21.15.181:0/4276319126 shutdown_connections 2024-09-13T10:36:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.313+0000 7f26b653d640 1 -- 172.21.15.181:0/4276319126 >> 172.21.15.181:0/4276319126 conn(0x7f26b00abcd0 msgr2=0x7f26b00a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.313+0000 7f26b653d640 1 -- 172.21.15.181:0/4276319126 shutdown_connections 2024-09-13T10:36:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.313+0000 7f26b653d640 1 -- 172.21.15.181:0/4276319126 wait complete. 2024-09-13T10:36:19.326 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:36:19.326 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:36:19.326 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:36:19.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.422+0000 7fbd415bb640 10 monclient: get_monmap_and_config 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.422+0000 7fbd415bb640 10 monclient: build_initial_monmap 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.422+0000 7fbd415bb640 10 monclient: monmap: 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:19.424130+0000 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:19.424130+0000 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:19.425 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:19.426 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:19.426 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:19.426 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:19.426 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:19.426 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 1 Processor -- start 2024-09-13T10:36:19.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 1 -- start start 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 10 monclient: init 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 10 monclient: _add_conns ranks=[8,4,6,5,7,1,3,0,2] 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 10 monclient(hunting): picked mon.noname-e con 0x7fbd3c0a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 10 monclient(hunting): picked mon.noname-c con 0x7fbd3c0a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 10 monclient(hunting): picked mon.noname-d con 0x7fbd3c13f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3c0a4bc0 con 0x7fbd3c0a8340 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3c13a320 con 0x7fbd3c13f750 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3c0a8100 con 0x7fbd3c0a6640 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd415bb640 10 monclient(hunting): authenticate will time out at 1118.929830s 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd3affd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fbd3c0a6640 0x7fbd3c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33830/0 (socket says 172.21.15.181:33830) 2024-09-13T10:36:19.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd3affd640 1 -- 172.21.15.181:0/3365423705 learned_addr learned my addr 172.21.15.181:0/3365423705 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:19.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.423+0000 7fbd3a7fc640 1 --1- 172.21.15.181:0/3365423705 >> v1:172.21.15.181:6791/0 conn(0x7fbd3c0a8340 0x7fbd3c139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:57978/0 (socket says 172.21.15.181:57978) 2024-09-13T10:36:19.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.426+0000 7fbd3affd640 1 -- 172.21.15.181:0/3365423705 >> v1:172.21.15.181:6793/0 conn(0x7fbd3c0a6640 legacy=0x7fbd3c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.426+0000 7fbd3b7fe640 1 -- 172.21.15.181:0/3365423705 >> v1:172.21.15.181:6792/0 conn(0x7fbd3c13f750 legacy=0x7fbd3c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.426+0000 7fbd3a7fc640 1 -- 172.21.15.181:0/3365423705 >> v1:172.21.15.181:6791/0 conn(0x7fbd3c0a8340 legacy=0x7fbd3c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.632+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 684131660 0 0) 0x7fbd3c13a320 con 0x7fbd3c13f750 2024-09-13T10:36:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 10 monclient(hunting): my global_id is 6315 2024-09-13T10:36:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd24003520 con 0x7fbd3c13f750 2024-09-13T10:36:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1669779287 0 0) 0x7fbd3c0a4bc0 con 0x7fbd3c0a8340 2024-09-13T10:36:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 10 monclient(hunting): my global_id is 114106 2024-09-13T10:36:19.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd3c13a320 con 0x7fbd3c0a8340 2024-09-13T10:36:19.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467547498 0 0) 0x7fbd3c0a8100 con 0x7fbd3c0a6640 2024-09-13T10:36:19.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 10 monclient(hunting): my global_id is 104507 2024-09-13T10:36:19.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.633+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd3c0a4bc0 con 0x7fbd3c0a6640 2024-09-13T10:36:19.638 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:19.638 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38627]: starting. 2024-09-13T10:36:19.638 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38627]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38589 2024-09-13T10:36:19.638 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38627]: shutting down. 2024-09-13T10:36:19.638 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:19.638 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:19.639 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:36:19.640 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:36:19.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.644+0000 7fbd3affd640 1 --1- 172.21.15.181:0/3365423705 >> v1:172.21.15.181:6793/0 conn(0x7fbd3c0a6640 0x7fbd3c139500 :-1 s=OPENED pgs=399 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fbd2c001a80 mon_map magic: 0 2024-09-13T10:36:19.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.644+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4209279917 0 0) 0x7fbd24003520 con 0x7fbd3c13f750 2024-09-13T10:36:19.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.644+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 >> v1:172.21.15.181:6793/0 conn(0x7fbd3c0a6640 legacy=0x7fbd3c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 >> v1:172.21.15.181:6791/0 conn(0x7fbd3c0a8340 legacy=0x7fbd3c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:36:19.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 1 monclient: found mon.noname-d 2024-09-13T10:36:19.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:19.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:36:19.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c0a48e0 con 0x7fbd3c13f750 2024-09-13T10:36:19.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 10 monclient: _finish_auth 0 2024-09-13T10:36:19.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:36:19.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:19.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd34001de0 con 0x7fbd3c13f750 2024-09-13T10:36:19.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:36:19.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 10 monclient: dump: 2024-09-13T10:36:19.651 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.651 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.651 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.651 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.651 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.651 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.651 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.651 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.652 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.652 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.652 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.652 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.652 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.652 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.652 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.652 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd2c001a80 con 0x7fbd3c0a6640 2024-09-13T10:36:19.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd415bb640 5 monclient: authenticate success, global_id 6315 2024-09-13T10:36:19.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd415bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:19.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:36:19.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd340020b0 con 0x7fbd3c13f750 2024-09-13T10:36:19.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:19.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 1 -- 172.21.15.181:0/3365423705 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd34003cd0 con 0x7fbd3c13f750 2024-09-13T10:36:19.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:36:19.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd39ffb640 10 monclient: dump: 2024-09-13T10:36:19.654 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.654 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.654 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.654 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.654 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.654 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.654 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.655 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.655 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.655 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.655 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.655 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.655 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.655 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.655 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.655 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd415bb640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd415bb640 4 set_mon_vals no callback set 2024-09-13T10:36:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd415bb640 10 monclient: shutdown 2024-09-13T10:36:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd415bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.645+0000 7fbd415bb640 1 -- 172.21.15.181:0/3365423705 >> v1:172.21.15.181:6792/0 conn(0x7fbd3c13f750 legacy=0x7fbd3c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.646+0000 7fbd415bb640 1 -- 172.21.15.181:0/3365423705 shutdown_connections 2024-09-13T10:36:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.646+0000 7fbd415bb640 1 -- 172.21.15.181:0/3365423705 >> 172.21.15.181:0/3365423705 conn(0x7fbd3c077170 msgr2=0x7fbd3c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.646+0000 7fbd415bb640 1 -- 172.21.15.181:0/3365423705 shutdown_connections 2024-09-13T10:36:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.646+0000 7fbd415bb640 1 -- 172.21.15.181:0/3365423705 wait complete. 2024-09-13T10:36:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.646+0000 7fbd415bb640 10 monclient: build_initial_monmap 2024-09-13T10:36:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.646+0000 7fbd415bb640 10 monclient: monmap: 2024-09-13T10:36:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:19.659 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 1 Processor -- start 2024-09-13T10:36:19.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 1 -- start start 2024-09-13T10:36:19.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 10 monclient: init 2024-09-13T10:36:19.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:19.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 10 monclient: _add_conns ranks=[4,8,6,1,2,0,3,7,5] 2024-09-13T10:36:19.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 10 monclient(hunting): picked mon.noname-c con 0x7fbd3c0a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:19.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 10 monclient(hunting): picked mon.noname-e con 0x7fbd3c13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:19.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 10 monclient(hunting): picked mon.noname-d con 0x7fbd3c142020 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:19.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3c1cf0f0 con 0x7fbd3c0a8340 2024-09-13T10:36:19.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3c0a9f00 con 0x7fbd3c142020 2024-09-13T10:36:19.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3c142940 con 0x7fbd3c13f750 2024-09-13T10:36:19.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:19.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd415bb640 10 monclient(hunting): authenticate will time out at 1119.153814s 2024-09-13T10:36:19.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd3a7fc640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fbd3c13f750 0x7fbd3c1ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33832/0 (socket says 172.21.15.181:33832) 2024-09-13T10:36:19.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd3a7fc640 1 -- 172.21.15.181:0/1396058085 learned_addr learned my addr 172.21.15.181:0/1396058085 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:19.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.647+0000 7fbd3b7fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fbd3c142020 0x7fbd3c1d6530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44762/0 (socket says 172.21.15.181:44762) 2024-09-13T10:36:19.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.650+0000 7fbd3b7fe640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.181:6792/0 conn(0x7fbd3c142020 legacy=0x7fbd3c1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.650+0000 7fbd3a7fc640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.181:6793/0 conn(0x7fbd3c13f750 legacy=0x7fbd3c1ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.650+0000 7fbd3affd640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.181:6791/0 conn(0x7fbd3c0a8340 legacy=0x7fbd3c1ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.650+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:36:19.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532633182 0 0) 0x7fbd3c142940 con 0x7fbd3c13f750 2024-09-13T10:36:19.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): my global_id is 104516 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd28003550 con 0x7fbd3c13f750 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3644473990 0 0) 0x7fbd3c0a9f00 con 0x7fbd3c142020 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): my global_id is 6324 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd3c142940 con 0x7fbd3c142020 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1786525938 0 0) 0x7fbd28003550 con 0x7fbd3c13f750 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd3c0a9f00 con 0x7fbd3c13f750 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd300047e0 con 0x7fbd3c13f750 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:19.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): dump: 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.670 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3770757353 0 0) 0x7fbd3c142940 con 0x7fbd3c142020 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd28003550 con 0x7fbd3c142020 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd34003cd0 con 0x7fbd3c142020 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient(hunting): dump: 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.671 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 965663321 0 0) 0x7fbd3c0a9f00 con 0x7fbd3c13f750 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.181:6792/0 conn(0x7fbd3c142020 legacy=0x7fbd3c1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.181:6791/0 conn(0x7fbd3c0a8340 legacy=0x7fbd3c1ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient: _finish_hunting 0 2024-09-13T10:36:19.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 monclient: found mon.e 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c13ba40 con 0x7fbd3c13f750 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient: _finish_auth 0 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient: _check_auth_tickets 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd415bb640 5 monclient: authenticate success, global_id 104516 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd415bb640 10 monclient: _renew_subs 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd415bb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd415bb640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3c13c5b0 con 0x7fbd3c13f750 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd415bb640 10 monclient: _renew_subs 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd415bb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd415bb640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fbd3c1d7c50 con 0x7fbd3c13f750 2024-09-13T10:36:19.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd30004d60 con 0x7fbd3c13f750 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd30005250 con 0x7fbd3c13f750 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd397fa640 4 set_mon_vals no callback set 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.652+0000 7fbd237fe640 10 monclient: dump: 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.674 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.653+0000 7fbd415bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.653+0000 7fbd415bb640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbd1c0065c0 con 0x7fbd1c002860 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.653+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fbd300118d0 con 0x7fbd3c13f750 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.654+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(196..196 src has 1..196) ==== 3506+0+0 (unknown 4160157974 0 0) 0x7fbd3004e1d0 con 0x7fbd3c13f750 2024-09-13T10:36:19.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.654+0000 7fbd3b7fe640 10 monclient: get_auth_request con 0x7fbd28040110 auth_method 0 2024-09-13T10:36:19.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd3affd640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.181:6789/0 conn(0x7fbd1c002860 legacy=0x7fbd1c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 34188099 0 0) 0x7fbd1c0065c0 con 0x7fbd1c002860 2024-09-13T10:36:19.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 10 monclient(hunting): my global_id is 114111 2024-09-13T10:36:19.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd3c0a9f00 con 0x7fbd1c002860 2024-09-13T10:36:19.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4090882694 0 0) 0x7fbd3c0a9f00 con 0x7fbd1c002860 2024-09-13T10:36:19.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd1c0065c0 con 0x7fbd1c002860 2024-09-13T10:36:19.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd2c001320 con 0x7fbd1c002860 2024-09-13T10:36:19.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 10 monclient: dump: 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.677 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.678 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.678 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3374360946 0 0) 0x7fbd1c0065c0 con 0x7fbd1c002860 2024-09-13T10:36:19.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.656+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd1c00a160 con 0x7fbd1c002860 2024-09-13T10:36:19.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.657+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fbd2c004970 con 0x7fbd1c002860 2024-09-13T10:36:19.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.657+0000 7fbd237fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:19.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.657+0000 7fbd237fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:19.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.657+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.181:6789/0 conn(0x7fbd1c002860 legacy=0x7fbd1c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.657+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.181:6789/0 conn(0x7fbd1c002860 legacy=0x7fbd1c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:19.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.663+0000 7fbd415bb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:19.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.663+0000 7fbd415bb640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbd1c009e50 con 0x7fbd1c009110 2024-09-13T10:36:19.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.665+0000 7fbd3affd640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.181:6789/0 conn(0x7fbd1c009110 legacy=0x7fbd1c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681474001 0 0) 0x7fbd1c009e50 con 0x7fbd1c009110 2024-09-13T10:36:19.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 10 monclient(hunting): my global_id is 114120 2024-09-13T10:36:19.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd1c0065c0 con 0x7fbd1c009110 2024-09-13T10:36:19.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 718137831 0 0) 0x7fbd1c0065c0 con 0x7fbd1c009110 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd1c009e50 con 0x7fbd1c009110 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbd2c005160 con 0x7fbd1c009110 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 10 monclient: dump: 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.681 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.682 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.682 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.682 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.682 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.682 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.682 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.682 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3289352594 0 0) 0x7fbd1c009e50 con 0x7fbd1c009110 2024-09-13T10:36:19.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd1c00c3f0 con 0x7fbd1c009110 2024-09-13T10:36:19.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 765503956) 0x7fbd2c007440 con 0x7fbd1c009110 2024-09-13T10:36:19.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:19.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:19.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.181:6789/0 conn(0x7fbd1c009110 legacy=0x7fbd1c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd237fe640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.181:6789/0 conn(0x7fbd1c009110 legacy=0x7fbd1c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:19.683 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:19.683 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:19.683 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:19.683 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:19.683 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:19.683 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 15644, 2024-09-13T10:36:19.683 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:19.684 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:19.685 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:19.686 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:19.687 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:19.688 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:19.688 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:19.688 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:19.688 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:19.688 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:19.688 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:19.688 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:19.688 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:19.688 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:19.688 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:19.688 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:19.689 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.691 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:19.691 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:19.691 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.691 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.691 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.691 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:19.691 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.691 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.692 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.692 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:19.692 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:19.692 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.692 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.692 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.692 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:19.692 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:19.692 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.693 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.693 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.693 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:19.693 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.693 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.694 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.695 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:19.695 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.695 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.695 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:19.695 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:19.695 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.695 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.696 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.696 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:19.696 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:19.697 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.697 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.697 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.697 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:19.697 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:19.698 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.699 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.700 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:19.700 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:19.700 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.700 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.700 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.700 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:19.700 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.700 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.700 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.701 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.702 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:19.702 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.702 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.702 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.702 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:19.702 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:19.702 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.702 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.702 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:19.703 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.704 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.704 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.704 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.704 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:19.704 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:19.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.704 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:19.704 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:19.704 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:19.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.705 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:19.705 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:19.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.705 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:19.705 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:19.705 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:19.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.705 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:19.706 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:36:19.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.706 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:19.706 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:19.706 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:19.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.706 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.706 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:19.706 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd415bb640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.195:6800/1839191919 conn(0x7fbd28040110 legacy=0x7fbd280425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd415bb640 10 monclient: shutdown 2024-09-13T10:36:19.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd415bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:19.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd415bb640 1 -- 172.21.15.181:0/1396058085 >> v1:172.21.15.181:6793/0 conn(0x7fbd3c13f750 legacy=0x7fbd3c1ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.666+0000 7fbd3b7fe640 1 -- 172.21.15.181:0/1396058085 reap_dead start 2024-09-13T10:36:19.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.667+0000 7fbd3b7fe640 1 -- 172.21.15.181:0/1396058085 reap_dead start 2024-09-13T10:36:19.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.667+0000 7fbd415bb640 1 -- 172.21.15.181:0/1396058085 shutdown_connections 2024-09-13T10:36:19.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.667+0000 7fbd415bb640 1 -- 172.21.15.181:0/1396058085 >> 172.21.15.181:0/1396058085 conn(0x7fbd3c0a6640 msgr2=0x7fbd3c0a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:19.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.667+0000 7fbd415bb640 1 -- 172.21.15.181:0/1396058085 shutdown_connections 2024-09-13T10:36:19.710 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.667+0000 7fbd415bb640 1 -- 172.21.15.181:0/1396058085 wait complete. 2024-09-13T10:36:19.710 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:19.710 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:36:19.710 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:36:19.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.806+0000 7f6c98860640 10 monclient: get_monmap_and_config 2024-09-13T10:36:19.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.806+0000 7f6c98860640 10 monclient: build_initial_monmap 2024-09-13T10:36:19.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.806+0000 7f6c98860640 10 monclient: monmap: 2024-09-13T10:36:19.809 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:19.809 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:19.808517+0000 2024-09-13T10:36:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:19.808517+0000 2024-09-13T10:36:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:19.810 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:19.811 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:19.811 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.807+0000 7f6c98860640 1 Processor -- start 2024-09-13T10:36:19.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.807+0000 7f6c98860640 1 -- start start 2024-09-13T10:36:19.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.807+0000 7f6c98860640 10 monclient: init 2024-09-13T10:36:19.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c98860640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:19.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c98860640 10 monclient: _add_conns ranks=[8,2,7,4,3,1,6,0,5] 2024-09-13T10:36:19.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c98860640 10 monclient(hunting): picked mon.noname-e con 0x7f6c940a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:19.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c98860640 10 monclient(hunting): picked mon.noname-b con 0x7f6c940a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:19.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c98860640 10 monclient(hunting): picked mon.noname-i con 0x7f6c9413f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:19.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c98860640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c940a4bc0 con 0x7f6c940a8340 2024-09-13T10:36:19.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c98860640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c9413a320 con 0x7f6c9413f750 2024-09-13T10:36:19.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c98860640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c940a8100 con 0x7f6c940a6640 2024-09-13T10:36:19.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c98860640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:19.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c98860640 10 monclient(hunting): authenticate will time out at 1119.314197s 2024-09-13T10:36:19.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c91d9b640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f6c940a8340 0x7f6c94139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55252/0 (socket says 172.21.15.181:55252) 2024-09-13T10:36:19.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c91d9b640 1 -- 172.21.15.181:0/1353003539 learned_addr learned my addr 172.21.15.181:0/1353003539 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:19.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.808+0000 7f6c9259c640 1 --1- 172.21.15.181:0/1353003539 >> v1:172.21.15.181:6793/0 conn(0x7f6c940a6640 0x7f6c94139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33834/0 (socket says 172.21.15.181:33834) 2024-09-13T10:36:19.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9259c640 1 -- 172.21.15.181:0/1353003539 >> v1:172.21.15.181:6793/0 conn(0x7f6c940a6640 legacy=0x7f6c94139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c91d9b640 1 -- 172.21.15.181:0/1353003539 >> v1:172.21.15.181:6790/0 conn(0x7f6c940a8340 legacy=0x7f6c94139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c92d9d640 1 -- 172.21.15.181:0/1353003539 >> v1:172.21.15.195:6792/0 conn(0x7f6c9413f750 legacy=0x7f6c94141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 1 -- 172.21.15.181:0/1353003539 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932925259 0 0) 0x7f6c940a4bc0 con 0x7f6c940a8340 2024-09-13T10:36:19.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient(hunting): my global_id is 114113 2024-09-13T10:36:19.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 1 -- 172.21.15.181:0/1353003539 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c80003520 con 0x7f6c940a8340 2024-09-13T10:36:19.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 1 -- 172.21.15.181:0/1353003539 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 342984427 0 0) 0x7f6c940a8100 con 0x7f6c940a6640 2024-09-13T10:36:19.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient(hunting): my global_id is 104525 2024-09-13T10:36:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 1 -- 172.21.15.181:0/1353003539 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c940a4bc0 con 0x7f6c940a6640 2024-09-13T10:36:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 1 -- 172.21.15.181:0/1353003539 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2254851474 0 0) 0x7f6c80003520 con 0x7f6c940a8340 2024-09-13T10:36:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 1 -- 172.21.15.181:0/1353003539 >> v1:172.21.15.181:6793/0 conn(0x7f6c940a6640 legacy=0x7f6c94139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 1 -- 172.21.15.181:0/1353003539 >> v1:172.21.15.195:6792/0 conn(0x7f6c9413f750 legacy=0x7f6c94141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient: _finish_hunting 0 2024-09-13T10:36:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 1 monclient: found mon.noname-b 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 1 -- 172.21.15.181:0/1353003539 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c940a48e0 con 0x7f6c940a8340 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient: _finish_auth 0 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient: _check_auth_tickets 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 1 -- 172.21.15.181:0/1353003539 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c7c001ae0 con 0x7f6c940a8340 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c98860640 5 monclient: authenticate success, global_id 114113 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c98860640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 10 monclient: dump: 2024-09-13T10:36:19.822 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.823 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c98860640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:19.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.810+0000 7f6c9159a640 1 -- 172.21.15.181:0/1353003539 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c7c0048a0 con 0x7f6c940a8340 2024-09-13T10:36:19.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c9159a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:19.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c98860640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:19.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c9159a640 1 -- 172.21.15.181:0/1353003539 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c7c004e10 con 0x7f6c940a8340 2024-09-13T10:36:19.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c9159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c98860640 4 set_mon_vals no callback set 2024-09-13T10:36:19.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c9159a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:36:19.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c9159a640 10 monclient: dump: 2024-09-13T10:36:19.824 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.824 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.824 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c98860640 10 monclient: shutdown 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c98860640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c98860640 1 -- 172.21.15.181:0/1353003539 >> v1:172.21.15.181:6790/0 conn(0x7f6c940a8340 legacy=0x7f6c94139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c98860640 1 -- 172.21.15.181:0/1353003539 shutdown_connections 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c98860640 1 -- 172.21.15.181:0/1353003539 >> 172.21.15.181:0/1353003539 conn(0x7f6c94077170 msgr2=0x7f6c940abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c98860640 1 -- 172.21.15.181:0/1353003539 shutdown_connections 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.811+0000 7f6c98860640 1 -- 172.21.15.181:0/1353003539 wait complete. 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.812+0000 7f6c98860640 10 monclient: build_initial_monmap 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.812+0000 7f6c98860640 10 monclient: monmap: 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:19.826 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.812+0000 7f6c98860640 1 Processor -- start 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.812+0000 7f6c98860640 1 -- start start 2024-09-13T10:36:19.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.812+0000 7f6c98860640 10 monclient: init 2024-09-13T10:36:19.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.813+0000 7f6c98860640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:19.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.813+0000 7f6c98860640 10 monclient: _add_conns ranks=[0,8,2,7,5,3,4,6,1] 2024-09-13T10:36:19.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.813+0000 7f6c98860640 10 monclient(hunting): picked mon.noname-a con 0x7f6c940a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:19.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.813+0000 7f6c98860640 10 monclient(hunting): picked mon.noname-e con 0x7f6c9413f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:19.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.813+0000 7f6c98860640 10 monclient(hunting): picked mon.noname-b con 0x7f6c941d4310 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:19.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.813+0000 7f6c98860640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c94134440 con 0x7f6c940a8340 2024-09-13T10:36:19.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.813+0000 7f6c98860640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c94134720 con 0x7f6c941d4310 2024-09-13T10:36:19.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.813+0000 7f6c98860640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c94134a00 con 0x7f6c9413f750 2024-09-13T10:36:19.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.813+0000 7f6c98860640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:19.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.813+0000 7f6c98860640 10 monclient(hunting): authenticate will time out at 1119.319147s 2024-09-13T10:36:19.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.813+0000 7f6c91d9b640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f6c9413f750 0x7f6c9413c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33838/0 (socket says 172.21.15.181:33838) 2024-09-13T10:36:19.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.813+0000 7f6c91d9b640 1 -- 172.21.15.181:0/3758738995 learned_addr learned my addr 172.21.15.181:0/3758738995 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:19.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c91d9b640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.181:6793/0 conn(0x7f6c9413f750 legacy=0x7f6c9413c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c92d9d640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.181:6790/0 conn(0x7f6c941d4310 legacy=0x7f6c941d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c9259c640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.181:6789/0 conn(0x7f6c940a8340 legacy=0x7f6c9413bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902410850 0 0) 0x7f6c94134a00 con 0x7f6c9413f750 2024-09-13T10:36:19.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): my global_id is 104534 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c74003550 con 0x7f6c9413f750 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 298421101 0 0) 0x7f6c94134720 con 0x7f6c941d4310 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): my global_id is 114122 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c94134a00 con 0x7f6c941d4310 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264220142 0 0) 0x7f6c94134440 con 0x7f6c940a8340 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): my global_id is 114147 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c94134720 con 0x7f6c940a8340 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2980220722 0 0) 0x7f6c74003550 con 0x7f6c9413f750 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c94134440 con 0x7f6c9413f750 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c7c004d90 con 0x7f6c9413f750 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): dump: 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.836 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.837 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.837 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.837 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.837 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.837 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.837 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.837 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.837 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.837 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.837 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 663726713 0 0) 0x7f6c94134a00 con 0x7f6c941d4310 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c74003550 con 0x7f6c941d4310 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2692571478 0 0) 0x7f6c94134720 con 0x7f6c940a8340 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c94134a00 con 0x7f6c940a8340 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c84001c80 con 0x7f6c941d4310 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): dump: 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.838 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c8c004b60 con 0x7f6c940a8340 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 10 monclient(hunting): dump: 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.840 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.815+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3632053361 0 0) 0x7f6c94134440 con 0x7f6c9413f750 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.181:6790/0 conn(0x7f6c941d4310 legacy=0x7f6c941d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.181:6789/0 conn(0x7f6c940a8340 legacy=0x7f6c9413bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 10 monclient: _finish_hunting 0 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 1 monclient: found mon.e 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c94135170 con 0x7f6c9413f750 2024-09-13T10:36:19.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 10 monclient: _finish_auth 0 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 10 monclient: _check_auth_tickets 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c98860640 5 monclient: authenticate success, global_id 104534 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c98860640 10 monclient: _renew_subs 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c98860640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c98860640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6c9413e3f0 con 0x7f6c9413f750 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c98860640 10 monclient: _renew_subs 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c98860640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c98860640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f6c9413d780 con 0x7f6c9413f750 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c7c001b00 con 0x7f6c9413f750 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c7c005740 con 0x7f6c9413f750 2024-09-13T10:36:19.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c8affd640 10 monclient: dump: 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.843 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c90d99640 4 set_mon_vals no callback set 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c98860640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.816+0000 7f6c98860640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6c940ac990 con 0x7f6c94077170 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.817+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6c7c011dc0 con 0x7f6c9413f750 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.817+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(196..196 src has 1..196) ==== 3506+0+0 (unknown 4160157974 0 0) 0x7f6c7c04e2d0 con 0x7f6c9413f750 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.817+0000 7f6c92d9d640 10 monclient: get_auth_request con 0x7f6c74040690 auth_method 0 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c9259c640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.181:6790/0 conn(0x7f6c94077170 legacy=0x7f6c9413fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224462494 0 0) 0x7f6c940ac990 con 0x7f6c94077170 2024-09-13T10:36:19.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 10 monclient(hunting): my global_id is 114131 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c94134440 con 0x7f6c94077170 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2828241136 0 0) 0x7f6c94134440 con 0x7f6c94077170 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c940ac990 con 0x7f6c94077170 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c8c005230 con 0x7f6c94077170 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 10 monclient: dump: 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.845 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 607324643 0 0) 0x7f6c940ac990 con 0x7f6c94077170 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c94143260 con 0x7f6c94077170 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6c8c005360 con 0x7f6c94077170 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.181:6790/0 conn(0x7f6c94077170 legacy=0x7f6c9413fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.819+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.181:6790/0 conn(0x7f6c94077170 legacy=0x7f6c9413fb30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.825+0000 7f6c98860640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.826+0000 7f6c98860640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6c94140950 con 0x7f6c94069b40 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c9259c640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.181:6790/0 conn(0x7f6c94069b40 legacy=0x7f6c94140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1879637797 0 0) 0x7f6c94140950 con 0x7f6c94069b40 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 10 monclient(hunting): my global_id is 114140 2024-09-13T10:36:19.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c940ac990 con 0x7f6c94069b40 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4131394283 0 0) 0x7f6c940ac990 con 0x7f6c94069b40 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c94140950 con 0x7f6c94069b40 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6c8c005b60 con 0x7f6c94069b40 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 10 monclient: dump: 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1311536380 0 0) 0x7f6c94140950 con 0x7f6c94069b40 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.828+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6c941df570 con 0x7f6c94069b40 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 3081862278) 0x7f6c8c007fd0 con 0x7f6c94069b40 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c8affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c8affd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.181:6790/0 conn(0x7f6c94069b40 legacy=0x7f6c94140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c8affd640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.181:6790/0 conn(0x7f6c94069b40 legacy=0x7f6c94140240 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:19.850 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:19.850 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:19.850 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:19.850 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:19.850 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:19.850 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 15807, 2024-09-13T10:36:19.850 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:19.850 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:19.850 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:19.851 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:19.852 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:19.853 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:19.854 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:19.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.857 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:19.858 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:19.860 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.861 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.862 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.863 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.864 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.865 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.866 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.867 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:19.868 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:19.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:19.869 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:19.869 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:19.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c98860640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6c74040690 legacy=0x7f6c74042b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c98860640 10 monclient: shutdown 2024-09-13T10:36:19.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c98860640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:19.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c98860640 1 -- 172.21.15.181:0/3758738995 >> v1:172.21.15.181:6793/0 conn(0x7f6c9413f750 legacy=0x7f6c9413c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c92d9d640 1 -- 172.21.15.181:0/3758738995 reap_dead start 2024-09-13T10:36:19.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c92d9d640 1 -- 172.21.15.181:0/3758738995 reap_dead start 2024-09-13T10:36:19.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c98860640 1 -- 172.21.15.181:0/3758738995 shutdown_connections 2024-09-13T10:36:19.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c98860640 1 -- 172.21.15.181:0/3758738995 >> 172.21.15.181:0/3758738995 conn(0x7f6c940a6640 msgr2=0x7f6c940a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:19.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c98860640 1 -- 172.21.15.181:0/3758738995 shutdown_connections 2024-09-13T10:36:19.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.829+0000 7f6c98860640 1 -- 172.21.15.181:0/3758738995 wait complete. 2024-09-13T10:36:19.871 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:19.871 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:36:19.871 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:36:19.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.967+0000 7f503ea3c640 10 monclient: get_monmap_and_config 2024-09-13T10:36:19.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.967+0000 7f503ea3c640 10 monclient: build_initial_monmap 2024-09-13T10:36:19.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.967+0000 7f503ea3c640 10 monclient: monmap: 2024-09-13T10:36:19.970 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:19.970 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.970 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:19.969255+0000 2024-09-13T10:36:19.970 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:19.969255+0000 2024-09-13T10:36:19.970 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:19.970 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.971 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:19.971 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:19.971 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:19.971 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:19.971 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:19.971 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:19.971 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:19.971 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:19.971 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:19.971 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 1 Processor -- start 2024-09-13T10:36:19.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 1 -- start start 2024-09-13T10:36:19.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 10 monclient: init 2024-09-13T10:36:19.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:19.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 10 monclient: _add_conns ranks=[3,8,1,6,5,2,4,7,0] 2024-09-13T10:36:19.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 10 monclient(hunting): picked mon.noname-g con 0x7f50380a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:19.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 10 monclient(hunting): picked mon.noname-e con 0x7f50380a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:19.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 10 monclient(hunting): picked mon.noname-f con 0x7f503813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:19.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50380a4bc0 con 0x7f503813f750 2024-09-13T10:36:19.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f503813a320 con 0x7f50380a6640 2024-09-13T10:36:19.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50380a8100 con 0x7f50380a8340 2024-09-13T10:36:19.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:19.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.968+0000 7f503ea3c640 10 monclient(hunting): authenticate will time out at 1119.474943s 2024-09-13T10:36:19.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.969+0000 7f50377fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f50380a8340 0x7f5038139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33842/0 (socket says 172.21.15.181:33842) 2024-09-13T10:36:19.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.969+0000 7f50377fe640 1 -- 172.21.15.181:0/3266444242 learned_addr learned my addr 172.21.15.181:0/3266444242 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f50377fe640 1 -- 172.21.15.181:0/3266444242 >> v1:172.21.15.181:6793/0 conn(0x7f50380a8340 legacy=0x7f5038139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5037fff640 1 -- 172.21.15.181:0/3266444242 >> v1:172.21.15.195:6790/0 conn(0x7f50380a6640 legacy=0x7f5038139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f503cfd9640 1 -- 172.21.15.181:0/3266444242 >> v1:172.21.15.195:6789/0 conn(0x7f503813f750 legacy=0x7f5038141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2623955232 0 0) 0x7f50380a8100 con 0x7f50380a8340 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient(hunting): my global_id is 104543 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5020003520 con 0x7f50380a8340 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522921363 0 0) 0x7f503813a320 con 0x7f50380a6640 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient(hunting): my global_id is 6249 2024-09-13T10:36:19.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50380a8100 con 0x7f50380a6640 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1761013355 0 0) 0x7f50380a4bc0 con 0x7f503813f750 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient(hunting): my global_id is 56557 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f503813a320 con 0x7f503813f750 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 674365894 0 0) 0x7f5020003520 con 0x7f50380a8340 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 >> v1:172.21.15.195:6790/0 conn(0x7f50380a6640 legacy=0x7f5038139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 >> v1:172.21.15.195:6789/0 conn(0x7f503813f750 legacy=0x7f5038141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 monclient: found mon.noname-e 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:36:19.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50380a48e0 con 0x7f50380a8340 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient: _finish_auth 0 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f502c001ae0 con 0x7f50380a8340 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f503ea3c640 5 monclient: authenticate success, global_id 104543 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f503ea3c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient: dump: 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.980 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f503ea3c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f502c0048a0 con 0x7f50380a8340 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:19.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f503ea3c640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 1 -- 172.21.15.181:0/3266444242 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f502c004e10 con 0x7f50380a8340 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f503ea3c640 4 set_mon_vals no callback set 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.971+0000 7f5036ffd640 10 monclient: dump: 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.982 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.972+0000 7f503ea3c640 10 monclient: shutdown 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.972+0000 7f503ea3c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.972+0000 7f503ea3c640 1 -- 172.21.15.181:0/3266444242 >> v1:172.21.15.181:6793/0 conn(0x7f50380a8340 legacy=0x7f5038139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.972+0000 7f503ea3c640 1 -- 172.21.15.181:0/3266444242 shutdown_connections 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.972+0000 7f503ea3c640 1 -- 172.21.15.181:0/3266444242 >> 172.21.15.181:0/3266444242 conn(0x7f5038077170 msgr2=0x7f50380abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.972+0000 7f503ea3c640 1 -- 172.21.15.181:0/3266444242 shutdown_connections 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.972+0000 7f503ea3c640 1 -- 172.21.15.181:0/3266444242 wait complete. 2024-09-13T10:36:19.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.972+0000 7f503ea3c640 10 monclient: build_initial_monmap 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.972+0000 7f503ea3c640 10 monclient: monmap: 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:19.984 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 1 Processor -- start 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 1 -- start start 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 10 monclient: init 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 10 monclient: _add_conns ranks=[0,5,4,7,1,2,6,8,3] 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 10 monclient(hunting): picked mon.noname-a con 0x7f50380a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 10 monclient(hunting): picked mon.noname-h con 0x7f503813f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 10 monclient(hunting): picked mon.noname-c con 0x7f503813cac0 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:19.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5038134cb0 con 0x7f50380a8340 2024-09-13T10:36:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f503813e760 con 0x7f503813cac0 2024-09-13T10:36:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f5037fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f50380a8340 0x7f50381ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60116/0 (socket says 172.21.15.181:60116) 2024-09-13T10:36:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f5037fff640 1 -- 172.21.15.181:0/708769634 learned_addr learned my addr 172.21.15.181:0/708769634 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50380aa0e0 con 0x7f503813f750 2024-09-13T10:36:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:19.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.973+0000 7f503ea3c640 10 monclient(hunting): authenticate will time out at 1119.479997s 2024-09-13T10:36:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5037fff640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.181:6789/0 conn(0x7f50380a8340 legacy=0x7f50381ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f503cfd9640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.181:6791/0 conn(0x7f503813cac0 legacy=0x7f50381d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f50377fe640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.195:6791/0 conn(0x7f503813f750 legacy=0x7f50381d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:19.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 801356512 0 0) 0x7f5038134cb0 con 0x7f50380a8340 2024-09-13T10:36:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): my global_id is 114156 2024-09-13T10:36:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5024003550 con 0x7f50380a8340 2024-09-13T10:36:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151234587 0 0) 0x7f503813e760 con 0x7f503813cac0 2024-09-13T10:36:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): my global_id is 114115 2024-09-13T10:36:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5038134cb0 con 0x7f503813cac0 2024-09-13T10:36:19.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1975617417 0 0) 0x7f50380aa0e0 con 0x7f503813f750 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): my global_id is 104432 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f503813e760 con 0x7f503813f750 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1879776341 0 0) 0x7f5024003550 con 0x7f50380a8340 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50380aa0e0 con 0x7f50380a8340 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5028003610 con 0x7f50380a8340 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): dump: 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.994 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2844112579 0 0) 0x7f5038134cb0 con 0x7f503813cac0 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5024003550 con 0x7f503813cac0 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 196441241 0 0) 0x7f503813e760 con 0x7f503813f750 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5038134cb0 con 0x7f503813f750 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5030001ff0 con 0x7f503813cac0 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): dump: 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.996 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f502c004d90 con 0x7f503813f750 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:19.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient(hunting): dump: 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:19.998 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3312916175 0 0) 0x7f50380aa0e0 con 0x7f50380a8340 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.195:6791/0 conn(0x7f503813f750 legacy=0x7f50381d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.181:6791/0 conn(0x7f503813cac0 legacy=0x7f50381d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 monclient: found mon.a 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503813d4a0 con 0x7f50380a8340 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient: _finish_auth 0 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f503ea3c640 5 monclient: authenticate success, global_id 114156 2024-09-13T10:36:19.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f503ea3c640 10 monclient: _renew_subs 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f503ea3c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f503ea3c640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f50381349d0 con 0x7f50380a8340 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f503ea3c640 10 monclient: _renew_subs 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f503ea3c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f503ea3c640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f50381cecb0 con 0x7f50380a8340 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5028003be0 con 0x7f50380a8340 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5028004110 con 0x7f50380a8340 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f50367fc640 4 set_mon_vals no callback set 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.976+0000 7f5034ff9640 10 monclient: dump: 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.000 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.001 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.977+0000 7f503ea3c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.977+0000 7f503ea3c640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50180065c0 con 0x7f5018002860 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.977+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f50280042b0 con 0x7f50380a8340 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.978+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(196..196 src has 1..196) ==== 3506+0+0 (unknown 4160157974 0 0) 0x7f502804e310 con 0x7f50380a8340 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.978+0000 7f503cfd9640 10 monclient: get_auth_request con 0x7f50240404c0 auth_method 0 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.979+0000 7f50377fe640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.181:6791/0 conn(0x7f5018002860 legacy=0x7f5018004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.979+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1929258729 0 0) 0x7f50180065c0 con 0x7f5018002860 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.979+0000 7f5034ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.979+0000 7f5034ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.979+0000 7f5034ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.979+0000 7f5034ff9640 10 monclient(hunting): my global_id is 114124 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50380aa0e0 con 0x7f5018002860 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2785347401 0 0) 0x7f50380aa0e0 con 0x7f5018002860 2024-09-13T10:36:20.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50180065c0 con 0x7f5018002860 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f502c001580 con 0x7f5018002860 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 10 monclient: dump: 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.003 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2041284842 0 0) 0x7f50180065c0 con 0x7f5018002860 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f501800a160 con 0x7f5018002860 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f502c001320 con 0x7f5018002860 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.181:6791/0 conn(0x7f5018002860 legacy=0x7f5018004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.980+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.181:6791/0 conn(0x7f5018002860 legacy=0x7f5018004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.986+0000 7f503ea3c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.986+0000 7f503ea3c640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5018009e70 con 0x7f5018009130 2024-09-13T10:36:20.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f50377fe640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.181:6791/0 conn(0x7f5018009130 legacy=0x7f50180095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349656612 0 0) 0x7f5018009e70 con 0x7f5018009130 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 10 monclient(hunting): my global_id is 114133 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50180065c0 con 0x7f5018009130 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 995604374 0 0) 0x7f50180065c0 con 0x7f5018009130 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5018009e70 con 0x7f5018009130 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f502c0059c0 con 0x7f5018009130 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 10 monclient: dump: 2024-09-13T10:36:20.005 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.006 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.006 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.006 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.006 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.006 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.006 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.006 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.006 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.006 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 393850254 0 0) 0x7f5018009e70 con 0x7f5018009130 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f501800c3f0 con 0x7f5018009130 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 602673237) 0x7f502c0048a0 con 0x7f5018009130 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.181:6791/0 conn(0x7f5018009130 legacy=0x7f50180095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.989+0000 7f5034ff9640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.181:6791/0 conn(0x7f5018009130 legacy=0x7f50180095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:20.008 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:20.008 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:20.008 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:20.008 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:20.008 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:20.008 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 15967, 2024-09-13T10:36:20.008 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:20.008 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:20.008 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:20.008 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:20.008 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:20.008 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.009 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.010 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:20.011 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.012 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.014 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.014 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:20.014 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.014 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.014 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.014 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:20.014 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:20.014 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.014 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.014 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:20.015 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.016 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.017 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.017 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:20.017 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:20.017 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.017 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.017 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.017 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:20.017 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.018 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.020 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:20.021 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.022 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.023 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:20.023 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:20.023 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.023 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.023 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.023 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:20.023 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.023 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.023 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.025 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:20.025 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.025 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.025 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:20.025 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:20.025 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.025 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.025 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.025 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:20.026 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:20.027 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:20.027 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.027 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.027 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:20.027 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.990+0000 7f503ea3c640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.195:6800/1839191919 conn(0x7f50240404c0 legacy=0x7f5024042980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.990+0000 7f503ea3c640 10 monclient: shutdown 2024-09-13T10:36:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.990+0000 7f503ea3c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.990+0000 7f503ea3c640 1 -- 172.21.15.181:0/708769634 >> v1:172.21.15.181:6789/0 conn(0x7f50380a8340 legacy=0x7f50381ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.990+0000 7f503cfd9640 1 -- 172.21.15.181:0/708769634 reap_dead start 2024-09-13T10:36:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.990+0000 7f503cfd9640 1 -- 172.21.15.181:0/708769634 reap_dead start 2024-09-13T10:36:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.990+0000 7f503ea3c640 1 -- 172.21.15.181:0/708769634 shutdown_connections 2024-09-13T10:36:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.990+0000 7f503ea3c640 1 -- 172.21.15.181:0/708769634 >> 172.21.15.181:0/708769634 conn(0x7f50380a6640 msgr2=0x7f50380a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.990+0000 7f503ea3c640 1 -- 172.21.15.181:0/708769634 shutdown_connections 2024-09-13T10:36:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:19.990+0000 7f503ea3c640 1 -- 172.21.15.181:0/708769634 wait complete. 2024-09-13T10:36:20.030 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:20.030 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:36:20.030 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:36:20.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.127+0000 7fb0c81c3640 10 monclient: get_monmap_and_config 2024-09-13T10:36:20.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.127+0000 7fb0c81c3640 10 monclient: build_initial_monmap 2024-09-13T10:36:20.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.127+0000 7fb0c81c3640 10 monclient: monmap: 2024-09-13T10:36:20.130 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:20.130 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.130 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:20.129284+0000 2024-09-13T10:36:20.130 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:20.129284+0000 2024-09-13T10:36:20.130 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:20.130 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.130 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:20.130 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:20.130 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:20.131 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:20.131 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:20.131 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:20.131 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:20.131 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:20.131 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:20.131 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 1 Processor -- start 2024-09-13T10:36:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 1 -- start start 2024-09-13T10:36:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 10 monclient: init 2024-09-13T10:36:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 10 monclient: _add_conns ranks=[6,1,3,7,4,2,5,0,8] 2024-09-13T10:36:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 10 monclient(hunting): picked mon.noname-d con 0x7fb0c00a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:20.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 10 monclient(hunting): picked mon.noname-f con 0x7fb0c00a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 10 monclient(hunting): picked mon.noname-g con 0x7fb0c013f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c00a4bc0 con 0x7fb0c00a8340 2024-09-13T10:36:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c013a320 con 0x7fb0c013f750 2024-09-13T10:36:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c00a8100 con 0x7fb0c00a6640 2024-09-13T10:36:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.128+0000 7fb0c81c3640 10 monclient(hunting): authenticate will time out at 1119.634927s 2024-09-13T10:36:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.129+0000 7fb0c5f5f640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fb0c00a6640 0x7fb0c0139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44774/0 (socket says 172.21.15.181:44774) 2024-09-13T10:36:20.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.129+0000 7fb0c5f5f640 1 -- 172.21.15.181:0/1588247138 learned_addr learned my addr 172.21.15.181:0/1588247138 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c5f5f640 1 -- 172.21.15.181:0/1588247138 >> v1:172.21.15.181:6792/0 conn(0x7fb0c00a6640 legacy=0x7fb0c0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c575e640 1 -- 172.21.15.181:0/1588247138 >> v1:172.21.15.195:6789/0 conn(0x7fb0c00a8340 legacy=0x7fb0c0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c6760640 1 -- 172.21.15.181:0/1588247138 >> v1:172.21.15.195:6790/0 conn(0x7fb0c013f750 legacy=0x7fb0c0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1050608649 0 0) 0x7fb0c00a8100 con 0x7fb0c00a6640 2024-09-13T10:36:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient(hunting): my global_id is 6351 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0ac003520 con 0x7fb0c00a6640 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897463384 0 0) 0x7fb0c00a4bc0 con 0x7fb0c00a8340 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient(hunting): my global_id is 56566 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c00a8100 con 0x7fb0c00a8340 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102820850 0 0) 0x7fb0c013a320 con 0x7fb0c013f750 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient(hunting): my global_id is 6258 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c00a4bc0 con 0x7fb0c013f750 2024-09-13T10:36:20.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1767879155 0 0) 0x7fb0c00a8100 con 0x7fb0c00a8340 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 >> v1:172.21.15.181:6792/0 conn(0x7fb0c00a6640 legacy=0x7fb0c0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 >> v1:172.21.15.195:6790/0 conn(0x7fb0c013f750 legacy=0x7fb0c0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient: _finish_hunting 0 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 monclient: found mon.noname-f 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c00a48e0 con 0x7fb0c00a8340 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient: _finish_auth 0 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient: _check_auth_tickets 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb0b0001b10 con 0x7fb0c00a8340 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c81c3640 5 monclient: authenticate success, global_id 56566 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c81c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:20.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient: dump: 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.144 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c81c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0b0003610 con 0x7fb0c00a8340 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c81c3640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c81c3640 4 set_mon_vals no callback set 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 1 -- 172.21.15.181:0/1588247138 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb0b0003bc0 con 0x7fb0c00a8340 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:36:20.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.131+0000 7fb0c4f5d640 10 monclient: dump: 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.146 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.147 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.147 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.132+0000 7fb0c81c3640 10 monclient: shutdown 2024-09-13T10:36:20.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.132+0000 7fb0c81c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:20.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.132+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1588247138 >> v1:172.21.15.195:6789/0 conn(0x7fb0c00a8340 legacy=0x7fb0c0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.132+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1588247138 shutdown_connections 2024-09-13T10:36:20.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.132+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1588247138 >> 172.21.15.181:0/1588247138 conn(0x7fb0c0077170 msgr2=0x7fb0c00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:20.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.132+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1588247138 shutdown_connections 2024-09-13T10:36:20.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.132+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1588247138 wait complete. 2024-09-13T10:36:20.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.132+0000 7fb0c81c3640 10 monclient: build_initial_monmap 2024-09-13T10:36:20.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.132+0000 7fb0c81c3640 10 monclient: monmap: 2024-09-13T10:36:20.147 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:20.148 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:20.148 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:20.148 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:20.148 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:20.148 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:20.148 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:20.148 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:20.148 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:20.148 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:20.148 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:20.148 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 1 Processor -- start 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 1 -- start start 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 10 monclient: init 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 10 monclient: _add_conns ranks=[4,5,0,3,2,7,8,1,6] 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 10 monclient(hunting): picked mon.noname-c con 0x7fb0c00a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 10 monclient(hunting): picked mon.noname-h con 0x7fb0c013f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 10 monclient(hunting): picked mon.noname-a con 0x7fb0c01d4310 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:20.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c00a10b0 con 0x7fb0c01d4310 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c009e1a0 con 0x7fb0c00a8340 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c00a9e20 con 0x7fb0c013f750 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c81c3640 10 monclient(hunting): authenticate will time out at 1119.639656s 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c5f5f640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fb0c00a8340 0x7fb0c009d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58036/0 (socket says 172.21.15.181:58036) 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.133+0000 7fb0c5f5f640 1 -- 172.21.15.181:0/1933159355 learned_addr learned my addr 172.21.15.181:0/1933159355 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.135+0000 7fb0c5f5f640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.181:6791/0 conn(0x7fb0c00a8340 legacy=0x7fb0c009d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.135+0000 7fb0c6760640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.181:6789/0 conn(0x7fb0c01d4310 legacy=0x7fb0c01d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.135+0000 7fb0c575e640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.195:6791/0 conn(0x7fb0c013f750 legacy=0x7fb0c009da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489204313 0 0) 0x7fb0c00a10b0 con 0x7fb0c01d4310 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): my global_id is 114165 2024-09-13T10:36:20.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0a4003550 con 0x7fb0c01d4310 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3562870094 0 0) 0x7fb0c009e1a0 con 0x7fb0c00a8340 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): my global_id is 114142 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c00a10b0 con 0x7fb0c00a8340 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3569733060 0 0) 0x7fb0c00a9e20 con 0x7fb0c013f750 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): my global_id is 104441 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c009e1a0 con 0x7fb0c013f750 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3806032820 0 0) 0x7fb0c00a10b0 con 0x7fb0c00a8340 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0c00a9e20 con 0x7fb0c00a8340 2024-09-13T10:36:20.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb0bc0047e0 con 0x7fb0c00a8340 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): dump: 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.152 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2234669763 0 0) 0x7fb0c009e1a0 con 0x7fb0c013f750 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0c00a10b0 con 0x7fb0c013f750 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 115477630 0 0) 0x7fb0a4003550 con 0x7fb0c01d4310 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0c009e1a0 con 0x7fb0c01d4310 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb0b0001a90 con 0x7fb0c013f750 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:36:20.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): dump: 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.154 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.155 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb0b80020b0 con 0x7fb0c01d4310 2024-09-13T10:36:20.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:20.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:20.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient(hunting): dump: 2024-09-13T10:36:20.155 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.155 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.155 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.155 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.155 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1977902403 0 0) 0x7fb0c00a9e20 con 0x7fb0c00a8340 2024-09-13T10:36:20.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.195:6791/0 conn(0x7fb0c013f750 legacy=0x7fb0c009da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.181:6789/0 conn(0x7fb0c01d4310 legacy=0x7fb0c01d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 monclient: found mon.c 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c0142ed0 con 0x7fb0c00a8340 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient: _finish_auth 0 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0c81c3640 5 monclient: authenticate success, global_id 114142 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0c81c3640 10 monclient: _renew_subs 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0c81c3640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c00a0240 con 0x7fb0c00a8340 2024-09-13T10:36:20.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0c81c3640 10 monclient: _renew_subs 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0c81c3640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fb0c00a0dd0 con 0x7fb0c00a8340 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0bc004c30 con 0x7fb0c00a8340 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb0bc005120 con 0x7fb0c00a8340 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b7fff640 4 set_mon_vals no callback set 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.136+0000 7fb0b67fc640 10 monclient: dump: 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.158 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.137+0000 7fb0c81c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.137+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb0a80065c0 con 0x7fb0a8002860 2024-09-13T10:36:20.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.137+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb0bc0053c0 con 0x7fb0c00a8340 2024-09-13T10:36:20.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.137+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(196..196 src has 1..196) ==== 3506+0+0 (unknown 4160157974 0 0) 0x7fb0bc04e260 con 0x7fb0c00a8340 2024-09-13T10:36:20.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.137+0000 7fb0c6760640 10 monclient: get_auth_request con 0x7fb0a40406a0 auth_method 0 2024-09-13T10:36:20.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0c575e640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.181:6792/0 conn(0x7fb0a8002860 legacy=0x7fb0a8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731661491 0 0) 0x7fb0a80065c0 con 0x7fb0a8002860 2024-09-13T10:36:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0b67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0b67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0b67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0b67fc640 10 monclient(hunting): my global_id is 6360 2024-09-13T10:36:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c00a9e20 con 0x7fb0a8002860 2024-09-13T10:36:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1213616261 0 0) 0x7fb0c00a9e20 con 0x7fb0a8002860 2024-09-13T10:36:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0a80065c0 con 0x7fb0a8002860 2024-09-13T10:36:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb0b00043f0 con 0x7fb0a8002860 2024-09-13T10:36:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0b67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0b67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:36:20.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.139+0000 7fb0b67fc640 10 monclient: dump: 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.210 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.140+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3788122505 0 0) 0x7fb0a80065c0 con 0x7fb0a8002860 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.140+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0a800a160 con 0x7fb0a8002860 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.140+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb0b0003610 con 0x7fb0a8002860 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.140+0000 7fb0b67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.140+0000 7fb0b67fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.140+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.181:6792/0 conn(0x7fb0a8002860 legacy=0x7fb0a8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.140+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.181:6792/0 conn(0x7fb0a8002860 legacy=0x7fb0a8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.146+0000 7fb0c81c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.146+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb0a8009e30 con 0x7fb0a8009110 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0c575e640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.181:6792/0 conn(0x7fb0a8009110 legacy=0x7fb0a8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2061887373 0 0) 0x7fb0a8009e30 con 0x7fb0a8009110 2024-09-13T10:36:20.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0b67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0b67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0b67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0b67fc640 10 monclient(hunting): my global_id is 6369 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0a80065c0 con 0x7fb0a8009110 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 871079504 0 0) 0x7fb0a80065c0 con 0x7fb0a8009110 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0a8009e30 con 0x7fb0a8009110 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb0b0004470 con 0x7fb0a8009110 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0b67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0b67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.148+0000 7fb0b67fc640 10 monclient: dump: 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.212 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 405858965 0 0) 0x7fb0a8009e30 con 0x7fb0a8009110 2024-09-13T10:36:20.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb0a800c3f0 con 0x7fb0a8009110 2024-09-13T10:36:20.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 1105388883) 0x7fb0b0006000 con 0x7fb0a8009110 2024-09-13T10:36:20.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0b67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:20.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0b67fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:20.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.181:6792/0 conn(0x7fb0a8009110 legacy=0x7fb0a8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0b67fc640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.181:6792/0 conn(0x7fb0a8009110 legacy=0x7fb0a8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:20.214 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:20.214 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:20.214 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:20.214 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 394593, 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.215 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.216 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.217 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.218 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.218 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.218 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:20.218 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:20.218 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:20.218 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:20.218 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:20.218 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:20.218 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:20.218 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:20.218 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:20.219 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:20.219 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:20.219 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:20.219 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:20.219 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:20.219 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:20.219 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:20.219 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:20.219 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.220 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.220 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.220 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.220 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.220 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.220 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.220 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.220 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.220 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.220 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.220 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.220 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.221 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.224 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.224 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:20.224 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.224 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.224 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.224 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:20.224 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:20.224 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.225 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.226 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:20.227 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.228 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:20.229 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.231 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:20.232 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.233 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:20.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:36:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.235 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:20.235 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:20.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb0a40406a0 legacy=0x7fb0a4042b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0c81c3640 10 monclient: shutdown 2024-09-13T10:36:20.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0c81c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:20.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1933159355 >> v1:172.21.15.181:6791/0 conn(0x7fb0c00a8340 legacy=0x7fb0c009d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0c6760640 1 -- 172.21.15.181:0/1933159355 reap_dead start 2024-09-13T10:36:20.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0c6760640 1 -- 172.21.15.181:0/1933159355 reap_dead start 2024-09-13T10:36:20.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1933159355 shutdown_connections 2024-09-13T10:36:20.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1933159355 >> 172.21.15.181:0/1933159355 conn(0x7fb0c00a6640 msgr2=0x7fb0c0141e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:20.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1933159355 shutdown_connections 2024-09-13T10:36:20.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.149+0000 7fb0c81c3640 1 -- 172.21.15.181:0/1933159355 wait complete. 2024-09-13T10:36:20.237 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:20.238 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:36:20.238 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:36:20.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.333+0000 7f102a107640 10 monclient: get_monmap_and_config 2024-09-13T10:36:20.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.333+0000 7f102a107640 10 monclient: build_initial_monmap 2024-09-13T10:36:20.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.333+0000 7f102a107640 10 monclient: monmap: 2024-09-13T10:36:20.336 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:20.336 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.336 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:20.335498+0000 2024-09-13T10:36:20.336 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:20.335498+0000 2024-09-13T10:36:20.336 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:20.336 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.337 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:20.337 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:20.337 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:20.337 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:20.337 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:20.337 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:20.337 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:20.337 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:20.337 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:20.337 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.334+0000 7f102a107640 1 Processor -- start 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.334+0000 7f102a107640 1 -- start start 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.334+0000 7f102a107640 10 monclient: init 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f102a107640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f102a107640 10 monclient: _add_conns ranks=[2,0,1,7,5,8,4,3,6] 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f102a107640 10 monclient(hunting): picked mon.noname-b con 0x7f10240a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f102a107640 10 monclient(hunting): picked mon.noname-a con 0x7f10240a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f102a107640 10 monclient(hunting): picked mon.noname-f con 0x7f102413f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f102a107640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10240a5fe0 con 0x7f10240a6ab0 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f102a107640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10240a8080 con 0x7f102413f9a0 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f102a107640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10240a42c0 con 0x7f10240a66d0 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f102a107640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f102a107640 10 monclient(hunting): authenticate will time out at 1119.841449s 2024-09-13T10:36:20.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f101bfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f10240a6ab0 0x7f10240a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60134/0 (socket says 172.21.15.181:60134) 2024-09-13T10:36:20.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f10237fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f10240a66d0 0x7f10240a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55276/0 (socket says 172.21.15.181:55276) 2024-09-13T10:36:20.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.335+0000 7f101bfff640 1 -- 172.21.15.181:0/1785928766 learned_addr learned my addr 172.21.15.181:0/1785928766 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:20.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f101bfff640 1 -- 172.21.15.181:0/1785928766 >> v1:172.21.15.181:6789/0 conn(0x7f10240a6ab0 legacy=0x7f10240a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1023fff640 1 -- 172.21.15.181:0/1785928766 >> v1:172.21.15.195:6789/0 conn(0x7f102413f9a0 legacy=0x7f1024141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f10237fe640 1 -- 172.21.15.181:0/1785928766 >> v1:172.21.15.181:6790/0 conn(0x7f10240a66d0 legacy=0x7f10240a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042222662 0 0) 0x7f10240a5fe0 con 0x7f10240a6ab0 2024-09-13T10:36:20.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 10 monclient(hunting): my global_id is 114174 2024-09-13T10:36:20.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1010003520 con 0x7f10240a6ab0 2024-09-13T10:36:20.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138996108 0 0) 0x7f10240a42c0 con 0x7f10240a66d0 2024-09-13T10:36:20.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 10 monclient(hunting): my global_id is 114149 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10240a5fe0 con 0x7f10240a66d0 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632262070 0 0) 0x7f10240a8080 con 0x7f102413f9a0 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.337+0000 7f1022ffd640 10 monclient(hunting): my global_id is 56575 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10240a42c0 con 0x7f102413f9a0 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2959320527 0 0) 0x7f10240a5fe0 con 0x7f10240a66d0 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 >> v1:172.21.15.195:6789/0 conn(0x7f102413f9a0 legacy=0x7f1024141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 >> v1:172.21.15.181:6789/0 conn(0x7f10240a6ab0 legacy=0x7f10240a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 1 monclient: found mon.noname-b 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10241464e0 con 0x7f10240a66d0 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 10 monclient: _finish_auth 0 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1014001a50 con 0x7f10240a66d0 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 10 monclient: dump: 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.346 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f102a107640 5 monclient: authenticate success, global_id 114149 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f102a107640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1014001d20 con 0x7f10240a66d0 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 1 -- 172.21.15.181:0/1785928766 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1014004b20 con 0x7f10240a66d0 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f102a107640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f102a107640 4 set_mon_vals no callback set 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f1022ffd640 10 monclient: dump: 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.348 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f102a107640 10 monclient: shutdown 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f102a107640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:20.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f102a107640 1 -- 172.21.15.181:0/1785928766 >> v1:172.21.15.181:6790/0 conn(0x7f10240a66d0 legacy=0x7f10240a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f102a107640 1 -- 172.21.15.181:0/1785928766 shutdown_connections 2024-09-13T10:36:20.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f102a107640 1 -- 172.21.15.181:0/1785928766 >> 172.21.15.181:0/1785928766 conn(0x7f10240abcd0 msgr2=0x7f10240ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:20.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f102a107640 1 -- 172.21.15.181:0/1785928766 shutdown_connections 2024-09-13T10:36:20.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.338+0000 7f102a107640 1 -- 172.21.15.181:0/1785928766 wait complete. 2024-09-13T10:36:20.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.339+0000 7f102a107640 10 monclient: build_initial_monmap 2024-09-13T10:36:20.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.339+0000 7f102a107640 10 monclient: monmap: 2024-09-13T10:36:20.350 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:20.350 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:20.350 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:20.350 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:20.350 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:20.350 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:20.351 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:20.351 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:20.351 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:20.351 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:20.351 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:20.351 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:20.351 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:20.351 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:20.351 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:20.351 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.339+0000 7f102a107640 1 Processor -- start 2024-09-13T10:36:20.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.339+0000 7f102a107640 1 -- start start 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.339+0000 7f102a107640 10 monclient: init 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.340+0000 7f102a107640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.340+0000 7f102a107640 10 monclient: _add_conns ranks=[2,7,4,1,0,5,6,8,3] 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.340+0000 7f102a107640 10 monclient(hunting): picked mon.noname-b con 0x7f10240a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.340+0000 7f102a107640 10 monclient(hunting): picked mon.noname-i con 0x7f10240a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.340+0000 7f102a107640 10 monclient(hunting): picked mon.noname-c con 0x7f102413f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.340+0000 7f102a107640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102413ee70 con 0x7f10240a66d0 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.340+0000 7f102a107640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102413f150 con 0x7f102413f9a0 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.340+0000 7f102a107640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102413d950 con 0x7f10240a6ab0 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.340+0000 7f102a107640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.340+0000 7f102a107640 10 monclient(hunting): authenticate will time out at 1119.846225s 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.340+0000 7f10237fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f10240a66d0 0x7f102413b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55280/0 (socket says 172.21.15.181:55280) 2024-09-13T10:36:20.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.340+0000 7f10237fe640 1 -- 172.21.15.181:0/2182497948 learned_addr learned my addr 172.21.15.181:0/2182497948 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:20.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f10237fe640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.181:6790/0 conn(0x7f10240a66d0 legacy=0x7f102413b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1023fff640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.181:6791/0 conn(0x7f102413f9a0 legacy=0x7f10241d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f101bfff640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.195:6792/0 conn(0x7f10240a6ab0 legacy=0x7f102413bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1482976426 0 0) 0x7f102413ee70 con 0x7f10240a66d0 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): my global_id is 114158 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1004003520 con 0x7f10240a66d0 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388750118 0 0) 0x7f102413f150 con 0x7f102413f9a0 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): my global_id is 114151 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f102413ee70 con 0x7f102413f9a0 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3933451617 0 0) 0x7f102413d950 con 0x7f10240a6ab0 2024-09-13T10:36:20.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): my global_id is 56437 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f102413f150 con 0x7f10240a6ab0 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1984520562 0 0) 0x7f1004003520 con 0x7f10240a66d0 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f102413d950 con 0x7f10240a66d0 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1014004b20 con 0x7f10240a66d0 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): dump: 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.360 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:20.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3467129785 0 0) 0x7f102413ee70 con 0x7f102413f9a0 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1004003520 con 0x7f102413f9a0 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f101c002070 con 0x7f102413f9a0 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient(hunting): dump: 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.362 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 112638282 0 0) 0x7f102413d950 con 0x7f10240a66d0 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.195:6792/0 conn(0x7f10240a6ab0 legacy=0x7f102413bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.181:6791/0 conn(0x7f102413f9a0 legacy=0x7f10241d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 monclient: found mon.b 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:36:20.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10240a27f0 con 0x7f10240a66d0 2024-09-13T10:36:20.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient: _finish_auth 0 2024-09-13T10:36:20.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:36:20.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.342+0000 7f1020ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:20.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f102a107640 5 monclient: authenticate success, global_id 114158 2024-09-13T10:36:20.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f102a107640 10 monclient: _renew_subs 2024-09-13T10:36:20.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f102a107640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:36:20.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f102a107640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f102413cdf0 con 0x7f10240a66d0 2024-09-13T10:36:20.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f102a107640 10 monclient: _renew_subs 2024-09-13T10:36:20.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f102a107640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:36:20.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f102a107640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f102413c3c0 con 0x7f10240a66d0 2024-09-13T10:36:20.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1014005150 con 0x7f10240a66d0 2024-09-13T10:36:20.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f1020ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1014005640 con 0x7f10240a66d0 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f1020ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f10227fc640 4 set_mon_vals no callback set 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f1020ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f1020ff9640 10 monclient: dump: 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.365 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.366 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.366 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.366 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.366 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.366 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.366 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.366 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f102a107640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:20.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f102a107640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f10080065c0 con 0x7f1008002860 2024-09-13T10:36:20.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.343+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1014011cc0 con 0x7f10240a66d0 2024-09-13T10:36:20.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.344+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(196..196 src has 1..196) ==== 3506+0+0 (unknown 4160157974 0 0) 0x7f101404e2f0 con 0x7f10240a66d0 2024-09-13T10:36:20.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.344+0000 7f1023fff640 10 monclient: get_auth_request con 0x7f1004040200 auth_method 0 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f101bfff640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.181:6793/0 conn(0x7f1008002860 legacy=0x7f1008004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1875655825 0 0) 0x7f10080065c0 con 0x7f1008002860 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 10 monclient(hunting): my global_id is 104552 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f102413d950 con 0x7f1008002860 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1645069156 0 0) 0x7f102413d950 con 0x7f1008002860 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10080065c0 con 0x7f1008002860 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f100c001b20 con 0x7f1008002860 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:20.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 10 monclient: dump: 2024-09-13T10:36:20.368 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.368 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.368 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.368 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.368 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.368 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.368 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.368 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.368 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.368 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.368 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.368 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1177809043 0 0) 0x7f10080065c0 con 0x7f1008002860 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f100800a160 con 0x7f1008002860 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f100c006860 con 0x7f1008002860 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.181:6793/0 conn(0x7f1008002860 legacy=0x7f1008004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.346+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.181:6793/0 conn(0x7f1008002860 legacy=0x7f1008004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.352+0000 7f102a107640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:20.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.352+0000 7f102a107640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1008009e70 con 0x7f1008009130 2024-09-13T10:36:20.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f101bfff640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.181:6793/0 conn(0x7f1008009130 legacy=0x7f10080095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3302591288 0 0) 0x7f1008009e70 con 0x7f1008009130 2024-09-13T10:36:20.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 10 monclient(hunting): my global_id is 104561 2024-09-13T10:36:20.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10080065c0 con 0x7f1008009130 2024-09-13T10:36:20.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3300677844 0 0) 0x7f10080065c0 con 0x7f1008009130 2024-09-13T10:36:20.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1008009e70 con 0x7f1008009130 2024-09-13T10:36:20.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f100c004fa0 con 0x7f1008009130 2024-09-13T10:36:20.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:20.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 10 monclient: dump: 2024-09-13T10:36:20.371 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.371 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.371 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.371 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.371 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.371 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.372 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.372 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.372 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.372 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.372 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.372 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.372 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.372 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.372 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.372 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4168904141 0 0) 0x7f1008009e70 con 0x7f1008009130 2024-09-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f100800c410 con 0x7f1008009130 2024-09-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 692728560) 0x7f100c0064d0 con 0x7f1008009130 2024-09-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.181:6793/0 conn(0x7f1008009130 legacy=0x7f10080095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.355+0000 7f1020ff9640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.181:6793/0 conn(0x7f1008009130 legacy=0x7f10080095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:20.373 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 64058, 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:20.374 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.375 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.376 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.377 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.377 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.377 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.377 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.377 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:20.377 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:20.377 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:20.377 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:20.377 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:20.377 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:20.377 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.378 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:20.379 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.380 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.382 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:20.383 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:20.385 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.387 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:20.388 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.389 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:20.390 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.391 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:20.392 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:20.392 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:20.392 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.392 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.392 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:20.392 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:20.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.356+0000 7f102a107640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1004040200 legacy=0x7f10040426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.356+0000 7f102a107640 10 monclient: shutdown 2024-09-13T10:36:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.356+0000 7f102a107640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.356+0000 7f102a107640 1 -- 172.21.15.181:0/2182497948 >> v1:172.21.15.181:6790/0 conn(0x7f10240a66d0 legacy=0x7f102413b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.356+0000 7f1023fff640 1 -- 172.21.15.181:0/2182497948 reap_dead start 2024-09-13T10:36:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.356+0000 7f102a107640 1 -- 172.21.15.181:0/2182497948 shutdown_connections 2024-09-13T10:36:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.356+0000 7f102a107640 1 -- 172.21.15.181:0/2182497948 >> 172.21.15.181:0/2182497948 conn(0x7f10240abcd0 msgr2=0x7f10240ab450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.356+0000 7f102a107640 1 -- 172.21.15.181:0/2182497948 shutdown_connections 2024-09-13T10:36:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.356+0000 7f102a107640 1 -- 172.21.15.181:0/2182497948 wait complete. 2024-09-13T10:36:20.395 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:20.395 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:36:20.395 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:36:20.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.491+0000 7f6024d64640 10 monclient: get_monmap_and_config 2024-09-13T10:36:20.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.492+0000 7f6024d64640 10 monclient: build_initial_monmap 2024-09-13T10:36:20.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.492+0000 7f6024d64640 10 monclient: monmap: 2024-09-13T10:36:20.497 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:20.498 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.498 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:20.493630+0000 2024-09-13T10:36:20.498 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:20.493630+0000 2024-09-13T10:36:20.498 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:20.498 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.498 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:20.499 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:20.500 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.492+0000 7f6024d64640 1 Processor -- start 2024-09-13T10:36:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.492+0000 7f6024d64640 1 -- start start 2024-09-13T10:36:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.492+0000 7f6024d64640 10 monclient: init 2024-09-13T10:36:20.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.493+0000 7f6024d64640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.493+0000 7f6024d64640 10 monclient: _add_conns ranks=[2,1,6,5,0,7,4,8,3] 2024-09-13T10:36:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.493+0000 7f6024d64640 10 monclient(hunting): picked mon.noname-b con 0x7f60200a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.493+0000 7f6024d64640 10 monclient(hunting): picked mon.noname-f con 0x7f60200a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.493+0000 7f6024d64640 10 monclient(hunting): picked mon.noname-d con 0x7f602013f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.493+0000 7f6024d64640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60200a5fe0 con 0x7f60200a6ab0 2024-09-13T10:36:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.493+0000 7f6024d64640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60200a8080 con 0x7f60200a66d0 2024-09-13T10:36:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.493+0000 7f6024d64640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60200a42c0 con 0x7f602013f9a0 2024-09-13T10:36:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.493+0000 7f6024d64640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:20.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.493+0000 7f6024d64640 10 monclient(hunting): authenticate will time out at 1119.999428s 2024-09-13T10:36:20.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.493+0000 7f601e59c640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f60200a66d0 0x7f60200a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55282/0 (socket says 172.21.15.181:55282) 2024-09-13T10:36:20.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.493+0000 7f601e59c640 1 -- 172.21.15.181:0/2627559862 learned_addr learned my addr 172.21.15.181:0/2627559862 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.495+0000 7f601ed9d640 1 -- 172.21.15.181:0/2627559862 >> v1:172.21.15.181:6792/0 conn(0x7f602013f9a0 legacy=0x7f6020141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.495+0000 7f601e59c640 1 -- 172.21.15.181:0/2627559862 >> v1:172.21.15.181:6790/0 conn(0x7f60200a66d0 legacy=0x7f60200a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.495+0000 7f601dd9b640 1 -- 172.21.15.181:0/2627559862 >> v1:172.21.15.195:6789/0 conn(0x7f60200a6ab0 legacy=0x7f60200a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017757988 0 0) 0x7f60200a8080 con 0x7f60200a66d0 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient(hunting): my global_id is 114167 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6008003520 con 0x7f60200a66d0 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 444915069 0 0) 0x7f60200a42c0 con 0x7f602013f9a0 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient(hunting): my global_id is 6378 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60200a8080 con 0x7f602013f9a0 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 294015842 0 0) 0x7f60200a5fe0 con 0x7f60200a6ab0 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient(hunting): my global_id is 56584 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60200a42c0 con 0x7f60200a6ab0 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 477261328 0 0) 0x7f6008003520 con 0x7f60200a66d0 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601dd9b640 1 --1- 172.21.15.181:0/2627559862 >> v1:172.21.15.195:6789/0 conn(0x7f60200a6ab0 0x7f60200a6ec0 :-1 s=OPENED pgs=522 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f60140019c0 mon_map magic: 0 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 >> v1:172.21.15.181:6792/0 conn(0x7f602013f9a0 legacy=0x7f6020141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 >> v1:172.21.15.195:6789/0 conn(0x7f60200a6ab0 legacy=0x7f60200a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient: _finish_hunting 0 2024-09-13T10:36:20.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 monclient: found mon.noname-b 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60201464e0 con 0x7f60200a66d0 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient: _finish_auth 0 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient: _check_auth_tickets 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f6024d64640 5 monclient: authenticate success, global_id 114167 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6010001ad0 con 0x7f60200a66d0 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f6024d64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient: dump: 2024-09-13T10:36:20.513 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.514 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f6024d64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f60140019c0 con 0x7f60200a6ab0 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6010001c70 con 0x7f60200a66d0 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f6024d64640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 1 -- 172.21.15.181:0/2627559862 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6010004be0 con 0x7f60200a66d0 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f6024d64640 4 set_mon_vals no callback set 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f601d59a640 10 monclient: dump: 2024-09-13T10:36:20.515 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.516 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.517 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.517 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f6024d64640 10 monclient: shutdown 2024-09-13T10:36:20.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f6024d64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:20.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.496+0000 7f6024d64640 1 -- 172.21.15.181:0/2627559862 >> v1:172.21.15.181:6790/0 conn(0x7f60200a66d0 legacy=0x7f60200a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.497+0000 7f6024d64640 1 -- 172.21.15.181:0/2627559862 shutdown_connections 2024-09-13T10:36:20.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.497+0000 7f6024d64640 1 -- 172.21.15.181:0/2627559862 >> 172.21.15.181:0/2627559862 conn(0x7f60200abcd0 msgr2=0x7f60200ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:20.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.497+0000 7f6024d64640 1 -- 172.21.15.181:0/2627559862 shutdown_connections 2024-09-13T10:36:20.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.497+0000 7f6024d64640 1 -- 172.21.15.181:0/2627559862 wait complete. 2024-09-13T10:36:20.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.497+0000 7f6024d64640 10 monclient: build_initial_monmap 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.497+0000 7f6024d64640 10 monclient: monmap: 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:20.518 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 1 Processor -- start 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 1 -- start start 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 10 monclient: init 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 10 monclient: _add_conns ranks=[3,1,8,0,5,7,4,2,6] 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 10 monclient(hunting): picked mon.noname-g con 0x7f60200a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 10 monclient(hunting): picked mon.noname-f con 0x7f60200a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 10 monclient(hunting): picked mon.noname-e con 0x7f602013f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f602013dd60 con 0x7f60200a6ab0 2024-09-13T10:36:20.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f602009cf50 con 0x7f60200a66d0 2024-09-13T10:36:20.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f602009ccb0 con 0x7f602013f9a0 2024-09-13T10:36:20.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:20.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f6024d64640 10 monclient(hunting): authenticate will time out at 1120.004639s 2024-09-13T10:36:20.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f601ed9d640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f602013f9a0 0x7f60201d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33870/0 (socket says 172.21.15.181:33870) 2024-09-13T10:36:20.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.498+0000 7f601ed9d640 1 -- 172.21.15.181:0/1292863331 learned_addr learned my addr 172.21.15.181:0/1292863331 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:20.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.500+0000 7f601ed9d640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.181:6793/0 conn(0x7f602013f9a0 legacy=0x7f60201d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1391117171 0 0) 0x7f602009ccb0 con 0x7f602013f9a0 2024-09-13T10:36:20.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): my global_id is 104570 2024-09-13T10:36:20.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6000003550 con 0x7f602013f9a0 2024-09-13T10:36:20.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f601e59c640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.195:6790/0 conn(0x7f60200a66d0 legacy=0x7f602013c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f601dd9b640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.195:6789/0 conn(0x7f60200a6ab0 legacy=0x7f602013ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 968615832 0 0) 0x7f6000003550 con 0x7f602013f9a0 2024-09-13T10:36:20.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f602009ccb0 con 0x7f602013f9a0 2024-09-13T10:36:20.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6018003990 con 0x7f602013f9a0 2024-09-13T10:36:20.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:20.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:20.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): dump: 2024-09-13T10:36:20.521 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.521 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.521 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.522 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993727537 0 0) 0x7f602013dd60 con 0x7f60200a6ab0 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): my global_id is 56593 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6000003550 con 0x7f60200a6ab0 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 956007445 0 0) 0x7f602009cf50 con 0x7f60200a66d0 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient(hunting): my global_id is 6267 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f602013dd60 con 0x7f60200a66d0 2024-09-13T10:36:20.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 705418099 0 0) 0x7f602009ccb0 con 0x7f602013f9a0 2024-09-13T10:36:20.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.195:6790/0 conn(0x7f60200a66d0 legacy=0x7f602013c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.195:6789/0 conn(0x7f60200a6ab0 legacy=0x7f602013ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient: _finish_hunting 0 2024-09-13T10:36:20.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 monclient: found mon.e 2024-09-13T10:36:20.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:20.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:20.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6020139390 con 0x7f602013f9a0 2024-09-13T10:36:20.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient: _finish_auth 0 2024-09-13T10:36:20.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient: _check_auth_tickets 2024-09-13T10:36:20.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:20.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f6024d64640 5 monclient: authenticate success, global_id 104570 2024-09-13T10:36:20.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f6024d64640 10 monclient: _renew_subs 2024-09-13T10:36:20.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f6024d64640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:20.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f6024d64640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f602013eb90 con 0x7f602013f9a0 2024-09-13T10:36:20.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f6024d64640 10 monclient: _renew_subs 2024-09-13T10:36:20.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f6024d64640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:20.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f6024d64640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f602013d400 con 0x7f602013f9a0 2024-09-13T10:36:20.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6018003ed0 con 0x7f602013f9a0 2024-09-13T10:36:20.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:20.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6018004440 con 0x7f602013f9a0 2024-09-13T10:36:20.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:20.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f601cd99640 4 set_mon_vals no callback set 2024-09-13T10:36:20.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.501+0000 7f600effd640 10 monclient: dump: 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.526 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.502+0000 7f6024d64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.502+0000 7f6024d64640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f60040065c0 con 0x7f6004002860 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.502+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f60180045e0 con 0x7f602013f9a0 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.502+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(196..196 src has 1..196) ==== 3506+0+0 (unknown 4160157974 0 0) 0x7f601804e580 con 0x7f602013f9a0 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.502+0000 7f601dd9b640 10 monclient: get_auth_request con 0x7f600003fd00 auth_method 0 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.504+0000 7f601e59c640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.195:6789/0 conn(0x7f6004002860 legacy=0x7f6004004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.504+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 339645547 0 0) 0x7f60040065c0 con 0x7f6004002860 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.504+0000 7f600effd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.504+0000 7f600effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.504+0000 7f600effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.504+0000 7f600effd640 10 monclient(hunting): my global_id is 56602 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.504+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f602009ccb0 con 0x7f6004002860 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2498956551 0 0) 0x7f602009ccb0 con 0x7f6004002860 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f60040065c0 con 0x7f6004002860 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6010001750 con 0x7f6004002860 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 10 monclient: dump: 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.528 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2204032995 0 0) 0x7f60040065c0 con 0x7f6004002860 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f600400a160 con 0x7f6004002860 2024-09-13T10:36:20.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6010001750 con 0x7f6004002860 2024-09-13T10:36:20.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:20.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:20.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.195:6789/0 conn(0x7f6004002860 legacy=0x7f6004004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.505+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.195:6789/0 conn(0x7f6004002860 legacy=0x7f6004004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:20.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.511+0000 7f6024d64640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:20.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.511+0000 7f6024d64640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f600400c4f0 con 0x7f6004009110 2024-09-13T10:36:20.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.513+0000 7f601e59c640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.195:6789/0 conn(0x7f6004009110 legacy=0x7f6004009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2775085755 0 0) 0x7f600400c4f0 con 0x7f6004009110 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 10 monclient(hunting): my global_id is 56611 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60040065c0 con 0x7f6004009110 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1571310705 0 0) 0x7f60040065c0 con 0x7f6004009110 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f600400c4f0 con 0x7f6004009110 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6010005340 con 0x7f6004009110 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 10 monclient: dump: 2024-09-13T10:36:20.532 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.533 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.534 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.534 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1205662094 0 0) 0x7f600400c4f0 con 0x7f6004009110 2024-09-13T10:36:20.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.514+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6004009ce0 con 0x7f6004009110 2024-09-13T10:36:20.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 1904091934) 0x7f6010005470 con 0x7f6004009110 2024-09-13T10:36:20.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f600effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:20.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f600effd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:20.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.195:6789/0 conn(0x7f6004009110 legacy=0x7f6004009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f600effd640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.195:6789/0 conn(0x7f6004009110 legacy=0x7f6004009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:20.534 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:20.534 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 394923, 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:20.535 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:36:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.536 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.537 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:20.538 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:20.539 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.540 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:20.541 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:20.542 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.543 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.544 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.546 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:20.547 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:20.548 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.549 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:20.551 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.552 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:20.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:20.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:36:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.555 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:20.555 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:20.557 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f6024d64640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.195:6800/1839191919 conn(0x7f600003fd00 legacy=0x7f60000421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f6024d64640 10 monclient: shutdown 2024-09-13T10:36:20.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f6024d64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:20.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f6024d64640 1 -- 172.21.15.181:0/1292863331 >> v1:172.21.15.181:6793/0 conn(0x7f602013f9a0 legacy=0x7f60201d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f601ed9d640 1 -- 172.21.15.181:0/1292863331 reap_dead start 2024-09-13T10:36:20.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f601ed9d640 1 -- 172.21.15.181:0/1292863331 reap_dead start 2024-09-13T10:36:20.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f6024d64640 1 -- 172.21.15.181:0/1292863331 shutdown_connections 2024-09-13T10:36:20.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f6024d64640 1 -- 172.21.15.181:0/1292863331 >> 172.21.15.181:0/1292863331 conn(0x7f60200abcd0 msgr2=0x7f60200a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:20.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f6024d64640 1 -- 172.21.15.181:0/1292863331 shutdown_connections 2024-09-13T10:36:20.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.515+0000 7f6024d64640 1 -- 172.21.15.181:0/1292863331 wait complete. 2024-09-13T10:36:20.558 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:20.559 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:36:20.559 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:36:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.662+0000 7f9c19695640 10 monclient: get_monmap_and_config 2024-09-13T10:36:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.662+0000 7f9c19695640 10 monclient: build_initial_monmap 2024-09-13T10:36:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.662+0000 7f9c19695640 10 monclient: monmap: 2024-09-13T10:36:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:20.664495+0000 2024-09-13T10:36:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:20.664495+0000 2024-09-13T10:36:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:20.665 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:20.666 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:20.666 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.663+0000 7f9c19695640 1 Processor -- start 2024-09-13T10:36:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.663+0000 7f9c19695640 1 -- start start 2024-09-13T10:36:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.663+0000 7f9c19695640 10 monclient: init 2024-09-13T10:36:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.663+0000 7f9c19695640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.663+0000 7f9c19695640 10 monclient: _add_conns ranks=[0,7,6,2,5,4,3,8,1] 2024-09-13T10:36:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.663+0000 7f9c19695640 10 monclient(hunting): picked mon.noname-a con 0x7f9c140a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.663+0000 7f9c19695640 10 monclient(hunting): picked mon.noname-i con 0x7f9c140a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.663+0000 7f9c19695640 10 monclient(hunting): picked mon.noname-d con 0x7f9c1413f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.664+0000 7f9c19695640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c140a5fe0 con 0x7f9c140a66d0 2024-09-13T10:36:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.664+0000 7f9c19695640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c140a8080 con 0x7f9c1413f9a0 2024-09-13T10:36:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.664+0000 7f9c19695640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c140a42c0 con 0x7f9c140a6ab0 2024-09-13T10:36:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.664+0000 7f9c19695640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:20.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.664+0000 7f9c19695640 10 monclient(hunting): authenticate will time out at 1120.170038s 2024-09-13T10:36:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.664+0000 7f9c12ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f9c140a66d0 0x7f9c140a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60136/0 (socket says 172.21.15.181:60136) 2024-09-13T10:36:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.664+0000 7f9c12ffd640 1 -- 172.21.15.181:0/3180973595 learned_addr learned my addr 172.21.15.181:0/3180973595 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:20.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.664+0000 7f9c137fe640 1 --1- 172.21.15.181:0/3180973595 >> v1:172.21.15.181:6792/0 conn(0x7f9c1413f9a0 0x7f9c14141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44812/0 (socket says 172.21.15.181:44812) 2024-09-13T10:36:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c137fe640 1 -- 172.21.15.181:0/3180973595 >> v1:172.21.15.181:6792/0 conn(0x7f9c1413f9a0 legacy=0x7f9c14141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c12ffd640 1 -- 172.21.15.181:0/3180973595 >> v1:172.21.15.181:6789/0 conn(0x7f9c140a66d0 legacy=0x7f9c140a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c127fc640 1 -- 172.21.15.181:0/3180973595 >> v1:172.21.15.195:6792/0 conn(0x7f9c140a6ab0 legacy=0x7f9c140a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 1 -- 172.21.15.181:0/3180973595 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4043221955 0 0) 0x7f9c140a42c0 con 0x7f9c140a6ab0 2024-09-13T10:36:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 10 monclient(hunting): my global_id is 56446 2024-09-13T10:36:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 1 -- 172.21.15.181:0/3180973595 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c00003520 con 0x7f9c140a6ab0 2024-09-13T10:36:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 1 -- 172.21.15.181:0/3180973595 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1559295848 0 0) 0x7f9c00003520 con 0x7f9c140a6ab0 2024-09-13T10:36:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 1 -- 172.21.15.181:0/3180973595 >> v1:172.21.15.181:6792/0 conn(0x7f9c1413f9a0 legacy=0x7f9c14141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 1 -- 172.21.15.181:0/3180973595 >> v1:172.21.15.181:6789/0 conn(0x7f9c140a66d0 legacy=0x7f9c140a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 1 monclient: found mon.noname-i 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 1 -- 172.21.15.181:0/3180973595 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c141464e0 con 0x7f9c140a6ab0 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 10 monclient: _finish_auth 0 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 1 -- 172.21.15.181:0/3180973595 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bfc001be0 con 0x7f9c140a6ab0 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c11ffb640 10 monclient: dump: 2024-09-13T10:36:20.673 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.674 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c19695640 5 monclient: authenticate success, global_id 56446 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.666+0000 7f9c19695640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c11ffb640 1 -- 172.21.15.181:0/3180973595 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9bfc003610 con 0x7f9c140a6ab0 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c11ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c11ffb640 1 -- 172.21.15.181:0/3180973595 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bfc003b40 con 0x7f9c140a6ab0 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c19695640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c19695640 4 set_mon_vals no callback set 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c11ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c11ffb640 10 monclient: dump: 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.675 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.676 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c19695640 10 monclient: shutdown 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c19695640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c19695640 1 -- 172.21.15.181:0/3180973595 >> v1:172.21.15.195:6792/0 conn(0x7f9c140a6ab0 legacy=0x7f9c140a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c19695640 1 -- 172.21.15.181:0/3180973595 shutdown_connections 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c19695640 1 -- 172.21.15.181:0/3180973595 >> 172.21.15.181:0/3180973595 conn(0x7f9c140abcd0 msgr2=0x7f9c140ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c19695640 1 -- 172.21.15.181:0/3180973595 shutdown_connections 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.667+0000 7f9c19695640 1 -- 172.21.15.181:0/3180973595 wait complete. 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.668+0000 7f9c19695640 10 monclient: build_initial_monmap 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.668+0000 7f9c19695640 10 monclient: monmap: 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:20.677 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.668+0000 7f9c19695640 1 Processor -- start 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.668+0000 7f9c19695640 1 -- start start 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.668+0000 7f9c19695640 10 monclient: init 2024-09-13T10:36:20.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.669+0000 7f9c19695640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.669+0000 7f9c19695640 10 monclient: _add_conns ranks=[5,8,4,6,0,1,7,3,2] 2024-09-13T10:36:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.669+0000 7f9c19695640 10 monclient(hunting): picked mon.noname-h con 0x7f9c140a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.669+0000 7f9c19695640 10 monclient(hunting): picked mon.noname-e con 0x7f9c140a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.669+0000 7f9c19695640 10 monclient(hunting): picked mon.noname-c con 0x7f9c1413f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.669+0000 7f9c19695640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c1413eec0 con 0x7f9c1413f9a0 2024-09-13T10:36:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.669+0000 7f9c19695640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c1413f1a0 con 0x7f9c140a66d0 2024-09-13T10:36:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.669+0000 7f9c19695640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c140a2840 con 0x7f9c140a6ab0 2024-09-13T10:36:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.669+0000 7f9c19695640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.669+0000 7f9c19695640 10 monclient(hunting): authenticate will time out at 1120.175114s 2024-09-13T10:36:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.669+0000 7f9c127fc640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f9c140a6ab0 0x7f9c1413bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33876/0 (socket says 172.21.15.181:33876) 2024-09-13T10:36:20.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.669+0000 7f9c127fc640 1 -- 172.21.15.181:0/2263840718 learned_addr learned my addr 172.21.15.181:0/2263840718 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:20.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c137fe640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.181:6791/0 conn(0x7f9c1413f9a0 legacy=0x7f9c141d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c127fc640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.181:6793/0 conn(0x7f9c140a6ab0 legacy=0x7f9c1413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c12ffd640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.195:6791/0 conn(0x7f9c140a66d0 legacy=0x7f9c1413b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1269289825 0 0) 0x7f9c140a2840 con 0x7f9c140a6ab0 2024-09-13T10:36:20.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 10 monclient(hunting): my global_id is 104579 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bf4003520 con 0x7f9c140a6ab0 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1111982916 0 0) 0x7f9bf4003520 con 0x7f9c140a6ab0 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c140a2840 con 0x7f9c140a6ab0 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bfc001ba0 con 0x7f9c140a6ab0 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 10 monclient(hunting): dump: 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.684 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:20.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4125861590 0 0) 0x7f9c140a2840 con 0x7f9c140a6ab0 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.195:6791/0 conn(0x7f9c140a66d0 legacy=0x7f9c1413b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.181:6791/0 conn(0x7f9c1413f9a0 legacy=0x7f9c141d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 1 monclient: found mon.e 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1413ce40 con 0x7f9c140a6ab0 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c19695640 5 monclient: authenticate success, global_id 104579 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c19695640 10 monclient: _renew_subs 2024-09-13T10:36:20.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c19695640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.671+0000 7f9c19695640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9c1413d9a0 con 0x7f9c140a6ab0 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c19695640 10 monclient: _renew_subs 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c19695640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c19695640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f9c1413c440 con 0x7f9c140a6ab0 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9bfc0041e0 con 0x7f9c140a6ab0 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c0b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bfc003610 con 0x7f9c140a6ab0 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c117fa640 4 set_mon_vals no callback set 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c0b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c0b7fe640 10 monclient: dump: 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.687 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.688 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c19695640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c19695640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9bf80065c0 con 0x7f9bf8002860 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.672+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9bfc011fe0 con 0x7f9c140a6ab0 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.673+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(197..197 src has 1..197) ==== 3898+0+0 (unknown 358366297 0 0) 0x7f9bfc04e5e0 con 0x7f9c140a6ab0 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.673+0000 7f9c137fe640 10 monclient: get_auth_request con 0x7f9bf403fc30 auth_method 0 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c12ffd640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.195:6790/0 conn(0x7f9bf8002860 legacy=0x7f9bf8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893370402 0 0) 0x7f9bf80065c0 con 0x7f9bf8002860 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 10 monclient(hunting): my global_id is 6276 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c140a2840 con 0x7f9bf8002860 2024-09-13T10:36:20.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3745868141 0 0) 0x7f9c140a2840 con 0x7f9bf8002860 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bf80065c0 con 0x7f9bf8002860 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9c0c001ad0 con 0x7f9bf8002860 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 10 monclient: dump: 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.690 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2189733230 0 0) 0x7f9bf80065c0 con 0x7f9bf8002860 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9bf800a160 con 0x7f9bf8002860 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9c0c0058d0 con 0x7f9bf8002860 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:20.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.195:6790/0 conn(0x7f9bf8002860 legacy=0x7f9bf8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.675+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.195:6790/0 conn(0x7f9bf8002860 legacy=0x7f9bf8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:20.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.681+0000 7f9c19695640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:20.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.682+0000 7f9c19695640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9bf8009e30 con 0x7f9bf8009110 2024-09-13T10:36:20.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c12ffd640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.195:6790/0 conn(0x7f9bf8009110 legacy=0x7f9bf8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2396333131 0 0) 0x7f9bf8009e30 con 0x7f9bf8009110 2024-09-13T10:36:20.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c0b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c0b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c0b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c0b7fe640 10 monclient(hunting): my global_id is 6285 2024-09-13T10:36:20.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bf80065c0 con 0x7f9bf8009110 2024-09-13T10:36:20.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1758933170 0 0) 0x7f9bf80065c0 con 0x7f9bf8009110 2024-09-13T10:36:20.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bf8009e30 con 0x7f9bf8009110 2024-09-13T10:36:20.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9c0c004dd0 con 0x7f9bf8009110 2024-09-13T10:36:20.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c0b7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:20.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.684+0000 7f9c0b7fe640 10 monclient: dump: 2024-09-13T10:36:20.694 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.695 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3938005019 0 0) 0x7f9bf8009e30 con 0x7f9bf8009110 2024-09-13T10:36:20.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9bf800c3f0 con 0x7f9bf8009110 2024-09-13T10:36:20.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7562 (unknown 0 0 1606713869) 0x7f9c0c005a80 con 0x7f9bf8009110 2024-09-13T10:36:20.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c0b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:20.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c0b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:20.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.195:6790/0 conn(0x7f9bf8009110 legacy=0x7f9bf8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c0b7fe640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.195:6790/0 conn(0x7f9bf8009110 legacy=0x7f9bf8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:20.696 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:20.696 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:20.696 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 395100, 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:20.697 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.698 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.699 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:20.700 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:20.701 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.702 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.703 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:20.704 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:20.704 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.704 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:20.704 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.704 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.705 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:20.706 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:20.707 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.707 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:20.707 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.707 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.707 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:20.707 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:20.707 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.708 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.708 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.708 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:20.708 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:20.708 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.708 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:20.709 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.709 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.709 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:20.709 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:20.709 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.709 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.709 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.710 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:20.710 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:20.710 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.710 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:20.710 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.710 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.710 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:20.714 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:20.715 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:20.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:20.716 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:20.716 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:20.716 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:36:20.716 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:20.716 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:20.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:20.716 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:20.716 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:20.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c19695640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.195:6800/1839191919 conn(0x7f9bf403fc30 legacy=0x7f9bf40420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c19695640 10 monclient: shutdown 2024-09-13T10:36:20.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c19695640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:20.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c19695640 1 -- 172.21.15.181:0/2263840718 >> v1:172.21.15.181:6793/0 conn(0x7f9c140a6ab0 legacy=0x7f9c1413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c137fe640 1 -- 172.21.15.181:0/2263840718 reap_dead start 2024-09-13T10:36:20.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c137fe640 1 -- 172.21.15.181:0/2263840718 reap_dead start 2024-09-13T10:36:20.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c19695640 1 -- 172.21.15.181:0/2263840718 shutdown_connections 2024-09-13T10:36:20.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c19695640 1 -- 172.21.15.181:0/2263840718 >> 172.21.15.181:0/2263840718 conn(0x7f9c140abcd0 msgr2=0x7f9c140a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:20.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c19695640 1 -- 172.21.15.181:0/2263840718 shutdown_connections 2024-09-13T10:36:20.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.685+0000 7f9c19695640 1 -- 172.21.15.181:0/2263840718 wait complete. 2024-09-13T10:36:20.718 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:20.718 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:36:20.719 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:36:20.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.815+0000 7fa5b7544640 10 monclient: get_monmap_and_config 2024-09-13T10:36:20.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.815+0000 7fa5b7544640 10 monclient: build_initial_monmap 2024-09-13T10:36:20.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.815+0000 7fa5b7544640 10 monclient: monmap: 2024-09-13T10:36:20.817 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:20.817 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.817 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:20.816710+0000 2024-09-13T10:36:20.817 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:20.816710+0000 2024-09-13T10:36:20.818 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:20.818 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.818 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:20.818 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:20.818 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:20.818 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:20.818 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:20.818 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:20.818 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:20.818 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:20.818 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:20.818 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.815+0000 7fa5b7544640 1 Processor -- start 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.815+0000 7fa5b7544640 1 -- start start 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.815+0000 7fa5b7544640 10 monclient: init 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.816+0000 7fa5b7544640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.816+0000 7fa5b7544640 10 monclient: _add_conns ranks=[4,7,6,1,5,2,3,0,8] 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.816+0000 7fa5b7544640 10 monclient(hunting): picked mon.noname-c con 0x7fa5b00a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.816+0000 7fa5b7544640 10 monclient(hunting): picked mon.noname-i con 0x7fa5b00a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.816+0000 7fa5b7544640 10 monclient(hunting): picked mon.noname-d con 0x7fa5b013f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.816+0000 7fa5b7544640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b00a5fe0 con 0x7fa5b00a66d0 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.816+0000 7fa5b7544640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b00a8080 con 0x7fa5b013f9a0 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.816+0000 7fa5b7544640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b00a42c0 con 0x7fa5b00a6ab0 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.816+0000 7fa5b7544640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.816+0000 7fa5b7544640 10 monclient(hunting): authenticate will time out at 1120.322533s 2024-09-13T10:36:20.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.816+0000 7fa5b52e0640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fa5b00a66d0 0x7fa5b00a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58078/0 (socket says 172.21.15.181:58078) 2024-09-13T10:36:20.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.816+0000 7fa5b52e0640 1 -- 172.21.15.181:0/1375434220 learned_addr learned my addr 172.21.15.181:0/1375434220 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:20.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.818+0000 7fa5b52e0640 1 -- 172.21.15.181:0/1375434220 >> v1:172.21.15.181:6791/0 conn(0x7fa5b00a66d0 legacy=0x7fa5b00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.818+0000 7fa5b5ae1640 1 -- 172.21.15.181:0/1375434220 >> v1:172.21.15.181:6792/0 conn(0x7fa5b013f9a0 legacy=0x7fa5b0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.818+0000 7fa5b4adf640 1 -- 172.21.15.181:0/1375434220 >> v1:172.21.15.195:6792/0 conn(0x7fa5b00a6ab0 legacy=0x7fa5b00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 1 -- 172.21.15.181:0/1375434220 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502026108 0 0) 0x7fa5b00a42c0 con 0x7fa5b00a6ab0 2024-09-13T10:36:20.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient(hunting): my global_id is 56455 2024-09-13T10:36:20.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 1 -- 172.21.15.181:0/1375434220 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa59c003520 con 0x7fa5b00a6ab0 2024-09-13T10:36:20.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 1 -- 172.21.15.181:0/1375434220 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2561549723 0 0) 0x7fa59c003520 con 0x7fa5b00a6ab0 2024-09-13T10:36:20.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 1 -- 172.21.15.181:0/1375434220 >> v1:172.21.15.181:6792/0 conn(0x7fa5b013f9a0 legacy=0x7fa5b0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 1 -- 172.21.15.181:0/1375434220 >> v1:172.21.15.181:6791/0 conn(0x7fa5b00a66d0 legacy=0x7fa5b00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient: _finish_hunting 0 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 1 monclient: found mon.noname-i 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 1 -- 172.21.15.181:0/1375434220 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b01464e0 con 0x7fa5b00a6ab0 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient: _finish_auth 0 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient: _check_auth_tickets 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 1 -- 172.21.15.181:0/1375434220 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa5ac001b20 con 0x7fa5b00a6ab0 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5b7544640 5 monclient: authenticate success, global_id 56455 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5b7544640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient: dump: 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.826 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5b7544640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 1 -- 172.21.15.181:0/1375434220 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5ac003610 con 0x7fa5b00a6ab0 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 1 -- 172.21.15.181:0/1375434220 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa5ac003b80 con 0x7fa5b00a6ab0 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5b7544640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5b7544640 4 set_mon_vals no callback set 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5a7fff640 10 monclient: dump: 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.827 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.828 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5b7544640 10 monclient: shutdown 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5b7544640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5b7544640 1 -- 172.21.15.181:0/1375434220 >> v1:172.21.15.195:6792/0 conn(0x7fa5b00a6ab0 legacy=0x7fa5b00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5b7544640 1 -- 172.21.15.181:0/1375434220 shutdown_connections 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5b7544640 1 -- 172.21.15.181:0/1375434220 >> 172.21.15.181:0/1375434220 conn(0x7fa5b00abcd0 msgr2=0x7fa5b00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.819+0000 7fa5b7544640 1 -- 172.21.15.181:0/1375434220 shutdown_connections 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.820+0000 7fa5b7544640 1 -- 172.21.15.181:0/1375434220 wait complete. 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.820+0000 7fa5b7544640 10 monclient: build_initial_monmap 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.820+0000 7fa5b7544640 10 monclient: monmap: 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:20.829 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.820+0000 7fa5b7544640 1 Processor -- start 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.820+0000 7fa5b7544640 1 -- start start 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.820+0000 7fa5b7544640 10 monclient: init 2024-09-13T10:36:20.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.821+0000 7fa5b7544640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:20.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.821+0000 7fa5b7544640 10 monclient: _add_conns ranks=[1,5,3,6,8,0,4,2,7] 2024-09-13T10:36:20.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.821+0000 7fa5b7544640 10 monclient(hunting): picked mon.noname-f con 0x7fa5b00a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:20.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.821+0000 7fa5b7544640 10 monclient(hunting): picked mon.noname-h con 0x7fa5b00a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:20.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.821+0000 7fa5b7544640 10 monclient(hunting): picked mon.noname-g con 0x7fa5b013f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:20.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.821+0000 7fa5b7544640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b01376e0 con 0x7fa5b00a66d0 2024-09-13T10:36:20.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.821+0000 7fa5b7544640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b013ed80 con 0x7fa5b013f9a0 2024-09-13T10:36:20.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.821+0000 7fa5b7544640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b013f060 con 0x7fa5b00a6ab0 2024-09-13T10:36:20.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.821+0000 7fa5b7544640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:20.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.821+0000 7fa5b7544640 10 monclient(hunting): authenticate will time out at 1120.327435s 2024-09-13T10:36:20.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.821+0000 7fa5b52e0640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fa5b00a66d0 0x7fa5b01366d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:47310/0 (socket says 172.21.15.181:47310) 2024-09-13T10:36:20.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.821+0000 7fa5b52e0640 1 -- 172.21.15.181:0/3521987496 learned_addr learned my addr 172.21.15.181:0/3521987496 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:20.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.823+0000 7fa5b5ae1640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6790/0 conn(0x7fa5b013f9a0 legacy=0x7fa5b01d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.823+0000 7fa5b52e0640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6789/0 conn(0x7fa5b00a66d0 legacy=0x7fa5b01366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.823+0000 7fa5b4adf640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5b00a6ab0 legacy=0x7fa5b01d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:20.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.823+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587521263 0 0) 0x7fa5b013ed80 con 0x7fa5b013f9a0 2024-09-13T10:36:20.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.823+0000 7fa5a5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:20.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.823+0000 7fa5a5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:20.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.823+0000 7fa5a5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.823+0000 7fa5a5ffb640 10 monclient(hunting): my global_id is 6294 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa594003520 con 0x7fa5b013f9a0 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 6262267 0 0) 0x7fa594003520 con 0x7fa5b013f9a0 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5b013ed80 con 0x7fa5b013f9a0 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa5a8002070 con 0x7fa5b013f9a0 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 10 monclient(hunting): dump: 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.835 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.836 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.836 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.836 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.836 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.836 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.836 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.836 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.836 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.836 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:20.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2491224076 0 0) 0x7fa5b013ed80 con 0x7fa5b013f9a0 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5b00a6ab0 legacy=0x7fa5b01d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6789/0 conn(0x7fa5b00a66d0 legacy=0x7fa5b01366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 1 monclient: found mon.g 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b013eaa0 con 0x7fa5b013f9a0 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 10 monclient: _finish_auth 0 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5b7544640 5 monclient: authenticate success, global_id 6294 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5b7544640 10 monclient: _renew_subs 2024-09-13T10:36:20.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5b7544640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5b7544640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b013d440 con 0x7fa5b013f9a0 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5a8003da0 con 0x7fa5b013f9a0 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa5a8004350 con 0x7fa5b013f9a0 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a5ffb640 10 monclient: dump: 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:20.838 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5b7544640 10 monclient: _renew_subs 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5a77fe640 4 set_mon_vals no callback set 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5b7544640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.824+0000 7fa5b7544640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa5b013c6c0 con 0x7fa5b013f9a0 2024-09-13T10:36:20.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.825+0000 7fa5b7544640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:20.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.825+0000 7fa5b7544640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa5b0139440 con 0x7fa5b0136de0 2024-09-13T10:36:20.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.825+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa5a8004570 con 0x7fa5b013f9a0 2024-09-13T10:36:20.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.825+0000 7fa5b52e0640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5b0136de0 legacy=0x7fa5b013fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T10:36:20.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.825+0000 7fa5b52e0640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5b0136de0 legacy=0x7fa5b013fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:36:20.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.825+0000 7fa5b52e0640 1 --1- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5b0136de0 0x7fa5b013fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify read banner and identify addresses failed 2024-09-13T10:36:20.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.825+0000 7fa5b52e0640 1 --1- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5b0136de0 0x7fa5b013fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).fault on lossy channel, failing 2024-09-13T10:36:20.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.825+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5b0136de0 legacy=0x7fa5b013fd80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:20.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.825+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5b0136de0 legacy=0x7fa5b013fd80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:20.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.825+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa5b013ed80 con 0x7fa5940437d0 2024-09-13T10:36:20.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.825+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(197..197 src has 1..197) ==== 3898+0+0 (unknown 358366297 0 0) 0x7fa5a804e6d0 con 0x7fa5b013f9a0 2024-09-13T10:36:20.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.825+0000 7fa5b52e0640 10 monclient: get_auth_request con 0x7fa59403fb00 auth_method 0 2024-09-13T10:36:20.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:20.828+0000 7fa5b4adf640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5940437d0 legacy=0x7fa594045bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 550816535 0 0) 0x7fa5b013ed80 con 0x7fa5940437d0 2024-09-13T10:36:21.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 10 monclient(hunting): my global_id is 104450 2024-09-13T10:36:21.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa594003520 con 0x7fa5940437d0 2024-09-13T10:36:21.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3989094992 0 0) 0x7fa594003520 con 0x7fa5940437d0 2024-09-13T10:36:21.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5b013ed80 con 0x7fa5940437d0 2024-09-13T10:36:21.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa5ac001350 con 0x7fa5940437d0 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 10 monclient: dump: 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.340 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3847685210 0 0) 0x7fa5b013ed80 con 0x7fa5940437d0 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa594048390 con 0x7fa5940437d0 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa5ac003610 con 0x7fa5940437d0 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5940437d0 legacy=0x7fa594045bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.336+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5940437d0 legacy=0x7fa594045bc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:21.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.343+0000 7fa5b7544640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:21.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.343+0000 7fa5b7544640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa5b013cfe0 con 0x7fa5b002e200 2024-09-13T10:36:21.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.345+0000 7fa5b4adf640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5b002e200 legacy=0x7fa5b0140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595846323 0 0) 0x7fa5b013cfe0 con 0x7fa5b002e200 2024-09-13T10:36:21.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 10 monclient(hunting): my global_id is 104459 2024-09-13T10:36:21.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5b013ed80 con 0x7fa5b002e200 2024-09-13T10:36:21.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 57494947 0 0) 0x7fa5b013ed80 con 0x7fa5b002e200 2024-09-13T10:36:21.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5b013cfe0 con 0x7fa5b002e200 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa5ac004180 con 0x7fa5b002e200 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 10 monclient: dump: 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.350 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2374389383 0 0) 0x7fa5b013cfe0 con 0x7fa5b002e200 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa5b00a3240 con 0x7fa5b002e200 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 3984745983) 0x7fa5ac004180 con 0x7fa5b002e200 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5b002e200 legacy=0x7fa5b0140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5a5ffb640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6791/0 conn(0x7fa5b002e200 legacy=0x7fa5b0140490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:21.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.346+0000 7fa5b5ae1640 1 -- 172.21.15.181:0/3521987496 reap_dead start 2024-09-13T10:36:21.352 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:21.352 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:21.352 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:21.352 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:21.352 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:21.352 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 65046, 2024-09-13T10:36:21.352 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:21.353 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:21.354 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:21.354 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:21.354 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:21.354 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:21.354 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:21.354 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:21.354 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:21.354 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:21.354 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:21.354 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:21.354 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:21.354 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:21.355 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:21.356 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:21.357 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.359 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.359 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:21.359 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.359 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.359 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.359 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:21.359 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:21.359 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.359 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.359 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.360 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.361 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.362 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:21.363 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.364 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.365 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.366 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.367 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:21.368 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.369 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.370 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.371 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:21.372 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.347+0000 7fa5b7544640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa59403fb00 legacy=0x7fa594041fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.347+0000 7fa5b7544640 10 monclient: shutdown 2024-09-13T10:36:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.347+0000 7fa5b7544640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.347+0000 7fa5b7544640 1 -- 172.21.15.181:0/3521987496 >> v1:172.21.15.195:6790/0 conn(0x7fa5b013f9a0 legacy=0x7fa5b01d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.347+0000 7fa5b7544640 1 -- 172.21.15.181:0/3521987496 shutdown_connections 2024-09-13T10:36:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.347+0000 7fa5b7544640 1 -- 172.21.15.181:0/3521987496 >> 172.21.15.181:0/3521987496 conn(0x7fa5b00abcd0 msgr2=0x7fa5b00a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.347+0000 7fa5b7544640 1 -- 172.21.15.181:0/3521987496 shutdown_connections 2024-09-13T10:36:21.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.347+0000 7fa5b7544640 1 -- 172.21.15.181:0/3521987496 wait complete. 2024-09-13T10:36:21.374 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:21.374 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:36:21.374 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:36:21.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.469+0000 7f165723c640 10 monclient: get_monmap_and_config 2024-09-13T10:36:21.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.469+0000 7f165723c640 10 monclient: build_initial_monmap 2024-09-13T10:36:21.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.469+0000 7f165723c640 10 monclient: monmap: 2024-09-13T10:36:21.472 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:21.472 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:21.471535+0000 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:21.471535+0000 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:21.473 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:21.474 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.470+0000 7f165723c640 1 Processor -- start 2024-09-13T10:36:21.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.470+0000 7f165723c640 1 -- start start 2024-09-13T10:36:21.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.470+0000 7f165723c640 10 monclient: init 2024-09-13T10:36:21.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f165723c640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:21.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f165723c640 10 monclient: _add_conns ranks=[2,5,4,6,1,0,7,3,8] 2024-09-13T10:36:21.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f165723c640 10 monclient(hunting): picked mon.noname-b con 0x7f16500a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:21.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f165723c640 10 monclient(hunting): picked mon.noname-h con 0x7f16500a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:21.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f165723c640 10 monclient(hunting): picked mon.noname-c con 0x7f165013f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:21.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f165723c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16500a4bc0 con 0x7f16500a6640 2024-09-13T10:36:21.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f165723c640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165013a320 con 0x7f165013f750 2024-09-13T10:36:21.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f165723c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16500a8100 con 0x7f16500a8340 2024-09-13T10:36:21.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f165723c640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:21.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f165723c640 10 monclient(hunting): authenticate will time out at 1120.977357s 2024-09-13T10:36:21.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f16557d9640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f165013f750 0x7f1650141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58086/0 (socket says 172.21.15.181:58086) 2024-09-13T10:36:21.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f1654fd8640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f16500a6640 0x7f1650139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55292/0 (socket says 172.21.15.181:55292) 2024-09-13T10:36:21.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.471+0000 7f16557d9640 1 -- 172.21.15.181:0/536427458 learned_addr learned my addr 172.21.15.181:0/536427458 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:21.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f16557d9640 1 -- 172.21.15.181:0/536427458 >> v1:172.21.15.181:6791/0 conn(0x7f165013f750 legacy=0x7f1650141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f1654fd8640 1 -- 172.21.15.181:0/536427458 >> v1:172.21.15.181:6790/0 conn(0x7f16500a6640 legacy=0x7f1650139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164ffff640 1 -- 172.21.15.181:0/536427458 >> v1:172.21.15.195:6791/0 conn(0x7f16500a8340 legacy=0x7f1650139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1209262129 0 0) 0x7f165013a320 con 0x7f165013f750 2024-09-13T10:36:21.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 10 monclient(hunting): my global_id is 114160 2024-09-13T10:36:21.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1638003520 con 0x7f165013f750 2024-09-13T10:36:21.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967396941 0 0) 0x7f16500a4bc0 con 0x7f16500a6640 2024-09-13T10:36:21.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 10 monclient(hunting): my global_id is 114176 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f165013a320 con 0x7f16500a6640 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.473+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4102652902 0 0) 0x7f16500a8100 con 0x7f16500a8340 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient(hunting): my global_id is 104468 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16500a4bc0 con 0x7f16500a8340 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3216094945 0 0) 0x7f1638003520 con 0x7f165013f750 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 >> v1:172.21.15.195:6791/0 conn(0x7f16500a8340 legacy=0x7f1650139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 >> v1:172.21.15.181:6790/0 conn(0x7f16500a6640 legacy=0x7f1650139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:36:21.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 1 monclient: found mon.noname-c 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16500a48e0 con 0x7f165013f750 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f165723c640 5 monclient: authenticate success, global_id 114160 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1648001ae0 con 0x7f165013f750 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f165723c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient: dump: 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.482 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.483 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f165723c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16480048a0 con 0x7f165013f750 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 1 -- 172.21.15.181:0/536427458 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1648004e10 con 0x7f165013f750 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f165723c640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f165723c640 4 set_mon_vals no callback set 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f164f7fe640 10 monclient: dump: 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.484 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f165723c640 10 monclient: shutdown 2024-09-13T10:36:21.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f165723c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f165723c640 1 -- 172.21.15.181:0/536427458 >> v1:172.21.15.181:6791/0 conn(0x7f165013f750 legacy=0x7f1650141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f165723c640 1 -- 172.21.15.181:0/536427458 shutdown_connections 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f165723c640 1 -- 172.21.15.181:0/536427458 >> 172.21.15.181:0/536427458 conn(0x7f1650077170 msgr2=0x7f16500abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f165723c640 1 -- 172.21.15.181:0/536427458 shutdown_connections 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.474+0000 7f165723c640 1 -- 172.21.15.181:0/536427458 wait complete. 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.475+0000 7f165723c640 10 monclient: build_initial_monmap 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.475+0000 7f165723c640 10 monclient: monmap: 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:21.486 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.475+0000 7f165723c640 1 Processor -- start 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.475+0000 7f165723c640 1 -- start start 2024-09-13T10:36:21.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.475+0000 7f165723c640 10 monclient: init 2024-09-13T10:36:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f165723c640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f165723c640 10 monclient: _add_conns ranks=[1,6,4,2,3,7,5,8,0] 2024-09-13T10:36:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f165723c640 10 monclient(hunting): picked mon.noname-f con 0x7f16500a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f165723c640 10 monclient(hunting): picked mon.noname-d con 0x7f165013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f165723c640 10 monclient(hunting): picked mon.noname-c con 0x7f165013cf30 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f165723c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165013dea0 con 0x7f16500a8340 2024-09-13T10:36:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f165723c640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1650135050 con 0x7f165013cf30 2024-09-13T10:36:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f165723c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165013d7c0 con 0x7f165013f750 2024-09-13T10:36:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f165723c640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f165723c640 10 monclient(hunting): authenticate will time out at 1120.982378s 2024-09-13T10:36:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f16557d9640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f165013cf30 0x7f16501d6e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:58090/0 (socket says 172.21.15.181:58090) 2024-09-13T10:36:21.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f164ffff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f165013f750 0x7f16501d3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44836/0 (socket says 172.21.15.181:44836) 2024-09-13T10:36:21.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.476+0000 7f16557d9640 1 -- 172.21.15.181:0/3131731336 learned_addr learned my addr 172.21.15.181:0/3131731336 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:21.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f16557d9640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.181:6791/0 conn(0x7f165013cf30 legacy=0x7f16501d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164ffff640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.181:6792/0 conn(0x7f165013f750 legacy=0x7f16501d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f1654fd8640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.195:6789/0 conn(0x7f16500a8340 legacy=0x7f165012f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654263368 0 0) 0x7f1650135050 con 0x7f165013cf30 2024-09-13T10:36:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 10 monclient(hunting): my global_id is 114169 2024-09-13T10:36:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f163c003520 con 0x7f165013cf30 2024-09-13T10:36:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430477424 0 0) 0x7f165013d7c0 con 0x7f165013f750 2024-09-13T10:36:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 10 monclient(hunting): my global_id is 6387 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1650135050 con 0x7f165013f750 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3609436377 0 0) 0x7f163c003520 con 0x7f165013cf30 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f165013d7c0 con 0x7f165013cf30 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1648001d30 con 0x7f165013cf30 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.478+0000 7f164d7fa640 10 monclient(hunting): dump: 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.494 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345592964 0 0) 0x7f165013dea0 con 0x7f16500a8340 2024-09-13T10:36:21.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient(hunting): my global_id is 56620 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f163c003520 con 0x7f16500a8340 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2252627578 0 0) 0x7f1650135050 con 0x7f165013f750 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f165013dea0 con 0x7f165013f750 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1644003990 con 0x7f165013f750 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient(hunting): dump: 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.496 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 103721730 0 0) 0x7f165013d7c0 con 0x7f165013cf30 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.181:6792/0 conn(0x7f165013f750 legacy=0x7f16501d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.195:6789/0 conn(0x7f16500a8340 legacy=0x7f165012f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 1 monclient: found mon.c 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1650134d70 con 0x7f165013cf30 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient: _finish_auth 0 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f165723c640 5 monclient: authenticate success, global_id 114169 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f165723c640 10 monclient: _renew_subs 2024-09-13T10:36:21.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f165723c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f165723c640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f165013e4b0 con 0x7f165013cf30 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f165723c640 10 monclient: _renew_subs 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f165723c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f165723c640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f165012fff0 con 0x7f165013cf30 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16480048a0 con 0x7f165013cf30 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1648005380 con 0x7f165013cf30 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164effd640 4 set_mon_vals no callback set 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.479+0000 7f164d7fa640 10 monclient: dump: 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.499 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.500 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.480+0000 7f165723c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.480+0000 7f165723c640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f16300065c0 con 0x7f1630002860 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.480+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1648011a00 con 0x7f165013cf30 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.480+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(197..197 src has 1..197) ==== 3898+0+0 (unknown 358366297 0 0) 0x7f164804e210 con 0x7f165013cf30 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.480+0000 7f164ffff640 10 monclient: get_auth_request con 0x7f163c040510 auth_method 0 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.482+0000 7f1654fd8640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.195:6792/0 conn(0x7f1630002860 legacy=0x7f1630004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.482+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1983416594 0 0) 0x7f16300065c0 con 0x7f1630002860 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.482+0000 7f164d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.482+0000 7f164d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.482+0000 7f164d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.482+0000 7f164d7fa640 10 monclient(hunting): my global_id is 56464 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.482+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f165013d7c0 con 0x7f1630002860 2024-09-13T10:36:21.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 375774831 0 0) 0x7f165013d7c0 con 0x7f1630002860 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16300065c0 con 0x7f1630002860 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1640001ab0 con 0x7f1630002860 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 10 monclient: dump: 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.502 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 847768233 0 0) 0x7f16300065c0 con 0x7f1630002860 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f163000a160 con 0x7f1630002860 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1640006880 con 0x7f1630002860 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:21.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.195:6792/0 conn(0x7f1630002860 legacy=0x7f1630004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.483+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.195:6792/0 conn(0x7f1630002860 legacy=0x7f1630004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:21.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.489+0000 7f165723c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:21.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.489+0000 7f165723c640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1630009e50 con 0x7f1630009110 2024-09-13T10:36:21.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f1654fd8640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.195:6792/0 conn(0x7f1630009110 legacy=0x7f16300095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3395176665 0 0) 0x7f1630009e50 con 0x7f1630009110 2024-09-13T10:36:21.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 10 monclient(hunting): my global_id is 56473 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16300065c0 con 0x7f1630009110 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 389146115 0 0) 0x7f16300065c0 con 0x7f1630009110 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1630009e50 con 0x7f1630009110 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f16400050b0 con 0x7f1630009110 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 10 monclient: dump: 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.506 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2785895380 0 0) 0x7f1630009e50 con 0x7f1630009110 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.492+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f163000c3f0 con 0x7f1630009110 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 3559733666) 0x7f1640006570 con 0x7f1630009110 2024-09-13T10:36:21.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f164d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:21.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f164d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:21.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.195:6792/0 conn(0x7f1630009110 legacy=0x7f16300095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f164d7fa640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.195:6792/0 conn(0x7f1630009110 legacy=0x7f16300095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:21.508 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:21.508 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:21.508 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:21.508 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:21.508 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:21.508 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 395912, 2024-09-13T10:36:21.508 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:21.509 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:21.510 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:21.511 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:21.512 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:21.513 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.515 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.516 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.517 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:21.518 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:21.518 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.518 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.518 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.518 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:21.518 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:21.518 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.518 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.518 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.519 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:21.520 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.521 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.522 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:21.523 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.524 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:21.525 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.526 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:21.527 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:21.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:21.527 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:21.527 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:21.527 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:36:21.527 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:21.527 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:21.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:21.527 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:21.527 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:21.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f165723c640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.195:6800/1839191919 conn(0x7f163c040510 legacy=0x7f163c0429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f165723c640 10 monclient: shutdown 2024-09-13T10:36:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f165723c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f165723c640 1 -- 172.21.15.181:0/3131731336 >> v1:172.21.15.181:6791/0 conn(0x7f165013cf30 legacy=0x7f16501d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f16557d9640 1 -- 172.21.15.181:0/3131731336 reap_dead start 2024-09-13T10:36:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f16557d9640 1 -- 172.21.15.181:0/3131731336 reap_dead start 2024-09-13T10:36:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f165723c640 1 -- 172.21.15.181:0/3131731336 shutdown_connections 2024-09-13T10:36:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f165723c640 1 -- 172.21.15.181:0/3131731336 >> 172.21.15.181:0/3131731336 conn(0x7f16500a6640 msgr2=0x7f16500a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f165723c640 1 -- 172.21.15.181:0/3131731336 shutdown_connections 2024-09-13T10:36:21.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.493+0000 7f165723c640 1 -- 172.21.15.181:0/3131731336 wait complete. 2024-09-13T10:36:21.530 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:21.530 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T10:36:21.530 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T10:36:21.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.625+0000 7f09c3564640 10 monclient: get_monmap_and_config 2024-09-13T10:36:21.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.625+0000 7f09c3564640 10 monclient: build_initial_monmap 2024-09-13T10:36:21.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.625+0000 7f09c3564640 10 monclient: monmap: 2024-09-13T10:36:21.628 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:21.628 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.628 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:21.626817+0000 2024-09-13T10:36:21.628 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:21.626817+0000 2024-09-13T10:36:21.628 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:21.628 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.628 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:21.628 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:21.628 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:21.628 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:21.628 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:21.629 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:21.629 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:21.629 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:21.629 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:21.629 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.625+0000 7f09c3564640 1 Processor -- start 2024-09-13T10:36:21.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.625+0000 7f09c3564640 1 -- start start 2024-09-13T10:36:21.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.625+0000 7f09c3564640 10 monclient: init 2024-09-13T10:36:21.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.626+0000 7f09c3564640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:21.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.626+0000 7f09c3564640 10 monclient: _add_conns ranks=[1,8,7,5,4,0,2,3,6] 2024-09-13T10:36:21.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.626+0000 7f09c3564640 10 monclient(hunting): picked mon.noname-f con 0x7f09bc0a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:21.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.626+0000 7f09c3564640 10 monclient(hunting): picked mon.noname-e con 0x7f09bc0a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:21.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.626+0000 7f09c3564640 10 monclient(hunting): picked mon.noname-i con 0x7f09bc13f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:21.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.626+0000 7f09c3564640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc0a5fe0 con 0x7f09bc0a66d0 2024-09-13T10:36:21.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.626+0000 7f09c3564640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc0a8080 con 0x7f09bc13f9a0 2024-09-13T10:36:21.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.626+0000 7f09c3564640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc0a42c0 con 0x7f09bc0a6ab0 2024-09-13T10:36:21.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.626+0000 7f09c3564640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:21.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.626+0000 7f09c3564640 10 monclient(hunting): authenticate will time out at 1121.132496s 2024-09-13T10:36:21.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.626+0000 7f09c0aff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f09bc0a6ab0 0x7f09bc0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33888/0 (socket says 172.21.15.181:33888) 2024-09-13T10:36:21.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.626+0000 7f09c0aff640 1 -- 172.21.15.181:0/501149683 learned_addr learned my addr 172.21.15.181:0/501149683 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:21.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.628+0000 7f09c1300640 1 -- 172.21.15.181:0/501149683 >> v1:172.21.15.195:6789/0 conn(0x7f09bc0a66d0 legacy=0x7f09bc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.628+0000 7f09c0aff640 1 -- 172.21.15.181:0/501149683 >> v1:172.21.15.181:6793/0 conn(0x7f09bc0a6ab0 legacy=0x7f09bc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.628+0000 7f09c1b01640 1 -- 172.21.15.181:0/501149683 >> v1:172.21.15.195:6792/0 conn(0x7f09bc13f9a0 legacy=0x7f09bc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190887819 0 0) 0x7f09bc0a5fe0 con 0x7f09bc0a66d0 2024-09-13T10:36:21.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient(hunting): my global_id is 56629 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09a8003520 con 0x7f09bc0a66d0 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567094199 0 0) 0x7f09bc0a42c0 con 0x7f09bc0a6ab0 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient(hunting): my global_id is 104588 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09bc0a5fe0 con 0x7f09bc0a6ab0 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078498139 0 0) 0x7f09bc0a8080 con 0x7f09bc13f9a0 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient(hunting): my global_id is 56482 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09bc0a42c0 con 0x7f09bc13f9a0 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3287338058 0 0) 0x7f09bc0a5fe0 con 0x7f09bc0a6ab0 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 >> v1:172.21.15.195:6792/0 conn(0x7f09bc13f9a0 legacy=0x7f09bc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 >> v1:172.21.15.195:6789/0 conn(0x7f09bc0a66d0 legacy=0x7f09bc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient: _finish_hunting 0 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 monclient: found mon.noname-e 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc1464e0 con 0x7f09bc0a6ab0 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient: _finish_auth 0 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient: _check_auth_tickets 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:21.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f09ac001980 con 0x7f09bc0a6ab0 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09c3564640 5 monclient: authenticate success, global_id 104588 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09c3564640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient: dump: 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.638 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09c3564640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09ac001c50 con 0x7f09bc0a6ab0 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 1 -- 172.21.15.181:0/501149683 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f09ac004be0 con 0x7f09bc0a6ab0 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09c3564640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:21.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09c3564640 4 set_mon_vals no callback set 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09b3fff640 10 monclient: dump: 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.640 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09c3564640 10 monclient: shutdown 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09c3564640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.629+0000 7f09c3564640 1 -- 172.21.15.181:0/501149683 >> v1:172.21.15.181:6793/0 conn(0x7f09bc0a6ab0 legacy=0x7f09bc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.630+0000 7f09c3564640 1 -- 172.21.15.181:0/501149683 shutdown_connections 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.630+0000 7f09c3564640 1 -- 172.21.15.181:0/501149683 >> 172.21.15.181:0/501149683 conn(0x7f09bc0abcd0 msgr2=0x7f09bc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.630+0000 7f09c3564640 1 -- 172.21.15.181:0/501149683 shutdown_connections 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.630+0000 7f09c3564640 1 -- 172.21.15.181:0/501149683 wait complete. 2024-09-13T10:36:21.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.630+0000 7f09c3564640 10 monclient: build_initial_monmap 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.630+0000 7f09c3564640 10 monclient: monmap: 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:21.642 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.630+0000 7f09c3564640 1 Processor -- start 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c3564640 1 -- start start 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c3564640 10 monclient: init 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c3564640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c3564640 10 monclient: _add_conns ranks=[6,1,8,4,0,2,7,3,5] 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c3564640 10 monclient(hunting): picked mon.noname-d con 0x7f09bc0a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c3564640 10 monclient(hunting): picked mon.noname-f con 0x7f09bc0a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c3564640 10 monclient(hunting): picked mon.noname-e con 0x7f09bc13f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c3564640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc13cc00 con 0x7f09bc0a6ab0 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c3564640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc13e6c0 con 0x7f09bc0a66d0 2024-09-13T10:36:21.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c3564640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc13e9a0 con 0x7f09bc13f9a0 2024-09-13T10:36:21.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c3564640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:21.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c3564640 10 monclient(hunting): authenticate will time out at 1121.137513s 2024-09-13T10:36:21.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c1b01640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f09bc13f9a0 0x7f09bc1d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33898/0 (socket says 172.21.15.181:33898) 2024-09-13T10:36:21.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c1300640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f09bc0a66d0 0x7f09bc13b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:44840/0 (socket says 172.21.15.181:44840) 2024-09-13T10:36:21.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.631+0000 7f09c1b01640 1 -- 172.21.15.181:0/1912776285 learned_addr learned my addr 172.21.15.181:0/1912776285 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:21.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09c1b01640 1 -- 172.21.15.181:0/1912776285 >> v1:172.21.15.181:6793/0 conn(0x7f09bc13f9a0 legacy=0x7f09bc1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09c1300640 1 -- 172.21.15.181:0/1912776285 >> v1:172.21.15.181:6792/0 conn(0x7f09bc0a66d0 legacy=0x7f09bc13b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599596506 0 0) 0x7f09bc13e9a0 con 0x7f09bc13f9a0 2024-09-13T10:36:21.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09b1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09b1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09b1ffb640 10 monclient(hunting): my global_id is 104597 2024-09-13T10:36:21.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09c0aff640 1 -- 172.21.15.181:0/1912776285 >> v1:172.21.15.195:6789/0 conn(0x7f09bc0a6ab0 legacy=0x7f09bc13b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:21.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09a0003520 con 0x7f09bc13f9a0 2024-09-13T10:36:21.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2952250400 0 0) 0x7f09bc13e6c0 con 0x7f09bc0a66d0 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09b1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09b1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09b1ffb640 10 monclient(hunting): my global_id is 6396 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.633+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09bc13e9a0 con 0x7f09bc0a66d0 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 662276169 0 0) 0x7f09bc13e9a0 con 0x7f09bc0a66d0 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09bc13e6c0 con 0x7f09bc0a66d0 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f09b8003610 con 0x7f09bc0a66d0 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient(hunting): dump: 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.648 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.649 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.649 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.649 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.649 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.649 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.649 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.649 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.649 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.649 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.649 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.649 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3382817168 0 0) 0x7f09a0003520 con 0x7f09bc13f9a0 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09bc13e9a0 con 0x7f09bc13f9a0 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2626135736 0 0) 0x7f09bc13cc00 con 0x7f09bc0a6ab0 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient(hunting): my global_id is 56638 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09a0003520 con 0x7f09bc0a6ab0 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f09b4003990 con 0x7f09bc13f9a0 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:21.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient(hunting): dump: 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.651 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3944987651 0 0) 0x7f09bc13e6c0 con 0x7f09bc0a66d0 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 >> v1:172.21.15.181:6793/0 conn(0x7f09bc13f9a0 legacy=0x7f09bc1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 >> v1:172.21.15.195:6789/0 conn(0x7f09bc0a6ab0 legacy=0x7f09bc13b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 monclient: found mon.d 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc1374e0 con 0x7f09bc0a66d0 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient: _finish_auth 0 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:36:21.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09c3564640 5 monclient: authenticate success, global_id 6396 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09c3564640 10 monclient: _renew_subs 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09c3564640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09c3564640 1 -- 172.21.15.181:0/1912776285 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f09bc13da00 con 0x7f09bc0a66d0 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09b8003a60 con 0x7f09bc0a66d0 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f09b8003f90 con 0x7f09bc0a66d0 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b1ffb640 10 monclient: dump: 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:21.653 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09b37fe640 4 set_mon_vals no callback set 2024-09-13T10:36:21.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09c3564640 10 monclient: _renew_subs 2024-09-13T10:36:21.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09c3564640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:36:21.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.634+0000 7f09c3564640 1 -- 172.21.15.181:0/1912776285 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f09bc0a2880 con 0x7f09bc0a66d0 2024-09-13T10:36:21.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.635+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f09b8004130 con 0x7f09bc0a66d0 2024-09-13T10:36:21.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.635+0000 7f09c3564640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:21.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.635+0000 7f09c3564640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:21.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.635+0000 7f09c3564640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:36:21.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.635+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(197..197 src has 1..197) ==== 3898+0+0 (unknown 358366297 0 0) 0x7f09b804e1f0 con 0x7f09bc0a66d0 2024-09-13T10:36:21.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.635+0000 7f09c3564640 1 -- 172.21.15.181:0/1912776285 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09bc0a3240 con 0x7f09bc0a66d0 2024-09-13T10:36:21.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.635+0000 7f09c0aff640 10 monclient: get_auth_request con 0x7f09a0040330 auth_method 0 2024-09-13T10:36:21.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.640+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f09b8017620 con 0x7f09bc0a66d0 2024-09-13T10:36:21.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.640+0000 7f09b1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:21.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.640+0000 7f09b1ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:21.762 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38697]: starting. 2024-09-13T10:36:21.762 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38697]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38696 2024-09-13T10:36:21.762 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38697]: created object 0... 2024-09-13T10:36:21.762 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38697]: created object 25... 2024-09-13T10:36:21.762 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38697]: created object 49... 2024-09-13T10:36:21.762 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38697]: finishing. 2024-09-13T10:36:21.762 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38697]: shutting down. 2024-09-13T10:36:21.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.898+0000 7f09c3564640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-13T10:36:21.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.898+0000 7f09c3564640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-13T10:36:21.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.898+0000 7f09c3564640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:36:21.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.898+0000 7f09c3564640 1 -- 172.21.15.181:0/1912776285 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f09bc06e060 con 0x7f09bc0a66d0 2024-09-13T10:36:21.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.900+0000 7f09b1ffb640 1 -- 172.21.15.181:0/1912776285 <== mon.6 v1:172.21.15.181:6792/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f09b8016f20 con 0x7f09bc0a66d0 2024-09-13T10:36:21.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.901+0000 7f09b1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-13T10:36:21.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.901+0000 7f09b1ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:21.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.903+0000 7f09c3564640 1 -- 172.21.15.181:0/1912776285 >> v1:172.21.15.195:6800/1839191919 conn(0x7f09a0040330 legacy=0x7f09a00427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.903+0000 7f09c3564640 10 monclient: shutdown 2024-09-13T10:36:21.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.903+0000 7f09c3564640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:21.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.903+0000 7f09c3564640 1 -- 172.21.15.181:0/1912776285 >> v1:172.21.15.181:6792/0 conn(0x7f09bc0a66d0 legacy=0x7f09bc13b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:21.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.904+0000 7f09c3564640 1 -- 172.21.15.181:0/1912776285 shutdown_connections 2024-09-13T10:36:21.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.904+0000 7f09c3564640 1 -- 172.21.15.181:0/1912776285 >> 172.21.15.181:0/1912776285 conn(0x7f09bc0abcd0 msgr2=0x7f09bc0ab450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:21.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.904+0000 7f09c3564640 1 -- 172.21.15.181:0/1912776285 shutdown_connections 2024-09-13T10:36:21.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:21.904+0000 7f09c3564640 1 -- 172.21.15.181:0/1912776285 wait complete. 2024-09-13T10:36:21.922 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-13T10:36:21.950 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.950 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3185231847,config=2586702516,health=3888942785,kv=3279620548,logm=2777837984}) 2024-09-13T10:36:21.950 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=11,logm=59} crc {auth=545864626,config=2586702516,health=1426870541,kv=885674775,logm=1387226230}) 2024-09-13T10:36:21.950 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.950 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3185231847,config=2586702516,health=3888942785,kv=3279620548,logm=2777837984}) 2024-09-13T10:36:21.950 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=18,config=2,health=12,kv=12,logm=56} crc {auth=545864626,config=2586702516,health=1625085729,kv=3467323233,logm=1368721856}) 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3185231847,config=2586702516,health=3888942785,kv=3279620548,logm=2777837984}) 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.900+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3185231847,config=2586702516,health=517372870,kv=775579436,logm=456141939}) 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3185231847,config=2586702516,health=3888942785,kv=3279620548,logm=2777837984}) 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=545864626,config=2586702516,health=4126145323,kv=1233182105,logm=2914524570}) 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3185231847,config=2586702516,health=3888942785,kv=3279620548,logm=2777837984}) 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=16,config=1,health=10,kv=12,logm=61} crc {auth=607256361,config=1747058506,health=1426870541,kv=3467323233,logm=171766197}) 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3185231847,config=2586702516,health=3888942785,kv=3279620548,logm=2777837984}) 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=17,config=2,health=11,kv=10,logm=60} crc {auth=3324493578,config=2586702516,health=3262428247,kv=2367575921,logm=3039406395}) 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.951 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3185231847,config=2586702516,health=3888942785,kv=3279620548,logm=2777837984}) 2024-09-13T10:36:21.952 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=17,config=2,health=11,kv=12,logm=58} crc {auth=3006436629,config=2586702516,health=2710655351,kv=3467323233,logm=3059926018}) 2024-09-13T10:36:21.952 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.952 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=17,config=2,health=11,kv=11,logm=59} crc {auth=3185231847,config=2586702516,health=3888942785,kv=3279620548,logm=2777837984}) 2024-09-13T10:36:21.952 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.901+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=18,config=2,health=12,kv=11,logm=57} crc {auth=545864626,config=2586702516,health=2909334714,kv=3074811039,logm=1543636184}) 2024-09-13T10:36:21.952 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.952 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1562256838}) 2024-09-13T10:36:21.952 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1299521277}) 2024-09-13T10:36:21.952 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.952 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1562256838}) 2024-09-13T10:36:21.952 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1804682571}) 2024-09-13T10:36:21.952 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.952 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1562256838}) 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3750828611}) 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1562256838}) 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=213354122}) 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1562256838}) 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2914710602}) 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1562256838}) 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=281584891}) 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1562256838}) 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2636928155}) 2024-09-13T10:36:21.953 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.902+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1562256838}) 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.903+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=774791109}) 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1847504307}) 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4029257440}) 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1847504307}) 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4138797303}) 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1847504307}) 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1794333413}) 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.954 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1847504307}) 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=674075779}) 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1847504307}) 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3594739197}) 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1847504307}) 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=412391663}) 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1847504307}) 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1255377434}) 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1847504307}) 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.904+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1219108156}) 2024-09-13T10:36:21.955 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3398103374}) 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=66721973}) 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3398103374}) 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3638123436}) 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3398103374}) 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3639613854}) 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3398103374}) 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3587990149}) 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.956 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3398103374}) 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2974950224}) 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3398103374}) 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1875483689}) 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3398103374}) 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3848471800}) 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.905+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3398103374}) 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.906+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=68728344}) 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2745242319}) 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3550813706}) 2024-09-13T10:36:21.957 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2745242319}) 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4168356977}) 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2745242319}) 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4272017679}) 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2745242319}) 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4272017679}) 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2745242319}) 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2650906335}) 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.958 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2745242319}) 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2498990188}) 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2745242319}) 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4003918288}) 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2745242319}) 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.907+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1227182407}) 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1055669595}) 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3023515567}) 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1055669595}) 2024-09-13T10:36:21.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4060647484}) 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1055669595}) 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3039128611}) 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1055669595}) 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3039128611}) 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1055669595}) 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=34477578}) 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1055669595}) 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2757550210}) 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1055669595}) 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2017861067}) 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1055669595}) 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.908+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1150987267}) 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2375399790}) 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=170442590}) 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2375399790}) 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3278058644}) 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2375399790}) 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2782574413}) 2024-09-13T10:36:21.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2375399790}) 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2782574413}) 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2375399790}) 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.909+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3307601377}) 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.910+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.910+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2375399790}) 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.910+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2274138082}) 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.910+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.910+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2375399790}) 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.910+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2539227151}) 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.910+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.910+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2375399790}) 2024-09-13T10:36:21.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.910+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2667000313}) 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3089208692}) 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3766612588}) 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3089208692}) 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2837500253}) 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3089208692}) 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=254498398}) 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3089208692}) 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=254498398}) 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3089208692}) 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3360598467}) 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3089208692}) 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4065174400}) 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3089208692}) 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4022548633}) 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3089208692}) 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.911+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2132293131}) 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=918434669}) 2024-09-13T10:36:21.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=102061991}) 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=918434669}) 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3616109800}) 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=918434669}) 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1282627830}) 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=918434669}) 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1282627830}) 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=918434669}) 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1255352348}) 2024-09-13T10:36:21.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=918434669}) 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1810532583}) 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=918434669}) 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.912+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3236390759}) 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.913+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.913+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=918434669}) 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.913+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1563655549}) 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2862565616}) 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4140068132}) 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2862565616}) 2024-09-13T10:36:21.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=409272426}) 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2862565616}) 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=471953786}) 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2862565616}) 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=471953786}) 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2862565616}) 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1896600006}) 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2862565616}) 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3796648211}) 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2862565616}) 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3262213307}) 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2862565616}) 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.914+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2111585846}) 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3758250881}) 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2321327496}) 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3758250881}) 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4273923954}) 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3758250881}) 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1009482288}) 2024-09-13T10:36:21.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3758250881}) 2024-09-13T10:36:21.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1009482288}) 2024-09-13T10:36:21.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3758250881}) 2024-09-13T10:36:21.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=915609676}) 2024-09-13T10:36:21.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3758250881}) 2024-09-13T10:36:21.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2057125903}) 2024-09-13T10:36:21.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3758250881}) 2024-09-13T10:36:21.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1504599363}) 2024-09-13T10:36:21.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3758250881}) 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.915+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1780096382}) 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.916+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.916+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1420448146}) 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.916+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2423105260}) 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.916+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.916+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1420448146}) 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.916+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=228469164}) 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.916+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.916+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1420448146}) 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.916+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2916249912}) 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1420448146}) 2024-09-13T10:36:21.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2916249912}) 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1420448146}) 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1736370984}) 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1420448146}) 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1536068875}) 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1420448146}) 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3280834990}) 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1420448146}) 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.917+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2048317246}) 2024-09-13T10:36:21.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2961074525}) 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2115107139}) 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2961074525}) 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1800555329}) 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2961074525}) 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1799505602}) 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2961074525}) 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1799505602}) 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2961074525}) 2024-09-13T10:36:21.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1689575773}) 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2961074525}) 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3556422446}) 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2961074525}) 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1428401526}) 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2961074525}) 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.918+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2246505282}) 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2222910681}) 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=559193795}) 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2222910681}) 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=759271014}) 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2222910681}) 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4046094650}) 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2222910681}) 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4046094650}) 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2222910681}) 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2864949470}) 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2222910681}) 2024-09-13T10:36:21.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3884558197}) 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2222910681}) 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2125990590}) 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.919+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2222910681}) 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.920+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2648903400}) 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3312304544}) 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861446999}) 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3312304544}) 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4022200613}) 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3312304544}) 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2353583381}) 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3312304544}) 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2353583381}) 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3312304544}) 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3243497262}) 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3312304544}) 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2885478185}) 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3312304544}) 2024-09-13T10:36:21.976 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3721067764}) 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3312304544}) 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.921+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=694611997}) 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1156846443}) 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1137340466}) 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1156846443}) 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=486926297}) 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1156846443}) 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4268057687}) 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.977 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1156846443}) 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4268057687}) 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1156846443}) 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1627587993}) 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1156846443}) 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1042358357}) 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1156846443}) 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1779883974}) 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1156846443}) 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.922+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=659497975}) 2024-09-13T10:36:21.978 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.923+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.923+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2644893896}) 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.923+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1141981261}) 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.923+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.923+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2644893896}) 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.923+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3810213790}) 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.923+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2644893896}) 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2728557331}) 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2644893896}) 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2728557331}) 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.979 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2644893896}) 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2822134256}) 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2644893896}) 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=848423110}) 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2644893896}) 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1927002540}) 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2644893896}) 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.924+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2307126475}) 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=652515695}) 2024-09-13T10:36:21.980 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2550993969}) 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=652515695}) 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3771082070}) 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=652515695}) 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2665168432}) 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=652515695}) 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2665168432}) 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=652515695}) 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2568846414}) 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.981 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=652515695}) 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3733790698}) 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=652515695}) 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4143289967}) 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=652515695}) 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.925+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1957829019}) 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3662292861}) 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2567243948}) 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3662292861}) 2024-09-13T10:36:21.982 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3799313567}) 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3662292861}) 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3465689552}) 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3662292861}) 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3465689552}) 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3662292861}) 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=313161385}) 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3662292861}) 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=707611323}) 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3662292861}) 2024-09-13T10:36:21.983 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=560565073}) 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3662292861}) 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.926+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3701743605}) 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.927+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.927+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3755882388}) 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.927+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2211894947}) 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.927+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.927+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3755882388}) 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.927+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2885728744}) 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.927+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3755882388}) 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2191905004}) 2024-09-13T10:36:21.984 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3755882388}) 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2191905004}) 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3755882388}) 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3203917736}) 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3755882388}) 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=297758178}) 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3755882388}) 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3145608498}) 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3755882388}) 2024-09-13T10:36:21.985 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.928+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1543831659}) 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2783743716}) 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3701794062}) 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2783743716}) 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1286415196}) 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2783743716}) 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2076466181}) 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2783743716}) 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2076466181}) 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.986 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2783743716}) 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3919378797}) 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2783743716}) 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3135647182}) 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2783743716}) 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1276709804}) 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2783743716}) 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.929+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=831024408}) 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1952896424}) 2024-09-13T10:36:21.987 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2940603970}) 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1952896424}) 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=528566371}) 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1952896424}) 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=941960565}) 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1952896424}) 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=941960565}) 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1952896424}) 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2534000941}) 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.988 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1952896424}) 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2733446115}) 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1952896424}) 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1556690514}) 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1952896424}) 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.930+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3016335801}) 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296935779}) 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=223456485}) 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296935779}) 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3892881677}) 2024-09-13T10:36:21.989 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296935779}) 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1782987872}) 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296935779}) 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1782987872}) 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296935779}) 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=359210007}) 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296935779}) 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=474955966}) 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.990 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296935779}) 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2947915130}) 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=296935779}) 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=778291040}) 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=144978962}) 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2335014534}) 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=144978962}) 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3654925284}) 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=144978962}) 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1748855827}) 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.991 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=144978962}) 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1748855827}) 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=144978962}) 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2426876297}) 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=144978962}) 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1559220182}) 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=144978962}) 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3066730739}) 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=144978962}) 2024-09-13T10:36:21.992 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:21.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2565966923}) 2024-09-13T10:36:22.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=731913247}) 2024-09-13T10:36:22.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688377447}) 2024-09-13T10:36:22.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.339 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=731913247}) 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=179844877}) 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=731913247}) 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=40001270}) 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=731913247}) 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=40001270}) 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=731913247}) 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3853749168}) 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=731913247}) 2024-09-13T10:36:22.340 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.335+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3943748379}) 2024-09-13T10:36:22.341 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.336+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.341 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.336+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=731913247}) 2024-09-13T10:36:22.341 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.336+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2127601877}) 2024-09-13T10:36:22.341 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.336+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.341 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.336+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=731913247}) 2024-09-13T10:36:22.341 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.336+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3626274601}) 2024-09-13T10:36:22.357 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.352+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.357 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.352+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1012862707}) 2024-09-13T10:36:22.357 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.352+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3677390121}) 2024-09-13T10:36:22.357 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.352+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.357 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.352+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1012862707}) 2024-09-13T10:36:22.357 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.352+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=878834409}) 2024-09-13T10:36:22.357 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.357 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1012862707}) 2024-09-13T10:36:22.357 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4257590610}) 2024-09-13T10:36:22.357 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.357 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1012862707}) 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1524191769}) 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1012862707}) 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2378868667}) 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1012862707}) 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1712240606}) 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1012862707}) 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3714499676}) 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1012862707}) 2024-09-13T10:36:22.358 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.353+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4156462210}) 2024-09-13T10:36:22.655 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.655 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1111004025}) 2024-09-13T10:36:22.655 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2276824050}) 2024-09-13T10:36:22.655 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.655 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1111004025}) 2024-09-13T10:36:22.655 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=718093776}) 2024-09-13T10:36:22.655 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.655 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1111004025}) 2024-09-13T10:36:22.655 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1352764273}) 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1111004025}) 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1911247548}) 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1111004025}) 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=747478874}) 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1111004025}) 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4079263248}) 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1111004025}) 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1163805979}) 2024-09-13T10:36:22.656 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.657 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1111004025}) 2024-09-13T10:36:22.657 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.651+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2428218593}) 2024-09-13T10:36:22.658 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.658 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3237734362}) 2024-09-13T10:36:22.658 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3197400060}) 2024-09-13T10:36:22.658 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3237734362}) 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3450041294}) 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3237734362}) 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2414166689}) 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3237734362}) 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2158891317}) 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3237734362}) 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=450597688}) 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.659 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3237734362}) 2024-09-13T10:36:22.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1658060257}) 2024-09-13T10:36:22.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3237734362}) 2024-09-13T10:36:22.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4006635452}) 2024-09-13T10:36:22.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3237734362}) 2024-09-13T10:36:22.660 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.654+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2296344278}) 2024-09-13T10:36:22.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1629347375}) 2024-09-13T10:36:22.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2554888254}) 2024-09-13T10:36:22.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1629347375}) 2024-09-13T10:36:22.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2684013216}) 2024-09-13T10:36:22.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1629347375}) 2024-09-13T10:36:22.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2739078875}) 2024-09-13T10:36:22.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1629347375}) 2024-09-13T10:36:22.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1003790742}) 2024-09-13T10:36:22.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1629347375}) 2024-09-13T10:36:22.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2416245173}) 2024-09-13T10:36:22.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1629347375}) 2024-09-13T10:36:22.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3577903002}) 2024-09-13T10:36:22.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1629347375}) 2024-09-13T10:36:22.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4207146888}) 2024-09-13T10:36:22.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.660+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:22.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.660+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1629347375}) 2024-09-13T10:36:22.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:22.660+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=235261948}) 2024-09-13T10:36:22.667 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38698]: starting. 2024-09-13T10:36:22.667 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38698]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38696 2024-09-13T10:36:22.667 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38698]: shutting down. 2024-09-13T10:36:22.923 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:36:22.924 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:36:23.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.022+0000 7f4e16831640 10 monclient: get_monmap_and_config 2024-09-13T10:36:23.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.022+0000 7f4e16831640 10 monclient: build_initial_monmap 2024-09-13T10:36:23.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.022+0000 7f4e16831640 10 monclient: monmap: 2024-09-13T10:36:23.025 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:23.025 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.025 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:23.024039+0000 2024-09-13T10:36:23.025 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:23.024039+0000 2024-09-13T10:36:23.025 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:23.025 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.025 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:23.025 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:23.025 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:23.026 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:23.026 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:23.026 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:23.026 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:23.026 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:23.026 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:23.026 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 1 Processor -- start 2024-09-13T10:36:23.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 1 -- start start 2024-09-13T10:36:23.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 10 monclient: init 2024-09-13T10:36:23.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:23.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 10 monclient: _add_conns ranks=[5,7,8,3,1,6,2,0,4] 2024-09-13T10:36:23.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 10 monclient(hunting): picked mon.noname-h con 0x7f4e100a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:23.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 10 monclient(hunting): picked mon.noname-i con 0x7f4e100a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:23.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 10 monclient(hunting): picked mon.noname-e con 0x7f4e1013f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:23.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e100a4bc0 con 0x7f4e100a6640 2024-09-13T10:36:23.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e1013a320 con 0x7f4e100a8340 2024-09-13T10:36:23.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e100a8100 con 0x7f4e1013f750 2024-09-13T10:36:23.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:23.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e16831640 10 monclient(hunting): authenticate will time out at 1122.529797s 2024-09-13T10:36:23.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e14dce640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f4e1013f750 0x7f4e10141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33912/0 (socket says 172.21.15.181:33912) 2024-09-13T10:36:23.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.023+0000 7f4e14dce640 1 -- 172.21.15.181:0/1146244336 learned_addr learned my addr 172.21.15.181:0/1146244336 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:23.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e14dce640 1 -- 172.21.15.181:0/1146244336 >> v1:172.21.15.181:6793/0 conn(0x7f4e1013f750 legacy=0x7f4e10141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 1 -- 172.21.15.181:0/1146244336 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 195019602 0 0) 0x7f4e100a8100 con 0x7f4e1013f750 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient(hunting): my global_id is 104606 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 1 -- 172.21.15.181:0/1146244336 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4df8003520 con 0x7f4e1013f750 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0ffff640 1 -- 172.21.15.181:0/1146244336 >> v1:172.21.15.195:6791/0 conn(0x7f4e100a6640 legacy=0x7f4e10139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0f7fe640 1 -- 172.21.15.181:0/1146244336 >> v1:172.21.15.195:6792/0 conn(0x7f4e100a8340 legacy=0x7f4e10139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 1 -- 172.21.15.181:0/1146244336 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2383583337 0 0) 0x7f4df8003520 con 0x7f4e1013f750 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 1 -- 172.21.15.181:0/1146244336 >> v1:172.21.15.195:6792/0 conn(0x7f4e100a8340 legacy=0x7f4e10139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 1 -- 172.21.15.181:0/1146244336 >> v1:172.21.15.195:6791/0 conn(0x7f4e100a6640 legacy=0x7f4e10139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient: _finish_hunting 0 2024-09-13T10:36:23.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 1 monclient: found mon.noname-e 2024-09-13T10:36:23.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:23.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:36:23.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 1 -- 172.21.15.181:0/1146244336 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e100a48e0 con 0x7f4e1013f750 2024-09-13T10:36:23.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient: _finish_auth 0 2024-09-13T10:36:23.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient: _check_auth_tickets 2024-09-13T10:36:23.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:23.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 1 -- 172.21.15.181:0/1146244336 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4e08001e60 con 0x7f4e1013f750 2024-09-13T10:36:23.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e16831640 5 monclient: authenticate success, global_id 104606 2024-09-13T10:36:23.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e16831640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:23.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:23.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient: dump: 2024-09-13T10:36:23.040 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.040 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.040 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.040 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.040 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.040 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.040 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e16831640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 1 -- 172.21.15.181:0/1146244336 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e08004c20 con 0x7f4e1013f750 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:23.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e16831640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:23.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 1 -- 172.21.15.181:0/1146244336 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4e08005190 con 0x7f4e1013f750 2024-09-13T10:36:23.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e16831640 4 set_mon_vals no callback set 2024-09-13T10:36:23.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:23.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.026+0000 7f4e0effd640 10 monclient: dump: 2024-09-13T10:36:23.042 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.042 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.042 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.042 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.042 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.042 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.027+0000 7f4e16831640 10 monclient: shutdown 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.027+0000 7f4e16831640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.027+0000 7f4e16831640 1 -- 172.21.15.181:0/1146244336 >> v1:172.21.15.181:6793/0 conn(0x7f4e1013f750 legacy=0x7f4e10141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.027+0000 7f4e16831640 1 -- 172.21.15.181:0/1146244336 shutdown_connections 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.027+0000 7f4e16831640 1 -- 172.21.15.181:0/1146244336 >> 172.21.15.181:0/1146244336 conn(0x7f4e10077170 msgr2=0x7f4e100abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.027+0000 7f4e16831640 1 -- 172.21.15.181:0/1146244336 shutdown_connections 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.027+0000 7f4e16831640 1 -- 172.21.15.181:0/1146244336 wait complete. 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.027+0000 7f4e16831640 10 monclient: build_initial_monmap 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.027+0000 7f4e16831640 10 monclient: monmap: 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:23.044 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.027+0000 7f4e16831640 1 Processor -- start 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e16831640 1 -- start start 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e16831640 10 monclient: init 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e16831640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:23.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e16831640 10 monclient: _add_conns ranks=[7,0,2,5,4,3,6,8,1] 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e16831640 10 monclient(hunting): picked mon.noname-i con 0x7f4e100a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e16831640 10 monclient(hunting): picked mon.noname-a con 0x7f4e1013f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e16831640 10 monclient(hunting): picked mon.noname-b con 0x7f4e101d4310 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e16831640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e100a11f0 con 0x7f4e1013f750 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e16831640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e10142f40 con 0x7f4e101d4310 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e16831640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e10142b60 con 0x7f4e100a8340 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e16831640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e16831640 10 monclient(hunting): authenticate will time out at 1122.534626s 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e14dce640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f4e101d4310 0x7f4e101d6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55302/0 (socket says 172.21.15.181:55302) 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e0f7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4e1013f750 0x7f4e1009dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60148/0 (socket says 172.21.15.181:60148) 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.028+0000 7f4e14dce640 1 -- 172.21.15.181:0/1038162523 learned_addr learned my addr 172.21.15.181:0/1038162523 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.030+0000 7f4e0f7fe640 1 -- 172.21.15.181:0/1038162523 >> v1:172.21.15.181:6789/0 conn(0x7f4e1013f750 legacy=0x7f4e1009dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.030+0000 7f4e14dce640 1 -- 172.21.15.181:0/1038162523 >> v1:172.21.15.181:6790/0 conn(0x7f4e101d4310 legacy=0x7f4e101d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.030+0000 7f4e0ffff640 1 -- 172.21.15.181:0/1038162523 >> v1:172.21.15.195:6792/0 conn(0x7f4e100a8340 legacy=0x7f4e1009d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.030+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1933244584 0 0) 0x7f4e100a11f0 con 0x7f4e1013f750 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): my global_id is 114192 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dfc003550 con 0x7f4e1013f750 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237149487 0 0) 0x7f4e10142f40 con 0x7f4e101d4310 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): my global_id is 114212 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e100a11f0 con 0x7f4e101d4310 2024-09-13T10:36:23.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1936426151 0 0) 0x7f4e10142b60 con 0x7f4e100a8340 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): my global_id is 56518 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e10142f40 con 0x7f4e100a8340 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4106352541 0 0) 0x7f4dfc003550 con 0x7f4e1013f750 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e10142b60 con 0x7f4e1013f750 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4e04003610 con 0x7f4e1013f750 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): dump: 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.048 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.049 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.049 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.049 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.049 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.049 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.049 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.050 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.050 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.050 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.050 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.050 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.050 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.050 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2998371557 0 0) 0x7f4e100a11f0 con 0x7f4e101d4310 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4dfc003550 con 0x7f4e101d4310 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4e080020b0 con 0x7f4e101d4310 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): dump: 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.051 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.052 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.052 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.052 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.052 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.052 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.052 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.052 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.052 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.052 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.052 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1646734596 0 0) 0x7f4e10142f40 con 0x7f4e100a8340 2024-09-13T10:36:23.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e100a11f0 con 0x7f4e100a8340 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4e00003610 con 0x7f4e100a8340 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient(hunting): dump: 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.053 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.054 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.054 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.054 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.054 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.054 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.054 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4283941665 0 0) 0x7f4e10142b60 con 0x7f4e1013f750 2024-09-13T10:36:23.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 >> v1:172.21.15.195:6792/0 conn(0x7f4e100a8340 legacy=0x7f4e1009d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 >> v1:172.21.15.181:6790/0 conn(0x7f4e101d4310 legacy=0x7f4e101d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient: _finish_hunting 0 2024-09-13T10:36:23.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 monclient: found mon.a 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e100a0380 con 0x7f4e1013f750 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient: _finish_auth 0 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient: _check_auth_tickets 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e16831640 5 monclient: authenticate success, global_id 114192 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e16831640 10 monclient: _renew_subs 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e16831640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e16831640 1 -- 172.21.15.181:0/1038162523 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1009ee90 con 0x7f4e1013f750 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e16831640 10 monclient: _renew_subs 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e16831640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e16831640 1 -- 172.21.15.181:0/1038162523 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4e100a0f10 con 0x7f4e1013f750 2024-09-13T10:36:23.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e04003b90 con 0x7f4e1013f750 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4e04004100 con 0x7f4e1013f750 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0e7fc640 4 set_mon_vals no callback set 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.031+0000 7f4e0cff9640 10 monclient: dump: 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.056 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.057 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.058 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.058 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.058 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.032+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4e040042a0 con 0x7f4e1013f750 2024-09-13T10:36:23.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.032+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(199..199 src has 1..199) ==== 3506+0+0 (unknown 2117558571 0 0) 0x7f4e0404e130 con 0x7f4e1013f750 2024-09-13T10:36:23.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.032+0000 7f4e16831640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:23.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.032+0000 7f4e16831640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:23.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.032+0000 7f4e16831640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:23.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.032+0000 7f4e16831640 1 -- 172.21.15.181:0/1038162523 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df0005080 con 0x7f4e1013f750 2024-09-13T10:36:23.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.032+0000 7f4e0ffff640 10 monclient: get_auth_request con 0x7f4dfc040680 auth_method 0 2024-09-13T10:36:23.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.037+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f4e040177a0 con 0x7f4e1013f750 2024-09-13T10:36:23.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.037+0000 7f4e0cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:23.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.037+0000 7f4e0cff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:23.066 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.066 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011552661}) 2024-09-13T10:36:23.066 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=862224571}) 2024-09-13T10:36:23.066 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.066 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011552661}) 2024-09-13T10:36:23.066 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2566860992}) 2024-09-13T10:36:23.066 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.066 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011552661}) 2024-09-13T10:36:23.066 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=542110330}) 2024-09-13T10:36:23.066 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.066 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011552661}) 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3873675903}) 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011552661}) 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2344081045}) 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011552661}) 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3460731267}) 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011552661}) 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=996771105}) 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.053+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.054+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3011552661}) 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.054+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4279391894}) 2024-09-13T10:36:23.067 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3805987314}) 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3354635413}) 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3805987314}) 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1435371051}) 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3805987314}) 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3984635566}) 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3805987314}) 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1580898239}) 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.068 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3805987314}) 2024-09-13T10:36:23.069 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2181797976}) 2024-09-13T10:36:23.069 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.069 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3805987314}) 2024-09-13T10:36:23.069 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=788993769}) 2024-09-13T10:36:23.069 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.069 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3805987314}) 2024-09-13T10:36:23.069 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3652935091}) 2024-09-13T10:36:23.069 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.069 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3805987314}) 2024-09-13T10:36:23.069 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.055+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=221707799}) 2024-09-13T10:36:23.085 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3975194360}) 2024-09-13T10:36:23.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1365555321}) 2024-09-13T10:36:23.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3975194360}) 2024-09-13T10:36:23.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=562440304}) 2024-09-13T10:36:23.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3975194360}) 2024-09-13T10:36:23.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3150110200}) 2024-09-13T10:36:23.086 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3975194360}) 2024-09-13T10:36:23.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2045411737}) 2024-09-13T10:36:23.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3975194360}) 2024-09-13T10:36:23.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=823251772}) 2024-09-13T10:36:23.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3975194360}) 2024-09-13T10:36:23.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1148362971}) 2024-09-13T10:36:23.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3975194360}) 2024-09-13T10:36:23.087 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1197923798}) 2024-09-13T10:36:23.088 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.088 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3975194360}) 2024-09-13T10:36:23.088 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.081+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2953530179}) 2024-09-13T10:36:23.091 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.091 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3043903644}) 2024-09-13T10:36:23.091 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3581908012}) 2024-09-13T10:36:23.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3043903644}) 2024-09-13T10:36:23.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3114464903}) 2024-09-13T10:36:23.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3043903644}) 2024-09-13T10:36:23.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=753692216}) 2024-09-13T10:36:23.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3043903644}) 2024-09-13T10:36:23.092 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3579042769}) 2024-09-13T10:36:23.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3043903644}) 2024-09-13T10:36:23.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=639815728}) 2024-09-13T10:36:23.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3043903644}) 2024-09-13T10:36:23.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=655812365}) 2024-09-13T10:36:23.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3043903644}) 2024-09-13T10:36:23.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3597994651}) 2024-09-13T10:36:23.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3043903644}) 2024-09-13T10:36:23.093 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.086+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1556458517}) 2024-09-13T10:36:23.097 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.097 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=752558422}) 2024-09-13T10:36:23.097 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2442781159}) 2024-09-13T10:36:23.097 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.097 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=752558422}) 2024-09-13T10:36:23.098 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3574859496}) 2024-09-13T10:36:23.098 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.098 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=752558422}) 2024-09-13T10:36:23.098 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4283461721}) 2024-09-13T10:36:23.098 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.098 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=752558422}) 2024-09-13T10:36:23.099 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=97139816}) 2024-09-13T10:36:23.099 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.099 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=752558422}) 2024-09-13T10:36:23.099 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2893645897}) 2024-09-13T10:36:23.099 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.099 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=752558422}) 2024-09-13T10:36:23.099 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=369191804}) 2024-09-13T10:36:23.099 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.100 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=752558422}) 2024-09-13T10:36:23.100 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=996821631}) 2024-09-13T10:36:23.100 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.100 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=752558422}) 2024-09-13T10:36:23.100 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.091+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3023031726}) 2024-09-13T10:36:23.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.282+0000 7f4e16831640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:36:23.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.282+0000 7f4e16831640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:36:23.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.282+0000 7f4e16831640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:23.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.282+0000 7f4e16831640 1 -- 172.21.15.181:0/1038162523 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4df0005370 con 0x7f4e1013f750 2024-09-13T10:36:23.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.283+0000 7f4e0cff9640 1 -- 172.21.15.181:0/1038162523 <== mon.0 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 1906087899) 0x7f4e040170a0 con 0x7f4e1013f750 2024-09-13T10:36:23.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.283+0000 7f4e0cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:36:23.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.283+0000 7f4e0cff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:23.286 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":100,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:36:23.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.285+0000 7f4e16831640 1 -- 172.21.15.181:0/1038162523 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4dfc040680 legacy=0x7f4dfc042b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.285+0000 7f4e16831640 10 monclient: shutdown 2024-09-13T10:36:23.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.285+0000 7f4e16831640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:23.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.285+0000 7f4e16831640 1 -- 172.21.15.181:0/1038162523 >> v1:172.21.15.181:6789/0 conn(0x7f4e1013f750 legacy=0x7f4e1009dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.285+0000 7f4e16831640 1 -- 172.21.15.181:0/1038162523 shutdown_connections 2024-09-13T10:36:23.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.285+0000 7f4e16831640 1 -- 172.21.15.181:0/1038162523 >> 172.21.15.181:0/1038162523 conn(0x7f4e100a6640 msgr2=0x7f4e100ab3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:23.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.285+0000 7f4e16831640 1 -- 172.21.15.181:0/1038162523 shutdown_connections 2024-09-13T10:36:23.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.285+0000 7f4e16831640 1 -- 172.21.15.181:0/1038162523 wait complete. 2024-09-13T10:36:23.298 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:36:23.298 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T10:36:23.298 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:36:23.298 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:36:23.346 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2602923566}) 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2614869220}) 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2602923566}) 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2804843416}) 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2602923566}) 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4151277433}) 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2602923566}) 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4115822358}) 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2602923566}) 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=73638827}) 2024-09-13T10:36:23.347 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.348 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2602923566}) 2024-09-13T10:36:23.348 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2778922282}) 2024-09-13T10:36:23.348 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.348 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2602923566}) 2024-09-13T10:36:23.348 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=572680239}) 2024-09-13T10:36:23.348 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.348 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.342+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2602923566}) 2024-09-13T10:36:23.348 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.343+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=143379952}) 2024-09-13T10:36:23.360 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.360 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=71862076}) 2024-09-13T10:36:23.360 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3515527868}) 2024-09-13T10:36:23.360 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.360 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=71862076}) 2024-09-13T10:36:23.360 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2289359102}) 2024-09-13T10:36:23.360 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.360 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=71862076}) 2024-09-13T10:36:23.360 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2371716536}) 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=71862076}) 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1062845396}) 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=71862076}) 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4263142991}) 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=71862076}) 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=174904421}) 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=71862076}) 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=418013478}) 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=71862076}) 2024-09-13T10:36:23.361 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.357+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4289296715}) 2024-09-13T10:36:23.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792978610}) 2024-09-13T10:36:23.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3018263813}) 2024-09-13T10:36:23.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792978610}) 2024-09-13T10:36:23.370 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2936799806}) 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792978610}) 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2825268882}) 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792978610}) 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3011087128}) 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792978610}) 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4027884978}) 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792978610}) 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=207924810}) 2024-09-13T10:36:23.371 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.372 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792978610}) 2024-09-13T10:36:23.372 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=433507828}) 2024-09-13T10:36:23.372 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.372 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792978610}) 2024-09-13T10:36:23.372 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1920977863}) 2024-09-13T10:36:23.393 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.393 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3015171713}) 2024-09-13T10:36:23.393 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3655961893}) 2024-09-13T10:36:23.393 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.393 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3015171713}) 2024-09-13T10:36:23.393 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1708073552}) 2024-09-13T10:36:23.393 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.393 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3015171713}) 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=935973443}) 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3015171713}) 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1354933549}) 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3015171713}) 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3854058281}) 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3015171713}) 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1228925386}) 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3015171713}) 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1322549460}) 2024-09-13T10:36:23.394 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3015171713}) 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.368+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1052298950}) 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2943162310}) 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2675518777}) 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2943162310}) 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2147736537}) 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2943162310}) 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2621310477}) 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.395 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2943162310}) 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3710384998}) 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2943162310}) 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1792848733}) 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2943162310}) 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2718635543}) 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2943162310}) 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3568527502}) 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2943162310}) 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.370+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1130017982}) 2024-09-13T10:36:23.396 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3527061110}) 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4207544088}) 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3527061110}) 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4105092715}) 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3527061110}) 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2194767405}) 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3527061110}) 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=247932723}) 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.397 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3527061110}) 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=307672013}) 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3527061110}) 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2917825744}) 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3527061110}) 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=912060146}) 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3527061110}) 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.371+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3650228429}) 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3991380713}) 2024-09-13T10:36:23.398 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3874385558}) 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3991380713}) 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=59613231}) 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3991380713}) 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3219699930}) 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3991380713}) 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1552586190}) 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3991380713}) 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2182377903}) 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.399 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3991380713}) 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1509568460}) 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3991380713}) 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1281234002}) 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3991380713}) 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.372+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1043112245}) 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=743072937}) 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=992456509}) 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=743072937}) 2024-09-13T10:36:23.400 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=765563848}) 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=743072937}) 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3013039756}) 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=743072937}) 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2823202520}) 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=743072937}) 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3159264202}) 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=743072937}) 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=414889692}) 2024-09-13T10:36:23.401 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=743072937}) 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3709775666}) 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=743072937}) 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.373+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1335754923}) 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2043238566}) 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2760550675}) 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2043238566}) 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3298012737}) 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2043238566}) 2024-09-13T10:36:23.402 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1016848351}) 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2043238566}) 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1913826068}) 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2043238566}) 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=492523878}) 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2043238566}) 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1590460019}) 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2043238566}) 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3796730131}) 2024-09-13T10:36:23.403 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2043238566}) 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.374+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=710886443}) 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4288731889}) 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1793142854}) 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4288731889}) 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3410384528}) 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4288731889}) 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3310541273}) 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.404 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4288731889}) 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2364874990}) 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4288731889}) 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1879292281}) 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4288731889}) 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2933295712}) 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4288731889}) 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4228058306}) 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4288731889}) 2024-09-13T10:36:23.405 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.375+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1478520333}) 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1993062903}) 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1827561862}) 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1993062903}) 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=558670447}) 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1993062903}) 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2395533603}) 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1993062903}) 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2728162078}) 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1993062903}) 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2871760016}) 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1993062903}) 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=417462442}) 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1993062903}) 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3453766640}) 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1993062903}) 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.376+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=960874103}) 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3129330515}) 2024-09-13T10:36:23.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3445687769}) 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3129330515}) 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1136722547}) 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3129330515}) 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1709882636}) 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3129330515}) 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4281865541}) 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3129330515}) 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3945300743}) 2024-09-13T10:36:23.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3129330515}) 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2172248232}) 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3129330515}) 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2623729881}) 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3129330515}) 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=325737801}) 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1920441569}) 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=171608626}) 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1920441569}) 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.377+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3453916952}) 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1920441569}) 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1335160944}) 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1920441569}) 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1254278402}) 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1920441569}) 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2387662951}) 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1920441569}) 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3702589352}) 2024-09-13T10:36:23.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1920441569}) 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2685516025}) 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1920441569}) 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3470557976}) 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=922233717}) 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=696944905}) 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=922233717}) 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3652747950}) 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=922233717}) 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1734758013}) 2024-09-13T10:36:23.411 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=922233717}) 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2234034663}) 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=922233717}) 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4208920376}) 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=922233717}) 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1446538884}) 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=922233717}) 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4211188282}) 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.412 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=922233717}) 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.378+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2462951622}) 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2785146148}) 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2322373450}) 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2785146148}) 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4065810681}) 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2785146148}) 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4137796499}) 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2785146148}) 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2559383116}) 2024-09-13T10:36:23.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2785146148}) 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1966426259}) 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2785146148}) 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1990344849}) 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2785146148}) 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3961985818}) 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2785146148}) 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.379+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1175433007}) 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=3} crc {logm=3121525572,mdsmap=2874252694,mgr=1393298302,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=110461049,mon_config_key=448010936}) 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=74,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=2} crc {logm=3973309324,mdsmap=2874252693,mgr=3673157433,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1979565751,mon_config_key=4256523098}) 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=3} crc {logm=3121525572,mdsmap=2874252694,mgr=1393298302,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=110461049,mon_config_key=448010936}) 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=71,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7} crc {logm=2347688867,mdsmap=3140514009,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1904775361,mon_config_key=2284309897}) 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=3} crc {logm=3121525572,mdsmap=2874252694,mgr=1393298302,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=110461049,mon_config_key=448010936}) 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13} crc {logm=245497218,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1622466475}) 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=3} crc {logm=3121525572,mdsmap=2874252694,mgr=1393298302,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=110461049,mon_config_key=448010936}) 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13} crc {logm=1912088321,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1622466475}) 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=3} crc {logm=3121525572,mdsmap=2874252694,mgr=1393298302,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=110461049,mon_config_key=448010936}) 2024-09-13T10:36:23.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=72,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=1} crc {logm=3464908808,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2510524965,mon_config_key=3445763272}) 2024-09-13T10:36:23.416 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.416 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.380+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=3} crc {logm=3121525572,mdsmap=2874252694,mgr=1393298302,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=110461049,mon_config_key=448010936}) 2024-09-13T10:36:23.416 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.381+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=72,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=2} crc {logm=3829433690,mdsmap=2874252693,mgr=1609905495,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2510524965,mon_config_key=2984667485}) 2024-09-13T10:36:23.416 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.381+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.416 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.381+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=3} crc {logm=3121525572,mdsmap=2874252694,mgr=1393298302,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=110461049,mon_config_key=448010936}) 2024-09-13T10:36:23.416 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.381+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=73,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=1} crc {logm=3968285444,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3056150004,mon_config_key=3445763272}) 2024-09-13T10:36:23.416 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.381+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.416 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.381+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=3} crc {logm=3121525572,mdsmap=2874252694,mgr=1393298302,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=110461049,mon_config_key=448010936}) 2024-09-13T10:36:23.416 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.381+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13} crc {logm=1520196765,mdsmap=2874252693,mgr=2309484752,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1622466476}) 2024-09-13T10:36:23.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.403+0000 7f83b0390640 10 monclient: get_monmap_and_config 2024-09-13T10:36:23.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.403+0000 7f83b0390640 10 monclient: build_initial_monmap 2024-09-13T10:36:23.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.403+0000 7f83b0390640 10 monclient: monmap: 2024-09-13T10:36:23.425 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:23.425 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.425 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:23.404704+0000 2024-09-13T10:36:23.425 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:23.404704+0000 2024-09-13T10:36:23.425 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:23.425 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.425 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:23.425 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:23.425 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.403+0000 7f83b0390640 1 Processor -- start 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.403+0000 7f83b0390640 1 -- start start 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.403+0000 7f83b0390640 10 monclient: init 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83b0390640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83b0390640 10 monclient: _add_conns ranks=[2,0,6,1,4,5,8,7,3] 2024-09-13T10:36:23.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83b0390640 10 monclient(hunting): picked mon.noname-b con 0x7f83a80a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83b0390640 10 monclient(hunting): picked mon.noname-a con 0x7f83a80a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83b0390640 10 monclient(hunting): picked mon.noname-d con 0x7f83a813f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83b0390640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a80a5fe0 con 0x7f83a80a6ab0 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83b0390640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a80a8080 con 0x7f83a80a66d0 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83b0390640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a80a42c0 con 0x7f83a813f9a0 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83b0390640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83b0390640 10 monclient(hunting): authenticate will time out at 1122.910374s 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83ad92b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f83a80a6ab0 0x7f83a80a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35926/0 (socket says 172.21.15.181:35926) 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83ae92d640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f83a813f9a0 0x7f83a8141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46204/0 (socket says 172.21.15.181:46204) 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83ad92b640 1 -- 172.21.15.181:0/14621410 learned_addr learned my addr 172.21.15.181:0/14621410 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.404+0000 7f83ae12c640 1 --1- 172.21.15.181:0/14621410 >> v1:172.21.15.181:6790/0 conn(0x7f83a80a66d0 0x7f83a80a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:37004/0 (socket says 172.21.15.181:37004) 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ae92d640 1 -- 172.21.15.181:0/14621410 >> v1:172.21.15.181:6792/0 conn(0x7f83a813f9a0 legacy=0x7f83a8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ae12c640 1 -- 172.21.15.181:0/14621410 >> v1:172.21.15.181:6790/0 conn(0x7f83a80a66d0 legacy=0x7f83a80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad92b640 1 -- 172.21.15.181:0/14621410 >> v1:172.21.15.181:6789/0 conn(0x7f83a80a6ab0 legacy=0x7f83a80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494664309 0 0) 0x7f83a80a8080 con 0x7f83a80a66d0 2024-09-13T10:36:23.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 10 monclient(hunting): my global_id is 114221 2024-09-13T10:36:23.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8390003520 con 0x7f83a80a66d0 2024-09-13T10:36:23.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198015079 0 0) 0x7f83a80a42c0 con 0x7f83a813f9a0 2024-09-13T10:36:23.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 10 monclient(hunting): my global_id is 6414 2024-09-13T10:36:23.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83a80a8080 con 0x7f83a813f9a0 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755283665 0 0) 0x7f83a80a5fe0 con 0x7f83a80a6ab0 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 10 monclient(hunting): my global_id is 114201 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.406+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83a80a42c0 con 0x7f83a80a6ab0 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ae92d640 1 --1- 172.21.15.181:0/14621410 >> v1:172.21.15.181:6792/0 conn(0x7f83a813f9a0 0x7f83a8141d90 :-1 s=OPENED pgs=495 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f8398001d50 mon_map magic: 0 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2516502733 0 0) 0x7f8390003520 con 0x7f83a80a66d0 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 >> v1:172.21.15.181:6792/0 conn(0x7f83a813f9a0 legacy=0x7f83a8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 >> v1:172.21.15.181:6789/0 conn(0x7f83a80a6ab0 legacy=0x7f83a80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 10 monclient: _finish_hunting 0 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 1 monclient: found mon.noname-b 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:23.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a81464e0 con 0x7f83a80a66d0 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 10 monclient: _finish_auth 0 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 10 monclient: _check_auth_tickets 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f83a0001a10 con 0x7f83a80a66d0 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83b0390640 5 monclient: authenticate success, global_id 114221 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 10 monclient: dump: 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.430 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8398001d50 con 0x7f83a813f9a0 2024-09-13T10:36:23.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:36:23.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83b0390640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:23.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f83a0001ce0 con 0x7f83a80a66d0 2024-09-13T10:36:23.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:23.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 1 -- 172.21.15.181:0/14621410 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f83a0004b20 con 0x7f83a80a66d0 2024-09-13T10:36:23.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:36:23.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83ad12a640 10 monclient: dump: 2024-09-13T10:36:23.432 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.432 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.432 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.432 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.432 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83b0390640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:23.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83b0390640 4 set_mon_vals no callback set 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83b0390640 10 monclient: shutdown 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83b0390640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83b0390640 1 -- 172.21.15.181:0/14621410 >> v1:172.21.15.181:6790/0 conn(0x7f83a80a66d0 legacy=0x7f83a80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83b0390640 1 -- 172.21.15.181:0/14621410 shutdown_connections 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83b0390640 1 -- 172.21.15.181:0/14621410 >> 172.21.15.181:0/14621410 conn(0x7f83a80abcd0 msgr2=0x7f83a80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83b0390640 1 -- 172.21.15.181:0/14621410 shutdown_connections 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.407+0000 7f83b0390640 1 -- 172.21.15.181:0/14621410 wait complete. 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.408+0000 7f83b0390640 10 monclient: build_initial_monmap 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.408+0000 7f83b0390640 10 monclient: monmap: 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:23.434 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.408+0000 7f83b0390640 1 Processor -- start 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.408+0000 7f83b0390640 1 -- start start 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.408+0000 7f83b0390640 10 monclient: init 2024-09-13T10:36:23.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.409+0000 7f83b0390640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.409+0000 7f83b0390640 10 monclient: _add_conns ranks=[4,3,1,8,6,0,2,5,7] 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.409+0000 7f83b0390640 10 monclient(hunting): picked mon.noname-c con 0x7f83a80a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.409+0000 7f83b0390640 10 monclient(hunting): picked mon.noname-g con 0x7f83a80a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.409+0000 7f83b0390640 10 monclient(hunting): picked mon.noname-f con 0x7f83a813f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.409+0000 7f83b0390640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a813d070 con 0x7f83a813f9a0 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.409+0000 7f83b0390640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a8070680 con 0x7f83a80a6ab0 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.409+0000 7f83b0390640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a8139070 con 0x7f83a80a66d0 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.409+0000 7f83b0390640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.409+0000 7f83b0390640 10 monclient(hunting): authenticate will time out at 1122.915316s 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.409+0000 7f83ae12c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f83a80a66d0 0x7f83a8136a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:49468/0 (socket says 172.21.15.181:49468) 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.409+0000 7f83ae12c640 1 -- 172.21.15.181:0/839937760 learned_addr learned my addr 172.21.15.181:0/839937760 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.411+0000 7f83ae12c640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.181:6791/0 conn(0x7f83a80a66d0 legacy=0x7f83a8136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.411+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.411+0000 7f83ae92d640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.195:6789/0 conn(0x7f83a813f9a0 legacy=0x7f83a81d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.411+0000 7f83ad92b640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.195:6790/0 conn(0x7f83a80a6ab0 legacy=0x7f83a81d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2018208541 0 0) 0x7f83a8139070 con 0x7f83a80a66d0 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): my global_id is 114205 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8394003520 con 0x7f83a80a66d0 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600117022 0 0) 0x7f839c001c10 con 0x7f83a80a6ab0 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): my global_id is 6312 2024-09-13T10:36:23.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83a8139070 con 0x7f83a80a6ab0 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920619131 0 0) 0x7f83a813d070 con 0x7f83a813f9a0 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): my global_id is 56656 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f839c001c10 con 0x7f83a813f9a0 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1261305359 0 0) 0x7f8394003520 con 0x7f83a80a66d0 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83a813d070 con 0x7f83a80a66d0 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f83a0004b20 con 0x7f83a80a66d0 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): dump: 2024-09-13T10:36:23.438 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.439 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.440 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.440 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:23.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3841776027 0 0) 0x7f83a813d070 con 0x7f83a80a66d0 2024-09-13T10:36:23.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.195:6790/0 conn(0x7f83a80a6ab0 legacy=0x7f83a81d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.195:6789/0 conn(0x7f83a813f9a0 legacy=0x7f83a81d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:36:23.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 1 monclient: found mon.c 2024-09-13T10:36:23.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.413+0000 7f83a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:23.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83a6ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:23.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a813e870 con 0x7f83a80a66d0 2024-09-13T10:36:23.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83a6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83a6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83b0390640 5 monclient: authenticate success, global_id 114205 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83b0390640 10 monclient: _renew_subs 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83b0390640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83b0390640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f83a813f3d0 con 0x7f83a80a66d0 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83b0390640 10 monclient: _renew_subs 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83b0390640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83b0390640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f83a8137130 con 0x7f83a80a66d0 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f83a0005190 con 0x7f83a80a66d0 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83a6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f83a0001ce0 con 0x7f83a80a66d0 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83a6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83ac929640 4 set_mon_vals no callback set 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83a6ffd640 10 monclient: dump: 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.442 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83b0390640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.414+0000 7f83b0390640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f83880065c0 con 0x7f8388002860 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.415+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f83a0011b60 con 0x7f83a80a66d0 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.415+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(199..199 src has 1..199) ==== 3506+0+0 (unknown 2117558571 0 0) 0x7f83a004e180 con 0x7f83a80a66d0 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.415+0000 7f83ae92d640 10 monclient: get_auth_request con 0x7f839403ff10 auth_method 0 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83ad92b640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.181:6789/0 conn(0x7f8388002860 legacy=0x7f8388004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1532239482 0 0) 0x7f83880065c0 con 0x7f8388002860 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 10 monclient(hunting): my global_id is 114210 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83a813d070 con 0x7f8388002860 2024-09-13T10:36:23.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1754991870 0 0) 0x7f83a813d070 con 0x7f8388002860 2024-09-13T10:36:23.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83880065c0 con 0x7f8388002860 2024-09-13T10:36:23.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f839c0047e0 con 0x7f8388002860 2024-09-13T10:36:23.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:23.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 10 monclient: dump: 2024-09-13T10:36:23.444 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.444 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.444 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.444 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.444 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.444 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.444 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 658486782 0 0) 0x7f83880065c0 con 0x7f8388002860 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f838800a160 con 0x7f8388002860 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f839c004910 con 0x7f8388002860 2024-09-13T10:36:23.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:23.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:23.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.181:6789/0 conn(0x7f8388002860 legacy=0x7f8388004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.417+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.181:6789/0 conn(0x7f8388002860 legacy=0x7f8388004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:23.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.423+0000 7f83b0390640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:23.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.424+0000 7f83b0390640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8388009e50 con 0x7f8388009110 2024-09-13T10:36:23.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83ad92b640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.181:6789/0 conn(0x7f8388009110 legacy=0x7f83880095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 6146327 0 0) 0x7f8388009e50 con 0x7f8388009110 2024-09-13T10:36:23.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 10 monclient(hunting): my global_id is 114219 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83880065c0 con 0x7f8388009110 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2009801109 0 0) 0x7f83880065c0 con 0x7f8388009110 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8388009e50 con 0x7f8388009110 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f839c0050f0 con 0x7f8388009110 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 10 monclient: dump: 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.448 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.449 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 647829547 0 0) 0x7f8388009e50 con 0x7f8388009110 2024-09-13T10:36:23.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f838800c3f0 con 0x7f8388009110 2024-09-13T10:36:23.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 2436147568) 0x7f839c007490 con 0x7f8388009110 2024-09-13T10:36:23.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:23.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:23.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.181:6789/0 conn(0x7f8388009110 legacy=0x7f83880095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.426+0000 7f83a6ffd640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.181:6789/0 conn(0x7f8388009110 legacy=0x7f83880095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:23.450 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:23.450 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:23.450 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 19404, 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:23.451 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:23.452 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:23.453 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:23.454 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:23.455 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:23.456 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.457 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.458 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.461 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:23.462 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.463 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.466 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.467 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.467 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:23.467 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:23.467 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.467 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.467 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.467 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:23.468 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.469 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:36:23.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.470 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:23.470 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:23.470 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:23.470 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.470 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.470 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:23.470 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:23.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.427+0000 7f83b0390640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.195:6800/1839191919 conn(0x7f839403ff10 legacy=0x7f83940423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.427+0000 7f83b0390640 10 monclient: shutdown 2024-09-13T10:36:23.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.427+0000 7f83b0390640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:23.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.427+0000 7f83b0390640 1 -- 172.21.15.181:0/839937760 >> v1:172.21.15.181:6791/0 conn(0x7f83a80a66d0 legacy=0x7f83a8136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.427+0000 7f83ae92d640 1 -- 172.21.15.181:0/839937760 reap_dead start 2024-09-13T10:36:23.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.427+0000 7f83ae92d640 1 -- 172.21.15.181:0/839937760 reap_dead start 2024-09-13T10:36:23.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.427+0000 7f83b0390640 1 -- 172.21.15.181:0/839937760 shutdown_connections 2024-09-13T10:36:23.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.427+0000 7f83b0390640 1 -- 172.21.15.181:0/839937760 >> 172.21.15.181:0/839937760 conn(0x7f83a80abcd0 msgr2=0x7f83a80a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:23.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.427+0000 7f83b0390640 1 -- 172.21.15.181:0/839937760 shutdown_connections 2024-09-13T10:36:23.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.427+0000 7f83b0390640 1 -- 172.21.15.181:0/839937760 wait complete. 2024-09-13T10:36:23.472 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:23.472 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:36:23.473 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:36:23.549 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.549 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=3356223178,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=3975660994}) 2024-09-13T10:36:23.549 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=13,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=3331134784,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=3408845930}) 2024-09-13T10:36:23.549 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.549 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=3356223178,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=3975660994}) 2024-09-13T10:36:23.549 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=3356223178,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=2185425236}) 2024-09-13T10:36:23.550 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.550 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=3356223178,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=3975660994}) 2024-09-13T10:36:23.550 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=13,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=3331134784,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=1920590969}) 2024-09-13T10:36:23.550 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.550 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=3356223178,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=3975660994}) 2024-09-13T10:36:23.550 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {mon_config_key=13,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=3888018229,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=2040855982}) 2024-09-13T10:36:23.550 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.550 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=3356223178,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=3975660994}) 2024-09-13T10:36:23.551 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {mon_config_key=13,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=3739367853,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=4063346789}) 2024-09-13T10:36:23.551 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.551 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=3356223178,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=3975660994}) 2024-09-13T10:36:23.551 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {mon_config_key=13,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=3674454326,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=492923072}) 2024-09-13T10:36:23.551 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.551 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=3356223178,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=3975660994}) 2024-09-13T10:36:23.551 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mon_config_key=13,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=73} crc {mon_config_key=730223728,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=1914091868,osdmap=3488620726}) 2024-09-13T10:36:23.551 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.551 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=3356223178,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=3975660994}) 2024-09-13T10:36:23.551 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.543+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=3356223178,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3779057766,osd_snap=4133920409,osdmap=2889251685}) 2024-09-13T10:36:23.551 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.551 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3497740079}) 2024-09-13T10:36:23.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3205532767}) 2024-09-13T10:36:23.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3497740079}) 2024-09-13T10:36:23.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4086144360}) 2024-09-13T10:36:23.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3497740079}) 2024-09-13T10:36:23.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1122753398}) 2024-09-13T10:36:23.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3497740079}) 2024-09-13T10:36:23.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1362666192}) 2024-09-13T10:36:23.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.552 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3497740079}) 2024-09-13T10:36:23.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=1670923108}) 2024-09-13T10:36:23.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3497740079}) 2024-09-13T10:36:23.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=4113582745}) 2024-09-13T10:36:23.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3497740079}) 2024-09-13T10:36:23.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2116800969}) 2024-09-13T10:36:23.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3497740079}) 2024-09-13T10:36:23.553 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.545+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=1986635924}) 2024-09-13T10:36:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.569+0000 7efd9dee6640 10 monclient: get_monmap_and_config 2024-09-13T10:36:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.569+0000 7efd9dee6640 10 monclient: build_initial_monmap 2024-09-13T10:36:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.569+0000 7efd9dee6640 10 monclient: monmap: 2024-09-13T10:36:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:23.571569+0000 2024-09-13T10:36:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:23.571569+0000 2024-09-13T10:36:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:23.572 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:23.573 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:23.573 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.570+0000 7efd9dee6640 1 Processor -- start 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.570+0000 7efd9dee6640 1 -- start start 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.570+0000 7efd9dee6640 10 monclient: init 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd9dee6640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd9dee6640 10 monclient: _add_conns ranks=[7,6,0,3,4,1,8,5,2] 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd9dee6640 10 monclient(hunting): picked mon.noname-i con 0x7efd980a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd9dee6640 10 monclient(hunting): picked mon.noname-d con 0x7efd980a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd9dee6640 10 monclient(hunting): picked mon.noname-a con 0x7efd9813f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd9dee6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd980a4bc0 con 0x7efd9813f750 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd9dee6640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9813a320 con 0x7efd980a8340 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd9dee6640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd980a8100 con 0x7efd980a6640 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd9dee6640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:23.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd9dee6640 10 monclient(hunting): authenticate will time out at 1123.077268s 2024-09-13T10:36:23.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd97fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7efd9813f750 0x7efd98141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35954/0 (socket says 172.21.15.181:35954) 2024-09-13T10:36:23.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd8effd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7efd980a8340 0x7efd98139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46210/0 (socket says 172.21.15.181:46210) 2024-09-13T10:36:23.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.571+0000 7efd97fff640 1 -- 172.21.15.181:0/1299953086 learned_addr learned my addr 172.21.15.181:0/1299953086 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:23.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd8effd640 1 -- 172.21.15.181:0/1299953086 >> v1:172.21.15.181:6792/0 conn(0x7efd980a8340 legacy=0x7efd98139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd97fff640 1 -- 172.21.15.181:0/1299953086 >> v1:172.21.15.181:6789/0 conn(0x7efd9813f750 legacy=0x7efd98141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2715911902 0 0) 0x7efd9813a320 con 0x7efd980a8340 2024-09-13T10:36:23.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd977fe640 1 -- 172.21.15.181:0/1299953086 >> v1:172.21.15.195:6792/0 conn(0x7efd980a6640 legacy=0x7efd98139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient(hunting): my global_id is 6423 2024-09-13T10:36:23.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd84003520 con 0x7efd980a8340 2024-09-13T10:36:23.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3162610819 0 0) 0x7efd980a4bc0 con 0x7efd9813f750 2024-09-13T10:36:23.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient(hunting): my global_id is 114228 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd9813a320 con 0x7efd9813f750 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1805336060 0 0) 0x7efd980a8100 con 0x7efd980a6640 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient(hunting): my global_id is 56527 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd980a4bc0 con 0x7efd980a6640 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3957780163 0 0) 0x7efd84003520 con 0x7efd980a8340 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 >> v1:172.21.15.195:6792/0 conn(0x7efd980a6640 legacy=0x7efd98139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 >> v1:172.21.15.181:6789/0 conn(0x7efd9813f750 legacy=0x7efd98141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 1 monclient: found mon.noname-d 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd980a48e0 con 0x7efd980a8340 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient: _finish_auth 0 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd9dee6640 5 monclient: authenticate success, global_id 6423 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd80001ae0 con 0x7efd980a8340 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.573+0000 7efd96ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd96ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd96ffd640 10 monclient: dump: 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.582 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd9dee6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:23.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efd800047e0 con 0x7efd980a8340 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd96ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd9dee6640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd96ffd640 1 -- 172.21.15.181:0/1299953086 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd80004d50 con 0x7efd980a8340 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd9dee6640 4 set_mon_vals no callback set 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd96ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd96ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd96ffd640 10 monclient: dump: 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.584 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd9dee6640 10 monclient: shutdown 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd9dee6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd9dee6640 1 -- 172.21.15.181:0/1299953086 >> v1:172.21.15.181:6792/0 conn(0x7efd980a8340 legacy=0x7efd98139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd9dee6640 1 -- 172.21.15.181:0/1299953086 shutdown_connections 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd9dee6640 1 -- 172.21.15.181:0/1299953086 >> 172.21.15.181:0/1299953086 conn(0x7efd98077170 msgr2=0x7efd980abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd9dee6640 1 -- 172.21.15.181:0/1299953086 shutdown_connections 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.574+0000 7efd9dee6640 1 -- 172.21.15.181:0/1299953086 wait complete. 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.575+0000 7efd9dee6640 10 monclient: build_initial_monmap 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.575+0000 7efd9dee6640 10 monclient: monmap: 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:23.586 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.575+0000 7efd9dee6640 1 Processor -- start 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.575+0000 7efd9dee6640 1 -- start start 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.575+0000 7efd9dee6640 10 monclient: init 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.576+0000 7efd9dee6640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.576+0000 7efd9dee6640 10 monclient: _add_conns ranks=[3,0,4,5,2,8,1,7,6] 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.576+0000 7efd9dee6640 10 monclient(hunting): picked mon.noname-g con 0x7efd980a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:23.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.576+0000 7efd9dee6640 10 monclient(hunting): picked mon.noname-a con 0x7efd9813f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:23.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.576+0000 7efd9dee6640 10 monclient(hunting): picked mon.noname-c con 0x7efd9813e520 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:23.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.576+0000 7efd9dee6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9813c4a0 con 0x7efd9813f750 2024-09-13T10:36:23.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.576+0000 7efd9dee6640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9813d000 con 0x7efd980a8340 2024-09-13T10:36:23.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.576+0000 7efd9dee6640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9813df60 con 0x7efd9813e520 2024-09-13T10:36:23.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.576+0000 7efd9dee6640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:23.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.576+0000 7efd9dee6640 10 monclient(hunting): authenticate will time out at 1123.082279s 2024-09-13T10:36:23.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.576+0000 7efd8effd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7efd9813f750 0x7efd981d3510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35970/0 (socket says 172.21.15.181:35970) 2024-09-13T10:36:23.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.576+0000 7efd8effd640 1 -- 172.21.15.181:0/1877431339 learned_addr learned my addr 172.21.15.181:0/1877431339 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:23.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd8effd640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.181:6789/0 conn(0x7efd9813f750 legacy=0x7efd981d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd97fff640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.181:6791/0 conn(0x7efd9813e520 legacy=0x7efd981d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2460929794 0 0) 0x7efd9813c4a0 con 0x7efd9813f750 2024-09-13T10:36:23.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): my global_id is 114237 2024-09-13T10:36:23.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd78003550 con 0x7efd9813f750 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd977fe640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.195:6790/0 conn(0x7efd980a8340 legacy=0x7efd9812e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3456778729 0 0) 0x7efd9813df60 con 0x7efd9813e520 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): my global_id is 114214 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd9813c4a0 con 0x7efd9813e520 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361898089 0 0) 0x7efd9813d000 con 0x7efd980a8340 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): my global_id is 6321 2024-09-13T10:36:23.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd9813df60 con 0x7efd980a8340 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1889306132 0 0) 0x7efd78003550 con 0x7efd9813f750 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd9813d000 con 0x7efd9813f750 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd80004cd0 con 0x7efd9813f750 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): dump: 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.596 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2912376678 0 0) 0x7efd9813c4a0 con 0x7efd9813e520 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.578+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd78003550 con 0x7efd9813e520 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd90002060 con 0x7efd9813e520 2024-09-13T10:36:23.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient(hunting): dump: 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.598 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 320065241 0 0) 0x7efd9813df60 con 0x7efd980a8340 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd9813c4a0 con 0x7efd980a8340 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd88003610 con 0x7efd980a8340 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient(hunting): dump: 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.599 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.600 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.600 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.600 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.600 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.600 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.600 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.600 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.600 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.600 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.600 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.600 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.600 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 454382673 0 0) 0x7efd9813d000 con 0x7efd9813f750 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.181:6791/0 conn(0x7efd9813e520 legacy=0x7efd981d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.195:6790/0 conn(0x7efd980a8340 legacy=0x7efd9812e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 1 monclient: found mon.a 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9813e240 con 0x7efd9813f750 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient: _finish_auth 0 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:23.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd9dee6640 5 monclient: authenticate success, global_id 114237 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd9dee6640 10 monclient: _renew_subs 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd9dee6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd9dee6640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efd9813bac0 con 0x7efd9813f750 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd9dee6640 10 monclient: _renew_subs 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd9dee6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd9dee6640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efd9812ee30 con 0x7efd9813f750 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efd800047e0 con 0x7efd9813f750 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd80001b00 con 0x7efd9813f750 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd967fc640 4 set_mon_vals no callback set 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd94ff9640 10 monclient: dump: 2024-09-13T10:36:23.602 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.603 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd9dee6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.579+0000 7efd9dee6640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efd7c0065c0 con 0x7efd7c002860 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.580+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7efd80011b60 con 0x7efd9813f750 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.580+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(199..199 src has 1..199) ==== 3506+0+0 (unknown 2117558571 0 0) 0x7efd8004e1e0 con 0x7efd9813f750 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.580+0000 7efd97fff640 10 monclient: get_auth_request con 0x7efd780405a0 auth_method 0 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd977fe640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.181:6790/0 conn(0x7efd7c002860 legacy=0x7efd7c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624738803 0 0) 0x7efd7c0065c0 con 0x7efd7c002860 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 10 monclient(hunting): my global_id is 114230 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd9813d000 con 0x7efd7c002860 2024-09-13T10:36:23.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3289558827 0 0) 0x7efd9813d000 con 0x7efd7c002860 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd7c0065c0 con 0x7efd7c002860 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd88003e90 con 0x7efd7c002860 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 10 monclient: dump: 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.605 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2653819269 0 0) 0x7efd7c0065c0 con 0x7efd7c002860 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd7c00a160 con 0x7efd7c002860 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7efd88004140 con 0x7efd7c002860 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:23.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.582+0000 7efd94ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:23.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.583+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.181:6790/0 conn(0x7efd7c002860 legacy=0x7efd7c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.583+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.181:6790/0 conn(0x7efd7c002860 legacy=0x7efd7c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:23.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.588+0000 7efd9dee6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:23.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.589+0000 7efd9dee6640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efd7c009e50 con 0x7efd7c009110 2024-09-13T10:36:23.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd977fe640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.181:6790/0 conn(0x7efd7c009110 legacy=0x7efd7c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129766745 0 0) 0x7efd7c009e50 con 0x7efd7c009110 2024-09-13T10:36:23.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 10 monclient(hunting): my global_id is 114239 2024-09-13T10:36:23.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd7c0065c0 con 0x7efd7c009110 2024-09-13T10:36:23.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1401756717 0 0) 0x7efd7c0065c0 con 0x7efd7c009110 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd7c009e50 con 0x7efd7c009110 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd88005b00 con 0x7efd7c009110 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 10 monclient: dump: 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.608 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2439487289 0 0) 0x7efd7c009e50 con 0x7efd7c009110 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efd7c00c3a0 con 0x7efd7c009110 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 458613360) 0x7efd88005b70 con 0x7efd7c009110 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.591+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.181:6790/0 conn(0x7efd7c009110 legacy=0x7efd7c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.592+0000 7efd94ff9640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.181:6790/0 conn(0x7efd7c009110 legacy=0x7efd7c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:23.610 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:23.610 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:23.610 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:23.610 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:23.610 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:23.610 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 19569, 2024-09-13T10:36:23.610 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:23.610 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:23.610 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:23.611 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:23.611 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:23.611 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:23.611 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:23.611 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:23.611 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:23.611 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:23.611 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.611 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:36:23.611 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:23.611 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:23.612 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:23.613 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:23.614 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:23.615 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.616 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.617 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:23.618 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.619 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.620 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:23.621 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.622 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.624 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:23.625 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:23.626 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.626 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.626 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.626 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:23.626 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.626 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.626 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.627 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:23.628 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.628 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.628 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.628 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:23.628 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:23.628 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.628 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.628 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.628 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.628 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:23.629 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.630 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.630 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:23.630 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:23.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.592+0000 7efd9dee6640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.195:6800/1839191919 conn(0x7efd780405a0 legacy=0x7efd78042a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.592+0000 7efd9dee6640 10 monclient: shutdown 2024-09-13T10:36:23.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.592+0000 7efd9dee6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:23.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.592+0000 7efd9dee6640 1 -- 172.21.15.181:0/1877431339 >> v1:172.21.15.181:6789/0 conn(0x7efd9813f750 legacy=0x7efd981d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.592+0000 7efd97fff640 1 -- 172.21.15.181:0/1877431339 reap_dead start 2024-09-13T10:36:23.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.592+0000 7efd97fff640 1 -- 172.21.15.181:0/1877431339 reap_dead start 2024-09-13T10:36:23.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.592+0000 7efd9dee6640 1 -- 172.21.15.181:0/1877431339 shutdown_connections 2024-09-13T10:36:23.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.592+0000 7efd9dee6640 1 -- 172.21.15.181:0/1877431339 >> 172.21.15.181:0/1877431339 conn(0x7efd980a6640 msgr2=0x7efd980a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:23.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.592+0000 7efd9dee6640 1 -- 172.21.15.181:0/1877431339 shutdown_connections 2024-09-13T10:36:23.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.592+0000 7efd9dee6640 1 -- 172.21.15.181:0/1877431339 wait complete. 2024-09-13T10:36:23.632 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:23.632 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:36:23.632 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:36:23.662 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.662 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=97587871}) 2024-09-13T10:36:23.662 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4229509361}) 2024-09-13T10:36:23.662 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.662 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=97587871}) 2024-09-13T10:36:23.662 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2361560768}) 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=97587871}) 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3922179361}) 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=97587871}) 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=864809577}) 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=97587871}) 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=539360718}) 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=97587871}) 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=2306986377}) 2024-09-13T10:36:23.663 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=97587871}) 2024-09-13T10:36:23.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1047475453}) 2024-09-13T10:36:23.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=97587871}) 2024-09-13T10:36:23.664 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.659+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=4066158740}) 2024-09-13T10:36:23.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=33} crc {osdmap=1950676995}) 2024-09-13T10:36:23.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=32} crc {osdmap=3161644407}) 2024-09-13T10:36:23.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=33} crc {osdmap=1950676995}) 2024-09-13T10:36:23.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=32} crc {osdmap=2783723141}) 2024-09-13T10:36:23.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=33} crc {osdmap=1950676995}) 2024-09-13T10:36:23.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=32} crc {osdmap=3769062492}) 2024-09-13T10:36:23.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=33} crc {osdmap=1950676995}) 2024-09-13T10:36:23.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=31} crc {osdmap=185725253}) 2024-09-13T10:36:23.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=33} crc {osdmap=1950676995}) 2024-09-13T10:36:23.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=31} crc {osdmap=3922888304}) 2024-09-13T10:36:23.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=33} crc {osdmap=1950676995}) 2024-09-13T10:36:23.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=32} crc {osdmap=1116443358}) 2024-09-13T10:36:23.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:36:23.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=33} crc {osdmap=1950676995}) 2024-09-13T10:36:23.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:36:23.668+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=28} crc {osdmap=790015865}) 2024-09-13T10:36:23.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.735+0000 7f27edf89640 10 monclient: get_monmap_and_config 2024-09-13T10:36:23.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.735+0000 7f27edf89640 10 monclient: build_initial_monmap 2024-09-13T10:36:23.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.735+0000 7f27edf89640 10 monclient: monmap: 2024-09-13T10:36:23.737 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:23.737 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.737 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:23.736676+0000 2024-09-13T10:36:23.737 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:23.736676+0000 2024-09-13T10:36:23.738 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:23.738 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.738 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:23.738 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:23.738 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:23.738 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:23.738 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:23.738 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:23.738 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:23.738 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:23.738 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:23.738 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.735+0000 7f27edf89640 1 Processor -- start 2024-09-13T10:36:23.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.735+0000 7f27edf89640 1 -- start start 2024-09-13T10:36:23.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.735+0000 7f27edf89640 10 monclient: init 2024-09-13T10:36:23.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.736+0000 7f27edf89640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:23.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.736+0000 7f27edf89640 10 monclient: _add_conns ranks=[2,7,3,1,0,5,8,6,4] 2024-09-13T10:36:23.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.736+0000 7f27edf89640 10 monclient(hunting): picked mon.noname-b con 0x7f27e80a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:23.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.736+0000 7f27edf89640 10 monclient(hunting): picked mon.noname-i con 0x7f27e80a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:23.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.736+0000 7f27edf89640 10 monclient(hunting): picked mon.noname-g con 0x7f27e813f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:23.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.736+0000 7f27edf89640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e80a5fe0 con 0x7f27e80a66d0 2024-09-13T10:36:23.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.736+0000 7f27edf89640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e80a8080 con 0x7f27e813f9a0 2024-09-13T10:36:23.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.736+0000 7f27edf89640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e80a42c0 con 0x7f27e80a6ab0 2024-09-13T10:36:23.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.736+0000 7f27edf89640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:23.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.736+0000 7f27edf89640 10 monclient(hunting): authenticate will time out at 1123.242409s 2024-09-13T10:36:23.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.736+0000 7f27e77fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f27e80a66d0 0x7f27e80a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:37030/0 (socket says 172.21.15.181:37030) 2024-09-13T10:36:23.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.736+0000 7f27e77fe640 1 -- 172.21.15.181:0/579356527 learned_addr learned my addr 172.21.15.181:0/579356527 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:23.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.738+0000 7f27e77fe640 1 -- 172.21.15.181:0/579356527 >> v1:172.21.15.181:6790/0 conn(0x7f27e80a66d0 legacy=0x7f27e80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.738+0000 7f27deffd640 1 -- 172.21.15.181:0/579356527 >> v1:172.21.15.195:6792/0 conn(0x7f27e80a6ab0 legacy=0x7f27e80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e7fff640 1 -- 172.21.15.181:0/579356527 >> v1:172.21.15.195:6790/0 conn(0x7f27e813f9a0 legacy=0x7f27e8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 1 -- 172.21.15.181:0/579356527 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1586708934 0 0) 0x7f27e80a42c0 con 0x7f27e80a6ab0 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient(hunting): my global_id is 56536 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 1 -- 172.21.15.181:0/579356527 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27d4003520 con 0x7f27e80a6ab0 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 1 -- 172.21.15.181:0/579356527 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1663708613 0 0) 0x7f27e80a8080 con 0x7f27e813f9a0 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient(hunting): my global_id is 6330 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 1 -- 172.21.15.181:0/579356527 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e80a42c0 con 0x7f27e813f9a0 2024-09-13T10:36:23.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 1 -- 172.21.15.181:0/579356527 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4091242294 0 0) 0x7f27e80a42c0 con 0x7f27e813f9a0 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 1 -- 172.21.15.181:0/579356527 >> v1:172.21.15.195:6792/0 conn(0x7f27e80a6ab0 legacy=0x7f27e80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 1 -- 172.21.15.181:0/579356527 >> v1:172.21.15.181:6790/0 conn(0x7f27e80a66d0 legacy=0x7f27e80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 1 monclient: found mon.noname-g 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 1 -- 172.21.15.181:0/579356527 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e81464e0 con 0x7f27e813f9a0 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 1 -- 172.21.15.181:0/579356527 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f27e0001e90 con 0x7f27e813f9a0 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:36:23.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient: dump: 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.747 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27edf89640 5 monclient: authenticate success, global_id 6330 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27edf89640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 1 -- 172.21.15.181:0/579356527 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27e0003990 con 0x7f27e813f9a0 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 1 -- 172.21.15.181:0/579356527 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f27e0003f00 con 0x7f27e813f9a0 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27edf89640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27edf89640 4 set_mon_vals no callback set 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.739+0000 7f27e6ffd640 10 monclient: dump: 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.748 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.740+0000 7f27edf89640 10 monclient: shutdown 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.740+0000 7f27edf89640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.740+0000 7f27edf89640 1 -- 172.21.15.181:0/579356527 >> v1:172.21.15.195:6790/0 conn(0x7f27e813f9a0 legacy=0x7f27e8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.740+0000 7f27edf89640 1 -- 172.21.15.181:0/579356527 shutdown_connections 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.740+0000 7f27edf89640 1 -- 172.21.15.181:0/579356527 >> 172.21.15.181:0/579356527 conn(0x7f27e80abcd0 msgr2=0x7f27e80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.740+0000 7f27edf89640 1 -- 172.21.15.181:0/579356527 shutdown_connections 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.740+0000 7f27edf89640 1 -- 172.21.15.181:0/579356527 wait complete. 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.740+0000 7f27edf89640 10 monclient: build_initial_monmap 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.740+0000 7f27edf89640 10 monclient: monmap: 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:23.750 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.741+0000 7f27edf89640 1 Processor -- start 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.741+0000 7f27edf89640 1 -- start start 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.741+0000 7f27edf89640 10 monclient: init 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.741+0000 7f27edf89640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:23.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.741+0000 7f27edf89640 10 monclient: _add_conns ranks=[3,1,4,7,8,5,2,6,0] 2024-09-13T10:36:23.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.741+0000 7f27edf89640 10 monclient(hunting): picked mon.noname-g con 0x7f27e80a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:23.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.741+0000 7f27edf89640 10 monclient(hunting): picked mon.noname-f con 0x7f27e80a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:23.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.741+0000 7f27edf89640 10 monclient(hunting): picked mon.noname-c con 0x7f27e813f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:23.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.741+0000 7f27edf89640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e8068680 con 0x7f27e80a6ab0 2024-09-13T10:36:23.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.742+0000 7f27edf89640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e813e180 con 0x7f27e80a66d0 2024-09-13T10:36:23.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.742+0000 7f27edf89640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e813cc90 con 0x7f27e813f9a0 2024-09-13T10:36:23.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.742+0000 7f27edf89640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:23.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.742+0000 7f27edf89640 10 monclient(hunting): authenticate will time out at 1123.248027s 2024-09-13T10:36:23.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.742+0000 7f27e7fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f27e813f9a0 0x7f27e81d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:49488/0 (socket says 172.21.15.181:49488) 2024-09-13T10:36:23.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.742+0000 7f27e7fff640 1 -- 172.21.15.181:0/3160245219 learned_addr learned my addr 172.21.15.181:0/3160245219 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:23.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e7fff640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.181:6791/0 conn(0x7f27e813f9a0 legacy=0x7f27e81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e77fe640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.195:6790/0 conn(0x7f27e80a66d0 legacy=0x7f27e813b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1394503016 0 0) 0x7f27e813cc90 con 0x7f27e813f9a0 2024-09-13T10:36:23.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): my global_id is 114223 2024-09-13T10:36:23.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27c8003520 con 0x7f27e813f9a0 2024-09-13T10:36:23.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27deffd640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.195:6789/0 conn(0x7f27e80a6ab0 legacy=0x7f27e813b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1210576493 0 0) 0x7f27e813e180 con 0x7f27e80a66d0 2024-09-13T10:36:23.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): my global_id is 6339 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e813cc90 con 0x7f27e80a66d0 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3760019417 0 0) 0x7f27e8068680 con 0x7f27e80a6ab0 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): my global_id is 56665 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e813e180 con 0x7f27e80a6ab0 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3995742907 0 0) 0x7f27c8003520 con 0x7f27e813f9a0 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27e8068680 con 0x7f27e813f9a0 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f27e0003e80 con 0x7f27e813f9a0 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:36:23.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): dump: 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.760 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1364449562 0 0) 0x7f27e813cc90 con 0x7f27e80a66d0 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27c8003520 con 0x7f27e80a66d0 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f27d8001c40 con 0x7f27e80a66d0 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient(hunting): dump: 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.761 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2747754205 0 0) 0x7f27e8068680 con 0x7f27e813f9a0 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.195:6790/0 conn(0x7f27e80a66d0 legacy=0x7f27e813b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.195:6789/0 conn(0x7f27e80a6ab0 legacy=0x7f27e813b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 monclient: found mon.c 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e813c000 con 0x7f27e813f9a0 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient: _finish_auth 0 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27e4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27edf89640 5 monclient: authenticate success, global_id 114223 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27edf89640 10 monclient: _renew_subs 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27edf89640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27edf89640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f27e813eff0 con 0x7f27e813f9a0 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27edf89640 10 monclient: _renew_subs 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27edf89640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:23.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.744+0000 7f27edf89640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f27e81374e0 con 0x7f27e813f9a0 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.745+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27e0004350 con 0x7f27e813f9a0 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.745+0000 7f27e4ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.745+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f27e00016d0 con 0x7f27e813f9a0 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.745+0000 7f27e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.745+0000 7f27e4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.745+0000 7f27e67fc640 4 set_mon_vals no callback set 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.745+0000 7f27e4ff9640 10 monclient: dump: 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.764 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.745+0000 7f27edf89640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.745+0000 7f27edf89640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f27cc0065c0 con 0x7f27cc002860 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.745+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f27e0012020 con 0x7f27e813f9a0 2024-09-13T10:36:23.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.746+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(200..200 src has 1..200) ==== 3898+0+0 (unknown 132779179 0 0) 0x7f27e004e6c0 con 0x7f27e813f9a0 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.746+0000 7f27deffd640 10 monclient: get_auth_request con 0x7f27c8040030 auth_method 0 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e77fe640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.181:6791/0 conn(0x7f27cc002860 legacy=0x7f27cc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532863762 0 0) 0x7f27cc0065c0 con 0x7f27cc002860 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 10 monclient(hunting): my global_id is 114232 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e8068680 con 0x7f27cc002860 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1751314785 0 0) 0x7f27e8068680 con 0x7f27cc002860 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27cc0065c0 con 0x7f27cc002860 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f27d8004f20 con 0x7f27cc002860 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 10 monclient: dump: 2024-09-13T10:36:23.766 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.767 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 482866241 0 0) 0x7f27cc0065c0 con 0x7f27cc002860 2024-09-13T10:36:23.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27cc00a160 con 0x7f27cc002860 2024-09-13T10:36:23.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f27d8005180 con 0x7f27cc002860 2024-09-13T10:36:23.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:23.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:23.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.181:6791/0 conn(0x7f27cc002860 legacy=0x7f27cc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.748+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.181:6791/0 conn(0x7f27cc002860 legacy=0x7f27cc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:23.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.754+0000 7f27edf89640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:23.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.754+0000 7f27edf89640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f27cc009e50 con 0x7f27cc009110 2024-09-13T10:36:23.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e77fe640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.181:6791/0 conn(0x7f27cc009110 legacy=0x7f27cc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2332325427 0 0) 0x7f27cc009e50 con 0x7f27cc009110 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 10 monclient(hunting): my global_id is 114241 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27cc0065c0 con 0x7f27cc009110 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 396843681 0 0) 0x7f27cc0065c0 con 0x7f27cc009110 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27cc009e50 con 0x7f27cc009110 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f27d80055a0 con 0x7f27cc009110 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 10 monclient: dump: 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.770 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.771 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.772 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2504671738 0 0) 0x7f27cc009e50 con 0x7f27cc009110 2024-09-13T10:36:23.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f27cc00c3f0 con 0x7f27cc009110 2024-09-13T10:36:23.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 468669405) 0x7f27d8005d80 con 0x7f27cc009110 2024-09-13T10:36:23.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:23.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:23.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.181:6791/0 conn(0x7f27cc009110 legacy=0x7f27cc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.757+0000 7f27e4ff9640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.181:6791/0 conn(0x7f27cc009110 legacy=0x7f27cc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:23.772 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:23.772 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:23.772 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 19735, 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:23.773 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:23.774 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:23.775 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:23.776 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:23.777 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.778 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.779 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.780 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:23.781 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.782 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.783 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:23.784 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.785 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.786 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.787 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.790 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:23.790 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:23.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.790 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:23.790 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:23.790 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:23.790 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.790 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.790 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:23.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.792 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:23.792 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:23.792 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:36:23.792 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.792 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.792 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:23.793 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:23.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.758+0000 7f27edf89640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.195:6800/1839191919 conn(0x7f27c8040030 legacy=0x7f27c80424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.758+0000 7f27edf89640 10 monclient: shutdown 2024-09-13T10:36:23.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.758+0000 7f27edf89640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:23.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.758+0000 7f27edf89640 1 -- 172.21.15.181:0/3160245219 >> v1:172.21.15.181:6791/0 conn(0x7f27e813f9a0 legacy=0x7f27e81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.758+0000 7f27e7fff640 1 -- 172.21.15.181:0/3160245219 reap_dead start 2024-09-13T10:36:23.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.758+0000 7f27e7fff640 1 -- 172.21.15.181:0/3160245219 reap_dead start 2024-09-13T10:36:23.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.758+0000 7f27edf89640 1 -- 172.21.15.181:0/3160245219 shutdown_connections 2024-09-13T10:36:23.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.758+0000 7f27edf89640 1 -- 172.21.15.181:0/3160245219 >> 172.21.15.181:0/3160245219 conn(0x7f27e80abcd0 msgr2=0x7f27e80a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:23.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.758+0000 7f27edf89640 1 -- 172.21.15.181:0/3160245219 shutdown_connections 2024-09-13T10:36:23.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.758+0000 7f27edf89640 1 -- 172.21.15.181:0/3160245219 wait complete. 2024-09-13T10:36:23.795 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:23.795 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:36:23.795 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:36:23.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.891+0000 7f5fb5608640 10 monclient: get_monmap_and_config 2024-09-13T10:36:23.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.891+0000 7f5fb5608640 10 monclient: build_initial_monmap 2024-09-13T10:36:23.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.891+0000 7f5fb5608640 10 monclient: monmap: 2024-09-13T10:36:23.894 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:23.894 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.894 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:23.893314+0000 2024-09-13T10:36:23.894 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:23.893314+0000 2024-09-13T10:36:23.894 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:23.894 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.894 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:23.895 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:23.895 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:23.895 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:23.895 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:23.895 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:23.895 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:23.895 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:23.895 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:23.895 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 1 Processor -- start 2024-09-13T10:36:23.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 1 -- start start 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 10 monclient: init 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 10 monclient: _add_conns ranks=[3,0,1,7,8,5,4,2,6] 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 10 monclient(hunting): picked mon.noname-g con 0x7f5fb00a6740 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 10 monclient(hunting): picked mon.noname-a con 0x7f5fb00a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 10 monclient(hunting): picked mon.noname-f con 0x7f5fb013f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb00a2f40 con 0x7f5fb00a8340 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb00a4bc0 con 0x7f5fb013f750 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb00a5360 con 0x7f5fb00a6740 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.892+0000 7f5fb5608640 10 monclient(hunting): authenticate will time out at 1123.398954s 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.893+0000 7f5fa7fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5fb00a8340 0x7f5fb00a7230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35984/0 (socket says 172.21.15.181:35984) 2024-09-13T10:36:23.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.893+0000 7f5fa7fff640 1 -- 172.21.15.181:0/1148385934 learned_addr learned my addr 172.21.15.181:0/1148385934 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:23.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fa7fff640 1 -- 172.21.15.181:0/1148385934 >> v1:172.21.15.181:6789/0 conn(0x7f5fb00a8340 legacy=0x7f5fb00a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5faeffd640 1 -- 172.21.15.181:0/1148385934 >> v1:172.21.15.195:6790/0 conn(0x7f5fb00a6740 legacy=0x7f5fb00a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5faf7fe640 1 -- 172.21.15.181:0/1148385934 >> v1:172.21.15.195:6789/0 conn(0x7f5fb013f750 legacy=0x7f5fb0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719063288 0 0) 0x7f5fb00a2f40 con 0x7f5fb00a8340 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient(hunting): my global_id is 114246 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f9c003520 con 0x7f5fb00a8340 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1129018222 0 0) 0x7f5fb00a5360 con 0x7f5fb00a6740 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient(hunting): my global_id is 6348 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fb00a2f40 con 0x7f5fb00a6740 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101789035 0 0) 0x7f5fb00a4bc0 con 0x7f5fb013f750 2024-09-13T10:36:23.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient(hunting): my global_id is 56674 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fb00a5360 con 0x7f5fb013f750 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1578281847 0 0) 0x7f5f9c003520 con 0x7f5fb00a8340 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 >> v1:172.21.15.195:6790/0 conn(0x7f5fb00a6740 legacy=0x7f5fb00a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 >> v1:172.21.15.195:6789/0 conn(0x7f5fb013f750 legacy=0x7f5fb0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 monclient: found mon.noname-a 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb0146290 con 0x7f5fb00a8340 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient: _finish_auth 0 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:36:23.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fb5608640 5 monclient: authenticate success, global_id 114246 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5f98001ae0 con 0x7f5fb00a8340 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fb5608640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient: dump: 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.904 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fb5608640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f980048a0 con 0x7f5fb00a8340 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fb5608640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:23.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fb5608640 4 set_mon_vals no callback set 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 1 -- 172.21.15.181:0/1148385934 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5f98004e50 con 0x7f5fb00a8340 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.895+0000 7f5fae7fc640 10 monclient: dump: 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.906 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.896+0000 7f5fb5608640 10 monclient: shutdown 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.896+0000 7f5fb5608640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.896+0000 7f5fb5608640 1 -- 172.21.15.181:0/1148385934 >> v1:172.21.15.181:6789/0 conn(0x7f5fb00a8340 legacy=0x7f5fb00a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.896+0000 7f5fb5608640 1 -- 172.21.15.181:0/1148385934 shutdown_connections 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.896+0000 7f5fb5608640 1 -- 172.21.15.181:0/1148385934 >> 172.21.15.181:0/1148385934 conn(0x7f5fb00abd40 msgr2=0x7f5fb00ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.896+0000 7f5fb5608640 1 -- 172.21.15.181:0/1148385934 shutdown_connections 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.896+0000 7f5fb5608640 1 -- 172.21.15.181:0/1148385934 wait complete. 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.896+0000 7f5fb5608640 10 monclient: build_initial_monmap 2024-09-13T10:36:23.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.896+0000 7f5fb5608640 10 monclient: monmap: 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:23.908 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 1 Processor -- start 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 1 -- start start 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 10 monclient: init 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 10 monclient: _add_conns ranks=[2,8,0,7,3,5,4,6,1] 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 10 monclient(hunting): picked mon.noname-b con 0x7f5fb00a6740 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 10 monclient(hunting): picked mon.noname-e con 0x7f5fb00a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 10 monclient(hunting): picked mon.noname-a con 0x7f5fb013f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb00aad00 con 0x7f5fb013f750 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb0123b00 con 0x7f5fb00a6740 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb0123de0 con 0x7f5fb00a8340 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:23.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5fb5608640 10 monclient(hunting): authenticate will time out at 1123.403735s 2024-09-13T10:36:23.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5faeffd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f5fb00a6740 0x7f5fb013c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:37038/0 (socket says 172.21.15.181:37038) 2024-09-13T10:36:23.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.897+0000 7f5faeffd640 1 -- 172.21.15.181:0/280637952 learned_addr learned my addr 172.21.15.181:0/280637952 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:23.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.899+0000 7f5faf7fe640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.181:6789/0 conn(0x7f5fb013f750 legacy=0x7f5fb01d6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.899+0000 7f5faeffd640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.181:6790/0 conn(0x7f5fb00a6740 legacy=0x7f5fb013c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.899+0000 7f5fa7fff640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.181:6793/0 conn(0x7f5fb00a8340 legacy=0x7f5fb01d3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2234532636 0 0) 0x7f5fb00a5360 con 0x7f5fb013f750 2024-09-13T10:36:23.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): my global_id is 114255 2024-09-13T10:36:23.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f90003550 con 0x7f5fb013f750 2024-09-13T10:36:23.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512487581 0 0) 0x7f5fb0123de0 con 0x7f5fb00a8340 2024-09-13T10:36:23.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): my global_id is 104615 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fb00a5360 con 0x7f5fb00a8340 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 519694062 0 0) 0x7f5f90003550 con 0x7f5fb013f750 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5fb0123de0 con 0x7f5fb013f750 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5fa8002070 con 0x7f5fb013f750 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): dump: 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.915 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1898629984 0 0) 0x7f5fb00a5360 con 0x7f5fb00a8340 2024-09-13T10:36:23.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f90003550 con 0x7f5fb00a8340 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5f98004d90 con 0x7f5fb00a8340 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient(hunting): dump: 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.917 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1017853298 0 0) 0x7f5fb0123de0 con 0x7f5fb013f750 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.181:6793/0 conn(0x7f5fb00a8340 legacy=0x7f5fb01d3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.181:6790/0 conn(0x7f5fb00a6740 legacy=0x7f5fb013c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient: _finish_hunting 0 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 monclient: found mon.a 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:23.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb013ce50 con 0x7f5fb013f750 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient: _finish_auth 0 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient: _check_auth_tickets 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fb5608640 5 monclient: authenticate success, global_id 114255 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fb5608640 10 monclient: _renew_subs 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fb5608640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fb5608640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb01228c0 con 0x7f5fb013f750 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fb5608640 10 monclient: _renew_subs 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fb5608640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fb5608640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5fb01ce210 con 0x7f5fb013f750 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5fa8003db0 con 0x7f5fb013f750 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5fa80042a0 con 0x7f5fb013f750 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fadffb640 4 set_mon_vals no callback set 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.900+0000 7f5fa77fe640 10 monclient: dump: 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.920 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.901+0000 7f5fb5608640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.901+0000 7f5fb5608640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5f940065c0 con 0x7f5f94002860 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.901+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5fa8004540 con 0x7f5fb013f750 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.901+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(200..200 src has 1..200) ==== 3898+0+0 (unknown 132779179 0 0) 0x7f5fa804e670 con 0x7f5fb013f750 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.902+0000 7f5fa7fff640 10 monclient: get_auth_request con 0x7f5f90040250 auth_method 0 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.903+0000 7f5faeffd640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.181:6792/0 conn(0x7f5f94002860 legacy=0x7f5f94004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.903+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 769146922 0 0) 0x7f5f940065c0 con 0x7f5f94002860 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 10 monclient(hunting): my global_id is 6432 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fb0123de0 con 0x7f5f94002860 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 25988738 0 0) 0x7f5fb0123de0 con 0x7f5f94002860 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f940065c0 con 0x7f5f94002860 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5fa0001c80 con 0x7f5f94002860 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 10 monclient: dump: 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.922 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3399855207 0 0) 0x7f5f940065c0 con 0x7f5f94002860 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f9400a160 con 0x7f5f94002860 2024-09-13T10:36:23.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5fa0006830 con 0x7f5f94002860 2024-09-13T10:36:23.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:23.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:23.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.181:6792/0 conn(0x7f5f94002860 legacy=0x7f5f94004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.904+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.181:6792/0 conn(0x7f5f94002860 legacy=0x7f5f94004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:23.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.910+0000 7f5fb5608640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:23.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.910+0000 7f5fb5608640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5f94009e40 con 0x7f5f94009100 2024-09-13T10:36:23.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.912+0000 7f5faeffd640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.181:6792/0 conn(0x7f5f94009100 legacy=0x7f5f94009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:23.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458401672 0 0) 0x7f5f94009e40 con 0x7f5f94009100 2024-09-13T10:36:23.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:23.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:23.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 10 monclient(hunting): my global_id is 6441 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f940065c0 con 0x7f5f94009100 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 310947289 0 0) 0x7f5f940065c0 con 0x7f5f94009100 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f94009e40 con 0x7f5f94009100 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5fa0003d40 con 0x7f5f94009100 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 10 monclient: dump: 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:23.926 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:23.927 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:23.927 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:23.927 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:23.927 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:23.927 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:23.927 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:23.927 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:23.927 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:23.927 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:23.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 915428999 0 0) 0x7f5f94009e40 con 0x7f5f94009100 2024-09-13T10:36:23.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f9400c3a0 con 0x7f5f94009100 2024-09-13T10:36:23.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 3519062065) 0x7f5fa0004090 con 0x7f5f94009100 2024-09-13T10:36:23.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:23.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:23.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.181:6792/0 conn(0x7f5f94009100 legacy=0x7f5f94009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.913+0000 7f5fa77fe640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.181:6792/0 conn(0x7f5f94009100 legacy=0x7f5f94009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:23.928 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:23.928 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:23.928 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:23.928 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:23.928 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:23.928 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 398357, 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:36:23.929 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.930 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:23.932 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:23.933 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:23.934 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:23.937 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.938 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.939 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:23.940 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:23.942 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.943 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.944 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.945 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:23.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:23.947 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:23.947 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:23.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.914+0000 7f5fb5608640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5f90040250 legacy=0x7f5f90042710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.914+0000 7f5fb5608640 10 monclient: shutdown 2024-09-13T10:36:23.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.914+0000 7f5fb5608640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:23.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.914+0000 7f5fb5608640 1 -- 172.21.15.181:0/280637952 >> v1:172.21.15.181:6789/0 conn(0x7f5fb013f750 legacy=0x7f5fb01d6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:23.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.914+0000 7f5faf7fe640 1 -- 172.21.15.181:0/280637952 reap_dead start 2024-09-13T10:36:23.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.914+0000 7f5faf7fe640 1 -- 172.21.15.181:0/280637952 reap_dead start 2024-09-13T10:36:23.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.914+0000 7f5fb5608640 1 -- 172.21.15.181:0/280637952 shutdown_connections 2024-09-13T10:36:23.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.914+0000 7f5fb5608640 1 -- 172.21.15.181:0/280637952 >> 172.21.15.181:0/280637952 conn(0x7f5fb00abd40 msgr2=0x7f5fb0143d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:23.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.914+0000 7f5fb5608640 1 -- 172.21.15.181:0/280637952 shutdown_connections 2024-09-13T10:36:23.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:23.914+0000 7f5fb5608640 1 -- 172.21.15.181:0/280637952 wait complete. 2024-09-13T10:36:23.949 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:23.949 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:36:23.949 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:36:24.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.045+0000 7f0079650640 10 monclient: get_monmap_and_config 2024-09-13T10:36:24.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.045+0000 7f0079650640 10 monclient: build_initial_monmap 2024-09-13T10:36:24.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.045+0000 7f0079650640 10 monclient: monmap: 2024-09-13T10:36:24.047 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:24.047 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:24.046670+0000 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:24.046670+0000 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:24.048 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:24.049 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.045+0000 7f0079650640 1 Processor -- start 2024-09-13T10:36:24.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.045+0000 7f0079650640 1 -- start start 2024-09-13T10:36:24.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.045+0000 7f0079650640 10 monclient: init 2024-09-13T10:36:24.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f0079650640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:24.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f0079650640 10 monclient: _add_conns ranks=[0,1,2,5,4,7,6,8,3] 2024-09-13T10:36:24.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f0079650640 10 monclient(hunting): picked mon.noname-a con 0x7f00740a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:24.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f0079650640 10 monclient(hunting): picked mon.noname-f con 0x7f00740a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:24.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f0079650640 10 monclient(hunting): picked mon.noname-b con 0x7f007413f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:24.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f0079650640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00740a5fe0 con 0x7f00740a66d0 2024-09-13T10:36:24.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f0079650640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00740a8080 con 0x7f00740a6ab0 2024-09-13T10:36:24.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f0079650640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00740a42c0 con 0x7f007413f9a0 2024-09-13T10:36:24.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f0079650640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:24.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f0079650640 10 monclient(hunting): authenticate will time out at 1123.552424s 2024-09-13T10:36:24.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f0072ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f00740a66d0 0x7f00740a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36000/0 (socket says 172.21.15.181:36000) 2024-09-13T10:36:24.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f0072ffd640 1 -- 172.21.15.181:0/1511078193 learned_addr learned my addr 172.21.15.181:0/1511078193 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:24.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.046+0000 7f00737fe640 1 --1- 172.21.15.181:0/1511078193 >> v1:172.21.15.181:6790/0 conn(0x7f007413f9a0 0x7f0074141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:37054/0 (socket says 172.21.15.181:37054) 2024-09-13T10:36:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0072ffd640 1 -- 172.21.15.181:0/1511078193 >> v1:172.21.15.181:6789/0 conn(0x7f00740a66d0 legacy=0x7f00740a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f00737fe640 1 -- 172.21.15.181:0/1511078193 >> v1:172.21.15.181:6790/0 conn(0x7f007413f9a0 legacy=0x7f0074141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f00727fc640 1 -- 172.21.15.181:0/1511078193 >> v1:172.21.15.195:6789/0 conn(0x7f00740a6ab0 legacy=0x7f00740a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1166085517 0 0) 0x7f00740a42c0 con 0x7f007413f9a0 2024-09-13T10:36:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 10 monclient(hunting): my global_id is 114248 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f005c003520 con 0x7f007413f9a0 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3535570787 0 0) 0x7f00740a8080 con 0x7f00740a6ab0 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 10 monclient(hunting): my global_id is 56683 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00740a42c0 con 0x7f00740a6ab0 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211121831 0 0) 0x7f00740a5fe0 con 0x7f00740a66d0 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 10 monclient(hunting): my global_id is 114264 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.048+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00740a8080 con 0x7f00740a66d0 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2868866263 0 0) 0x7f00740a42c0 con 0x7f00740a6ab0 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 >> v1:172.21.15.181:6790/0 conn(0x7f007413f9a0 legacy=0x7f0074141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 >> v1:172.21.15.181:6789/0 conn(0x7f00740a66d0 legacy=0x7f00740a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 1 monclient: found mon.noname-f 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00741464e0 con 0x7f00740a6ab0 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 10 monclient: _finish_auth 0 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0079650640 5 monclient: authenticate success, global_id 56683 2024-09-13T10:36:24.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0068001b10 con 0x7f00740a6ab0 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0079650640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 10 monclient: dump: 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.058 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.059 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.059 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.059 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.059 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.059 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.059 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.059 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0079650640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:24.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0068003610 con 0x7f00740a6ab0 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0079650640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 1 -- 172.21.15.181:0/1511078193 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0068003bc0 con 0x7f00740a6ab0 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0079650640 4 set_mon_vals no callback set 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0071ffb640 10 monclient: dump: 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.060 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0079650640 10 monclient: shutdown 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0079650640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:24.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0079650640 1 -- 172.21.15.181:0/1511078193 >> v1:172.21.15.195:6789/0 conn(0x7f00740a6ab0 legacy=0x7f00740a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0079650640 1 -- 172.21.15.181:0/1511078193 shutdown_connections 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0079650640 1 -- 172.21.15.181:0/1511078193 >> 172.21.15.181:0/1511078193 conn(0x7f00740abcd0 msgr2=0x7f00740ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0079650640 1 -- 172.21.15.181:0/1511078193 shutdown_connections 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.049+0000 7f0079650640 1 -- 172.21.15.181:0/1511078193 wait complete. 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.050+0000 7f0079650640 10 monclient: build_initial_monmap 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.050+0000 7f0079650640 10 monclient: monmap: 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:24.062 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.050+0000 7f0079650640 1 Processor -- start 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.050+0000 7f0079650640 1 -- start start 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.050+0000 7f0079650640 10 monclient: init 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f0079650640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f0079650640 10 monclient: _add_conns ranks=[3,6,8,7,2,0,1,5,4] 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f0079650640 10 monclient(hunting): picked mon.noname-g con 0x7f00740a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:24.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f0079650640 10 monclient(hunting): picked mon.noname-d con 0x7f00740a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:24.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f0079650640 10 monclient(hunting): picked mon.noname-e con 0x7f007413f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:24.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f0079650640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f007413ecf0 con 0x7f00740a66d0 2024-09-13T10:36:24.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f0079650640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f007413efd0 con 0x7f00740a6ab0 2024-09-13T10:36:24.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f0079650640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0074068d40 con 0x7f007413f9a0 2024-09-13T10:36:24.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f0079650640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:24.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f0079650640 10 monclient(hunting): authenticate will time out at 1123.557459s 2024-09-13T10:36:24.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f00737fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f007413f9a0 0x7f00741d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:36206/0 (socket says 172.21.15.181:36206) 2024-09-13T10:36:24.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f00727fc640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f00740a6ab0 0x7f00741d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46224/0 (socket says 172.21.15.181:46224) 2024-09-13T10:36:24.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.051+0000 7f00737fe640 1 -- 172.21.15.181:0/714786049 learned_addr learned my addr 172.21.15.181:0/714786049 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:24.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f00737fe640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.181:6793/0 conn(0x7f007413f9a0 legacy=0x7f00741d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f00727fc640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.181:6792/0 conn(0x7f00740a6ab0 legacy=0x7f00741d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f0072ffd640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.195:6790/0 conn(0x7f00740a66d0 legacy=0x7f00741ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1717372280 0 0) 0x7f0074068d40 con 0x7f007413f9a0 2024-09-13T10:36:24.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 10 monclient(hunting): my global_id is 104624 2024-09-13T10:36:24.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0060003520 con 0x7f007413f9a0 2024-09-13T10:36:24.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3030408715 0 0) 0x7f007413efd0 con 0x7f00740a6ab0 2024-09-13T10:36:24.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 10 monclient(hunting): my global_id is 6450 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0074068d40 con 0x7f00740a6ab0 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309281292 0 0) 0x7f007413ecf0 con 0x7f00740a66d0 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 10 monclient(hunting): my global_id is 6357 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.053+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f007413efd0 con 0x7f00740a66d0 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1172785941 0 0) 0x7f0074068d40 con 0x7f00740a6ab0 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f007413ecf0 con 0x7f00740a6ab0 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0068003b00 con 0x7f00740a6ab0 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:36:24.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient(hunting): dump: 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.071 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3785784316 0 0) 0x7f0060003520 con 0x7f007413f9a0 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0074068d40 con 0x7f007413f9a0 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2590513765 0 0) 0x7f007413efd0 con 0x7f00740a66d0 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0060003520 con 0x7f00740a66d0 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f006c004b60 con 0x7f007413f9a0 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient(hunting): dump: 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.072 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.073 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0064001ce0 con 0x7f00740a66d0 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient(hunting): dump: 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.074 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2828511943 0 0) 0x7f007413ecf0 con 0x7f00740a6ab0 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.181:6793/0 conn(0x7f007413f9a0 legacy=0x7f00741d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.195:6790/0 conn(0x7f00740a66d0 legacy=0x7f00741ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 monclient: found mon.d 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:36:24.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0074139330 con 0x7f00740a6ab0 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f0079650640 5 monclient: authenticate success, global_id 6450 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f0079650640 10 monclient: _renew_subs 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f0079650640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f0079650640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f007413ea10 con 0x7f00740a6ab0 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f0079650640 10 monclient: _renew_subs 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f0079650640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f0079650640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f007413c510 con 0x7f00740a6ab0 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0068001b30 con 0x7f00740a6ab0 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:24.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0068004470 con 0x7f00740a6ab0 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f00717fa640 4 set_mon_vals no callback set 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.054+0000 7f005b7fe640 10 monclient: dump: 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.077 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.055+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0068011ca0 con 0x7f00740a6ab0 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.055+0000 7f0079650640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.055+0000 7f0079650640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f00540065c0 con 0x7f0054002860 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.055+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(200..200 src has 1..200) ==== 3898+0+0 (unknown 132779179 0 0) 0x7f006804e2c0 con 0x7f00740a6ab0 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.055+0000 7f00737fe640 10 monclient: get_auth_request con 0x7f0060040670 auth_method 0 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.057+0000 7f0072ffd640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.181:6793/0 conn(0x7f0054002860 legacy=0x7f0054004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.057+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835325921 0 0) 0x7f00540065c0 con 0x7f0054002860 2024-09-13T10:36:24.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.057+0000 7f005b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.057+0000 7f005b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.057+0000 7f005b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.057+0000 7f005b7fe640 10 monclient(hunting): my global_id is 104633 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.057+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f007413ecf0 con 0x7f0054002860 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.057+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2918700908 0 0) 0x7f007413ecf0 con 0x7f0054002860 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.057+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00540065c0 con 0x7f0054002860 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.057+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0064004dd0 con 0x7f0054002860 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.057+0000 7f005b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.058+0000 7f005b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.058+0000 7f005b7fe640 10 monclient: dump: 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.079 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.058+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3762351318 0 0) 0x7f00540065c0 con 0x7f0054002860 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.058+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f005400a160 con 0x7f0054002860 2024-09-13T10:36:24.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.058+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0064006820 con 0x7f0054002860 2024-09-13T10:36:24.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.058+0000 7f005b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:24.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.058+0000 7f005b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:24.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.058+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.181:6793/0 conn(0x7f0054002860 legacy=0x7f0054004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.058+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.181:6793/0 conn(0x7f0054002860 legacy=0x7f0054004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:24.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.064+0000 7f0079650640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:24.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.064+0000 7f0079650640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0054009e70 con 0x7f0054009130 2024-09-13T10:36:24.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.066+0000 7f0072ffd640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.181:6793/0 conn(0x7f0054009130 legacy=0x7f00540095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2162331861 0 0) 0x7f0054009e70 con 0x7f0054009130 2024-09-13T10:36:24.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 10 monclient(hunting): my global_id is 104642 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00540065c0 con 0x7f0054009130 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3837520355 0 0) 0x7f00540065c0 con 0x7f0054009130 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0054009e70 con 0x7f0054009130 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f00640056a0 con 0x7f0054009130 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 10 monclient: dump: 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.083 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 379306987 0 0) 0x7f0054009e70 con 0x7f0054009130 2024-09-13T10:36:24.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f005400c410 con 0x7f0054009130 2024-09-13T10:36:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 3328571766) 0x7f00640069d0 con 0x7f0054009130 2024-09-13T10:36:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.181:6793/0 conn(0x7f0054009130 legacy=0x7f00540095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.067+0000 7f005b7fe640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.181:6793/0 conn(0x7f0054009130 legacy=0x7f00540095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:24.085 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:24.085 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:24.085 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:24.085 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:24.085 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:24.085 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 67770, 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:24.086 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:24.087 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:24.088 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:24.089 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:24.090 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.091 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.093 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.094 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.095 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:24.096 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.096 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.096 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.096 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:24.096 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:24.096 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.096 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.096 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.096 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:24.097 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.098 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.100 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:24.101 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.102 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.103 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.104 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:24.105 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:24.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.068+0000 7f0079650640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0060040670 legacy=0x7f0060042b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.068+0000 7f0079650640 10 monclient: shutdown 2024-09-13T10:36:24.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.068+0000 7f0079650640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:24.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.068+0000 7f0079650640 1 -- 172.21.15.181:0/714786049 >> v1:172.21.15.181:6792/0 conn(0x7f00740a6ab0 legacy=0x7f00741d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.068+0000 7f00737fe640 1 -- 172.21.15.181:0/714786049 reap_dead start 2024-09-13T10:36:24.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.068+0000 7f00737fe640 1 -- 172.21.15.181:0/714786049 reap_dead start 2024-09-13T10:36:24.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.068+0000 7f0079650640 1 -- 172.21.15.181:0/714786049 shutdown_connections 2024-09-13T10:36:24.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.068+0000 7f0079650640 1 -- 172.21.15.181:0/714786049 >> 172.21.15.181:0/714786049 conn(0x7f00740abcd0 msgr2=0x7f00740a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:24.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.068+0000 7f0079650640 1 -- 172.21.15.181:0/714786049 shutdown_connections 2024-09-13T10:36:24.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.068+0000 7f0079650640 1 -- 172.21.15.181:0/714786049 wait complete. 2024-09-13T10:36:24.107 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:24.107 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:36:24.107 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:36:24.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.203+0000 7f5da6e16640 10 monclient: get_monmap_and_config 2024-09-13T10:36:24.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.203+0000 7f5da6e16640 10 monclient: build_initial_monmap 2024-09-13T10:36:24.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.203+0000 7f5da6e16640 10 monclient: monmap: 2024-09-13T10:36:24.206 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:24.206 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.206 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:24.205053+0000 2024-09-13T10:36:24.206 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:24.205053+0000 2024-09-13T10:36:24.206 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:24.206 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.206 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:24.206 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:24.206 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:24.206 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:24.207 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:24.207 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:24.207 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:24.207 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:24.207 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:24.207 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 1 Processor -- start 2024-09-13T10:36:24.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 1 -- start start 2024-09-13T10:36:24.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 10 monclient: init 2024-09-13T10:36:24.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:24.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 10 monclient: _add_conns ranks=[2,4,8,7,3,6,5,0,1] 2024-09-13T10:36:24.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 10 monclient(hunting): picked mon.noname-b con 0x7f5da0139040 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:24.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 10 monclient(hunting): picked mon.noname-c con 0x7f5da009cd50 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:24.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 10 monclient(hunting): picked mon.noname-e con 0x7f5da013fae0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:24.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da009dbb0 con 0x7f5da0139040 2024-09-13T10:36:24.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da009de90 con 0x7f5da009cd50 2024-09-13T10:36:24.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da009e170 con 0x7f5da013fae0 2024-09-13T10:36:24.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:24.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da6e16640 10 monclient(hunting): authenticate will time out at 1123.710784s 2024-09-13T10:36:24.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da4bb2640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f5da0139040 0x7f5da00a58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:37056/0 (socket says 172.21.15.181:37056) 2024-09-13T10:36:24.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5d9ffff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f5da009cd50 0x7f5da013e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:49510/0 (socket says 172.21.15.181:49510) 2024-09-13T10:36:24.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.204+0000 7f5da4bb2640 1 -- 172.21.15.181:0/3256473533 learned_addr learned my addr 172.21.15.181:0/3256473533 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:24.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5da4bb2640 1 -- 172.21.15.181:0/3256473533 >> v1:172.21.15.181:6790/0 conn(0x7f5da0139040 legacy=0x7f5da00a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5da53b3640 1 -- 172.21.15.181:0/3256473533 >> v1:172.21.15.181:6793/0 conn(0x7f5da013fae0 legacy=0x7f5da0141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9ffff640 1 -- 172.21.15.181:0/3256473533 >> v1:172.21.15.181:6791/0 conn(0x7f5da009cd50 legacy=0x7f5da013e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4111475808 0 0) 0x7f5da009dbb0 con 0x7f5da0139040 2024-09-13T10:36:24.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient(hunting): my global_id is 114257 2024-09-13T10:36:24.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d90003520 con 0x7f5da0139040 2024-09-13T10:36:24.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1233742283 0 0) 0x7f5da009e170 con 0x7f5da013fae0 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient(hunting): my global_id is 104651 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5da009dbb0 con 0x7f5da013fae0 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441807230 0 0) 0x7f5da009de90 con 0x7f5da009cd50 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient(hunting): my global_id is 114250 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5da009e170 con 0x7f5da009cd50 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 694450726 0 0) 0x7f5da009e170 con 0x7f5da009cd50 2024-09-13T10:36:24.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 >> v1:172.21.15.181:6793/0 conn(0x7f5da013fae0 legacy=0x7f5da0141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 >> v1:172.21.15.181:6790/0 conn(0x7f5da0139040 legacy=0x7f5da00a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 monclient: found mon.noname-c 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da00a5ff0 con 0x7f5da009cd50 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d8c001a00 con 0x7f5da009cd50 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient: dump: 2024-09-13T10:36:24.215 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.216 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5da6e16640 5 monclient: authenticate success, global_id 114250 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5da6e16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d8c001c90 con 0x7f5da009cd50 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 1 -- 172.21.15.181:0/3256473533 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d8c004b20 con 0x7f5da009cd50 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5d9f7fe640 10 monclient: dump: 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.217 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5da6e16640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:24.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.207+0000 7f5da6e16640 4 set_mon_vals no callback set 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.208+0000 7f5da6e16640 10 monclient: shutdown 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.208+0000 7f5da6e16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.208+0000 7f5da6e16640 1 -- 172.21.15.181:0/3256473533 >> v1:172.21.15.181:6791/0 conn(0x7f5da009cd50 legacy=0x7f5da013e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.208+0000 7f5da6e16640 1 -- 172.21.15.181:0/3256473533 shutdown_connections 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.208+0000 7f5da6e16640 1 -- 172.21.15.181:0/3256473533 >> 172.21.15.181:0/3256473533 conn(0x7f5da0077120 msgr2=0x7f5da00abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.208+0000 7f5da6e16640 1 -- 172.21.15.181:0/3256473533 shutdown_connections 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.208+0000 7f5da6e16640 1 -- 172.21.15.181:0/3256473533 wait complete. 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.208+0000 7f5da6e16640 10 monclient: build_initial_monmap 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 10 monclient: monmap: 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:24.219 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 1 Processor -- start 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 1 -- start start 2024-09-13T10:36:24.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 10 monclient: init 2024-09-13T10:36:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 10 monclient: _add_conns ranks=[7,4,2,3,8,0,6,5,1] 2024-09-13T10:36:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 10 monclient(hunting): picked mon.noname-i con 0x7f5da009cd50 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 10 monclient(hunting): picked mon.noname-c con 0x7f5da0139040 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 10 monclient(hunting): picked mon.noname-b con 0x7f5da013fae0 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da00a58e0 con 0x7f5da013fae0 2024-09-13T10:36:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da00a71d0 con 0x7f5da0139040 2024-09-13T10:36:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da013e120 con 0x7f5da009cd50 2024-09-13T10:36:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.209+0000 7f5da6e16640 10 monclient(hunting): authenticate will time out at 1123.715970s 2024-09-13T10:36:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.210+0000 7f5d9ffff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f5da0139040 0x7f5da013acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:49516/0 (socket says 172.21.15.181:49516) 2024-09-13T10:36:24.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.210+0000 7f5d9ffff640 1 -- 172.21.15.181:0/3984113030 learned_addr learned my addr 172.21.15.181:0/3984113030 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5da53b3640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.181:6790/0 conn(0x7f5da013fae0 legacy=0x7f5da01d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9ffff640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.181:6791/0 conn(0x7f5da0139040 legacy=0x7f5da013acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428760456 0 0) 0x7f5da00a5ff0 con 0x7f5da0139040 2024-09-13T10:36:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): my global_id is 114259 2024-09-13T10:36:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d84003520 con 0x7f5da0139040 2024-09-13T10:36:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708685587 0 0) 0x7f5d98001f90 con 0x7f5da013fae0 2024-09-13T10:36:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): my global_id is 114266 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5da4bb2640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.195:6792/0 conn(0x7f5da009cd50 legacy=0x7f5da013a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5da00a5ff0 con 0x7f5da013fae0 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3814215504 0 0) 0x7f5da013e120 con 0x7f5da009cd50 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): my global_id is 56545 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d98001f90 con 0x7f5da009cd50 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1223300126 0 0) 0x7f5d84003520 con 0x7f5da0139040 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5da013e120 con 0x7f5da0139040 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d8c004b20 con 0x7f5da0139040 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:36:24.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): dump: 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.228 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2882228646 0 0) 0x7f5da00a5ff0 con 0x7f5da013fae0 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d84003520 con 0x7f5da013fae0 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d98003990 con 0x7f5da013fae0 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): dump: 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.229 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2309643624 0 0) 0x7f5d98001f90 con 0x7f5da009cd50 2024-09-13T10:36:24.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5da00a5ff0 con 0x7f5da009cd50 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d940047e0 con 0x7f5da009cd50 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient(hunting): dump: 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.231 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1390367695 0 0) 0x7f5da013e120 con 0x7f5da0139040 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.195:6792/0 conn(0x7f5da009cd50 legacy=0x7f5da013a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.181:6790/0 conn(0x7f5da013fae0 legacy=0x7f5da01d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 monclient: found mon.c 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:24.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da013e400 con 0x7f5da0139040 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient: _finish_auth 0 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5da6e16640 5 monclient: authenticate success, global_id 114259 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5da6e16640 10 monclient: _renew_subs 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5da6e16640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5da6e16640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5da013b3d0 con 0x7f5da0139040 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5da6e16640 10 monclient: _renew_subs 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5da6e16640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5da6e16640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f5da00a53f0 con 0x7f5da0139040 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d8c004f70 con 0x7f5da0139040 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:24.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d8c005460 con 0x7f5da0139040 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9effd640 4 set_mon_vals no callback set 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.212+0000 7f5d9d7fa640 10 monclient: dump: 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.234 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.213+0000 7f5da6e16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.213+0000 7f5da6e16640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5d800065c0 con 0x7f5d80002860 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.213+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5d8c005600 con 0x7f5da0139040 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.213+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(200..200 src has 1..200) ==== 3898+0+0 (unknown 132779179 0 0) 0x7f5d8c04e340 con 0x7f5da0139040 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.214+0000 7f5da53b3640 10 monclient: get_auth_request con 0x7f5d84040490 auth_method 0 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5da4bb2640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.195:6789/0 conn(0x7f5d80002860 legacy=0x7f5d80004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464701742 0 0) 0x7f5d800065c0 con 0x7f5d80002860 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 10 monclient(hunting): my global_id is 56692 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5da013e120 con 0x7f5d80002860 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2834978713 0 0) 0x7f5da013e120 con 0x7f5d80002860 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d800065c0 con 0x7f5d80002860 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d94004eb0 con 0x7f5d80002860 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 10 monclient: dump: 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.236 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.237 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2217832752 0 0) 0x7f5d800065c0 con 0x7f5d80002860 2024-09-13T10:36:24.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d8000a160 con 0x7f5d80002860 2024-09-13T10:36:24.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5d94006430 con 0x7f5d80002860 2024-09-13T10:36:24.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:24.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:24.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.195:6789/0 conn(0x7f5d80002860 legacy=0x7f5d80004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.216+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.195:6789/0 conn(0x7f5d80002860 legacy=0x7f5d80004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:24.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.222+0000 7f5da6e16640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:24.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.222+0000 7f5da6e16640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5d80009e70 con 0x7f5d80009130 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.225+0000 7f5da4bb2640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.195:6789/0 conn(0x7f5d80009130 legacy=0x7f5d800095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.225+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1024228780 0 0) 0x7f5d80009e70 con 0x7f5d80009130 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.225+0000 7f5d9d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.225+0000 7f5d9d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.225+0000 7f5d9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.225+0000 7f5d9d7fa640 10 monclient(hunting): my global_id is 56701 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.225+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d800065c0 con 0x7f5d80009130 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 535570479 0 0) 0x7f5d800065c0 con 0x7f5d80009130 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d80009e70 con 0x7f5d80009130 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d9400a480 con 0x7f5d80009130 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:36:24.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 10 monclient: dump: 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.241 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.242 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2034202522 0 0) 0x7f5d80009e70 con 0x7f5d80009130 2024-09-13T10:36:24.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5d8000c410 con 0x7f5d80009130 2024-09-13T10:36:24.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 4027216297) 0x7f5d940066e0 con 0x7f5d80009130 2024-09-13T10:36:24.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:24.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:24.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.195:6789/0 conn(0x7f5d80009130 legacy=0x7f5d800095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5d9d7fa640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.195:6789/0 conn(0x7f5d80009130 legacy=0x7f5d800095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:24.242 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:24.242 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:24.243 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:24.243 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:24.243 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:24.243 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 398635, 2024-09-13T10:36:24.243 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:24.243 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:24.243 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:24.243 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:24.243 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:24.243 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:24.243 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:24.243 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:24.244 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:24.245 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:24.246 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:24.247 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.248 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.249 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:24.250 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.252 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.252 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:24.252 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.252 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.252 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.252 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:24.252 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:24.252 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.252 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.252 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.254 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:24.255 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.256 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.258 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:24.259 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.260 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.261 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.262 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:24.263 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:24.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5da6e16640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5d84040490 legacy=0x7f5d84042950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5da6e16640 10 monclient: shutdown 2024-09-13T10:36:24.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5da6e16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:24.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5da6e16640 1 -- 172.21.15.181:0/3984113030 >> v1:172.21.15.181:6791/0 conn(0x7f5da0139040 legacy=0x7f5da013acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5da53b3640 1 -- 172.21.15.181:0/3984113030 reap_dead start 2024-09-13T10:36:24.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5da53b3640 1 -- 172.21.15.181:0/3984113030 reap_dead start 2024-09-13T10:36:24.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5da6e16640 1 -- 172.21.15.181:0/3984113030 shutdown_connections 2024-09-13T10:36:24.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.226+0000 7f5da6e16640 1 -- 172.21.15.181:0/3984113030 >> 172.21.15.181:0/3984113030 conn(0x7f5da0077120 msgr2=0x7f5da00a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:24.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.227+0000 7f5da6e16640 1 -- 172.21.15.181:0/3984113030 shutdown_connections 2024-09-13T10:36:24.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.227+0000 7f5da6e16640 1 -- 172.21.15.181:0/3984113030 wait complete. 2024-09-13T10:36:24.265 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:24.265 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:36:24.265 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:36:24.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.364+0000 7fceda902640 10 monclient: get_monmap_and_config 2024-09-13T10:36:24.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.364+0000 7fceda902640 10 monclient: build_initial_monmap 2024-09-13T10:36:24.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.364+0000 7fceda902640 10 monclient: monmap: 2024-09-13T10:36:24.408 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:24.408 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.408 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:24.366315+0000 2024-09-13T10:36:24.408 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:24.366315+0000 2024-09-13T10:36:24.408 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.365+0000 7fceda902640 1 Processor -- start 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.365+0000 7fceda902640 1 -- start start 2024-09-13T10:36:24.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.365+0000 7fceda902640 10 monclient: init 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.366+0000 7fceda902640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.366+0000 7fceda902640 10 monclient: _add_conns ranks=[6,4,1,7,8,0,2,3,5] 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.366+0000 7fceda902640 10 monclient(hunting): picked mon.noname-d con 0x7fced408d5b0 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.366+0000 7fceda902640 10 monclient(hunting): picked mon.noname-c con 0x7fced4070260 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.366+0000 7fceda902640 10 monclient(hunting): picked mon.noname-f con 0x7fced408d990 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.366+0000 7fceda902640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced4072370 con 0x7fced408d990 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.366+0000 7fceda902640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced4071990 con 0x7fced4070260 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.366+0000 7fceda902640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced406fdd0 con 0x7fced408d5b0 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.366+0000 7fceda902640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.366+0000 7fceda902640 10 monclient(hunting): authenticate will time out at 1123.872800s 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.366+0000 7fced90ff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fced4070260 0x7fced40a3eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:49518/0 (socket says 172.21.15.181:49518) 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.367+0000 7fced90ff640 1 -- 172.21.15.181:0/2478857397 learned_addr learned my addr 172.21.15.181:0/2478857397 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.369+0000 7fced90ff640 1 -- 172.21.15.181:0/2478857397 >> v1:172.21.15.181:6791/0 conn(0x7fced4070260 legacy=0x7fced40a3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.369+0000 7fceda101640 1 -- 172.21.15.181:0/2478857397 >> v1:172.21.15.195:6789/0 conn(0x7fced408d990 legacy=0x7fced40a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.369+0000 7fced9900640 1 -- 172.21.15.181:0/2478857397 >> v1:172.21.15.181:6792/0 conn(0x7fced408d5b0 legacy=0x7fced40a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.371+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3139888146 0 0) 0x7fcecc001820 con 0x7fced408d990 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.371+0000 7fced88fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.371+0000 7fced88fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.371+0000 7fced88fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient(hunting): my global_id is 56710 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcec0003440 con 0x7fced408d990 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1693435316 0 0) 0x7fced4071990 con 0x7fced4070260 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient(hunting): my global_id is 114268 2024-09-13T10:36:24.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcecc001820 con 0x7fced4070260 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3241627764 0 0) 0x7fced406fdd0 con 0x7fced408d5b0 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient(hunting): my global_id is 6459 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fced4071990 con 0x7fced408d5b0 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3778384156 0 0) 0x7fced4071990 con 0x7fced408d5b0 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 >> v1:172.21.15.181:6791/0 conn(0x7fced4070260 legacy=0x7fced40a3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 >> v1:172.21.15.195:6789/0 conn(0x7fced408d990 legacy=0x7fced40a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient: _finish_hunting 0 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 monclient: found mon.noname-d 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:24.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced408ddb0 con 0x7fced408d5b0 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient: _finish_auth 0 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient: _check_auth_tickets 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fced0001a50 con 0x7fced408d5b0 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fceda902640 5 monclient: authenticate success, global_id 6459 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fceda902640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient: dump: 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.413 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fceda902640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fced0001ca0 con 0x7fced408d5b0 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fceda902640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fceda902640 4 set_mon_vals no callback set 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 1 -- 172.21.15.181:0/2478857397 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fced0003950 con 0x7fced408d5b0 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.403+0000 7fced88fe640 10 monclient: dump: 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.415 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.404+0000 7fceda902640 10 monclient: shutdown 2024-09-13T10:36:24.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.404+0000 7fceda902640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.404+0000 7fceda902640 1 -- 172.21.15.181:0/2478857397 >> v1:172.21.15.181:6792/0 conn(0x7fced408d5b0 legacy=0x7fced40a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.404+0000 7fceda902640 1 -- 172.21.15.181:0/2478857397 shutdown_connections 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.404+0000 7fceda902640 1 -- 172.21.15.181:0/2478857397 >> 172.21.15.181:0/2478857397 conn(0x7fced40a7c80 msgr2=0x7fced40a8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.404+0000 7fceda902640 1 -- 172.21.15.181:0/2478857397 shutdown_connections 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.404+0000 7fceda902640 1 -- 172.21.15.181:0/2478857397 wait complete. 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.404+0000 7fceda902640 10 monclient: build_initial_monmap 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.404+0000 7fceda902640 10 monclient: monmap: 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:24.417 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 1 Processor -- start 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 1 -- start start 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 10 monclient: init 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:24.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 10 monclient: _add_conns ranks=[5,8,1,6,4,7,0,2,3] 2024-09-13T10:36:24.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 10 monclient(hunting): picked mon.noname-h con 0x7fced4070260 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:24.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 10 monclient(hunting): picked mon.noname-e con 0x7fced408d5b0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:24.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 10 monclient(hunting): picked mon.noname-f con 0x7fced408d990 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:24.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced4144c60 con 0x7fced408d990 2024-09-13T10:36:24.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced4145e00 con 0x7fced4070260 2024-09-13T10:36:24.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced41460e0 con 0x7fced408d5b0 2024-09-13T10:36:24.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:24.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fceda902640 10 monclient(hunting): authenticate will time out at 1123.911623s 2024-09-13T10:36:24.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fced90ff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fced408d5b0 0x7fced4142cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:36236/0 (socket says 172.21.15.181:36236) 2024-09-13T10:36:24.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.405+0000 7fced90ff640 1 -- 172.21.15.181:0/98872813 learned_addr learned my addr 172.21.15.181:0/98872813 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:24.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.407+0000 7fced90ff640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.181:6793/0 conn(0x7fced408d5b0 legacy=0x7fced4142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.407+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964860199 0 0) 0x7fced41460e0 con 0x7fced408d5b0 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.407+0000 7fcec67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.407+0000 7fcec67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.407+0000 7fcec67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.407+0000 7fcec67fc640 10 monclient(hunting): my global_id is 104660 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.407+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceb8003520 con 0x7fced408d5b0 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.407+0000 7fceda101640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.195:6789/0 conn(0x7fced408d990 legacy=0x7fced41433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.407+0000 7fced9900640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.195:6791/0 conn(0x7fced4070260 legacy=0x7fced41425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211507825 0 0) 0x7fcec0003440 con 0x7fced408d990 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient(hunting): my global_id is 56719 2024-09-13T10:36:24.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fced41460e0 con 0x7fced408d990 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35285591 0 0) 0x7fced4145e00 con 0x7fced4070260 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient(hunting): my global_id is 104504 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcec0003440 con 0x7fced4070260 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 53088748 0 0) 0x7fceb8003520 con 0x7fced408d5b0 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fced4145e00 con 0x7fced408d5b0 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcec80047e0 con 0x7fced408d5b0 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient(hunting): dump: 2024-09-13T10:36:24.426 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.427 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2649419359 0 0) 0x7fced4145e00 con 0x7fced408d5b0 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.195:6791/0 conn(0x7fced4070260 legacy=0x7fced41425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.195:6789/0 conn(0x7fced408d990 legacy=0x7fced41433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 monclient: found mon.e 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced40a4130 con 0x7fced408d5b0 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient: _finish_auth 0 2024-09-13T10:36:24.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fceda902640 5 monclient: authenticate success, global_id 104660 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fceda902640 10 monclient: _renew_subs 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fceda902640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fceda902640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fced4144060 con 0x7fced408d5b0 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fceda902640 10 monclient: _renew_subs 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fceda902640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fceda902640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fced4144f90 con 0x7fced408d5b0 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcec8004c30 con 0x7fced408d5b0 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcec8005160 con 0x7fced408d5b0 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec7fff640 4 set_mon_vals no callback set 2024-09-13T10:36:24.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:24.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.408+0000 7fcec67fc640 10 monclient: dump: 2024-09-13T10:36:24.430 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.430 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.430 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.430 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.430 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.430 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.430 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.430 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.430 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.430 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.431 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.431 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.431 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.431 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.431 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.431 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.409+0000 7fceda902640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:24.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.409+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fcec8005400 con 0x7fced408d5b0 2024-09-13T10:36:24.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.409+0000 7fceda902640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcebc0065c0 con 0x7fcebc002860 2024-09-13T10:36:24.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.409+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(200..200 src has 1..200) ==== 3898+0+0 (unknown 132779179 0 0) 0x7fcec804e320 con 0x7fced408d5b0 2024-09-13T10:36:24.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.409+0000 7fceda101640 10 monclient: get_auth_request con 0x7fceb803fbb0 auth_method 0 2024-09-13T10:36:24.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.411+0000 7fced9900640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.195:6790/0 conn(0x7fcebc002860 legacy=0x7fcebc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.411+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3306740824 0 0) 0x7fcebc0065c0 con 0x7fcebc002860 2024-09-13T10:36:24.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.411+0000 7fcec67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.411+0000 7fcec67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.411+0000 7fcec67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.411+0000 7fcec67fc640 10 monclient(hunting): my global_id is 6366 2024-09-13T10:36:24.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.411+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fced4145e00 con 0x7fcebc002860 2024-09-13T10:36:24.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1544660121 0 0) 0x7fced4145e00 con 0x7fcebc002860 2024-09-13T10:36:24.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcebc0065c0 con 0x7fcebc002860 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fced0001890 con 0x7fcebc002860 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 10 monclient: dump: 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.433 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 230734964 0 0) 0x7fcebc0065c0 con 0x7fcebc002860 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcebc00a160 con 0x7fcebc002860 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fced0001a70 con 0x7fcebc002860 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:24.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.195:6790/0 conn(0x7fcebc002860 legacy=0x7fcebc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.412+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.195:6790/0 conn(0x7fcebc002860 legacy=0x7fcebc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:24.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.418+0000 7fceda902640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:24.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.418+0000 7fceda902640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcebc009e50 con 0x7fcebc009110 2024-09-13T10:36:24.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fced9900640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.195:6790/0 conn(0x7fcebc009110 legacy=0x7fcebc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2157969903 0 0) 0x7fcebc009e50 con 0x7fcebc009110 2024-09-13T10:36:24.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 10 monclient(hunting): my global_id is 6375 2024-09-13T10:36:24.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcebc0065c0 con 0x7fcebc009110 2024-09-13T10:36:24.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3294596755 0 0) 0x7fcebc0065c0 con 0x7fcebc009110 2024-09-13T10:36:24.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcebc009e50 con 0x7fcebc009110 2024-09-13T10:36:24.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fced0003fd0 con 0x7fcebc009110 2024-09-13T10:36:24.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:24.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 10 monclient: dump: 2024-09-13T10:36:24.436 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.436 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.436 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.436 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.436 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.436 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.436 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.436 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1104399302 0 0) 0x7fcebc009e50 con 0x7fcebc009110 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.421+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcebc00c3f0 con 0x7fcebc009110 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7562 (unknown 0 0 1402176611) 0x7fced0004290 con 0x7fcebc009110 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fcec67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:24.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fcec67fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:24.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.195:6790/0 conn(0x7fcebc009110 legacy=0x7fcebc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fcec67fc640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.195:6790/0 conn(0x7fcebc009110 legacy=0x7fcebc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:24.438 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:24.438 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:24.438 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:24.438 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:36:24.438 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:24.438 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 398836, 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:36:24.439 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:24.440 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:24.441 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:24.442 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:24.443 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.444 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:24.445 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.446 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.448 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.449 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:24.451 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.452 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.453 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:24.455 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.456 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:36:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.457 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:24.458 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:24.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fceda902640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.195:6800/1839191919 conn(0x7fceb803fbb0 legacy=0x7fceb8042070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fceda902640 10 monclient: shutdown 2024-09-13T10:36:24.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fceda902640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:24.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fceda902640 1 -- 172.21.15.181:0/98872813 >> v1:172.21.15.181:6793/0 conn(0x7fced408d5b0 legacy=0x7fced4142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fceda101640 1 -- 172.21.15.181:0/98872813 reap_dead start 2024-09-13T10:36:24.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fceda101640 1 -- 172.21.15.181:0/98872813 reap_dead start 2024-09-13T10:36:24.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fceda902640 1 -- 172.21.15.181:0/98872813 shutdown_connections 2024-09-13T10:36:24.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fceda902640 1 -- 172.21.15.181:0/98872813 >> 172.21.15.181:0/98872813 conn(0x7fced40a7c80 msgr2=0x7fced414f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:24.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fceda902640 1 -- 172.21.15.181:0/98872813 shutdown_connections 2024-09-13T10:36:24.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.422+0000 7fceda902640 1 -- 172.21.15.181:0/98872813 wait complete. 2024-09-13T10:36:24.460 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:24.460 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:36:24.460 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:36:24.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.556+0000 7f54059f5640 10 monclient: get_monmap_and_config 2024-09-13T10:36:24.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.556+0000 7f54059f5640 10 monclient: build_initial_monmap 2024-09-13T10:36:24.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.556+0000 7f54059f5640 10 monclient: monmap: 2024-09-13T10:36:24.559 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:24.559 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.560 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:24.558486+0000 2024-09-13T10:36:24.560 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:24.558486+0000 2024-09-13T10:36:24.560 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:24.560 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.560 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:24.560 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:24.560 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:24.560 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:24.560 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:24.560 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:24.560 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:24.560 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:24.561 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:24.561 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.557+0000 7f54059f5640 1 Processor -- start 2024-09-13T10:36:24.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.557+0000 7f54059f5640 1 -- start start 2024-09-13T10:36:24.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.557+0000 7f54059f5640 10 monclient: init 2024-09-13T10:36:24.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.557+0000 7f54059f5640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:24.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.557+0000 7f54059f5640 10 monclient: _add_conns ranks=[6,7,0,1,3,4,5,2,8] 2024-09-13T10:36:24.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.558+0000 7f54059f5640 10 monclient(hunting): picked mon.noname-d con 0x7f54000a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:24.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.558+0000 7f54059f5640 10 monclient(hunting): picked mon.noname-i con 0x7f54000a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:24.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.558+0000 7f54059f5640 10 monclient(hunting): picked mon.noname-a con 0x7f540013f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:24.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.558+0000 7f54059f5640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54000a5fe0 con 0x7f540013f9a0 2024-09-13T10:36:24.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.558+0000 7f54059f5640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54000a8080 con 0x7f54000a66d0 2024-09-13T10:36:24.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.558+0000 7f54059f5640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54000a42c0 con 0x7f54000a6ab0 2024-09-13T10:36:24.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.558+0000 7f54059f5640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:24.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.558+0000 7f54059f5640 10 monclient(hunting): authenticate will time out at 1124.064159s 2024-09-13T10:36:24.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.558+0000 7f53feffd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f54000a66d0 0x7f54000a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46238/0 (socket says 172.21.15.181:46238) 2024-09-13T10:36:24.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.558+0000 7f53feffd640 1 -- 172.21.15.181:0/2059907570 learned_addr learned my addr 172.21.15.181:0/2059907570 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:24.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53ff7fe640 1 -- 172.21.15.181:0/2059907570 >> v1:172.21.15.181:6789/0 conn(0x7f540013f9a0 legacy=0x7f5400141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53feffd640 1 -- 172.21.15.181:0/2059907570 >> v1:172.21.15.181:6792/0 conn(0x7f54000a66d0 legacy=0x7f54000a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53f67fc640 1 -- 172.21.15.181:0/2059907570 >> v1:172.21.15.195:6792/0 conn(0x7f54000a6ab0 legacy=0x7f54000a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858605363 0 0) 0x7f54000a5fe0 con 0x7f540013f9a0 2024-09-13T10:36:24.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient(hunting): my global_id is 114273 2024-09-13T10:36:24.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53ec003520 con 0x7f540013f9a0 2024-09-13T10:36:24.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3921330662 0 0) 0x7f54000a8080 con 0x7f54000a66d0 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient(hunting): my global_id is 6468 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54000a5fe0 con 0x7f54000a66d0 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837259845 0 0) 0x7f54000a42c0 con 0x7f54000a6ab0 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient(hunting): my global_id is 56554 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54000a8080 con 0x7f54000a6ab0 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2096389775 0 0) 0x7f53ec003520 con 0x7f540013f9a0 2024-09-13T10:36:24.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 >> v1:172.21.15.195:6792/0 conn(0x7f54000a6ab0 legacy=0x7f54000a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 >> v1:172.21.15.181:6792/0 conn(0x7f54000a66d0 legacy=0x7f54000a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:36:24.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 monclient: found mon.noname-a 2024-09-13T10:36:24.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:24.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:36:24.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54001464e0 con 0x7f540013f9a0 2024-09-13T10:36:24.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient: _finish_auth 0 2024-09-13T10:36:24.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:36:24.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:24.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f53f8001ea0 con 0x7f540013f9a0 2024-09-13T10:36:24.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f54059f5640 5 monclient: authenticate success, global_id 114273 2024-09-13T10:36:24.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f54059f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:24.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:36:24.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient: dump: 2024-09-13T10:36:24.570 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.570 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.570 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.570 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.570 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.571 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.571 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.571 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.571 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.571 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.571 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.571 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.571 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.571 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.571 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.571 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f54059f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:24.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f53f8003990 con 0x7f540013f9a0 2024-09-13T10:36:24.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:24.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 1 -- 172.21.15.181:0/2059907570 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f53f8003ec0 con 0x7f540013f9a0 2024-09-13T10:36:24.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f54059f5640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:24.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f54059f5640 4 set_mon_vals no callback set 2024-09-13T10:36:24.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:24.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.560+0000 7f53fe7fc640 10 monclient: dump: 2024-09-13T10:36:24.572 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.572 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.573 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.561+0000 7f54059f5640 10 monclient: shutdown 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.561+0000 7f54059f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.561+0000 7f54059f5640 1 -- 172.21.15.181:0/2059907570 >> v1:172.21.15.181:6789/0 conn(0x7f540013f9a0 legacy=0x7f5400141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.561+0000 7f54059f5640 1 -- 172.21.15.181:0/2059907570 shutdown_connections 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.561+0000 7f54059f5640 1 -- 172.21.15.181:0/2059907570 >> 172.21.15.181:0/2059907570 conn(0x7f54000abcd0 msgr2=0x7f54000ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.561+0000 7f54059f5640 1 -- 172.21.15.181:0/2059907570 shutdown_connections 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.561+0000 7f54059f5640 1 -- 172.21.15.181:0/2059907570 wait complete. 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.561+0000 7f54059f5640 10 monclient: build_initial_monmap 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.561+0000 7f54059f5640 10 monclient: monmap: 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:24.574 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 1 Processor -- start 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 1 -- start start 2024-09-13T10:36:24.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 10 monclient: init 2024-09-13T10:36:24.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:24.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 10 monclient: _add_conns ranks=[6,8,0,4,5,2,7,3,1] 2024-09-13T10:36:24.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 10 monclient(hunting): picked mon.noname-d con 0x7f54000a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:24.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 10 monclient(hunting): picked mon.noname-e con 0x7f54000a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:24.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 10 monclient(hunting): picked mon.noname-a con 0x7f540013f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:24.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f540013e9e0 con 0x7f540013f9a0 2024-09-13T10:36:24.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5400068810 con 0x7f54000a66d0 2024-09-13T10:36:24.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f540013cf20 con 0x7f54000a6ab0 2024-09-13T10:36:24.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:24.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.562+0000 7f54059f5640 10 monclient(hunting): authenticate will time out at 1124.068937s 2024-09-13T10:36:24.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.563+0000 7f53feffd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f54000a66d0 0x7f54001ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:46242/0 (socket says 172.21.15.181:46242) 2024-09-13T10:36:24.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.563+0000 7f53ff7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f540013f9a0 0x7f54001d6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36016/0 (socket says 172.21.15.181:36016) 2024-09-13T10:36:24.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.563+0000 7f53feffd640 1 -- 172.21.15.181:0/3983629406 learned_addr learned my addr 172.21.15.181:0/3983629406 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53ff7fe640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.181:6789/0 conn(0x7f540013f9a0 legacy=0x7f54001d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53feffd640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.181:6792/0 conn(0x7f54000a66d0 legacy=0x7f54001ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53f67fc640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.181:6793/0 conn(0x7f54000a6ab0 legacy=0x7f54001d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3202589649 0 0) 0x7f54001464e0 con 0x7f540013f9a0 2024-09-13T10:36:24.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): my global_id is 114282 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53e0003520 con 0x7f540013f9a0 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012704947 0 0) 0x7f5400068810 con 0x7f54000a66d0 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): my global_id is 6477 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54001464e0 con 0x7f54000a66d0 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2713052037 0 0) 0x7f540013cf20 con 0x7f54000a6ab0 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): my global_id is 104669 2024-09-13T10:36:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5400068810 con 0x7f54000a6ab0 2024-09-13T10:36:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4072616536 0 0) 0x7f53e0003520 con 0x7f540013f9a0 2024-09-13T10:36:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f540013cf20 con 0x7f540013f9a0 2024-09-13T10:36:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f53f8003e80 con 0x7f540013f9a0 2024-09-13T10:36:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:36:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): dump: 2024-09-13T10:36:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.585 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.586 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 8033223 0 0) 0x7f54001464e0 con 0x7f54000a66d0 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53e0003520 con 0x7f54000a66d0 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 75658228 0 0) 0x7f5400068810 con 0x7f54000a6ab0 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54001464e0 con 0x7f54000a6ab0 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f53f0001d20 con 0x7f54000a66d0 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): dump: 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.587 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f53e8003610 con 0x7f54000a6ab0 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient(hunting): dump: 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.589 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1694483220 0 0) 0x7f540013cf20 con 0x7f540013f9a0 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.181:6793/0 conn(0x7f54000a6ab0 legacy=0x7f54001d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.181:6792/0 conn(0x7f54000a66d0 legacy=0x7f54001ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient: _finish_hunting 0 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 monclient: found mon.a 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540013f280 con 0x7f540013f9a0 2024-09-13T10:36:24.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient: _finish_auth 0 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 10 monclient: _check_auth_tickets 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f53fcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f54059f5640 5 monclient: authenticate success, global_id 114282 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f54059f5640 10 monclient: _renew_subs 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f54059f5640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f54059f5640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f54000a2880 con 0x7f540013f9a0 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f54059f5640 10 monclient: _renew_subs 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f54059f5640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.565+0000 7f54059f5640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f540013c440 con 0x7f540013f9a0 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.566+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f53f8003990 con 0x7f540013f9a0 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.566+0000 7f53fcff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.566+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f53f8004610 con 0x7f540013f9a0 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.566+0000 7f53fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.566+0000 7f53fdffb640 4 set_mon_vals no callback set 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.566+0000 7f53fcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.566+0000 7f53fcff9640 10 monclient: dump: 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.592 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.593 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.593 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.593 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.593 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.566+0000 7f54059f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:24.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.566+0000 7f54059f5640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f53e40065c0 con 0x7f53e4002860 2024-09-13T10:36:24.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.566+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f53f8012020 con 0x7f540013f9a0 2024-09-13T10:36:24.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.567+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(200..200 src has 1..200) ==== 3898+0+0 (unknown 132779179 0 0) 0x7f53f804e530 con 0x7f540013f9a0 2024-09-13T10:36:24.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.567+0000 7f53f67fc640 10 monclient: get_auth_request con 0x7f53e0040540 auth_method 0 2024-09-13T10:36:24.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53feffd640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.195:6791/0 conn(0x7f53e4002860 legacy=0x7f53e4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324816386 0 0) 0x7f53e40065c0 con 0x7f53e4002860 2024-09-13T10:36:24.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 10 monclient(hunting): my global_id is 104513 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f540013cf20 con 0x7f53e4002860 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1231246623 0 0) 0x7f540013cf20 con 0x7f53e4002860 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53e40065c0 con 0x7f53e4002860 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f53f0004e50 con 0x7f53e4002860 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 10 monclient: dump: 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.594 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4000752267 0 0) 0x7f53e40065c0 con 0x7f53e4002860 2024-09-13T10:36:24.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.569+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53e400a160 con 0x7f53e4002860 2024-09-13T10:36:24.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.570+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f53f00051b0 con 0x7f53e4002860 2024-09-13T10:36:24.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.570+0000 7f53fcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:24.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.570+0000 7f53fcff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:24.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.570+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.195:6791/0 conn(0x7f53e4002860 legacy=0x7f53e4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.570+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.195:6791/0 conn(0x7f53e4002860 legacy=0x7f53e4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:24.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.576+0000 7f54059f5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:24.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.576+0000 7f54059f5640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f53e4009e50 con 0x7f53e4009110 2024-09-13T10:36:24.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.578+0000 7f53feffd640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.195:6791/0 conn(0x7f53e4009110 legacy=0x7f53e40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.578+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2142510225 0 0) 0x7f53e4009e50 con 0x7f53e4009110 2024-09-13T10:36:24.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.578+0000 7f53fcff9640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.578+0000 7f53fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.578+0000 7f53fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.578+0000 7f53fcff9640 10 monclient(hunting): my global_id is 104522 2024-09-13T10:36:24.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.578+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53e40065c0 con 0x7f53e4009110 2024-09-13T10:36:24.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.578+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3963816584 0 0) 0x7f53e40065c0 con 0x7f53e4009110 2024-09-13T10:36:24.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53e4009e50 con 0x7f53e4009110 2024-09-13T10:36:24.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f53f0005a20 con 0x7f53e4009110 2024-09-13T10:36:24.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53fcff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:36:24.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53fcff9640 10 monclient: dump: 2024-09-13T10:36:24.597 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.597 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.597 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2952011474 0 0) 0x7f53e4009e50 con 0x7f53e4009110 2024-09-13T10:36:24.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f53e400c3f0 con 0x7f53e4009110 2024-09-13T10:36:24.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 2145975329) 0x7f53f0007d90 con 0x7f53e4009110 2024-09-13T10:36:24.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53fcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:24.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53fcff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:24.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.195:6791/0 conn(0x7f53e4009110 legacy=0x7f53e40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53fcff9640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.195:6791/0 conn(0x7f53e4009110 legacy=0x7f53e40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:24.599 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:24.599 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:24.599 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:24.599 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:24.600 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:24.600 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 68279, 2024-09-13T10:36:24.600 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:24.600 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:24.600 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:24.600 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:24.600 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:24.600 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:24.600 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:24.600 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:24.600 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:24.600 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:24.601 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.601 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:36:24.601 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:24.601 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:24.601 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:24.601 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:24.601 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:24.601 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:24.601 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:24.601 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:24.601 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:24.602 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:24.603 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:24.604 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:24.605 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:24.605 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:24.605 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:24.605 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:24.605 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:24.605 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:24.605 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:24.605 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:24.605 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:24.606 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:24.607 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.608 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.608 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.608 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:24.608 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.608 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.608 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.608 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:24.608 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:24.608 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.609 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.609 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.609 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:24.609 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:24.609 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.609 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.610 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.610 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:24.610 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.610 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.610 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.610 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:24.610 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:24.610 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.610 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.610 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.611 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.612 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:24.613 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.613 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.613 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.613 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:24.613 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:24.613 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.613 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.614 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.614 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:24.615 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:24.615 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.615 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.615 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.616 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:24.616 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.616 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.616 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.616 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:24.616 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:24.617 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.617 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.617 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.617 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:24.617 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:24.618 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.618 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.618 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.618 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:24.618 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.618 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.619 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.619 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:24.619 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:24.619 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.619 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.620 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.620 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:24.620 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:24.620 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.621 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.621 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.621 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:24.621 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.621 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.622 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:24.622 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:24.622 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.622 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.622 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.623 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:24.623 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:24.623 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:24.623 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:24.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.623 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:24.623 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:24.623 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:24.623 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.623 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.624 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:24.624 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:24.624 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:24.624 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:24.624 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:24.624 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.624 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.624 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:24.624 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:24.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.625 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:24.625 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:24.625 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:24.625 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.625 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.625 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:36:24.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.625 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:24.625 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:24.625 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:36:24.626 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.626 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:24.626 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:24.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:24.626 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:24.626 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:24.626 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:36:24.626 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:24.626 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:24.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:24.626 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:24.626 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f54059f5640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.195:6800/1839191919 conn(0x7f53e0040540 legacy=0x7f53e0042a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f54059f5640 10 monclient: shutdown 2024-09-13T10:36:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f54059f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f54059f5640 1 -- 172.21.15.181:0/3983629406 >> v1:172.21.15.181:6789/0 conn(0x7f540013f9a0 legacy=0x7f54001d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53ff7fe640 1 -- 172.21.15.181:0/3983629406 reap_dead start 2024-09-13T10:36:24.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f53ff7fe640 1 -- 172.21.15.181:0/3983629406 reap_dead start 2024-09-13T10:36:24.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f54059f5640 1 -- 172.21.15.181:0/3983629406 shutdown_connections 2024-09-13T10:36:24.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f54059f5640 1 -- 172.21.15.181:0/3983629406 >> 172.21.15.181:0/3983629406 conn(0x7f54000abcd0 msgr2=0x7f54000a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:24.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f54059f5640 1 -- 172.21.15.181:0/3983629406 shutdown_connections 2024-09-13T10:36:24.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.579+0000 7f54059f5640 1 -- 172.21.15.181:0/3983629406 wait complete. 2024-09-13T10:36:24.629 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:24.630 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:36:24.630 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:36:24.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.727+0000 7f0379801640 10 monclient: get_monmap_and_config 2024-09-13T10:36:24.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.727+0000 7f0379801640 10 monclient: build_initial_monmap 2024-09-13T10:36:24.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.727+0000 7f0379801640 10 monclient: monmap: 2024-09-13T10:36:24.730 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:24.730 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.730 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:24.728980+0000 2024-09-13T10:36:24.730 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:24.728980+0000 2024-09-13T10:36:24.730 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:24.731 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.731 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:24.731 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:24.731 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:24.731 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:24.731 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:24.731 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:24.731 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:24.731 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:24.731 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:24.731 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 1 Processor -- start 2024-09-13T10:36:24.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 1 -- start start 2024-09-13T10:36:24.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 10 monclient: init 2024-09-13T10:36:24.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:24.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 10 monclient: _add_conns ranks=[2,3,1,4,8,5,0,6,7] 2024-09-13T10:36:24.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 10 monclient(hunting): picked mon.noname-b con 0x7f03740a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:24.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 10 monclient(hunting): picked mon.noname-g con 0x7f03740a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:24.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 10 monclient(hunting): picked mon.noname-f con 0x7f037413f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:24.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03740a5fe0 con 0x7f037413f9a0 2024-09-13T10:36:24.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03740a8080 con 0x7f03740a66d0 2024-09-13T10:36:24.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03740a42c0 con 0x7f03740a6ab0 2024-09-13T10:36:24.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:24.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0379801640 10 monclient(hunting): authenticate will time out at 1124.234681s 2024-09-13T10:36:24.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0372ffd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f03740a66d0 0x7f03740a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:37064/0 (socket says 172.21.15.181:37064) 2024-09-13T10:36:24.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.728+0000 7f0372ffd640 1 -- 172.21.15.181:0/2517055184 learned_addr learned my addr 172.21.15.181:0/2517055184 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:24.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.730+0000 7f0372ffd640 1 -- 172.21.15.181:0/2517055184 >> v1:172.21.15.181:6790/0 conn(0x7f03740a66d0 legacy=0x7f03740a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f03727fc640 1 -- 172.21.15.181:0/2517055184 >> v1:172.21.15.195:6790/0 conn(0x7f03740a6ab0 legacy=0x7f03740a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f03737fe640 1 -- 172.21.15.181:0/2517055184 >> v1:172.21.15.195:6789/0 conn(0x7f037413f9a0 legacy=0x7f0374141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 1 -- 172.21.15.181:0/2517055184 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 26824754 0 0) 0x7f03740a42c0 con 0x7f03740a6ab0 2024-09-13T10:36:24.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient(hunting): my global_id is 6384 2024-09-13T10:36:24.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 1 -- 172.21.15.181:0/2517055184 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f035c003520 con 0x7f03740a6ab0 2024-09-13T10:36:24.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 1 -- 172.21.15.181:0/2517055184 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1689448604 0 0) 0x7f035c003520 con 0x7f03740a6ab0 2024-09-13T10:36:24.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 1 -- 172.21.15.181:0/2517055184 >> v1:172.21.15.181:6790/0 conn(0x7f03740a66d0 legacy=0x7f03740a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 1 -- 172.21.15.181:0/2517055184 >> v1:172.21.15.195:6789/0 conn(0x7f037413f9a0 legacy=0x7f0374141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:36:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 1 monclient: found mon.noname-g 2024-09-13T10:36:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:36:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 1 -- 172.21.15.181:0/2517055184 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03741464e0 con 0x7f03740a6ab0 2024-09-13T10:36:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient: _finish_auth 0 2024-09-13T10:36:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:36:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 1 -- 172.21.15.181:0/2517055184 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0368001be0 con 0x7f03740a6ab0 2024-09-13T10:36:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0379801640 5 monclient: authenticate success, global_id 6384 2024-09-13T10:36:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0379801640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:36:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient: dump: 2024-09-13T10:36:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0379801640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 1 -- 172.21.15.181:0/2517055184 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0368003610 con 0x7f03740a6ab0 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0379801640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0379801640 4 set_mon_vals no callback set 2024-09-13T10:36:24.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 1 -- 172.21.15.181:0/2517055184 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0368003c00 con 0x7f03740a6ab0 2024-09-13T10:36:24.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:24.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.731+0000 7f0371ffb640 10 monclient: dump: 2024-09-13T10:36:24.741 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.741 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.741 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.741 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.741 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.741 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.741 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.741 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.741 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.742 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.742 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.742 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.742 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.742 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.742 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.742 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.732+0000 7f0379801640 10 monclient: shutdown 2024-09-13T10:36:24.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.732+0000 7f0379801640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:24.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.732+0000 7f0379801640 1 -- 172.21.15.181:0/2517055184 >> v1:172.21.15.195:6790/0 conn(0x7f03740a6ab0 legacy=0x7f03740a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.732+0000 7f0379801640 1 -- 172.21.15.181:0/2517055184 shutdown_connections 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.732+0000 7f0379801640 1 -- 172.21.15.181:0/2517055184 >> 172.21.15.181:0/2517055184 conn(0x7f03740abcd0 msgr2=0x7f03740ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.732+0000 7f0379801640 1 -- 172.21.15.181:0/2517055184 shutdown_connections 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.732+0000 7f0379801640 1 -- 172.21.15.181:0/2517055184 wait complete. 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.732+0000 7f0379801640 10 monclient: build_initial_monmap 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.732+0000 7f0379801640 10 monclient: monmap: 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:24.743 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:24.744 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:24.744 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:24.744 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:24.744 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:24.744 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:24.744 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:24.744 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 1 Processor -- start 2024-09-13T10:36:24.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 1 -- start start 2024-09-13T10:36:24.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 10 monclient: init 2024-09-13T10:36:24.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:24.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 10 monclient: _add_conns ranks=[8,4,7,0,6,1,5,3,2] 2024-09-13T10:36:24.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 10 monclient(hunting): picked mon.noname-e con 0x7f03740a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:24.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 10 monclient(hunting): picked mon.noname-c con 0x7f03740a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:24.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 10 monclient(hunting): picked mon.noname-i con 0x7f037413f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:24.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037413f2b0 con 0x7f03740a6ab0 2024-09-13T10:36:24.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037413d6d0 con 0x7f037413f9a0 2024-09-13T10:36:24.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0374143040 con 0x7f03740a66d0 2024-09-13T10:36:24.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:24.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0379801640 10 monclient(hunting): authenticate will time out at 1124.239752s 2024-09-13T10:36:24.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0372ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f03740a66d0 0x7f0374136730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:36262/0 (socket says 172.21.15.181:36262) 2024-09-13T10:36:24.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.733+0000 7f0372ffd640 1 -- 172.21.15.181:0/572470524 learned_addr learned my addr 172.21.15.181:0/572470524 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:24.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.735+0000 7f0372ffd640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.181:6793/0 conn(0x7f03740a66d0 legacy=0x7f0374136730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.735+0000 7f03727fc640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.181:6791/0 conn(0x7f03740a6ab0 legacy=0x7f03741d38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 939486864 0 0) 0x7f0374143040 con 0x7f03740a66d0 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient(hunting): my global_id is 104678 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0360003520 con 0x7f03740a66d0 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f03737fe640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.195:6792/0 conn(0x7f037413f9a0 legacy=0x7f03741d6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2298646194 0 0) 0x7f0360003520 con 0x7f03740a66d0 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0374143040 con 0x7f03740a66d0 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03640047e0 con 0x7f03740a66d0 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:24.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient(hunting): dump: 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.750 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1984970826 0 0) 0x7f0374143040 con 0x7f03740a66d0 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.195:6792/0 conn(0x7f037413f9a0 legacy=0x7f03741d6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.181:6791/0 conn(0x7f03740a6ab0 legacy=0x7f03741d38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 1 monclient: found mon.e 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0374068a30 con 0x7f03740a66d0 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:36:24.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f0379801640 5 monclient: authenticate success, global_id 104678 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f0379801640 10 monclient: _renew_subs 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f0379801640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f0379801640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f03740a2710 con 0x7f03740a66d0 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f0379801640 10 monclient: _renew_subs 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f0379801640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f0379801640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f0374137600 con 0x7f03740a66d0 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0364004cb0 con 0x7f03740a66d0 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0364005220 con 0x7f03740a66d0 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:24.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f03717fa640 4 set_mon_vals no callback set 2024-09-13T10:36:24.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.736+0000 7f035b7fe640 10 monclient: dump: 2024-09-13T10:36:24.753 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.753 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.753 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.753 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.753 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.753 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.753 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.753 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.753 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.753 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.754 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.754 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.754 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.754 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.754 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.754 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.737+0000 7f0379801640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:24.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.737+0000 7f0379801640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f03540065c0 con 0x7f0354002860 2024-09-13T10:36:24.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.737+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0364005470 con 0x7f03740a66d0 2024-09-13T10:36:24.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.737+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(200..200 src has 1..200) ==== 3898+0+0 (unknown 132779179 0 0) 0x7f036404e450 con 0x7f03740a66d0 2024-09-13T10:36:24.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.737+0000 7f03737fe640 10 monclient: get_auth_request con 0x7f036003fa40 auth_method 0 2024-09-13T10:36:24.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.739+0000 7f03727fc640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.195:6792/0 conn(0x7f0354002860 legacy=0x7f0354004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:24.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.993+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297576127 0 0) 0x7f03540065c0 con 0x7f0354002860 2024-09-13T10:36:24.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.993+0000 7f035b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:24.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.993+0000 7f035b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:24.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.993+0000 7f035b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:24.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.993+0000 7f035b7fe640 10 monclient(hunting): my global_id is 56563 2024-09-13T10:36:24.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.993+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0374143040 con 0x7f0354002860 2024-09-13T10:36:24.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.994+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2970384417 0 0) 0x7f0374143040 con 0x7f0354002860 2024-09-13T10:36:24.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.994+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03540065c0 con 0x7f0354002860 2024-09-13T10:36:24.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.994+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0368001350 con 0x7f0354002860 2024-09-13T10:36:24.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.994+0000 7f035b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.994+0000 7f035b7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.994+0000 7f035b7fe640 10 monclient: dump: 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:24.998 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:24.999 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:24.999 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:24.999 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:24.999 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:24.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.995+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1564395789 0 0) 0x7f03540065c0 con 0x7f0354002860 2024-09-13T10:36:24.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.995+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f035400a160 con 0x7f0354002860 2024-09-13T10:36:24.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.995+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0368003f50 con 0x7f0354002860 2024-09-13T10:36:25.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.995+0000 7f035b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:25.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.995+0000 7f035b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:25.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.995+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.195:6792/0 conn(0x7f0354002860 legacy=0x7f0354004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:25.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:24.995+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.195:6792/0 conn(0x7f0354002860 legacy=0x7f0354004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:25.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.007+0000 7f0379801640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:25.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.007+0000 7f0379801640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0354009e50 con 0x7f0354009110 2024-09-13T10:36:25.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.009+0000 7f03727fc640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.195:6792/0 conn(0x7f0354009110 legacy=0x7f03540095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:25.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.009+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4262373449 0 0) 0x7f0354009e50 con 0x7f0354009110 2024-09-13T10:36:25.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.009+0000 7f035b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:25.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.009+0000 7f035b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:25.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.009+0000 7f035b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:25.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.009+0000 7f035b7fe640 10 monclient(hunting): my global_id is 56572 2024-09-13T10:36:25.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.009+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03540065c0 con 0x7f0354009110 2024-09-13T10:36:25.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3642390303 0 0) 0x7f03540065c0 con 0x7f0354009110 2024-09-13T10:36:25.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0354009e50 con 0x7f0354009110 2024-09-13T10:36:25.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0368003950 con 0x7f0354009110 2024-09-13T10:36:25.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:25.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:36:25.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 10 monclient: dump: 2024-09-13T10:36:25.014 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:25.014 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:25.014 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:25.014 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:25.014 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:25.014 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:25.014 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:25.015 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:25.015 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:25.015 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:25.015 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:25.015 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:25.015 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:25.015 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:25.015 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:25.015 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:25.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1992424710 0 0) 0x7f0354009e50 con 0x7f0354009110 2024-09-13T10:36:25.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f035400c3f0 con 0x7f0354009110 2024-09-13T10:36:25.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 196364310) 0x7f0368003b70 con 0x7f0354009110 2024-09-13T10:36:25.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:25.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:25.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.195:6792/0 conn(0x7f0354009110 legacy=0x7f03540095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:25.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.010+0000 7f035b7fe640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.195:6792/0 conn(0x7f0354009110 legacy=0x7f03540095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:25.017 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:25.017 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:25.017 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:25.017 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:25.017 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 100, 2024-09-13T10:36:25.017 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 399430, 2024-09-13T10:36:25.017 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:25.017 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:25.017 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:25.017 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:36:25.018 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:25.018 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:25.018 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:25.018 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:36:25.018 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:25.018 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:25.019 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:25.019 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 6, 2024-09-13T10:36:25.019 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:25.019 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:25.019 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:25.019 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:25.019 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:25.019 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:25.020 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:25.020 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:25.020 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:25.020 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:25.020 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:25.020 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:25.020 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:25.021 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:25.021 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:25.021 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:25.021 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:25.021 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:25.021 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:25.021 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:25.021 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:25.021 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:25.022 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:25.023 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:25.023 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:25.023 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:25.023 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:25.023 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:25.023 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:25.023 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:25.023 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:25.024 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:25.024 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:25.024 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:25.024 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:25.024 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:25.025 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:25.025 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:25.025 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:25.025 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:25.025 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:25.025 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:25.026 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:25.026 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:25.026 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:25.026 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:25.026 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:25.027 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:25.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.027 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:25.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.027 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:25.027 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:25.028 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:25.028 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:25.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.028 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:25.028 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:25.029 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:25.029 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:25.029 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:25.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.029 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:25.029 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:25.030 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:25.030 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:25.030 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:25.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.031 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:25.031 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:25.031 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:25.031 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:25.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.031 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:25.032 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:25.032 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:25.032 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:25.032 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:25.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.032 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:25.032 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:25.032 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:25.033 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:25.034 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:25.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.035 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:25.035 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:25.035 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:25.035 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:25.035 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:25.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.035 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:25.035 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:25.035 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:25.035 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:25.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.037 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.038 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:25.039 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:25.040 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:25.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.040 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:25.040 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:25.040 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:25.040 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:25.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.040 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:25.040 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:25.041 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:25.042 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:25.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:25.044 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:25.044 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:25.044 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:36:25.044 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:25.044 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:25.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:25.044 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:25.044 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:25.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.011+0000 7f0379801640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.195:6800/1839191919 conn(0x7f036003fa40 legacy=0x7f0360041f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:25.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.011+0000 7f0379801640 10 monclient: shutdown 2024-09-13T10:36:25.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.011+0000 7f0379801640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:25.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.011+0000 7f0379801640 1 -- 172.21.15.181:0/572470524 >> v1:172.21.15.181:6793/0 conn(0x7f03740a66d0 legacy=0x7f0374136730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:25.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.011+0000 7f03737fe640 1 -- 172.21.15.181:0/572470524 reap_dead start 2024-09-13T10:36:25.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.011+0000 7f03737fe640 1 -- 172.21.15.181:0/572470524 reap_dead start 2024-09-13T10:36:25.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.011+0000 7f0379801640 1 -- 172.21.15.181:0/572470524 shutdown_connections 2024-09-13T10:36:25.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.011+0000 7f0379801640 1 -- 172.21.15.181:0/572470524 >> 172.21.15.181:0/572470524 conn(0x7f03740abcd0 msgr2=0x7f0374138df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:25.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.011+0000 7f0379801640 1 -- 172.21.15.181:0/572470524 shutdown_connections 2024-09-13T10:36:25.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.011+0000 7f0379801640 1 -- 172.21.15.181:0/572470524 wait complete. 2024-09-13T10:36:25.047 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:36:25.047 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b', 'd'] 2024-09-13T10:36:25.047 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-13T10:36:25.047 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-13T10:36:25.047 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-13T10:36:25.048 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T10:36:25.048 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:36:25.059 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T10:36:25.059 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-09-13T10:36:25.059 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-09-13T10:36:25.059 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-09-13T10:36:25.059 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:36:25.091 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:25.091 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38733]: starting. 2024-09-13T10:36:25.091 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38733]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38696 2024-09-13T10:36:25.092 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38733]: created object 0... 2024-09-13T10:36:25.092 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38733]: created object 25... 2024-09-13T10:36:25.092 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38733]: created object 49... 2024-09-13T10:36:25.092 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38733]: finishing. 2024-09-13T10:36:25.092 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38733]: shutting down. 2024-09-13T10:36:25.111 INFO:tasks.ceph.mon.d:Stopped 2024-09-13T10:36:25.111 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 7 2024-09-13T10:36:25.111 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:36:25.134 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:25.134 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38735]: starting. 2024-09-13T10:36:25.134 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38735]: listing objects. 2024-09-13T10:36:25.134 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38735]: listed object 0... 2024-09-13T10:36:25.134 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38735]: listed object 25... 2024-09-13T10:36:25.134 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38735]: saw 50 objects 2024-09-13T10:36:25.134 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38735]: shutting down. 2024-09-13T10:36:25.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.244+0000 7f3979f1e640 10 monclient: get_monmap_and_config 2024-09-13T10:36:25.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.244+0000 7f3979f1e640 10 monclient: build_initial_monmap 2024-09-13T10:36:25.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.244+0000 7f3979f1e640 10 monclient: monmap: 2024-09-13T10:36:25.247 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:25.247 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:25.247 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:25.246157+0000 2024-09-13T10:36:25.247 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:25.246157+0000 2024-09-13T10:36:25.247 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:25.247 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:25.247 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:25.247 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:25.248 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:25.248 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:25.248 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:25.248 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:25.248 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:25.248 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:25.248 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:25.248 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:25.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 1 Processor -- start 2024-09-13T10:36:25.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 1 -- start start 2024-09-13T10:36:25.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 10 monclient: init 2024-09-13T10:36:25.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:25.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 10 monclient: _add_conns ranks=[7,8,6,0,2,4,5,3,1] 2024-09-13T10:36:25.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 10 monclient(hunting): picked mon.noname-i con 0x7f39740a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:25.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 10 monclient(hunting): picked mon.noname-e con 0x7f39740a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:25.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 10 monclient(hunting): picked mon.noname-d con 0x7f397413f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:25.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39740a4bc0 con 0x7f397413f750 2024-09-13T10:36:25.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397413a320 con 0x7f39740a6640 2024-09-13T10:36:25.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39740a8100 con 0x7f39740a8340 2024-09-13T10:36:25.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:25.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3979f1e640 10 monclient(hunting): authenticate will time out at 1124.751814s 2024-09-13T10:36:25.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3973fff640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f397413f750 legacy=0x7f3974141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:36:25.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3972ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f39740a8340 0x7f3974139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:36272/0 (socket says 172.21.15.181:36272) 2024-09-13T10:36:25.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.245+0000 7f3972ffd640 1 -- 172.21.15.181:0/2273279344 learned_addr learned my addr 172.21.15.181:0/2273279344 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:25.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f3972ffd640 1 -- 172.21.15.181:0/2273279344 >> v1:172.21.15.181:6793/0 conn(0x7f39740a8340 legacy=0x7f3974139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:25.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 1 -- 172.21.15.181:0/2273279344 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1054008159 0 0) 0x7f39740a8100 con 0x7f39740a8340 2024-09-13T10:36:25.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:25.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:25.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:25.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient(hunting): my global_id is 104687 2024-09-13T10:36:25.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 1 -- 172.21.15.181:0/2273279344 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f395c003520 con 0x7f39740a8340 2024-09-13T10:36:25.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39737fe640 1 -- 172.21.15.181:0/2273279344 >> v1:172.21.15.195:6792/0 conn(0x7f39740a6640 legacy=0x7f3974139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:25.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 1 -- 172.21.15.181:0/2273279344 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1885216348 0 0) 0x7f395c003520 con 0x7f39740a8340 2024-09-13T10:36:25.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 1 -- 172.21.15.181:0/2273279344 >> v1:172.21.15.195:6792/0 conn(0x7f39740a6640 legacy=0x7f3974139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:25.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 1 -- 172.21.15.181:0/2273279344 >> v1:172.21.15.181:6792/0 conn(0x7f397413f750 legacy=0x7f3974141b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:36:25.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient: _finish_hunting 0 2024-09-13T10:36:25.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 1 monclient: found mon.noname-e 2024-09-13T10:36:25.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:25.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:36:25.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 1 -- 172.21.15.181:0/2273279344 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39740a48e0 con 0x7f39740a8340 2024-09-13T10:36:25.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient: _finish_auth 0 2024-09-13T10:36:25.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient: _check_auth_tickets 2024-09-13T10:36:25.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:25.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 1 -- 172.21.15.181:0/2273279344 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3968001ae0 con 0x7f39740a8340 2024-09-13T10:36:25.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:25.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:25.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient: dump: 2024-09-13T10:36:25.256 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:25.256 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:25.256 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:25.257 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f3979f1e640 5 monclient: authenticate success, global_id 104687 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f3979f1e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 1 -- 172.21.15.181:0/2273279344 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f39680048a0 con 0x7f39740a8340 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f3979f1e640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 1 -- 172.21.15.181:0/2273279344 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3968004e10 con 0x7f39740a8340 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f3979f1e640 4 set_mon_vals no callback set 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.248+0000 7f39727fc640 10 monclient: dump: 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:25.258 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.249+0000 7f3979f1e640 10 monclient: shutdown 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.249+0000 7f3979f1e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:25.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.249+0000 7f3979f1e640 1 -- 172.21.15.181:0/2273279344 >> v1:172.21.15.181:6793/0 conn(0x7f39740a8340 legacy=0x7f3974139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:25.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.249+0000 7f3979f1e640 1 -- 172.21.15.181:0/2273279344 shutdown_connections 2024-09-13T10:36:25.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.249+0000 7f3979f1e640 1 -- 172.21.15.181:0/2273279344 >> 172.21.15.181:0/2273279344 conn(0x7f3974077170 msgr2=0x7f39740abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:25.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.249+0000 7f3979f1e640 1 -- 172.21.15.181:0/2273279344 shutdown_connections 2024-09-13T10:36:25.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.249+0000 7f3979f1e640 1 -- 172.21.15.181:0/2273279344 wait complete. 2024-09-13T10:36:25.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.249+0000 7f3979f1e640 10 monclient: build_initial_monmap 2024-09-13T10:36:25.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.249+0000 7f3979f1e640 10 monclient: monmap: 2024-09-13T10:36:25.260 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:25.260 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:25.260 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:25.260 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:25.260 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:25.260 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:25.261 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.249+0000 7f3979f1e640 1 Processor -- start 2024-09-13T10:36:25.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3979f1e640 1 -- start start 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3979f1e640 10 monclient: init 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3979f1e640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3979f1e640 10 monclient: _add_conns ranks=[6,2,1,7,0,5,4,3,8] 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3979f1e640 10 monclient(hunting): picked mon.noname-d con 0x7f39740a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3979f1e640 10 monclient(hunting): picked mon.noname-b con 0x7f397413f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3979f1e640 10 monclient(hunting): picked mon.noname-f con 0x7f397413cc60 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3979f1e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3974142f80 con 0x7f397413cc60 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3979f1e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397413e160 con 0x7f397413f750 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3979f1e640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39741343d0 con 0x7f39740a8340 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3979f1e640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f39737fe640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f39740a8340 legacy=0x7f39741ce5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3972ffd640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f397413f750 legacy=0x7f39741d3510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:25.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3979f1e640 10 monclient(hunting): authenticate will time out at 1124.756604s 2024-09-13T10:36:25.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3973fff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f397413cc60 0x7f39741d6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:60546/0 (socket says 172.21.15.181:60546) 2024-09-13T10:36:25.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.250+0000 7f3973fff640 1 -- 172.21.15.181:0/300674533 learned_addr learned my addr 172.21.15.181:0/300674533 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.252+0000 7f3973fff640 1 -- 172.21.15.181:0/300674533 >> v1:172.21.15.195:6789/0 conn(0x7f397413cc60 legacy=0x7f39741d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2608148110 0 0) 0x7f396c004070 con 0x7f397413cc60 2024-09-13T10:36:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:36:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 10 monclient(hunting): my global_id is 56728 2024-09-13T10:36:25.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3960003550 con 0x7f397413cc60 2024-09-13T10:36:25.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f3973fff640 1 --1- 172.21.15.181:0/300674533 >> v1:172.21.15.195:6789/0 conn(0x7f397413cc60 0x7f39741d6c40 :-1 s=OPENED pgs=542 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f3960003550 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:36:25.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4134400819 0 0) 0x7f3960003550 con 0x7f397413cc60 2024-09-13T10:36:25.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f396c004070 con 0x7f397413cc60 2024-09-13T10:36:25.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f396c004a20 con 0x7f397413cc60 2024-09-13T10:36:25.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:25.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:36:25.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 10 monclient(hunting): dump: 2024-09-13T10:36:25.265 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:25.265 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:25.265 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:25.266 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:25.266 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:25.266 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:25.266 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:25.266 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:25.266 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:25.266 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:25.266 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:25.266 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:25.266 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:25.266 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:25.266 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:25.267 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:25.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.253+0000 7f395bfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:25.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.451+0000 7f3972ffd640 1 -- 172.21.15.181:0/300674533 >> v1:172.21.15.181:6790/0 conn(0x7f397413f750 legacy=0x7f39741d3510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:25.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.451+0000 7f39737fe640 1 -- 172.21.15.181:0/300674533 >> v1:172.21.15.181:6792/0 conn(0x7f39740a8340 legacy=0x7f39741ce5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:36:25.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.852+0000 7f3972ffd640 1 -- 172.21.15.181:0/300674533 >> v1:172.21.15.181:6790/0 conn(0x7f397413f750 legacy=0x7f39741d3510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:25.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.852+0000 7f39737fe640 1 -- 172.21.15.181:0/300674533 >> v1:172.21.15.181:6792/0 conn(0x7f39740a8340 legacy=0x7f39741ce5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:36:25.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1130952129 0 0) 0x7f396c004070 con 0x7f397413cc60 2024-09-13T10:36:25.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 >> v1:172.21.15.181:6792/0 conn(0x7f39740a8340 legacy=0x7f39741ce5a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:36:25.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 >> v1:172.21.15.181:6790/0 conn(0x7f397413f750 legacy=0x7f39741d3510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:36:25.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:36:25.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 1 monclient: found mon.f 2024-09-13T10:36:25.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:25.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:36:25.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39741346b0 con 0x7f397413cc60 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 10 monclient: _finish_auth 0 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f3979f1e640 5 monclient: authenticate success, global_id 56728 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f3979f1e640 10 monclient: _renew_subs 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f3979f1e640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f3979f1e640 1 -- 172.21.15.181:0/300674533 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f397413e710 con 0x7f397413cc60 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f3979f1e640 10 monclient: _renew_subs 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f3979f1e640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f3979f1e640 1 -- 172.21.15.181:0/300674533 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f397413d820 con 0x7f397413cc60 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f396c004d30 con 0x7f397413cc60 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:25.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f396c005220 con 0x7f397413cc60 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f3971ffb640 4 set_mon_vals no callback set 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 10 monclient: dump: 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:25.882 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f396c0053c0 con 0x7f397413cc60 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f3979f1e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f3979f1e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f3979f1e640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f3979f1e640 1 -- 172.21.15.181:0/300674533 --> v1:172.21.15.195:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3954005080 con 0x7f397413cc60 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.877+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(201..201 src has 1..201) ==== 3898+0+0 (unknown 4008361621 0 0) 0x7f396c04e8c0 con 0x7f397413cc60 2024-09-13T10:36:25.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.878+0000 7f39737fe640 10 monclient: get_auth_request con 0x7f396003f860 auth_method 0 2024-09-13T10:36:25.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.882+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 <== mon.1 v1:172.21.15.195:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f3974142f80 con 0x7f397413cc60 2024-09-13T10:36:25.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.882+0000 7f395bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:25.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:25.882+0000 7f395bfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:26.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.125+0000 7f3979f1e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:36:26.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.126+0000 7f3979f1e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:36:26.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.126+0000 7f3979f1e640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:36:26.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.126+0000 7f3979f1e640 1 -- 172.21.15.181:0/300674533 --> v1:172.21.15.195:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3954005370 con 0x7f397413cc60 2024-09-13T10:36:26.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.126+0000 7f395bfff640 1 -- 172.21.15.181:0/300674533 <== mon.1 v1:172.21.15.195:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 690108907) 0x7f396c017d70 con 0x7f397413cc60 2024-09-13T10:36:26.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.126+0000 7f395bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:36:26.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.126+0000 7f395bfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:26.129 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":100,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:36:26.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.129+0000 7f3979f1e640 1 -- 172.21.15.181:0/300674533 >> v1:172.21.15.195:6800/1839191919 conn(0x7f396003f860 legacy=0x7f3960041d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:26.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.129+0000 7f3979f1e640 10 monclient: shutdown 2024-09-13T10:36:26.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.129+0000 7f3979f1e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:26.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.129+0000 7f3979f1e640 1 -- 172.21.15.181:0/300674533 >> v1:172.21.15.195:6789/0 conn(0x7f397413cc60 legacy=0x7f39741d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:26.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.129+0000 7f3979f1e640 1 -- 172.21.15.181:0/300674533 shutdown_connections 2024-09-13T10:36:26.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.129+0000 7f3979f1e640 1 -- 172.21.15.181:0/300674533 >> 172.21.15.181:0/300674533 conn(0x7f39740a6640 msgr2=0x7f39740a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:26.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.129+0000 7f3979f1e640 1 -- 172.21.15.181:0/300674533 shutdown_connections 2024-09-13T10:36:26.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:26.129+0000 7f3979f1e640 1 -- 172.21.15.181:0/300674533 wait complete. 2024-09-13T10:36:29.143 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:36:29.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.249+0000 7f938c194640 10 monclient: get_monmap_and_config 2024-09-13T10:36:29.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.249+0000 7f938c194640 10 monclient: build_initial_monmap 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.249+0000 7f938c194640 10 monclient: monmap: 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:29.250961+0000 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:29.250961+0000 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:29.252 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:29.253 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:29.253 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:29.253 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:29.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.249+0000 7f938c194640 1 Processor -- start 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f938c194640 1 -- start start 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f938c194640 10 monclient: init 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f938c194640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f938c194640 10 monclient: _add_conns ranks=[8,1,3,6,7,4,0,2,5] 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f938c194640 10 monclient(hunting): picked mon.noname-e con 0x7f93840a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f938c194640 10 monclient(hunting): picked mon.noname-f con 0x7f93840a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f938c194640 10 monclient(hunting): picked mon.noname-g con 0x7f938413f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f938c194640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93840a4bc0 con 0x7f93840a8340 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f938c194640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938413a320 con 0x7f938413f750 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f938c194640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93840a8100 con 0x7f93840a6640 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f938c194640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f938c194640 10 monclient(hunting): authenticate will time out at 1128.756739s 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f9389f30640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f93840a6640 0x7f9384139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:36280/0 (socket says 172.21.15.181:36280) 2024-09-13T10:36:29.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.250+0000 7f9389f30640 1 -- 172.21.15.181:0/2894680038 learned_addr learned my addr 172.21.15.181:0/2894680038 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:29.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9389f30640 1 -- 172.21.15.181:0/2894680038 >> v1:172.21.15.181:6793/0 conn(0x7f93840a6640 legacy=0x7f9384139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:29.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f938972f640 1 -- 172.21.15.181:0/2894680038 >> v1:172.21.15.195:6789/0 conn(0x7f93840a8340 legacy=0x7f9384139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:29.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f938a731640 1 -- 172.21.15.181:0/2894680038 >> v1:172.21.15.195:6790/0 conn(0x7f938413f750 legacy=0x7f9384141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:29.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 1 -- 172.21.15.181:0/2894680038 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2638378328 0 0) 0x7f938413a320 con 0x7f938413f750 2024-09-13T10:36:29.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 10 monclient(hunting): _negotiate 2024-09-13T10:36:29.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:29.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:29.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 10 monclient(hunting): my global_id is 6393 2024-09-13T10:36:29.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 1 -- 172.21.15.181:0/2894680038 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f936c003520 con 0x7f938413f750 2024-09-13T10:36:29.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 1 -- 172.21.15.181:0/2894680038 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2552912286 0 0) 0x7f936c003520 con 0x7f938413f750 2024-09-13T10:36:29.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 1 -- 172.21.15.181:0/2894680038 >> v1:172.21.15.181:6793/0 conn(0x7f93840a6640 legacy=0x7f9384139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 1 -- 172.21.15.181:0/2894680038 >> v1:172.21.15.195:6789/0 conn(0x7f93840a8340 legacy=0x7f9384139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 10 monclient: _finish_hunting 0 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 1 monclient: found mon.noname-g 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 1 -- 172.21.15.181:0/2894680038 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93840a48e0 con 0x7f938413f750 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 10 monclient: _finish_auth 0 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 10 monclient: _check_auth_tickets 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 1 -- 172.21.15.181:0/2894680038 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9374001b30 con 0x7f938413f750 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f938c194640 5 monclient: authenticate success, global_id 6393 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f938c194640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.253+0000 7f9388f2e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f9388f2e640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f9388f2e640 10 monclient: dump: 2024-09-13T10:36:29.258 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:29.259 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f938c194640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f9388f2e640 1 -- 172.21.15.181:0/2894680038 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9374003610 con 0x7f938413f750 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f9388f2e640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f9388f2e640 1 -- 172.21.15.181:0/2894680038 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9374003b40 con 0x7f938413f750 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f938c194640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f938c194640 4 set_mon_vals no callback set 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f9388f2e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f9388f2e640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f9388f2e640 10 monclient: dump: 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:29.260 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f938c194640 10 monclient: shutdown 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f938c194640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f938c194640 1 -- 172.21.15.181:0/2894680038 >> v1:172.21.15.195:6790/0 conn(0x7f938413f750 legacy=0x7f9384141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:29.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f938c194640 1 -- 172.21.15.181:0/2894680038 shutdown_connections 2024-09-13T10:36:29.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f938c194640 1 -- 172.21.15.181:0/2894680038 >> 172.21.15.181:0/2894680038 conn(0x7f9384077170 msgr2=0x7f93840abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:29.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f938c194640 1 -- 172.21.15.181:0/2894680038 shutdown_connections 2024-09-13T10:36:29.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.254+0000 7f938c194640 1 -- 172.21.15.181:0/2894680038 wait complete. 2024-09-13T10:36:29.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.255+0000 7f938c194640 10 monclient: build_initial_monmap 2024-09-13T10:36:29.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.255+0000 7f938c194640 10 monclient: monmap: 2024-09-13T10:36:29.266 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:29.266 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:29.266 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:29.266 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:29.266 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:29.266 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:29.266 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.255+0000 7f938c194640 1 Processor -- start 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.255+0000 7f938c194640 1 -- start start 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.255+0000 7f938c194640 10 monclient: init 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.256+0000 7f938c194640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.256+0000 7f938c194640 10 monclient: _add_conns ranks=[3,0,7,5,6,4,1,2,8] 2024-09-13T10:36:29.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.256+0000 7f938c194640 10 monclient(hunting): picked mon.noname-g con 0x7f93840a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.256+0000 7f938c194640 10 monclient(hunting): picked mon.noname-a con 0x7f938413f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.256+0000 7f938c194640 10 monclient(hunting): picked mon.noname-i con 0x7f938413e180 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.256+0000 7f938c194640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9384134c70 con 0x7f938413f750 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.256+0000 7f938c194640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9384134f50 con 0x7f93840a8340 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.256+0000 7f938c194640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93840a9d40 con 0x7f938413e180 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.256+0000 7f938c194640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.256+0000 7f938c194640 10 monclient(hunting): authenticate will time out at 1128.762344s 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.256+0000 7f938972f640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f938413f750 0x7f93841d3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36032/0 (socket says 172.21.15.181:36032) 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.256+0000 7f938972f640 1 -- 172.21.15.181:0/3692981349 learned_addr learned my addr 172.21.15.181:0/3692981349 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.258+0000 7f938972f640 1 -- 172.21.15.181:0/3692981349 >> v1:172.21.15.181:6789/0 conn(0x7f938413f750 legacy=0x7f93841d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.258+0000 7f9389f30640 1 -- 172.21.15.181:0/3692981349 >> v1:172.21.15.195:6790/0 conn(0x7f93840a8340 legacy=0x7f93841ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.258+0000 7f938a731640 1 -- 172.21.15.181:0/3692981349 >> v1:172.21.15.195:6792/0 conn(0x7f938413e180 legacy=0x7f93841d6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:29.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3302631208 0 0) 0x7f9384134f50 con 0x7f93840a8340 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient(hunting): my global_id is 6402 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9370003550 con 0x7f93840a8340 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 6436529 0 0) 0x7f9370003550 con 0x7f93840a8340 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9384134f50 con 0x7f93840a8340 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f937c004b60 con 0x7f93840a8340 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient(hunting): dump: 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:29.269 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:29.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2517017074 0 0) 0x7f9384134f50 con 0x7f93840a8340 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 >> v1:172.21.15.195:6792/0 conn(0x7f938413e180 legacy=0x7f93841d6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 >> v1:172.21.15.181:6789/0 conn(0x7f938413f750 legacy=0x7f93841d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient: _finish_hunting 0 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 1 monclient: found mon.g 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938413d620 con 0x7f93840a8340 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient: _finish_auth 0 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient: _check_auth_tickets 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f938c194640 5 monclient: authenticate success, global_id 6402 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f938c194640 10 monclient: _renew_subs 2024-09-13T10:36:29.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f938c194640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f938c194640 1 -- 172.21.15.181:0/3692981349 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f938413e730 con 0x7f93840a8340 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f938c194640 10 monclient: _renew_subs 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f938c194640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f938c194640 1 -- 172.21.15.181:0/3692981349 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f938413cd20 con 0x7f93840a8340 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f937c005030 con 0x7f93840a8340 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f937c0055a0 con 0x7f93840a8340 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f9383fff640 4 set_mon_vals no callback set 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.259+0000 7f93827fc640 10 monclient: dump: 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:29.272 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:29.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.260+0000 7f938c194640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:29.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.260+0000 7f938c194640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:29.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.260+0000 7f938c194640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:36:29.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.260+0000 7f938c194640 1 -- 172.21.15.181:0/3692981349 --> v1:172.21.15.195:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9364005080 con 0x7f93840a8340 2024-09-13T10:36:29.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.260+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f937c0057f0 con 0x7f93840a8340 2024-09-13T10:36:29.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.260+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(201..201 src has 1..201) ==== 3898+0+0 (unknown 4008361621 0 0) 0x7f937c04e7f0 con 0x7f93840a8340 2024-09-13T10:36:29.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.261+0000 7f938972f640 10 monclient: get_auth_request con 0x7f937003fb10 auth_method 0 2024-09-13T10:36:29.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.265+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 <== mon.3 v1:172.21.15.195:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f937c017c20 con 0x7f93840a8340 2024-09-13T10:36:29.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.265+0000 7f93827fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:29.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.265+0000 7f93827fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:29.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.510+0000 7f938c194640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:36:29.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.510+0000 7f938c194640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:36:29.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.510+0000 7f938c194640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:36:29.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.510+0000 7f938c194640 1 -- 172.21.15.181:0/3692981349 --> v1:172.21.15.195:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9364005370 con 0x7f93840a8340 2024-09-13T10:36:29.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.511+0000 7f93827fc640 1 -- 172.21.15.181:0/3692981349 <== mon.3 v1:172.21.15.195:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2746 (unknown 254746657 0 4213127248) 0x7f937c017520 con 0x7f93840a8340 2024-09-13T10:36:29.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.511+0000 7f93827fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:36:29.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.511+0000 7f93827fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:29.513 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":100,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":10,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:36:29.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.513+0000 7f938c194640 1 -- 172.21.15.181:0/3692981349 >> v1:172.21.15.195:6800/1839191919 conn(0x7f937003fb10 legacy=0x7f9370041fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:29.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.513+0000 7f938c194640 10 monclient: shutdown 2024-09-13T10:36:29.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.513+0000 7f938c194640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:29.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.513+0000 7f938c194640 1 -- 172.21.15.181:0/3692981349 >> v1:172.21.15.195:6790/0 conn(0x7f93840a8340 legacy=0x7f93841ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:29.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.513+0000 7f938c194640 1 -- 172.21.15.181:0/3692981349 shutdown_connections 2024-09-13T10:36:29.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.513+0000 7f938c194640 1 -- 172.21.15.181:0/3692981349 >> 172.21.15.181:0/3692981349 conn(0x7f93840a6640 msgr2=0x7f93840a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:29.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.513+0000 7f938c194640 1 -- 172.21.15.181:0/3692981349 shutdown_connections 2024-09-13T10:36:29.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:29.513+0000 7f938c194640 1 -- 172.21.15.181:0/3692981349 wait complete. 2024-09-13T10:36:32.526 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:36:32.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.633+0000 7f193b5ab640 10 monclient: get_monmap_and_config 2024-09-13T10:36:32.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.633+0000 7f193b5ab640 10 monclient: build_initial_monmap 2024-09-13T10:36:32.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.633+0000 7f193b5ab640 10 monclient: monmap: 2024-09-13T10:36:32.636 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:32.636 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:32.636 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:32.635310+0000 2024-09-13T10:36:32.636 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:32.635310+0000 2024-09-13T10:36:32.637 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:32.637 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:32.637 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:32.637 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:32.637 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:32.637 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:32.637 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:32.637 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:32.637 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:32.637 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:32.637 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:32.637 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:32.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.634+0000 7f193b5ab640 1 Processor -- start 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.634+0000 7f193b5ab640 1 -- start start 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.634+0000 7f193b5ab640 10 monclient: init 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.634+0000 7f193b5ab640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.634+0000 7f193b5ab640 10 monclient: _add_conns ranks=[5,7,1,4,0,2,3,8,6] 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.634+0000 7f193b5ab640 10 monclient(hunting): picked mon.noname-h con 0x7f1934139040 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.634+0000 7f193b5ab640 10 monclient(hunting): picked mon.noname-i con 0x7f193409cd50 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.635+0000 7f193b5ab640 10 monclient(hunting): picked mon.noname-f con 0x7f193413fae0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.635+0000 7f193b5ab640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f193409dbb0 con 0x7f193413fae0 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.635+0000 7f193b5ab640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f193409de90 con 0x7f1934139040 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.635+0000 7f193b5ab640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f193409e170 con 0x7f193409cd50 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.635+0000 7f193b5ab640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.635+0000 7f193b5ab640 10 monclient(hunting): authenticate will time out at 1132.141046s 2024-09-13T10:36:32.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.635+0000 7f1939b48640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f193413fae0 0x7f1934141ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:60550/0 (socket says 172.21.15.181:60550) 2024-09-13T10:36:32.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.635+0000 7f1938b46640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f193409cd50 0x7f193413e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:53460/0 (socket says 172.21.15.181:53460) 2024-09-13T10:36:32.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.635+0000 7f1939b48640 1 -- 172.21.15.181:0/4091621748 learned_addr learned my addr 172.21.15.181:0/4091621748 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:32.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.637+0000 7f1939b48640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.195:6789/0 conn(0x7f193413fae0 legacy=0x7f1934141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:32.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.637+0000 7f1939347640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.195:6791/0 conn(0x7f1934139040 legacy=0x7f19340a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:32.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:32.637+0000 7f1938b46640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.195:6792/0 conn(0x7f193409cd50 legacy=0x7f193413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:35.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 10 monclient(hunting): tick 2024-09-13T10:36:35.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:36:35.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 1 monclient(hunting): continuing hunt 2024-09-13T10:36:35.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:36:35.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.195:6792/0 conn(0x7f193409cd50 legacy=0x7f193413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:35.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.195:6791/0 conn(0x7f1934139040 legacy=0x7f19340a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:35.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.195:6789/0 conn(0x7f193413fae0 legacy=0x7f1934141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:35.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 10 monclient: _add_conns ranks=[2,4,8,0,3,6] 2024-09-13T10:36:35.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 10 monclient(hunting): picked mon.noname-b con 0x7f1918003960 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:35.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 10 monclient(hunting): picked mon.noname-c con 0x7f1918007530 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:35.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 10 monclient(hunting): picked mon.noname-e con 0x7f191800b2a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:35.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 1 -- 172.21.15.181:0/4091621748 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19340a5ff0 con 0x7f1918003960 2024-09-13T10:36:35.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 1 -- 172.21.15.181:0/4091621748 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1918010150 con 0x7f1918007530 2024-09-13T10:36:35.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 1 -- 172.21.15.181:0/4091621748 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19180113f0 con 0x7f191800b2a0 2024-09-13T10:36:35.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f192affd640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:35.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.635+0000 7f1939347640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6790/0 conn(0x7f1918003960 legacy=0x7f1918005d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:35.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.637+0000 7f1938b46640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6791/0 conn(0x7f1918007530 legacy=0x7f19180099f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:35.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.637+0000 7f1939b48640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6793/0 conn(0x7f191800b2a0 legacy=0x7f191800d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:35.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:35.836+0000 7f1939347640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6790/0 conn(0x7f1918003960 legacy=0x7f1918005d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:36.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:36.237+0000 7f1939347640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6790/0 conn(0x7f1918003960 legacy=0x7f1918005d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:37.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:37.039+0000 7f1939347640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6790/0 conn(0x7f1918003960 legacy=0x7f1918005d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:38.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 10 monclient(hunting): tick 2024-09-13T10:36:38.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:36:38.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 1 monclient(hunting): continuing hunt 2024-09-13T10:36:38.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:36:38.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6793/0 conn(0x7f191800b2a0 legacy=0x7f191800d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:38.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6791/0 conn(0x7f1918007530 legacy=0x7f19180099f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:38.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6790/0 conn(0x7f1918003960 legacy=0x7f1918005d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:36:38.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 10 monclient: _add_conns ranks=[3,0,6] 2024-09-13T10:36:38.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 10 monclient(hunting): picked mon.noname-g con 0x7f1918011920 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 10 monclient(hunting): picked mon.noname-a con 0x7f1918010320 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f1939b48640 1 -- 172.21.15.181:0/4091621748 reap_dead start 2024-09-13T10:36:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 10 monclient(hunting): picked mon.noname-d con 0x7f19180179f0 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 1 -- 172.21.15.181:0/4091621748 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1918012690 con 0x7f1918010320 2024-09-13T10:36:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 1 -- 172.21.15.181:0/4091621748 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19340a5ff0 con 0x7f1918011920 2024-09-13T10:36:38.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 1 -- 172.21.15.181:0/4091621748 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19180064c0 con 0x7f19180179f0 2024-09-13T10:36:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f192affd640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.635+0000 7f1939b48640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6792/0 conn(0x7f19180179f0 legacy=0x7f1918019de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:36:38.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.637+0000 7f1938b46640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6789/0 conn(0x7f1918010320 legacy=0x7f19180107a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:38.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.638+0000 7f1939347640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.195:6790/0 conn(0x7f1918011920 legacy=0x7f1918011d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:38.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:38.838+0000 7f1939b48640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6792/0 conn(0x7f19180179f0 legacy=0x7f1918019de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:36:39.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:39.239+0000 7f1939b48640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6792/0 conn(0x7f19180179f0 legacy=0x7f1918019de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:36:40.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 1 -- 172.21.15.181:0/4091621748 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544373462 0 0) 0x7f1918012690 con 0x7f1918010320 2024-09-13T10:36:40.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient(hunting): my global_id is 114291 2024-09-13T10:36:40.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 1 -- 172.21.15.181:0/4091621748 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1920003520 con 0x7f1918010320 2024-09-13T10:36:40.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 1 -- 172.21.15.181:0/4091621748 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1161990384 0 0) 0x7f1920003520 con 0x7f1918010320 2024-09-13T10:36:40.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6792/0 conn(0x7f19180179f0 legacy=0x7f1918019de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:36:40.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.195:6790/0 conn(0x7f1918011920 legacy=0x7f1918011d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:36:40.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 1 monclient: found mon.noname-a 2024-09-13T10:36:40.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:40.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:36:40.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 1 -- 172.21.15.181:0/4091621748 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1918006690 con 0x7f1918010320 2024-09-13T10:36:40.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient: _finish_auth 0 2024-09-13T10:36:40.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:36:40.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:40.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 1 -- 172.21.15.181:0/4091621748 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1924001a60 con 0x7f1918010320 2024-09-13T10:36:40.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f193b5ab640 5 monclient: authenticate success, global_id 114291 2024-09-13T10:36:40.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f193b5ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:40.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:36:40.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient: dump: 2024-09-13T10:36:40.022 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.022 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.022 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.022 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.022 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.022 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.022 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.022 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.022 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.022 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.023 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.023 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.023 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.023 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.023 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.023 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f193b5ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:40.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 1 -- 172.21.15.181:0/4091621748 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1924001cb0 con 0x7f1918010320 2024-09-13T10:36:40.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:40.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 1 -- 172.21.15.181:0/4091621748 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1924004b20 con 0x7f1918010320 2024-09-13T10:36:40.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f193b5ab640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:40.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f193b5ab640 4 set_mon_vals no callback set 2024-09-13T10:36:40.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:40.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.015+0000 7f192bfff640 10 monclient: dump: 2024-09-13T10:36:40.024 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.024 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.024 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.024 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.024 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.024 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.024 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.024 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.025 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.025 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.025 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.025 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.025 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.025 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.025 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.025 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.016+0000 7f193b5ab640 10 monclient: shutdown 2024-09-13T10:36:40.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.016+0000 7f193b5ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:40.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.016+0000 7f193b5ab640 1 -- 172.21.15.181:0/4091621748 >> v1:172.21.15.181:6789/0 conn(0x7f1918010320 legacy=0x7f19180107a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.016+0000 7f193b5ab640 1 -- 172.21.15.181:0/4091621748 shutdown_connections 2024-09-13T10:36:40.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.016+0000 7f193b5ab640 1 -- 172.21.15.181:0/4091621748 >> 172.21.15.181:0/4091621748 conn(0x7f1934077120 msgr2=0x7f19340abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:40.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.016+0000 7f193b5ab640 1 -- 172.21.15.181:0/4091621748 shutdown_connections 2024-09-13T10:36:40.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.016+0000 7f193b5ab640 1 -- 172.21.15.181:0/4091621748 wait complete. 2024-09-13T10:36:40.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.017+0000 7f193b5ab640 10 monclient: build_initial_monmap 2024-09-13T10:36:40.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.017+0000 7f193b5ab640 10 monclient: monmap: 2024-09-13T10:36:40.026 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:40.026 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:40.026 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:40.026 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:40.026 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:40.027 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:40.027 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:40.027 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:40.027 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:40.027 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:40.027 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:40.027 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:40.027 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:40.027 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:40.027 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:40.028 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.017+0000 7f193b5ab640 1 Processor -- start 2024-09-13T10:36:40.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.017+0000 7f193b5ab640 1 -- start start 2024-09-13T10:36:40.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.017+0000 7f193b5ab640 10 monclient: init 2024-09-13T10:36:40.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f193b5ab640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:40.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f193b5ab640 10 monclient: _add_conns ranks=[8,4,5,1,6,7,0,2,3] 2024-09-13T10:36:40.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f193b5ab640 10 monclient(hunting): picked mon.noname-e con 0x7f1918010320 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:40.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f193b5ab640 10 monclient(hunting): picked mon.noname-c con 0x7f1918011920 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:40.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f193b5ab640 10 monclient(hunting): picked mon.noname-h con 0x7f19180179f0 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:40.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f193b5ab640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f193409f750 con 0x7f1918011920 2024-09-13T10:36:40.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f193b5ab640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f193409eba0 con 0x7f19180179f0 2024-09-13T10:36:40.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f193b5ab640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f193413dc70 con 0x7f1918010320 2024-09-13T10:36:40.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f193b5ab640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:40.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f193b5ab640 10 monclient(hunting): authenticate will time out at 1139.524544s 2024-09-13T10:36:40.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f1938b46640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f1918011920 0x7f19341d3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53688/0 (socket says 172.21.15.181:53688) 2024-09-13T10:36:40.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f1939347640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f1918010320 0x7f19340a4bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:59674/0 (socket says 172.21.15.181:59674) 2024-09-13T10:36:40.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.018+0000 7f1938b46640 1 -- 172.21.15.181:0/973127793 learned_addr learned my addr 172.21.15.181:0/973127793 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:40.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.020+0000 7f1938b46640 1 -- 172.21.15.181:0/973127793 >> v1:172.21.15.181:6791/0 conn(0x7f1918011920 legacy=0x7f19341d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.020+0000 7f1939347640 1 -- 172.21.15.181:0/973127793 >> v1:172.21.15.181:6793/0 conn(0x7f1918010320 legacy=0x7f19340a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.020+0000 7f1939b48640 1 -- 172.21.15.181:0/973127793 >> v1:172.21.15.195:6791/0 conn(0x7f19180179f0 legacy=0x7f19341d6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3437445581 0 0) 0x7f193409f750 con 0x7f1918011920 2024-09-13T10:36:40.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): my global_id is 114277 2024-09-13T10:36:40.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19180115c0 con 0x7f1918011920 2024-09-13T10:36:40.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2587508801 0 0) 0x7f193409eba0 con 0x7f19180179f0 2024-09-13T10:36:40.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): my global_id is 104531 2024-09-13T10:36:40.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f193409f750 con 0x7f19180179f0 2024-09-13T10:36:40.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4184742673 0 0) 0x7f19180115c0 con 0x7f1918011920 2024-09-13T10:36:40.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f193409eba0 con 0x7f1918011920 2024-09-13T10:36:40.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1924004b20 con 0x7f1918011920 2024-09-13T10:36:40.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:40.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:36:40.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): dump: 2024-09-13T10:36:40.035 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.035 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.035 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.036 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.036 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.036 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.036 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.036 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.036 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.036 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.036 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.036 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.036 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.036 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.036 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.037 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:40.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3387429604 0 0) 0x7f193409f750 con 0x7f19180179f0 2024-09-13T10:36:40.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f19180115c0 con 0x7f19180179f0 2024-09-13T10:36:40.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f192c001f00 con 0x7f19180179f0 2024-09-13T10:36:40.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:40.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:36:40.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 10 monclient(hunting): dump: 2024-09-13T10:36:40.037 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.038 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.038 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.038 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.038 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.038 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.038 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.038 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.038 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.038 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.038 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.038 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.038 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.039 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.039 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.039 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.022+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2441721113 0 0) 0x7f193409eba0 con 0x7f1918011920 2024-09-13T10:36:40.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 >> v1:172.21.15.181:6793/0 conn(0x7f1918010320 legacy=0x7f19340a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 >> v1:172.21.15.195:6791/0 conn(0x7f19180179f0 legacy=0x7f19341d6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:36:40.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 1 monclient: found mon.c 2024-09-13T10:36:40.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:40.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:40.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193409eeb0 con 0x7f1918011920 2024-09-13T10:36:40.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 10 monclient: _finish_auth 0 2024-09-13T10:36:40.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:36:40.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:40.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f193b5ab640 5 monclient: authenticate success, global_id 114277 2024-09-13T10:36:40.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f193b5ab640 10 monclient: _renew_subs 2024-09-13T10:36:40.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f193b5ab640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:40.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f193b5ab640 1 -- 172.21.15.181:0/973127793 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f193409f190 con 0x7f1918011920 2024-09-13T10:36:40.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1924004f70 con 0x7f1918011920 2024-09-13T10:36:40.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:40.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1924005460 con 0x7f1918011920 2024-09-13T10:36:40.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:40.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f1929ffb640 10 monclient: dump: 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.041 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.042 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.042 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.042 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f192b7fe640 4 set_mon_vals no callback set 2024-09-13T10:36:40.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f193b5ab640 10 monclient: _renew_subs 2024-09-13T10:36:40.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f193b5ab640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:40.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.023+0000 7f193b5ab640 1 -- 172.21.15.181:0/973127793 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f19341ce250 con 0x7f1918011920 2024-09-13T10:36:40.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.024+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1924011ae0 con 0x7f1918011920 2024-09-13T10:36:40.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.024+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(201..201 src has 1..201) ==== 3898+0+0 (unknown 4008361621 0 0) 0x7f192404e200 con 0x7f1918011920 2024-09-13T10:36:40.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.024+0000 7f1939347640 10 monclient: get_auth_request con 0x7f1918042560 auth_method 0 2024-09-13T10:36:40.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.024+0000 7f193b5ab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:40.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.024+0000 7f193b5ab640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:40.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.024+0000 7f193b5ab640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:40.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.024+0000 7f193b5ab640 1 -- 172.21.15.181:0/973127793 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19340008d0 con 0x7f1918011920 2024-09-13T10:36:40.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.030+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f1924017750 con 0x7f1918011920 2024-09-13T10:36:40.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.030+0000 7f1929ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:40.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.030+0000 7f1929ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:40.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.273+0000 7f193b5ab640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:36:40.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.273+0000 7f193b5ab640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:36:40.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.273+0000 7f193b5ab640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:40.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.273+0000 7f193b5ab640 1 -- 172.21.15.181:0/973127793 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f19340a52d0 con 0x7f1918011920 2024-09-13T10:36:40.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.273+0000 7f1929ffb640 1 -- 172.21.15.181:0/973127793 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2733 (unknown 254746657 0 2637830433) 0x7f1924017050 con 0x7f1918011920 2024-09-13T10:36:40.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.273+0000 7f1929ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:36:40.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.273+0000 7f1929ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:40.276 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":108,"quorum":[0,1,3,4,5,7,8],"quorum_names":["a","f","g","c","h","i","e"],"quorum_leader_name":"g","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:36:40.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.275+0000 7f193b5ab640 1 -- 172.21.15.181:0/973127793 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1918042560 legacy=0x7f1918044a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.275+0000 7f193b5ab640 10 monclient: shutdown 2024-09-13T10:36:40.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.275+0000 7f193b5ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:40.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.275+0000 7f193b5ab640 1 -- 172.21.15.181:0/973127793 >> v1:172.21.15.181:6791/0 conn(0x7f1918011920 legacy=0x7f19341d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.276+0000 7f193b5ab640 1 -- 172.21.15.181:0/973127793 shutdown_connections 2024-09-13T10:36:40.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.276+0000 7f193b5ab640 1 -- 172.21.15.181:0/973127793 >> 172.21.15.181:0/973127793 conn(0x7f1934077120 msgr2=0x7f19340a99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:40.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.276+0000 7f193b5ab640 1 -- 172.21.15.181:0/973127793 shutdown_connections 2024-09-13T10:36:40.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.276+0000 7f193b5ab640 1 -- 172.21.15.181:0/973127793 wait complete. 2024-09-13T10:36:40.289 INFO:tasks.mon_thrash.ceph_manager:quorum is size 7 2024-09-13T10:36:40.289 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon a 2024-09-13T10:36:40.289 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:36:40.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.385+0000 7f78fc37d640 10 monclient: get_monmap_and_config 2024-09-13T10:36:40.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.385+0000 7f78fc37d640 10 monclient: build_initial_monmap 2024-09-13T10:36:40.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.385+0000 7f78fc37d640 10 monclient: monmap: 2024-09-13T10:36:40.388 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:40.388 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.388 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:40.387010+0000 2024-09-13T10:36:40.388 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:40.387010+0000 2024-09-13T10:36:40.388 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:40.388 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.388 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:40.389 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:40.389 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:40.389 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:40.389 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:40.389 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:40.389 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:40.389 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:40.389 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:40.389 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 1 Processor -- start 2024-09-13T10:36:40.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 1 -- start start 2024-09-13T10:36:40.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 10 monclient: init 2024-09-13T10:36:40.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:40.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 10 monclient: _add_conns ranks=[8,7,5,3,4,6,1,2,0] 2024-09-13T10:36:40.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 10 monclient(hunting): picked mon.noname-e con 0x7f78f40a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:40.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 10 monclient(hunting): picked mon.noname-i con 0x7f78f40a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:40.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 10 monclient(hunting): picked mon.noname-h con 0x7f78f413f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:40.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f40a5fe0 con 0x7f78f413f9a0 2024-09-13T10:36:40.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f40a8080 con 0x7f78f40a6ab0 2024-09-13T10:36:40.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f40a42c0 con 0x7f78f40a66d0 2024-09-13T10:36:40.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:40.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fc37d640 10 monclient(hunting): authenticate will time out at 1139.892854s 2024-09-13T10:36:40.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fa119640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f78f40a66d0 0x7f78f40a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:59690/0 (socket says 172.21.15.181:59690) 2024-09-13T10:36:40.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.386+0000 7f78fa119640 1 -- 172.21.15.181:0/3708406008 learned_addr learned my addr 172.21.15.181:0/3708406008 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:40.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fa119640 1 -- 172.21.15.181:0/3708406008 >> v1:172.21.15.181:6793/0 conn(0x7f78f40a66d0 legacy=0x7f78f40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 1 -- 172.21.15.181:0/3708406008 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743953568 0 0) 0x7f78f40a42c0 con 0x7f78f40a66d0 2024-09-13T10:36:40.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient(hunting): my global_id is 104705 2024-09-13T10:36:40.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 1 -- 172.21.15.181:0/3708406008 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78e0003520 con 0x7f78f40a66d0 2024-09-13T10:36:40.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fa91a640 1 -- 172.21.15.181:0/3708406008 >> v1:172.21.15.195:6791/0 conn(0x7f78f413f9a0 legacy=0x7f78f4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9918640 1 -- 172.21.15.181:0/3708406008 >> v1:172.21.15.195:6792/0 conn(0x7f78f40a6ab0 legacy=0x7f78f40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 1 -- 172.21.15.181:0/3708406008 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3530671834 0 0) 0x7f78e0003520 con 0x7f78f40a66d0 2024-09-13T10:36:40.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 1 -- 172.21.15.181:0/3708406008 >> v1:172.21.15.195:6792/0 conn(0x7f78f40a6ab0 legacy=0x7f78f40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 1 -- 172.21.15.181:0/3708406008 >> v1:172.21.15.195:6791/0 conn(0x7f78f413f9a0 legacy=0x7f78f4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient: _finish_hunting 0 2024-09-13T10:36:40.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 1 monclient: found mon.noname-e 2024-09-13T10:36:40.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 1 -- 172.21.15.181:0/3708406008 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f41464e0 con 0x7f78f40a66d0 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient: _finish_auth 0 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient: _check_auth_tickets 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 1 -- 172.21.15.181:0/3708406008 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f78f0001ad0 con 0x7f78f40a66d0 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient: dump: 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.397 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.398 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.398 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.398 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.398 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.398 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.398 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.398 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.398 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.398 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.398 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.398 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.398 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 5 monclient: authenticate success, global_id 104705 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 1 -- 172.21.15.181:0/3708406008 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78f00048a0 con 0x7f78f40a66d0 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 1 -- 172.21.15.181:0/3708406008 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f78f0004dd0 con 0x7f78f40a66d0 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 4 set_mon_vals no callback set 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78f9117640 10 monclient: dump: 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.399 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.400 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.400 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.400 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.400 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.400 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.400 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.400 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.400 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.400 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.400 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.400 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.400 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 10 monclient: shutdown 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 1 -- 172.21.15.181:0/3708406008 >> v1:172.21.15.181:6793/0 conn(0x7f78f40a66d0 legacy=0x7f78f40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 1 -- 172.21.15.181:0/3708406008 shutdown_connections 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 1 -- 172.21.15.181:0/3708406008 >> 172.21.15.181:0/3708406008 conn(0x7f78f40abcd0 msgr2=0x7f78f40ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 1 -- 172.21.15.181:0/3708406008 shutdown_connections 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 1 -- 172.21.15.181:0/3708406008 wait complete. 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 10 monclient: build_initial_monmap 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.390+0000 7f78fc37d640 10 monclient: monmap: 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:40.401 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 1 Processor -- start 2024-09-13T10:36:40.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 1 -- start start 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 10 monclient: init 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 10 monclient: _add_conns ranks=[3,0,1,4,5,8,6,7,2] 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 10 monclient(hunting): picked mon.noname-g con 0x7f78f40a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 10 monclient(hunting): picked mon.noname-a con 0x7f78f40a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 10 monclient(hunting): picked mon.noname-f con 0x7f78f413f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f413f000 con 0x7f78f40a6ab0 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f413f2e0 con 0x7f78f413f9a0 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f41430b0 con 0x7f78f40a66d0 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78fc37d640 10 monclient(hunting): authenticate will time out at 1139.897501s 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78f9918640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f78f40a6ab0 0x7f78f41d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:42830/0 (socket says 172.21.15.181:42830) 2024-09-13T10:36:40.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.391+0000 7f78f9918640 1 -- 172.21.15.181:0/481919177 learned_addr learned my addr 172.21.15.181:0/481919177 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:40.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.393+0000 7f78f9918640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.181:6789/0 conn(0x7f78f40a6ab0 legacy=0x7f78f41d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.393+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2881958831 0 0) 0x7f78f413f000 con 0x7f78f40a6ab0 2024-09-13T10:36:40.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.393+0000 7f78eaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.393+0000 7f78eaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.393+0000 7f78eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.393+0000 7f78eaffd640 10 monclient(hunting): my global_id is 114300 2024-09-13T10:36:40.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.393+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78d8003550 con 0x7f78f40a6ab0 2024-09-13T10:36:40.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.393+0000 7f78fa91a640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.195:6789/0 conn(0x7f78f413f9a0 legacy=0x7f78f41d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.393+0000 7f78fa119640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.195:6790/0 conn(0x7f78f40a66d0 legacy=0x7f78f41ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2649841610 0 0) 0x7f78d8003550 con 0x7f78f40a6ab0 2024-09-13T10:36:40.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78f413f000 con 0x7f78f40a6ab0 2024-09-13T10:36:40.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f78e4003610 con 0x7f78f40a6ab0 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient(hunting): dump: 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.409 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 52795657 0 0) 0x7f78f41430b0 con 0x7f78f40a66d0 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient(hunting): my global_id is 6420 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78d8003550 con 0x7f78f40a66d0 2024-09-13T10:36:40.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231499219 0 0) 0x7f78f413f2e0 con 0x7f78f413f9a0 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient(hunting): my global_id is 56737 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78f41430b0 con 0x7f78f413f9a0 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1364017540 0 0) 0x7f78f413f000 con 0x7f78f40a6ab0 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.195:6790/0 conn(0x7f78f40a66d0 legacy=0x7f78f41ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.195:6789/0 conn(0x7f78f413f9a0 legacy=0x7f78f41d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient: _finish_hunting 0 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 monclient: found mon.a 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f41376e0 con 0x7f78f40a6ab0 2024-09-13T10:36:40.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient: _finish_auth 0 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient: _check_auth_tickets 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78fc37d640 5 monclient: authenticate success, global_id 114300 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78fc37d640 10 monclient: _renew_subs 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78fc37d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78fc37d640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f78f40688a0 con 0x7f78f40a6ab0 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78fc37d640 10 monclient: _renew_subs 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78fc37d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78fc37d640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f78f413ed20 con 0x7f78f40a6ab0 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78e4003bd0 con 0x7f78f40a6ab0 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f78e4004100 con 0x7f78f40a6ab0 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78f8916640 4 set_mon_vals no callback set 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.394+0000 7f78eaffd640 10 monclient: dump: 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.413 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.395+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f78e40042a0 con 0x7f78f40a6ab0 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.395+0000 7f78fc37d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.395+0000 7f78fc37d640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f78dc0065c0 con 0x7f78dc002860 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.395+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(201..201 src has 1..201) ==== 3898+0+0 (unknown 4008361621 0 0) 0x7f78e404e4a0 con 0x7f78f40a6ab0 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.395+0000 7f78fa91a640 10 monclient: get_auth_request con 0x7f78d803fca0 auth_method 0 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78fa119640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.181:6789/0 conn(0x7f78dc002860 legacy=0x7f78dc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045924099 0 0) 0x7f78dc0065c0 con 0x7f78dc002860 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 10 monclient(hunting): my global_id is 114309 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78f413f000 con 0x7f78dc002860 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 508153207 0 0) 0x7f78f413f000 con 0x7f78dc002860 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78dc0065c0 con 0x7f78dc002860 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f78f0001d20 con 0x7f78dc002860 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78fa91a640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.195:6800/1839191919 conn(0x7f78d803fca0 legacy=0x7f78d8042160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 10 monclient: dump: 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.415 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78fa91a640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.195:6800/1839191919 conn(0x7f78d803fca0 legacy=0x7f78d8042160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:36:40.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78fa91a640 1 --1- 172.21.15.181:0/481919177 >> v1:172.21.15.195:6800/1839191919 conn(0x7f78d803fca0 0x7f78d8042160 :-1 s=OPENED pgs=421 cs=1 l=1).handle_message read tag failed 2024-09-13T10:36:40.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78fa91a640 1 --1- 172.21.15.181:0/481919177 >> v1:172.21.15.195:6800/1839191919 conn(0x7f78d803fca0 0x7f78d8042160 :-1 s=OPENED pgs=421 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:36:40.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.195:6800/1839191919 conn(0x7f78d803fca0 legacy=0x7f78d8042160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:40.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1615367285 0 0) 0x7f78dc0065c0 con 0x7f78dc002860 2024-09-13T10:36:40.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.397+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78dc00a160 con 0x7f78dc002860 2024-09-13T10:36:40.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.398+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f78f0004a00 con 0x7f78dc002860 2024-09-13T10:36:40.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.398+0000 7f78eaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:40.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.398+0000 7f78eaffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:40.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.398+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.181:6789/0 conn(0x7f78dc002860 legacy=0x7f78dc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.398+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.181:6789/0 conn(0x7f78dc002860 legacy=0x7f78dc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:40.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.404+0000 7f78fc37d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:40.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.404+0000 7f78fc37d640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f78dc009e70 con 0x7f78dc009130 2024-09-13T10:36:40.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78fa119640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.181:6789/0 conn(0x7f78dc009130 legacy=0x7f78dc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2965196212 0 0) 0x7f78dc009e70 con 0x7f78dc009130 2024-09-13T10:36:40.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 10 monclient(hunting): my global_id is 114318 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78dc0065c0 con 0x7f78dc009130 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 457687286 0 0) 0x7f78dc0065c0 con 0x7f78dc009130 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78dc009e70 con 0x7f78dc009130 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f78f0005450 con 0x7f78dc009130 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 10 monclient: dump: 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.420 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 19047284 0 0) 0x7f78dc009e70 con 0x7f78dc009130 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f78dc00c3f0 con 0x7f78dc009130 2024-09-13T10:36:40.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7704 (unknown 0 0 314382634) 0x7f78f00085c0 con 0x7f78dc009130 2024-09-13T10:36:40.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:40.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:40.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.181:6789/0 conn(0x7f78dc009130 legacy=0x7f78dc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78eaffd640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.181:6789/0 conn(0x7f78dc009130 legacy=0x7f78dc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:40.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78fa91a640 1 -- 172.21.15.181:0/481919177 reap_dead start 2024-09-13T10:36:40.422 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:40.422 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:40.422 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:40.422 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:40.422 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 108, 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 36385, 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:40.423 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:40.424 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:40.425 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:40.426 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:40.427 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.429 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:40.430 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.431 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.432 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.434 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.435 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:40.436 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.437 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.438 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.440 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:40.440 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.440 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.440 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:40.440 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:40.440 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.440 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.440 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:40.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.443 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:40.443 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78fc37d640 10 monclient: shutdown 2024-09-13T10:36:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78fc37d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78fc37d640 1 -- 172.21.15.181:0/481919177 >> v1:172.21.15.181:6789/0 conn(0x7f78f40a6ab0 legacy=0x7f78f41d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78fc37d640 1 -- 172.21.15.181:0/481919177 shutdown_connections 2024-09-13T10:36:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.407+0000 7f78fc37d640 1 -- 172.21.15.181:0/481919177 >> 172.21.15.181:0/481919177 conn(0x7f78f40abcd0 msgr2=0x7f78f40a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.408+0000 7f78fc37d640 1 -- 172.21.15.181:0/481919177 shutdown_connections 2024-09-13T10:36:40.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.408+0000 7f78fc37d640 1 -- 172.21.15.181:0/481919177 wait complete. 2024-09-13T10:36:40.445 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-13T10:36:40.445 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon c 2024-09-13T10:36:40.445 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:36:40.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.541+0000 7fc642416640 10 monclient: get_monmap_and_config 2024-09-13T10:36:40.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.541+0000 7fc642416640 10 monclient: build_initial_monmap 2024-09-13T10:36:40.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.541+0000 7fc642416640 10 monclient: monmap: 2024-09-13T10:36:40.544 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:40.544 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.544 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:40.543379+0000 2024-09-13T10:36:40.544 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:40.543379+0000 2024-09-13T10:36:40.544 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:40.544 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.544 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:40.544 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:40.545 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:40.545 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:40.545 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:40.545 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:40.545 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:40.545 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:40.545 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:40.545 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.542+0000 7fc642416640 1 Processor -- start 2024-09-13T10:36:40.546 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.542+0000 7fc642416640 1 -- start start 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.542+0000 7fc642416640 10 monclient: init 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc642416640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc642416640 10 monclient: _add_conns ranks=[2,6,1,8,4,5,3,7,0] 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc642416640 10 monclient(hunting): picked mon.noname-b con 0x7fc63c0a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc642416640 10 monclient(hunting): picked mon.noname-d con 0x7fc63c0a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc642416640 10 monclient(hunting): picked mon.noname-f con 0x7fc63c13f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc642416640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63c0a4bc0 con 0x7fc63c13f750 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc63bfff640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fc63c0a6640 legacy=0x7fc63c139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc633fff640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7fc63c0a8340 legacy=0x7fc63c139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc642416640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63c13a320 con 0x7fc63c0a6640 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc642416640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63c0a8100 con 0x7fc63c0a8340 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc642416640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:40.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc642416640 10 monclient(hunting): authenticate will time out at 1140.049314s 2024-09-13T10:36:40.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc6409b3640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fc63c13f750 0x7fc63c141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:35338/0 (socket says 172.21.15.181:35338) 2024-09-13T10:36:40.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.543+0000 7fc6409b3640 1 -- 172.21.15.181:0/483989317 learned_addr learned my addr 172.21.15.181:0/483989317 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:40.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc6409b3640 1 -- 172.21.15.181:0/483989317 >> v1:172.21.15.195:6789/0 conn(0x7fc63c13f750 legacy=0x7fc63c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 1 -- 172.21.15.181:0/483989317 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395575299 0 0) 0x7fc63c0a4bc0 con 0x7fc63c13f750 2024-09-13T10:36:40.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient(hunting): my global_id is 56746 2024-09-13T10:36:40.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 1 -- 172.21.15.181:0/483989317 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc628003520 con 0x7fc63c13f750 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 1 -- 172.21.15.181:0/483989317 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1646448704 0 0) 0x7fc628003520 con 0x7fc63c13f750 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 1 -- 172.21.15.181:0/483989317 >> v1:172.21.15.181:6792/0 conn(0x7fc63c0a8340 legacy=0x7fc63c139c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 1 -- 172.21.15.181:0/483989317 >> v1:172.21.15.181:6790/0 conn(0x7fc63c0a6640 legacy=0x7fc63c139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 1 monclient: found mon.noname-f 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 1 -- 172.21.15.181:0/483989317 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c0a48e0 con 0x7fc63c13f750 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 1 -- 172.21.15.181:0/483989317 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc634001e60 con 0x7fc63c13f750 2024-09-13T10:36:40.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient: dump: 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.553 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc642416640 5 monclient: authenticate success, global_id 56746 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc642416640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 1 -- 172.21.15.181:0/483989317 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc634004c20 con 0x7fc63c13f750 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 1 -- 172.21.15.181:0/483989317 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc634005190 con 0x7fc63c13f750 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc642416640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc642416640 4 set_mon_vals no callback set 2024-09-13T10:36:40.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc63b7fe640 10 monclient: dump: 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.555 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc642416640 10 monclient: shutdown 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc642416640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.546+0000 7fc642416640 1 -- 172.21.15.181:0/483989317 >> v1:172.21.15.195:6789/0 conn(0x7fc63c13f750 legacy=0x7fc63c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.547+0000 7fc642416640 1 -- 172.21.15.181:0/483989317 shutdown_connections 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.547+0000 7fc642416640 1 -- 172.21.15.181:0/483989317 >> 172.21.15.181:0/483989317 conn(0x7fc63c077170 msgr2=0x7fc63c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.547+0000 7fc642416640 1 -- 172.21.15.181:0/483989317 shutdown_connections 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.547+0000 7fc642416640 1 -- 172.21.15.181:0/483989317 wait complete. 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.547+0000 7fc642416640 10 monclient: build_initial_monmap 2024-09-13T10:36:40.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.547+0000 7fc642416640 10 monclient: monmap: 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:40.557 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.547+0000 7fc642416640 1 Processor -- start 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc642416640 1 -- start start 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc642416640 10 monclient: init 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc642416640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc642416640 10 monclient: _add_conns ranks=[6,8,2,4,1,3,5,7,0] 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc642416640 10 monclient(hunting): picked mon.noname-d con 0x7fc63c0a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc642416640 10 monclient(hunting): picked mon.noname-e con 0x7fc63c13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc642416640 10 monclient(hunting): picked mon.noname-b con 0x7fc63c1d43a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc63bfff640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7fc63c0a8340 legacy=0x7fc63c09d440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc642416640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63c0a11b0 con 0x7fc63c1d43a0 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc642416640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63c142b60 con 0x7fc63c0a8340 2024-09-13T10:36:40.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc642416640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63c0a0340 con 0x7fc63c13f750 2024-09-13T10:36:40.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc6409b3640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fc63c1d43a0 legacy=0x7fc63c1d6790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:40.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc642416640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:40.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc642416640 10 monclient(hunting): authenticate will time out at 1140.054530s 2024-09-13T10:36:40.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc633fff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fc63c13f750 0x7fc63c09db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:59704/0 (socket says 172.21.15.181:59704) 2024-09-13T10:36:40.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.548+0000 7fc633fff640 1 -- 172.21.15.181:0/2121434435 learned_addr learned my addr 172.21.15.181:0/2121434435 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:40.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.550+0000 7fc633fff640 1 -- 172.21.15.181:0/2121434435 >> v1:172.21.15.181:6793/0 conn(0x7fc63c13f750 legacy=0x7fc63c09db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.550+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3895982237 0 0) 0x7fc63c0a0340 con 0x7fc63c13f750 2024-09-13T10:36:40.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.550+0000 7fc6397fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.550+0000 7fc6397fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.550+0000 7fc6397fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.550+0000 7fc6397fa640 10 monclient(hunting): my global_id is 104714 2024-09-13T10:36:40.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.550+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc61c003550 con 0x7fc63c13f750 2024-09-13T10:36:40.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1679711327 0 0) 0x7fc61c003550 con 0x7fc63c13f750 2024-09-13T10:36:40.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc63c0a0340 con 0x7fc63c13f750 2024-09-13T10:36:40.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc624004610 con 0x7fc63c13f750 2024-09-13T10:36:40.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 10 monclient(hunting): dump: 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.564 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3029407829 0 0) 0x7fc63c0a0340 con 0x7fc63c13f750 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 >> v1:172.21.15.181:6792/0 conn(0x7fc63c0a8340 legacy=0x7fc63c09d440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 >> v1:172.21.15.181:6790/0 conn(0x7fc63c1d43a0 legacy=0x7fc63c1d6790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 10 monclient: _finish_hunting 0 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 1 monclient: found mon.e 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:40.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c09ee50 con 0x7fc63c13f750 2024-09-13T10:36:40.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 10 monclient: _finish_auth 0 2024-09-13T10:36:40.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 10 monclient: _check_auth_tickets 2024-09-13T10:36:40.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:40.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc642416640 5 monclient: authenticate success, global_id 104714 2024-09-13T10:36:40.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc642416640 10 monclient: _renew_subs 2024-09-13T10:36:40.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc642416640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:40.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc642416640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc63c09e260 con 0x7fc63c13f750 2024-09-13T10:36:40.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc642416640 10 monclient: _renew_subs 2024-09-13T10:36:40.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc642416640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:40.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc642416640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fc63c0a2a10 con 0x7fc63c13f750 2024-09-13T10:36:40.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc624004c40 con 0x7fc63c13f750 2024-09-13T10:36:40.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:40.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc624005170 con 0x7fc63c13f750 2024-09-13T10:36:40.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc63affd640 4 set_mon_vals no callback set 2024-09-13T10:36:40.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:40.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.551+0000 7fc6397fa640 10 monclient: dump: 2024-09-13T10:36:40.569 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.570 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.571 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.571 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.552+0000 7fc642416640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:40.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.552+0000 7fc642416640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc6200065c0 con 0x7fc620002860 2024-09-13T10:36:40.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.552+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fc624005310 con 0x7fc63c13f750 2024-09-13T10:36:40.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.552+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(201..201 src has 1..201) ==== 3898+0+0 (unknown 4008361621 0 0) 0x7fc62404e420 con 0x7fc63c13f750 2024-09-13T10:36:40.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.552+0000 7fc6409b3640 10 monclient: get_auth_request con 0x7fc61c03f900 auth_method 0 2024-09-13T10:36:40.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc63bfff640 1 -- 172.21.15.181:0/2121434435 >> v1:172.21.15.181:6791/0 conn(0x7fc620002860 legacy=0x7fc620004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101632422 0 0) 0x7fc6200065c0 con 0x7fc620002860 2024-09-13T10:36:40.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 10 monclient(hunting): my global_id is 114286 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc63c0a0340 con 0x7fc620002860 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2309943513 0 0) 0x7fc63c0a0340 con 0x7fc620002860 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6200065c0 con 0x7fc620002860 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc62c004440 con 0x7fc620002860 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 10 monclient: dump: 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.572 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3316970396 0 0) 0x7fc6200065c0 con 0x7fc620002860 2024-09-13T10:36:40.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.554+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc62000a160 con 0x7fc620002860 2024-09-13T10:36:40.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.555+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc62c0067f0 con 0x7fc620002860 2024-09-13T10:36:40.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.555+0000 7fc6397fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:40.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.555+0000 7fc6397fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:40.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.555+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 >> v1:172.21.15.181:6791/0 conn(0x7fc620002860 legacy=0x7fc620004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.555+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 >> v1:172.21.15.181:6791/0 conn(0x7fc620002860 legacy=0x7fc620004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:40.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.561+0000 7fc642416640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:40.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.561+0000 7fc642416640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc620009e70 con 0x7fc620009130 2024-09-13T10:36:40.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc63bfff640 1 -- 172.21.15.181:0/2121434435 >> v1:172.21.15.181:6791/0 conn(0x7fc620009130 legacy=0x7fc6200095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723762581 0 0) 0x7fc620009e70 con 0x7fc620009130 2024-09-13T10:36:40.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 10 monclient(hunting): my global_id is 114295 2024-09-13T10:36:40.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6200065c0 con 0x7fc620009130 2024-09-13T10:36:40.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3436946006 0 0) 0x7fc6200065c0 con 0x7fc620009130 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc620009e70 con 0x7fc620009130 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc62c004e70 con 0x7fc620009130 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 10 monclient: dump: 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.577 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3912167961 0 0) 0x7fc620009e70 con 0x7fc620009130 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.563+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc62000c410 con 0x7fc620009130 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7537 (unknown 0 0 2737306922) 0x7fc62c0062d0 con 0x7fc620009130 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc6397fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc6397fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:40.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 >> v1:172.21.15.181:6791/0 conn(0x7fc620009130 legacy=0x7fc6200095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc6397fa640 1 -- 172.21.15.181:0/2121434435 >> v1:172.21.15.181:6791/0 conn(0x7fc620009130 legacy=0x7fc6200095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:40.579 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 108, 2024-09-13T10:36:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 36542, 2024-09-13T10:36:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:40.598 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:40.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc642416640 1 -- 172.21.15.181:0/2121434435 >> v1:172.21.15.195:6800/1839191919 conn(0x7fc61c03f900 legacy=0x7fc61c041dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc642416640 10 monclient: shutdown 2024-09-13T10:36:40.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc642416640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:40.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc642416640 1 -- 172.21.15.181:0/2121434435 >> v1:172.21.15.181:6793/0 conn(0x7fc63c13f750 legacy=0x7fc63c09db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc6409b3640 1 -- 172.21.15.181:0/2121434435 reap_dead start 2024-09-13T10:36:40.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc6409b3640 1 -- 172.21.15.181:0/2121434435 reap_dead start 2024-09-13T10:36:40.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc642416640 1 -- 172.21.15.181:0/2121434435 shutdown_connections 2024-09-13T10:36:40.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc642416640 1 -- 172.21.15.181:0/2121434435 >> 172.21.15.181:0/2121434435 conn(0x7fc63c0a6640 msgr2=0x7fc63c141b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:40.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc642416640 1 -- 172.21.15.181:0/2121434435 shutdown_connections 2024-09-13T10:36:40.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.564+0000 7fc642416640 1 -- 172.21.15.181:0/2121434435 wait complete. 2024-09-13T10:36:40.601 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-13T10:36:40.601 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon e 2024-09-13T10:36:40.601 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:36:40.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.702+0000 7fa6b99a4640 10 monclient: get_monmap_and_config 2024-09-13T10:36:40.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.702+0000 7fa6b99a4640 10 monclient: build_initial_monmap 2024-09-13T10:36:40.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.702+0000 7fa6b99a4640 10 monclient: monmap: 2024-09-13T10:36:40.705 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:40.705 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.705 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:40.704497+0000 2024-09-13T10:36:40.705 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:40.704497+0000 2024-09-13T10:36:40.705 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:40.706 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.706 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:40.706 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:40.706 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:40.706 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:40.706 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:40.706 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:40.706 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:40.706 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:40.706 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:40.706 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.703+0000 7fa6b99a4640 1 Processor -- start 2024-09-13T10:36:40.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.703+0000 7fa6b99a4640 1 -- start start 2024-09-13T10:36:40.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.703+0000 7fa6b99a4640 10 monclient: init 2024-09-13T10:36:40.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.703+0000 7fa6b99a4640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:40.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.703+0000 7fa6b99a4640 10 monclient: _add_conns ranks=[1,8,6,7,4,2,5,3,0] 2024-09-13T10:36:40.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.703+0000 7fa6b99a4640 10 monclient(hunting): picked mon.noname-f con 0x7fa6b40a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:40.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.704+0000 7fa6b99a4640 10 monclient(hunting): picked mon.noname-e con 0x7fa6b40a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:40.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.704+0000 7fa6b99a4640 10 monclient(hunting): picked mon.noname-d con 0x7fa6b413f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:40.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.704+0000 7fa6b99a4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6b40a4bc0 con 0x7fa6b40a6640 2024-09-13T10:36:40.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.704+0000 7fa6b99a4640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6b413a320 con 0x7fa6b413f750 2024-09-13T10:36:40.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.704+0000 7fa6b99a4640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6b40a8100 con 0x7fa6b40a8340 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.704+0000 7fa6b99a4640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.704+0000 7fa6b99a4640 10 monclient(hunting): authenticate will time out at 1140.210058s 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.704+0000 7fa6b37fe640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7fa6b413f750 legacy=0x7fa6b4141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.704+0000 7fa6b27fc640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fa6b40a8340 0x7fa6b4139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:59716/0 (socket says 172.21.15.181:59716) 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.704+0000 7fa6b27fc640 1 -- 172.21.15.181:0/992166729 learned_addr learned my addr 172.21.15.181:0/992166729 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b27fc640 1 -- 172.21.15.181:0/992166729 >> v1:172.21.15.181:6793/0 conn(0x7fa6b40a8340 legacy=0x7fa6b4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b2ffd640 1 -- 172.21.15.181:0/992166729 >> v1:172.21.15.195:6789/0 conn(0x7fa6b40a6640 legacy=0x7fa6b4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 1 -- 172.21.15.181:0/992166729 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945383424 0 0) 0x7fa6b40a8100 con 0x7fa6b40a8340 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient(hunting): my global_id is 104723 2024-09-13T10:36:40.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 1 -- 172.21.15.181:0/992166729 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa69c003520 con 0x7fa6b40a8340 2024-09-13T10:36:40.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 1 -- 172.21.15.181:0/992166729 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3129286856 0 0) 0x7fa6b40a4bc0 con 0x7fa6b40a6640 2024-09-13T10:36:40.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient(hunting): my global_id is 56755 2024-09-13T10:36:40.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 1 -- 172.21.15.181:0/992166729 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6b40a8100 con 0x7fa6b40a6640 2024-09-13T10:36:40.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 1 -- 172.21.15.181:0/992166729 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3807459909 0 0) 0x7fa69c003520 con 0x7fa6b40a8340 2024-09-13T10:36:40.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 1 -- 172.21.15.181:0/992166729 >> v1:172.21.15.181:6792/0 conn(0x7fa6b413f750 legacy=0x7fa6b4141b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:36:40.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 1 -- 172.21.15.181:0/992166729 >> v1:172.21.15.195:6789/0 conn(0x7fa6b40a6640 legacy=0x7fa6b4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:36:40.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 1 monclient: found mon.noname-e 2024-09-13T10:36:40.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:40.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:36:40.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 1 -- 172.21.15.181:0/992166729 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b40a48e0 con 0x7fa6b40a8340 2024-09-13T10:36:40.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient: _finish_auth 0 2024-09-13T10:36:40.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:36:40.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:40.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 1 -- 172.21.15.181:0/992166729 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa6a4001ae0 con 0x7fa6b40a8340 2024-09-13T10:36:40.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.706+0000 7fa6b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b1ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b1ffb640 10 monclient: dump: 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.715 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b99a4640 5 monclient: authenticate success, global_id 104723 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b99a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b1ffb640 1 -- 172.21.15.181:0/992166729 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6a40048a0 con 0x7fa6b40a8340 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b1ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b1ffb640 1 -- 172.21.15.181:0/992166729 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa6a4004e50 con 0x7fa6b40a8340 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b99a4640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b99a4640 4 set_mon_vals no callback set 2024-09-13T10:36:40.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b1ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b1ffb640 10 monclient: dump: 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.717 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b99a4640 10 monclient: shutdown 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b99a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b99a4640 1 -- 172.21.15.181:0/992166729 >> v1:172.21.15.181:6793/0 conn(0x7fa6b40a8340 legacy=0x7fa6b4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b99a4640 1 -- 172.21.15.181:0/992166729 shutdown_connections 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b99a4640 1 -- 172.21.15.181:0/992166729 >> 172.21.15.181:0/992166729 conn(0x7fa6b4077170 msgr2=0x7fa6b40abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b99a4640 1 -- 172.21.15.181:0/992166729 shutdown_connections 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.707+0000 7fa6b99a4640 1 -- 172.21.15.181:0/992166729 wait complete. 2024-09-13T10:36:40.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.708+0000 7fa6b99a4640 10 monclient: build_initial_monmap 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.708+0000 7fa6b99a4640 10 monclient: monmap: 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:40.719 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:40.720 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:40.720 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:40.720 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.708+0000 7fa6b99a4640 1 Processor -- start 2024-09-13T10:36:40.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.708+0000 7fa6b99a4640 1 -- start start 2024-09-13T10:36:40.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.708+0000 7fa6b99a4640 10 monclient: init 2024-09-13T10:36:40.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b99a4640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:40.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b99a4640 10 monclient: _add_conns ranks=[7,5,3,6,4,0,8,2,1] 2024-09-13T10:36:40.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b99a4640 10 monclient(hunting): picked mon.noname-i con 0x7fa6b40a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:40.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b99a4640 10 monclient(hunting): picked mon.noname-h con 0x7fa6b413f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:40.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b99a4640 10 monclient(hunting): picked mon.noname-g con 0x7fa6b413ceb0 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:40.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b99a4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6b413d7f0 con 0x7fa6b413ceb0 2024-09-13T10:36:40.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b99a4640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6b4134f70 con 0x7fa6b413f750 2024-09-13T10:36:40.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b99a4640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6b4134c90 con 0x7fa6b40a8340 2024-09-13T10:36:40.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b99a4640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:40.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b99a4640 10 monclient(hunting): authenticate will time out at 1140.215242s 2024-09-13T10:36:40.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b2ffd640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7fa6b40a8340 0x7fa6b412f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:50526/0 (socket says 172.21.15.181:50526) 2024-09-13T10:36:40.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b27fc640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7fa6b413f750 0x7fa6b41d3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:39146/0 (socket says 172.21.15.181:39146) 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b2ffd640 1 -- 172.21.15.181:0/914885111 learned_addr learned my addr 172.21.15.181:0/914885111 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.709+0000 7fa6b37fe640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7fa6b413ceb0 0x7fa6b41d6e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:53846/0 (socket says 172.21.15.181:53846) 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa6b37fe640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.195:6790/0 conn(0x7fa6b413ceb0 legacy=0x7fa6b41d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa6b27fc640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.195:6791/0 conn(0x7fa6b413f750 legacy=0x7fa6b41d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa6b2ffd640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.195:6792/0 conn(0x7fa6b40a8340 legacy=0x7fa6b412f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3137408902 0 0) 0x7fa6b4134f70 con 0x7fa6b413f750 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): my global_id is 104549 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6a0003520 con 0x7fa6b413f750 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715935479 0 0) 0x7fa6b413d7f0 con 0x7fa6b413ceb0 2024-09-13T10:36:40.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): my global_id is 6429 2024-09-13T10:36:40.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6b4134f70 con 0x7fa6b413ceb0 2024-09-13T10:36:40.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1094627554 0 0) 0x7fa6b4134c90 con 0x7fa6b40a8340 2024-09-13T10:36:40.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): my global_id is 56599 2024-09-13T10:36:40.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6b413d7f0 con 0x7fa6b40a8340 2024-09-13T10:36:40.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3723969704 0 0) 0x7fa6a0003520 con 0x7fa6b413f750 2024-09-13T10:36:40.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa6b4134c90 con 0x7fa6b413f750 2024-09-13T10:36:40.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa6a4001a60 con 0x7fa6b413f750 2024-09-13T10:36:40.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:40.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:36:40.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): dump: 2024-09-13T10:36:40.729 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.729 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.729 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.729 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.729 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.729 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.729 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.711+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3061814923 0 0) 0x7fa6b413d7f0 con 0x7fa6b40a8340 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa6a0003520 con 0x7fa6b40a8340 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa6a8003610 con 0x7fa6b40a8340 2024-09-13T10:36:40.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient(hunting): dump: 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.731 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.732 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.732 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.732 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.732 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4057507341 0 0) 0x7fa6b4134f70 con 0x7fa6b413ceb0 2024-09-13T10:36:40.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa6b413d7f0 con 0x7fa6b413ceb0 2024-09-13T10:36:40.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa6ac004780 con 0x7fa6b413ceb0 2024-09-13T10:36:40.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:40.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:40.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient(hunting): dump: 2024-09-13T10:36:40.732 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.732 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3557141750 0 0) 0x7fa6b4134c90 con 0x7fa6b413f750 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.195:6792/0 conn(0x7fa6b40a8340 legacy=0x7fa6b412f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.195:6790/0 conn(0x7fa6b413ceb0 legacy=0x7fa6b41d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 1 monclient: found mon.h 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b413e350 con 0x7fa6b413f750 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient: _finish_auth 0 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa6b99a4640 5 monclient: authenticate success, global_id 104549 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa6b99a4640 10 monclient: _renew_subs 2024-09-13T10:36:40.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa6b99a4640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa6b99a4640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b412fe10 con 0x7fa6b413f750 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa6b99a4640 10 monclient: _renew_subs 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa6b99a4640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa6b99a4640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa6b41d8570 con 0x7fa6b413f750 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6a4001d30 con 0x7fa6b413f750 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa6a40048a0 con 0x7fa6b413f750 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa6b17fa640 4 set_mon_vals no callback set 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.712+0000 7fa69bfff640 10 monclient: dump: 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.735 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.713+0000 7fa6b99a4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:40.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.713+0000 7fa6b99a4640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa6940065c0 con 0x7fa694002860 2024-09-13T10:36:40.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.713+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa6a4011ba0 con 0x7fa6b413f750 2024-09-13T10:36:40.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.713+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(201..201 src has 1..201) ==== 3898+0+0 (unknown 4008361621 0 0) 0x7fa6a404e360 con 0x7fa6b413f750 2024-09-13T10:36:40.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.713+0000 7fa6b37fe640 10 monclient: get_auth_request con 0x7fa6a0040600 auth_method 0 2024-09-13T10:36:40.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa6b2ffd640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.181:6793/0 conn(0x7fa694002860 legacy=0x7fa694004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472010180 0 0) 0x7fa6940065c0 con 0x7fa694002860 2024-09-13T10:36:40.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 10 monclient(hunting): my global_id is 104732 2024-09-13T10:36:40.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6b4134c90 con 0x7fa694002860 2024-09-13T10:36:40.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1240630651 0 0) 0x7fa6b4134c90 con 0x7fa694002860 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa6940065c0 con 0x7fa694002860 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa6a8003de0 con 0x7fa694002860 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 10 monclient: dump: 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.738 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1856352310 0 0) 0x7fa6940065c0 con 0x7fa694002860 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa69400a160 con 0x7fa694002860 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.715+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa6a8004170 con 0x7fa694002860 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.716+0000 7fa69bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.716+0000 7fa69bfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.716+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.181:6793/0 conn(0x7fa694002860 legacy=0x7fa694004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.716+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.181:6793/0 conn(0x7fa694002860 legacy=0x7fa694004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.721+0000 7fa6b99a4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:40.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.722+0000 7fa6b99a4640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa694009e50 con 0x7fa694009110 2024-09-13T10:36:40.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa6b2ffd640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.181:6793/0 conn(0x7fa694009110 legacy=0x7fa6940095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645933708 0 0) 0x7fa694009e50 con 0x7fa694009110 2024-09-13T10:36:40.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 10 monclient(hunting): my global_id is 104741 2024-09-13T10:36:40.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6940065c0 con 0x7fa694009110 2024-09-13T10:36:40.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2509100448 0 0) 0x7fa6940065c0 con 0x7fa694009110 2024-09-13T10:36:40.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa694009e50 con 0x7fa694009110 2024-09-13T10:36:40.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa6a8005b80 con 0x7fa694009110 2024-09-13T10:36:40.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 10 monclient: dump: 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.742 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.743 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.743 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.743 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.743 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.743 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1331631677 0 0) 0x7fa694009e50 con 0x7fa694009110 2024-09-13T10:36:40.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.724+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa69400c3a0 con 0x7fa694009110 2024-09-13T10:36:40.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7537 (unknown 0 0 2496254385) 0x7fa6a8005e90 con 0x7fa694009110 2024-09-13T10:36:40.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa69bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:40.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa69bfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:40.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.181:6793/0 conn(0x7fa694009110 legacy=0x7fa6940095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa69bfff640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.181:6793/0 conn(0x7fa694009110 legacy=0x7fa6940095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:40.744 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:40.744 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:40.744 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:40.744 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:40.744 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 108, 2024-09-13T10:36:40.744 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 84428, 2024-09-13T10:36:40.744 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:40.744 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:40.744 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:40.744 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:40.744 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:40.745 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:40.746 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:40.746 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:40.746 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:40.746 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:40.746 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:40.746 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.746 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:40.746 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:40.746 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:40.746 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:40.746 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:40.746 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:40.747 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:40.748 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:40.748 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:40.748 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:40.748 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:40.748 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:40.748 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:40.748 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:40.748 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:40.748 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:40.748 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:40.748 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:40.748 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:40.749 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:40.750 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:40.751 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.752 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:40.754 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:40.755 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.758 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.759 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:40.761 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.762 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.763 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:40.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.763 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:40.763 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:40.763 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:40.763 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.763 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.763 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:40.763 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:40.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa6b99a4640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa6a0040600 legacy=0x7fa6a0042ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa6b99a4640 10 monclient: shutdown 2024-09-13T10:36:40.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa6b99a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:40.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa6b99a4640 1 -- 172.21.15.181:0/914885111 >> v1:172.21.15.195:6791/0 conn(0x7fa6b413f750 legacy=0x7fa6b41d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa6b37fe640 1 -- 172.21.15.181:0/914885111 reap_dead start 2024-09-13T10:36:40.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa6b37fe640 1 -- 172.21.15.181:0/914885111 reap_dead start 2024-09-13T10:36:40.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa6b99a4640 1 -- 172.21.15.181:0/914885111 shutdown_connections 2024-09-13T10:36:40.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa6b99a4640 1 -- 172.21.15.181:0/914885111 >> 172.21.15.181:0/914885111 conn(0x7fa6b40a6640 msgr2=0x7fa6b40a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:40.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa6b99a4640 1 -- 172.21.15.181:0/914885111 shutdown_connections 2024-09-13T10:36:40.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.725+0000 7fa6b99a4640 1 -- 172.21.15.181:0/914885111 wait complete. 2024-09-13T10:36:40.765 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-13T10:36:40.766 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon f 2024-09-13T10:36:40.766 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:36:40.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.862+0000 7fb572f07640 10 monclient: get_monmap_and_config 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.862+0000 7fb572f07640 10 monclient: build_initial_monmap 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.862+0000 7fb572f07640 10 monclient: monmap: 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:40.863817+0000 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:40.863817+0000 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:40.866 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.862+0000 7fb572f07640 1 Processor -- start 2024-09-13T10:36:40.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.862+0000 7fb572f07640 1 -- start start 2024-09-13T10:36:40.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.862+0000 7fb572f07640 10 monclient: init 2024-09-13T10:36:40.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.863+0000 7fb572f07640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:40.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.863+0000 7fb572f07640 10 monclient: _add_conns ranks=[8,1,7,0,2,6,3,5,4] 2024-09-13T10:36:40.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.863+0000 7fb572f07640 10 monclient(hunting): picked mon.noname-e con 0x7fb56c070b10 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:40.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.863+0000 7fb572f07640 10 monclient(hunting): picked mon.noname-f con 0x7fb56c071600 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:40.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.863+0000 7fb572f07640 10 monclient(hunting): picked mon.noname-i con 0x7fb56c13cbe0 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:40.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.863+0000 7fb572f07640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56c0a1cc0 con 0x7fb56c071600 2024-09-13T10:36:40.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.863+0000 7fb572f07640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56c0722b0 con 0x7fb56c13cbe0 2024-09-13T10:36:40.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.863+0000 7fb572f07640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56c072590 con 0x7fb56c070b10 2024-09-13T10:36:40.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.863+0000 7fb572f07640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:40.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.863+0000 7fb572f07640 10 monclient(hunting): authenticate will time out at 1140.369510s 2024-09-13T10:36:40.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.863+0000 7fb570ca3640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fb56c070b10 0x7fb56c070ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:59736/0 (socket says 172.21.15.181:59736) 2024-09-13T10:36:40.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.863+0000 7fb570ca3640 1 -- 172.21.15.181:0/2401839869 learned_addr learned my addr 172.21.15.181:0/2401839869 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:40.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.865+0000 7fb570ca3640 1 -- 172.21.15.181:0/2401839869 >> v1:172.21.15.181:6793/0 conn(0x7fb56c070b10 legacy=0x7fb56c070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.865+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 834088245 0 0) 0x7fb56c072590 con 0x7fb56c070b10 2024-09-13T10:36:40.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.865+0000 7fb56bfff640 1 -- 172.21.15.181:0/2401839869 >> v1:172.21.15.195:6789/0 conn(0x7fb56c071600 legacy=0x7fb56c13b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient(hunting): my global_id is 104750 2024-09-13T10:36:40.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb55c003520 con 0x7fb56c070b10 2024-09-13T10:36:40.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb5714a4640 1 -- 172.21.15.181:0/2401839869 >> v1:172.21.15.195:6792/0 conn(0x7fb56c13cbe0 legacy=0x7fb56c13efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 696240749 0 0) 0x7fb56c0a1cc0 con 0x7fb56c071600 2024-09-13T10:36:40.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient(hunting): my global_id is 56764 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb56c072590 con 0x7fb56c071600 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 64803176 0 0) 0x7fb56c0722b0 con 0x7fb56c13cbe0 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient(hunting): my global_id is 56608 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb56c0a1cc0 con 0x7fb56c13cbe0 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 163906538 0 0) 0x7fb55c003520 con 0x7fb56c070b10 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 >> v1:172.21.15.195:6792/0 conn(0x7fb56c13cbe0 legacy=0x7fb56c13efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 >> v1:172.21.15.195:6789/0 conn(0x7fb56c071600 legacy=0x7fb56c13b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:36:40.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 monclient: found mon.noname-e 2024-09-13T10:36:40.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:40.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:36:40.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c072870 con 0x7fb56c070b10 2024-09-13T10:36:40.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:36:40.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:36:40.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:40.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb560001ae0 con 0x7fb56c070b10 2024-09-13T10:36:40.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb572f07640 5 monclient: authenticate success, global_id 104750 2024-09-13T10:36:40.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb572f07640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:40.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:40.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient: dump: 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.876 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.877 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.877 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.877 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb572f07640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:40.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5600048a0 con 0x7fb56c070b10 2024-09-13T10:36:40.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:40.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb572f07640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:40.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 1 -- 172.21.15.181:0/2401839869 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb560004e10 con 0x7fb56c070b10 2024-09-13T10:36:40.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb572f07640 4 set_mon_vals no callback set 2024-09-13T10:36:40.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:40.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb56b7fe640 10 monclient: dump: 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.878 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb572f07640 10 monclient: shutdown 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb572f07640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb572f07640 1 -- 172.21.15.181:0/2401839869 >> v1:172.21.15.181:6793/0 conn(0x7fb56c070b10 legacy=0x7fb56c070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb572f07640 1 -- 172.21.15.181:0/2401839869 shutdown_connections 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb572f07640 1 -- 172.21.15.181:0/2401839869 >> 172.21.15.181:0/2401839869 conn(0x7fb56c0a45b0 msgr2=0x7fb56c0a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb572f07640 1 -- 172.21.15.181:0/2401839869 shutdown_connections 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.866+0000 7fb572f07640 1 -- 172.21.15.181:0/2401839869 wait complete. 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.867+0000 7fb572f07640 10 monclient: build_initial_monmap 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.867+0000 7fb572f07640 10 monclient: monmap: 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:40.879 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:40.880 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.867+0000 7fb572f07640 1 Processor -- start 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.867+0000 7fb572f07640 1 -- start start 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.867+0000 7fb572f07640 10 monclient: init 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb572f07640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb572f07640 10 monclient: _add_conns ranks=[2,0,5,1,3,6,7,8,4] 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb572f07640 10 monclient(hunting): picked mon.noname-b con 0x7fb56c070b10 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb572f07640 10 monclient(hunting): picked mon.noname-a con 0x7fb56c071600 addr v1:172.21.15.181:6789/0 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb572f07640 10 monclient(hunting): picked mon.noname-h con 0x7fb56c13cbe0 addr v1:172.21.15.195:6791/0 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb572f07640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56c0a7170 con 0x7fb56c071600 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb570ca3640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fb56c070b10 legacy=0x7fb56c13aad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb572f07640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56c127140 con 0x7fb56c070b10 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb572f07640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56c128c00 con 0x7fb56c13cbe0 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb572f07640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:40.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb572f07640 10 monclient(hunting): authenticate will time out at 1140.374549s 2024-09-13T10:36:40.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb56bfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb56c071600 0x7fb56c1d3140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:42854/0 (socket says 172.21.15.181:42854) 2024-09-13T10:36:40.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.868+0000 7fb56bfff640 1 -- 172.21.15.181:0/2394948300 learned_addr learned my addr 172.21.15.181:0/2394948300 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:40.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.870+0000 7fb56bfff640 1 -- 172.21.15.181:0/2394948300 >> v1:172.21.15.181:6789/0 conn(0x7fb56c071600 legacy=0x7fb56c1d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.870+0000 7fb5714a4640 1 -- 172.21.15.181:0/2394948300 >> v1:172.21.15.195:6791/0 conn(0x7fb56c13cbe0 legacy=0x7fb56c1d6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006422259 0 0) 0x7fb56c0a7170 con 0x7fb56c071600 2024-09-13T10:36:40.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): my global_id is 114327 2024-09-13T10:36:40.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb550003550 con 0x7fb56c071600 2024-09-13T10:36:40.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372359226 0 0) 0x7fb56c128c00 con 0x7fb56c13cbe0 2024-09-13T10:36:40.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): my global_id is 104558 2024-09-13T10:36:40.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb56c0a7170 con 0x7fb56c13cbe0 2024-09-13T10:36:40.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 78040648 0 0) 0x7fb550003550 con 0x7fb56c071600 2024-09-13T10:36:40.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb56c128c00 con 0x7fb56c071600 2024-09-13T10:36:40.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb558003610 con 0x7fb56c071600 2024-09-13T10:36:40.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:40.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:36:40.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): dump: 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.890 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 504906375 0 0) 0x7fb56c0a7170 con 0x7fb56c13cbe0 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb550003550 con 0x7fb56c13cbe0 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb564002070 con 0x7fb56c13cbe0 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient(hunting): dump: 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.891 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 289451317 0 0) 0x7fb56c128c00 con 0x7fb56c071600 2024-09-13T10:36:40.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 >> v1:172.21.15.195:6791/0 conn(0x7fb56c13cbe0 legacy=0x7fb56c1d6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 >> v1:172.21.15.181:6790/0 conn(0x7fb56c070b10 legacy=0x7fb56c13aad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient: _finish_hunting 0 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 monclient: found mon.a 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c127ca0 con 0x7fb56c071600 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient: _finish_auth 0 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient: _check_auth_tickets 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb572f07640 5 monclient: authenticate success, global_id 114327 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb572f07640 10 monclient: _renew_subs 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb572f07640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:40.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb572f07640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb56c13b1e0 con 0x7fb56c071600 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb572f07640 10 monclient: _renew_subs 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb572f07640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb572f07640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb56c1cde00 con 0x7fb56c071600 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb558003b60 con 0x7fb56c071600 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb5580040d0 con 0x7fb56c071600 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb56affd640 4 set_mon_vals no callback set 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.871+0000 7fb5697fa640 10 monclient: dump: 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.894 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.872+0000 7fb572f07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.872+0000 7fb572f07640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb54c0065c0 con 0x7fb54c002860 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.872+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb5580042f0 con 0x7fb56c071600 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.872+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(201..201 src has 1..201) ==== 3898+0+0 (unknown 4008361621 0 0) 0x7fb55804e480 con 0x7fb56c071600 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.872+0000 7fb5714a4640 10 monclient: get_auth_request con 0x7fb5500400e0 auth_method 0 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.874+0000 7fb570ca3640 1 -- 172.21.15.181:0/2394948300 >> v1:172.21.15.195:6789/0 conn(0x7fb54c002860 legacy=0x7fb54c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.874+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124711902 0 0) 0x7fb54c0065c0 con 0x7fb54c002860 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.874+0000 7fb5697fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.874+0000 7fb5697fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.874+0000 7fb5697fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.874+0000 7fb5697fa640 10 monclient(hunting): my global_id is 56773 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.874+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb56c128c00 con 0x7fb54c002860 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2591102449 0 0) 0x7fb56c128c00 con 0x7fb54c002860 2024-09-13T10:36:40.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb54c0065c0 con 0x7fb54c002860 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb560004dd0 con 0x7fb54c002860 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 10 monclient: dump: 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.897 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1383510829 0 0) 0x7fb54c0065c0 con 0x7fb54c002860 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb54c00a160 con 0x7fb54c002860 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb560001d30 con 0x7fb54c002860 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 >> v1:172.21.15.195:6789/0 conn(0x7fb54c002860 legacy=0x7fb54c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.875+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 >> v1:172.21.15.195:6789/0 conn(0x7fb54c002860 legacy=0x7fb54c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.881+0000 7fb572f07640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.881+0000 7fb572f07640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb54c009e30 con 0x7fb54c009110 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb570ca3640 1 -- 172.21.15.181:0/2394948300 >> v1:172.21.15.195:6789/0 conn(0x7fb54c009110 legacy=0x7fb54c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144386533 0 0) 0x7fb54c009e30 con 0x7fb54c009110 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 10 monclient(hunting): _negotiate 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 10 monclient(hunting): my global_id is 56782 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb54c0065c0 con 0x7fb54c009110 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 60572084 0 0) 0x7fb54c0065c0 con 0x7fb54c009110 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb54c009e30 con 0x7fb54c009110 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb560005150 con 0x7fb54c009110 2024-09-13T10:36:40.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 10 monclient: dump: 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:40.900 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:40.901 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:40.901 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:40.901 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:40.901 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:40.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 603036450 0 0) 0x7fb54c009e30 con 0x7fb54c009110 2024-09-13T10:36:40.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb54c00c3f0 con 0x7fb54c009110 2024-09-13T10:36:40.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7705 (unknown 0 0 3636997128) 0x7fb560007e30 con 0x7fb54c009110 2024-09-13T10:36:40.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:40.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:40.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 >> v1:172.21.15.195:6789/0 conn(0x7fb54c009110 legacy=0x7fb54c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5697fa640 1 -- 172.21.15.181:0/2394948300 >> v1:172.21.15.195:6789/0 conn(0x7fb54c009110 legacy=0x7fb54c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:40.902 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 108, 2024-09-13T10:36:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 415294, 2024-09-13T10:36:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:40.902 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:40.903 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:40.904 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:40.905 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:40.906 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:40.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.908 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:40.909 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.910 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.911 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:40.914 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:40.915 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:40.916 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.917 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:40.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:40.920 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:40.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:40.922 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:40.922 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:40.922 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:36:40.922 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:40.922 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:40.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:40.922 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:40.922 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb572f07640 1 -- 172.21.15.181:0/2394948300 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb5500400e0 legacy=0x7fb5500425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb572f07640 10 monclient: shutdown 2024-09-13T10:36:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb572f07640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb572f07640 1 -- 172.21.15.181:0/2394948300 >> v1:172.21.15.181:6789/0 conn(0x7fb56c071600 legacy=0x7fb56c1d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5714a4640 1 -- 172.21.15.181:0/2394948300 reap_dead start 2024-09-13T10:36:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb5714a4640 1 -- 172.21.15.181:0/2394948300 reap_dead start 2024-09-13T10:36:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb572f07640 1 -- 172.21.15.181:0/2394948300 shutdown_connections 2024-09-13T10:36:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb572f07640 1 -- 172.21.15.181:0/2394948300 >> 172.21.15.181:0/2394948300 conn(0x7fb56c0a45b0 msgr2=0x7fb56c0a6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb572f07640 1 -- 172.21.15.181:0/2394948300 shutdown_connections 2024-09-13T10:36:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:40.885+0000 7fb572f07640 1 -- 172.21.15.181:0/2394948300 wait complete. 2024-09-13T10:36:40.924 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-13T10:36:40.924 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon g 2024-09-13T10:36:40.924 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:36:41.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.022+0000 7f1e2bac8640 10 monclient: get_monmap_and_config 2024-09-13T10:36:41.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.022+0000 7f1e2bac8640 10 monclient: build_initial_monmap 2024-09-13T10:36:41.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.022+0000 7f1e2bac8640 10 monclient: monmap: 2024-09-13T10:36:41.024 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:41.023636+0000 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:41.023636+0000 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:41.025 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:41.026 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:41.026 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.022+0000 7f1e2bac8640 1 Processor -- start 2024-09-13T10:36:41.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.022+0000 7f1e2bac8640 1 -- start start 2024-09-13T10:36:41.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.022+0000 7f1e2bac8640 10 monclient: init 2024-09-13T10:36:41.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e2bac8640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:41.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e2bac8640 10 monclient: _add_conns ranks=[2,8,1,4,3,6,0,5,7] 2024-09-13T10:36:41.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e2bac8640 10 monclient(hunting): picked mon.noname-b con 0x7f1e240a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:41.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e2bac8640 10 monclient(hunting): picked mon.noname-e con 0x7f1e240a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:41.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e2bac8640 10 monclient(hunting): picked mon.noname-f con 0x7f1e2413f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:41.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e2bac8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e240a4bc0 con 0x7f1e2413f750 2024-09-13T10:36:41.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e2bac8640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e2413a320 con 0x7f1e240a6640 2024-09-13T10:36:41.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e2bac8640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e240a8100 con 0x7f1e240a8340 2024-09-13T10:36:41.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e2bac8640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:41.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e2bac8640 10 monclient(hunting): authenticate will time out at 1140.529307s 2024-09-13T10:36:41.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e29864640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f1e240a6640 legacy=0x7f1e24139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:41.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e29063640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f1e240a8340 0x7f1e24139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:59750/0 (socket says 172.21.15.181:59750) 2024-09-13T10:36:41.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.023+0000 7f1e29063640 1 -- 172.21.15.181:0/4278993052 learned_addr learned my addr 172.21.15.181:0/4278993052 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:41.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.025+0000 7f1e29063640 1 -- 172.21.15.181:0/4278993052 >> v1:172.21.15.181:6793/0 conn(0x7f1e240a8340 legacy=0x7f1e24139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.025+0000 7f1e2a065640 1 -- 172.21.15.181:0/4278993052 >> v1:172.21.15.195:6789/0 conn(0x7f1e2413f750 legacy=0x7f1e24141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 1 -- 172.21.15.181:0/4278993052 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999390449 0 0) 0x7f1e240a4bc0 con 0x7f1e2413f750 2024-09-13T10:36:41.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient(hunting): my global_id is 56791 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 1 -- 172.21.15.181:0/4278993052 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e10003520 con 0x7f1e2413f750 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 1 -- 172.21.15.181:0/4278993052 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2040204793 0 0) 0x7f1e10003520 con 0x7f1e2413f750 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 1 -- 172.21.15.181:0/4278993052 >> v1:172.21.15.181:6793/0 conn(0x7f1e240a8340 legacy=0x7f1e24139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 1 -- 172.21.15.181:0/4278993052 >> v1:172.21.15.181:6790/0 conn(0x7f1e240a6640 legacy=0x7f1e24139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient: _finish_hunting 0 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 1 monclient: found mon.noname-f 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 1 -- 172.21.15.181:0/4278993052 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e240a48e0 con 0x7f1e2413f750 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient: _finish_auth 0 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient: _check_auth_tickets 2024-09-13T10:36:41.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 1 -- 172.21.15.181:0/4278993052 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1e1c001eb0 con 0x7f1e2413f750 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient: dump: 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.075 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 1 -- 172.21.15.181:0/4278993052 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e1c003990 con 0x7f1e2413f750 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 1 -- 172.21.15.181:0/4278993052 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1e1c003f00 con 0x7f1e2413f750 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:36:41.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.070+0000 7f1e28862640 10 monclient: dump: 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.077 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.078 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.078 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.071+0000 7f1e2bac8640 5 monclient: authenticate success, global_id 56791 2024-09-13T10:36:41.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.071+0000 7f1e2bac8640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:41.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.071+0000 7f1e2bac8640 4 set_mon_vals no callback set 2024-09-13T10:36:41.080 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:41.080 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38734]: starting. 2024-09-13T10:36:41.080 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38734]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38696 2024-09-13T10:36:41.080 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38734]: shutting down. 2024-09-13T10:36:41.080 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:41.080 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:41.080 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:36:41.081 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:36:41.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.071+0000 7f1e2bac8640 10 monclient: shutdown 2024-09-13T10:36:41.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.071+0000 7f1e2bac8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:41.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.071+0000 7f1e2bac8640 1 -- 172.21.15.181:0/4278993052 >> v1:172.21.15.195:6789/0 conn(0x7f1e2413f750 legacy=0x7f1e24141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.072+0000 7f1e2bac8640 1 -- 172.21.15.181:0/4278993052 shutdown_connections 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.072+0000 7f1e2bac8640 1 -- 172.21.15.181:0/4278993052 >> 172.21.15.181:0/4278993052 conn(0x7f1e24077170 msgr2=0x7f1e240abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.072+0000 7f1e2bac8640 1 -- 172.21.15.181:0/4278993052 shutdown_connections 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.072+0000 7f1e2bac8640 1 -- 172.21.15.181:0/4278993052 wait complete. 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.072+0000 7f1e2bac8640 10 monclient: build_initial_monmap 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.072+0000 7f1e2bac8640 10 monclient: monmap: 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:41.087 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:41.088 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 1 Processor -- start 2024-09-13T10:36:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 1 -- start start 2024-09-13T10:36:41.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 10 monclient: init 2024-09-13T10:36:41.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:41.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 10 monclient: _add_conns ranks=[2,1,4,7,0,3,6,5,8] 2024-09-13T10:36:41.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 10 monclient(hunting): picked mon.noname-b con 0x7f1e240a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:41.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 10 monclient(hunting): picked mon.noname-f con 0x7f1e2413f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:36:41.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 10 monclient(hunting): picked mon.noname-c con 0x7f1e241d4520 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:41.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e240a0fb0 con 0x7f1e2413f750 2024-09-13T10:36:41.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e241cf0f0 con 0x7f1e240a8340 2024-09-13T10:36:41.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e240a1290 con 0x7f1e241d4520 2024-09-13T10:36:41.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:41.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2bac8640 10 monclient(hunting): authenticate will time out at 1140.579545s 2024-09-13T10:36:41.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e29864640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f1e240a8340 legacy=0x7f1e241ce2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:41.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2a065640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f1e241d4520 0x7f1e241d6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53712/0 (socket says 172.21.15.181:53712) 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e2a065640 1 -- 172.21.15.181:0/939591349 learned_addr learned my addr 172.21.15.181:0/939591349 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.073+0000 7f1e29063640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f1e2413f750 0x7f1e241ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:35368/0 (socket says 172.21.15.181:35368) 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.075+0000 7f1e2a065640 1 -- 172.21.15.181:0/939591349 >> v1:172.21.15.181:6791/0 conn(0x7f1e241d4520 legacy=0x7f1e241d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.075+0000 7f1e29063640 1 -- 172.21.15.181:0/939591349 >> v1:172.21.15.195:6789/0 conn(0x7f1e2413f750 legacy=0x7f1e241ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.075+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2241620394 0 0) 0x7f1e240a1290 con 0x7f1e241d4520 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.075+0000 7f1e1a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.075+0000 7f1e1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.075+0000 7f1e1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.075+0000 7f1e1a7fc640 10 monclient(hunting): my global_id is 114304 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.075+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e08003550 con 0x7f1e241d4520 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1946939103 0 0) 0x7f1e240a0fb0 con 0x7f1e2413f750 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient(hunting): my global_id is 56800 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e240a1290 con 0x7f1e2413f750 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1642291650 0 0) 0x7f1e08003550 con 0x7f1e241d4520 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e240a0fb0 con 0x7f1e241d4520 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1e1c003e80 con 0x7f1e241d4520 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient(hunting): dump: 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.091 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:41.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 271857354 0 0) 0x7f1e240a1290 con 0x7f1e2413f750 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e08003550 con 0x7f1e2413f750 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1e14001d00 con 0x7f1e2413f750 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient(hunting): dump: 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.093 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3667214144 0 0) 0x7f1e240a0fb0 con 0x7f1e241d4520 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 >> v1:172.21.15.181:6790/0 conn(0x7f1e240a8340 legacy=0x7f1e241ce2d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 >> v1:172.21.15.195:6789/0 conn(0x7f1e2413f750 legacy=0x7f1e241ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 monclient: found mon.c 2024-09-13T10:36:41.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e240aa370 con 0x7f1e241d4520 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e2bac8640 5 monclient: authenticate success, global_id 114304 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e2bac8640 10 monclient: _renew_subs 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e2bac8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e2bac8640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1e240a0420 con 0x7f1e241d4520 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e2bac8640 10 monclient: _renew_subs 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e2bac8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e2bac8640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f1e2409fd60 con 0x7f1e241d4520 2024-09-13T10:36:41.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e1c001ef0 con 0x7f1e241d4520 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1e1c004610 con 0x7f1e241d4520 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1bfff640 4 set_mon_vals no callback set 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.076+0000 7f1e1a7fc640 10 monclient: dump: 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.096 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.077+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1e1c012020 con 0x7f1e241d4520 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.077+0000 7f1e2bac8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.077+0000 7f1e2bac8640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1e0c0065c0 con 0x7f1e0c002860 2024-09-13T10:36:41.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.077+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(202..202 src has 1..202) ==== 3506+0+0 (unknown 3606230649 0 0) 0x7f1e1c04e600 con 0x7f1e241d4520 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.077+0000 7f1e29063640 10 monclient: get_auth_request con 0x7f1e08040040 auth_method 0 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.079+0000 7f1e29864640 1 -- 172.21.15.181:0/939591349 >> v1:172.21.15.195:6790/0 conn(0x7f1e0c002860 legacy=0x7f1e0c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426599296 0 0) 0x7f1e0c0065c0 con 0x7f1e0c002860 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 10 monclient(hunting): my global_id is 6438 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e240a0fb0 con 0x7f1e0c002860 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1097557584 0 0) 0x7f1e240a0fb0 con 0x7f1e0c002860 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e0c0065c0 con 0x7f1e0c002860 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1e20004480 con 0x7f1e0c002860 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 10 monclient: dump: 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.099 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.100 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 728483265 0 0) 0x7f1e0c0065c0 con 0x7f1e0c002860 2024-09-13T10:36:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e0c00a160 con 0x7f1e0c002860 2024-09-13T10:36:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1e20006740 con 0x7f1e0c002860 2024-09-13T10:36:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 >> v1:172.21.15.195:6790/0 conn(0x7f1e0c002860 legacy=0x7f1e0c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.080+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 >> v1:172.21.15.195:6790/0 conn(0x7f1e0c002860 legacy=0x7f1e0c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.086+0000 7f1e2bac8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.086+0000 7f1e2bac8640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1e0c009e70 con 0x7f1e0c009130 2024-09-13T10:36:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e29864640 1 -- 172.21.15.181:0/939591349 >> v1:172.21.15.195:6790/0 conn(0x7f1e0c009130 legacy=0x7f1e0c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1936656129 0 0) 0x7f1e0c009e70 con 0x7f1e0c009130 2024-09-13T10:36:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 10 monclient(hunting): my global_id is 6447 2024-09-13T10:36:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e0c0065c0 con 0x7f1e0c009130 2024-09-13T10:36:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1243064649 0 0) 0x7f1e0c0065c0 con 0x7f1e0c009130 2024-09-13T10:36:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e0c009e70 con 0x7f1e0c009130 2024-09-13T10:36:41.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1e20006030 con 0x7f1e0c009130 2024-09-13T10:36:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:36:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 10 monclient: dump: 2024-09-13T10:36:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.103 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2060827079 0 0) 0x7f1e0c009e70 con 0x7f1e0c009130 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1e0c00c410 con 0x7f1e0c009130 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7540 (unknown 0 0 3913880983) 0x7f1e200060b0 con 0x7f1e0c009130 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:41.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 >> v1:172.21.15.195:6790/0 conn(0x7f1e0c009130 legacy=0x7f1e0c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e1a7fc640 1 -- 172.21.15.181:0/939591349 >> v1:172.21.15.195:6790/0 conn(0x7f1e0c009130 legacy=0x7f1e0c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:41.105 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:36:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 108, 2024-09-13T10:36:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 415506, 2024-09-13T10:36:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:36:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:41.125 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:41.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e2bac8640 1 -- 172.21.15.181:0/939591349 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1e08040040 legacy=0x7f1e08042500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e2bac8640 10 monclient: shutdown 2024-09-13T10:36:41.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e2bac8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:41.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e2bac8640 1 -- 172.21.15.181:0/939591349 >> v1:172.21.15.181:6791/0 conn(0x7f1e241d4520 legacy=0x7f1e241d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e2a065640 1 -- 172.21.15.181:0/939591349 reap_dead start 2024-09-13T10:36:41.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e2a065640 1 -- 172.21.15.181:0/939591349 reap_dead start 2024-09-13T10:36:41.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e2bac8640 1 -- 172.21.15.181:0/939591349 shutdown_connections 2024-09-13T10:36:41.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e2bac8640 1 -- 172.21.15.181:0/939591349 >> 172.21.15.181:0/939591349 conn(0x7f1e240a6640 msgr2=0x7f1e24141f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:41.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e2bac8640 1 -- 172.21.15.181:0/939591349 shutdown_connections 2024-09-13T10:36:41.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.090+0000 7f1e2bac8640 1 -- 172.21.15.181:0/939591349 wait complete. 2024-09-13T10:36:41.128 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-13T10:36:41.128 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon h 2024-09-13T10:36:41.128 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:36:41.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.225+0000 7f1c77e57640 10 monclient: get_monmap_and_config 2024-09-13T10:36:41.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.225+0000 7f1c77e57640 10 monclient: build_initial_monmap 2024-09-13T10:36:41.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.225+0000 7f1c77e57640 10 monclient: monmap: 2024-09-13T10:36:41.228 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:41.228 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:41.227196+0000 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:41.227196+0000 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:41.229 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:41.230 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.226+0000 7f1c77e57640 1 Processor -- start 2024-09-13T10:36:41.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.226+0000 7f1c77e57640 1 -- start start 2024-09-13T10:36:41.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.226+0000 7f1c77e57640 10 monclient: init 2024-09-13T10:36:41.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.226+0000 7f1c77e57640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:41.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.226+0000 7f1c77e57640 10 monclient: _add_conns ranks=[2,6,4,8,5,7,3,0,1] 2024-09-13T10:36:41.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.226+0000 7f1c77e57640 10 monclient(hunting): picked mon.noname-b con 0x7f1c700a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:36:41.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.226+0000 7f1c77e57640 10 monclient(hunting): picked mon.noname-d con 0x7f1c700a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:36:41.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.226+0000 7f1c77e57640 10 monclient(hunting): picked mon.noname-c con 0x7f1c7013f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:41.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.226+0000 7f1c77e57640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c700a5fe0 con 0x7f1c700a66d0 2024-09-13T10:36:41.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.226+0000 7f1c753f2640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f1c700a6ab0 legacy=0x7f1c700a6ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:36:41.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.226+0000 7f1c75bf3640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f1c700a66d0 legacy=0x7f1c700a53b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.226+0000 7f1c77e57640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c700a8080 con 0x7f1c7013f9a0 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.227+0000 7f1c77e57640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c700a42c0 con 0x7f1c700a6ab0 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.227+0000 7f1c77e57640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.227+0000 7f1c77e57640 10 monclient(hunting): authenticate will time out at 1140.733040s 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.227+0000 7f1c763f4640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f1c7013f9a0 0x7f1c70141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53722/0 (socket says 172.21.15.181:53722) 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.227+0000 7f1c763f4640 1 -- 172.21.15.181:0/1286990352 learned_addr learned my addr 172.21.15.181:0/1286990352 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c763f4640 1 -- 172.21.15.181:0/1286990352 >> v1:172.21.15.181:6791/0 conn(0x7f1c7013f9a0 legacy=0x7f1c70141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 1 -- 172.21.15.181:0/1286990352 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818853758 0 0) 0x7f1c700a8080 con 0x7f1c7013f9a0 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient(hunting): my global_id is 114340 2024-09-13T10:36:41.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 1 -- 172.21.15.181:0/1286990352 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c5c003520 con 0x7f1c7013f9a0 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 1 -- 172.21.15.181:0/1286990352 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1991411330 0 0) 0x7f1c5c003520 con 0x7f1c7013f9a0 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 1 -- 172.21.15.181:0/1286990352 >> v1:172.21.15.181:6792/0 conn(0x7f1c700a6ab0 legacy=0x7f1c700a6ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 1 -- 172.21.15.181:0/1286990352 >> v1:172.21.15.181:6790/0 conn(0x7f1c700a66d0 legacy=0x7f1c700a53b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient: _finish_hunting 0 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 1 monclient: found mon.noname-c 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 1 -- 172.21.15.181:0/1286990352 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c701464e0 con 0x7f1c7013f9a0 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient: _finish_auth 0 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient: _check_auth_tickets 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 1 -- 172.21.15.181:0/1286990352 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1c68001e60 con 0x7f1c7013f9a0 2024-09-13T10:36:41.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c77e57640 5 monclient: authenticate success, global_id 114340 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c77e57640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient: dump: 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.237 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c77e57640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 1 -- 172.21.15.181:0/1286990352 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c68004c20 con 0x7f1c7013f9a0 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 1 -- 172.21.15.181:0/1286990352 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1c680051d0 con 0x7f1c7013f9a0 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c77e57640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:41.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c77e57640 4 set_mon_vals no callback set 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.229+0000 7f1c74bf1640 10 monclient: dump: 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.239 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.230+0000 7f1c77e57640 10 monclient: shutdown 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.230+0000 7f1c77e57640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.230+0000 7f1c77e57640 1 -- 172.21.15.181:0/1286990352 >> v1:172.21.15.181:6791/0 conn(0x7f1c7013f9a0 legacy=0x7f1c70141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.230+0000 7f1c77e57640 1 -- 172.21.15.181:0/1286990352 shutdown_connections 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.230+0000 7f1c77e57640 1 -- 172.21.15.181:0/1286990352 >> 172.21.15.181:0/1286990352 conn(0x7f1c700abcd0 msgr2=0x7f1c700ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.230+0000 7f1c77e57640 1 -- 172.21.15.181:0/1286990352 shutdown_connections 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.230+0000 7f1c77e57640 1 -- 172.21.15.181:0/1286990352 wait complete. 2024-09-13T10:36:41.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.230+0000 7f1c77e57640 10 monclient: build_initial_monmap 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.230+0000 7f1c77e57640 10 monclient: monmap: 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:41.241 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 1 Processor -- start 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 1 -- start start 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 10 monclient: init 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 10 monclient: _add_conns ranks=[3,8,4,6,0,7,1,2,5] 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 10 monclient(hunting): picked mon.noname-g con 0x7f1c700a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 10 monclient(hunting): picked mon.noname-e con 0x7f1c700a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 10 monclient(hunting): picked mon.noname-c con 0x7f1c7013f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c7013ee30 con 0x7f1c700a66d0 2024-09-13T10:36:41.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c70142f40 con 0x7f1c7013f9a0 2024-09-13T10:36:41.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c7013cad0 con 0x7f1c700a6ab0 2024-09-13T10:36:41.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:41.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c77e57640 10 monclient(hunting): authenticate will time out at 1140.737773s 2024-09-13T10:36:41.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c763f4640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f1c7013f9a0 0x7f1c701d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53726/0 (socket says 172.21.15.181:53726) 2024-09-13T10:36:41.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c763f4640 1 -- 172.21.15.181:0/13711076 learned_addr learned my addr 172.21.15.181:0/13711076 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:41.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.231+0000 7f1c753f2640 1 --1- 172.21.15.181:0/13711076 >> v1:172.21.15.181:6793/0 conn(0x7f1c700a6ab0 0x7f1c7013b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:59760/0 (socket says 172.21.15.181:59760) 2024-09-13T10:36:41.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.233+0000 7f1c753f2640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.181:6793/0 conn(0x7f1c700a6ab0 legacy=0x7f1c7013b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.233+0000 7f1c763f4640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.181:6791/0 conn(0x7f1c7013f9a0 legacy=0x7f1c701d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2559403347 0 0) 0x7f1c70142f40 con 0x7f1c7013f9a0 2024-09-13T10:36:41.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): my global_id is 114349 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c54003520 con 0x7f1c7013f9a0 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2121045122 0 0) 0x7f1c7013cad0 con 0x7f1c700a6ab0 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): my global_id is 104786 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c70142f40 con 0x7f1c700a6ab0 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c75bf3640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.195:6790/0 conn(0x7f1c700a66d0 legacy=0x7f1c7013b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 648478088 0 0) 0x7f1c7013ee30 con 0x7f1c700a66d0 2024-09-13T10:36:41.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): my global_id is 6465 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c7013cad0 con 0x7f1c700a66d0 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2395649818 0 0) 0x7f1c54003520 con 0x7f1c7013f9a0 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c7013ee30 con 0x7f1c7013f9a0 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1c680020b0 con 0x7f1c7013f9a0 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): dump: 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.249 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1375566005 0 0) 0x7f1c70142f40 con 0x7f1c700a6ab0 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c54003520 con 0x7f1c700a6ab0 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1c600046a0 con 0x7f1c700a6ab0 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient(hunting): dump: 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.251 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2360261318 0 0) 0x7f1c7013ee30 con 0x7f1c7013f9a0 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.181:6793/0 conn(0x7f1c700a6ab0 legacy=0x7f1c7013b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.195:6790/0 conn(0x7f1c700a66d0 legacy=0x7f1c7013b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient: _finish_hunting 0 2024-09-13T10:36:41.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 monclient: found mon.c 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7013bf30 con 0x7f1c7013f9a0 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient: _finish_auth 0 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient: _check_auth_tickets 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c77e57640 5 monclient: authenticate success, global_id 114349 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c77e57640 10 monclient: _renew_subs 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c77e57640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c77e57640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7013eb50 con 0x7f1c7013f9a0 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c77e57640 10 monclient: _renew_subs 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c77e57640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:36:41.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c77e57640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f1c7013f5c0 con 0x7f1c7013f9a0 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c680053c0 con 0x7f1c7013f9a0 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1c68004c20 con 0x7f1c7013f9a0 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c67fff640 4 set_mon_vals no callback set 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.234+0000 7f1c667fc640 10 monclient: dump: 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.254 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.235+0000 7f1c77e57640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.235+0000 7f1c77e57640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1c580065c0 con 0x7f1c58002860 2024-09-13T10:36:41.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.235+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1c68011d90 con 0x7f1c7013f9a0 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.236+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(202..202 src has 1..202) ==== 3506+0+0 (unknown 3606230649 0 0) 0x7f1c6804e530 con 0x7f1c7013f9a0 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.236+0000 7f1c753f2640 10 monclient: get_auth_request con 0x7f1c540403c0 auth_method 0 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.237+0000 7f1c75bf3640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.195:6791/0 conn(0x7f1c58002860 legacy=0x7f1c58004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715255451 0 0) 0x7f1c580065c0 con 0x7f1c58002860 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 10 monclient(hunting): my global_id is 104567 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c7013ee30 con 0x7f1c58002860 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3848885197 0 0) 0x7f1c7013ee30 con 0x7f1c58002860 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c580065c0 con 0x7f1c58002860 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1c6c004d30 con 0x7f1c58002860 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 10 monclient: dump: 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.257 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1184056554 0 0) 0x7f1c580065c0 con 0x7f1c58002860 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.238+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c5800a160 con 0x7f1c58002860 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.239+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1c6c007070 con 0x7f1c58002860 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.239+0000 7f1c667fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.239+0000 7f1c667fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.239+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.195:6791/0 conn(0x7f1c58002860 legacy=0x7f1c58004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.239+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.195:6791/0 conn(0x7f1c58002860 legacy=0x7f1c58004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.245+0000 7f1c77e57640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:41.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.245+0000 7f1c77e57640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1c58009e50 con 0x7f1c58009110 2024-09-13T10:36:41.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.247+0000 7f1c75bf3640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.195:6791/0 conn(0x7f1c58009110 legacy=0x7f1c580095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.247+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4011101989 0 0) 0x7f1c58009e50 con 0x7f1c58009110 2024-09-13T10:36:41.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.247+0000 7f1c667fc640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.247+0000 7f1c667fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.247+0000 7f1c667fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.247+0000 7f1c667fc640 10 monclient(hunting): my global_id is 104576 2024-09-13T10:36:41.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.247+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c580065c0 con 0x7f1c58009110 2024-09-13T10:36:41.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 903348628 0 0) 0x7f1c580065c0 con 0x7f1c58009110 2024-09-13T10:36:41.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c58009e50 con 0x7f1c58009110 2024-09-13T10:36:41.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1c6c005730 con 0x7f1c58009110 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 10 monclient: dump: 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.261 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 827380640 0 0) 0x7f1c58009e50 con 0x7f1c58009110 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1c5800c3f0 con 0x7f1c58009110 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7704 (unknown 0 0 901587678) 0x7f1c6c00a070 con 0x7f1c58009110 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.195:6791/0 conn(0x7f1c58009110 legacy=0x7f1c580095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c667fc640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.195:6791/0 conn(0x7f1c58009110 legacy=0x7f1c580095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:41.263 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:41.263 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:41.263 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:41.263 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:41.263 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 108, 2024-09-13T10:36:41.263 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 84949, 2024-09-13T10:36:41.263 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:41.263 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:41.263 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:41.263 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:41.264 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:41.265 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:41.265 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:41.265 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:41.265 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:41.265 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:41.265 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:41.265 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:41.265 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.265 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:41.265 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:41.265 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:41.265 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:41.266 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:41.267 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:41.268 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:41.269 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.270 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.272 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.273 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:41.274 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.275 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.276 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:41.276 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:41.276 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.276 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.276 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.276 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:41.276 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.276 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.276 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.277 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:41.278 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.279 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.280 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.281 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:41.281 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:41.281 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.281 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.281 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.281 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.281 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.281 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:41.281 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:41.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.282 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:41.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.283 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:41.283 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:41.283 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:41.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.283 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.283 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:41.283 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:41.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c77e57640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1c540403c0 legacy=0x7f1c54042880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c77e57640 10 monclient: shutdown 2024-09-13T10:36:41.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c77e57640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:41.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c77e57640 1 -- 172.21.15.181:0/13711076 >> v1:172.21.15.181:6791/0 conn(0x7f1c7013f9a0 legacy=0x7f1c701d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c763f4640 1 -- 172.21.15.181:0/13711076 reap_dead start 2024-09-13T10:36:41.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c763f4640 1 -- 172.21.15.181:0/13711076 reap_dead start 2024-09-13T10:36:41.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c77e57640 1 -- 172.21.15.181:0/13711076 shutdown_connections 2024-09-13T10:36:41.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c77e57640 1 -- 172.21.15.181:0/13711076 >> 172.21.15.181:0/13711076 conn(0x7f1c700abcd0 msgr2=0x7f1c70145ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:41.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c77e57640 1 -- 172.21.15.181:0/13711076 shutdown_connections 2024-09-13T10:36:41.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.248+0000 7f1c77e57640 1 -- 172.21.15.181:0/13711076 wait complete. 2024-09-13T10:36:41.285 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-13T10:36:41.286 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon i 2024-09-13T10:36:41.286 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:36:41.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.382+0000 7f4a7cf44640 10 monclient: get_monmap_and_config 2024-09-13T10:36:41.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.382+0000 7f4a7cf44640 10 monclient: build_initial_monmap 2024-09-13T10:36:41.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.382+0000 7f4a7cf44640 10 monclient: monmap: 2024-09-13T10:36:41.389 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:41.389 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.389 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:36:41.384360+0000 2024-09-13T10:36:41.389 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:36:41.384360+0000 2024-09-13T10:36:41.389 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:41.389 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.390 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:41.390 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:41.390 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:41.391 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:41.391 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:41.392 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:41.393 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 1 Processor -- start 2024-09-13T10:36:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 1 -- start start 2024-09-13T10:36:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 10 monclient: init 2024-09-13T10:36:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 10 monclient: _add_conns ranks=[4,8,7,2,1,3,5,0,6] 2024-09-13T10:36:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 10 monclient(hunting): picked mon.noname-c con 0x7f4a780a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:41.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 10 monclient(hunting): picked mon.noname-e con 0x7f4a780a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 10 monclient(hunting): picked mon.noname-i con 0x7f4a7813f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a780a4bc0 con 0x7f4a780a6640 2024-09-13T10:36:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a7813a320 con 0x7f4a7813f750 2024-09-13T10:36:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a780a8100 con 0x7f4a780a8340 2024-09-13T10:36:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.383+0000 7f4a7cf44640 10 monclient(hunting): authenticate will time out at 1140.889982s 2024-09-13T10:36:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.384+0000 7f4a7659c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f4a780a6640 0x7f4a78139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53730/0 (socket says 172.21.15.181:53730) 2024-09-13T10:36:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.384+0000 7f4a7659c640 1 -- 172.21.15.181:0/434451577 learned_addr learned my addr 172.21.15.181:0/434451577 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.384+0000 7f4a6dd9b640 1 --1- 172.21.15.181:0/434451577 >> v1:172.21.15.181:6793/0 conn(0x7f4a780a8340 0x7f4a78139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:59770/0 (socket says 172.21.15.181:59770) 2024-09-13T10:36:41.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a7659c640 1 -- 172.21.15.181:0/434451577 >> v1:172.21.15.181:6791/0 conn(0x7f4a780a6640 legacy=0x7f4a78139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a6dd9b640 1 -- 172.21.15.181:0/434451577 >> v1:172.21.15.181:6793/0 conn(0x7f4a780a8340 legacy=0x7f4a78139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 1 -- 172.21.15.181:0/434451577 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1039271599 0 0) 0x7f4a780a4bc0 con 0x7f4a780a6640 2024-09-13T10:36:41.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient(hunting): my global_id is 114358 2024-09-13T10:36:41.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 1 -- 172.21.15.181:0/434451577 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a64003520 con 0x7f4a780a6640 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 1 -- 172.21.15.181:0/434451577 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4167852609 0 0) 0x7f4a780a8100 con 0x7f4a780a8340 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient(hunting): my global_id is 104795 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 1 -- 172.21.15.181:0/434451577 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a780a4bc0 con 0x7f4a780a8340 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a76d9d640 1 -- 172.21.15.181:0/434451577 >> v1:172.21.15.195:6792/0 conn(0x7f4a7813f750 legacy=0x7f4a78141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 1 -- 172.21.15.181:0/434451577 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3010860638 0 0) 0x7f4a780a4bc0 con 0x7f4a780a8340 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 1 -- 172.21.15.181:0/434451577 >> v1:172.21.15.195:6792/0 conn(0x7f4a7813f750 legacy=0x7f4a78141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 1 -- 172.21.15.181:0/434451577 >> v1:172.21.15.181:6791/0 conn(0x7f4a780a6640 legacy=0x7f4a78139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 1 monclient: found mon.noname-e 2024-09-13T10:36:41.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 1 -- 172.21.15.181:0/434451577 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a780a48e0 con 0x7f4a780a8340 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient: _finish_auth 0 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a7cf44640 5 monclient: authenticate success, global_id 104795 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 1 -- 172.21.15.181:0/434451577 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a60001ac0 con 0x7f4a780a8340 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a7cf44640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient: dump: 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.404 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.405 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a7cf44640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:36:41.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 1 -- 172.21.15.181:0/434451577 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a600047e0 con 0x7f4a780a8340 2024-09-13T10:36:41.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:41.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 1 -- 172.21.15.181:0/434451577 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a60004d50 con 0x7f4a780a8340 2024-09-13T10:36:41.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:41.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a75d9b640 10 monclient: dump: 2024-09-13T10:36:41.406 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.406 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.406 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a7cf44640 10 monclient: get_monmap_and_config success 2024-09-13T10:36:41.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.386+0000 7f4a7cf44640 4 set_mon_vals no callback set 2024-09-13T10:36:41.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.387+0000 7f4a7cf44640 10 monclient: shutdown 2024-09-13T10:36:41.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.387+0000 7f4a7cf44640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:41.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.387+0000 7f4a7cf44640 1 -- 172.21.15.181:0/434451577 >> v1:172.21.15.181:6793/0 conn(0x7f4a780a8340 legacy=0x7f4a78139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.387+0000 7f4a7cf44640 1 -- 172.21.15.181:0/434451577 shutdown_connections 2024-09-13T10:36:41.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.387+0000 7f4a7cf44640 1 -- 172.21.15.181:0/434451577 >> 172.21.15.181:0/434451577 conn(0x7f4a78077170 msgr2=0x7f4a780abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:41.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.387+0000 7f4a7cf44640 1 -- 172.21.15.181:0/434451577 shutdown_connections 2024-09-13T10:36:41.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.387+0000 7f4a7cf44640 1 -- 172.21.15.181:0/434451577 wait complete. 2024-09-13T10:36:41.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.388+0000 7f4a7cf44640 10 monclient: build_initial_monmap 2024-09-13T10:36:41.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.388+0000 7f4a7cf44640 10 monclient: monmap: 2024-09-13T10:36:41.409 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:36:41.409 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:36:41.409 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:36:41.409 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.388+0000 7f4a7cf44640 1 Processor -- start 2024-09-13T10:36:41.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.388+0000 7f4a7cf44640 1 -- start start 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.388+0000 7f4a7cf44640 10 monclient: init 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.388+0000 7f4a7cf44640 10 monclient: _reopen_session rank -1 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.388+0000 7f4a7cf44640 10 monclient: _add_conns ranks=[4,7,8,1,0,6,5,3,2] 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.388+0000 7f4a7cf44640 10 monclient(hunting): picked mon.noname-c con 0x7f4a780a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.388+0000 7f4a7cf44640 10 monclient(hunting): picked mon.noname-i con 0x7f4a7813f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.388+0000 7f4a7cf44640 10 monclient(hunting): picked mon.noname-e con 0x7f4a781d4310 addr v1:172.21.15.181:6793/0 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.389+0000 7f4a7cf44640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a780a1190 con 0x7f4a780a8340 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.389+0000 7f4a7cf44640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a7809e190 con 0x7f4a7813f750 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.389+0000 7f4a7cf44640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a78142f10 con 0x7f4a781d4310 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.389+0000 7f4a7cf44640 10 monclient(hunting): _renew_subs 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.389+0000 7f4a7cf44640 10 monclient(hunting): authenticate will time out at 1140.895038s 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.389+0000 7f4a7659c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f4a780a8340 0x7f4a7809d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53738/0 (socket says 172.21.15.181:53738) 2024-09-13T10:36:41.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.389+0000 7f4a7659c640 1 -- 172.21.15.181:0/84178518 learned_addr learned my addr 172.21.15.181:0/84178518 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a7659c640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.181:6791/0 conn(0x7f4a780a8340 legacy=0x7f4a7809d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a76d9d640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.181:6793/0 conn(0x7f4a781d4310 legacy=0x7f4a781d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1474020957 0 0) 0x7f4a780a1190 con 0x7f4a780a8340 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): my global_id is 114367 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a58003550 con 0x7f4a780a8340 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2065614782 0 0) 0x7f4a78142f10 con 0x7f4a781d4310 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): my global_id is 104804 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a780a1190 con 0x7f4a781d4310 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6dd9b640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.195:6792/0 conn(0x7f4a7813f750 legacy=0x7f4a7809da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 319872771 0 0) 0x7f4a780a1190 con 0x7f4a781d4310 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a78142f10 con 0x7f4a781d4310 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a70002000 con 0x7f4a781d4310 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): dump: 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.413 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1230596239 0 0) 0x7f4a58003550 con 0x7f4a780a8340 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a780a1190 con 0x7f4a780a8340 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a680019d0 con 0x7f4a780a8340 2024-09-13T10:36:41.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): dump: 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.415 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634319964 0 0) 0x7f4a7809e190 con 0x7f4a7813f750 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient(hunting): my global_id is 56635 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a58003550 con 0x7f4a7813f750 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2312721947 0 0) 0x7f4a78142f10 con 0x7f4a781d4310 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.195:6792/0 conn(0x7f4a7813f750 legacy=0x7f4a7809da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.181:6791/0 conn(0x7f4a780a8340 legacy=0x7f4a7809d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 monclient: found mon.e 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a780a0320 con 0x7f4a781d4310 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a7cf44640 5 monclient: authenticate success, global_id 104804 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a7cf44640 10 monclient: _renew_subs 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a7cf44640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a7cf44640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7809ee30 con 0x7f4a781d4310 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a7cf44640 10 monclient: _renew_subs 2024-09-13T10:36:41.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a7cf44640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a7cf44640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f4a780a29f0 con 0x7f4a781d4310 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a70003c40 con 0x7f4a781d4310 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a70004170 con 0x7f4a781d4310 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a7559a640 4 set_mon_vals no callback set 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.391+0000 7f4a6f7fe640 10 monclient: dump: 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.418 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.392+0000 7f4a7cf44640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.392+0000 7f4a7cf44640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4a5c0065c0 con 0x7f4a5c002860 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.392+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4a70004440 con 0x7f4a781d4310 2024-09-13T10:36:41.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.393+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(202..202 src has 1..202) ==== 3506+0+0 (unknown 3606230649 0 0) 0x7f4a7004e410 con 0x7f4a781d4310 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.393+0000 7f4a6dd9b640 10 monclient: get_auth_request con 0x7f4a580401c0 auth_method 0 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a7659c640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.195:6792/0 conn(0x7f4a5c002860 legacy=0x7f4a5c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 976106698 0 0) 0x7f4a5c0065c0 con 0x7f4a5c002860 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 10 monclient(hunting): my global_id is 56644 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a78142f10 con 0x7f4a5c002860 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2008193272 0 0) 0x7f4a78142f10 con 0x7f4a5c002860 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a5c0065c0 con 0x7f4a5c002860 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a68001320 con 0x7f4a5c002860 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 10 monclient: dump: 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.421 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.422 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.422 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3685394501 0 0) 0x7f4a5c0065c0 con 0x7f4a5c002860 2024-09-13T10:36:41.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a5c00a160 con 0x7f4a5c002860 2024-09-13T10:36:41.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4a680071f0 con 0x7f4a5c002860 2024-09-13T10:36:41.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:36:41.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:36:41.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.195:6792/0 conn(0x7f4a5c002860 legacy=0x7f4a5c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.395+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.195:6792/0 conn(0x7f4a5c002860 legacy=0x7f4a5c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:41.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.401+0000 7f4a7cf44640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:36:41.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.403+0000 7f4a7cf44640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4a5c009e70 con 0x7f4a5c009130 2024-09-13T10:36:41.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a7659c640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.195:6792/0 conn(0x7f4a5c009130 legacy=0x7f4a5c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:36:41.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1018874170 0 0) 0x7f4a5c009e70 con 0x7f4a5c009130 2024-09-13T10:36:41.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:36:41.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:36:41.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:36:41.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 10 monclient(hunting): my global_id is 56653 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a5c0065c0 con 0x7f4a5c009130 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 388423729 0 0) 0x7f4a5c0065c0 con 0x7f4a5c009130 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a5c009e70 con 0x7f4a5c009130 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a68006a70 con 0x7f4a5c009130 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 10 monclient: dump: 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:36:41.425 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 586591991 0 0) 0x7f4a5c009e70 con 0x7f4a5c009130 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4a5c00c410 con 0x7f4a5c009130 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7538 (unknown 0 0 141746708) 0x7f4a6800a150 con 0x7f4a5c009130 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:36:41.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:36:41.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.195:6792/0 conn(0x7f4a5c009130 legacy=0x7f4a5c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a6f7fe640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.195:6792/0 conn(0x7f4a5c009130 legacy=0x7f4a5c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:36:41.427 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:36:41.427 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:41.427 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:41.427 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:36:41.427 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 108, 2024-09-13T10:36:41.427 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 415826, 2024-09-13T10:36:41.427 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:36:41.427 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:41.428 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:41.429 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:36:41.430 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:36:41.431 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:36:41.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.434 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:36:41.435 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.436 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:36:41.439 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:36:41.442 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:36:41.443 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.444 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:36:41.445 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:36:41.446 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:36:41.446 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:36:41.446 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:36:41.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:36:41.446 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:36:41.446 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:36:41.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a7cf44640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4a580401c0 legacy=0x7f4a58042680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a7cf44640 10 monclient: shutdown 2024-09-13T10:36:41.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a7cf44640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:36:41.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a7cf44640 1 -- 172.21.15.181:0/84178518 >> v1:172.21.15.181:6793/0 conn(0x7f4a781d4310 legacy=0x7f4a781d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:36:41.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a76d9d640 1 -- 172.21.15.181:0/84178518 reap_dead start 2024-09-13T10:36:41.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a76d9d640 1 -- 172.21.15.181:0/84178518 reap_dead start 2024-09-13T10:36:41.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a7cf44640 1 -- 172.21.15.181:0/84178518 shutdown_connections 2024-09-13T10:36:41.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a7cf44640 1 -- 172.21.15.181:0/84178518 >> 172.21.15.181:0/84178518 conn(0x7f4a780a6640 msgr2=0x7f4a7813eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:36:41.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a7cf44640 1 -- 172.21.15.181:0/84178518 shutdown_connections 2024-09-13T10:36:41.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:36:41.405+0000 7f4a7cf44640 1 -- 172.21.15.181:0/84178518 wait complete. 2024-09-13T10:36:41.448 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-13T10:36:41.448 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T10:36:43.192 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38804]: starting. 2024-09-13T10:36:43.193 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38804]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38803 2024-09-13T10:36:43.193 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38804]: created object 0... 2024-09-13T10:36:43.193 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38804]: created object 25... 2024-09-13T10:36:43.193 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38804]: created object 49... 2024-09-13T10:36:43.193 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38804]: finishing. 2024-09-13T10:36:43.193 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38804]: shutting down. 2024-09-13T10:36:44.289 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38805]: starting. 2024-09-13T10:36:44.289 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38805]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38803 2024-09-13T10:36:44.290 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38805]: shutting down. 2024-09-13T10:36:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38840]: starting. 2024-09-13T10:36:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38840]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38803 2024-09-13T10:36:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38840]: created object 0... 2024-09-13T10:36:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38840]: created object 25... 2024-09-13T10:36:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38840]: created object 49... 2024-09-13T10:36:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38840]: finishing. 2024-09-13T10:36:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38840]: shutting down. 2024-09-13T10:36:45.955 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:45.955 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38842]: starting. 2024-09-13T10:36:45.955 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38842]: listing objects. 2024-09-13T10:36:45.956 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38842]: listed object 0... 2024-09-13T10:36:45.956 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38842]: listed object 25... 2024-09-13T10:36:45.956 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38842]: saw 50 objects 2024-09-13T10:36:45.956 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38842]: shutting down. 2024-09-13T10:36:46.677 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:46.677 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38841]: starting. 2024-09-13T10:36:46.677 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38841]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38803 2024-09-13T10:36:46.677 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38841]: shutting down. 2024-09-13T10:36:46.679 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:46.679 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:46.679 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:36:46.681 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:36:48.838 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38912]: starting. 2024-09-13T10:36:48.838 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38912]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38911 2024-09-13T10:36:48.838 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38912]: created object 0... 2024-09-13T10:36:48.838 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38912]: created object 25... 2024-09-13T10:36:48.839 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38912]: created object 49... 2024-09-13T10:36:48.839 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38912]: finishing. 2024-09-13T10:36:48.839 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[38912]: shutting down. 2024-09-13T10:36:49.733 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38913]: starting. 2024-09-13T10:36:49.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38913]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38911 2024-09-13T10:36:49.734 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[38913]: shutting down. 2024-09-13T10:36:52.177 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:52.177 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38948]: starting. 2024-09-13T10:36:52.178 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38948]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-38911 2024-09-13T10:36:52.178 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38948]: created object 0... 2024-09-13T10:36:52.178 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38948]: created object 25... 2024-09-13T10:36:52.178 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38948]: created object 49... 2024-09-13T10:36:52.178 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38948]: finishing. 2024-09-13T10:36:52.179 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[38948]: shutting down. 2024-09-13T10:36:52.216 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:52.216 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38950]: starting. 2024-09-13T10:36:52.216 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38950]: listing objects. 2024-09-13T10:36:52.216 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38950]: listed object 0... 2024-09-13T10:36:52.216 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38950]: listed object 25... 2024-09-13T10:36:52.216 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38950]: saw 50 objects 2024-09-13T10:36:52.216 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[38950]: shutting down. 2024-09-13T10:36:53.077 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:53.077 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38949]: starting. 2024-09-13T10:36:53.077 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38949]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-38911 2024-09-13T10:36:53.077 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[38949]: shutting down. 2024-09-13T10:36:53.079 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:53.079 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:53.079 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:36:53.082 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:36:55.178 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39019]: starting. 2024-09-13T10:36:55.178 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39019]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39018 2024-09-13T10:36:55.178 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39019]: created object 0... 2024-09-13T10:36:55.178 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39019]: created object 25... 2024-09-13T10:36:55.178 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39019]: created object 49... 2024-09-13T10:36:55.178 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39019]: finishing. 2024-09-13T10:36:55.178 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39019]: shutting down. 2024-09-13T10:36:55.657 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39020]: starting. 2024-09-13T10:36:55.657 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39020]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39018 2024-09-13T10:36:55.658 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39020]: shutting down. 2024-09-13T10:36:58.191 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:58.192 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39055]: starting. 2024-09-13T10:36:58.192 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39055]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39018 2024-09-13T10:36:58.192 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39055]: created object 0... 2024-09-13T10:36:58.192 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39055]: created object 25... 2024-09-13T10:36:58.192 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39055]: created object 49... 2024-09-13T10:36:58.192 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39055]: finishing. 2024-09-13T10:36:58.192 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39055]: shutting down. 2024-09-13T10:36:58.229 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:58.230 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39057]: starting. 2024-09-13T10:36:58.230 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39057]: listing objects. 2024-09-13T10:36:58.230 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39057]: listed object 0... 2024-09-13T10:36:58.230 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39057]: listed object 25... 2024-09-13T10:36:58.230 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39057]: saw 50 objects 2024-09-13T10:36:58.230 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39057]: shutting down. 2024-09-13T10:36:59.097 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:59.097 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39056]: starting. 2024-09-13T10:36:59.097 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39056]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39018 2024-09-13T10:36:59.097 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39056]: shutting down. 2024-09-13T10:36:59.099 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:59.099 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:36:59.099 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:36:59.103 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:37:01.213 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39126]: starting. 2024-09-13T10:37:01.214 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39126]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39125 2024-09-13T10:37:01.214 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39126]: created object 0... 2024-09-13T10:37:01.214 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39126]: created object 25... 2024-09-13T10:37:01.214 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39126]: created object 49... 2024-09-13T10:37:01.214 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39126]: finishing. 2024-09-13T10:37:01.214 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39126]: shutting down. 2024-09-13T10:37:01.449 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-13T10:37:01.449 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T10:37:01.450 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T10:37:01.453 INFO:tasks.ceph.mon.b:Started 2024-09-13T10:37:01.453 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-09-13T10:37:01.453 INFO:tasks.ceph.mon.d:Restarting daemon 2024-09-13T10:37:01.453 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-09-13T10:37:01.455 INFO:tasks.ceph.mon.d:Started 2024-09-13T10:37:01.455 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:37:01.455 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:37:01.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.560+0000 7fa9c1449640 10 monclient: get_monmap_and_config 2024-09-13T10:37:01.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.560+0000 7fa9c1449640 10 monclient: build_initial_monmap 2024-09-13T10:37:01.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.560+0000 7fa9c1449640 10 monclient: monmap: 2024-09-13T10:37:01.562 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:01.562 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:01.562 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:01.561496+0000 2024-09-13T10:37:01.562 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:01.561496+0000 2024-09-13T10:37:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:01.563 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.561+0000 7fa9c1449640 1 Processor -- start 2024-09-13T10:37:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.561+0000 7fa9c1449640 1 -- start start 2024-09-13T10:37:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.561+0000 7fa9c1449640 10 monclient: init 2024-09-13T10:37:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.562+0000 7fa9c1449640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.562+0000 7fa9c1449640 10 monclient: _add_conns ranks=[4,5,8,3,6,0,7,2,1] 2024-09-13T10:37:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.562+0000 7fa9c1449640 10 monclient(hunting): picked mon.noname-c con 0x7fa9bc0a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.562+0000 7fa9c1449640 10 monclient(hunting): picked mon.noname-h con 0x7fa9bc0a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.562+0000 7fa9baffd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fa9bc0a66d0 0x7fa9bc0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53280/0 (socket says 172.21.15.181:53280) 2024-09-13T10:37:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.562+0000 7fa9c1449640 10 monclient(hunting): picked mon.noname-e con 0x7fa9bc13f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.562+0000 7fa9baffd640 1 -- 172.21.15.181:0/2421663220 learned_addr learned my addr 172.21.15.181:0/2421663220 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:01.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.562+0000 7fa9c1449640 1 -- 172.21.15.181:0/2421663220 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9bc0a5fe0 con 0x7fa9bc0a66d0 2024-09-13T10:37:01.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.562+0000 7fa9c1449640 1 -- 172.21.15.181:0/2421663220 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9bc0a8080 con 0x7fa9bc0a6ab0 2024-09-13T10:37:01.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.562+0000 7fa9c1449640 1 -- 172.21.15.181:0/2421663220 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9bc0a42c0 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.562+0000 7fa9c1449640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:01.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.562+0000 7fa9c1449640 10 monclient(hunting): authenticate will time out at 1161.067613s 2024-09-13T10:37:01.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.564+0000 7fa9baffd640 1 -- 172.21.15.181:0/2421663220 >> v1:172.21.15.181:6791/0 conn(0x7fa9bc0a66d0 legacy=0x7fa9bc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:01.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.564+0000 7fa9b3fff640 1 -- 172.21.15.181:0/2421663220 >> v1:172.21.15.195:6791/0 conn(0x7fa9bc0a6ab0 legacy=0x7fa9bc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:01.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.564+0000 7fa9ba7fc640 1 -- 172.21.15.181:0/2421663220 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 46089053 0 0) 0x7fa9bc0a5fe0 con 0x7fa9bc0a66d0 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.564+0000 7fa9ba7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.564+0000 7fa9ba7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.564+0000 7fa9ba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.564+0000 7fa9ba7fc640 10 monclient(hunting): my global_id is 114511 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 1 -- 172.21.15.181:0/2421663220 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9a8003520 con 0x7fa9bc0a66d0 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 1 -- 172.21.15.181:0/2421663220 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519996889 0 0) 0x7fa9bc0a8080 con 0x7fa9bc0a6ab0 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient(hunting): my global_id is 104639 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 1 -- 172.21.15.181:0/2421663220 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9bc0a5fe0 con 0x7fa9bc0a6ab0 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 1 -- 172.21.15.181:0/2421663220 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2096182094 0 0) 0x7fa9a8003520 con 0x7fa9bc0a66d0 2024-09-13T10:37:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 1 -- 172.21.15.181:0/2421663220 >> v1:172.21.15.181:6793/0 conn(0x7fa9bc13f9a0 legacy=0x7fa9bc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 1 -- 172.21.15.181:0/2421663220 >> v1:172.21.15.195:6791/0 conn(0x7fa9bc0a6ab0 legacy=0x7fa9bc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 1 monclient: found mon.noname-c 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 1 -- 172.21.15.181:0/2421663220 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc1464e0 con 0x7fa9bc0a66d0 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient: _finish_auth 0 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 1 -- 172.21.15.181:0/2421663220 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa9ac001ad0 con 0x7fa9bc0a66d0 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient: dump: 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9c1449640 5 monclient: authenticate success, global_id 114511 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9c1449640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 1 -- 172.21.15.181:0/2421663220 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9ac0048a0 con 0x7fa9bc0a66d0 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 1 -- 172.21.15.181:0/2421663220 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa9ac004dd0 con 0x7fa9bc0a66d0 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9ba7fc640 10 monclient: dump: 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:01.573 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9c1449640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.565+0000 7fa9c1449640 4 set_mon_vals no callback set 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.566+0000 7fa9c1449640 10 monclient: shutdown 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.566+0000 7fa9c1449640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.566+0000 7fa9c1449640 1 -- 172.21.15.181:0/2421663220 >> v1:172.21.15.181:6791/0 conn(0x7fa9bc0a66d0 legacy=0x7fa9bc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.566+0000 7fa9c1449640 1 -- 172.21.15.181:0/2421663220 shutdown_connections 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.566+0000 7fa9c1449640 1 -- 172.21.15.181:0/2421663220 >> 172.21.15.181:0/2421663220 conn(0x7fa9bc0abcd0 msgr2=0x7fa9bc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.566+0000 7fa9c1449640 1 -- 172.21.15.181:0/2421663220 shutdown_connections 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.566+0000 7fa9c1449640 1 -- 172.21.15.181:0/2421663220 wait complete. 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.567+0000 7fa9c1449640 10 monclient: build_initial_monmap 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.567+0000 7fa9c1449640 10 monclient: monmap: 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:01.575 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.567+0000 7fa9c1449640 1 Processor -- start 2024-09-13T10:37:01.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.567+0000 7fa9c1449640 1 -- start start 2024-09-13T10:37:01.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.567+0000 7fa9c1449640 10 monclient: init 2024-09-13T10:37:01.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.568+0000 7fa9c1449640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.568+0000 7fa9c1449640 10 monclient: _add_conns ranks=[2,5,8,1,6,7,4,0,3] 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.568+0000 7fa9c1449640 10 monclient(hunting): picked mon.noname-b con 0x7fa9bc0a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.568+0000 7fa9c1449640 10 monclient(hunting): picked mon.noname-h con 0x7fa9bc0a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.568+0000 7fa9c1449640 10 monclient(hunting): picked mon.noname-e con 0x7fa9bc13f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.568+0000 7fa9c1449640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9bc13ef70 con 0x7fa9bc0a66d0 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.568+0000 7fa9c1449640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9bc1377e0 con 0x7fa9bc0a6ab0 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.568+0000 7fa9c1449640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9bc13e100 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.568+0000 7fa9c1449640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.568+0000 7fa9c1449640 10 monclient(hunting): authenticate will time out at 1161.073543s 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.568+0000 7fa9bb7fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fa9bc13f9a0 0x7fa9bc1d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:51232/0 (socket says 172.21.15.181:51232) 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.568+0000 7fa9bb7fe640 1 -- 172.21.15.181:0/2806169235 learned_addr learned my addr 172.21.15.181:0/2806169235 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.570+0000 7fa9bb7fe640 1 -- 172.21.15.181:0/2806169235 >> v1:172.21.15.181:6793/0 conn(0x7fa9bc13f9a0 legacy=0x7fa9bc1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:01.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.570+0000 7fa9baffd640 1 -- 172.21.15.181:0/2806169235 >> v1:172.21.15.181:6790/0 conn(0x7fa9bc0a66d0 legacy=0x7fa9bc13b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51083988 0 0) 0x7fa9bc13e100 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 10 monclient(hunting): my global_id is 104894 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa99c003520 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1362272866 0 0) 0x7fa99c003520 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa9bc13e100 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa9b4001f20 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 10 monclient(hunting): dump: 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 415595564 0 0) 0x7fa9bc13e100 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 >> v1:172.21.15.195:6791/0 conn(0x7fa9bc0a6ab0 legacy=0x7fa9bc13b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 >> v1:172.21.15.181:6790/0 conn(0x7fa9bc0a66d0 legacy=0x7fa9bc13b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 1 monclient: found mon.e 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc13bf40 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.571+0000 7fa9b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9b4004e90 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9b37fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa9b4005480 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9b37fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9b37fe640 10 monclient: dump: 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:01.586 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9c1449640 5 monclient: authenticate success, global_id 104894 2024-09-13T10:37:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9c1449640 10 monclient: _renew_subs 2024-09-13T10:37:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9c1449640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9c1449640 1 -- 172.21.15.181:0/2806169235 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa9bc13ec90 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9c1449640 10 monclient: _renew_subs 2024-09-13T10:37:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9c1449640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9c1449640 1 -- 172.21.15.181:0/2806169235 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fa9bc13f570 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.572+0000 7fa9b9ffb640 4 set_mon_vals no callback set 2024-09-13T10:37:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.573+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa9b40056a0 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.574+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(222..222 src has 1..222) ==== 3898+0+0 (unknown 3643862915 0 0) 0x7fa9b404d8b0 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.574+0000 7fa9baffd640 10 monclient: get_auth_request con 0x7fa99c03f9f0 auth_method 0 2024-09-13T10:37:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.574+0000 7fa9c1449640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.574+0000 7fa9c1449640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.574+0000 7fa9c1449640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.574+0000 7fa9c1449640 1 -- 172.21.15.181:0/2806169235 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a0005080 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.579+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fa9b4017c20 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.579+0000 7fa9b37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.579+0000 7fa9b37fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:01.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.829+0000 7fa9c1449640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:37:01.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.829+0000 7fa9c1449640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:01.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.829+0000 7fa9c1449640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:01.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.829+0000 7fa9c1449640 1 -- 172.21.15.181:0/2806169235 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa9a0005370 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.830+0000 7fa9b37fe640 1 -- 172.21.15.181:0/2806169235 <== mon.8 v1:172.21.15.181:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 2775346009) 0x7fa9b4017520 con 0x7fa9bc13f9a0 2024-09-13T10:37:01.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.830+0000 7fa9b37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:01.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.830+0000 7fa9b37fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:01.833 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":110,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:37:01.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.832+0000 7fa9c1449640 1 -- 172.21.15.181:0/2806169235 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa99c03f9f0 legacy=0x7fa99c041e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.832+0000 7fa9c1449640 10 monclient: shutdown 2024-09-13T10:37:01.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.832+0000 7fa9c1449640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:01.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.832+0000 7fa9c1449640 1 -- 172.21.15.181:0/2806169235 >> v1:172.21.15.181:6793/0 conn(0x7fa9bc13f9a0 legacy=0x7fa9bc1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.832+0000 7fa9c1449640 1 -- 172.21.15.181:0/2806169235 shutdown_connections 2024-09-13T10:37:01.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.832+0000 7fa9c1449640 1 -- 172.21.15.181:0/2806169235 >> 172.21.15.181:0/2806169235 conn(0x7fa9bc0abcd0 msgr2=0x7fa9bc145ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:01.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.832+0000 7fa9c1449640 1 -- 172.21.15.181:0/2806169235 shutdown_connections 2024-09-13T10:37:01.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.832+0000 7fa9c1449640 1 -- 172.21.15.181:0/2806169235 wait complete. 2024-09-13T10:37:01.844 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:37:01.845 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:37:01.845 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:37:01.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.941+0000 7f1679575640 10 monclient: get_monmap_and_config 2024-09-13T10:37:01.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.941+0000 7f1679575640 10 monclient: build_initial_monmap 2024-09-13T10:37:01.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.941+0000 7f1679575640 10 monclient: monmap: 2024-09-13T10:37:01.943 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:01.943 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:01.943 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:01.942463+0000 2024-09-13T10:37:01.943 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:01.942463+0000 2024-09-13T10:37:01.943 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:01.943 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:01.944 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:01.944 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:01.944 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:01.944 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:01.944 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:01.944 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:01.944 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:01.944 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:01.944 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:01.944 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.942+0000 7f1679575640 1 Processor -- start 2024-09-13T10:37:01.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.942+0000 7f1679575640 1 -- start start 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.942+0000 7f1679575640 10 monclient: init 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f1679575640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f1679575640 10 monclient: _add_conns ranks=[8,5,0,3,4,2,7,6,1] 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f1679575640 10 monclient(hunting): picked mon.noname-e con 0x7f16740a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f1679575640 10 monclient(hunting): picked mon.noname-h con 0x7f16740a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f1679575640 10 monclient(hunting): picked mon.noname-a con 0x7f167413f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f1679575640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16740a5fe0 con 0x7f167413f9a0 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f1679575640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16740a8080 con 0x7f16740a6ab0 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f1679575640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16740a42c0 con 0x7f16740a66d0 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f1679575640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f1679575640 10 monclient(hunting): authenticate will time out at 1161.448182s 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f1672ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f16740a66d0 0x7f16740a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:51234/0 (socket says 172.21.15.181:51234) 2024-09-13T10:37:01.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f16737fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f167413f9a0 0x7f1674141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:40378/0 (socket says 172.21.15.181:40378) 2024-09-13T10:37:01.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.943+0000 7f1672ffd640 1 -- 172.21.15.181:0/1353723746 learned_addr learned my addr 172.21.15.181:0/1353723746 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:01.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1672ffd640 1 -- 172.21.15.181:0/1353723746 >> v1:172.21.15.181:6793/0 conn(0x7f16740a66d0 legacy=0x7f16740a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:01.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f16737fe640 1 -- 172.21.15.181:0/1353723746 >> v1:172.21.15.181:6789/0 conn(0x7f167413f9a0 legacy=0x7f1674141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:01.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 1 -- 172.21.15.181:0/1353723746 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1981617547 0 0) 0x7f16740a42c0 con 0x7f16740a66d0 2024-09-13T10:37:01.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:01.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:01.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:01.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient(hunting): my global_id is 104903 2024-09-13T10:37:01.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 1 -- 172.21.15.181:0/1353723746 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f165c003520 con 0x7f16740a66d0 2024-09-13T10:37:01.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 1 -- 172.21.15.181:0/1353723746 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209433895 0 0) 0x7f16740a5fe0 con 0x7f167413f9a0 2024-09-13T10:37:01.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient(hunting): my global_id is 114417 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 1 -- 172.21.15.181:0/1353723746 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16740a42c0 con 0x7f167413f9a0 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f16727fc640 1 -- 172.21.15.181:0/1353723746 >> v1:172.21.15.195:6791/0 conn(0x7f16740a6ab0 legacy=0x7f16740a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 1 -- 172.21.15.181:0/1353723746 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1143465065 0 0) 0x7f165c003520 con 0x7f16740a66d0 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 1 -- 172.21.15.181:0/1353723746 >> v1:172.21.15.195:6791/0 conn(0x7f16740a6ab0 legacy=0x7f16740a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 1 -- 172.21.15.181:0/1353723746 >> v1:172.21.15.181:6789/0 conn(0x7f167413f9a0 legacy=0x7f1674141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 1 monclient: found mon.noname-e 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:37:01.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 1 -- 172.21.15.181:0/1353723746 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16741464e0 con 0x7f16740a66d0 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient: _finish_auth 0 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1679575640 5 monclient: authenticate success, global_id 104903 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 1 -- 172.21.15.181:0/1353723746 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1664001ad0 con 0x7f16740a66d0 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient: dump: 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:01.952 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1679575640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 1 -- 172.21.15.181:0/1353723746 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f16640048a0 con 0x7f16740a66d0 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:01.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1679575640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 1 -- 172.21.15.181:0/1353723746 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1664004dd0 con 0x7f16740a66d0 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1679575640 4 set_mon_vals no callback set 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.945+0000 7f1671ffb640 10 monclient: dump: 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:01.954 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.946+0000 7f1679575640 10 monclient: shutdown 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.946+0000 7f1679575640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.946+0000 7f1679575640 1 -- 172.21.15.181:0/1353723746 >> v1:172.21.15.181:6793/0 conn(0x7f16740a66d0 legacy=0x7f16740a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.946+0000 7f1679575640 1 -- 172.21.15.181:0/1353723746 shutdown_connections 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.946+0000 7f1679575640 1 -- 172.21.15.181:0/1353723746 >> 172.21.15.181:0/1353723746 conn(0x7f16740abcd0 msgr2=0x7f16740ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:01.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.946+0000 7f1679575640 1 -- 172.21.15.181:0/1353723746 shutdown_connections 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.946+0000 7f1679575640 1 -- 172.21.15.181:0/1353723746 wait complete. 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.947+0000 7f1679575640 10 monclient: build_initial_monmap 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.947+0000 7f1679575640 10 monclient: monmap: 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:01.956 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.947+0000 7f1679575640 1 Processor -- start 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.947+0000 7f1679575640 1 -- start start 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.947+0000 7f1679575640 10 monclient: init 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.947+0000 7f1679575640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.947+0000 7f1679575640 10 monclient: _add_conns ranks=[7,4,1,8,0,2,6,3,5] 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.948+0000 7f1679575640 10 monclient(hunting): picked mon.noname-i con 0x7f16740a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.948+0000 7f1679575640 10 monclient(hunting): picked mon.noname-c con 0x7f16740a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:01.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.948+0000 7f1679575640 10 monclient(hunting): picked mon.noname-f con 0x7f167413f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:01.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.948+0000 7f1679575640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167413d540 con 0x7f167413f9a0 2024-09-13T10:37:01.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.948+0000 7f1679575640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167413ed80 con 0x7f16740a6ab0 2024-09-13T10:37:01.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.948+0000 7f1679575640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167413f060 con 0x7f16740a66d0 2024-09-13T10:37:01.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.948+0000 7f1679575640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:01.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.948+0000 7f1679575640 10 monclient(hunting): authenticate will time out at 1161.453094s 2024-09-13T10:37:01.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.948+0000 7f16727fc640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f16740a6ab0 0x7f16741d36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53286/0 (socket says 172.21.15.181:53286) 2024-09-13T10:37:01.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.948+0000 7f16727fc640 1 -- 172.21.15.181:0/384549127 learned_addr learned my addr 172.21.15.181:0/384549127 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:01.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f16727fc640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.181:6791/0 conn(0x7f16740a6ab0 legacy=0x7f16741d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:01.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282470453 0 0) 0x7f167413ed80 con 0x7f16740a6ab0 2024-09-13T10:37:01.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:01.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:01.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:01.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): my global_id is 114520 2024-09-13T10:37:01.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f1672ffd640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.195:6792/0 conn(0x7f16740a66d0 legacy=0x7f16740a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:01.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1660003550 con 0x7f16740a6ab0 2024-09-13T10:37:01.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f16737fe640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.195:6789/0 conn(0x7f167413f9a0 legacy=0x7f16741d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:01.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3844226417 0 0) 0x7f167413f060 con 0x7f16740a66d0 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): my global_id is 56743 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f167413ed80 con 0x7f16740a66d0 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158902104 0 0) 0x7f166c001810 con 0x7f167413f9a0 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): my global_id is 56872 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f167413f060 con 0x7f167413f9a0 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3817570761 0 0) 0x7f1660003550 con 0x7f16740a6ab0 2024-09-13T10:37:01.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f166c001810 con 0x7f16740a6ab0 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1668003610 con 0x7f16740a6ab0 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): dump: 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:01.964 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1995226138 0 0) 0x7f166c001810 con 0x7f16740a6ab0 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.195:6792/0 conn(0x7f16740a66d0 legacy=0x7f16740a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.195:6789/0 conn(0x7f167413f9a0 legacy=0x7f16741d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 monclient: found mon.c 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:01.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167413f340 con 0x7f16740a6ab0 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f165b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f1679575640 5 monclient: authenticate success, global_id 114520 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f1679575640 10 monclient: _renew_subs 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f1679575640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f1679575640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f16741374e0 con 0x7f16740a6ab0 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f1679575640 10 monclient: _renew_subs 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f1679575640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.950+0000 7f1679575640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f167413de20 con 0x7f16740a6ab0 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.951+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1668003ac0 con 0x7f16740a6ab0 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.951+0000 7f165b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:01.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.951+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1668003fb0 con 0x7f16740a6ab0 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.951+0000 7f165b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.951+0000 7f16717fa640 4 set_mon_vals no callback set 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.951+0000 7f165b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.951+0000 7f165b7fe640 10 monclient: dump: 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:01.967 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.951+0000 7f1679575640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.951+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1668004150 con 0x7f16740a6ab0 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.951+0000 7f1679575640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f16540065c0 con 0x7f1654002860 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.951+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(222..222 src has 1..222) ==== 3898+0+0 (unknown 3643862915 0 0) 0x7f166804e380 con 0x7f16740a6ab0 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.952+0000 7f16737fe640 10 monclient: get_auth_request con 0x7f166003fe40 auth_method 0 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.953+0000 7f1672ffd640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.181:6789/0 conn(0x7f1654002860 legacy=0x7f1654004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:01.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321029413 0 0) 0x7f16540065c0 con 0x7f1654002860 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 10 monclient(hunting): my global_id is 114426 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f166c001810 con 0x7f1654002860 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1106175166 0 0) 0x7f166c001810 con 0x7f1654002860 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16540065c0 con 0x7f1654002860 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1664001d20 con 0x7f1654002860 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 10 monclient: dump: 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:01.969 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:01.970 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3688837989 0 0) 0x7f16540065c0 con 0x7f1654002860 2024-09-13T10:37:01.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f165400a160 con 0x7f1654002860 2024-09-13T10:37:01.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f16640049d0 con 0x7f1654002860 2024-09-13T10:37:01.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:01.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:01.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.181:6789/0 conn(0x7f1654002860 legacy=0x7f1654004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.954+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.181:6789/0 conn(0x7f1654002860 legacy=0x7f1654004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:01.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.960+0000 7f1679575640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:01.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.960+0000 7f1679575640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1654009e70 con 0x7f1654009130 2024-09-13T10:37:01.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f1672ffd640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.181:6789/0 conn(0x7f1654009130 legacy=0x7f16540095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:01.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2396798237 0 0) 0x7f1654009e70 con 0x7f1654009130 2024-09-13T10:37:01.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:01.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:01.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:01.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 10 monclient(hunting): my global_id is 114435 2024-09-13T10:37:01.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16540065c0 con 0x7f1654009130 2024-09-13T10:37:01.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 685792096 0 0) 0x7f16540065c0 con 0x7f1654009130 2024-09-13T10:37:01.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1654009e70 con 0x7f1654009130 2024-09-13T10:37:01.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1664005450 con 0x7f1654009130 2024-09-13T10:37:01.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 10 monclient: dump: 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:01.974 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:01.975 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:01.975 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:01.975 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:01.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3791587963 0 0) 0x7f1654009e70 con 0x7f1654009130 2024-09-13T10:37:01.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f165400c3f0 con 0x7f1654009130 2024-09-13T10:37:01.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 2995582410) 0x7f16640085c0 con 0x7f1654009130 2024-09-13T10:37:01.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:01.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:01.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.181:6789/0 conn(0x7f1654009130 legacy=0x7f16540095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.963+0000 7f165b7fe640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.181:6789/0 conn(0x7f1654009130 legacy=0x7f16540095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:01.975 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:01.976 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:01.976 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:01.976 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:01.976 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:01.976 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 57941, 2024-09-13T10:37:01.976 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:01.976 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:01.976 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:01.976 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:01.976 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:01.976 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:01.976 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:01.977 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:01.978 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:01.979 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:01.980 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:01.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:01.982 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.983 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:01.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.984 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:01.984 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:01.984 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:01.984 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:01.984 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:01.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.984 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:01.984 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:01.984 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:01.984 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:01.986 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:01.987 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:01.988 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:01.990 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.991 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:01.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:01.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:01.994 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.995 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:01.995 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:37:01.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:01.995 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:01.995 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:01.995 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:01.995 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:01.995 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:01.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:01.995 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:01.995 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:01.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.964+0000 7f1679575640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.195:6800/1839191919 conn(0x7f166003fe40 legacy=0x7f1660042300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.964+0000 7f1679575640 10 monclient: shutdown 2024-09-13T10:37:01.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.964+0000 7f1679575640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:01.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.964+0000 7f1679575640 1 -- 172.21.15.181:0/384549127 >> v1:172.21.15.181:6791/0 conn(0x7f16740a6ab0 legacy=0x7f16741d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:01.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.964+0000 7f16737fe640 1 -- 172.21.15.181:0/384549127 reap_dead start 2024-09-13T10:37:01.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.964+0000 7f16737fe640 1 -- 172.21.15.181:0/384549127 reap_dead start 2024-09-13T10:37:01.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.964+0000 7f1679575640 1 -- 172.21.15.181:0/384549127 shutdown_connections 2024-09-13T10:37:01.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.964+0000 7f1679575640 1 -- 172.21.15.181:0/384549127 >> 172.21.15.181:0/384549127 conn(0x7f16740abcd0 msgr2=0x7f1674138cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:01.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.964+0000 7f1679575640 1 -- 172.21.15.181:0/384549127 shutdown_connections 2024-09-13T10:37:01.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:01.964+0000 7f1679575640 1 -- 172.21.15.181:0/384549127 wait complete. 2024-09-13T10:37:01.998 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:01.998 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:37:01.998 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:37:02.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.094+0000 7fb50ad94640 10 monclient: get_monmap_and_config 2024-09-13T10:37:02.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.094+0000 7fb50ad94640 10 monclient: build_initial_monmap 2024-09-13T10:37:02.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.094+0000 7fb50ad94640 10 monclient: monmap: 2024-09-13T10:37:02.096 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:02.096 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.096 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:02.095433+0000 2024-09-13T10:37:02.096 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:02.095433+0000 2024-09-13T10:37:02.096 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:02.097 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.097 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:02.097 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:02.097 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:02.097 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:02.097 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:02.097 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:02.097 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:02.097 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:02.097 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:02.097 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.095+0000 7fb50ad94640 1 Processor -- start 2024-09-13T10:37:02.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.095+0000 7fb50ad94640 1 -- start start 2024-09-13T10:37:02.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.095+0000 7fb50ad94640 10 monclient: init 2024-09-13T10:37:02.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb50ad94640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:02.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb50ad94640 10 monclient: _add_conns ranks=[3,0,6,7,5,2,8,1,4] 2024-09-13T10:37:02.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb50ad94640 10 monclient(hunting): picked mon.noname-g con 0x7fb5040a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:02.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb50ad94640 10 monclient(hunting): picked mon.noname-a con 0x7fb5040a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:02.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb50ad94640 10 monclient(hunting): picked mon.noname-d con 0x7fb50413f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:02.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb50ad94640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5040a4bc0 con 0x7fb5040a8340 2024-09-13T10:37:02.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb50ad94640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50413a320 con 0x7fb5040a6640 2024-09-13T10:37:02.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb50ad94640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5040a8100 con 0x7fb50413f750 2024-09-13T10:37:02.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb50ad94640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:02.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb50ad94640 10 monclient(hunting): authenticate will time out at 1161.601210s 2024-09-13T10:37:02.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb509331640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fb50413f750 0x7fb504141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41106/0 (socket says 172.21.15.181:41106) 2024-09-13T10:37:02.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb4fbfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb5040a8340 0x7fb504139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:40398/0 (socket says 172.21.15.181:40398) 2024-09-13T10:37:02.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.096+0000 7fb509331640 1 -- 172.21.15.181:0/3154030062 learned_addr learned my addr 172.21.15.181:0/3154030062 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:02.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fbfff640 1 -- 172.21.15.181:0/3154030062 >> v1:172.21.15.181:6789/0 conn(0x7fb5040a8340 legacy=0x7fb504139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb509331640 1 -- 172.21.15.181:0/3154030062 >> v1:172.21.15.181:6792/0 conn(0x7fb50413f750 legacy=0x7fb504141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 1 -- 172.21.15.181:0/3154030062 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192404256 0 0) 0x7fb5040a4bc0 con 0x7fb5040a8340 2024-09-13T10:37:02.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient(hunting): my global_id is 114444 2024-09-13T10:37:02.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb508b30640 1 -- 172.21.15.181:0/3154030062 >> v1:172.21.15.195:6790/0 conn(0x7fb5040a6640 legacy=0x7fb504139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 1 -- 172.21.15.181:0/3154030062 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4ec003520 con 0x7fb5040a8340 2024-09-13T10:37:02.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 1 -- 172.21.15.181:0/3154030062 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 978767581 0 0) 0x7fb4ec003520 con 0x7fb5040a8340 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 1 -- 172.21.15.181:0/3154030062 >> v1:172.21.15.181:6792/0 conn(0x7fb50413f750 legacy=0x7fb504141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 1 -- 172.21.15.181:0/3154030062 >> v1:172.21.15.195:6790/0 conn(0x7fb5040a6640 legacy=0x7fb504139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 1 monclient: found mon.noname-a 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 1 -- 172.21.15.181:0/3154030062 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5040a48e0 con 0x7fb5040a8340 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 1 -- 172.21.15.181:0/3154030062 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb4f4001ae0 con 0x7fb5040a8340 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb50ad94640 5 monclient: authenticate success, global_id 114444 2024-09-13T10:37:02.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb50ad94640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:02.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:02.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient: dump: 2024-09-13T10:37:02.105 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.105 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.105 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.105 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.105 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.105 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.105 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.105 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.106 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.106 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.106 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.106 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.106 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.106 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.106 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.106 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb50ad94640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:02.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 1 -- 172.21.15.181:0/3154030062 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4f40047e0 con 0x7fb5040a8340 2024-09-13T10:37:02.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:02.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 1 -- 172.21.15.181:0/3154030062 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb4f4004d10 con 0x7fb5040a8340 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb50ad94640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb50ad94640 4 set_mon_vals no callback set 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.098+0000 7fb4fb7fe640 10 monclient: dump: 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.107 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.099+0000 7fb50ad94640 10 monclient: shutdown 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.099+0000 7fb50ad94640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.099+0000 7fb50ad94640 1 -- 172.21.15.181:0/3154030062 >> v1:172.21.15.181:6789/0 conn(0x7fb5040a8340 legacy=0x7fb504139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.099+0000 7fb50ad94640 1 -- 172.21.15.181:0/3154030062 shutdown_connections 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.099+0000 7fb50ad94640 1 -- 172.21.15.181:0/3154030062 >> 172.21.15.181:0/3154030062 conn(0x7fb504077170 msgr2=0x7fb5040abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.099+0000 7fb50ad94640 1 -- 172.21.15.181:0/3154030062 shutdown_connections 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.099+0000 7fb50ad94640 1 -- 172.21.15.181:0/3154030062 wait complete. 2024-09-13T10:37:02.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.100+0000 7fb50ad94640 10 monclient: build_initial_monmap 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.100+0000 7fb50ad94640 10 monclient: monmap: 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:02.109 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.100+0000 7fb50ad94640 1 Processor -- start 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.100+0000 7fb50ad94640 1 -- start start 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.100+0000 7fb50ad94640 10 monclient: init 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.101+0000 7fb50ad94640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.101+0000 7fb50ad94640 10 monclient: _add_conns ranks=[6,5,3,0,1,8,2,4,7] 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.101+0000 7fb50ad94640 10 monclient(hunting): picked mon.noname-d con 0x7fb5040a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.101+0000 7fb50ad94640 10 monclient(hunting): picked mon.noname-h con 0x7fb50413f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.101+0000 7fb50ad94640 10 monclient(hunting): picked mon.noname-g con 0x7fb5041420c0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.101+0000 7fb50ad94640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5040a9c40 con 0x7fb5041420c0 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.101+0000 7fb50ad94640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb504142b60 con 0x7fb50413f750 2024-09-13T10:37:02.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.101+0000 7fb50ad94640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50413bdb0 con 0x7fb5040a8340 2024-09-13T10:37:02.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.101+0000 7fb50ad94640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:02.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.101+0000 7fb50ad94640 10 monclient(hunting): authenticate will time out at 1161.606321s 2024-09-13T10:37:02.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.101+0000 7fb508b30640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fb5040a8340 0x7fb50412c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41120/0 (socket says 172.21.15.181:41120) 2024-09-13T10:37:02.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.101+0000 7fb508b30640 1 -- 172.21.15.181:0/833076528 learned_addr learned my addr 172.21.15.181:0/833076528 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:02.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb508b30640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.181:6792/0 conn(0x7fb5040a8340 legacy=0x7fb50412c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb509331640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.195:6790/0 conn(0x7fb5041420c0 legacy=0x7fb5041d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4fbfff640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.195:6791/0 conn(0x7fb50413f750 legacy=0x7fb5041d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2673250457 0 0) 0x7fb5040a9c40 con 0x7fb5041420c0 2024-09-13T10:37:02.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4f97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4f97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4f97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4f97fa640 10 monclient(hunting): my global_id is 6582 2024-09-13T10:37:02.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4f0003550 con 0x7fb5041420c0 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3728751624 0 0) 0x7fb504142b60 con 0x7fb50413f750 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4f97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4f97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4f97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4f97fa640 10 monclient(hunting): my global_id is 104657 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.103+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5040a9c40 con 0x7fb50413f750 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2240875278 0 0) 0x7fb5040a9c40 con 0x7fb50413f750 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb504142b60 con 0x7fb50413f750 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3628831508 0 0) 0x7fb4f0003550 con 0x7fb5041420c0 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5040a9c40 con 0x7fb5041420c0 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb4f4004cd0 con 0x7fb50413f750 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:37:02.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient(hunting): dump: 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.117 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb4fc001ee0 con 0x7fb5041420c0 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient(hunting): dump: 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.118 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3756114843 0 0) 0x7fb504142b60 con 0x7fb50413f750 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.181:6792/0 conn(0x7fb5040a8340 legacy=0x7fb50412c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.195:6790/0 conn(0x7fb5041420c0 legacy=0x7fb5041d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient: _finish_hunting 0 2024-09-13T10:37:02.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 monclient: found mon.h 2024-09-13T10:37:02.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:02.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:02.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50413baa0 con 0x7fb50413f750 2024-09-13T10:37:02.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient: _finish_auth 0 2024-09-13T10:37:02.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient: _check_auth_tickets 2024-09-13T10:37:02.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:02.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb50ad94640 5 monclient: authenticate success, global_id 104657 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb50ad94640 10 monclient: _renew_subs 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb50ad94640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb50ad94640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb50413ae50 con 0x7fb50413f750 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb50ad94640 10 monclient: _renew_subs 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb50ad94640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb50ad94640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fb50412cff0 con 0x7fb50413f750 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4f4001d30 con 0x7fb50413f750 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb4f4001b00 con 0x7fb50413f750 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4faffd640 4 set_mon_vals no callback set 2024-09-13T10:37:02.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.104+0000 7fb4f97fa640 10 monclient: dump: 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.122 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.105+0000 7fb50ad94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.105+0000 7fb50ad94640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb4e40065c0 con 0x7fb4e4002860 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.105+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb4f4011b20 con 0x7fb50413f750 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.105+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(222..222 src has 1..222) ==== 3898+0+0 (unknown 3643862915 0 0) 0x7fb4f404e1b0 con 0x7fb50413f750 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.106+0000 7fb509331640 10 monclient: get_auth_request con 0x7fb4f00400f0 auth_method 0 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.107+0000 7fb508b30640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.181:6790/0 conn(0x7fb4e4002860 legacy=0x7fb4e4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608198616 0 0) 0x7fb4e40065c0 con 0x7fb4e4002860 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 10 monclient(hunting): my global_id is 124103 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb504142b60 con 0x7fb4e4002860 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1039414645 0 0) 0x7fb504142b60 con 0x7fb4e4002860 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4e40065c0 con 0x7fb4e4002860 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb500001c40 con 0x7fb4e4002860 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 10 monclient: dump: 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.124 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.125 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.125 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.125 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.125 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.125 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.125 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.126 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.126 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.126 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.126 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.126 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1505549590 0 0) 0x7fb4e40065c0 con 0x7fb4e4002860 2024-09-13T10:37:02.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.108+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4e400a160 con 0x7fb4e4002860 2024-09-13T10:37:02.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.109+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb500006890 con 0x7fb4e4002860 2024-09-13T10:37:02.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.109+0000 7fb4f97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:02.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.109+0000 7fb4f97fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:02.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.109+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.181:6790/0 conn(0x7fb4e4002860 legacy=0x7fb4e4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.109+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.181:6790/0 conn(0x7fb4e4002860 legacy=0x7fb4e4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.127 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39127]: starting. 2024-09-13T10:37:02.127 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39127]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39125 2024-09-13T10:37:02.127 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39127]: shutting down. 2024-09-13T10:37:02.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.116+0000 7fb50ad94640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:02.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.116+0000 7fb50ad94640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb4e4009e70 con 0x7fb4e4009130 2024-09-13T10:37:02.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.119+0000 7fb508b30640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.181:6790/0 conn(0x7fb4e4009130 legacy=0x7fb4e40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.132+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026034887 0 0) 0x7fb4e4009e70 con 0x7fb4e4009130 2024-09-13T10:37:02.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.132+0000 7fb4f97fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.132+0000 7fb4f97fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.132+0000 7fb4f97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.132+0000 7fb4f97fa640 10 monclient(hunting): my global_id is 124112 2024-09-13T10:37:02.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4e40065c0 con 0x7fb4e4009130 2024-09-13T10:37:02.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4131050158 0 0) 0x7fb4e40065c0 con 0x7fb4e4009130 2024-09-13T10:37:02.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4e4009e70 con 0x7fb4e4009130 2024-09-13T10:37:02.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb500003d00 con 0x7fb4e4009130 2024-09-13T10:37:02.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:02.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 10 monclient: dump: 2024-09-13T10:37:02.136 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.136 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.136 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.136 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.136 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.136 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.136 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4146157489 0 0) 0x7fb4e4009e70 con 0x7fb4e4009130 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb4e400c410 con 0x7fb4e4009130 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7557 (unknown 0 0 3526534080) 0x7fb500006b00 con 0x7fb4e4009130 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:02.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:02.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.181:6790/0 conn(0x7fb4e4009130 legacy=0x7fb4e40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.133+0000 7fb4f97fa640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.181:6790/0 conn(0x7fb4e4009130 legacy=0x7fb4e40095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.138 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:02.138 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:02.138 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:02.138 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:02.138 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:02.138 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 592, 2024-09-13T10:37:02.138 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:02.138 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:02.139 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.140 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.140 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.140 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.140 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.140 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.140 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.140 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.140 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.140 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.140 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.140 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.140 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.142 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:02.142 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:02.142 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:02.142 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:02.142 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:02.142 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:02.142 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:02.142 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:02.142 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.143 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:02.144 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.145 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.147 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:02.147 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:02.147 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.147 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.147 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.148 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:02.148 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:02.148 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.148 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.149 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.149 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:02.149 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.149 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.149 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.149 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:02.149 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:02.149 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.149 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.149 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.150 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:02.151 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:02.151 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.151 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.151 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.151 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:02.151 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:02.151 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.151 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.153 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:02.153 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:02.154 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.154 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.154 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.154 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:02.154 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.154 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.155 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.157 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:02.157 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:02.157 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.157 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.158 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:02.159 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:02.159 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.159 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.159 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.159 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:02.159 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.159 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.159 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.160 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:02.160 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:02.160 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.160 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.160 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.160 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.160 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.160 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:02.161 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.162 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.162 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:02.162 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:02.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.134+0000 7fb50ad94640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb4f00400f0 legacy=0x7fb4f00425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.134+0000 7fb50ad94640 10 monclient: shutdown 2024-09-13T10:37:02.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.134+0000 7fb50ad94640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:02.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.134+0000 7fb50ad94640 1 -- 172.21.15.181:0/833076528 >> v1:172.21.15.195:6791/0 conn(0x7fb50413f750 legacy=0x7fb5041d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.134+0000 7fb509331640 1 -- 172.21.15.181:0/833076528 reap_dead start 2024-09-13T10:37:02.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.134+0000 7fb509331640 1 -- 172.21.15.181:0/833076528 reap_dead start 2024-09-13T10:37:02.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.134+0000 7fb50ad94640 1 -- 172.21.15.181:0/833076528 shutdown_connections 2024-09-13T10:37:02.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.134+0000 7fb50ad94640 1 -- 172.21.15.181:0/833076528 >> 172.21.15.181:0/833076528 conn(0x7fb5040a6640 msgr2=0x7fb5040a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:02.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.134+0000 7fb50ad94640 1 -- 172.21.15.181:0/833076528 shutdown_connections 2024-09-13T10:37:02.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.134+0000 7fb50ad94640 1 -- 172.21.15.181:0/833076528 wait complete. 2024-09-13T10:37:02.164 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:02.165 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:37:02.166 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:37:02.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.262+0000 7f523a260640 10 monclient: get_monmap_and_config 2024-09-13T10:37:02.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.262+0000 7f523a260640 10 monclient: build_initial_monmap 2024-09-13T10:37:02.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.262+0000 7f523a260640 10 monclient: monmap: 2024-09-13T10:37:02.264 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:02.263378+0000 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:02.263378+0000 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:02.265 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:02.266 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.263+0000 7f523a260640 1 Processor -- start 2024-09-13T10:37:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.263+0000 7f523a260640 1 -- start start 2024-09-13T10:37:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.263+0000 7f523a260640 10 monclient: init 2024-09-13T10:37:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.264+0000 7f523a260640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.264+0000 7f523a260640 10 monclient: _add_conns ranks=[8,3,7,4,2,5,0,1,6] 2024-09-13T10:37:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.264+0000 7f523a260640 10 monclient(hunting): picked mon.noname-e con 0x7f52340a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.264+0000 7f523a260640 10 monclient(hunting): picked mon.noname-g con 0x7f52340a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.264+0000 7f523a260640 10 monclient(hunting): picked mon.noname-i con 0x7f523413f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.264+0000 7f523a260640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52340a4bc0 con 0x7f52340a8340 2024-09-13T10:37:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.264+0000 7f523a260640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f523413a320 con 0x7f523413f750 2024-09-13T10:37:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.264+0000 7f523a260640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52340a8100 con 0x7f52340a6640 2024-09-13T10:37:02.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.264+0000 7f523a260640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.264+0000 7f523a260640 10 monclient(hunting): authenticate will time out at 1161.769134s 2024-09-13T10:37:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.264+0000 7f52337fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f52340a6640 0x7f5234139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:51236/0 (socket says 172.21.15.181:51236) 2024-09-13T10:37:02.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.264+0000 7f52337fe640 1 -- 172.21.15.181:0/1232784050 learned_addr learned my addr 172.21.15.181:0/1232784050 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:02.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f52337fe640 1 -- 172.21.15.181:0/1232784050 >> v1:172.21.15.181:6793/0 conn(0x7f52340a6640 legacy=0x7f5234139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 1 -- 172.21.15.181:0/1232784050 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 362009525 0 0) 0x7f52340a8100 con 0x7f52340a6640 2024-09-13T10:37:02.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient(hunting): my global_id is 104921 2024-09-13T10:37:02.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 1 -- 172.21.15.181:0/1232784050 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5220003520 con 0x7f52340a6640 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f522affd640 1 -- 172.21.15.181:0/1232784050 >> v1:172.21.15.195:6790/0 conn(0x7f52340a8340 legacy=0x7f5234139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5233fff640 1 -- 172.21.15.181:0/1232784050 >> v1:172.21.15.195:6792/0 conn(0x7f523413f750 legacy=0x7f5234141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 1 -- 172.21.15.181:0/1232784050 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2938736390 0 0) 0x7f5220003520 con 0x7f52340a6640 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 1 -- 172.21.15.181:0/1232784050 >> v1:172.21.15.195:6792/0 conn(0x7f523413f750 legacy=0x7f5234141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 1 -- 172.21.15.181:0/1232784050 >> v1:172.21.15.195:6790/0 conn(0x7f52340a8340 legacy=0x7f5234139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 1 monclient: found mon.noname-e 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 1 -- 172.21.15.181:0/1232784050 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52340a48e0 con 0x7f52340a6640 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:02.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 1 -- 172.21.15.181:0/1232784050 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5224001ba0 con 0x7f52340a6640 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f523a260640 5 monclient: authenticate success, global_id 104921 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f523a260640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient: dump: 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.273 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f523a260640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 1 -- 172.21.15.181:0/1232784050 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52240048a0 con 0x7f52340a6640 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 1 -- 172.21.15.181:0/1232784050 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5224004dd0 con 0x7f52340a6640 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f523a260640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:02.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f523a260640 4 set_mon_vals no callback set 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.266+0000 7f5232ffd640 10 monclient: dump: 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.275 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.267+0000 7f523a260640 10 monclient: shutdown 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.267+0000 7f523a260640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.267+0000 7f523a260640 1 -- 172.21.15.181:0/1232784050 >> v1:172.21.15.181:6793/0 conn(0x7f52340a6640 legacy=0x7f5234139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.267+0000 7f523a260640 1 -- 172.21.15.181:0/1232784050 shutdown_connections 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.267+0000 7f523a260640 1 -- 172.21.15.181:0/1232784050 >> 172.21.15.181:0/1232784050 conn(0x7f5234077170 msgr2=0x7f52340abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.267+0000 7f523a260640 1 -- 172.21.15.181:0/1232784050 shutdown_connections 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.267+0000 7f523a260640 1 -- 172.21.15.181:0/1232784050 wait complete. 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.268+0000 7f523a260640 10 monclient: build_initial_monmap 2024-09-13T10:37:02.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.268+0000 7f523a260640 10 monclient: monmap: 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:02.277 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.268+0000 7f523a260640 1 Processor -- start 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.268+0000 7f523a260640 1 -- start start 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.268+0000 7f523a260640 10 monclient: init 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.269+0000 7f523a260640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.269+0000 7f523a260640 10 monclient: _add_conns ranks=[8,3,2,0,6,5,1,4,7] 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.269+0000 7f523a260640 10 monclient(hunting): picked mon.noname-e con 0x7f52340a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.269+0000 7f523a260640 10 monclient(hunting): picked mon.noname-g con 0x7f523413f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.269+0000 7f523a260640 10 monclient(hunting): picked mon.noname-b con 0x7f523413cb70 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.269+0000 7f523a260640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5234134cb0 con 0x7f523413cb70 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.269+0000 7f523a260640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5234134f90 con 0x7f523413f750 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.269+0000 7f523a260640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5234134400 con 0x7f52340a8340 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.269+0000 7f523a260640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:02.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.269+0000 7f523a260640 10 monclient(hunting): authenticate will time out at 1161.774145s 2024-09-13T10:37:02.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.269+0000 7f52337fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f52340a8340 0x7f523412f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:51250/0 (socket says 172.21.15.181:51250) 2024-09-13T10:37:02.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.269+0000 7f52337fe640 1 -- 172.21.15.181:0/2068173038 learned_addr learned my addr 172.21.15.181:0/2068173038 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f52337fe640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.181:6793/0 conn(0x7f52340a8340 legacy=0x7f523412f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5233fff640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.181:6790/0 conn(0x7f523413cb70 legacy=0x7f52341d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612748632 0 0) 0x7f5234134400 con 0x7f52340a8340 2024-09-13T10:37:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): my global_id is 104930 2024-09-13T10:37:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5214003550 con 0x7f52340a8340 2024-09-13T10:37:02.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971401108 0 0) 0x7f5234134cb0 con 0x7f523413cb70 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): my global_id is 124121 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5234134400 con 0x7f523413cb70 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f522affd640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.195:6790/0 conn(0x7f523413f750 legacy=0x7f523412fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1175050037 0 0) 0x7f5214003550 con 0x7f52340a8340 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5234134cb0 con 0x7f52340a8340 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5224004d90 con 0x7f52340a8340 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.284 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.285 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.286 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.286 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.286 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.286 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:02.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 789783775 0 0) 0x7f5234134400 con 0x7f523413cb70 2024-09-13T10:37:02.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5214003550 con 0x7f523413cb70 2024-09-13T10:37:02.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f522c002000 con 0x7f523413cb70 2024-09-13T10:37:02.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:02.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:02.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.287 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933958780 0 0) 0x7f5234134f90 con 0x7f523413f750 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient(hunting): my global_id is 6600 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5234134400 con 0x7f523413f750 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 580468967 0 0) 0x7f5234134cb0 con 0x7f52340a8340 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.195:6790/0 conn(0x7f523413f750 legacy=0x7f523412fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.181:6790/0 conn(0x7f523413cb70 legacy=0x7f52341d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 monclient: found mon.e 2024-09-13T10:37:02.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523413d620 con 0x7f52340a8340 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient: _finish_auth 0 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f5230ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f523a260640 5 monclient: authenticate success, global_id 104930 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f523a260640 10 monclient: _renew_subs 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f523a260640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f523a260640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f523413e730 con 0x7f52340a8340 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f523a260640 10 monclient: _renew_subs 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f523a260640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.271+0000 7f523a260640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f52341d7e60 con 0x7f52340a8340 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.272+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52240048a0 con 0x7f52340a8340 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.272+0000 7f5230ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:02.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.272+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5224001b80 con 0x7f52340a8340 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.272+0000 7f5230ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.272+0000 7f5230ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.272+0000 7f52327fc640 4 set_mon_vals no callback set 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.272+0000 7f5230ff9640 10 monclient: dump: 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.290 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.272+0000 7f523a260640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.272+0000 7f523a260640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f52180065c0 con 0x7f5218002860 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.272+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5224011af0 con 0x7f52340a8340 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.273+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(223..223 src has 1..223) ==== 3506+0+0 (unknown 663386887 0 0) 0x7f522404e320 con 0x7f52340a8340 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.273+0000 7f5233fff640 10 monclient: get_auth_request con 0x7f5214040210 auth_method 0 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.274+0000 7f522affd640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.181:6791/0 conn(0x7f5218002860 legacy=0x7f5218004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2971338751 0 0) 0x7f52180065c0 con 0x7f5218002860 2024-09-13T10:37:02.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 10 monclient(hunting): my global_id is 114538 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5234134cb0 con 0x7f5218002860 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1541502367 0 0) 0x7f5234134cb0 con 0x7f5218002860 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52180065c0 con 0x7f5218002860 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f521c001bf0 con 0x7f5218002860 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 10 monclient: dump: 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.292 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 824159843 0 0) 0x7f52180065c0 con 0x7f5218002860 2024-09-13T10:37:02.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f521800a160 con 0x7f5218002860 2024-09-13T10:37:02.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f521c0057c0 con 0x7f5218002860 2024-09-13T10:37:02.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:02.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:02.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.181:6791/0 conn(0x7f5218002860 legacy=0x7f5218004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.275+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.181:6791/0 conn(0x7f5218002860 legacy=0x7f5218004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.281+0000 7f523a260640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:02.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.281+0000 7f523a260640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5218009e50 con 0x7f5218009110 2024-09-13T10:37:02.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f522affd640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.181:6791/0 conn(0x7f5218009110 legacy=0x7f52180095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177074416 0 0) 0x7f5218009e50 con 0x7f5218009110 2024-09-13T10:37:02.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 10 monclient(hunting): my global_id is 114547 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52180065c0 con 0x7f5218009110 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 524052269 0 0) 0x7f52180065c0 con 0x7f5218009110 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5218009e50 con 0x7f5218009110 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f521c003d40 con 0x7f5218009110 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 10 monclient: dump: 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.296 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3854327125 0 0) 0x7f5218009e50 con 0x7f5218009110 2024-09-13T10:37:02.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f521800c3a0 con 0x7f5218009110 2024-09-13T10:37:02.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 2068852363) 0x7f521c003fe0 con 0x7f5218009110 2024-09-13T10:37:02.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:02.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:02.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.181:6791/0 conn(0x7f5218009110 legacy=0x7f52180095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.284+0000 7f5230ff9640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.181:6791/0 conn(0x7f5218009110 legacy=0x7f52180095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.298 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 58262, 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:37:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.308 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.310 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.311 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:02.313 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.314 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.315 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.316 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.317 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.318 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:02.318 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:02.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.285+0000 7f523a260640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5214040210 legacy=0x7f52140426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.285+0000 7f523a260640 10 monclient: shutdown 2024-09-13T10:37:02.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.285+0000 7f523a260640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:02.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.285+0000 7f523a260640 1 -- 172.21.15.181:0/2068173038 >> v1:172.21.15.181:6793/0 conn(0x7f52340a8340 legacy=0x7f523412f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.285+0000 7f5233fff640 1 -- 172.21.15.181:0/2068173038 reap_dead start 2024-09-13T10:37:02.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.285+0000 7f5233fff640 1 -- 172.21.15.181:0/2068173038 reap_dead start 2024-09-13T10:37:02.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.285+0000 7f523a260640 1 -- 172.21.15.181:0/2068173038 shutdown_connections 2024-09-13T10:37:02.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.285+0000 7f523a260640 1 -- 172.21.15.181:0/2068173038 >> 172.21.15.181:0/2068173038 conn(0x7f52340a6640 msgr2=0x7f52340a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:02.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.285+0000 7f523a260640 1 -- 172.21.15.181:0/2068173038 shutdown_connections 2024-09-13T10:37:02.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.285+0000 7f523a260640 1 -- 172.21.15.181:0/2068173038 wait complete. 2024-09-13T10:37:02.320 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:02.320 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:37:02.320 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:37:02.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.418+0000 7f41df317640 10 monclient: get_monmap_and_config 2024-09-13T10:37:02.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.418+0000 7f41df317640 10 monclient: build_initial_monmap 2024-09-13T10:37:02.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.418+0000 7f41df317640 10 monclient: monmap: 2024-09-13T10:37:02.420 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:02.420 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.420 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:02.419460+0000 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:02.419460+0000 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:02.421 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.419+0000 7f41df317640 1 Processor -- start 2024-09-13T10:37:02.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.419+0000 7f41df317640 1 -- start start 2024-09-13T10:37:02.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.419+0000 7f41df317640 10 monclient: init 2024-09-13T10:37:02.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41df317640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:02.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41df317640 10 monclient: _add_conns ranks=[1,8,4,7,5,0,2,6,3] 2024-09-13T10:37:02.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41df317640 10 monclient(hunting): picked mon.noname-f con 0x7f41d8139040 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:02.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41df317640 10 monclient(hunting): picked mon.noname-e con 0x7f41d809cd50 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:02.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41df317640 10 monclient(hunting): picked mon.noname-c con 0x7f41d813fae0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:02.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41df317640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d809dbb0 con 0x7f41d8139040 2024-09-13T10:37:02.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41df317640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d809de90 con 0x7f41d813fae0 2024-09-13T10:37:02.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41df317640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d809e170 con 0x7f41d809cd50 2024-09-13T10:37:02.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41df317640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:02.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41df317640 10 monclient(hunting): authenticate will time out at 1161.925284s 2024-09-13T10:37:02.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41dd8b4640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f41d813fae0 0x7f41d8141ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53310/0 (socket says 172.21.15.181:53310) 2024-09-13T10:37:02.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41dd8b4640 1 -- 172.21.15.181:0/886043884 learned_addr learned my addr 172.21.15.181:0/886043884 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:02.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.420+0000 7f41dc8b2640 1 --1- 172.21.15.181:0/886043884 >> v1:172.21.15.181:6793/0 conn(0x7f41d809cd50 0x7f41d813e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:51260/0 (socket says 172.21.15.181:51260) 2024-09-13T10:37:02.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41dc8b2640 1 -- 172.21.15.181:0/886043884 >> v1:172.21.15.181:6793/0 conn(0x7f41d809cd50 legacy=0x7f41d813e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41dd8b4640 1 -- 172.21.15.181:0/886043884 >> v1:172.21.15.181:6791/0 conn(0x7f41d813fae0 legacy=0x7f41d8141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 1 -- 172.21.15.181:0/886043884 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1485275052 0 0) 0x7f41d809e170 con 0x7f41d809cd50 2024-09-13T10:37:02.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient(hunting): my global_id is 104939 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 1 -- 172.21.15.181:0/886043884 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41c4003520 con 0x7f41d809cd50 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 1 -- 172.21.15.181:0/886043884 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870062724 0 0) 0x7f41d809de90 con 0x7f41d813fae0 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient(hunting): my global_id is 114556 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 1 -- 172.21.15.181:0/886043884 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d809e170 con 0x7f41d813fae0 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41dd0b3640 1 -- 172.21.15.181:0/886043884 >> v1:172.21.15.195:6789/0 conn(0x7f41d8139040 legacy=0x7f41d80a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 1 -- 172.21.15.181:0/886043884 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2605190131 0 0) 0x7f41c4003520 con 0x7f41d809cd50 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 1 -- 172.21.15.181:0/886043884 >> v1:172.21.15.181:6791/0 conn(0x7f41d813fae0 legacy=0x7f41d8141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 1 -- 172.21.15.181:0/886043884 >> v1:172.21.15.195:6789/0 conn(0x7f41d8139040 legacy=0x7f41d80a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient: _finish_hunting 0 2024-09-13T10:37:02.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 1 monclient: found mon.noname-e 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 1 -- 172.21.15.181:0/886043884 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d80a5ff0 con 0x7f41d809cd50 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient: _finish_auth 0 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient: _check_auth_tickets 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 1 -- 172.21.15.181:0/886043884 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41c8001ae0 con 0x7f41d809cd50 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41df317640 5 monclient: authenticate success, global_id 104939 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41df317640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41cffff640 10 monclient: dump: 2024-09-13T10:37:02.433 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.434 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.422+0000 7f41df317640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41dc8b2640 1 --1- 172.21.15.181:0/886043884 >> v1:172.21.15.181:6793/0 conn(0x7f41d809cd50 0x7f41d813e3c0 :-1 s=OPENED pgs=487 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f41c8004d50 mon_map magic: 0 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41cffff640 1 -- 172.21.15.181:0/886043884 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41c80047e0 con 0x7f41d809cd50 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41cffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41df317640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41df317640 4 set_mon_vals no callback set 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41df317640 10 monclient: shutdown 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41df317640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41df317640 1 -- 172.21.15.181:0/886043884 >> v1:172.21.15.181:6793/0 conn(0x7f41d809cd50 legacy=0x7f41d813e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41cffff640 1 -- 172.21.15.181:0/886043884 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41c8004d50 con 0x7f41d809cd50 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41cffff640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:37:02.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41df317640 1 -- 172.21.15.181:0/886043884 shutdown_connections 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41df317640 1 -- 172.21.15.181:0/886043884 >> 172.21.15.181:0/886043884 conn(0x7f41d8077120 msgr2=0x7f41d80abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41df317640 1 -- 172.21.15.181:0/886043884 shutdown_connections 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.423+0000 7f41df317640 1 -- 172.21.15.181:0/886043884 wait complete. 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.424+0000 7f41df317640 10 monclient: build_initial_monmap 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.424+0000 7f41df317640 10 monclient: monmap: 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:02.436 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.424+0000 7f41df317640 1 Processor -- start 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.424+0000 7f41df317640 1 -- start start 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.424+0000 7f41df317640 10 monclient: init 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.424+0000 7f41df317640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.424+0000 7f41df317640 10 monclient: _add_conns ranks=[8,5,6,4,0,1,2,7,3] 2024-09-13T10:37:02.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.425+0000 7f41df317640 10 monclient(hunting): picked mon.noname-e con 0x7f41d809cd50 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.425+0000 7f41df317640 10 monclient(hunting): picked mon.noname-h con 0x7f41d8139040 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.425+0000 7f41df317640 10 monclient(hunting): picked mon.noname-d con 0x7f41d813fae0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.425+0000 7f41df317640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d81356b0 con 0x7f41d8139040 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.425+0000 7f41df317640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d813ef50 con 0x7f41d813fae0 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.425+0000 7f41df317640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d8143330 con 0x7f41d809cd50 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.425+0000 7f41df317640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.425+0000 7f41df317640 10 monclient(hunting): authenticate will time out at 1161.930077s 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.425+0000 7f41dd0b3640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f41d809cd50 0x7f41d8133c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:51266/0 (socket says 172.21.15.181:51266) 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.425+0000 7f41dd0b3640 1 -- 172.21.15.181:0/4064553950 learned_addr learned my addr 172.21.15.181:0/4064553950 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41dd0b3640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6793/0 conn(0x7f41d809cd50 legacy=0x7f41d8133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41dd8b4640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41d813fae0 legacy=0x7f41d8134a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4011700591 0 0) 0x7f41d8143330 con 0x7f41d809cd50 2024-09-13T10:37:02.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): my global_id is 104948 2024-09-13T10:37:02.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41bc003520 con 0x7f41d809cd50 2024-09-13T10:37:02.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41dc8b2640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.195:6791/0 conn(0x7f41d8139040 legacy=0x7f41d8134350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3764559957 0 0) 0x7f41d0002090 con 0x7f41d813fae0 2024-09-13T10:37:02.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): my global_id is 124134 2024-09-13T10:37:02.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d8143330 con 0x7f41d813fae0 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122475412 0 0) 0x7f41d81356b0 con 0x7f41d8139040 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): my global_id is 104693 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d0002090 con 0x7f41d8139040 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 815054207 0 0) 0x7f41bc003520 con 0x7f41d809cd50 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41d81356b0 con 0x7f41d809cd50 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41d4003610 con 0x7f41d809cd50 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): dump: 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.440 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.441 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:02.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2306152832 0 0) 0x7f41d8143330 con 0x7f41d813fae0 2024-09-13T10:37:02.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41bc003520 con 0x7f41d813fae0 2024-09-13T10:37:02.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41d0004b60 con 0x7f41d813fae0 2024-09-13T10:37:02.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:02.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:02.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient(hunting): dump: 2024-09-13T10:37:02.442 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.442 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.442 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.443 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.443 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.443 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.443 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.443 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.443 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.443 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.443 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.443 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3583398543 0 0) 0x7f41d81356b0 con 0x7f41d809cd50 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41d813fae0 legacy=0x7f41d8134a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.195:6791/0 conn(0x7f41d8139040 legacy=0x7f41d8134350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient: _finish_hunting 0 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 monclient: found mon.e 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d813af90 con 0x7f41d809cd50 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient: _finish_auth 0 2024-09-13T10:37:02.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 10 monclient: _check_auth_tickets 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41df317640 5 monclient: authenticate success, global_id 104948 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41df317640 10 monclient: _renew_subs 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41df317640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.427+0000 7f41df317640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f41d8136210 con 0x7f41d809cd50 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41d4003bd0 con 0x7f41d809cd50 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41cdffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41d40040c0 con 0x7f41d809cd50 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41cdffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41cdffb640 10 monclient: dump: 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.445 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.446 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.446 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.446 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.446 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.446 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.448 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.448 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.448 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.448 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.448 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.448 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.448 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.448 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41df317640 10 monclient: _renew_subs 2024-09-13T10:37:02.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41cf7fe640 4 set_mon_vals no callback set 2024-09-13T10:37:02.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41df317640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:02.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41df317640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f41d81d7980 con 0x7f41d809cd50 2024-09-13T10:37:02.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41df317640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:02.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f41d4004260 con 0x7f41d809cd50 2024-09-13T10:37:02.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.428+0000 7f41df317640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f41d80008d0 con 0x7f41d813fec0 2024-09-13T10:37:02.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.429+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(223..223 src has 1..223) ==== 3506+0+0 (unknown 663386887 0 0) 0x7f41d404e1f0 con 0x7f41d809cd50 2024-09-13T10:37:02.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.429+0000 7f41dd8b4640 10 monclient: get_auth_request con 0x7f41bc040090 auth_method 0 2024-09-13T10:37:02.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41dc8b2640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41d813fec0 legacy=0x7f41d81402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615317536 0 0) 0x7f41d80008d0 con 0x7f41d813fec0 2024-09-13T10:37:02.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41cdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41cdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41cdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41cdffb640 10 monclient(hunting): my global_id is 124143 2024-09-13T10:37:02.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d81356b0 con 0x7f41d813fec0 2024-09-13T10:37:02.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41dc8b2640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41d813fec0 legacy=0x7f41d81402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-13T10:37:02.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41dc8b2640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41d813fec0 legacy=0x7f41d81402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:37:02.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41dc8b2640 1 --1- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41d813fec0 0x7f41d81402a0 :-1 s=OPENED pgs=512 cs=1 l=1).handle_message read tag failed 2024-09-13T10:37:02.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41dc8b2640 1 --1- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41d813fec0 0x7f41d81402a0 :-1 s=OPENED pgs=512 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:37:02.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41d813fec0 legacy=0x7f41d81402a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41d813fec0 legacy=0x7f41d81402a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.431+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f41d80008d0 con 0x7f41bc0465a0 2024-09-13T10:37:02.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.433+0000 7f41dc8b2640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41bc0465a0 legacy=0x7f41bc0469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.433+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3129247763 0 0) 0x7f41d80008d0 con 0x7f41bc0465a0 2024-09-13T10:37:02.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.433+0000 7f41cdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.433+0000 7f41cdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.433+0000 7f41cdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.433+0000 7f41cdffb640 10 monclient(hunting): my global_id is 124152 2024-09-13T10:37:02.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.433+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d0002090 con 0x7f41bc0465a0 2024-09-13T10:37:02.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 587621178 0 0) 0x7f41d0002090 con 0x7f41bc0465a0 2024-09-13T10:37:02.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41d80008d0 con 0x7f41bc0465a0 2024-09-13T10:37:02.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41c8001d30 con 0x7f41bc0465a0 2024-09-13T10:37:02.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:02.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 10 monclient: dump: 2024-09-13T10:37:02.456 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.456 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.456 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.456 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.457 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.457 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.457 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.457 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.457 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.457 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.457 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.457 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.457 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.457 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.457 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3906296963 0 0) 0x7f41d80008d0 con 0x7f41bc0465a0 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41bc048220 con 0x7f41bc0465a0 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f41c80054a0 con 0x7f41bc0465a0 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41bc0465a0 legacy=0x7f41bc0469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.434+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41bc0465a0 legacy=0x7f41bc0469b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.440+0000 7f41df317640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.440+0000 7f41df317640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f41d809cb10 con 0x7f41d81409b0 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.442+0000 7f41dc8b2640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41d81409b0 legacy=0x7f41d81dbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1800430544 0 0) 0x7f41d809cb10 con 0x7f41d81409b0 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 10 monclient(hunting): my global_id is 124161 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d80008d0 con 0x7f41d81409b0 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3681480159 0 0) 0x7f41d80008d0 con 0x7f41d81409b0 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41d809cb10 con 0x7f41d81409b0 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41c8005b80 con 0x7f41d81409b0 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 10 monclient: dump: 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.459 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2505648283 0 0) 0x7f41d809cb10 con 0x7f41d81409b0 2024-09-13T10:37:02.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f41d8140d90 con 0x7f41d81409b0 2024-09-13T10:37:02.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7557 (unknown 0 0 1766893050) 0x7f41c8005ed0 con 0x7f41d81409b0 2024-09-13T10:37:02.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:02.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:02.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41d81409b0 legacy=0x7f41d81dbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41cdffb640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6792/0 conn(0x7f41d81409b0 legacy=0x7f41d81dbb70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.443+0000 7f41dd8b4640 1 -- 172.21.15.181:0/4064553950 reap_dead start 2024-09-13T10:37:02.461 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:02.461 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:02.461 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:02.461 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 902, 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:02.462 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.463 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.464 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:02.465 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.466 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.467 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:02.468 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.469 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.470 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:02.471 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.472 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:02.474 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.475 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.477 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.478 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.479 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.480 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.480 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:02.480 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.480 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.480 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:02.480 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:02.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.444+0000 7f41df317640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.195:6800/1839191919 conn(0x7f41bc040090 legacy=0x7f41bc042550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.444+0000 7f41df317640 10 monclient: shutdown 2024-09-13T10:37:02.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.444+0000 7f41df317640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:02.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.444+0000 7f41df317640 1 -- 172.21.15.181:0/4064553950 >> v1:172.21.15.181:6793/0 conn(0x7f41d809cd50 legacy=0x7f41d8133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.444+0000 7f41df317640 1 -- 172.21.15.181:0/4064553950 shutdown_connections 2024-09-13T10:37:02.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.444+0000 7f41df317640 1 -- 172.21.15.181:0/4064553950 >> 172.21.15.181:0/4064553950 conn(0x7f41d8077120 msgr2=0x7f41d812c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:02.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.444+0000 7f41df317640 1 -- 172.21.15.181:0/4064553950 shutdown_connections 2024-09-13T10:37:02.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.444+0000 7f41df317640 1 -- 172.21.15.181:0/4064553950 wait complete. 2024-09-13T10:37:02.482 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:02.482 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:37:02.482 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:37:02.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.580+0000 7f0fb7d56640 10 monclient: get_monmap_and_config 2024-09-13T10:37:02.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.580+0000 7f0fb7d56640 10 monclient: build_initial_monmap 2024-09-13T10:37:02.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.580+0000 7f0fb7d56640 10 monclient: monmap: 2024-09-13T10:37:02.582 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:02.582 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.582 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:02.581457+0000 2024-09-13T10:37:02.583 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:02.581457+0000 2024-09-13T10:37:02.583 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:02.583 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.583 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:02.583 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:02.583 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:02.583 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:02.583 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:02.583 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:02.583 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:02.583 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:02.583 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:02.584 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.581+0000 7f0fb7d56640 1 Processor -- start 2024-09-13T10:37:02.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.581+0000 7f0fb7d56640 1 -- start start 2024-09-13T10:37:02.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.581+0000 7f0fb7d56640 10 monclient: init 2024-09-13T10:37:02.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.582+0000 7f0fb7d56640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:02.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.582+0000 7f0fb7d56640 10 monclient: _add_conns ranks=[0,3,5,7,8,2,6,1,4] 2024-09-13T10:37:02.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.582+0000 7f0fb7d56640 10 monclient(hunting): picked mon.noname-a con 0x7f0fb00a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:02.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.582+0000 7f0fb7d56640 10 monclient(hunting): picked mon.noname-g con 0x7f0fb00a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:02.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.582+0000 7f0fb7d56640 10 monclient(hunting): picked mon.noname-h con 0x7f0fb013f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:02.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.582+0000 7f0fb7d56640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb00a4bc0 con 0x7f0fb00a6640 2024-09-13T10:37:02.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.582+0000 7f0fb7d56640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb013a320 con 0x7f0fb00a8340 2024-09-13T10:37:02.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.582+0000 7f0fb7d56640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb00a8100 con 0x7f0fb013f750 2024-09-13T10:37:02.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.582+0000 7f0fb7d56640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:02.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.582+0000 7f0fb7d56640 10 monclient(hunting): authenticate will time out at 1162.087217s 2024-09-13T10:37:02.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.582+0000 7f0fb5af2640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0fb00a6640 0x7f0fb0139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:40418/0 (socket says 172.21.15.181:40418) 2024-09-13T10:37:02.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.582+0000 7f0fb5af2640 1 -- 172.21.15.181:0/1144956285 learned_addr learned my addr 172.21.15.181:0/1144956285 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:02.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb5af2640 1 -- 172.21.15.181:0/1144956285 >> v1:172.21.15.181:6789/0 conn(0x7f0fb00a6640 legacy=0x7f0fb0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb52f1640 1 -- 172.21.15.181:0/1144956285 >> v1:172.21.15.195:6790/0 conn(0x7f0fb00a8340 legacy=0x7f0fb0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb62f3640 1 -- 172.21.15.181:0/1144956285 >> v1:172.21.15.195:6791/0 conn(0x7f0fb013f750 legacy=0x7f0fb0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 239765467 0 0) 0x7f0fb00a4bc0 con 0x7f0fb00a6640 2024-09-13T10:37:02.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient(hunting): my global_id is 114462 2024-09-13T10:37:02.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f9c003520 con 0x7f0fb00a6640 2024-09-13T10:37:02.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2693985787 0 0) 0x7f0fb013a320 con 0x7f0fb00a8340 2024-09-13T10:37:02.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient(hunting): my global_id is 6609 2024-09-13T10:37:02.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fb00a4bc0 con 0x7f0fb00a8340 2024-09-13T10:37:02.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 789193818 0 0) 0x7f0fb00a8100 con 0x7f0fb013f750 2024-09-13T10:37:02.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient(hunting): my global_id is 104702 2024-09-13T10:37:02.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fb013a320 con 0x7f0fb013f750 2024-09-13T10:37:02.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 469590750 0 0) 0x7f0f9c003520 con 0x7f0fb00a6640 2024-09-13T10:37:02.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 >> v1:172.21.15.195:6791/0 conn(0x7f0fb013f750 legacy=0x7f0fb0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 >> v1:172.21.15.195:6790/0 conn(0x7f0fb00a8340 legacy=0x7f0fb0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient: _finish_hunting 0 2024-09-13T10:37:02.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 monclient: found mon.noname-a 2024-09-13T10:37:02.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:02.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:37:02.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb00a48e0 con 0x7f0fb00a6640 2024-09-13T10:37:02.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient: _finish_auth 0 2024-09-13T10:37:02.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient: _check_auth_tickets 2024-09-13T10:37:02.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:02.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb7d56640 5 monclient: authenticate success, global_id 114462 2024-09-13T10:37:02.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0fac001ae0 con 0x7f0fb00a6640 2024-09-13T10:37:02.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb7d56640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:02.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:02.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient: dump: 2024-09-13T10:37:02.594 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.594 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.594 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.594 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.594 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.594 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.594 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.594 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.594 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.595 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.595 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.595 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.595 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.595 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.595 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.595 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb7d56640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:02.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0fac0048a0 con 0x7f0fb00a6640 2024-09-13T10:37:02.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:02.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb7d56640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:02.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 1 -- 172.21.15.181:0/1144956285 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0fac004e10 con 0x7f0fb00a6640 2024-09-13T10:37:02.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb7d56640 4 set_mon_vals no callback set 2024-09-13T10:37:02.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.584+0000 7f0fb4af0640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.585+0000 7f0fb4af0640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:02.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.585+0000 7f0fb4af0640 10 monclient: dump: 2024-09-13T10:37:02.596 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.596 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.596 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.596 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.596 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.596 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.597 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.597 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.597 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.597 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.597 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.597 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.597 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.597 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.597 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.597 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.585+0000 7f0fb7d56640 10 monclient: shutdown 2024-09-13T10:37:02.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.585+0000 7f0fb7d56640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:02.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.585+0000 7f0fb7d56640 1 -- 172.21.15.181:0/1144956285 >> v1:172.21.15.181:6789/0 conn(0x7f0fb00a6640 legacy=0x7f0fb0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.585+0000 7f0fb7d56640 1 -- 172.21.15.181:0/1144956285 shutdown_connections 2024-09-13T10:37:02.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.585+0000 7f0fb7d56640 1 -- 172.21.15.181:0/1144956285 >> 172.21.15.181:0/1144956285 conn(0x7f0fb0077170 msgr2=0x7f0fb00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:02.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.585+0000 7f0fb7d56640 1 -- 172.21.15.181:0/1144956285 shutdown_connections 2024-09-13T10:37:02.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.585+0000 7f0fb7d56640 1 -- 172.21.15.181:0/1144956285 wait complete. 2024-09-13T10:37:02.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 10 monclient: build_initial_monmap 2024-09-13T10:37:02.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 10 monclient: monmap: 2024-09-13T10:37:02.598 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:02.598 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:02.598 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:02.598 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:02.599 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:02.599 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:02.599 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:02.599 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:02.599 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:02.599 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:02.599 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:02.599 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:02.599 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:02.599 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:02.599 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:02.600 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 1 Processor -- start 2024-09-13T10:37:02.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 1 -- start start 2024-09-13T10:37:02.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 10 monclient: init 2024-09-13T10:37:02.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:02.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 10 monclient: _add_conns ranks=[7,2,4,3,8,0,1,5,6] 2024-09-13T10:37:02.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 10 monclient(hunting): picked mon.noname-i con 0x7f0fb00a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:02.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 10 monclient(hunting): picked mon.noname-b con 0x7f0fb013f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:02.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 10 monclient(hunting): picked mon.noname-c con 0x7f0fb0142030 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:02.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb00a9c40 con 0x7f0fb013f750 2024-09-13T10:37:02.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb0142a00 con 0x7f0fb0142030 2024-09-13T10:37:02.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb013bb70 con 0x7f0fb00a8340 2024-09-13T10:37:02.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:02.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.586+0000 7f0fb7d56640 10 monclient(hunting): authenticate will time out at 1162.091918s 2024-09-13T10:37:02.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.587+0000 7f0fb52f1640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f0fb013f750 0x7f0fb01d3510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:50768/0 (socket says 172.21.15.181:50768) 2024-09-13T10:37:02.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.587+0000 7f0fb62f3640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f0fb0142030 0x7f0fb01d6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53312/0 (socket says 172.21.15.181:53312) 2024-09-13T10:37:02.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.587+0000 7f0fb52f1640 1 -- 172.21.15.181:0/676446077 learned_addr learned my addr 172.21.15.181:0/676446077 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:02.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fb52f1640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.181:6790/0 conn(0x7f0fb013f750 legacy=0x7f0fb01d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fb62f3640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.181:6791/0 conn(0x7f0fb0142030 legacy=0x7f0fb01d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fb5af2640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.195:6792/0 conn(0x7f0fb00a8340 legacy=0x7f0fb01ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999452876 0 0) 0x7f0fb00a9c40 con 0x7f0fb013f750 2024-09-13T10:37:02.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): my global_id is 124130 2024-09-13T10:37:02.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f94003550 con 0x7f0fb013f750 2024-09-13T10:37:02.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 95349878 0 0) 0x7f0fb0142a00 con 0x7f0fb0142030 2024-09-13T10:37:02.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): my global_id is 114565 2024-09-13T10:37:02.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fb00a9c40 con 0x7f0fb0142030 2024-09-13T10:37:02.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3779253837 0 0) 0x7f0fb013bb70 con 0x7f0fb00a8340 2024-09-13T10:37:02.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): my global_id is 56779 2024-09-13T10:37:02.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fb0142a00 con 0x7f0fb00a8340 2024-09-13T10:37:02.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 402492015 0 0) 0x7f0f94003550 con 0x7f0fb013f750 2024-09-13T10:37:02.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0fb013bb70 con 0x7f0fb013f750 2024-09-13T10:37:02.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0fa0003610 con 0x7f0fb013f750 2024-09-13T10:37:02.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:02.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:37:02.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): dump: 2024-09-13T10:37:02.610 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.610 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.610 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.610 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.610 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.611 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:02.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1396671141 0 0) 0x7f0fb00a9c40 con 0x7f0fb0142030 2024-09-13T10:37:02.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f94003550 con 0x7f0fb0142030 2024-09-13T10:37:02.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3343888856 0 0) 0x7f0fb0142a00 con 0x7f0fb00a8340 2024-09-13T10:37:02.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0fb00a9c40 con 0x7f0fb00a8340 2024-09-13T10:37:02.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0fa8002070 con 0x7f0fb0142030 2024-09-13T10:37:02.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:02.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:02.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): dump: 2024-09-13T10:37:02.612 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.612 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.612 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.614 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0fac004d90 con 0x7f0fb00a8340 2024-09-13T10:37:02.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:02.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:02.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient(hunting): dump: 2024-09-13T10:37:02.614 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.614 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.614 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.614 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.614 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.614 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.614 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.615 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3099581410 0 0) 0x7f0fb013bb70 con 0x7f0fb013f750 2024-09-13T10:37:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.195:6792/0 conn(0x7f0fb00a8340 legacy=0x7f0fb01ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.181:6791/0 conn(0x7f0fb0142030 legacy=0x7f0fb01d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:37:02.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 monclient: found mon.b 2024-09-13T10:37:02.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:02.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:37:02.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb013b840 con 0x7f0fb013f750 2024-09-13T10:37:02.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient: _finish_auth 0 2024-09-13T10:37:02.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:37:02.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:02.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fb7d56640 5 monclient: authenticate success, global_id 124130 2024-09-13T10:37:02.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fb7d56640 10 monclient: _renew_subs 2024-09-13T10:37:02.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fb7d56640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:37:02.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fb7d56640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb013cdf0 con 0x7f0fb013f750 2024-09-13T10:37:02.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fb7d56640 10 monclient: _renew_subs 2024-09-13T10:37:02.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fb7d56640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:37:02.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fb7d56640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0fb01cec50 con 0x7f0fb013f750 2024-09-13T10:37:02.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0fa0003ba0 con 0x7f0fb013f750 2024-09-13T10:37:02.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:02.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0fa0004090 con 0x7f0fb013f750 2024-09-13T10:37:02.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:02.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa7fff640 4 set_mon_vals no callback set 2024-09-13T10:37:02.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.589+0000 7f0fa67fc640 10 monclient: dump: 2024-09-13T10:37:02.618 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.618 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.618 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.618 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.618 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.618 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.618 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.618 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.618 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.618 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.619 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.619 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.619 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.619 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.619 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.619 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.590+0000 7f0fb7d56640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:02.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.590+0000 7f0fb7d56640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0f980065c0 con 0x7f0f98002860 2024-09-13T10:37:02.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.590+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0fa00042e0 con 0x7f0fb013f750 2024-09-13T10:37:02.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.591+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(223..223 src has 1..223) ==== 3506+0+0 (unknown 663386887 0 0) 0x7f0fa004e220 con 0x7f0fb013f750 2024-09-13T10:37:02.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.591+0000 7f0fb62f3640 10 monclient: get_auth_request con 0x7f0f94040460 auth_method 0 2024-09-13T10:37:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.592+0000 7f0fb5af2640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.181:6793/0 conn(0x7f0f98002860 legacy=0x7f0f98004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273797356 0 0) 0x7f0f980065c0 con 0x7f0f98002860 2024-09-13T10:37:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 10 monclient(hunting): my global_id is 104957 2024-09-13T10:37:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fb013bb70 con 0x7f0f98002860 2024-09-13T10:37:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 46227399 0 0) 0x7f0fb013bb70 con 0x7f0f98002860 2024-09-13T10:37:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f980065c0 con 0x7f0f98002860 2024-09-13T10:37:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0fac001580 con 0x7f0f98002860 2024-09-13T10:37:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 10 monclient: dump: 2024-09-13T10:37:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.621 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.622 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.622 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.622 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.622 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.622 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.622 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2459357141 0 0) 0x7f0f980065c0 con 0x7f0f98002860 2024-09-13T10:37:02.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f9800a160 con 0x7f0f98002860 2024-09-13T10:37:02.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0fac001320 con 0x7f0f98002860 2024-09-13T10:37:02.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:02.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:02.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.181:6793/0 conn(0x7f0f98002860 legacy=0x7f0f98004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.593+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.181:6793/0 conn(0x7f0f98002860 legacy=0x7f0f98004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.599+0000 7f0fb7d56640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:02.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.599+0000 7f0fb7d56640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0f98009e70 con 0x7f0f98009130 2024-09-13T10:37:02.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fb5af2640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.181:6793/0 conn(0x7f0f98009130 legacy=0x7f0f980095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900796515 0 0) 0x7f0f98009e70 con 0x7f0f98009130 2024-09-13T10:37:02.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 10 monclient(hunting): my global_id is 104966 2024-09-13T10:37:02.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f980065c0 con 0x7f0f98009130 2024-09-13T10:37:02.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1932415209 0 0) 0x7f0f980065c0 con 0x7f0f98009130 2024-09-13T10:37:02.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f98009e70 con 0x7f0f98009130 2024-09-13T10:37:02.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0fac0059c0 con 0x7f0f98009130 2024-09-13T10:37:02.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:02.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 10 monclient: dump: 2024-09-13T10:37:02.624 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.624 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.624 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.624 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.625 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.625 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.625 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.625 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.625 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.625 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.625 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.625 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.625 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.625 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.625 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.625 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1841345932 0 0) 0x7f0f98009e70 con 0x7f0f98009130 2024-09-13T10:37:02.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0f9800c410 con 0x7f0f98009130 2024-09-13T10:37:02.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 217651045) 0x7f0fac0048a0 con 0x7f0f98009130 2024-09-13T10:37:02.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:02.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:02.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.181:6793/0 conn(0x7f0f98009130 legacy=0x7f0f980095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.602+0000 7f0fa67fc640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.181:6793/0 conn(0x7f0f98009130 legacy=0x7f0f980095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.626 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 106305, 2024-09-13T10:37:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:37:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:02.644 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:02.644 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.644 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:02.644 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.644 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.644 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:02.645 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:02.645 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.645 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.645 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.645 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:02.645 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:02.645 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.645 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.645 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:02.646 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.646 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:02.646 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:02.646 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.646 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.646 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.647 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:02.647 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:02.647 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.647 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:02.647 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.647 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.647 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:02.648 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:02.648 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.648 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.648 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.648 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.648 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.648 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:02.648 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:02.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.649 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.649 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.649 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:02.649 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.649 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.649 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:02.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.649 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.649 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.649 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:02.649 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.650 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.650 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:02.650 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:02.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.603+0000 7f0fb7d56640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0f94040460 legacy=0x7f0f94042920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.603+0000 7f0fb7d56640 10 monclient: shutdown 2024-09-13T10:37:02.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.603+0000 7f0fb7d56640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:02.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.603+0000 7f0fb7d56640 1 -- 172.21.15.181:0/676446077 >> v1:172.21.15.181:6790/0 conn(0x7f0fb013f750 legacy=0x7f0fb01d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.603+0000 7f0fb62f3640 1 -- 172.21.15.181:0/676446077 reap_dead start 2024-09-13T10:37:02.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.603+0000 7f0fb62f3640 1 -- 172.21.15.181:0/676446077 reap_dead start 2024-09-13T10:37:02.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.603+0000 7f0fb7d56640 1 -- 172.21.15.181:0/676446077 shutdown_connections 2024-09-13T10:37:02.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.603+0000 7f0fb7d56640 1 -- 172.21.15.181:0/676446077 >> 172.21.15.181:0/676446077 conn(0x7f0fb00a6640 msgr2=0x7f0fb00a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:02.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.603+0000 7f0fb7d56640 1 -- 172.21.15.181:0/676446077 shutdown_connections 2024-09-13T10:37:02.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.603+0000 7f0fb7d56640 1 -- 172.21.15.181:0/676446077 wait complete. 2024-09-13T10:37:02.653 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:02.653 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:37:02.653 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:37:02.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.751+0000 7f2afd623640 10 monclient: get_monmap_and_config 2024-09-13T10:37:02.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.751+0000 7f2afd623640 10 monclient: build_initial_monmap 2024-09-13T10:37:02.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.751+0000 7f2afd623640 10 monclient: monmap: 2024-09-13T10:37:02.753 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:02.753 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.753 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:02.752354+0000 2024-09-13T10:37:02.753 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:02.752354+0000 2024-09-13T10:37:02.754 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:02.754 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.754 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:02.754 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:02.754 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:02.754 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:02.754 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:02.754 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:02.754 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:02.754 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:02.754 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:02.754 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 1 Processor -- start 2024-09-13T10:37:02.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 1 -- start start 2024-09-13T10:37:02.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 10 monclient: init 2024-09-13T10:37:02.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:02.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 10 monclient: _add_conns ranks=[6,4,7,5,2,8,3,0,1] 2024-09-13T10:37:02.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 10 monclient(hunting): picked mon.noname-d con 0x7f2af80a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:02.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 10 monclient(hunting): picked mon.noname-c con 0x7f2af80a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:02.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 10 monclient(hunting): picked mon.noname-i con 0x7f2af813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:02.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af80a5fe0 con 0x7f2af80a6ab0 2024-09-13T10:37:02.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af80a8080 con 0x7f2af80a66d0 2024-09-13T10:37:02.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af80a42c0 con 0x7f2af813f9a0 2024-09-13T10:37:02.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:02.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.752+0000 7f2afd623640 10 monclient(hunting): authenticate will time out at 1162.257995s 2024-09-13T10:37:02.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.753+0000 7f2aee7fc640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f2af80a6ab0 0x7f2af80a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53322/0 (socket says 172.21.15.181:53322) 2024-09-13T10:37:02.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.753+0000 7f2aee7fc640 1 -- 172.21.15.181:0/645637382 learned_addr learned my addr 172.21.15.181:0/645637382 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:02.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.753+0000 7f2af6ffd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f2af80a66d0 0x7f2af80a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41164/0 (socket says 172.21.15.181:41164) 2024-09-13T10:37:02.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af6ffd640 1 -- 172.21.15.181:0/645637382 >> v1:172.21.15.181:6792/0 conn(0x7f2af80a66d0 legacy=0x7f2af80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2aee7fc640 1 -- 172.21.15.181:0/645637382 >> v1:172.21.15.181:6791/0 conn(0x7f2af80a6ab0 legacy=0x7f2af80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 1 -- 172.21.15.181:0/645637382 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819444320 0 0) 0x7f2af80a8080 con 0x7f2af80a66d0 2024-09-13T10:37:02.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient(hunting): my global_id is 124170 2024-09-13T10:37:02.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 1 -- 172.21.15.181:0/645637382 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ae4003520 con 0x7f2af80a66d0 2024-09-13T10:37:02.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 1 -- 172.21.15.181:0/645637382 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3707228311 0 0) 0x7f2af80a5fe0 con 0x7f2af80a6ab0 2024-09-13T10:37:02.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient(hunting): my global_id is 114574 2024-09-13T10:37:02.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 1 -- 172.21.15.181:0/645637382 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2af80a8080 con 0x7f2af80a6ab0 2024-09-13T10:37:02.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af77fe640 1 -- 172.21.15.181:0/645637382 >> v1:172.21.15.195:6792/0 conn(0x7f2af813f9a0 legacy=0x7f2af8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 1 -- 172.21.15.181:0/645637382 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 713605898 0 0) 0x7f2ae4003520 con 0x7f2af80a66d0 2024-09-13T10:37:02.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 1 -- 172.21.15.181:0/645637382 >> v1:172.21.15.195:6792/0 conn(0x7f2af813f9a0 legacy=0x7f2af8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 1 -- 172.21.15.181:0/645637382 >> v1:172.21.15.181:6791/0 conn(0x7f2af80a6ab0 legacy=0x7f2af80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:37:02.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 1 monclient: found mon.noname-d 2024-09-13T10:37:02.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:02.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:37:02.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 1 -- 172.21.15.181:0/645637382 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af81464e0 con 0x7f2af80a66d0 2024-09-13T10:37:02.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient: _finish_auth 0 2024-09-13T10:37:02.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:37:02.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:02.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2afd623640 5 monclient: authenticate success, global_id 124170 2024-09-13T10:37:02.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 1 -- 172.21.15.181:0/645637382 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ae8001ae0 con 0x7f2af80a66d0 2024-09-13T10:37:02.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:37:02.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient: dump: 2024-09-13T10:37:02.764 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.764 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.764 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.764 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.765 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.765 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.765 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.765 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.765 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.765 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.765 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.765 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.765 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.765 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.765 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.765 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2afd623640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:02.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 1 -- 172.21.15.181:0/645637382 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ae80047e0 con 0x7f2af80a66d0 2024-09-13T10:37:02.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:02.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 1 -- 172.21.15.181:0/645637382 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ae8004d50 con 0x7f2af80a66d0 2024-09-13T10:37:02.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2afd623640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:02.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2afd623640 4 set_mon_vals no callback set 2024-09-13T10:37:02.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:02.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.755+0000 7f2af67fc640 10 monclient: dump: 2024-09-13T10:37:02.766 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.766 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.766 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.767 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.767 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.767 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.767 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.767 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.767 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.768 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.768 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.768 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.768 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.768 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.768 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.768 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.756+0000 7f2afd623640 10 monclient: shutdown 2024-09-13T10:37:02.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.756+0000 7f2afd623640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:02.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.756+0000 7f2afd623640 1 -- 172.21.15.181:0/645637382 >> v1:172.21.15.181:6792/0 conn(0x7f2af80a66d0 legacy=0x7f2af80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.756+0000 7f2afd623640 1 -- 172.21.15.181:0/645637382 shutdown_connections 2024-09-13T10:37:02.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.756+0000 7f2afd623640 1 -- 172.21.15.181:0/645637382 >> 172.21.15.181:0/645637382 conn(0x7f2af80abcd0 msgr2=0x7f2af80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:02.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.756+0000 7f2afd623640 1 -- 172.21.15.181:0/645637382 shutdown_connections 2024-09-13T10:37:02.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.756+0000 7f2afd623640 1 -- 172.21.15.181:0/645637382 wait complete. 2024-09-13T10:37:02.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.756+0000 7f2afd623640 10 monclient: build_initial_monmap 2024-09-13T10:37:02.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.756+0000 7f2afd623640 10 monclient: monmap: 2024-09-13T10:37:02.769 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:02.769 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:02.769 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:02.769 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:02.769 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:02.770 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:02.770 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:02.770 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:02.770 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:02.770 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:02.770 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:02.770 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:02.770 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:02.770 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:02.770 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:02.770 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 1 Processor -- start 2024-09-13T10:37:02.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 1 -- start start 2024-09-13T10:37:02.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 10 monclient: init 2024-09-13T10:37:02.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:02.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 10 monclient: _add_conns ranks=[1,3,6,4,7,8,0,2,5] 2024-09-13T10:37:02.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 10 monclient(hunting): picked mon.noname-f con 0x7f2af80a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:02.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 10 monclient(hunting): picked mon.noname-g con 0x7f2af80a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:02.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 10 monclient(hunting): picked mon.noname-d con 0x7f2af813f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:02.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af813ef60 con 0x7f2af80a66d0 2024-09-13T10:37:02.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af813f240 con 0x7f2af80a6ab0 2024-09-13T10:37:02.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af8142db0 con 0x7f2af813f9a0 2024-09-13T10:37:02.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:02.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2afd623640 10 monclient(hunting): authenticate will time out at 1162.262922s 2024-09-13T10:37:02.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2af77fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f2af813f9a0 0x7f2af81d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41166/0 (socket says 172.21.15.181:41166) 2024-09-13T10:37:02.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.757+0000 7f2af77fe640 1 -- 172.21.15.181:0/1676007440 learned_addr learned my addr 172.21.15.181:0/1676007440 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:02.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2af77fe640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.181:6792/0 conn(0x7f2af813f9a0 legacy=0x7f2af81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2155111086 0 0) 0x7f2af8142db0 con 0x7f2af813f9a0 2024-09-13T10:37:02.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): my global_id is 124179 2024-09-13T10:37:02.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ad8003520 con 0x7f2af813f9a0 2024-09-13T10:37:02.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2af6ffd640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.195:6789/0 conn(0x7f2af80a66d0 legacy=0x7f2af813b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3716570485 0 0) 0x7f2ad8003520 con 0x7f2af813f9a0 2024-09-13T10:37:02.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aee7fc640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.195:6790/0 conn(0x7f2af80a6ab0 legacy=0x7f2af813bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2af8142db0 con 0x7f2af813f9a0 2024-09-13T10:37:02.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2af0003990 con 0x7f2af813f9a0 2024-09-13T10:37:02.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:02.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:37:02.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): dump: 2024-09-13T10:37:02.779 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.779 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.779 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.779 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.780 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.780 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.780 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.780 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.780 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.780 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.780 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.780 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.780 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.780 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.780 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.781 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:02.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4087168554 0 0) 0x7f2af813ef60 con 0x7f2af80a66d0 2024-09-13T10:37:02.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): my global_id is 56890 2024-09-13T10:37:02.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ad8003520 con 0x7f2af80a66d0 2024-09-13T10:37:02.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446564002 0 0) 0x7f2af813f240 con 0x7f2af80a6ab0 2024-09-13T10:37:02.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient(hunting): my global_id is 6618 2024-09-13T10:37:02.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2af813ef60 con 0x7f2af80a6ab0 2024-09-13T10:37:02.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 233756176 0 0) 0x7f2af8142db0 con 0x7f2af813f9a0 2024-09-13T10:37:02.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.195:6790/0 conn(0x7f2af80a6ab0 legacy=0x7f2af813bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.195:6789/0 conn(0x7f2af80a66d0 legacy=0x7f2af813b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient: _finish_hunting 0 2024-09-13T10:37:02.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 monclient: found mon.d 2024-09-13T10:37:02.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:02.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:02.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af8137600 con 0x7f2af813f9a0 2024-09-13T10:37:02.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient: _finish_auth 0 2024-09-13T10:37:02.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient: _check_auth_tickets 2024-09-13T10:37:02.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:02.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2afd623640 5 monclient: authenticate success, global_id 124179 2024-09-13T10:37:02.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2afd623640 10 monclient: _renew_subs 2024-09-13T10:37:02.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2afd623640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:02.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2afd623640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2af8068bf0 con 0x7f2af813f9a0 2024-09-13T10:37:02.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2afd623640 10 monclient: _renew_subs 2024-09-13T10:37:02.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2afd623640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:02.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2afd623640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f2af813c260 con 0x7f2af813f9a0 2024-09-13T10:37:02.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2af0003ee0 con 0x7f2af813f9a0 2024-09-13T10:37:02.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:02.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2af0004410 con 0x7f2af813f9a0 2024-09-13T10:37:02.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2af5ffb640 4 set_mon_vals no callback set 2024-09-13T10:37:02.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:02.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.760+0000 7f2aeffff640 10 monclient: dump: 2024-09-13T10:37:02.784 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.784 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.784 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.784 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.784 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.784 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.784 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.785 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.785 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.785 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.785 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.785 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.785 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.785 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.785 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.785 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.761+0000 7f2afd623640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:02.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.761+0000 7f2afd623640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2adc0065c0 con 0x7f2adc002860 2024-09-13T10:37:02.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.761+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2af00045b0 con 0x7f2af813f9a0 2024-09-13T10:37:02.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.761+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(223..223 src has 1..223) ==== 3506+0+0 (unknown 663386887 0 0) 0x7f2af004e550 con 0x7f2af813f9a0 2024-09-13T10:37:02.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.761+0000 7f2aee7fc640 10 monclient: get_auth_request con 0x7f2ad803fc90 auth_method 0 2024-09-13T10:37:02.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.763+0000 7f2af6ffd640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.195:6789/0 conn(0x7f2adc002860 legacy=0x7f2adc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762077458 0 0) 0x7f2adc0065c0 con 0x7f2adc002860 2024-09-13T10:37:02.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 10 monclient(hunting): my global_id is 56899 2024-09-13T10:37:02.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2af8142db0 con 0x7f2adc002860 2024-09-13T10:37:02.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3118942101 0 0) 0x7f2af8142db0 con 0x7f2adc002860 2024-09-13T10:37:02.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2adc0065c0 con 0x7f2adc002860 2024-09-13T10:37:02.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ae8001320 con 0x7f2adc002860 2024-09-13T10:37:02.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:02.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 10 monclient: dump: 2024-09-13T10:37:02.787 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.787 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.787 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.787 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.787 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.787 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.787 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.787 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.788 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.788 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.788 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.788 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.788 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.788 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.788 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.788 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2876720212 0 0) 0x7f2adc0065c0 con 0x7f2adc002860 2024-09-13T10:37:02.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2adc00a160 con 0x7f2adc002860 2024-09-13T10:37:02.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2ae8004a70 con 0x7f2adc002860 2024-09-13T10:37:02.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:02.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:02.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.195:6789/0 conn(0x7f2adc002860 legacy=0x7f2adc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.764+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.195:6789/0 conn(0x7f2adc002860 legacy=0x7f2adc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.770+0000 7f2afd623640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:02.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.770+0000 7f2afd623640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2adc009e70 con 0x7f2adc009130 2024-09-13T10:37:02.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2af6ffd640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.195:6789/0 conn(0x7f2adc009130 legacy=0x7f2adc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 594250146 0 0) 0x7f2adc009e70 con 0x7f2adc009130 2024-09-13T10:37:02.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2aeffff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2aeffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2aeffff640 10 monclient(hunting): my global_id is 56908 2024-09-13T10:37:02.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2adc0065c0 con 0x7f2adc009130 2024-09-13T10:37:02.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2459463327 0 0) 0x7f2adc0065c0 con 0x7f2adc009130 2024-09-13T10:37:02.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2adc009e70 con 0x7f2adc009130 2024-09-13T10:37:02.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ae80053d0 con 0x7f2adc009130 2024-09-13T10:37:02.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2aeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2aeffff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:02.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.773+0000 7f2aeffff640 10 monclient: dump: 2024-09-13T10:37:02.790 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.790 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.791 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.791 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.791 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.791 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.791 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.791 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.791 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.791 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.791 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.791 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.791 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.791 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.792 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.792 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4270664166 0 0) 0x7f2adc009e70 con 0x7f2adc009130 2024-09-13T10:37:02.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2adc00c410 con 0x7f2adc009130 2024-09-13T10:37:02.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 3091497017) 0x7f2ae8008540 con 0x7f2adc009130 2024-09-13T10:37:02.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2aeffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:02.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2aeffff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:02.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.195:6789/0 conn(0x7f2adc009130 legacy=0x7f2adc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2aeffff640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.195:6789/0 conn(0x7f2adc009130 legacy=0x7f2adc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.793 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 437183, 2024-09-13T10:37:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:02.793 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:37:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:02.794 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:02.816 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:02.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2afd623640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.195:6800/1839191919 conn(0x7f2ad803fc90 legacy=0x7f2ad8042150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2afd623640 10 monclient: shutdown 2024-09-13T10:37:02.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2afd623640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:02.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2afd623640 1 -- 172.21.15.181:0/1676007440 >> v1:172.21.15.181:6792/0 conn(0x7f2af813f9a0 legacy=0x7f2af81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2af77fe640 1 -- 172.21.15.181:0/1676007440 reap_dead start 2024-09-13T10:37:02.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2af77fe640 1 -- 172.21.15.181:0/1676007440 reap_dead start 2024-09-13T10:37:02.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2afd623640 1 -- 172.21.15.181:0/1676007440 shutdown_connections 2024-09-13T10:37:02.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2afd623640 1 -- 172.21.15.181:0/1676007440 >> 172.21.15.181:0/1676007440 conn(0x7f2af80abcd0 msgr2=0x7f2af8138900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:02.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2afd623640 1 -- 172.21.15.181:0/1676007440 shutdown_connections 2024-09-13T10:37:02.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.774+0000 7f2afd623640 1 -- 172.21.15.181:0/1676007440 wait complete. 2024-09-13T10:37:02.819 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:02.819 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:37:02.819 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:37:02.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.917+0000 7ff21d3f3640 10 monclient: get_monmap_and_config 2024-09-13T10:37:02.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.917+0000 7ff21d3f3640 10 monclient: build_initial_monmap 2024-09-13T10:37:02.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.917+0000 7ff21d3f3640 10 monclient: monmap: 2024-09-13T10:37:02.919 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:02.919 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.919 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:02.918034+0000 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:02.918034+0000 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:02.920 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.917+0000 7ff21d3f3640 1 Processor -- start 2024-09-13T10:37:02.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff21d3f3640 1 -- start start 2024-09-13T10:37:02.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff21d3f3640 10 monclient: init 2024-09-13T10:37:02.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff21d3f3640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:02.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff21d3f3640 10 monclient: _add_conns ranks=[4,6,3,8,1,5,0,7,2] 2024-09-13T10:37:02.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff21d3f3640 10 monclient(hunting): picked mon.noname-c con 0x7ff2180a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:02.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff21d3f3640 10 monclient(hunting): picked mon.noname-d con 0x7ff2180a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:02.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff21d3f3640 10 monclient(hunting): picked mon.noname-g con 0x7ff21813f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:02.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff21d3f3640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2180a5fe0 con 0x7ff21813f9a0 2024-09-13T10:37:02.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff21d3f3640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2180a8080 con 0x7ff2180a66d0 2024-09-13T10:37:02.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff21d3f3640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2180a42c0 con 0x7ff2180a6ab0 2024-09-13T10:37:02.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff21d3f3640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:02.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff21d3f3640 10 monclient(hunting): authenticate will time out at 1162.423543s 2024-09-13T10:37:02.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff216ffd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ff2180a66d0 0x7ff2180a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53328/0 (socket says 172.21.15.181:53328) 2024-09-13T10:37:02.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff216ffd640 1 -- 172.21.15.181:0/3701569740 learned_addr learned my addr 172.21.15.181:0/3701569740 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.918+0000 7ff2167fc640 1 --1- 172.21.15.181:0/3701569740 >> v1:172.21.15.181:6792/0 conn(0x7ff2180a6ab0 0x7ff2180a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41168/0 (socket says 172.21.15.181:41168) 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.920+0000 7ff2167fc640 1 -- 172.21.15.181:0/3701569740 >> v1:172.21.15.181:6792/0 conn(0x7ff2180a6ab0 legacy=0x7ff2180a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.920+0000 7ff216ffd640 1 -- 172.21.15.181:0/3701569740 >> v1:172.21.15.181:6791/0 conn(0x7ff2180a66d0 legacy=0x7ff2180a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff2177fe640 1 -- 172.21.15.181:0/3701569740 >> v1:172.21.15.195:6790/0 conn(0x7ff21813f9a0 legacy=0x7ff218141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3081417890 0 0) 0x7ff2180a42c0 con 0x7ff2180a6ab0 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient(hunting): my global_id is 124188 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff204003520 con 0x7ff2180a6ab0 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 332166559 0 0) 0x7ff2180a8080 con 0x7ff2180a66d0 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient(hunting): my global_id is 114583 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2180a42c0 con 0x7ff2180a66d0 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250025225 0 0) 0x7ff2180a5fe0 con 0x7ff21813f9a0 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient(hunting): my global_id is 6627 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2180a8080 con 0x7ff21813f9a0 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1729813092 0 0) 0x7ff204003520 con 0x7ff2180a6ab0 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 >> v1:172.21.15.181:6791/0 conn(0x7ff2180a66d0 legacy=0x7ff2180a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 >> v1:172.21.15.195:6790/0 conn(0x7ff21813f9a0 legacy=0x7ff218141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:37:02.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 monclient: found mon.noname-d 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2181464e0 con 0x7ff2180a6ab0 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient: _finish_auth 0 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff200001ad0 con 0x7ff2180a6ab0 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff21d3f3640 5 monclient: authenticate success, global_id 124188 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff21d3f3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient: dump: 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.929 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.930 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff21d3f3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2000047e0 con 0x7ff2180a6ab0 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 1 -- 172.21.15.181:0/3701569740 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff200004d50 con 0x7ff2180a6ab0 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff21d3f3640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff21d3f3640 4 set_mon_vals no callback set 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff215ffb640 10 monclient: dump: 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.931 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.932 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.932 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.932 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.932 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.932 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.932 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.932 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.932 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.932 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.932 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.932 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.932 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff21d3f3640 10 monclient: shutdown 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff21d3f3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.921+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3701569740 >> v1:172.21.15.181:6792/0 conn(0x7ff2180a6ab0 legacy=0x7ff2180a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.922+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3701569740 shutdown_connections 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.922+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3701569740 >> 172.21.15.181:0/3701569740 conn(0x7ff2180abcd0 msgr2=0x7ff2180ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.922+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3701569740 shutdown_connections 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.922+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3701569740 wait complete. 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.922+0000 7ff21d3f3640 10 monclient: build_initial_monmap 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.922+0000 7ff21d3f3640 10 monclient: monmap: 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:02.933 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 1 Processor -- start 2024-09-13T10:37:02.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 1 -- start start 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 10 monclient: init 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 10 monclient: _add_conns ranks=[3,5,1,6,4,7,0,2,8] 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 10 monclient(hunting): picked mon.noname-g con 0x7ff2180a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 10 monclient(hunting): picked mon.noname-h con 0x7ff2180a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 10 monclient(hunting): picked mon.noname-f con 0x7ff21813f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff21813ea30 con 0x7ff21813f9a0 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff21813ed10 con 0x7ff2180a66d0 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff21813d410 con 0x7ff2180a6ab0 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff21d3f3640 10 monclient(hunting): authenticate will time out at 1162.428620s 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff2167fc640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7ff2180a6ab0 0x7ff2181d3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:33454/0 (socket says 172.21.15.181:33454) 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff2167fc640 1 -- 172.21.15.181:0/3240283818 learned_addr learned my addr 172.21.15.181:0/3240283818 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:02.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff2177fe640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6789/0 conn(0x7ff21813f9a0 legacy=0x7ff2181d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-13T10:37:02.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff2177fe640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6789/0 conn(0x7ff21813f9a0 legacy=0x7ff2181d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:37:02.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff2177fe640 1 --1- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6789/0 conn(0x7ff21813f9a0 0x7ff2181d6f70 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2024-09-13T10:37:02.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff2177fe640 1 --1- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6789/0 conn(0x7ff21813f9a0 0x7ff2181d6f70 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2024-09-13T10:37:02.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.923+0000 7ff20f7fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.195:6789/0 2024-09-13T10:37:02.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.925+0000 7ff216ffd640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6790/0 conn(0x7ff2180a66d0 legacy=0x7ff218136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.925+0000 7ff2167fc640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6791/0 conn(0x7ff2180a6ab0 legacy=0x7ff2181d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2334939749 0 0) 0x7ff21813ed10 con 0x7ff2180a66d0 2024-09-13T10:37:02.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): my global_id is 6636 2024-09-13T10:37:02.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1f8003520 con 0x7ff2180a66d0 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472034458 0 0) 0x7ff21813d410 con 0x7ff2180a6ab0 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): my global_id is 104711 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff21813ed10 con 0x7ff2180a6ab0 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1694863765 0 0) 0x7ff21813ed10 con 0x7ff2180a6ab0 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff21813d410 con 0x7ff2180a6ab0 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 783893613 0 0) 0x7ff1f8003520 con 0x7ff2180a66d0 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff21813ed10 con 0x7ff2180a66d0 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff200004cd0 con 0x7ff2180a6ab0 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:02.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): dump: 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.943 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.944 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.944 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.944 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:02.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff210001d60 con 0x7ff2180a66d0 2024-09-13T10:37:02.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:02.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:02.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient(hunting): dump: 2024-09-13T10:37:02.944 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.944 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.944 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.944 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1340358813 0 0) 0x7ff21813d410 con 0x7ff2180a6ab0 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6790/0 conn(0x7ff2180a66d0 legacy=0x7ff218136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6789/0 conn(0x7ff21813f9a0 legacy=0x7ff2181d6f70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 monclient: found mon.h 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21813eff0 con 0x7ff2180a6ab0 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff21d3f3640 5 monclient: authenticate success, global_id 104711 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff21d3f3640 10 monclient: _renew_subs 2024-09-13T10:37:02.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff21d3f3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff2180a29c0 con 0x7ff2180a6ab0 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff21d3f3640 10 monclient: _renew_subs 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff21d3f3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7ff21813c670 con 0x7ff2180a6ab0 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2000047e0 con 0x7ff2180a6ab0 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff200001d20 con 0x7ff2180a6ab0 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff2157fa640 4 set_mon_vals no callback set 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.926+0000 7ff20f7fe640 10 monclient: dump: 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.947 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.948 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.927+0000 7ff21d3f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.927+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff1fc0065c0 con 0x7ff1fc002860 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.927+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff200011b60 con 0x7ff2180a6ab0 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.927+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(223..223 src has 1..223) ==== 3506+0+0 (unknown 663386887 0 0) 0x7ff20004e2a0 con 0x7ff2180a6ab0 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.928+0000 7ff2177fe640 10 monclient: get_auth_request con 0x7ff1f803ffb0 auth_method 0 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.929+0000 7ff216ffd640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6790/0 conn(0x7ff1fc002860 legacy=0x7ff1fc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.929+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3303104379 0 0) 0x7ff1fc0065c0 con 0x7ff1fc002860 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.929+0000 7ff20f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.929+0000 7ff20f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.929+0000 7ff20f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.929+0000 7ff20f7fe640 10 monclient(hunting): my global_id is 6645 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.929+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff21813d410 con 0x7ff1fc002860 2024-09-13T10:37:02.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3758399890 0 0) 0x7ff21813d410 con 0x7ff1fc002860 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1fc0065c0 con 0x7ff1fc002860 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff2100053d0 con 0x7ff1fc002860 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 10 monclient: dump: 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.950 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.951 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.951 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.951 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.951 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.951 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.951 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.951 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2790845845 0 0) 0x7ff1fc0065c0 con 0x7ff1fc002860 2024-09-13T10:37:02.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1fc00a160 con 0x7ff1fc002860 2024-09-13T10:37:02.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff210005570 con 0x7ff1fc002860 2024-09-13T10:37:02.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:02.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6790/0 conn(0x7ff1fc002860 legacy=0x7ff1fc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.930+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6790/0 conn(0x7ff1fc002860 legacy=0x7ff1fc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.936+0000 7ff21d3f3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.936+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff1fc009e50 con 0x7ff1fc009110 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff216ffd640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6790/0 conn(0x7ff1fc009110 legacy=0x7ff1fc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4177542243 0 0) 0x7ff1fc009e50 con 0x7ff1fc009110 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 10 monclient(hunting): my global_id is 6654 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1fc0065c0 con 0x7ff1fc009110 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3841278359 0 0) 0x7ff1fc0065c0 con 0x7ff1fc009110 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1fc009e50 con 0x7ff1fc009110 2024-09-13T10:37:02.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff210005d50 con 0x7ff1fc009110 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 10 monclient: dump: 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:02.953 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3128014297 0 0) 0x7ff1fc009e50 con 0x7ff1fc009110 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.939+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff1fc00c3f0 con 0x7ff1fc009110 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7562 (unknown 0 0 2619136890) 0x7ff210007240 con 0x7ff1fc009110 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff20f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff20f7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6790/0 conn(0x7ff1fc009110 legacy=0x7ff1fc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff20f7fe640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6790/0 conn(0x7ff1fc009110 legacy=0x7ff1fc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:02.955 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:02.955 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:02.955 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:02.955 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:37:02.955 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:02.955 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 437354, 2024-09-13T10:37:02.955 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:02.955 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:02.955 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:02.955 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.956 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.957 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:02.958 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:02.959 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:02.959 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:02.959 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:02.959 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:02.959 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:02.959 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:02.959 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:02.959 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:02.959 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:02.959 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:02.960 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.961 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:02.962 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.963 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.964 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.967 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.968 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:02.969 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.970 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.971 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:02.972 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.973 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:02.974 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:02.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:02.975 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:02.975 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:02.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff1f803ffb0 legacy=0x7ff1f8042470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff21d3f3640 10 monclient: shutdown 2024-09-13T10:37:02.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff21d3f3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:02.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3240283818 >> v1:172.21.15.195:6791/0 conn(0x7ff2180a6ab0 legacy=0x7ff2181d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:02.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff2177fe640 1 -- 172.21.15.181:0/3240283818 reap_dead start 2024-09-13T10:37:02.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff2177fe640 1 -- 172.21.15.181:0/3240283818 reap_dead start 2024-09-13T10:37:02.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3240283818 shutdown_connections 2024-09-13T10:37:02.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3240283818 >> 172.21.15.181:0/3240283818 conn(0x7ff2180abcd0 msgr2=0x7ff2180ab450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:02.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3240283818 shutdown_connections 2024-09-13T10:37:02.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:02.940+0000 7ff21d3f3640 1 -- 172.21.15.181:0/3240283818 wait complete. 2024-09-13T10:37:02.977 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:02.977 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:37:02.977 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:37:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.078+0000 7ff1e87aa640 10 monclient: get_monmap_and_config 2024-09-13T10:37:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.078+0000 7ff1e87aa640 10 monclient: build_initial_monmap 2024-09-13T10:37:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.078+0000 7ff1e87aa640 10 monclient: monmap: 2024-09-13T10:37:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:03.079373+0000 2024-09-13T10:37:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:03.079373+0000 2024-09-13T10:37:03.080 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:03.081 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.081 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:03.081 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:03.081 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:03.081 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:03.081 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:03.081 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:03.081 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:03.081 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:03.081 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:03.081 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.079+0000 7ff1e87aa640 1 Processor -- start 2024-09-13T10:37:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.079+0000 7ff1e87aa640 1 -- start start 2024-09-13T10:37:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.079+0000 7ff1e87aa640 10 monclient: init 2024-09-13T10:37:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.079+0000 7ff1e87aa640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.079+0000 7ff1e87aa640 10 monclient: _add_conns ranks=[5,0,4,3,8,1,2,6,7] 2024-09-13T10:37:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.079+0000 7ff1e87aa640 10 monclient(hunting): picked mon.noname-h con 0x7ff1e00a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.079+0000 7ff1e87aa640 10 monclient(hunting): picked mon.noname-a con 0x7ff1e00a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.079+0000 7ff1e87aa640 10 monclient(hunting): picked mon.noname-c con 0x7ff1e013f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.079+0000 7ff1e87aa640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e00a4bc0 con 0x7ff1e00a8340 2024-09-13T10:37:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.080+0000 7ff1e87aa640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e013a320 con 0x7ff1e013f750 2024-09-13T10:37:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.080+0000 7ff1e87aa640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e00a8100 con 0x7ff1e00a6640 2024-09-13T10:37:03.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.080+0000 7ff1e87aa640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:03.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.080+0000 7ff1e87aa640 10 monclient(hunting): authenticate will time out at 1162.585035s 2024-09-13T10:37:03.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.080+0000 7ff1e6d47640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ff1e013f750 0x7ff1e0141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:53336/0 (socket says 172.21.15.181:53336) 2024-09-13T10:37:03.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.080+0000 7ff1e6d47640 1 -- 172.21.15.181:0/3849117944 learned_addr learned my addr 172.21.15.181:0/3849117944 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:03.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.080+0000 7ff1e5d45640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff1e00a8340 0x7ff1e0139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:40424/0 (socket says 172.21.15.181:40424) 2024-09-13T10:37:03.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e6d47640 1 -- 172.21.15.181:0/3849117944 >> v1:172.21.15.181:6791/0 conn(0x7ff1e013f750 legacy=0x7ff1e0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5d45640 1 -- 172.21.15.181:0/3849117944 >> v1:172.21.15.181:6789/0 conn(0x7ff1e00a8340 legacy=0x7ff1e0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 1 -- 172.21.15.181:0/3849117944 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905840831 0 0) 0x7ff1e013a320 con 0x7ff1e013f750 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient(hunting): my global_id is 114592 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 1 -- 172.21.15.181:0/3849117944 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1cc003520 con 0x7ff1e013f750 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 1 -- 172.21.15.181:0/3849117944 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142937724 0 0) 0x7ff1e00a4bc0 con 0x7ff1e00a8340 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient(hunting): my global_id is 114471 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 1 -- 172.21.15.181:0/3849117944 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1e013a320 con 0x7ff1e00a8340 2024-09-13T10:37:03.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e6546640 1 -- 172.21.15.181:0/3849117944 >> v1:172.21.15.195:6791/0 conn(0x7ff1e00a6640 legacy=0x7ff1e0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 1 -- 172.21.15.181:0/3849117944 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1481450960 0 0) 0x7ff1cc003520 con 0x7ff1e013f750 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 1 -- 172.21.15.181:0/3849117944 >> v1:172.21.15.195:6791/0 conn(0x7ff1e00a6640 legacy=0x7ff1e0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 1 -- 172.21.15.181:0/3849117944 >> v1:172.21.15.181:6789/0 conn(0x7ff1e00a8340 legacy=0x7ff1e0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient: _finish_hunting 0 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 1 monclient: found mon.noname-c 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 1 -- 172.21.15.181:0/3849117944 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e00a48e0 con 0x7ff1e013f750 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient: _finish_auth 0 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient: _check_auth_tickets 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e87aa640 5 monclient: authenticate success, global_id 114592 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 1 -- 172.21.15.181:0/3849117944 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff1d8001e60 con 0x7ff1e013f750 2024-09-13T10:37:03.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e87aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:03.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:03.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient: dump: 2024-09-13T10:37:03.090 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.090 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.090 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.090 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.090 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.090 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.090 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.090 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e87aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 1 -- 172.21.15.181:0/3849117944 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1d8004c20 con 0x7ff1e013f750 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e87aa640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:03.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 1 -- 172.21.15.181:0/3849117944 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff1d8005190 con 0x7ff1e013f750 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e87aa640 4 set_mon_vals no callback set 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.082+0000 7ff1e5544640 10 monclient: dump: 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.092 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.083+0000 7ff1e87aa640 10 monclient: shutdown 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.083+0000 7ff1e87aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.083+0000 7ff1e87aa640 1 -- 172.21.15.181:0/3849117944 >> v1:172.21.15.181:6791/0 conn(0x7ff1e013f750 legacy=0x7ff1e0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.083+0000 7ff1e87aa640 1 -- 172.21.15.181:0/3849117944 shutdown_connections 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.083+0000 7ff1e87aa640 1 -- 172.21.15.181:0/3849117944 >> 172.21.15.181:0/3849117944 conn(0x7ff1e0077170 msgr2=0x7ff1e00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.083+0000 7ff1e87aa640 1 -- 172.21.15.181:0/3849117944 shutdown_connections 2024-09-13T10:37:03.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.083+0000 7ff1e87aa640 1 -- 172.21.15.181:0/3849117944 wait complete. 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.083+0000 7ff1e87aa640 10 monclient: build_initial_monmap 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.083+0000 7ff1e87aa640 10 monclient: monmap: 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:03.094 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:03.095 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:03.095 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:03.095 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:03.095 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:03.095 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 1 Processor -- start 2024-09-13T10:37:03.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 1 -- start start 2024-09-13T10:37:03.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 10 monclient: init 2024-09-13T10:37:03.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:03.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 10 monclient: _add_conns ranks=[6,8,3,5,1,4,7,2,0] 2024-09-13T10:37:03.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 10 monclient(hunting): picked mon.noname-d con 0x7ff1e00a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:03.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 10 monclient(hunting): picked mon.noname-e con 0x7ff1e013f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:03.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 10 monclient(hunting): picked mon.noname-g con 0x7ff1e009f780 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:03.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e00a0f80 con 0x7ff1e009f780 2024-09-13T10:37:03.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e0142d80 con 0x7ff1e00a8340 2024-09-13T10:37:03.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e00a0110 con 0x7ff1e013f750 2024-09-13T10:37:03.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:03.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e87aa640 10 monclient(hunting): authenticate will time out at 1162.589795s 2024-09-13T10:37:03.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e5d45640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7ff1e013f750 0x7ff1e009d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:51284/0 (socket says 172.21.15.181:51284) 2024-09-13T10:37:03.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e5d45640 1 -- 172.21.15.181:0/328819925 learned_addr learned my addr 172.21.15.181:0/328819925 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:03.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.084+0000 7ff1e6546640 1 --1- 172.21.15.181:0/328819925 >> v1:172.21.15.181:6792/0 conn(0x7ff1e00a8340 0x7ff1e009d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41172/0 (socket says 172.21.15.181:41172) 2024-09-13T10:37:03.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1e5d45640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.181:6793/0 conn(0x7ff1e013f750 legacy=0x7ff1e009d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1e6546640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.181:6792/0 conn(0x7ff1e00a8340 legacy=0x7ff1e009d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2176894111 0 0) 0x7ff1e00a0110 con 0x7ff1e013f750 2024-09-13T10:37:03.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): my global_id is 104975 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c4003520 con 0x7ff1e013f750 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577454735 0 0) 0x7ff1e0142d80 con 0x7ff1e00a8340 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): my global_id is 124197 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1e00a0110 con 0x7ff1e00a8340 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1e6d47640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.195:6790/0 conn(0x7ff1e009f780 legacy=0x7ff1e01d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1875175006 0 0) 0x7ff1e00a0f80 con 0x7ff1e009f780 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): my global_id is 6663 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1e0142d80 con 0x7ff1e009f780 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1904195980 0 0) 0x7ff1e00a0110 con 0x7ff1e00a8340 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1e00a0f80 con 0x7ff1e00a8340 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2153867486 0 0) 0x7ff1c4003520 con 0x7ff1e013f750 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1e00a0110 con 0x7ff1e013f750 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff1dc003610 con 0x7ff1e00a8340 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.103 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.104 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff1d00047e0 con 0x7ff1e013f750 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.105 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4183388700 0 0) 0x7ff1e00a0110 con 0x7ff1e013f750 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.181:6792/0 conn(0x7ff1e00a8340 legacy=0x7ff1e009d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.195:6790/0 conn(0x7ff1e009f780 legacy=0x7ff1e01d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 monclient: found mon.e 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:03.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e009ec20 con 0x7ff1e013f750 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1e87aa640 5 monclient: authenticate success, global_id 104975 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1e87aa640 10 monclient: _renew_subs 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1e87aa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1e87aa640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e009df90 con 0x7ff1e013f750 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1e87aa640 10 monclient: _renew_subs 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1e87aa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1e87aa640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7ff1e00a27e0 con 0x7ff1e013f750 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1d0004d20 con 0x7ff1e013f750 2024-09-13T10:37:03.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff1d0005250 con 0x7ff1e013f750 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.088+0000 7ff1d6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.087+0000 7ff1e4d43640 4 set_mon_vals no callback set 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.088+0000 7ff1d6ffd640 10 monclient: dump: 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.108 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.088+0000 7ff1e87aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.088+0000 7ff1e87aa640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff1c80065c0 con 0x7ff1c8002860 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.088+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff1d00053f0 con 0x7ff1e013f750 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.089+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(223..223 src has 1..223) ==== 3506+0+0 (unknown 663386887 0 0) 0x7ff1d004e330 con 0x7ff1e013f750 2024-09-13T10:37:03.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.089+0000 7ff1e6d47640 10 monclient: get_auth_request con 0x7ff1c40401e0 auth_method 0 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1e6546640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.195:6791/0 conn(0x7ff1c8002860 legacy=0x7ff1c8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 416597499 0 0) 0x7ff1c80065c0 con 0x7ff1c8002860 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 10 monclient(hunting): my global_id is 104729 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1e00a0110 con 0x7ff1c8002860 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2146203734 0 0) 0x7ff1e00a0110 con 0x7ff1c8002860 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1c80065c0 con 0x7ff1c8002860 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff1dc004050 con 0x7ff1c8002860 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 10 monclient: dump: 2024-09-13T10:37:03.110 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.111 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.112 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3798208994 0 0) 0x7ff1c80065c0 con 0x7ff1c8002860 2024-09-13T10:37:03.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.091+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1c800a160 con 0x7ff1c8002860 2024-09-13T10:37:03.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.092+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff1dc004300 con 0x7ff1c8002860 2024-09-13T10:37:03.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.092+0000 7ff1d6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:03.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.092+0000 7ff1d6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:03.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.092+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.195:6791/0 conn(0x7ff1c8002860 legacy=0x7ff1c8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.092+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.195:6791/0 conn(0x7ff1c8002860 legacy=0x7ff1c8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:03.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.098+0000 7ff1e87aa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:03.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.098+0000 7ff1e87aa640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff1c8009e70 con 0x7ff1c8009130 2024-09-13T10:37:03.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1e6546640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.195:6791/0 conn(0x7ff1c8009130 legacy=0x7ff1c80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3770828795 0 0) 0x7ff1c8009e70 con 0x7ff1c8009130 2024-09-13T10:37:03.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 10 monclient(hunting): my global_id is 104738 2024-09-13T10:37:03.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c80065c0 con 0x7ff1c8009130 2024-09-13T10:37:03.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2238798840 0 0) 0x7ff1c80065c0 con 0x7ff1c8009130 2024-09-13T10:37:03.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1c8009e70 con 0x7ff1c8009130 2024-09-13T10:37:03.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff1dc005cf0 con 0x7ff1c8009130 2024-09-13T10:37:03.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 10 monclient: dump: 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.115 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.116 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.116 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.116 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.116 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.116 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2150505677 0 0) 0x7ff1c8009e70 con 0x7ff1c8009130 2024-09-13T10:37:03.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff1c800c410 con 0x7ff1c8009130 2024-09-13T10:37:03.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 4012452338) 0x7ff1dc007e40 con 0x7ff1c8009130 2024-09-13T10:37:03.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:03.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:03.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.195:6791/0 conn(0x7ff1c8009130 legacy=0x7ff1c80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.101+0000 7ff1d6ffd640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.195:6791/0 conn(0x7ff1c8009130 legacy=0x7ff1c80095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:03.117 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 106800, 2024-09-13T10:37:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:03.117 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:03.118 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:03.119 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.120 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:03.121 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:03.122 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.123 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.124 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.125 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:03.125 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.125 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.125 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.125 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:03.125 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:03.125 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.125 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.125 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.126 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:03.126 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:03.126 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.126 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.126 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.126 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:03.126 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.126 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.126 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.128 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:03.129 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.130 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.131 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:03.133 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.134 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.135 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.136 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:03.137 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:03.137 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:03.137 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.137 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.137 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:03.137 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:03.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.102+0000 7ff1e87aa640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff1c40401e0 legacy=0x7ff1c40426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.102+0000 7ff1e87aa640 10 monclient: shutdown 2024-09-13T10:37:03.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.102+0000 7ff1e87aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:03.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.102+0000 7ff1e87aa640 1 -- 172.21.15.181:0/328819925 >> v1:172.21.15.181:6793/0 conn(0x7ff1e013f750 legacy=0x7ff1e009d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.102+0000 7ff1e6d47640 1 -- 172.21.15.181:0/328819925 reap_dead start 2024-09-13T10:37:03.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.102+0000 7ff1e6d47640 1 -- 172.21.15.181:0/328819925 reap_dead start 2024-09-13T10:37:03.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.102+0000 7ff1e87aa640 1 -- 172.21.15.181:0/328819925 shutdown_connections 2024-09-13T10:37:03.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.102+0000 7ff1e87aa640 1 -- 172.21.15.181:0/328819925 >> 172.21.15.181:0/328819925 conn(0x7ff1e00a6640 msgr2=0x7ff1e0141f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:03.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.102+0000 7ff1e87aa640 1 -- 172.21.15.181:0/328819925 shutdown_connections 2024-09-13T10:37:03.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.102+0000 7ff1e87aa640 1 -- 172.21.15.181:0/328819925 wait complete. 2024-09-13T10:37:03.139 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:03.139 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:37:03.140 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:37:03.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.236+0000 7f705cdca640 10 monclient: get_monmap_and_config 2024-09-13T10:37:03.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.236+0000 7f705cdca640 10 monclient: build_initial_monmap 2024-09-13T10:37:03.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.236+0000 7f705cdca640 10 monclient: monmap: 2024-09-13T10:37:03.238 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:03.238 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.238 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:03.237244+0000 2024-09-13T10:37:03.238 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:03.237244+0000 2024-09-13T10:37:03.238 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:03.238 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.238 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:03.238 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:03.238 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:03.239 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:03.239 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:03.239 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:03.239 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:03.239 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:03.239 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:03.239 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 1 Processor -- start 2024-09-13T10:37:03.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 1 -- start start 2024-09-13T10:37:03.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 10 monclient: init 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 10 monclient: _add_conns ranks=[7,3,5,4,0,6,8,2,1] 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 10 monclient(hunting): picked mon.noname-i con 0x7f70580a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 10 monclient(hunting): picked mon.noname-g con 0x7f70580a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 10 monclient(hunting): picked mon.noname-h con 0x7f705813f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70580a4bc0 con 0x7f70580a8340 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f705813a320 con 0x7f705813f750 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70580a8100 con 0x7f70580a6640 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.237+0000 7f705cdca640 10 monclient(hunting): authenticate will time out at 1162.742915s 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.238+0000 7f7055d9b640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f70580a8340 0x7f7058139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:58444/0 (socket says 172.21.15.181:58444) 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.238+0000 7f705659c640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f70580a6640 0x7f7058139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:35976/0 (socket says 172.21.15.181:35976) 2024-09-13T10:37:03.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.238+0000 7f7055d9b640 1 -- 172.21.15.181:0/3183305280 learned_addr learned my addr 172.21.15.181:0/3183305280 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:03.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.240+0000 7f7056d9d640 1 -- 172.21.15.181:0/3183305280 >> v1:172.21.15.195:6791/0 conn(0x7f705813f750 legacy=0x7f7058141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.240+0000 7f705659c640 1 -- 172.21.15.181:0/3183305280 >> v1:172.21.15.195:6792/0 conn(0x7f70580a6640 legacy=0x7f7058139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.240+0000 7f7055d9b640 1 -- 172.21.15.181:0/3183305280 >> v1:172.21.15.195:6790/0 conn(0x7f70580a8340 legacy=0x7f7058139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.240+0000 7f705559a640 1 -- 172.21.15.181:0/3183305280 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472252362 0 0) 0x7f70580a4bc0 con 0x7f70580a8340 2024-09-13T10:37:03.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.240+0000 7f705559a640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.240+0000 7f705559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.240+0000 7f705559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.240+0000 7f705559a640 10 monclient(hunting): my global_id is 6672 2024-09-13T10:37:03.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.240+0000 7f705559a640 1 -- 172.21.15.181:0/3183305280 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7040003520 con 0x7f70580a8340 2024-09-13T10:37:03.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 1 -- 172.21.15.181:0/3183305280 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3847375678 0 0) 0x7f7040003520 con 0x7f70580a8340 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 1 -- 172.21.15.181:0/3183305280 >> v1:172.21.15.195:6792/0 conn(0x7f70580a6640 legacy=0x7f7058139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 1 -- 172.21.15.181:0/3183305280 >> v1:172.21.15.195:6791/0 conn(0x7f705813f750 legacy=0x7f7058141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 10 monclient: _finish_hunting 0 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 1 monclient: found mon.noname-g 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 1 -- 172.21.15.181:0/3183305280 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70580a48e0 con 0x7f70580a8340 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 10 monclient: _finish_auth 0 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 10 monclient: _check_auth_tickets 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 1 -- 172.21.15.181:0/3183305280 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7048001ae0 con 0x7f70580a8340 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 10 monclient: dump: 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.247 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705cdca640 5 monclient: authenticate success, global_id 6672 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705cdca640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 1 -- 172.21.15.181:0/3183305280 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70480048a0 con 0x7f70580a8340 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 1 -- 172.21.15.181:0/3183305280 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7048004e50 con 0x7f70580a8340 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705cdca640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705cdca640 4 set_mon_vals no callback set 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:03.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705559a640 10 monclient: dump: 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.249 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705cdca640 10 monclient: shutdown 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705cdca640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705cdca640 1 -- 172.21.15.181:0/3183305280 >> v1:172.21.15.195:6790/0 conn(0x7f70580a8340 legacy=0x7f7058139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705cdca640 1 -- 172.21.15.181:0/3183305280 shutdown_connections 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705cdca640 1 -- 172.21.15.181:0/3183305280 >> 172.21.15.181:0/3183305280 conn(0x7f7058077170 msgr2=0x7f70580abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705cdca640 1 -- 172.21.15.181:0/3183305280 shutdown_connections 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.241+0000 7f705cdca640 1 -- 172.21.15.181:0/3183305280 wait complete. 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.242+0000 7f705cdca640 10 monclient: build_initial_monmap 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.242+0000 7f705cdca640 10 monclient: monmap: 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:03.250 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:03.251 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.242+0000 7f705cdca640 1 Processor -- start 2024-09-13T10:37:03.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705cdca640 1 -- start start 2024-09-13T10:37:03.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705cdca640 10 monclient: init 2024-09-13T10:37:03.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705cdca640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:03.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705cdca640 10 monclient: _add_conns ranks=[8,7,4,1,2,0,5,3,6] 2024-09-13T10:37:03.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705cdca640 10 monclient(hunting): picked mon.noname-e con 0x7f70580a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:03.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705cdca640 10 monclient(hunting): picked mon.noname-i con 0x7f705813f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:03.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705cdca640 10 monclient(hunting): picked mon.noname-c con 0x7f70581d4810 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:03.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705cdca640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f705813c6d0 con 0x7f70581d4810 2024-09-13T10:37:03.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705cdca640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7058134cc0 con 0x7f705813f750 2024-09-13T10:37:03.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705cdca640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f705813baf0 con 0x7f70580a8340 2024-09-13T10:37:03.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705cdca640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:03.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705cdca640 10 monclient(hunting): authenticate will time out at 1162.748523s 2024-09-13T10:37:03.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705659c640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f70580a8340 0x7f705813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:51294/0 (socket says 172.21.15.181:51294) 2024-09-13T10:37:03.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.243+0000 7f705659c640 1 -- 172.21.15.181:0/2637839681 learned_addr learned my addr 172.21.15.181:0/2637839681 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:03.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.245+0000 7f705659c640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.181:6793/0 conn(0x7f70580a8340 legacy=0x7f705813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.245+0000 7f7056d9d640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.181:6791/0 conn(0x7f70581d4810 legacy=0x7f70581d6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.246+0000 7f7055d9b640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.195:6792/0 conn(0x7f705813f750 legacy=0x7f705813b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1319723329 0 0) 0x7f705813c6d0 con 0x7f70581d4810 2024-09-13T10:37:03.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): my global_id is 114601 2024-09-13T10:37:03.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7038003550 con 0x7f70581d4810 2024-09-13T10:37:03.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4133382161 0 0) 0x7f70580a48e0 con 0x7f705813f750 2024-09-13T10:37:03.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): my global_id is 56797 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f705813c6d0 con 0x7f705813f750 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288567246 0 0) 0x7f705813baf0 con 0x7f70580a8340 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): my global_id is 104984 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70580a48e0 con 0x7f70580a8340 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2255575074 0 0) 0x7f7038003550 con 0x7f70581d4810 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f705813baf0 con 0x7f70581d4810 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7050002000 con 0x7f70581d4810 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:03.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.696 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3990056619 0 0) 0x7f70580a48e0 con 0x7f70580a8340 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7038003550 con 0x7f70580a8340 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f704c001d20 con 0x7f70580a8340 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.697 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1557305254 0 0) 0x7f705813c6d0 con 0x7f705813f750 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70580a48e0 con 0x7f705813f750 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7048001a60 con 0x7f705813f750 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.699 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.690+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 352752329 0 0) 0x7f70580a48e0 con 0x7f705813f750 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.181:6793/0 conn(0x7f70580a8340 legacy=0x7f705813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.181:6791/0 conn(0x7f70581d4810 legacy=0x7f70581d6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 1 monclient: found mon.i 2024-09-13T10:37:03.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70581340e0 con 0x7f705813f750 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f705cdca640 5 monclient: authenticate success, global_id 56797 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f705cdca640 10 monclient: _renew_subs 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f705cdca640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f705cdca640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f705813e190 con 0x7f705813f750 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f705cdca640 10 monclient: _renew_subs 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f705cdca640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f705cdca640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f705813d230 con 0x7f705813f750 2024-09-13T10:37:03.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7048001d30 con 0x7f705813f750 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7048001580 con 0x7f705813f750 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7054d99640 4 set_mon_vals no callback set 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.691+0000 7f7046ffd640 10 monclient: dump: 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.702 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.703 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.703 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.703 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.703 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.703 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.703 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.703 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.703 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.692+0000 7f705cdca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:03.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.692+0000 7f705cdca640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f703c0065c0 con 0x7f703c002860 2024-09-13T10:37:03.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.692+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7048011b60 con 0x7f705813f750 2024-09-13T10:37:03.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.692+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(223..223 src has 1..223) ==== 3506+0+0 (unknown 663386887 0 0) 0x7f704804e0d0 con 0x7f705813f750 2024-09-13T10:37:03.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.694+0000 7f7056d9d640 10 monclient: get_auth_request con 0x7f70380405c0 auth_method 0 2024-09-13T10:37:03.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.694+0000 7f705659c640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.195:6792/0 conn(0x7f703c002860 legacy=0x7f703c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.695+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062949298 0 0) 0x7f703c0065c0 con 0x7f703c002860 2024-09-13T10:37:03.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.695+0000 7f7046ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.695+0000 7f7046ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.695+0000 7f7046ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.695+0000 7f7046ffd640 10 monclient(hunting): my global_id is 56806 2024-09-13T10:37:03.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.695+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70580a48e0 con 0x7f703c002860 2024-09-13T10:37:03.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.695+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1444529377 0 0) 0x7f70580a48e0 con 0x7f703c002860 2024-09-13T10:37:03.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.695+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f703c0065c0 con 0x7f703c002860 2024-09-13T10:37:03.705 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.695+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f704c004f50 con 0x7f703c002860 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.695+0000 7f7046ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.695+0000 7f7046ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.695+0000 7f7046ffd640 10 monclient: dump: 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.706 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.696+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4075366491 0 0) 0x7f703c0065c0 con 0x7f703c002860 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.696+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f703c00a160 con 0x7f703c002860 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.697+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f704c005260 con 0x7f703c002860 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.697+0000 7f7046ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.697+0000 7f7046ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.697+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.195:6792/0 conn(0x7f703c002860 legacy=0x7f703c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.697+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.195:6792/0 conn(0x7f703c002860 legacy=0x7f703c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:03.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.706+0000 7f705cdca640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:03.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.706+0000 7f705cdca640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f703c009e50 con 0x7f703c009110 2024-09-13T10:37:03.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.708+0000 7f705659c640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.195:6792/0 conn(0x7f703c009110 legacy=0x7f703c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756628489 0 0) 0x7f703c009e50 con 0x7f703c009110 2024-09-13T10:37:03.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 10 monclient(hunting): my global_id is 56815 2024-09-13T10:37:03.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f703c0065c0 con 0x7f703c009110 2024-09-13T10:37:03.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 690662744 0 0) 0x7f703c0065c0 con 0x7f703c009110 2024-09-13T10:37:03.711 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f703c009e50 con 0x7f703c009110 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f704c005b50 con 0x7f703c009110 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 10 monclient: dump: 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.712 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2596421612 0 0) 0x7f703c009e50 con 0x7f703c009110 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f703c00c3f0 con 0x7f703c009110 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 3653387539) 0x7f704c007e40 con 0x7f703c009110 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:03.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.195:6792/0 conn(0x7f703c009110 legacy=0x7f703c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.709+0000 7f7046ffd640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.195:6792/0 conn(0x7f703c009110 legacy=0x7f703c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:03.714 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:03.714 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:03.714 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:03.714 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:03.714 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:03.714 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 438129, 2024-09-13T10:37:03.714 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:03.714 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:03.715 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:03.716 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:03.716 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:03.716 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:03.716 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:03.716 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:03.716 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:03.716 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:03.716 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:03.716 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:03.716 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:03.716 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:03.716 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:03.718 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:03.719 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.720 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:03.723 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.724 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.727 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:03.727 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:03.727 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.727 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.727 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:03.727 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.727 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.727 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.728 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.730 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:03.732 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:03.733 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:03.734 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:03.734 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:37:03.734 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:03.734 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:03.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:03.734 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:03.734 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.710+0000 7f705cdca640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.195:6800/1839191919 conn(0x7f70380405c0 legacy=0x7f7038042a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.710+0000 7f705cdca640 10 monclient: shutdown 2024-09-13T10:37:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.710+0000 7f705cdca640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.710+0000 7f705cdca640 1 -- 172.21.15.181:0/2637839681 >> v1:172.21.15.195:6792/0 conn(0x7f705813f750 legacy=0x7f705813b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.710+0000 7f7056d9d640 1 -- 172.21.15.181:0/2637839681 reap_dead start 2024-09-13T10:37:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.710+0000 7f7056d9d640 1 -- 172.21.15.181:0/2637839681 reap_dead start 2024-09-13T10:37:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.710+0000 7f705cdca640 1 -- 172.21.15.181:0/2637839681 shutdown_connections 2024-09-13T10:37:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.710+0000 7f705cdca640 1 -- 172.21.15.181:0/2637839681 >> 172.21.15.181:0/2637839681 conn(0x7f70580a6640 msgr2=0x7f70580a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.710+0000 7f705cdca640 1 -- 172.21.15.181:0/2637839681 shutdown_connections 2024-09-13T10:37:03.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.710+0000 7f705cdca640 1 -- 172.21.15.181:0/2637839681 wait complete. 2024-09-13T10:37:03.737 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:03.737 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T10:37:03.737 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T10:37:03.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.833+0000 7f7f23544640 10 monclient: get_monmap_and_config 2024-09-13T10:37:03.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.833+0000 7f7f23544640 10 monclient: build_initial_monmap 2024-09-13T10:37:03.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.833+0000 7f7f23544640 10 monclient: monmap: 2024-09-13T10:37:03.834 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:03.834 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:03.833661+0000 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:03.833661+0000 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:03.835 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.833+0000 7f7f23544640 1 Processor -- start 2024-09-13T10:37:03.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.833+0000 7f7f23544640 1 -- start start 2024-09-13T10:37:03.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.833+0000 7f7f23544640 10 monclient: init 2024-09-13T10:37:03.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.834+0000 7f7f23544640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:03.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.834+0000 7f7f23544640 10 monclient: _add_conns ranks=[3,0,5,4,8,7,1,6,2] 2024-09-13T10:37:03.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.834+0000 7f7f23544640 10 monclient(hunting): picked mon.noname-g con 0x7f7f1c0a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:03.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.834+0000 7f7f23544640 10 monclient(hunting): picked mon.noname-a con 0x7f7f1c0a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:03.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.834+0000 7f7f23544640 10 monclient(hunting): picked mon.noname-h con 0x7f7f1c13f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:03.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.834+0000 7f7f23544640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f1c0a5fe0 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.834+0000 7f7f23544640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f1c0a8080 con 0x7f7f1c0a66d0 2024-09-13T10:37:03.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.834+0000 7f7f23544640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f1c0a42c0 con 0x7f7f1c13f9a0 2024-09-13T10:37:03.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.834+0000 7f7f23544640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:03.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.834+0000 7f7f23544640 10 monclient(hunting): authenticate will time out at 1163.339436s 2024-09-13T10:37:03.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.834+0000 7f7f20adf640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7f1c0a6ab0 0x7f7f1c0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53404/0 (socket says 172.21.15.181:53404) 2024-09-13T10:37:03.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.834+0000 7f7f20adf640 1 -- 172.21.15.181:0/3100934383 learned_addr learned my addr 172.21.15.181:0/3100934383 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:03.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.836+0000 7f7f20adf640 1 -- 172.21.15.181:0/3100934383 >> v1:172.21.15.181:6789/0 conn(0x7f7f1c0a6ab0 legacy=0x7f7f1c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.836+0000 7f7f21ae1640 1 -- 172.21.15.181:0/3100934383 >> v1:172.21.15.195:6791/0 conn(0x7f7f1c13f9a0 legacy=0x7f7f1c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.836+0000 7f7f1bfff640 1 -- 172.21.15.181:0/3100934383 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1013291777 0 0) 0x7f7f1c0a5fe0 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.836+0000 7f7f1bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.836+0000 7f7f1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.836+0000 7f7f1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.836+0000 7f7f1bfff640 10 monclient(hunting): my global_id is 114480 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.836+0000 7f7f1bfff640 1 -- 172.21.15.181:0/3100934383 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f04003520 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.836+0000 7f7f212e0640 1 -- 172.21.15.181:0/3100934383 >> v1:172.21.15.195:6790/0 conn(0x7f7f1c0a66d0 legacy=0x7f7f1c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 1 -- 172.21.15.181:0/3100934383 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932675387 0 0) 0x7f7f1c0a42c0 con 0x7f7f1c13f9a0 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient(hunting): my global_id is 104747 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 1 -- 172.21.15.181:0/3100934383 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f1c0a5fe0 con 0x7f7f1c13f9a0 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 1 -- 172.21.15.181:0/3100934383 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4066204659 0 0) 0x7f7f04003520 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 1 -- 172.21.15.181:0/3100934383 >> v1:172.21.15.195:6791/0 conn(0x7f7f1c13f9a0 legacy=0x7f7f1c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 1 -- 172.21.15.181:0/3100934383 >> v1:172.21.15.195:6790/0 conn(0x7f7f1c0a66d0 legacy=0x7f7f1c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 1 monclient: found mon.noname-a 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 1 -- 172.21.15.181:0/3100934383 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1c1464e0 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient: _finish_auth 0 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 1 -- 172.21.15.181:0/3100934383 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f10001ad0 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f23544640 5 monclient: authenticate success, global_id 114480 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f23544640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:03.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient: dump: 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.844 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.845 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.845 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f23544640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:03.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 1 -- 172.21.15.181:0/3100934383 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f100048a0 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:03.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 1 -- 172.21.15.181:0/3100934383 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f10004e10 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f23544640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:03.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f23544640 4 set_mon_vals no callback set 2024-09-13T10:37:03.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:03.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f1bfff640 10 monclient: dump: 2024-09-13T10:37:03.845 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.846 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f23544640 10 monclient: shutdown 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f23544640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f23544640 1 -- 172.21.15.181:0/3100934383 >> v1:172.21.15.181:6789/0 conn(0x7f7f1c0a6ab0 legacy=0x7f7f1c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f23544640 1 -- 172.21.15.181:0/3100934383 shutdown_connections 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f23544640 1 -- 172.21.15.181:0/3100934383 >> 172.21.15.181:0/3100934383 conn(0x7f7f1c0abcd0 msgr2=0x7f7f1c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f23544640 1 -- 172.21.15.181:0/3100934383 shutdown_connections 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.837+0000 7f7f23544640 1 -- 172.21.15.181:0/3100934383 wait complete. 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.838+0000 7f7f23544640 10 monclient: build_initial_monmap 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.838+0000 7f7f23544640 10 monclient: monmap: 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:03.847 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.838+0000 7f7f23544640 1 Processor -- start 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.838+0000 7f7f23544640 1 -- start start 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.838+0000 7f7f23544640 10 monclient: init 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.839+0000 7f7f23544640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.839+0000 7f7f23544640 10 monclient: _add_conns ranks=[5,0,8,1,2,6,3,4,7] 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.839+0000 7f7f23544640 10 monclient(hunting): picked mon.noname-h con 0x7f7f1c0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.839+0000 7f7f23544640 10 monclient(hunting): picked mon.noname-a con 0x7f7f1c0a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.839+0000 7f7f23544640 10 monclient(hunting): picked mon.noname-e con 0x7f7f1c13f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.839+0000 7f7f23544640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f1c13edc0 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.839+0000 7f7f23544640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f1c13f0a0 con 0x7f7f1c0a66d0 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.839+0000 7f7f23544640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f1c13e7d0 con 0x7f7f1c13f9a0 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.839+0000 7f7f23544640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.839+0000 7f7f23544640 10 monclient(hunting): authenticate will time out at 1163.344328s 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.839+0000 7f7f20adf640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7f1c0a6ab0 0x7f7f1c1d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53410/0 (socket says 172.21.15.181:53410) 2024-09-13T10:37:03.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.839+0000 7f7f20adf640 1 -- 172.21.15.181:0/3232194175 learned_addr learned my addr 172.21.15.181:0/3232194175 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:03.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f20adf640 1 -- 172.21.15.181:0/3232194175 >> v1:172.21.15.181:6789/0 conn(0x7f7f1c0a6ab0 legacy=0x7f7f1c1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f21ae1640 1 -- 172.21.15.181:0/3232194175 >> v1:172.21.15.181:6793/0 conn(0x7f7f1c13f9a0 legacy=0x7f7f1c1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f212e0640 1 -- 172.21.15.181:0/3232194175 >> v1:172.21.15.195:6791/0 conn(0x7f7f1c0a66d0 legacy=0x7f7f1c1366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:03.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333011439 0 0) 0x7f7f1c13edc0 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): my global_id is 114489 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f08003520 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1934757285 0 0) 0x7f7f1c13e7d0 con 0x7f7f1c13f9a0 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): my global_id is 104993 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f1c13edc0 con 0x7f7f1c13f9a0 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3359276185 0 0) 0x7f7f1c13f0a0 con 0x7f7f1c0a66d0 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:03.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): my global_id is 104756 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f1c13e7d0 con 0x7f7f1c0a66d0 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1568394866 0 0) 0x7f7f08003520 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f1c13f0a0 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1569984815 0 0) 0x7f7f1c13edc0 con 0x7f7f1c13f9a0 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f08003520 con 0x7f7f1c13f9a0 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f10004d90 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): dump: 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.855 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:03.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f0c002040 con 0x7f7f1c13f9a0 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.841+0000 7f7f19ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 10 monclient(hunting): dump: 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.857 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 481164866 0 0) 0x7f7f1c13e7d0 con 0x7f7f1c0a66d0 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f1c13edc0 con 0x7f7f1c0a66d0 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f14003610 con 0x7f7f1c0a66d0 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 10 monclient(hunting): dump: 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.858 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1284969623 0 0) 0x7f7f1c13f0a0 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 >> v1:172.21.15.181:6793/0 conn(0x7f7f1c13f9a0 legacy=0x7f7f1c1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 >> v1:172.21.15.195:6791/0 conn(0x7f7f1c0a66d0 legacy=0x7f7f1c1366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 1 monclient: found mon.a 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1c068680 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 10 monclient: _finish_auth 0 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f23544640 5 monclient: authenticate success, global_id 114489 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f23544640 10 monclient: _renew_subs 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f23544640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f23544640 1 -- 172.21.15.181:0/3232194175 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7f1c13f380 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f10001d20 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f10005740 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f19ffb640 10 monclient: dump: 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:03.861 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f1b7fe640 4 set_mon_vals no callback set 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f23544640 10 monclient: _renew_subs 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f23544640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.842+0000 7f7f23544640 1 -- 172.21.15.181:0/3232194175 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7f1c13c630 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.843+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7f10011dc0 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.843+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(224..224 src has 1..224) ==== 3898+0+0 (unknown 361099233 0 0) 0x7f7f1004e3a0 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.843+0000 7f7f23544640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:03.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.843+0000 7f7f23544640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:03.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.843+0000 7f7f23544640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:03.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.843+0000 7f7f23544640 1 -- 172.21.15.181:0/3232194175 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f1c074d40 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.843+0000 7f7f212e0640 10 monclient: get_auth_request con 0x7f7f08040460 auth_method 0 2024-09-13T10:37:03.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.847+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f7f1c074d40 con 0x7f7f1c0a6ab0 2024-09-13T10:37:03.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.847+0000 7f7f19ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:03.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:03.847+0000 7f7f19ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:04.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.089+0000 7f7f23544640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-13T10:37:04.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.089+0000 7f7f23544640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-13T10:37:04.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.089+0000 7f7f23544640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:04.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.089+0000 7f7f23544640 1 -- 172.21.15.181:0/3232194175 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f7f1c0a3240 con 0x7f7f1c0a6ab0 2024-09-13T10:37:04.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.092+0000 7f7f19ffb640 1 -- 172.21.15.181:0/3232194175 <== mon.0 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f7f100178f0 con 0x7f7f1c0a6ab0 2024-09-13T10:37:04.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.092+0000 7f7f19ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-13T10:37:04.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.092+0000 7f7f19ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:04.095 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.095 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=4196111062,config=2586702516,health=458764714,kv=222517459,logm=1712986908}) 2024-09-13T10:37:04.095 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=11,kv=11,logm=57} crc {auth=1473454061,config=2586702516,health=2286356095,kv=760235678,logm=375330288}) 2024-09-13T10:37:04.095 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.095 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=4196111062,config=2586702516,health=458764714,kv=222517459,logm=1712986908}) 2024-09-13T10:37:04.095 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=18,config=2,health=12,kv=12,logm=56} crc {auth=611252310,config=2586702516,health=739250522,kv=3467323233,logm=308965507}) 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=4196111062,config=2586702516,health=458764714,kv=222517459,logm=1712986908}) 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=18,config=2,health=12,kv=10,logm=58} crc {auth=4024455246,config=2586702516,health=739250522,kv=4267675733,logm=2184538517}) 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=4196111062,config=2586702516,health=458764714,kv=222517459,logm=1712986908}) 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=16,config=2,health=12,kv=11,logm=59} crc {auth=4228003847,config=2586702516,health=739250523,kv=760235678,logm=848946248}) 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=4196111062,config=2586702516,health=458764714,kv=222517459,logm=1712986908}) 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=18,config=2,health=12,kv=12,logm=56} crc {auth=846114667,config=2586702516,health=739250522,kv=3467323233,logm=1493390465}) 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=4196111062,config=2586702516,health=458764714,kv=222517459,logm=1712986908}) 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=17,config=2,health=11,kv=12,logm=58} crc {auth=1424483764,config=2586702516,health=1021086455,kv=3467323233,logm=2787108597}) 2024-09-13T10:37:04.096 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.097 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=4196111062,config=2586702516,health=458764714,kv=222517459,logm=1712986908}) 2024-09-13T10:37:04.097 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=1473454061,config=2586702516,health=739250522,kv=3467323233,logm=3437106500}) 2024-09-13T10:37:04.097 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.097 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=4196111062,config=2586702516,health=458764714,kv=222517459,logm=1712986908}) 2024-09-13T10:37:04.097 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.092+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=19,config=2,health=10,kv=9,logm=60} crc {auth=1473454061,config=2586702516,health=221594133,kv=2582457679,logm=1178629125}) 2024-09-13T10:37:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.094+0000 7f7f23544640 1 -- 172.21.15.181:0/3232194175 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7f08040460 legacy=0x7f7f08042920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.094+0000 7f7f23544640 10 monclient: shutdown 2024-09-13T10:37:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.094+0000 7f7f23544640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.094+0000 7f7f23544640 1 -- 172.21.15.181:0/3232194175 >> v1:172.21.15.181:6789/0 conn(0x7f7f1c0a6ab0 legacy=0x7f7f1c1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.095+0000 7f7f23544640 1 -- 172.21.15.181:0/3232194175 shutdown_connections 2024-09-13T10:37:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.095+0000 7f7f23544640 1 -- 172.21.15.181:0/3232194175 >> 172.21.15.181:0/3232194175 conn(0x7f7f1c0abcd0 msgr2=0x7f7f1c0a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.095+0000 7f7f23544640 1 -- 172.21.15.181:0/3232194175 shutdown_connections 2024-09-13T10:37:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:04.095+0000 7f7f23544640 1 -- 172.21.15.181:0/3232194175 wait complete. 2024-09-13T10:37:04.111 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-13T10:37:04.117 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.117 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2691038682}) 2024-09-13T10:37:04.117 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2176590978}) 2024-09-13T10:37:04.117 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.117 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2691038682}) 2024-09-13T10:37:04.117 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4009293137}) 2024-09-13T10:37:04.117 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.117 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2691038682}) 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1728855325}) 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2691038682}) 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1636546348}) 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2691038682}) 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1319090287}) 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2691038682}) 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=647815259}) 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2691038682}) 2024-09-13T10:37:04.118 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1691784554}) 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2691038682}) 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.102+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3155376467}) 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3008973197}) 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=168893840}) 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3008973197}) 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2962575626}) 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3008973197}) 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=318366599}) 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.119 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3008973197}) 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=769300113}) 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3008973197}) 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1602559206}) 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3008973197}) 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1872216253}) 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3008973197}) 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3533308906}) 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3008973197}) 2024-09-13T10:37:04.120 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.104+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3066645459}) 2024-09-13T10:37:04.121 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.121 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=342308735}) 2024-09-13T10:37:04.121 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3175575767}) 2024-09-13T10:37:04.121 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.121 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=342308735}) 2024-09-13T10:37:04.121 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=809835901}) 2024-09-13T10:37:04.121 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.121 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=342308735}) 2024-09-13T10:37:04.121 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2367798659}) 2024-09-13T10:37:04.121 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.121 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=342308735}) 2024-09-13T10:37:04.121 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2829062830}) 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=342308735}) 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=595353774}) 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=342308735}) 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2842118546}) 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=342308735}) 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3101898257}) 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=342308735}) 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.105+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4168253268}) 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.122 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3528590046}) 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=866191136}) 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3528590046}) 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2637873833}) 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3528590046}) 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=121344223}) 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3528590046}) 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3557811600}) 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3528590046}) 2024-09-13T10:37:04.123 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2282697454}) 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3528590046}) 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3714799075}) 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3528590046}) 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4155903431}) 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.106+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3528590046}) 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.107+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3332395416}) 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1165982240}) 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3634537321}) 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.124 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1165982240}) 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1318797213}) 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1165982240}) 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=462617166}) 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1165982240}) 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3144559697}) 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1165982240}) 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4279315374}) 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1165982240}) 2024-09-13T10:37:04.125 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3533331029}) 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1165982240}) 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3756696829}) 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1165982240}) 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.108+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4252096467}) 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1871393060}) 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2532046644}) 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1871393060}) 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4122744045}) 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.126 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1871393060}) 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=621791161}) 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1871393060}) 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=447438927}) 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1871393060}) 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3299896430}) 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1871393060}) 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3251582065}) 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1871393060}) 2024-09-13T10:37:04.127 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2874712448}) 2024-09-13T10:37:04.128 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.128 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1871393060}) 2024-09-13T10:37:04.128 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.109+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2136449426}) 2024-09-13T10:37:04.128 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.128 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4184286367}) 2024-09-13T10:37:04.128 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3172747965}) 2024-09-13T10:37:04.128 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.128 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4184286367}) 2024-09-13T10:37:04.128 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1167369983}) 2024-09-13T10:37:04.128 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.128 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4184286367}) 2024-09-13T10:37:04.128 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4139495077}) 2024-09-13T10:37:04.129 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.129 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4184286367}) 2024-09-13T10:37:04.129 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1414426346}) 2024-09-13T10:37:04.129 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.129 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4184286367}) 2024-09-13T10:37:04.129 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1377404605}) 2024-09-13T10:37:04.129 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.129 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4184286367}) 2024-09-13T10:37:04.129 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2976714695}) 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4184286367}) 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1959681394}) 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4184286367}) 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.110+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2960042074}) 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4252994107}) 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4218049772}) 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4252994107}) 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2759166989}) 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.130 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4252994107}) 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1188351929}) 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4252994107}) 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1176830868}) 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4252994107}) 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3309856323}) 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4252994107}) 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1760772108}) 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4252994107}) 2024-09-13T10:37:04.131 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3368523268}) 2024-09-13T10:37:04.132 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.132 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4252994107}) 2024-09-13T10:37:04.132 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.111+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1957409367}) 2024-09-13T10:37:04.691 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.688+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.692 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.688+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2462835056}) 2024-09-13T10:37:04.692 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.688+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2607685233}) 2024-09-13T10:37:04.692 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.688+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.692 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.688+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2462835056}) 2024-09-13T10:37:04.692 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3300545441}) 2024-09-13T10:37:04.692 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.692 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2462835056}) 2024-09-13T10:37:04.692 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3711208852}) 2024-09-13T10:37:04.692 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.692 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2462835056}) 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3207660133}) 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2462835056}) 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=418900956}) 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2462835056}) 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2371228419}) 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2462835056}) 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3807856566}) 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2462835056}) 2024-09-13T10:37:04.693 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.689+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1222494840}) 2024-09-13T10:37:04.709 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.704+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.709 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.704+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1860891002}) 2024-09-13T10:37:04.709 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.704+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789932537}) 2024-09-13T10:37:04.709 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.704+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.709 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.704+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1860891002}) 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.704+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=631849023}) 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.704+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.704+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1860891002}) 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2868179881}) 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1860891002}) 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1934657617}) 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1860891002}) 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=703731768}) 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1860891002}) 2024-09-13T10:37:04.710 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3273680446}) 2024-09-13T10:37:04.711 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.711 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1860891002}) 2024-09-13T10:37:04.711 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4204359069}) 2024-09-13T10:37:04.711 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.711 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1860891002}) 2024-09-13T10:37:04.711 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.705+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=887385514}) 2024-09-13T10:37:04.711 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.712 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=294364290}) 2024-09-13T10:37:04.712 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=342636660}) 2024-09-13T10:37:04.712 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.712 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=294364290}) 2024-09-13T10:37:04.712 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2375637897}) 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=294364290}) 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1973638497}) 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=294364290}) 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3985442412}) 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=294364290}) 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=959513650}) 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=294364290}) 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3835440723}) 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.713 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=294364290}) 2024-09-13T10:37:04.714 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=139118240}) 2024-09-13T10:37:04.714 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.714 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=294364290}) 2024-09-13T10:37:04.714 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.710+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3150158895}) 2024-09-13T10:37:04.811 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:04.812 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39162]: starting. 2024-09-13T10:37:04.812 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39162]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39125 2024-09-13T10:37:04.812 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39162]: created object 0... 2024-09-13T10:37:04.812 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39162]: created object 25... 2024-09-13T10:37:04.812 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39162]: created object 49... 2024-09-13T10:37:04.812 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39162]: finishing. 2024-09-13T10:37:04.812 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39162]: shutting down. 2024-09-13T10:37:04.849 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:04.849 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39164]: starting. 2024-09-13T10:37:04.849 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39164]: listing objects. 2024-09-13T10:37:04.850 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39164]: listed object 0... 2024-09-13T10:37:04.850 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39164]: listed object 25... 2024-09-13T10:37:04.850 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39164]: saw 50 objects 2024-09-13T10:37:04.850 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39164]: shutting down. 2024-09-13T10:37:04.936 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.936 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3852726003}) 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1486435221}) 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3852726003}) 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2595076692}) 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3852726003}) 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2503397436}) 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3852726003}) 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3871747924}) 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3852726003}) 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=488859058}) 2024-09-13T10:37:04.937 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3852726003}) 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3317102495}) 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3852726003}) 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3449409570}) 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3852726003}) 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1167306393}) 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1666582936}) 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3157109909}) 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.938 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1666582936}) 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=900977420}) 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1666582936}) 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2895314211}) 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.931+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1666582936}) 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2010869212}) 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1666582936}) 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1851866903}) 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1666582936}) 2024-09-13T10:37:04.939 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=49502868}) 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1666582936}) 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1594327633}) 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1666582936}) 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.932+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1665186851}) 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2837697234}) 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3836368312}) 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2837697234}) 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=284305064}) 2024-09-13T10:37:04.940 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.941 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2837697234}) 2024-09-13T10:37:04.941 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1717087138}) 2024-09-13T10:37:04.941 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.941 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2837697234}) 2024-09-13T10:37:04.941 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=620805030}) 2024-09-13T10:37:04.941 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.941 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2837697234}) 2024-09-13T10:37:04.941 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2370728877}) 2024-09-13T10:37:04.941 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.941 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2837697234}) 2024-09-13T10:37:04.941 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=375446803}) 2024-09-13T10:37:04.941 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.942 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2837697234}) 2024-09-13T10:37:04.942 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2417565361}) 2024-09-13T10:37:04.942 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.942 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2837697234}) 2024-09-13T10:37:04.942 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.933+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3731959547}) 2024-09-13T10:37:04.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2430559025}) 2024-09-13T10:37:04.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1182293521}) 2024-09-13T10:37:04.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2430559025}) 2024-09-13T10:37:04.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=984587636}) 2024-09-13T10:37:04.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2430559025}) 2024-09-13T10:37:04.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4111551319}) 2024-09-13T10:37:04.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2430559025}) 2024-09-13T10:37:04.959 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=877957071}) 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2430559025}) 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1914491932}) 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2430559025}) 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1076606636}) 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2430559025}) 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2025493998}) 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2430559025}) 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.942+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2728279434}) 2024-09-13T10:37:04.960 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=573351750}) 2024-09-13T10:37:04.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1014442799}) 2024-09-13T10:37:04.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=573351750}) 2024-09-13T10:37:04.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2654555685}) 2024-09-13T10:37:04.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=573351750}) 2024-09-13T10:37:04.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2266699003}) 2024-09-13T10:37:04.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.961 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=573351750}) 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1187459883}) 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.943+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.944+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=573351750}) 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.944+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3345663064}) 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.944+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.944+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=573351750}) 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.944+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2898582984}) 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.944+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.944+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=573351750}) 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.944+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3881390274}) 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.944+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.944+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=573351750}) 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.944+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=828998089}) 2024-09-13T10:37:04.962 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=445587012}) 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2554019244}) 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=445587012}) 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3694168648}) 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=445587012}) 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=215411842}) 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=445587012}) 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1317835547}) 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=445587012}) 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2936239478}) 2024-09-13T10:37:04.963 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=445587012}) 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=888980671}) 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=445587012}) 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1249826226}) 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=445587012}) 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.945+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1985264971}) 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=268709569}) 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2391673429}) 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.964 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=268709569}) 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=740159085}) 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=268709569}) 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2606404072}) 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=268709569}) 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4085481295}) 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=268709569}) 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=704309449}) 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=268709569}) 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=940384594}) 2024-09-13T10:37:04.965 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=268709569}) 2024-09-13T10:37:04.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=275882531}) 2024-09-13T10:37:04.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=268709569}) 2024-09-13T10:37:04.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.946+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2860188606}) 2024-09-13T10:37:04.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=63127107}) 2024-09-13T10:37:04.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=898248833}) 2024-09-13T10:37:04.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.966 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=63127107}) 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2067673966}) 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=63127107}) 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=825824500}) 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=63127107}) 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2363545219}) 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=63127107}) 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1369486492}) 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=63127107}) 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3124562097}) 2024-09-13T10:37:04.967 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=63127107}) 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2277286547}) 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=63127107}) 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.947+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=365580111}) 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3954194662}) 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3823652560}) 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3954194662}) 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1473515503}) 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3954194662}) 2024-09-13T10:37:04.968 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=715499597}) 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3954194662}) 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=375137160}) 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3954194662}) 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1633147079}) 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3954194662}) 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2320788973}) 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3954194662}) 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1877067647}) 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.969 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3954194662}) 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.948+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3080962539}) 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.949+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.949+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4239955993}) 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.949+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434130147}) 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.949+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.949+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4239955993}) 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.949+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=902337101}) 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4239955993}) 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=296872669}) 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4239955993}) 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3648538829}) 2024-09-13T10:37:04.970 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4239955993}) 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2073806060}) 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4239955993}) 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=966382725}) 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4239955993}) 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2106214698}) 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4239955993}) 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.950+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2881220946}) 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3539768058}) 2024-09-13T10:37:04.971 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1776122498}) 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3539768058}) 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=677863061}) 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3539768058}) 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1878790997}) 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3539768058}) 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=363203094}) 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3539768058}) 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3891764645}) 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.972 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3539768058}) 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2991103016}) 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3539768058}) 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=21798517}) 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3539768058}) 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.951+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1283771808}) 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1446490061}) 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1921341270}) 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1446490061}) 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2789633107}) 2024-09-13T10:37:04.973 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1446490061}) 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1361522424}) 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1446490061}) 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3177307142}) 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1446490061}) 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=961439229}) 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1446490061}) 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1376697628}) 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1446490061}) 2024-09-13T10:37:04.974 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=203245802}) 2024-09-13T10:37:04.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:04.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1446490061}) 2024-09-13T10:37:04.975 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:04.954+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2270576554}) 2024-09-13T10:37:05.112 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:37:05.112 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:37:05.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.210+0000 7ff05a310640 10 monclient: get_monmap_and_config 2024-09-13T10:37:05.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.210+0000 7ff05a310640 10 monclient: build_initial_monmap 2024-09-13T10:37:05.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.210+0000 7ff05a310640 10 monclient: monmap: 2024-09-13T10:37:05.212 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:05.212 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.212 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:05.211343+0000 2024-09-13T10:37:05.212 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:05.211343+0000 2024-09-13T10:37:05.212 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:05.213 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.213 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:05.213 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:05.213 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:05.213 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:05.213 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:05.213 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:05.213 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:05.213 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:05.213 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:05.213 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.211+0000 7ff05a310640 1 Processor -- start 2024-09-13T10:37:05.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.211+0000 7ff05a310640 1 -- start start 2024-09-13T10:37:05.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.211+0000 7ff05a310640 10 monclient: init 2024-09-13T10:37:05.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.211+0000 7ff05a310640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:05.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.211+0000 7ff05a310640 10 monclient: _add_conns ranks=[1,0,8,5,7,3,6,4,2] 2024-09-13T10:37:05.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.211+0000 7ff05a310640 10 monclient(hunting): picked mon.noname-f con 0x7ff054139040 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:05.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.211+0000 7ff05a310640 10 monclient(hunting): picked mon.noname-a con 0x7ff05409cd50 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.212+0000 7ff05a310640 10 monclient(hunting): picked mon.noname-e con 0x7ff05413fae0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.212+0000 7ff05a310640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff05409dbb0 con 0x7ff05409cd50 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.212+0000 7ff05a310640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff05409de90 con 0x7ff054139040 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.212+0000 7ff05a310640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff05409e170 con 0x7ff05413fae0 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.212+0000 7ff05a310640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.212+0000 7ff05a310640 10 monclient(hunting): authenticate will time out at 1164.717047s 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.212+0000 7ff0588ad640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7ff05413fae0 0x7ff054141ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33154/0 (socket says 172.21.15.181:33154) 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.212+0000 7ff0588ad640 1 -- 172.21.15.181:0/2830876215 learned_addr learned my addr 172.21.15.181:0/2830876215 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.212+0000 7ff0537fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff05409cd50 0x7ff05413e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53418/0 (socket says 172.21.15.181:53418) 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff0588ad640 1 -- 172.21.15.181:0/2830876215 >> v1:172.21.15.181:6793/0 conn(0x7ff05413fae0 legacy=0x7ff054141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff0537fe640 1 -- 172.21.15.181:0/2830876215 >> v1:172.21.15.181:6789/0 conn(0x7ff05409cd50 legacy=0x7ff05413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff053fff640 1 -- 172.21.15.181:0/2830876215 >> v1:172.21.15.195:6789/0 conn(0x7ff054139040 legacy=0x7ff0540a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 1 -- 172.21.15.181:0/2830876215 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2830131123 0 0) 0x7ff05409e170 con 0x7ff05413fae0 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient(hunting): my global_id is 105002 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 1 -- 172.21.15.181:0/2830876215 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff03c003520 con 0x7ff05413fae0 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 1 -- 172.21.15.181:0/2830876215 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664636027 0 0) 0x7ff05409dbb0 con 0x7ff05409cd50 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient(hunting): my global_id is 114498 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 1 -- 172.21.15.181:0/2830876215 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff05409e170 con 0x7ff05409cd50 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 1 -- 172.21.15.181:0/2830876215 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 224793247 0 0) 0x7ff05409e170 con 0x7ff05409cd50 2024-09-13T10:37:05.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 1 -- 172.21.15.181:0/2830876215 >> v1:172.21.15.181:6793/0 conn(0x7ff05413fae0 legacy=0x7ff054141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 1 -- 172.21.15.181:0/2830876215 >> v1:172.21.15.195:6789/0 conn(0x7ff054139040 legacy=0x7ff0540a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 1 monclient: found mon.noname-a 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 1 -- 172.21.15.181:0/2830876215 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0540a5ff0 con 0x7ff05409cd50 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 1 -- 172.21.15.181:0/2830876215 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff048001b80 con 0x7ff05409cd50 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff05a310640 5 monclient: authenticate success, global_id 114498 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff05a310640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:05.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient: dump: 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.223 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff05a310640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 1 -- 172.21.15.181:0/2830876215 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff048001d20 con 0x7ff05409cd50 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 1 -- 172.21.15.181:0/2830876215 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff048004b20 con 0x7ff05409cd50 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff052ffd640 10 monclient: dump: 2024-09-13T10:37:05.224 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.225 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.226 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.226 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff05a310640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:05.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.214+0000 7ff05a310640 4 set_mon_vals no callback set 2024-09-13T10:37:05.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.215+0000 7ff05a310640 10 monclient: shutdown 2024-09-13T10:37:05.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.215+0000 7ff05a310640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:05.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.215+0000 7ff05a310640 1 -- 172.21.15.181:0/2830876215 >> v1:172.21.15.181:6789/0 conn(0x7ff05409cd50 legacy=0x7ff05413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.215+0000 7ff05a310640 1 -- 172.21.15.181:0/2830876215 shutdown_connections 2024-09-13T10:37:05.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.215+0000 7ff05a310640 1 -- 172.21.15.181:0/2830876215 >> 172.21.15.181:0/2830876215 conn(0x7ff054077120 msgr2=0x7ff0540abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:05.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.215+0000 7ff05a310640 1 -- 172.21.15.181:0/2830876215 shutdown_connections 2024-09-13T10:37:05.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.215+0000 7ff05a310640 1 -- 172.21.15.181:0/2830876215 wait complete. 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.215+0000 7ff05a310640 10 monclient: build_initial_monmap 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.215+0000 7ff05a310640 10 monclient: monmap: 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:05.227 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.216+0000 7ff05a310640 1 Processor -- start 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.216+0000 7ff05a310640 1 -- start start 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.216+0000 7ff05a310640 10 monclient: init 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.216+0000 7ff05a310640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.216+0000 7ff05a310640 10 monclient: _add_conns ranks=[2,6,4,0,3,5,1,8,7] 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.216+0000 7ff05a310640 10 monclient(hunting): picked mon.noname-b con 0x7ff05409cd50 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.216+0000 7ff05a310640 10 monclient(hunting): picked mon.noname-d con 0x7ff054139040 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.216+0000 7ff05a310640 10 monclient(hunting): picked mon.noname-c con 0x7ff05413fae0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:05.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.217+0000 7ff05a310640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff05413a7a0 con 0x7ff05409cd50 2024-09-13T10:37:05.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.217+0000 7ff05a310640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff05413aa80 con 0x7ff05413fae0 2024-09-13T10:37:05.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.217+0000 7ff05a310640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff054135760 con 0x7ff054139040 2024-09-13T10:37:05.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.217+0000 7ff05a310640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:05.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.217+0000 7ff05a310640 10 monclient(hunting): authenticate will time out at 1164.722034s 2024-09-13T10:37:05.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.217+0000 7ff053fff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7ff05409cd50 0x7ff054133dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55796/0 (socket says 172.21.15.181:55796) 2024-09-13T10:37:05.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.217+0000 7ff053fff640 1 -- 172.21.15.181:0/515597726 learned_addr learned my addr 172.21.15.181:0/515597726 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:05.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff0537fe640 1 -- 172.21.15.181:0/515597726 >> v1:172.21.15.181:6792/0 conn(0x7ff054139040 legacy=0x7ff0541344d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff053fff640 1 -- 172.21.15.181:0/515597726 >> v1:172.21.15.181:6790/0 conn(0x7ff05409cd50 legacy=0x7ff054133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff0588ad640 1 -- 172.21.15.181:0/515597726 >> v1:172.21.15.181:6791/0 conn(0x7ff05413fae0 legacy=0x7ff054134be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 335050086 0 0) 0x7ff054135760 con 0x7ff054139040 2024-09-13T10:37:05.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): my global_id is 124206 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff040003520 con 0x7ff054139040 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1016183170 0 0) 0x7ff05413aa80 con 0x7ff05413fae0 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): my global_id is 114610 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff054135760 con 0x7ff05413fae0 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1114127748 0 0) 0x7ff05413a7a0 con 0x7ff05409cd50 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): my global_id is 124139 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff05413aa80 con 0x7ff05409cd50 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1066391017 0 0) 0x7ff040003520 con 0x7ff054139040 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff05413a7a0 con 0x7ff054139040 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff048001ac0 con 0x7ff054139040 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.234 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2760705185 0 0) 0x7ff054135760 con 0x7ff05413fae0 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff040003520 con 0x7ff05413fae0 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff04c002020 con 0x7ff05413fae0 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.236 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.237 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.237 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.237 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.237 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.237 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.237 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.237 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.237 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.237 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1391730688 0 0) 0x7ff05413aa80 con 0x7ff05409cd50 2024-09-13T10:37:05.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff054135760 con 0x7ff05409cd50 2024-09-13T10:37:05.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff044003610 con 0x7ff05409cd50 2024-09-13T10:37:05.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:05.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:05.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:05.238 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.238 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.238 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.238 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.238 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.238 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.239 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.239 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.239 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.239 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.239 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.239 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.239 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.239 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.239 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.239 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2372261825 0 0) 0x7ff05413a7a0 con 0x7ff054139040 2024-09-13T10:37:05.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 >> v1:172.21.15.181:6791/0 conn(0x7ff05413fae0 legacy=0x7ff054134be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 >> v1:172.21.15.181:6790/0 conn(0x7ff05409cd50 legacy=0x7ff054133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 monclient: found mon.d 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff054136240 con 0x7ff054139040 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient: _finish_auth 0 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff050ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff05a310640 5 monclient: authenticate success, global_id 124206 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff05a310640 10 monclient: _renew_subs 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff05a310640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:05.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.219+0000 7ff05a310640 1 -- 172.21.15.181:0/515597726 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff0541d76c0 con 0x7ff054139040 2024-09-13T10:37:05.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff05a310640 10 monclient: _renew_subs 2024-09-13T10:37:05.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff05a310640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:05.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff05a310640 1 -- 172.21.15.181:0/515597726 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7ff0541d7a70 con 0x7ff054139040 2024-09-13T10:37:05.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff048001c60 con 0x7ff054139040 2024-09-13T10:37:05.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff050ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:05.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff048005500 con 0x7ff054139040 2024-09-13T10:37:05.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff050ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff0527fc640 4 set_mon_vals no callback set 2024-09-13T10:37:05.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff050ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:05.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff050ff9640 10 monclient: dump: 2024-09-13T10:37:05.241 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.241 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.242 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.242 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.242 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.242 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.242 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.242 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.242 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.242 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.242 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.242 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.242 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.242 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.243 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.243 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff048011b80 con 0x7ff054139040 2024-09-13T10:37:05.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff05a310640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:05.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff05a310640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:05.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff05a310640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:05.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.220+0000 7ff05a310640 1 -- 172.21.15.181:0/515597726 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff034005080 con 0x7ff054139040 2024-09-13T10:37:05.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.221+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(225..225 src has 1..225) ==== 3898+0+0 (unknown 4236598751 0 0) 0x7ff04804e3b0 con 0x7ff054139040 2024-09-13T10:37:05.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.221+0000 7ff053fff640 10 monclient: get_auth_request con 0x7ff040040550 auth_method 0 2024-09-13T10:37:05.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.225+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7ff048017900 con 0x7ff054139040 2024-09-13T10:37:05.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.225+0000 7ff050ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:05.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.225+0000 7ff050ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:05.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1067602177}) 2024-09-13T10:37:05.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2745831121}) 2024-09-13T10:37:05.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1067602177}) 2024-09-13T10:37:05.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2401001083}) 2024-09-13T10:37:05.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1067602177}) 2024-09-13T10:37:05.413 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=904317872}) 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1067602177}) 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4286402822}) 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1067602177}) 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2620905718}) 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1067602177}) 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3967911712}) 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1067602177}) 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3082796924}) 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.414 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1067602177}) 2024-09-13T10:37:05.415 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.410+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3030628668}) 2024-09-13T10:37:05.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.467+0000 7ff05a310640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:37:05.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.467+0000 7ff05a310640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:05.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.467+0000 7ff05a310640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:05.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.467+0000 7ff05a310640 1 -- 172.21.15.181:0/515597726 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff034005370 con 0x7ff054139040 2024-09-13T10:37:05.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.467+0000 7ff050ff9640 1 -- 172.21.15.181:0/515597726 <== mon.6 v1:172.21.15.181:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 4258448745) 0x7ff048017200 con 0x7ff054139040 2024-09-13T10:37:05.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.467+0000 7ff050ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:05.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.467+0000 7ff050ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:05.469 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":110,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":3,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:37:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.470+0000 7ff05a310640 1 -- 172.21.15.181:0/515597726 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff040040550 legacy=0x7ff040042a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.470+0000 7ff05a310640 10 monclient: shutdown 2024-09-13T10:37:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.470+0000 7ff05a310640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.470+0000 7ff05a310640 1 -- 172.21.15.181:0/515597726 >> v1:172.21.15.181:6792/0 conn(0x7ff054139040 legacy=0x7ff0541344d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.470+0000 7ff05a310640 1 -- 172.21.15.181:0/515597726 shutdown_connections 2024-09-13T10:37:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.470+0000 7ff05a310640 1 -- 172.21.15.181:0/515597726 >> 172.21.15.181:0/515597726 conn(0x7ff054077120 msgr2=0x7ff054137f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.470+0000 7ff05a310640 1 -- 172.21.15.181:0/515597726 shutdown_connections 2024-09-13T10:37:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.470+0000 7ff05a310640 1 -- 172.21.15.181:0/515597726 wait complete. 2024-09-13T10:37:05.481 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:37:05.481 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T10:37:05.482 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:37:05.482 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:37:05.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.579+0000 7f86f6f3a640 10 monclient: get_monmap_and_config 2024-09-13T10:37:05.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.579+0000 7f86f6f3a640 10 monclient: build_initial_monmap 2024-09-13T10:37:05.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.579+0000 7f86f6f3a640 10 monclient: monmap: 2024-09-13T10:37:05.581 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:05.581 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.581 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:05.580161+0000 2024-09-13T10:37:05.581 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:05.580161+0000 2024-09-13T10:37:05.581 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:05.581 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.581 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:05.581 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:05.582 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:05.582 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:05.582 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:05.582 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:05.582 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:05.582 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:05.582 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:05.582 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 1 Processor -- start 2024-09-13T10:37:05.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 1 -- start start 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 10 monclient: init 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 10 monclient: _add_conns ranks=[7,1,5,4,6,8,2,3,0] 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 10 monclient(hunting): picked mon.noname-i con 0x7f86f00a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 10 monclient(hunting): picked mon.noname-f con 0x7f86f00a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 10 monclient(hunting): picked mon.noname-h con 0x7f86f013f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f00a4bc0 con 0x7f86f00a8340 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f013a320 con 0x7f86f013f750 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f00a8100 con 0x7f86f00a6640 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f6f3a640 10 monclient(hunting): authenticate will time out at 1165.085819s 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86effff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f86f00a8340 0x7f86f0139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:45392/0 (socket says 172.21.15.181:45392) 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86effff640 1 -- 172.21.15.181:0/1030744449 learned_addr learned my addr 172.21.15.181:0/1030744449 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:05.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.580+0000 7f86f4cd6640 1 --1- 172.21.15.181:0/1030744449 >> v1:172.21.15.195:6792/0 conn(0x7f86f00a6640 0x7f86f0139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:34640/0 (socket says 172.21.15.181:34640) 2024-09-13T10:37:05.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86effff640 1 -- 172.21.15.181:0/1030744449 >> v1:172.21.15.195:6789/0 conn(0x7f86f00a8340 legacy=0x7f86f0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86f4cd6640 1 -- 172.21.15.181:0/1030744449 >> v1:172.21.15.195:6792/0 conn(0x7f86f00a6640 legacy=0x7f86f0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 1 -- 172.21.15.181:0/1030744449 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267783033 0 0) 0x7f86f00a8100 con 0x7f86f00a6640 2024-09-13T10:37:05.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient(hunting): my global_id is 56824 2024-09-13T10:37:05.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 1 -- 172.21.15.181:0/1030744449 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86e0003520 con 0x7f86f00a6640 2024-09-13T10:37:05.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 1 -- 172.21.15.181:0/1030744449 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200752422 0 0) 0x7f86f00a4bc0 con 0x7f86f00a8340 2024-09-13T10:37:05.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient(hunting): my global_id is 56926 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 1 -- 172.21.15.181:0/1030744449 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f00a8100 con 0x7f86f00a8340 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 1 -- 172.21.15.181:0/1030744449 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1816661256 0 0) 0x7f86e0003520 con 0x7f86f00a6640 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 1 -- 172.21.15.181:0/1030744449 >> v1:172.21.15.195:6791/0 conn(0x7f86f013f750 legacy=0x7f86f0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 1 -- 172.21.15.181:0/1030744449 >> v1:172.21.15.195:6789/0 conn(0x7f86f00a8340 legacy=0x7f86f0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 1 monclient: found mon.noname-i 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 1 -- 172.21.15.181:0/1030744449 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f00a48e0 con 0x7f86f00a6640 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:05.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86f6f3a640 5 monclient: authenticate success, global_id 56824 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86f6f3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 1 -- 172.21.15.181:0/1030744449 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f86e4001ba0 con 0x7f86f00a6640 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient: dump: 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.603 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86f6f3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 1 -- 172.21.15.181:0/1030744449 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f86e40047e0 con 0x7f86f00a6640 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:05.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86f6f3a640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86f6f3a640 4 set_mon_vals no callback set 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 1 -- 172.21.15.181:0/1030744449 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f86e4004d50 con 0x7f86f00a6640 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.583+0000 7f86ef7fe640 10 monclient: dump: 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.605 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.606 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.584+0000 7f86f6f3a640 10 monclient: shutdown 2024-09-13T10:37:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.584+0000 7f86f6f3a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.584+0000 7f86f6f3a640 1 -- 172.21.15.181:0/1030744449 >> v1:172.21.15.195:6792/0 conn(0x7f86f00a6640 legacy=0x7f86f0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.584+0000 7f86f6f3a640 1 -- 172.21.15.181:0/1030744449 shutdown_connections 2024-09-13T10:37:05.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.584+0000 7f86f6f3a640 1 -- 172.21.15.181:0/1030744449 >> 172.21.15.181:0/1030744449 conn(0x7f86f0077170 msgr2=0x7f86f00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.584+0000 7f86f6f3a640 1 -- 172.21.15.181:0/1030744449 shutdown_connections 2024-09-13T10:37:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.584+0000 7f86f6f3a640 1 -- 172.21.15.181:0/1030744449 wait complete. 2024-09-13T10:37:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.585+0000 7f86f6f3a640 10 monclient: build_initial_monmap 2024-09-13T10:37:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.585+0000 7f86f6f3a640 10 monclient: monmap: 2024-09-13T10:37:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:05.607 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.585+0000 7f86f6f3a640 1 Processor -- start 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.585+0000 7f86f6f3a640 1 -- start start 2024-09-13T10:37:05.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.585+0000 7f86f6f3a640 10 monclient: init 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.586+0000 7f86f6f3a640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.586+0000 7f86f6f3a640 10 monclient: _add_conns ranks=[3,5,0,1,4,2,8,6,7] 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.586+0000 7f86f6f3a640 10 monclient(hunting): picked mon.noname-g con 0x7f86f00a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.586+0000 7f86f6f3a640 10 monclient(hunting): picked mon.noname-h con 0x7f86f013f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.586+0000 7f86f4cd6640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f86f00a8340 0x7f86f01389e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:47284/0 (socket says 172.21.15.181:47284) 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.586+0000 7f86f4cd6640 1 -- 172.21.15.181:0/3670823474 learned_addr learned my addr 172.21.15.181:0/3670823474 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.586+0000 7f86f6f3a640 10 monclient(hunting): picked mon.noname-a con 0x7f86f01390f0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.586+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f013caf0 con 0x7f86f01390f0 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.587+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f0133ec0 con 0x7f86f00a8340 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.587+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f013d650 con 0x7f86f013f750 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.587+0000 7f86f6f3a640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.587+0000 7f86f6f3a640 10 monclient(hunting): authenticate will time out at 1165.092106s 2024-09-13T10:37:05.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86f4cd6640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.195:6790/0 conn(0x7f86f00a8340 legacy=0x7f86f01389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86effff640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.195:6791/0 conn(0x7f86f013f750 legacy=0x7f86f01d3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86f54d7640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.181:6789/0 conn(0x7f86f01390f0 legacy=0x7f86f01d70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2586178103 0 0) 0x7f86f013d650 con 0x7f86f013f750 2024-09-13T10:37:05.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): my global_id is 104765 2024-09-13T10:37:05.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86d4003520 con 0x7f86f013f750 2024-09-13T10:37:05.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750581334 0 0) 0x7f86f013caf0 con 0x7f86f01390f0 2024-09-13T10:37:05.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): my global_id is 114507 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f013d650 con 0x7f86f01390f0 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2665374837 0 0) 0x7f86f013d650 con 0x7f86f01390f0 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86f013caf0 con 0x7f86f01390f0 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f86e8001ea0 con 0x7f86f01390f0 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): dump: 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.611 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3726562977 0 0) 0x7f86d4003520 con 0x7f86f013f750 2024-09-13T10:37:05.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86f013d650 con 0x7f86f013f750 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f86dc0047e0 con 0x7f86f013f750 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.589+0000 7f86ed7fa640 10 monclient(hunting): dump: 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.613 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3730877366 0 0) 0x7f86f013caf0 con 0x7f86f01390f0 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.195:6791/0 conn(0x7f86f013f750 legacy=0x7f86f01d3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.195:6790/0 conn(0x7f86f00a8340 legacy=0x7f86f01389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 1 monclient: found mon.a 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:05.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f013e5b0 con 0x7f86f01390f0 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 10 monclient: _finish_auth 0 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86f6f3a640 5 monclient: authenticate success, global_id 114507 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86f6f3a640 10 monclient: _renew_subs 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86f6f3a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f86f01ce650 con 0x7f86f01390f0 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86f6f3a640 10 monclient: _renew_subs 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86f6f3a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f86f01d87c0 con 0x7f86f01390f0 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f86e8004da0 con 0x7f86f01390f0 2024-09-13T10:37:05.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f86e8005290 con 0x7f86f01390f0 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86eeffd640 4 set_mon_vals no callback set 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.590+0000 7f86ed7fa640 10 monclient: dump: 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.616 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.591+0000 7f86f6f3a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.591+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f86d00065c0 con 0x7f86d0002860 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.591+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f86e8011990 con 0x7f86f01390f0 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.592+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(225..225 src has 1..225) ==== 3898+0+0 (unknown 4236598751 0 0) 0x7f86e804e490 con 0x7f86f01390f0 2024-09-13T10:37:05.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.592+0000 7f86effff640 10 monclient: get_auth_request con 0x7f86d40401a0 auth_method 0 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.593+0000 7f86f4cd6640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.181:6789/0 conn(0x7f86d0002860 legacy=0x7f86d0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920926178 0 0) 0x7f86d00065c0 con 0x7f86d0002860 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 10 monclient(hunting): my global_id is 114516 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f013caf0 con 0x7f86d0002860 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2307614248 0 0) 0x7f86f013caf0 con 0x7f86d0002860 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86d00065c0 con 0x7f86d0002860 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f86e40015e0 con 0x7f86d0002860 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 10 monclient: dump: 2024-09-13T10:37:05.618 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.619 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.620 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2042699149 0 0) 0x7f86d00065c0 con 0x7f86d0002860 2024-09-13T10:37:05.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.594+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86d000a160 con 0x7f86d0002860 2024-09-13T10:37:05.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.595+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f86e4004870 con 0x7f86d0002860 2024-09-13T10:37:05.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.595+0000 7f86ed7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:05.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.595+0000 7f86ed7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:05.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.595+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.181:6789/0 conn(0x7f86d0002860 legacy=0x7f86d0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.595+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.181:6789/0 conn(0x7f86d0002860 legacy=0x7f86d0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:05.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.603+0000 7f86f6f3a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:05.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.603+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f86d0009e70 con 0x7f86d0009130 2024-09-13T10:37:05.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.605+0000 7f86f4cd6640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.181:6789/0 conn(0x7f86d0009130 legacy=0x7f86d00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.605+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228156014 0 0) 0x7f86d0009e70 con 0x7f86d0009130 2024-09-13T10:37:05.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.605+0000 7f86ed7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.605+0000 7f86ed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.605+0000 7f86ed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.605+0000 7f86ed7fa640 10 monclient(hunting): my global_id is 114525 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.605+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86d00065c0 con 0x7f86d0009130 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1924855452 0 0) 0x7f86d00065c0 con 0x7f86d0009130 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86d0009e70 con 0x7f86d0009130 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f86e4004ce0 con 0x7f86d0009130 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 10 monclient: dump: 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.625 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3874480112 0 0) 0x7f86d0009e70 con 0x7f86d0009130 2024-09-13T10:37:05.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f86d000c3f0 con 0x7f86d0009130 2024-09-13T10:37:05.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 3960145890) 0x7f86e4005350 con 0x7f86d0009130 2024-09-13T10:37:05.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:05.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:05.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.181:6789/0 conn(0x7f86d0009130 legacy=0x7f86d00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86ed7fa640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.181:6789/0 conn(0x7f86d0009130 legacy=0x7f86d00095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:05.627 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:05.627 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 61584, 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:05.628 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:05.629 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:05.630 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:05.630 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:05.630 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:05.630 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:05.630 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:05.630 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:05.630 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:05.630 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:05.630 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:05.630 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:05.630 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:05.630 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:05.631 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:05.632 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:05.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.635 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:05.637 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.638 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.640 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:05.640 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.640 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.640 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:05.640 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:05.640 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.640 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.640 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.642 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:05.643 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.643 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.643 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.643 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:05.643 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:05.643 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.643 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.643 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.643 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:05.644 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.645 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.646 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:05.646 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:05.646 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.646 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.646 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.646 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.646 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:05.646 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:05.647 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:37:05.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.648 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:05.648 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:05.648 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:05.648 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.648 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.648 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:05.648 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:05.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.195:6800/1839191919 conn(0x7f86d40401a0 legacy=0x7f86d4042660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86f6f3a640 10 monclient: shutdown 2024-09-13T10:37:05.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86f6f3a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:05.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 >> v1:172.21.15.181:6789/0 conn(0x7f86f01390f0 legacy=0x7f86f01d70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86f54d7640 1 -- 172.21.15.181:0/3670823474 reap_dead start 2024-09-13T10:37:05.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86f54d7640 1 -- 172.21.15.181:0/3670823474 reap_dead start 2024-09-13T10:37:05.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 shutdown_connections 2024-09-13T10:37:05.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.606+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 >> 172.21.15.181:0/3670823474 conn(0x7f86f00a6640 msgr2=0x7f86f00a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:05.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.607+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 shutdown_connections 2024-09-13T10:37:05.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.607+0000 7f86f6f3a640 1 -- 172.21.15.181:0/3670823474 wait complete. 2024-09-13T10:37:05.652 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:05.652 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:37:05.652 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:37:05.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1941881249}) 2024-09-13T10:37:05.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3489660313}) 2024-09-13T10:37:05.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1941881249}) 2024-09-13T10:37:05.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3428340041}) 2024-09-13T10:37:05.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1941881249}) 2024-09-13T10:37:05.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1174935165}) 2024-09-13T10:37:05.665 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1941881249}) 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=377756547}) 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1941881249}) 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1375519622}) 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1941881249}) 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3647726697}) 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1941881249}) 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2553880053}) 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1941881249}) 2024-09-13T10:37:05.666 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.583+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3820223353}) 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4038484344}) 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3424270590}) 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4038484344}) 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1396739903}) 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4038484344}) 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=925472511}) 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4038484344}) 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3602086013}) 2024-09-13T10:37:05.667 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4038484344}) 2024-09-13T10:37:05.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2494359825}) 2024-09-13T10:37:05.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4038484344}) 2024-09-13T10:37:05.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3710057296}) 2024-09-13T10:37:05.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.584+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.585+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4038484344}) 2024-09-13T10:37:05.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.585+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3086189875}) 2024-09-13T10:37:05.668 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.585+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.585+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4038484344}) 2024-09-13T10:37:05.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.585+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2433099073}) 2024-09-13T10:37:05.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792451360}) 2024-09-13T10:37:05.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=993152582}) 2024-09-13T10:37:05.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792451360}) 2024-09-13T10:37:05.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2350777248}) 2024-09-13T10:37:05.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792451360}) 2024-09-13T10:37:05.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3050780294}) 2024-09-13T10:37:05.669 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.670 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792451360}) 2024-09-13T10:37:05.670 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2458154372}) 2024-09-13T10:37:05.670 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.670 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792451360}) 2024-09-13T10:37:05.670 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3701346518}) 2024-09-13T10:37:05.670 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.670 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792451360}) 2024-09-13T10:37:05.670 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3428857920}) 2024-09-13T10:37:05.670 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.671 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792451360}) 2024-09-13T10:37:05.671 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1105784873}) 2024-09-13T10:37:05.671 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.671 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792451360}) 2024-09-13T10:37:05.671 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.586+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=271240424}) 2024-09-13T10:37:05.671 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.588+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.671 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.588+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1540205226}) 2024-09-13T10:37:05.671 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.588+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2042109307}) 2024-09-13T10:37:05.671 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.671 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1540205226}) 2024-09-13T10:37:05.671 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2566906621}) 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1540205226}) 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2075948815}) 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1540205226}) 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3291450054}) 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1540205226}) 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=687688626}) 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1540205226}) 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=641088321}) 2024-09-13T10:37:05.672 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1540205226}) 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3654087331}) 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1540205226}) 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.589+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3094015519}) 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=121772042}) 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343214695}) 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=121772042}) 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1551467276}) 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.673 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=121772042}) 2024-09-13T10:37:05.674 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1857929765}) 2024-09-13T10:37:05.674 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.674 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=121772042}) 2024-09-13T10:37:05.674 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3642702808}) 2024-09-13T10:37:05.674 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.674 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=121772042}) 2024-09-13T10:37:05.674 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4097458949}) 2024-09-13T10:37:05.674 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.674 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=121772042}) 2024-09-13T10:37:05.674 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=663970589}) 2024-09-13T10:37:05.674 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.674 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=121772042}) 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2780695886}) 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=121772042}) 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.590+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2541212966}) 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2494673706}) 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2591631676}) 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2494673706}) 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3188196324}) 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2494673706}) 2024-09-13T10:37:05.675 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1070921025}) 2024-09-13T10:37:05.676 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.676 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2494673706}) 2024-09-13T10:37:05.676 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2856835215}) 2024-09-13T10:37:05.676 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.676 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2494673706}) 2024-09-13T10:37:05.676 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3615427207}) 2024-09-13T10:37:05.676 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.676 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2494673706}) 2024-09-13T10:37:05.676 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2923786407}) 2024-09-13T10:37:05.676 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.676 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2494673706}) 2024-09-13T10:37:05.676 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2925045259}) 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2494673706}) 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.592+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2224122505}) 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2613276086}) 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3021490905}) 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2613276086}) 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1467209889}) 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2613276086}) 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1131874147}) 2024-09-13T10:37:05.677 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2613276086}) 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2315681941}) 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2613276086}) 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2161310713}) 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2613276086}) 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1719566507}) 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2613276086}) 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2280331160}) 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.678 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2613276086}) 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.593+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4181505961}) 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2088562801}) 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1576560505}) 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2088562801}) 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3780869493}) 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2088562801}) 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=296885481}) 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2088562801}) 2024-09-13T10:37:05.679 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3284406420}) 2024-09-13T10:37:05.680 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.680 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2088562801}) 2024-09-13T10:37:05.680 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3973837722}) 2024-09-13T10:37:05.680 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.680 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2088562801}) 2024-09-13T10:37:05.680 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2428613652}) 2024-09-13T10:37:05.680 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.680 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2088562801}) 2024-09-13T10:37:05.680 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1573006755}) 2024-09-13T10:37:05.680 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.680 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2088562801}) 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.594+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1174638156}) 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.595+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.595+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1694708102}) 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.595+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402291799}) 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.595+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.595+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1694708102}) 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.595+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2201499860}) 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.595+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.595+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1694708102}) 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.595+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1753937484}) 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.595+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.595+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1694708102}) 2024-09-13T10:37:05.681 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.595+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2953713374}) 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.596+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.596+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1694708102}) 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.596+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1179489980}) 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.596+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.596+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1694708102}) 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.596+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1590167390}) 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.596+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.596+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1694708102}) 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.596+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2752239362}) 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.596+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.596+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1694708102}) 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.596+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2711651737}) 2024-09-13T10:37:05.682 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3839303155}) 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=427568564}) 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3839303155}) 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1743408588}) 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3839303155}) 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1957986780}) 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3839303155}) 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3013320390}) 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.683 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3839303155}) 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1978002536}) 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3839303155}) 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3886028297}) 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3839303155}) 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4187057466}) 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3839303155}) 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.597+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2125516405}) 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3304670384}) 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=654760843}) 2024-09-13T10:37:05.684 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3304670384}) 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1777702370}) 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3304670384}) 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2903358272}) 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3304670384}) 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3832249629}) 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3304670384}) 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2471684025}) 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.685 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3304670384}) 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1390234480}) 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3304670384}) 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1997097763}) 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3304670384}) 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.598+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1759519814}) 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2630828910}) 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3487238716}) 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2630828910}) 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3787451131}) 2024-09-13T10:37:05.686 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2630828910}) 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1624793198}) 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2630828910}) 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2523168541}) 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2630828910}) 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3049559359}) 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2630828910}) 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.599+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2523611411}) 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.600+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.687 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.600+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2630828910}) 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.600+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=824670787}) 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.600+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.600+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2630828910}) 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.600+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1195155207}) 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=813923161}) 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2612652015}) 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=813923161}) 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=184374669}) 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=813923161}) 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3780223175}) 2024-09-13T10:37:05.688 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=813923161}) 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3893681729}) 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=813923161}) 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1233109687}) 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=813923161}) 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3985992839}) 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=813923161}) 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4242826573}) 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.689 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=813923161}) 2024-09-13T10:37:05.690 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.601+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1521922962}) 2024-09-13T10:37:05.705 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.705 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1021585164}) 2024-09-13T10:37:05.705 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1035884742}) 2024-09-13T10:37:05.705 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.705 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1021585164}) 2024-09-13T10:37:05.705 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1005023726}) 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1021585164}) 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3058182805}) 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1021585164}) 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=371052631}) 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1021585164}) 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2613196061}) 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1021585164}) 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1639343271}) 2024-09-13T10:37:05.706 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.707 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1021585164}) 2024-09-13T10:37:05.707 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3857457610}) 2024-09-13T10:37:05.707 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.707 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1021585164}) 2024-09-13T10:37:05.707 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.702+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3504461039}) 2024-09-13T10:37:05.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.755+0000 7efd85584640 10 monclient: get_monmap_and_config 2024-09-13T10:37:05.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.755+0000 7efd85584640 10 monclient: build_initial_monmap 2024-09-13T10:37:05.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.755+0000 7efd85584640 10 monclient: monmap: 2024-09-13T10:37:05.757 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:05.757 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.757 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:05.755798+0000 2024-09-13T10:37:05.757 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:05.755798+0000 2024-09-13T10:37:05.757 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:05.757 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.757 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:05.757 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:05.757 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:05.757 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:05.757 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:05.758 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:05.758 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:05.758 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:05.758 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:05.758 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.755+0000 7efd85584640 1 Processor -- start 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.755+0000 7efd85584640 1 -- start start 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.755+0000 7efd85584640 10 monclient: init 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd85584640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd85584640 10 monclient: _add_conns ranks=[4,8,5,1,7,6,0,2,3] 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd85584640 10 monclient(hunting): picked mon.noname-c con 0x7efd800a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd85584640 10 monclient(hunting): picked mon.noname-e con 0x7efd800a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd85584640 10 monclient(hunting): picked mon.noname-h con 0x7efd8013f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd85584640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd800a5fe0 con 0x7efd800a66d0 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd85584640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd800a8080 con 0x7efd8013f9a0 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd85584640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd800a42c0 con 0x7efd800a6ab0 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd85584640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd85584640 10 monclient(hunting): authenticate will time out at 1165.261416s 2024-09-13T10:37:05.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd7effd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7efd800a66d0 0x7efd800a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51230/0 (socket says 172.21.15.181:51230) 2024-09-13T10:37:05.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd7e7fc640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7efd800a6ab0 0x7efd800a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33156/0 (socket says 172.21.15.181:33156) 2024-09-13T10:37:05.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.756+0000 7efd7effd640 1 -- 172.21.15.181:0/3787426020 learned_addr learned my addr 172.21.15.181:0/3787426020 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:05.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.758+0000 7efd7e7fc640 1 -- 172.21.15.181:0/3787426020 >> v1:172.21.15.181:6793/0 conn(0x7efd800a6ab0 legacy=0x7efd800a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.758+0000 7efd7effd640 1 -- 172.21.15.181:0/3787426020 >> v1:172.21.15.181:6791/0 conn(0x7efd800a66d0 legacy=0x7efd800a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.758+0000 7efd7f7fe640 1 -- 172.21.15.181:0/3787426020 >> v1:172.21.15.195:6791/0 conn(0x7efd8013f9a0 legacy=0x7efd80141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 1 -- 172.21.15.181:0/3787426020 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2894606483 0 0) 0x7efd800a5fe0 con 0x7efd800a66d0 2024-09-13T10:37:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient(hunting): my global_id is 114619 2024-09-13T10:37:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 1 -- 172.21.15.181:0/3787426020 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd68003520 con 0x7efd800a66d0 2024-09-13T10:37:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 1 -- 172.21.15.181:0/3787426020 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 594274626 0 0) 0x7efd800a8080 con 0x7efd8013f9a0 2024-09-13T10:37:05.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient(hunting): my global_id is 104774 2024-09-13T10:37:05.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 1 -- 172.21.15.181:0/3787426020 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd800a5fe0 con 0x7efd8013f9a0 2024-09-13T10:37:05.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 1 -- 172.21.15.181:0/3787426020 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 846438395 0 0) 0x7efd68003520 con 0x7efd800a66d0 2024-09-13T10:37:05.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 1 -- 172.21.15.181:0/3787426020 >> v1:172.21.15.181:6793/0 conn(0x7efd800a6ab0 legacy=0x7efd800a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 1 -- 172.21.15.181:0/3787426020 >> v1:172.21.15.195:6791/0 conn(0x7efd8013f9a0 legacy=0x7efd80141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient: _finish_hunting 0 2024-09-13T10:37:05.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 1 monclient: found mon.noname-c 2024-09-13T10:37:05.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:05.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:05.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 1 -- 172.21.15.181:0/3787426020 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd801464e0 con 0x7efd800a66d0 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient: _finish_auth 0 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient: _check_auth_tickets 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 1 -- 172.21.15.181:0/3787426020 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd70001e50 con 0x7efd800a66d0 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd7dffb640 10 monclient: dump: 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.782 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd85584640 5 monclient: authenticate success, global_id 114619 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.776+0000 7efd85584640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd7dffb640 1 -- 172.21.15.181:0/3787426020 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efd70004c20 con 0x7efd800a66d0 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd7dffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:05.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd7dffb640 1 -- 172.21.15.181:0/3787426020 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd70005110 con 0x7efd800a66d0 2024-09-13T10:37:05.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd85584640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:05.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd85584640 4 set_mon_vals no callback set 2024-09-13T10:37:05.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd7dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd7dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:05.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd7dffb640 10 monclient: dump: 2024-09-13T10:37:05.784 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.784 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.784 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.784 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.784 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.784 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.784 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd85584640 10 monclient: shutdown 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd85584640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd85584640 1 -- 172.21.15.181:0/3787426020 >> v1:172.21.15.181:6791/0 conn(0x7efd800a66d0 legacy=0x7efd800a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd85584640 1 -- 172.21.15.181:0/3787426020 shutdown_connections 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.777+0000 7efd85584640 1 -- 172.21.15.181:0/3787426020 >> 172.21.15.181:0/3787426020 conn(0x7efd800abcd0 msgr2=0x7efd800ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.778+0000 7efd85584640 1 -- 172.21.15.181:0/3787426020 shutdown_connections 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.778+0000 7efd85584640 1 -- 172.21.15.181:0/3787426020 wait complete. 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.778+0000 7efd85584640 10 monclient: build_initial_monmap 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.778+0000 7efd85584640 10 monclient: monmap: 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:05.786 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:05.787 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:05.787 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.790 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.790 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=516596219}) 2024-09-13T10:37:05.790 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1689680788}) 2024-09-13T10:37:05.790 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.790 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=516596219}) 2024-09-13T10:37:05.790 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=826562212}) 2024-09-13T10:37:05.790 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.790 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=516596219}) 2024-09-13T10:37:05.790 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=725726680}) 2024-09-13T10:37:05.790 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.791 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=516596219}) 2024-09-13T10:37:05.791 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1219088119}) 2024-09-13T10:37:05.791 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.791 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=516596219}) 2024-09-13T10:37:05.791 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3492948803}) 2024-09-13T10:37:05.791 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.791 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=516596219}) 2024-09-13T10:37:05.791 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2873356678}) 2024-09-13T10:37:05.791 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.791 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=516596219}) 2024-09-13T10:37:05.791 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4235310303}) 2024-09-13T10:37:05.792 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.792 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=516596219}) 2024-09-13T10:37:05.792 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.777+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3756379592}) 2024-09-13T10:37:05.796 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.789+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.796 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.789+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3681346090}) 2024-09-13T10:37:05.796 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.789+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3882560042}) 2024-09-13T10:37:05.796 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.796 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3681346090}) 2024-09-13T10:37:05.796 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2473748750}) 2024-09-13T10:37:05.796 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.796 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3681346090}) 2024-09-13T10:37:05.796 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1698791518}) 2024-09-13T10:37:05.797 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.797 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3681346090}) 2024-09-13T10:37:05.797 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3778174751}) 2024-09-13T10:37:05.797 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.797 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3681346090}) 2024-09-13T10:37:05.797 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3525051076}) 2024-09-13T10:37:05.797 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.797 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3681346090}) 2024-09-13T10:37:05.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.779+0000 7efd85584640 1 Processor -- start 2024-09-13T10:37:05.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.779+0000 7efd85584640 1 -- start start 2024-09-13T10:37:05.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.779+0000 7efd85584640 10 monclient: init 2024-09-13T10:37:05.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.779+0000 7efd85584640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:05.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.779+0000 7efd85584640 10 monclient: _add_conns ranks=[5,8,7,0,2,1,6,3,4] 2024-09-13T10:37:05.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.779+0000 7efd85584640 10 monclient(hunting): picked mon.noname-h con 0x7efd800a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:05.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.779+0000 7efd85584640 10 monclient(hunting): picked mon.noname-e con 0x7efd800a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:05.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.780+0000 7efd85584640 10 monclient(hunting): picked mon.noname-i con 0x7efd8013f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:05.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.780+0000 7efd85584640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8013f0e0 con 0x7efd800a66d0 2024-09-13T10:37:05.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.780+0000 7efd85584640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd80068680 con 0x7efd8013f9a0 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.780+0000 7efd85584640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8013cd80 con 0x7efd800a6ab0 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.780+0000 7efd85584640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.780+0000 7efd85584640 10 monclient(hunting): authenticate will time out at 1165.285133s 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.780+0000 7efd7e7fc640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7efd800a6ab0 0x7efd8013bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33172/0 (socket says 172.21.15.181:33172) 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.780+0000 7efd7e7fc640 1 -- 172.21.15.181:0/3909051204 learned_addr learned my addr 172.21.15.181:0/3909051204 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.782+0000 7efd7e7fc640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.181:6793/0 conn(0x7efd800a6ab0 legacy=0x7efd8013bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.782+0000 7efd7effd640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.195:6791/0 conn(0x7efd800a66d0 legacy=0x7efd8013b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.782+0000 7efd7f7fe640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.195:6792/0 conn(0x7efd8013f9a0 legacy=0x7efd801d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 500301865 0 0) 0x7efd80068680 con 0x7efd8013f9a0 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 10 monclient(hunting): my global_id is 56833 2024-09-13T10:37:05.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd6c003520 con 0x7efd8013f9a0 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432665473 0 0) 0x7efd8013f0e0 con 0x7efd800a66d0 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 10 monclient(hunting): my global_id is 104783 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd80068680 con 0x7efd800a66d0 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3774644860 0 0) 0x7efd6c003520 con 0x7efd8013f9a0 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd8013f0e0 con 0x7efd8013f9a0 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd78001d30 con 0x7efd8013f9a0 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 10 monclient(hunting): dump: 2024-09-13T10:37:05.802 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.803 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.790+0000 7efd677fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3836858746 0 0) 0x7efd8013f0e0 con 0x7efd8013f9a0 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.181:6793/0 conn(0x7efd800a6ab0 legacy=0x7efd8013bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.195:6791/0 conn(0x7efd800a66d0 legacy=0x7efd8013b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 1 monclient: found mon.i 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8013ee00 con 0x7efd8013f9a0 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:05.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd85584640 5 monclient: authenticate success, global_id 56833 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd85584640 10 monclient: _renew_subs 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd85584640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd85584640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efd800a2100 con 0x7efd8013f9a0 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd85584640 10 monclient: _renew_subs 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd85584640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd85584640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7efd8013c3d0 con 0x7efd8013f9a0 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efd78003940 con 0x7efd8013f9a0 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd677fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.791+0000 7efd7d7fa640 4 set_mon_vals no callback set 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.792+0000 7efd85584640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.792+0000 7efd85584640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efd600065c0 con 0x7efd60002860 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.792+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd78003ef0 con 0x7efd8013f9a0 2024-09-13T10:37:05.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.792+0000 7efd677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.792+0000 7efd677fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.792+0000 7efd677fe640 10 monclient: dump: 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.806 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.792+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7efd78004090 con 0x7efd8013f9a0 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.793+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(226..226 src has 1..226) ==== 3506+0+0 (unknown 1010145293 0 0) 0x7efd7804e2c0 con 0x7efd8013f9a0 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd7effd640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.181:6790/0 conn(0x7efd60002860 legacy=0x7efd60004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2735113609 0 0) 0x7efd600065c0 con 0x7efd60002860 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 10 monclient(hunting): my global_id is 124148 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd8013f0e0 con 0x7efd60002860 2024-09-13T10:37:05.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd7e7fc640 10 monclient: get_auth_request con 0x7efd6c03fd40 auth_method 0 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1175280697 0 0) 0x7efd8013f0e0 con 0x7efd60002860 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd600065c0 con 0x7efd60002860 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd700020a0 con 0x7efd60002860 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 10 monclient: dump: 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.808 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3276862262 0 0) 0x7efd600065c0 con 0x7efd60002860 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd6000a160 con 0x7efd60002860 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7efd700019c0 con 0x7efd60002860 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:05.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.181:6790/0 conn(0x7efd60002860 legacy=0x7efd60004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.795+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.181:6790/0 conn(0x7efd60002860 legacy=0x7efd60004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:05.810 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=418767402}) 2024-09-13T10:37:05.810 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.810 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3681346090}) 2024-09-13T10:37:05.810 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2954924523}) 2024-09-13T10:37:05.810 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.810 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3681346090}) 2024-09-13T10:37:05.810 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.790+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3275257442}) 2024-09-13T10:37:05.812 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:05.812 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39163]: starting. 2024-09-13T10:37:05.812 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39163]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39125 2024-09-13T10:37:05.812 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39163]: shutting down. 2024-09-13T10:37:05.812 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:05.812 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:05.813 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:37:05.813 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:37:05.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.802+0000 7efd85584640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:05.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.802+0000 7efd85584640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efd60009e70 con 0x7efd60009130 2024-09-13T10:37:05.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.804+0000 7efd7effd640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.181:6790/0 conn(0x7efd60009130 legacy=0x7efd600095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.804+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68165377 0 0) 0x7efd60009e70 con 0x7efd60009130 2024-09-13T10:37:05.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.804+0000 7efd677fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.804+0000 7efd677fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.804+0000 7efd677fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.804+0000 7efd677fe640 10 monclient(hunting): my global_id is 124157 2024-09-13T10:37:05.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.804+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd600065c0 con 0x7efd60009130 2024-09-13T10:37:05.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3801592664 0 0) 0x7efd600065c0 con 0x7efd60009130 2024-09-13T10:37:05.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd60009e70 con 0x7efd60009130 2024-09-13T10:37:05.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efd70005690 con 0x7efd60009130 2024-09-13T10:37:05.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:05.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 10 monclient: dump: 2024-09-13T10:37:05.815 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.815 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.815 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.815 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.815 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.816 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.816 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.816 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.816 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.816 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.816 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.816 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.816 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.816 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.816 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.816 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 996584276 0 0) 0x7efd60009e70 con 0x7efd60009130 2024-09-13T10:37:05.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efd6000c3f0 con 0x7efd60009130 2024-09-13T10:37:05.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 2077776633) 0x7efd70008800 con 0x7efd60009130 2024-09-13T10:37:05.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:05.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:05.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.181:6790/0 conn(0x7efd60009130 legacy=0x7efd600095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd677fe640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.181:6790/0 conn(0x7efd60009130 legacy=0x7efd600095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:05.817 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:05.817 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:05.817 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 4264, 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:05.818 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:05.819 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:05.819 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:37:05.819 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:05.819 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:05.819 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:05.819 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:05.819 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:05.819 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:05.820 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:05.821 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:05.821 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:05.821 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:05.821 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:05.821 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:05.821 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:05.821 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:05.821 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:05.821 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:05.821 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.821 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:05.822 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:05.823 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:05.825 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.826 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.828 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:05.828 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:05.828 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.828 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.828 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.828 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:05.828 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:05.828 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.828 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.830 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:05.830 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:05.830 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.830 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.830 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.830 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:05.830 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.830 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.830 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.830 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:05.831 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:05.831 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.831 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.831 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.831 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:05.831 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:05.831 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.831 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.831 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.832 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:05.832 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.832 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.832 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.832 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:05.832 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:05.832 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.832 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.832 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:05.833 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.834 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.835 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:05.837 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.838 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.838 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:05.838 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:05.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd85584640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.195:6800/1839191919 conn(0x7efd6c03fd40 legacy=0x7efd6c042200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd85584640 10 monclient: shutdown 2024-09-13T10:37:05.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd85584640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:05.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd85584640 1 -- 172.21.15.181:0/3909051204 >> v1:172.21.15.195:6792/0 conn(0x7efd8013f9a0 legacy=0x7efd801d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd7f7fe640 1 -- 172.21.15.181:0/3909051204 reap_dead start 2024-09-13T10:37:05.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd7f7fe640 1 -- 172.21.15.181:0/3909051204 reap_dead start 2024-09-13T10:37:05.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd85584640 1 -- 172.21.15.181:0/3909051204 shutdown_connections 2024-09-13T10:37:05.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd85584640 1 -- 172.21.15.181:0/3909051204 >> 172.21.15.181:0/3909051204 conn(0x7efd800abcd0 msgr2=0x7efd80138d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:05.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd85584640 1 -- 172.21.15.181:0/3909051204 shutdown_connections 2024-09-13T10:37:05.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.805+0000 7efd85584640 1 -- 172.21.15.181:0/3909051204 wait complete. 2024-09-13T10:37:05.840 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:05.841 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:37:05.841 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:37:05.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.938+0000 7f9a9123c640 10 monclient: get_monmap_and_config 2024-09-13T10:37:05.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.938+0000 7f9a9123c640 10 monclient: build_initial_monmap 2024-09-13T10:37:05.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.938+0000 7f9a9123c640 10 monclient: monmap: 2024-09-13T10:37:05.940 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:05.940 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.940 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:05.939416+0000 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:05.939416+0000 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:05.941 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.946 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.946 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1152628513}) 2024-09-13T10:37:05.946 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=680941373}) 2024-09-13T10:37:05.946 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.946 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1152628513}) 2024-09-13T10:37:05.946 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2524413415}) 2024-09-13T10:37:05.946 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.946 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1152628513}) 2024-09-13T10:37:05.946 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3222243543}) 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1152628513}) 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4063196561}) 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1152628513}) 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=106103305}) 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1152628513}) 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3300491204}) 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1152628513}) 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3750851066}) 2024-09-13T10:37:05.947 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:05.948 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1152628513}) 2024-09-13T10:37:05.948 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:05.939+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2269826583}) 2024-09-13T10:37:05.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.939+0000 7f9a9123c640 1 Processor -- start 2024-09-13T10:37:05.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.939+0000 7f9a9123c640 1 -- start start 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.939+0000 7f9a9123c640 10 monclient: init 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.939+0000 7f9a9123c640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.939+0000 7f9a9123c640 10 monclient: _add_conns ranks=[5,7,0,4,8,3,6,2,1] 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.939+0000 7f9a9123c640 10 monclient(hunting): picked mon.noname-h con 0x7f9a8c0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.939+0000 7f9a9123c640 10 monclient(hunting): picked mon.noname-i con 0x7f9a8c0a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.939+0000 7f9a9123c640 10 monclient(hunting): picked mon.noname-a con 0x7f9a8c13f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.940+0000 7f9a9123c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8c0a5fe0 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.940+0000 7f9a9123c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8c0a8080 con 0x7f9a8c0a66d0 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.940+0000 7f9a9123c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8c0a42c0 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.940+0000 7f9a9123c640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.940+0000 7f9a9123c640 10 monclient(hunting): authenticate will time out at 1165.445058s 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.940+0000 7f9a8b59e640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f9a8c13f9a0 0x7f9a8c141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53454/0 (socket says 172.21.15.181:53454) 2024-09-13T10:37:05.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.940+0000 7f9a8b59e640 1 -- 172.21.15.181:0/2209763154 learned_addr learned my addr 172.21.15.181:0/2209763154 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:05.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a8b59e640 1 -- 172.21.15.181:0/2209763154 >> v1:172.21.15.181:6789/0 conn(0x7f9a8c13f9a0 legacy=0x7f9a8c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a8ad9d640 1 -- 172.21.15.181:0/2209763154 >> v1:172.21.15.195:6791/0 conn(0x7f9a8c0a66d0 legacy=0x7f9a8c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a8a59c640 1 -- 172.21.15.181:0/2209763154 >> v1:172.21.15.195:6792/0 conn(0x7f9a8c0a6ab0 legacy=0x7f9a8c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1792571593 0 0) 0x7f9a8c0a5fe0 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient(hunting): my global_id is 114570 2024-09-13T10:37:05.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a78003520 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3905287011 0 0) 0x7f9a8c0a8080 con 0x7f9a8c0a66d0 2024-09-13T10:37:05.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient(hunting): my global_id is 104792 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a8c0a5fe0 con 0x7f9a8c0a66d0 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 548381658 0 0) 0x7f9a8c0a42c0 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient(hunting): my global_id is 56842 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a8c0a8080 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2093394565 0 0) 0x7f9a78003520 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 >> v1:172.21.15.195:6792/0 conn(0x7f9a8c0a6ab0 legacy=0x7f9a8c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 >> v1:172.21.15.195:6791/0 conn(0x7f9a8c0a66d0 legacy=0x7f9a8c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:37:05.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 monclient: found mon.noname-a 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c1464e0 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient: _finish_auth 0 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a9123c640 5 monclient: authenticate success, global_id 114570 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a9123c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9a7c001ad0 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient: dump: 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.959 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.960 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a9123c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a7c0048a0 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 1 -- 172.21.15.181:0/2209763154 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9a7c004dd0 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a9123c640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a9123c640 4 set_mon_vals no callback set 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.942+0000 7f9a89d9b640 10 monclient: dump: 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.961 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.962 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.943+0000 7f9a9123c640 10 monclient: shutdown 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.943+0000 7f9a9123c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.943+0000 7f9a9123c640 1 -- 172.21.15.181:0/2209763154 >> v1:172.21.15.181:6789/0 conn(0x7f9a8c13f9a0 legacy=0x7f9a8c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.943+0000 7f9a9123c640 1 -- 172.21.15.181:0/2209763154 shutdown_connections 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.943+0000 7f9a9123c640 1 -- 172.21.15.181:0/2209763154 >> 172.21.15.181:0/2209763154 conn(0x7f9a8c0abcd0 msgr2=0x7f9a8c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.943+0000 7f9a9123c640 1 -- 172.21.15.181:0/2209763154 shutdown_connections 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.943+0000 7f9a9123c640 1 -- 172.21.15.181:0/2209763154 wait complete. 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.944+0000 7f9a9123c640 10 monclient: build_initial_monmap 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.944+0000 7f9a9123c640 10 monclient: monmap: 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:05.963 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.944+0000 7f9a9123c640 1 Processor -- start 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.944+0000 7f9a9123c640 1 -- start start 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.944+0000 7f9a9123c640 10 monclient: init 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a9123c640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a9123c640 10 monclient: _add_conns ranks=[4,8,6,1,5,0,3,2,7] 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a9123c640 10 monclient(hunting): picked mon.noname-c con 0x7f9a8c0a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a9123c640 10 monclient(hunting): picked mon.noname-e con 0x7f9a8c0a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a9123c640 10 monclient(hunting): picked mon.noname-d con 0x7f9a8c13f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a9123c640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8c1378c0 con 0x7f9a8c0a66d0 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a9123c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8c13cb20 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a9123c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8c13eba0 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a9123c640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a9123c640 10 monclient(hunting): authenticate will time out at 1165.450155s 2024-09-13T10:37:05.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a8b59e640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f9a8c13f9a0 0x7f9a8c1d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:59094/0 (socket says 172.21.15.181:59094) 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a8b59e640 1 -- 172.21.15.181:0/3095967440 learned_addr learned my addr 172.21.15.181:0/3095967440 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.945+0000 7f9a8ad9d640 1 --1- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6791/0 conn(0x7f9a8c0a66d0 0x7f9a8c13b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51238/0 (socket says 172.21.15.181:51238) 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a8a59c640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6793/0 conn(0x7f9a8c0a6ab0 legacy=0x7f9a8c13b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a8ad9d640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6791/0 conn(0x7f9a8c0a66d0 legacy=0x7f9a8c13b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a8b59e640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6792/0 conn(0x7f9a8c13f9a0 legacy=0x7f9a8c1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 434055447 0 0) 0x7f9a8c13eba0 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): my global_id is 105020 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a6c003520 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1053431168 0 0) 0x7f9a8c1378c0 con 0x7f9a8c0a66d0 2024-09-13T10:37:05.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): my global_id is 114637 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a8c13eba0 con 0x7f9a8c0a66d0 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 455818903 0 0) 0x7f9a8c13cb20 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): my global_id is 124224 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a8c1378c0 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1149533312 0 0) 0x7f9a6c003520 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a8c13cb20 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9a74003610 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): dump: 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.968 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.969 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.969 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.969 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.969 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.969 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.969 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:05.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2075609410 0 0) 0x7f9a8c13eba0 con 0x7f9a8c0a66d0 2024-09-13T10:37:05.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a6c003520 con 0x7f9a8c0a66d0 2024-09-13T10:37:05.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1789161963 0 0) 0x7f9a8c1378c0 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a8c13eba0 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9a84003990 con 0x7f9a8c0a66d0 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.947+0000 7f9a837fe640 10 monclient(hunting): dump: 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.970 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.971 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.971 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.971 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.971 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.971 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9a7c001d20 con 0x7f9a8c13f9a0 2024-09-13T10:37:05.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:05.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:05.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 10 monclient(hunting): dump: 2024-09-13T10:37:05.972 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.972 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.972 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.972 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.972 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.972 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.972 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.972 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.972 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.972 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.972 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.972 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 790393013 0 0) 0x7f9a8c13cb20 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6792/0 conn(0x7f9a8c13f9a0 legacy=0x7f9a8c1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6791/0 conn(0x7f9a8c0a66d0 legacy=0x7f9a8c13b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 1 monclient: found mon.e 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c13ee80 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:05.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a9123c640 5 monclient: authenticate success, global_id 105020 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a9123c640 10 monclient: _renew_subs 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a9123c640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a9123c640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8c13da30 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a9123c640 10 monclient: _renew_subs 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a9123c640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a9123c640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a8c13f2a0 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a74003ac0 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9a74003ff0 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a8959a640 4 set_mon_vals no callback set 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a837fe640 10 monclient: dump: 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.975 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.976 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.976 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.976 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.948+0000 7f9a9123c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:05.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.949+0000 7f9a9123c640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9a700065c0 con 0x7f9a70002860 2024-09-13T10:37:05.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.949+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9a74004190 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.949+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(226..226 src has 1..226) ==== 3506+0+0 (unknown 1010145293 0 0) 0x7f9a7404e1b0 con 0x7f9a8c0a6ab0 2024-09-13T10:37:05.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.949+0000 7f9a8b59e640 10 monclient: get_auth_request con 0x7f9a6c0405f0 auth_method 0 2024-09-13T10:37:05.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a8ad9d640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6791/0 conn(0x7f9a70002860 legacy=0x7f9a70004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1013736205 0 0) 0x7f9a700065c0 con 0x7f9a70002860 2024-09-13T10:37:05.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 10 monclient(hunting): my global_id is 114646 2024-09-13T10:37:05.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a8c13cb20 con 0x7f9a70002860 2024-09-13T10:37:05.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1430281130 0 0) 0x7f9a8c13cb20 con 0x7f9a70002860 2024-09-13T10:37:05.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a700065c0 con 0x7f9a70002860 2024-09-13T10:37:05.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9a84004120 con 0x7f9a70002860 2024-09-13T10:37:05.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:05.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 10 monclient: dump: 2024-09-13T10:37:05.977 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.977 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.977 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.978 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 855725633 0 0) 0x7f9a700065c0 con 0x7f9a70002860 2024-09-13T10:37:05.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a7000a160 con 0x7f9a70002860 2024-09-13T10:37:05.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9a84005b40 con 0x7f9a70002860 2024-09-13T10:37:05.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:05.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.951+0000 7f9a837fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:05.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.952+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6791/0 conn(0x7f9a70002860 legacy=0x7f9a70004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.952+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6791/0 conn(0x7f9a70002860 legacy=0x7f9a70004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:05.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.958+0000 7f9a9123c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:05.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.958+0000 7f9a9123c640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9a70009e70 con 0x7f9a70009130 2024-09-13T10:37:05.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a8ad9d640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6791/0 conn(0x7f9a70009130 legacy=0x7f9a700095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:05.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297564638 0 0) 0x7f9a70009e70 con 0x7f9a70009130 2024-09-13T10:37:05.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:05.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:05.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:05.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 10 monclient(hunting): my global_id is 114655 2024-09-13T10:37:05.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a700065c0 con 0x7f9a70009130 2024-09-13T10:37:05.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 241848353 0 0) 0x7f9a700065c0 con 0x7f9a70009130 2024-09-13T10:37:05.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a70009e70 con 0x7f9a70009130 2024-09-13T10:37:05.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9a84005dd0 con 0x7f9a70009130 2024-09-13T10:37:05.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 10 monclient: dump: 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:05.982 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:05.983 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:05.983 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:05.983 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:05.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3132790444 0 0) 0x7f9a70009e70 con 0x7f9a70009130 2024-09-13T10:37:05.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.960+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9a7000c3f0 con 0x7f9a70009130 2024-09-13T10:37:05.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 3178315412) 0x7f9a84008050 con 0x7f9a70009130 2024-09-13T10:37:05.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a837fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:05.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a837fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:05.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6791/0 conn(0x7f9a70009130 legacy=0x7f9a700095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:05.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a837fe640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6791/0 conn(0x7f9a70009130 legacy=0x7f9a700095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:05.983 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 61938, 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:05.984 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:05.985 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:05.986 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:05.987 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:05.988 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.989 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:05.990 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.991 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.992 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:05.994 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:05.997 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:05.998 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:05.999 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.001 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.002 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.003 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:06.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.003 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.003 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.003 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:06.003 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.003 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.003 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:06.003 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:06.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a9123c640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.195:6800/1839191919 conn(0x7f9a6c0405f0 legacy=0x7f9a6c042ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a9123c640 10 monclient: shutdown 2024-09-13T10:37:06.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a9123c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a9123c640 1 -- 172.21.15.181:0/3095967440 >> v1:172.21.15.181:6793/0 conn(0x7f9a8c0a6ab0 legacy=0x7f9a8c13b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a8b59e640 1 -- 172.21.15.181:0/3095967440 reap_dead start 2024-09-13T10:37:06.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a8b59e640 1 -- 172.21.15.181:0/3095967440 reap_dead start 2024-09-13T10:37:06.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a9123c640 1 -- 172.21.15.181:0/3095967440 shutdown_connections 2024-09-13T10:37:06.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a9123c640 1 -- 172.21.15.181:0/3095967440 >> 172.21.15.181:0/3095967440 conn(0x7f9a8c0abcd0 msgr2=0x7f9a8c145cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a9123c640 1 -- 172.21.15.181:0/3095967440 shutdown_connections 2024-09-13T10:37:06.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:05.961+0000 7f9a9123c640 1 -- 172.21.15.181:0/3095967440 wait complete. 2024-09-13T10:37:06.006 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:06.006 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:37:06.006 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:37:06.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.103+0000 7f89e8394640 10 monclient: get_monmap_and_config 2024-09-13T10:37:06.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.103+0000 7f89e8394640 10 monclient: build_initial_monmap 2024-09-13T10:37:06.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.103+0000 7f89e8394640 10 monclient: monmap: 2024-09-13T10:37:06.105 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:06.105 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.105 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:06.104292+0000 2024-09-13T10:37:06.105 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:06.104292+0000 2024-09-13T10:37:06.105 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:06.105 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.105 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:06.106 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:06.106 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:06.106 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:06.106 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:06.106 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:06.106 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:06.106 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:06.106 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:06.106 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.104+0000 7f89e8394640 1 Processor -- start 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.104+0000 7f89e8394640 1 -- start start 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.104+0000 7f89e8394640 10 monclient: init 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.104+0000 7f89e8394640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.104+0000 7f89e8394640 10 monclient: _add_conns ranks=[4,1,0,7,8,3,6,2,5] 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.104+0000 7f89e8394640 10 monclient(hunting): picked mon.noname-c con 0x7f89e00a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.104+0000 7f89e8394640 10 monclient(hunting): picked mon.noname-f con 0x7f89e00a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.104+0000 7f89e8394640 10 monclient(hunting): picked mon.noname-a con 0x7f89e013f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.105+0000 7f89e8394640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e00a4bc0 con 0x7f89e013f750 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.105+0000 7f89e8394640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e013a320 con 0x7f89e00a8340 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.105+0000 7f89e8394640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e00a8100 con 0x7f89e00a6640 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.105+0000 7f89e8394640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.105+0000 7f89e8394640 10 monclient(hunting): authenticate will time out at 1165.610106s 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.105+0000 7f89e6130640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f89e00a6640 0x7f89e0139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51276/0 (socket says 172.21.15.181:51276) 2024-09-13T10:37:06.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.105+0000 7f89e6130640 1 -- 172.21.15.181:0/3052073494 learned_addr learned my addr 172.21.15.181:0/3052073494 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:06.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e6931640 1 -- 172.21.15.181:0/3052073494 >> v1:172.21.15.181:6789/0 conn(0x7f89e013f750 legacy=0x7f89e0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e6130640 1 -- 172.21.15.181:0/3052073494 >> v1:172.21.15.181:6791/0 conn(0x7f89e00a6640 legacy=0x7f89e0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 1 -- 172.21.15.181:0/3052073494 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868557293 0 0) 0x7f89e00a8100 con 0x7f89e00a6640 2024-09-13T10:37:06.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient(hunting): my global_id is 114664 2024-09-13T10:37:06.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e592f640 1 -- 172.21.15.181:0/3052073494 >> v1:172.21.15.195:6789/0 conn(0x7f89e00a8340 legacy=0x7f89e0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 1 -- 172.21.15.181:0/3052073494 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89cc003520 con 0x7f89e00a6640 2024-09-13T10:37:06.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 1 -- 172.21.15.181:0/3052073494 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542666350 0 0) 0x7f89e00a4bc0 con 0x7f89e013f750 2024-09-13T10:37:06.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient(hunting): my global_id is 114579 2024-09-13T10:37:06.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 1 -- 172.21.15.181:0/3052073494 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89e00a8100 con 0x7f89e013f750 2024-09-13T10:37:06.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 1 -- 172.21.15.181:0/3052073494 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1076770571 0 0) 0x7f89cc003520 con 0x7f89e00a6640 2024-09-13T10:37:06.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 1 -- 172.21.15.181:0/3052073494 >> v1:172.21.15.195:6789/0 conn(0x7f89e00a8340 legacy=0x7f89e0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 1 -- 172.21.15.181:0/3052073494 >> v1:172.21.15.181:6789/0 conn(0x7f89e013f750 legacy=0x7f89e0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient: _finish_hunting 0 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 1 monclient: found mon.noname-c 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 1 -- 172.21.15.181:0/3052073494 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e00a48e0 con 0x7f89e00a6640 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient: _finish_auth 0 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient: _check_auth_tickets 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 1 -- 172.21.15.181:0/3052073494 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89dc001ae0 con 0x7f89e00a6640 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e8394640 5 monclient: authenticate success, global_id 114664 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e8394640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:06.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient: dump: 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.115 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e8394640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 1 -- 172.21.15.181:0/3052073494 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89dc0048a0 con 0x7f89e00a6640 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 1 -- 172.21.15.181:0/3052073494 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89dc004e10 con 0x7f89e00a6640 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e8394640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e8394640 4 set_mon_vals no callback set 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.107+0000 7f89e512e640 10 monclient: dump: 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.116 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.108+0000 7f89e8394640 10 monclient: shutdown 2024-09-13T10:37:06.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.108+0000 7f89e8394640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.108+0000 7f89e8394640 1 -- 172.21.15.181:0/3052073494 >> v1:172.21.15.181:6791/0 conn(0x7f89e00a6640 legacy=0x7f89e0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.108+0000 7f89e8394640 1 -- 172.21.15.181:0/3052073494 shutdown_connections 2024-09-13T10:37:06.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.108+0000 7f89e8394640 1 -- 172.21.15.181:0/3052073494 >> 172.21.15.181:0/3052073494 conn(0x7f89e0077170 msgr2=0x7f89e00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.108+0000 7f89e8394640 1 -- 172.21.15.181:0/3052073494 shutdown_connections 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.108+0000 7f89e8394640 1 -- 172.21.15.181:0/3052073494 wait complete. 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.108+0000 7f89e8394640 10 monclient: build_initial_monmap 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.108+0000 7f89e8394640 10 monclient: monmap: 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:06.119 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:06.120 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:06.120 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:06.120 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:06.120 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:06.120 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 1 Processor -- start 2024-09-13T10:37:06.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 1 -- start start 2024-09-13T10:37:06.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 10 monclient: init 2024-09-13T10:37:06.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:06.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 10 monclient: _add_conns ranks=[0,3,4,5,6,7,8,2,1] 2024-09-13T10:37:06.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 10 monclient(hunting): picked mon.noname-a con 0x7f89e00a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:06.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 10 monclient(hunting): picked mon.noname-g con 0x7f89e013f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:06.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 10 monclient(hunting): picked mon.noname-c con 0x7f89e01d4520 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:06.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e00a1220 con 0x7f89e00a8340 2024-09-13T10:37:06.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e01cf0f0 con 0x7f89e013f750 2024-09-13T10:37:06.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e00a9db0 con 0x7f89e01d4520 2024-09-13T10:37:06.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:06.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e8394640 10 monclient(hunting): authenticate will time out at 1165.614800s 2024-09-13T10:37:06.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e6130640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f89e00a8340 0x7f89e01ce2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53458/0 (socket says 172.21.15.181:53458) 2024-09-13T10:37:06.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.109+0000 7f89e6130640 1 -- 172.21.15.181:0/2616314343 learned_addr learned my addr 172.21.15.181:0/2616314343 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:06.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.111+0000 7f89e6130640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.181:6789/0 conn(0x7f89e00a8340 legacy=0x7f89e01ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89e6931640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.181:6791/0 conn(0x7f89e01d4520 legacy=0x7f89e01d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89e6130640 1 --1- 172.21.15.181:0/2616314343 >> v1:172.21.15.181:6789/0 conn(0x7f89e00a8340 0x7f89e01ce2d0 :-1 s=OPENED pgs=521 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f89e00a1220 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:37:06.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3495789263 0 0) 0x7f89e00a9db0 con 0x7f89e01d4520 2024-09-13T10:37:06.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient(hunting): my global_id is 114673 2024-09-13T10:37:06.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c4003550 con 0x7f89e01d4520 2024-09-13T10:37:06.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89e592f640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.195:6790/0 conn(0x7f89e013f750 legacy=0x7f89e01ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1573165689 0 0) 0x7f89c4003550 con 0x7f89e01d4520 2024-09-13T10:37:06.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89e00a9db0 con 0x7f89e01d4520 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89d8003990 con 0x7f89e01d4520 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.128 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 85495690 0 0) 0x7f89e01cf0f0 con 0x7f89e013f750 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient(hunting): my global_id is 6699 2024-09-13T10:37:06.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c4003550 con 0x7f89e013f750 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3376300650 0 0) 0x7f89e00a9db0 con 0x7f89e01d4520 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.195:6790/0 conn(0x7f89e013f750 legacy=0x7f89e01ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.181:6789/0 conn(0x7f89e00a8340 legacy=0x7f89e01ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 monclient: found mon.c 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e0142e60 con 0x7f89e01d4520 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2868014023 0 0) 0x7f89e00a1220 con 0x7f89e00a8340 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89e8394640 5 monclient: authenticate success, global_id 114673 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89e8394640 10 monclient: _renew_subs 2024-09-13T10:37:06.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89e8394640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89e8394640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89e00a03b0 con 0x7f89e01d4520 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89e8394640 10 monclient: _renew_subs 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89e8394640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89e8394640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f89e00a0f40 con 0x7f89e01d4520 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89d8003e60 con 0x7f89e01d4520 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89d8004350 con 0x7f89e01d4520 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89e492d640 4 set_mon_vals no callback set 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.112+0000 7f89d6ffd640 10 monclient: dump: 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.131 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.113+0000 7f89e8394640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.113+0000 7f89e8394640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f89c80065c0 con 0x7f89c8002860 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.113+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f89d80044f0 con 0x7f89e01d4520 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.113+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(226..226 src has 1..226) ==== 3506+0+0 (unknown 1010145293 0 0) 0x7f89d804e430 con 0x7f89e01d4520 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.113+0000 7f89e592f640 10 monclient: get_auth_request con 0x7f89c403fb40 auth_method 0 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.115+0000 7f89e6130640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.181:6792/0 conn(0x7f89c8002860 legacy=0x7f89c8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.115+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1761383764 0 0) 0x7f89c80065c0 con 0x7f89c8002860 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.115+0000 7f89d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.115+0000 7f89d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.115+0000 7f89d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.115+0000 7f89d6ffd640 10 monclient(hunting): my global_id is 124233 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.115+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89e00a1220 con 0x7f89c8002860 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.115+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1007502310 0 0) 0x7f89e00a1220 con 0x7f89c8002860 2024-09-13T10:37:06.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.115+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89c80065c0 con 0x7f89c8002860 2024-09-13T10:37:06.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.116+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89dc004be0 con 0x7f89c8002860 2024-09-13T10:37:06.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.116+0000 7f89d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.116+0000 7f89d6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:06.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.116+0000 7f89d6ffd640 10 monclient: dump: 2024-09-13T10:37:06.134 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.134 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.134 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.136 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.136 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.136 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.136 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.136 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.116+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3712088949 0 0) 0x7f89c80065c0 con 0x7f89c8002860 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.116+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89c800a160 con 0x7f89c8002860 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.116+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f89dc001320 con 0x7f89c8002860 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.116+0000 7f89d6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.116+0000 7f89d6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:06.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.116+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.181:6792/0 conn(0x7f89c8002860 legacy=0x7f89c8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.116+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.181:6792/0 conn(0x7f89c8002860 legacy=0x7f89c8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.122+0000 7f89e8394640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.122+0000 7f89e8394640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f89c8009e40 con 0x7f89c8009100 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.124+0000 7f89e6130640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.181:6792/0 conn(0x7f89c8009100 legacy=0x7f89c8009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.124+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3871337031 0 0) 0x7f89c8009e40 con 0x7f89c8009100 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.124+0000 7f89d6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.124+0000 7f89d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.124+0000 7f89d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.124+0000 7f89d6ffd640 10 monclient(hunting): my global_id is 124242 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.124+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c80065c0 con 0x7f89c8009100 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 369653606 0 0) 0x7f89c80065c0 con 0x7f89c8009100 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89c8009e40 con 0x7f89c8009100 2024-09-13T10:37:06.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89dc005150 con 0x7f89c8009100 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 10 monclient: dump: 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.139 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.140 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.140 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.140 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.140 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.140 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2561967070 0 0) 0x7f89c8009e40 con 0x7f89c8009100 2024-09-13T10:37:06.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f89c800c3f0 con 0x7f89c8009100 2024-09-13T10:37:06.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 3523523623) 0x7f89dc008600 con 0x7f89c8009100 2024-09-13T10:37:06.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:06.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:06.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.181:6792/0 conn(0x7f89c8009100 legacy=0x7f89c8009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89d6ffd640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.181:6792/0 conn(0x7f89c8009100 legacy=0x7f89c8009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:06.141 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:06.141 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:06.141 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:06.141 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:06.141 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:06.141 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 4584, 2024-09-13T10:37:06.141 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:06.141 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:06.141 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:06.141 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:06.141 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.142 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.143 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:06.144 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.145 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:06.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:06.147 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.148 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.149 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:06.150 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.151 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.152 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.153 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:06.154 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.155 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.156 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.157 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.158 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.160 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:06.160 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:06.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89e8394640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.195:6800/1839191919 conn(0x7f89c403fb40 legacy=0x7f89c4042000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89e8394640 10 monclient: shutdown 2024-09-13T10:37:06.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89e8394640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89e8394640 1 -- 172.21.15.181:0/2616314343 >> v1:172.21.15.181:6791/0 conn(0x7f89e01d4520 legacy=0x7f89e01d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89e6931640 1 -- 172.21.15.181:0/2616314343 reap_dead start 2024-09-13T10:37:06.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89e6931640 1 -- 172.21.15.181:0/2616314343 reap_dead start 2024-09-13T10:37:06.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89e8394640 1 -- 172.21.15.181:0/2616314343 shutdown_connections 2024-09-13T10:37:06.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89e8394640 1 -- 172.21.15.181:0/2616314343 >> 172.21.15.181:0/2616314343 conn(0x7f89e00a6640 msgr2=0x7f89e0141e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89e8394640 1 -- 172.21.15.181:0/2616314343 shutdown_connections 2024-09-13T10:37:06.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.125+0000 7f89e8394640 1 -- 172.21.15.181:0/2616314343 wait complete. 2024-09-13T10:37:06.162 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:06.162 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:37:06.162 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:37:06.165 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.139+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.165 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.139+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2258384390}) 2024-09-13T10:37:06.165 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.139+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3602565121}) 2024-09-13T10:37:06.165 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.139+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.165 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.139+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2258384390}) 2024-09-13T10:37:06.165 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.139+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3067817128}) 2024-09-13T10:37:06.165 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.139+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.165 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.139+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2258384390}) 2024-09-13T10:37:06.165 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.139+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2237393996}) 2024-09-13T10:37:06.165 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.139+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.165 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2258384390}) 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=245711841}) 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2258384390}) 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=441775025}) 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2258384390}) 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2233826967}) 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2258384390}) 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1789383532}) 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2258384390}) 2024-09-13T10:37:06.166 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.140+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1202782359}) 2024-09-13T10:37:06.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.262+0000 7fb77b857640 10 monclient: get_monmap_and_config 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.262+0000 7fb77b857640 10 monclient: build_initial_monmap 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.262+0000 7fb77b857640 10 monclient: monmap: 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:06.263503+0000 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:06.263503+0000 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:06.265 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:06.266 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:06.266 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:06.266 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:06.266 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:06.266 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.263+0000 7fb77b857640 1 Processor -- start 2024-09-13T10:37:06.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.263+0000 7fb77b857640 1 -- start start 2024-09-13T10:37:06.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.263+0000 7fb77b857640 10 monclient: init 2024-09-13T10:37:06.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.264+0000 7fb77b857640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:06.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.264+0000 7fb77b857640 10 monclient: _add_conns ranks=[2,7,3,4,5,1,0,6,8] 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.264+0000 7fb77b857640 10 monclient(hunting): picked mon.noname-b con 0x7fb7741399b0 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.264+0000 7fb77b857640 10 monclient(hunting): picked mon.noname-i con 0x7fb77409d2a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.264+0000 7fb77b857640 10 monclient(hunting): picked mon.noname-g con 0x7fb774139d90 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.264+0000 7fb77b857640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7740a8070 con 0x7fb7741399b0 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.264+0000 7fb77b857640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb77409cb80 con 0x7fb774139d90 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.264+0000 7fb77b857640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb77409e4c0 con 0x7fb77409d2a0 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.264+0000 7fb77b857640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.264+0000 7fb77b857640 10 monclient(hunting): authenticate will time out at 1165.769263s 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.264+0000 7fb7795f3640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fb7741399b0 0x7fb7740a64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55824/0 (socket says 172.21.15.181:55824) 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.264+0000 7fb7795f3640 1 -- 172.21.15.181:0/440885184 learned_addr learned my addr 172.21.15.181:0/440885184 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb7795f3640 1 -- 172.21.15.181:0/440885184 >> v1:172.21.15.181:6790/0 conn(0x7fb7741399b0 legacy=0x7fb7740a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb778df2640 1 -- 172.21.15.181:0/440885184 >> v1:172.21.15.195:6792/0 conn(0x7fb77409d2a0 legacy=0x7fb7740a6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb779df4640 1 -- 172.21.15.181:0/440885184 >> v1:172.21.15.195:6790/0 conn(0x7fb774139d90 legacy=0x7fb7740a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 1 -- 172.21.15.181:0/440885184 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722419590 0 0) 0x7fb7740a8070 con 0x7fb7741399b0 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 10 monclient(hunting): my global_id is 124166 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 1 -- 172.21.15.181:0/440885184 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb75c003520 con 0x7fb7741399b0 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 1 -- 172.21.15.181:0/440885184 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 140777768 0 0) 0x7fb75c003520 con 0x7fb7741399b0 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 1 -- 172.21.15.181:0/440885184 >> v1:172.21.15.195:6792/0 conn(0x7fb77409d2a0 legacy=0x7fb7740a6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 1 -- 172.21.15.181:0/440885184 >> v1:172.21.15.195:6790/0 conn(0x7fb774139d90 legacy=0x7fb7740a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 10 monclient: _finish_hunting 0 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 1 monclient: found mon.noname-b 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:37:06.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 1 -- 172.21.15.181:0/440885184 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7740a82b0 con 0x7fb7741399b0 2024-09-13T10:37:06.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 10 monclient: _finish_auth 0 2024-09-13T10:37:06.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 10 monclient: _check_auth_tickets 2024-09-13T10:37:06.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:06.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 1 -- 172.21.15.181:0/440885184 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb76c001ad0 con 0x7fb7741399b0 2024-09-13T10:37:06.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:37:06.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb773fff640 10 monclient: dump: 2024-09-13T10:37:06.273 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.273 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.273 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.273 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.273 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.273 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.273 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.273 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.273 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.273 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.273 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.273 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb77b857640 5 monclient: authenticate success, global_id 124166 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.266+0000 7fb77b857640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb773fff640 1 -- 172.21.15.181:0/440885184 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb76c0048a0 con 0x7fb7741399b0 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb773fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb77b857640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb773fff640 1 -- 172.21.15.181:0/440885184 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb76c004dd0 con 0x7fb7741399b0 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb773fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb77b857640 4 set_mon_vals no callback set 2024-09-13T10:37:06.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb773fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb773fff640 10 monclient: dump: 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.275 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb77b857640 10 monclient: shutdown 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb77b857640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb77b857640 1 -- 172.21.15.181:0/440885184 >> v1:172.21.15.181:6790/0 conn(0x7fb7741399b0 legacy=0x7fb7740a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb77b857640 1 -- 172.21.15.181:0/440885184 shutdown_connections 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb77b857640 1 -- 172.21.15.181:0/440885184 >> 172.21.15.181:0/440885184 conn(0x7fb7740abdb0 msgr2=0x7fb7740ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb77b857640 1 -- 172.21.15.181:0/440885184 shutdown_connections 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.267+0000 7fb77b857640 1 -- 172.21.15.181:0/440885184 wait complete. 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.268+0000 7fb77b857640 10 monclient: build_initial_monmap 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.268+0000 7fb77b857640 10 monclient: monmap: 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:06.276 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:06.277 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.268+0000 7fb77b857640 1 Processor -- start 2024-09-13T10:37:06.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.268+0000 7fb77b857640 1 -- start start 2024-09-13T10:37:06.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.268+0000 7fb77b857640 10 monclient: init 2024-09-13T10:37:06.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.269+0000 7fb77b857640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:06.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.269+0000 7fb77b857640 10 monclient: _add_conns ranks=[6,7,2,8,3,1,5,0,4] 2024-09-13T10:37:06.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.269+0000 7fb77b857640 10 monclient(hunting): picked mon.noname-d con 0x7fb77409d2a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:06.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.269+0000 7fb77b857640 10 monclient(hunting): picked mon.noname-i con 0x7fb7741399b0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:06.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.269+0000 7fb77b857640 10 monclient(hunting): picked mon.noname-b con 0x7fb774139d90 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.269+0000 7fb77b857640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb774135a70 con 0x7fb774139d90 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.269+0000 7fb77b857640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7741cf530 con 0x7fb77409d2a0 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.269+0000 7fb77b857640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7740a4310 con 0x7fb7741399b0 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.269+0000 7fb77b857640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.269+0000 7fb77b857640 10 monclient(hunting): authenticate will time out at 1165.774172s 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.269+0000 7fb7795f3640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fb77409d2a0 0x7fb7741ce710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:59114/0 (socket says 172.21.15.181:59114) 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.269+0000 7fb7795f3640 1 -- 172.21.15.181:0/2789651031 learned_addr learned my addr 172.21.15.181:0/2789651031 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb7795f3640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.181:6792/0 conn(0x7fb77409d2a0 legacy=0x7fb7741ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb779df4640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.181:6790/0 conn(0x7fb774139d90 legacy=0x7fb7741d69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb778df2640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.195:6792/0 conn(0x7fb7741399b0 legacy=0x7fb7741cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2074142433 0 0) 0x7fb7741cf530 con 0x7fb77409d2a0 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): my global_id is 124251 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb760003550 con 0x7fb77409d2a0 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528912005 0 0) 0x7fb774135a70 con 0x7fb774139d90 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): my global_id is 124175 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7741cf530 con 0x7fb774139d90 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104214086 0 0) 0x7fb7740a4310 con 0x7fb7741399b0 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): my global_id is 56860 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb774135a70 con 0x7fb7741399b0 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 129273928 0 0) 0x7fb760003550 con 0x7fb77409d2a0 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7740a4310 con 0x7fb77409d2a0 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb76c004d90 con 0x7fb77409d2a0 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): dump: 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.287 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.288 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.288 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.288 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.288 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.288 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.288 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.288 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.288 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.288 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.288 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.288 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1510388937 0 0) 0x7fb7741cf530 con 0x7fb774139d90 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb760003550 con 0x7fb774139d90 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb764002030 con 0x7fb774139d90 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): dump: 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.289 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3401125930 0 0) 0x7fb774135a70 con 0x7fb7741399b0 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7741cf530 con 0x7fb7741399b0 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb768001cd0 con 0x7fb7741399b0 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:06.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient(hunting): dump: 2024-09-13T10:37:06.291 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.291 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.291 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.291 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.291 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.291 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.291 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.292 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.292 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.292 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.292 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.292 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.292 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.292 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.292 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.292 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 758763725 0 0) 0x7fb7740a4310 con 0x7fb77409d2a0 2024-09-13T10:37:06.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.195:6792/0 conn(0x7fb7741399b0 legacy=0x7fb7741cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.181:6790/0 conn(0x7fb774139d90 legacy=0x7fb7741d69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 monclient: found mon.d 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7740a9050 con 0x7fb77409d2a0 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient: _finish_auth 0 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb771ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.271+0000 7fb77b857640 5 monclient: authenticate success, global_id 124251 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb77b857640 10 monclient: _renew_subs 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb77b857640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb77b857640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb774137dd0 con 0x7fb77409d2a0 2024-09-13T10:37:06.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb76c001af0 con 0x7fb77409d2a0 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb771ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb76c005700 con 0x7fb77409d2a0 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb771ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb771ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb771ffb640 10 monclient: dump: 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.294 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb7737fe640 4 set_mon_vals no callback set 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb77b857640 10 monclient: _renew_subs 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb77b857640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb77b857640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb774138560 con 0x7fb77409d2a0 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb77b857640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.272+0000 7fb77b857640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb7741333f0 con 0x7fb77409fec0 2024-09-13T10:37:06.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.273+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb76c011d80 con 0x7fb77409d2a0 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.273+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(226..226 src has 1..226) ==== 3506+0+0 (unknown 1010145293 0 0) 0x7fb76c04e1d0 con 0x7fb77409d2a0 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.273+0000 7fb779df4640 10 monclient: get_auth_request con 0x7fb760040560 auth_method 0 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb778df2640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.181:6793/0 conn(0x7fb77409fec0 legacy=0x7fb7740a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 903775472 0 0) 0x7fb7741333f0 con 0x7fb77409fec0 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 10 monclient(hunting): my global_id is 105029 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7740a4310 con 0x7fb77409fec0 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3449951417 0 0) 0x7fb7740a4310 con 0x7fb77409fec0 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7741333f0 con 0x7fb77409fec0 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb768003d50 con 0x7fb77409fec0 2024-09-13T10:37:06.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 10 monclient: dump: 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.297 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.298 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.298 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.298 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 219211404 0 0) 0x7fb7741333f0 con 0x7fb77409fec0 2024-09-13T10:37:06.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.275+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7740008d0 con 0x7fb77409fec0 2024-09-13T10:37:06.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.276+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb7680040e0 con 0x7fb77409fec0 2024-09-13T10:37:06.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.276+0000 7fb771ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:06.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.276+0000 7fb771ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:06.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.276+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.181:6793/0 conn(0x7fb77409fec0 legacy=0x7fb7740a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.276+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.181:6793/0 conn(0x7fb77409fec0 legacy=0x7fb7740a02a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:06.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.282+0000 7fb77b857640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:06.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.282+0000 7fb77b857640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb7740a0d90 con 0x7fb7740a09b0 2024-09-13T10:37:06.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb778df2640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.181:6793/0 conn(0x7fb7740a09b0 legacy=0x7fb7741dc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881995225 0 0) 0x7fb7740a0d90 con 0x7fb7740a09b0 2024-09-13T10:37:06.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb771ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb771ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb771ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb771ffb640 10 monclient(hunting): my global_id is 105038 2024-09-13T10:37:06.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7741333f0 con 0x7fb7740a09b0 2024-09-13T10:37:06.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3920824296 0 0) 0x7fb7741333f0 con 0x7fb7740a09b0 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7740a0d90 con 0x7fb7740a09b0 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb768005b00 con 0x7fb7740a09b0 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb771ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb771ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.284+0000 7fb771ffb640 10 monclient: dump: 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.301 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3297999585 0 0) 0x7fb7740a0d90 con 0x7fb7740a09b0 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb774143610 con 0x7fb7740a09b0 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 233155619) 0x7fb768005bd0 con 0x7fb7740a09b0 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb771ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb771ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.181:6793/0 conn(0x7fb7740a09b0 legacy=0x7fb7741dc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb771ffb640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.181:6793/0 conn(0x7fb7740a09b0 legacy=0x7fb7741dc120 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:06.303 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 109988, 2024-09-13T10:37:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:37:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:06.322 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:06.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb77b857640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb760040560 legacy=0x7fb760042a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb77b857640 10 monclient: shutdown 2024-09-13T10:37:06.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb77b857640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb77b857640 1 -- 172.21.15.181:0/2789651031 >> v1:172.21.15.181:6792/0 conn(0x7fb77409d2a0 legacy=0x7fb7741ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb779df4640 1 -- 172.21.15.181:0/2789651031 reap_dead start 2024-09-13T10:37:06.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb779df4640 1 -- 172.21.15.181:0/2789651031 reap_dead start 2024-09-13T10:37:06.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb77b857640 1 -- 172.21.15.181:0/2789651031 shutdown_connections 2024-09-13T10:37:06.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb77b857640 1 -- 172.21.15.181:0/2789651031 >> 172.21.15.181:0/2789651031 conn(0x7fb7740abdb0 msgr2=0x7fb774132520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb77b857640 1 -- 172.21.15.181:0/2789651031 shutdown_connections 2024-09-13T10:37:06.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.285+0000 7fb77b857640 1 -- 172.21.15.181:0/2789651031 wait complete. 2024-09-13T10:37:06.325 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:06.325 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:37:06.325 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:37:06.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=589810610}) 2024-09-13T10:37:06.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2791797867}) 2024-09-13T10:37:06.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=589810610}) 2024-09-13T10:37:06.406 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1769453747}) 2024-09-13T10:37:06.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=589810610}) 2024-09-13T10:37:06.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=914203390}) 2024-09-13T10:37:06.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=589810610}) 2024-09-13T10:37:06.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4006907177}) 2024-09-13T10:37:06.407 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=589810610}) 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3012984581}) 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=589810610}) 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=335430496}) 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=589810610}) 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3206962146}) 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=589810610}) 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.400+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2198793064}) 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3632331467}) 2024-09-13T10:37:06.408 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2643584208}) 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3632331467}) 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1753486825}) 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3632331467}) 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=769706966}) 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3632331467}) 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2505500128}) 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3632331467}) 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3105749556}) 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.409 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3632331467}) 2024-09-13T10:37:06.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2134060205}) 2024-09-13T10:37:06.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3632331467}) 2024-09-13T10:37:06.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2717175479}) 2024-09-13T10:37:06.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3632331467}) 2024-09-13T10:37:06.410 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.401+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3338012224}) 2024-09-13T10:37:06.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.426+0000 7ff34c944640 10 monclient: get_monmap_and_config 2024-09-13T10:37:06.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.426+0000 7ff34c944640 10 monclient: build_initial_monmap 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.426+0000 7ff34c944640 10 monclient: monmap: 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:06.427438+0000 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:06.427438+0000 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:06.429 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:06.430 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:06.430 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:06.430 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:06.430 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.427+0000 7ff34c944640 1 Processor -- start 2024-09-13T10:37:06.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.427+0000 7ff34c944640 1 -- start start 2024-09-13T10:37:06.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.427+0000 7ff34c944640 10 monclient: init 2024-09-13T10:37:06.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff34c944640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:06.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff34c944640 10 monclient: _add_conns ranks=[4,1,2,3,6,7,5,0,8] 2024-09-13T10:37:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff34c944640 10 monclient(hunting): picked mon.noname-c con 0x7ff3480a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff34c944640 10 monclient(hunting): picked mon.noname-f con 0x7ff3480a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff34c944640 10 monclient(hunting): picked mon.noname-b con 0x7ff34813f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff34c944640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3480a5fe0 con 0x7ff3480a6ab0 2024-09-13T10:37:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff34c944640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3480a8080 con 0x7ff34813f9a0 2024-09-13T10:37:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff34c944640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3480a42c0 con 0x7ff3480a66d0 2024-09-13T10:37:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff34c944640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff34c944640 10 monclient(hunting): authenticate will time out at 1165.933647s 2024-09-13T10:37:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff346d9d640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7ff34813f9a0 0x7ff348141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55848/0 (socket says 172.21.15.181:55848) 2024-09-13T10:37:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff34659c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ff3480a66d0 0x7ff3480a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51300/0 (socket says 172.21.15.181:51300) 2024-09-13T10:37:06.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.428+0000 7ff346d9d640 1 -- 172.21.15.181:0/437563192 learned_addr learned my addr 172.21.15.181:0/437563192 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:06.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.430+0000 7ff346d9d640 1 -- 172.21.15.181:0/437563192 >> v1:172.21.15.181:6790/0 conn(0x7ff34813f9a0 legacy=0x7ff348141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.430+0000 7ff34659c640 1 -- 172.21.15.181:0/437563192 >> v1:172.21.15.181:6791/0 conn(0x7ff3480a66d0 legacy=0x7ff3480a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.430+0000 7ff345d9b640 1 -- 172.21.15.181:0/437563192 >> v1:172.21.15.195:6789/0 conn(0x7ff3480a6ab0 legacy=0x7ff3480a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551930692 0 0) 0x7ff3480a42c0 con 0x7ff3480a66d0 2024-09-13T10:37:06.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient(hunting): my global_id is 114682 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff330003520 con 0x7ff3480a66d0 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651959107 0 0) 0x7ff3480a8080 con 0x7ff34813f9a0 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient(hunting): my global_id is 124184 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3480a42c0 con 0x7ff34813f9a0 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 52334993 0 0) 0x7ff3480a5fe0 con 0x7ff3480a6ab0 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient(hunting): my global_id is 56953 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3480a8080 con 0x7ff3480a6ab0 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2461461517 0 0) 0x7ff3480a8080 con 0x7ff3480a6ab0 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 >> v1:172.21.15.181:6791/0 conn(0x7ff3480a66d0 legacy=0x7ff3480a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 >> v1:172.21.15.181:6790/0 conn(0x7ff34813f9a0 legacy=0x7ff348141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient: _finish_hunting 0 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 monclient: found mon.noname-f 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3481464e0 con 0x7ff3480a6ab0 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient: _finish_auth 0 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient: _check_auth_tickets 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:06.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff33c001a80 con 0x7ff3480a6ab0 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient: dump: 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.439 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.440 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.440 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34c944640 5 monclient: authenticate success, global_id 56953 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34c944640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff33c001c20 con 0x7ff3480a6ab0 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34c944640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34c944640 4 set_mon_vals no callback set 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 1 -- 172.21.15.181:0/437563192 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff33c003950 con 0x7ff3480a6ab0 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.431+0000 7ff34559a640 10 monclient: dump: 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.441 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.442 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.432+0000 7ff34c944640 10 monclient: shutdown 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.432+0000 7ff34c944640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.432+0000 7ff34c944640 1 -- 172.21.15.181:0/437563192 >> v1:172.21.15.195:6789/0 conn(0x7ff3480a6ab0 legacy=0x7ff3480a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.432+0000 7ff34c944640 1 -- 172.21.15.181:0/437563192 shutdown_connections 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.432+0000 7ff34c944640 1 -- 172.21.15.181:0/437563192 >> 172.21.15.181:0/437563192 conn(0x7ff3480abcd0 msgr2=0x7ff3480ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.432+0000 7ff34c944640 1 -- 172.21.15.181:0/437563192 shutdown_connections 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.432+0000 7ff34c944640 1 -- 172.21.15.181:0/437563192 wait complete. 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.433+0000 7ff34c944640 10 monclient: build_initial_monmap 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.433+0000 7ff34c944640 10 monclient: monmap: 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:06.443 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.433+0000 7ff34c944640 1 Processor -- start 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.433+0000 7ff34c944640 1 -- start start 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.433+0000 7ff34c944640 10 monclient: init 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff34c944640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff34c944640 10 monclient: _add_conns ranks=[1,0,7,8,5,2,6,3,4] 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff34c944640 10 monclient(hunting): picked mon.noname-f con 0x7ff3480a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff34c944640 10 monclient(hunting): picked mon.noname-a con 0x7ff3480a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff34c944640 10 monclient(hunting): picked mon.noname-i con 0x7ff34813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff34c944640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3480a28b0 con 0x7ff3480a6ab0 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff34c944640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3481cf210 con 0x7ff3480a66d0 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff34c944640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34813ce70 con 0x7ff34813f9a0 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff34c944640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff34c944640 10 monclient(hunting): authenticate will time out at 1165.939307s 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff345d9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff3480a6ab0 0x7ff3481ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53470/0 (socket says 172.21.15.181:53470) 2024-09-13T10:37:06.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff345d9b640 1 -- 172.21.15.181:0/4115098071 learned_addr learned my addr 172.21.15.181:0/4115098071 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:06.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.434+0000 7ff34659c640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7ff3480a66d0 0x7ff3481ce3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:45428/0 (socket says 172.21.15.181:45428) 2024-09-13T10:37:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff345d9b640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.181:6789/0 conn(0x7ff3480a6ab0 legacy=0x7ff3481ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff34659c640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.195:6789/0 conn(0x7ff3480a66d0 legacy=0x7ff3481ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff346d9d640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.195:6792/0 conn(0x7ff34813f9a0 legacy=0x7ff3481d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367381082 0 0) 0x7ff3480a28b0 con 0x7ff3480a6ab0 2024-09-13T10:37:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): my global_id is 114597 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff328003520 con 0x7ff3480a6ab0 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639866527 0 0) 0x7ff3481cf210 con 0x7ff3480a66d0 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): my global_id is 56962 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3480a28b0 con 0x7ff3480a66d0 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025035844 0 0) 0x7ff34813ce70 con 0x7ff34813f9a0 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): my global_id is 56869 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3481cf210 con 0x7ff34813f9a0 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3272035454 0 0) 0x7ff328003520 con 0x7ff3480a6ab0 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff34813ce70 con 0x7ff3480a6ab0 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1729561700 0 0) 0x7ff3480a28b0 con 0x7ff3480a66d0 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff328003520 con 0x7ff3480a66d0 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff33c003950 con 0x7ff3480a6ab0 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.452 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:06.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff3380047e0 con 0x7ff3480a66d0 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.436+0000 7ff336ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.454 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2058025368 0 0) 0x7ff3481cf210 con 0x7ff34813f9a0 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff3480a28b0 con 0x7ff34813f9a0 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff340002090 con 0x7ff34813f9a0 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.455 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.456 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 140256929 0 0) 0x7ff328003520 con 0x7ff3480a66d0 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.195:6792/0 conn(0x7ff34813f9a0 legacy=0x7ff3481d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.181:6789/0 conn(0x7ff3480a6ab0 legacy=0x7ff3481ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 1 monclient: found mon.f 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34813f1d0 con 0x7ff3480a66d0 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff34c944640 5 monclient: authenticate success, global_id 56962 2024-09-13T10:37:06.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff34c944640 10 monclient: _renew_subs 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff34c944640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff34c944640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff34813e930 con 0x7ff3480a66d0 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff34c944640 10 monclient: _renew_subs 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff34c944640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff34c944640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff34813c550 con 0x7ff3480a66d0 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff338004c30 con 0x7ff3480a66d0 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff338005160 con 0x7ff3480a66d0 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff344d99640 4 set_mon_vals no callback set 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.437+0000 7ff336ffd640 10 monclient: dump: 2024-09-13T10:37:06.458 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.459 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.438+0000 7ff34c944640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.438+0000 7ff34c944640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff32c0065c0 con 0x7ff32c002860 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.438+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff338005380 con 0x7ff3480a66d0 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.438+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(226..226 src has 1..226) ==== 3506+0+0 (unknown 1010145293 0 0) 0x7ff33804e210 con 0x7ff3480a66d0 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.438+0000 7ff346d9d640 10 monclient: get_auth_request con 0x7ff328040400 auth_method 0 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff345d9b640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.195:6789/0 conn(0x7ff32c002860 legacy=0x7ff32c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1839733874 0 0) 0x7ff32c0065c0 con 0x7ff32c002860 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 10 monclient(hunting): my global_id is 56971 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff328003520 con 0x7ff32c002860 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2523717297 0 0) 0x7ff328003520 con 0x7ff32c002860 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff32c0065c0 con 0x7ff32c002860 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff33c004280 con 0x7ff32c002860 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 10 monclient: dump: 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.461 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.462 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.462 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.462 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.462 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.462 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.462 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.462 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.462 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.462 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.462 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 668995148 0 0) 0x7ff32c0065c0 con 0x7ff32c002860 2024-09-13T10:37:06.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.440+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff32c00a160 con 0x7ff32c002860 2024-09-13T10:37:06.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.441+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff33c0057c0 con 0x7ff32c002860 2024-09-13T10:37:06.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.441+0000 7ff336ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:06.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.441+0000 7ff336ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:06.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.441+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.195:6789/0 conn(0x7ff32c002860 legacy=0x7ff32c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.441+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.195:6789/0 conn(0x7ff32c002860 legacy=0x7ff32c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:06.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.447+0000 7ff34c944640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:06.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.447+0000 7ff34c944640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff32c009e50 con 0x7ff32c009110 2024-09-13T10:37:06.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.449+0000 7ff345d9b640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.195:6789/0 conn(0x7ff32c009110 legacy=0x7ff32c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.449+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132953781 0 0) 0x7ff32c009e50 con 0x7ff32c009110 2024-09-13T10:37:06.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 10 monclient(hunting): my global_id is 56980 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff32c0065c0 con 0x7ff32c009110 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3160752124 0 0) 0x7ff32c0065c0 con 0x7ff32c009110 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff32c009e50 con 0x7ff32c009110 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff33c005ea0 con 0x7ff32c009110 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 10 monclient: dump: 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.465 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3170787362 0 0) 0x7ff32c009e50 con 0x7ff32c009110 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff32c00c3f0 con 0x7ff32c009110 2024-09-13T10:37:06.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 3455337965) 0x7ff33c0072d0 con 0x7ff32c009110 2024-09-13T10:37:06.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:06.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:06.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.195:6789/0 conn(0x7ff32c009110 legacy=0x7ff32c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.450+0000 7ff336ffd640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.195:6789/0 conn(0x7ff32c009110 legacy=0x7ff32c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:06.467 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 440859, 2024-09-13T10:37:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:06.486 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.487 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:37:06.488 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.488 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.488 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:06.488 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:06.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.451+0000 7ff34c944640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff328040400 legacy=0x7ff3280428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.451+0000 7ff34c944640 10 monclient: shutdown 2024-09-13T10:37:06.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.451+0000 7ff34c944640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.451+0000 7ff34c944640 1 -- 172.21.15.181:0/4115098071 >> v1:172.21.15.195:6789/0 conn(0x7ff3480a66d0 legacy=0x7ff3481ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.451+0000 7ff346d9d640 1 -- 172.21.15.181:0/4115098071 reap_dead start 2024-09-13T10:37:06.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.451+0000 7ff346d9d640 1 -- 172.21.15.181:0/4115098071 reap_dead start 2024-09-13T10:37:06.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.451+0000 7ff34c944640 1 -- 172.21.15.181:0/4115098071 shutdown_connections 2024-09-13T10:37:06.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.451+0000 7ff34c944640 1 -- 172.21.15.181:0/4115098071 >> 172.21.15.181:0/4115098071 conn(0x7ff3480abcd0 msgr2=0x7ff348145d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.451+0000 7ff34c944640 1 -- 172.21.15.181:0/4115098071 shutdown_connections 2024-09-13T10:37:06.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.451+0000 7ff34c944640 1 -- 172.21.15.181:0/4115098071 wait complete. 2024-09-13T10:37:06.490 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:06.490 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:37:06.491 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:37:06.579 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.579 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3366655036}) 2024-09-13T10:37:06.579 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=81727662}) 2024-09-13T10:37:06.579 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.579 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3366655036}) 2024-09-13T10:37:06.579 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=948397165}) 2024-09-13T10:37:06.579 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.580 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3366655036}) 2024-09-13T10:37:06.580 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1282516177}) 2024-09-13T10:37:06.580 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.580 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3366655036}) 2024-09-13T10:37:06.580 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2972347678}) 2024-09-13T10:37:06.580 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.580 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3366655036}) 2024-09-13T10:37:06.580 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=975595858}) 2024-09-13T10:37:06.580 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.580 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.574+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3366655036}) 2024-09-13T10:37:06.580 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.575+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=548122184}) 2024-09-13T10:37:06.580 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.575+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.581 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.575+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3366655036}) 2024-09-13T10:37:06.581 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.575+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3269802459}) 2024-09-13T10:37:06.581 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.575+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.581 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.575+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3366655036}) 2024-09-13T10:37:06.581 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.575+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3980537738}) 2024-09-13T10:37:06.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.590+0000 7ff9fd57c640 10 monclient: get_monmap_and_config 2024-09-13T10:37:06.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.590+0000 7ff9fd57c640 10 monclient: build_initial_monmap 2024-09-13T10:37:06.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.590+0000 7ff9fd57c640 10 monclient: monmap: 2024-09-13T10:37:06.594 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:06.594 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.594 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:06.591014+0000 2024-09-13T10:37:06.594 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:06.591014+0000 2024-09-13T10:37:06.594 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:06.594 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.594 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:06.594 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:06.594 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:06.594 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:06.595 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:06.595 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:06.595 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:06.595 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:06.595 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:06.595 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.590+0000 7ff9fd57c640 1 Processor -- start 2024-09-13T10:37:06.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9fd57c640 1 -- start start 2024-09-13T10:37:06.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9fd57c640 10 monclient: init 2024-09-13T10:37:06.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9fd57c640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:06.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9fd57c640 10 monclient: _add_conns ranks=[8,6,7,1,2,0,3,4,5] 2024-09-13T10:37:06.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9fd57c640 10 monclient(hunting): picked mon.noname-e con 0x7ff9f80a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:06.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9fd57c640 10 monclient(hunting): picked mon.noname-d con 0x7ff9f80a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:06.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9fd57c640 10 monclient(hunting): picked mon.noname-i con 0x7ff9f813f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:06.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9fd57c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f80a4bc0 con 0x7ff9f80a8340 2024-09-13T10:37:06.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9fd57c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f813a320 con 0x7ff9f813f750 2024-09-13T10:37:06.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9fd57c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f80a8100 con 0x7ff9f80a6640 2024-09-13T10:37:06.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9fd57c640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:06.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9fd57c640 10 monclient(hunting): authenticate will time out at 1166.096521s 2024-09-13T10:37:06.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9f67fc640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7ff9f80a8340 0x7ff9f8139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:59128/0 (socket says 172.21.15.181:59128) 2024-09-13T10:37:06.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9f6ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7ff9f80a6640 0x7ff9f8139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33210/0 (socket says 172.21.15.181:33210) 2024-09-13T10:37:06.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.591+0000 7ff9f67fc640 1 -- 172.21.15.181:0/3060588433 learned_addr learned my addr 172.21.15.181:0/3060588433 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:06.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f67fc640 1 -- 172.21.15.181:0/3060588433 >> v1:172.21.15.181:6792/0 conn(0x7ff9f80a8340 legacy=0x7ff9f8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f6ffd640 1 -- 172.21.15.181:0/3060588433 >> v1:172.21.15.181:6793/0 conn(0x7ff9f80a6640 legacy=0x7ff9f8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133870852 0 0) 0x7ff9f80a4bc0 con 0x7ff9f80a8340 2024-09-13T10:37:06.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f5ffb640 10 monclient(hunting): my global_id is 124260 2024-09-13T10:37:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e0003520 con 0x7ff9f80a8340 2024-09-13T10:37:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1097515458 0 0) 0x7ff9f80a8100 con 0x7ff9f80a6640 2024-09-13T10:37:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f77fe640 1 -- 172.21.15.181:0/3060588433 >> v1:172.21.15.195:6792/0 conn(0x7ff9f813f750 legacy=0x7ff9f8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.593+0000 7ff9f5ffb640 10 monclient(hunting): my global_id is 105047 2024-09-13T10:37:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9f80a4bc0 con 0x7ff9f80a6640 2024-09-13T10:37:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314869344 0 0) 0x7ff9f813a320 con 0x7ff9f813f750 2024-09-13T10:37:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient(hunting): my global_id is 56878 2024-09-13T10:37:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9f80a8100 con 0x7ff9f813f750 2024-09-13T10:37:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1840130623 0 0) 0x7ff9f80a4bc0 con 0x7ff9f80a6640 2024-09-13T10:37:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 >> v1:172.21.15.195:6792/0 conn(0x7ff9f813f750 legacy=0x7ff9f8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 >> v1:172.21.15.181:6792/0 conn(0x7ff9f80a8340 legacy=0x7ff9f8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:37:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 1 monclient: found mon.noname-e 2024-09-13T10:37:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:37:06.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f80a48e0 con 0x7ff9f80a6640 2024-09-13T10:37:06.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient: _finish_auth 0 2024-09-13T10:37:06.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:37:06.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:06.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9e8001ac0 con 0x7ff9f80a6640 2024-09-13T10:37:06.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9fd57c640 5 monclient: authenticate success, global_id 105047 2024-09-13T10:37:06.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9fd57c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:06.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:06.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient: dump: 2024-09-13T10:37:06.608 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.608 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.609 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.609 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.609 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.609 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.609 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.609 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.609 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.609 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.609 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.609 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.609 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.609 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.610 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.610 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9fd57c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:06.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9e80047e0 con 0x7ff9f80a6640 2024-09-13T10:37:06.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:06.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 1 -- 172.21.15.181:0/3060588433 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9e8004d90 con 0x7ff9f80a6640 2024-09-13T10:37:06.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:06.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9f5ffb640 10 monclient: dump: 2024-09-13T10:37:06.610 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.610 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.610 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.611 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.611 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.611 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.611 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.611 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.611 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.611 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.611 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.611 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.611 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.611 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.611 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.612 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9fd57c640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:06.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9fd57c640 4 set_mon_vals no callback set 2024-09-13T10:37:06.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9fd57c640 10 monclient: shutdown 2024-09-13T10:37:06.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9fd57c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3060588433 >> v1:172.21.15.181:6793/0 conn(0x7ff9f80a6640 legacy=0x7ff9f8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3060588433 shutdown_connections 2024-09-13T10:37:06.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3060588433 >> 172.21.15.181:0/3060588433 conn(0x7ff9f8077170 msgr2=0x7ff9f80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3060588433 shutdown_connections 2024-09-13T10:37:06.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.594+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3060588433 wait complete. 2024-09-13T10:37:06.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.595+0000 7ff9fd57c640 10 monclient: build_initial_monmap 2024-09-13T10:37:06.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.595+0000 7ff9fd57c640 10 monclient: monmap: 2024-09-13T10:37:06.613 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:06.613 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:06.613 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:06.613 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:06.613 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:06.613 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:06.613 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:06.613 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:06.613 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:06.613 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:06.613 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:06.614 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:06.614 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:06.614 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:06.614 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:06.614 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.595+0000 7ff9fd57c640 1 Processor -- start 2024-09-13T10:37:06.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.595+0000 7ff9fd57c640 1 -- start start 2024-09-13T10:37:06.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.595+0000 7ff9fd57c640 10 monclient: init 2024-09-13T10:37:06.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.596+0000 7ff9fd57c640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:06.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.596+0000 7ff9fd57c640 10 monclient: _add_conns ranks=[7,4,1,6,5,0,8,3,2] 2024-09-13T10:37:06.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.596+0000 7ff9fd57c640 10 monclient(hunting): picked mon.noname-i con 0x7ff9f80a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:06.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.596+0000 7ff9fd57c640 10 monclient(hunting): picked mon.noname-c con 0x7ff9f813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:06.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.596+0000 7ff9fd57c640 10 monclient(hunting): picked mon.noname-f con 0x7ff9f813ce40 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:06.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.596+0000 7ff9fd57c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f81345d0 con 0x7ff9f813ce40 2024-09-13T10:37:06.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.596+0000 7ff9fd57c640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f81348b0 con 0x7ff9f813f750 2024-09-13T10:37:06.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.596+0000 7ff9fd57c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f813d820 con 0x7ff9f80a8340 2024-09-13T10:37:06.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.596+0000 7ff9fd57c640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:06.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.596+0000 7ff9fd57c640 10 monclient(hunting): authenticate will time out at 1166.101441s 2024-09-13T10:37:06.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.596+0000 7ff9f67fc640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ff9f813f750 0x7ff9f81d3510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51310/0 (socket says 172.21.15.181:51310) 2024-09-13T10:37:06.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.596+0000 7ff9f67fc640 1 -- 172.21.15.181:0/3254106112 learned_addr learned my addr 172.21.15.181:0/3254106112 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:06.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9f67fc640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.181:6791/0 conn(0x7ff9f813f750 legacy=0x7ff9f81d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9f77fe640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.195:6789/0 conn(0x7ff9f813ce40 legacy=0x7ff9f81d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9f6ffd640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.195:6792/0 conn(0x7ff9f80a8340 legacy=0x7ff9f81ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124537160 0 0) 0x7ff9f81348b0 con 0x7ff9f813f750 2024-09-13T10:37:06.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 10 monclient(hunting): my global_id is 114691 2024-09-13T10:37:06.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e4003550 con 0x7ff9f813f750 2024-09-13T10:37:06.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145548074 0 0) 0x7ff9f813d820 con 0x7ff9f80a8340 2024-09-13T10:37:06.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 10 monclient(hunting): my global_id is 56887 2024-09-13T10:37:06.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9f81348b0 con 0x7ff9f80a8340 2024-09-13T10:37:06.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2055104655 0 0) 0x7ff9f81345d0 con 0x7ff9f813ce40 2024-09-13T10:37:06.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 10 monclient(hunting): my global_id is 56989 2024-09-13T10:37:06.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.598+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9f813d820 con 0x7ff9f813ce40 2024-09-13T10:37:06.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1720123433 0 0) 0x7ff9e4003550 con 0x7ff9f813f750 2024-09-13T10:37:06.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9f81345d0 con 0x7ff9f813f750 2024-09-13T10:37:06.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9ec0019d0 con 0x7ff9f813f750 2024-09-13T10:37:06.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:06.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient(hunting): dump: 2024-09-13T10:37:06.618 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.618 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.618 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.618 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.618 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.618 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.618 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.618 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.618 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.618 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.618 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.619 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.619 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.619 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.619 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.619 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:06.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2850275429 0 0) 0x7ff9f81348b0 con 0x7ff9f80a8340 2024-09-13T10:37:06.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9e4003550 con 0x7ff9f80a8340 2024-09-13T10:37:06.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9e8004cd0 con 0x7ff9f80a8340 2024-09-13T10:37:06.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:06.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient(hunting): dump: 2024-09-13T10:37:06.620 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.620 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.620 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.620 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.620 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.620 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.620 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.620 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.620 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.620 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.620 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.620 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.621 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.621 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.621 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.621 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3566073573 0 0) 0x7ff9f813d820 con 0x7ff9f813ce40 2024-09-13T10:37:06.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9f81348b0 con 0x7ff9f813ce40 2024-09-13T10:37:06.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2557935756 0 0) 0x7ff9f81345d0 con 0x7ff9f813f750 2024-09-13T10:37:06.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.195:6792/0 conn(0x7ff9f80a8340 legacy=0x7ff9f81ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.195:6789/0 conn(0x7ff9f813ce40 legacy=0x7ff9f81d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:06.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 monclient: found mon.c 2024-09-13T10:37:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f813e500 con 0x7ff9f813f750 2024-09-13T10:37:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9fd57c640 5 monclient: authenticate success, global_id 114691 2024-09-13T10:37:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9fd57c640 10 monclient: _renew_subs 2024-09-13T10:37:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9fd57c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f81cecb0 con 0x7ff9f813f750 2024-09-13T10:37:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9fd57c640 10 monclient: _renew_subs 2024-09-13T10:37:06.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9fd57c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:06.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7ff9f81d8360 con 0x7ff9f813f750 2024-09-13T10:37:06.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9ec004dd0 con 0x7ff9f813f750 2024-09-13T10:37:06.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:06.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9ec0052c0 con 0x7ff9f813f750 2024-09-13T10:37:06.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9f57fa640 4 set_mon_vals no callback set 2024-09-13T10:37:06.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:06.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.599+0000 7ff9df7fe640 10 monclient: dump: 2024-09-13T10:37:06.623 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.623 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.623 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.623 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.624 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.624 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.600+0000 7ff9fd57c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.600+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff9d80065c0 con 0x7ff9d8002860 2024-09-13T10:37:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.600+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff9ec011940 con 0x7ff9f813f750 2024-09-13T10:37:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.600+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(226..226 src has 1..226) ==== 3506+0+0 (unknown 1010145293 0 0) 0x7ff9ec04e1a0 con 0x7ff9f813f750 2024-09-13T10:37:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.600+0000 7ff9f77fe640 10 monclient: get_auth_request con 0x7ff9e40405a0 auth_method 0 2024-09-13T10:37:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.602+0000 7ff9f6ffd640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.195:6790/0 conn(0x7ff9d8002860 legacy=0x7ff9d8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.602+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2994996577 0 0) 0x7ff9d80065c0 con 0x7ff9d8002860 2024-09-13T10:37:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.602+0000 7ff9df7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.602+0000 7ff9df7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.602+0000 7ff9df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.602+0000 7ff9df7fe640 10 monclient(hunting): my global_id is 6717 2024-09-13T10:37:06.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.602+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9f81345d0 con 0x7ff9d8002860 2024-09-13T10:37:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 749125634 0 0) 0x7ff9f81345d0 con 0x7ff9d8002860 2024-09-13T10:37:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9d80065c0 con 0x7ff9d8002860 2024-09-13T10:37:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9e80047e0 con 0x7ff9d8002860 2024-09-13T10:37:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 10 monclient: dump: 2024-09-13T10:37:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.626 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.627 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2130316250 0 0) 0x7ff9d80065c0 con 0x7ff9d8002860 2024-09-13T10:37:06.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9d800a160 con 0x7ff9d8002860 2024-09-13T10:37:06.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff9e8005460 con 0x7ff9d8002860 2024-09-13T10:37:06.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:06.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:06.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.195:6790/0 conn(0x7ff9d8002860 legacy=0x7ff9d8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.603+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.195:6790/0 conn(0x7ff9d8002860 legacy=0x7ff9d8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.609+0000 7ff9fd57c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.609+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff9d8009e70 con 0x7ff9d8009130 2024-09-13T10:37:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9f6ffd640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.195:6790/0 conn(0x7ff9d8009130 legacy=0x7ff9d80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004882978 0 0) 0x7ff9d8009e70 con 0x7ff9d8009130 2024-09-13T10:37:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 10 monclient(hunting): my global_id is 6726 2024-09-13T10:37:06.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9d80065c0 con 0x7ff9d8009130 2024-09-13T10:37:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2327754281 0 0) 0x7ff9d80065c0 con 0x7ff9d8009130 2024-09-13T10:37:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9d8009e70 con 0x7ff9d8009130 2024-09-13T10:37:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9e8005bd0 con 0x7ff9d8009130 2024-09-13T10:37:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 10 monclient: dump: 2024-09-13T10:37:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.631 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.632 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.632 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.632 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.632 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.632 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.632 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.632 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.632 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.632 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.632 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.632 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3720290625 0 0) 0x7ff9d8009e70 con 0x7ff9d8009130 2024-09-13T10:37:06.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.612+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff9d800c410 con 0x7ff9d8009130 2024-09-13T10:37:06.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7562 (unknown 0 0 927477843) 0x7ff9e8007000 con 0x7ff9d8009130 2024-09-13T10:37:06.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9df7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:06.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9df7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:06.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.195:6790/0 conn(0x7ff9d8009130 legacy=0x7ff9d80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9df7fe640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.195:6790/0 conn(0x7ff9d8009130 legacy=0x7ff9d80095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:06.633 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:06.633 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:06.634 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:06.634 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:37:06.634 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:06.634 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 441027, 2024-09-13T10:37:06.634 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:06.634 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:06.634 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:06.634 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:06.634 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:06.634 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:06.634 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:06.635 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:06.635 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:06.635 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:06.635 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.635 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:37:06.635 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:06.635 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:06.635 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:06.635 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.635 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.635 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.635 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.636 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.636 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.636 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.636 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.636 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.636 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.636 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.636 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.636 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:06.636 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:06.637 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.637 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.637 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.637 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.637 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.637 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.637 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.637 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.637 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.637 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.637 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.637 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.638 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:06.638 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:06.638 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:06.638 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:06.638 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:06.638 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:06.638 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:06.638 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:06.638 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:06.638 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:06.638 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:06.639 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:06.639 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:06.639 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:06.639 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:06.639 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:06.639 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:06.639 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.639 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.639 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.639 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.639 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.640 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.640 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.640 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.640 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.640 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.640 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.640 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.640 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:06.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.640 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:06.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.641 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:06.641 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:06.641 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.641 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:06.641 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.641 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:06.642 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:06.642 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.642 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.642 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.642 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:06.642 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:06.642 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.642 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.642 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.643 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:06.643 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.643 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.643 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.643 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:06.643 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:06.643 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.643 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.643 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.644 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:06.644 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:06.644 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.644 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:06.644 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.644 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.644 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.645 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:06.645 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:06.645 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.645 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.645 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.645 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:06.645 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:06.645 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.645 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.646 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:06.646 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.646 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:06.646 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:06.646 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.646 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.646 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:06.648 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:06.648 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.648 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.648 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.648 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:06.648 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:06.648 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.649 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.649 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:06.649 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.649 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.649 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.649 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:06.649 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:06.649 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.649 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.649 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.650 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:06.650 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:06.650 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.650 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.650 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.650 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:06.650 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.650 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.650 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:06.651 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:06.651 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.651 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.651 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.651 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:06.651 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:06.651 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.652 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.652 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:06.652 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.652 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.652 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.652 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.652 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.652 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.652 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.652 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.653 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:06.653 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:06.653 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.653 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.653 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.653 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:06.653 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.653 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.654 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.654 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.654 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.654 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.654 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.654 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.654 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.654 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.654 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:06.654 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:06.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.655 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.655 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.655 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:06.655 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.655 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.655 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:06.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.655 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.655 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.655 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4 2024-09-13T10:37:06.655 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.656 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.656 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:06.656 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:06.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff9e40405a0 legacy=0x7ff9e4042a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9fd57c640 10 monclient: shutdown 2024-09-13T10:37:06.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9fd57c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3254106112 >> v1:172.21.15.181:6791/0 conn(0x7ff9f813f750 legacy=0x7ff9f81d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9f77fe640 1 -- 172.21.15.181:0/3254106112 reap_dead start 2024-09-13T10:37:06.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9f77fe640 1 -- 172.21.15.181:0/3254106112 reap_dead start 2024-09-13T10:37:06.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3254106112 shutdown_connections 2024-09-13T10:37:06.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3254106112 >> 172.21.15.181:0/3254106112 conn(0x7ff9f80a6640 msgr2=0x7ff9f80a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3254106112 shutdown_connections 2024-09-13T10:37:06.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.613+0000 7ff9fd57c640 1 -- 172.21.15.181:0/3254106112 wait complete. 2024-09-13T10:37:06.659 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:06.659 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:37:06.659 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:37:06.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.756+0000 7ff049a71640 10 monclient: get_monmap_and_config 2024-09-13T10:37:06.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.756+0000 7ff049a71640 10 monclient: build_initial_monmap 2024-09-13T10:37:06.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.756+0000 7ff049a71640 10 monclient: monmap: 2024-09-13T10:37:06.758 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:06.758 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.758 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:06.756782+0000 2024-09-13T10:37:06.758 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:06.756782+0000 2024-09-13T10:37:06.758 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:06.758 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.758 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:06.758 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:06.758 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:06.759 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:06.759 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:06.759 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:06.759 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:06.759 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:06.759 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:06.759 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 1 Processor -- start 2024-09-13T10:37:06.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 1 -- start start 2024-09-13T10:37:06.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 10 monclient: init 2024-09-13T10:37:06.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:06.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 10 monclient: _add_conns ranks=[8,5,0,6,4,3,1,2,7] 2024-09-13T10:37:06.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 10 monclient(hunting): picked mon.noname-e con 0x7ff0440a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:06.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 10 monclient(hunting): picked mon.noname-h con 0x7ff0440a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:06.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 10 monclient(hunting): picked mon.noname-a con 0x7ff04413f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:06.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0440a5fe0 con 0x7ff04413f9a0 2024-09-13T10:37:06.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0440a8080 con 0x7ff0440a6ab0 2024-09-13T10:37:06.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0440a42c0 con 0x7ff0440a66d0 2024-09-13T10:37:06.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:06.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff049a71640 10 monclient(hunting): authenticate will time out at 1166.262683s 2024-09-13T10:37:06.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff0437fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7ff0440a66d0 0x7ff0440a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33214/0 (socket says 172.21.15.181:33214) 2024-09-13T10:37:06.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff0437fe640 1 -- 172.21.15.181:0/426681620 learned_addr learned my addr 172.21.15.181:0/426681620 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:06.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.757+0000 7ff043fff640 1 --1- 172.21.15.181:0/426681620 >> v1:172.21.15.181:6789/0 conn(0x7ff04413f9a0 0x7ff044141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53482/0 (socket says 172.21.15.181:53482) 2024-09-13T10:37:06.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.759+0000 7ff0437fe640 1 -- 172.21.15.181:0/426681620 >> v1:172.21.15.181:6793/0 conn(0x7ff0440a66d0 legacy=0x7ff0440a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.759+0000 7ff043fff640 1 -- 172.21.15.181:0/426681620 >> v1:172.21.15.181:6789/0 conn(0x7ff04413f9a0 legacy=0x7ff044141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.760+0000 7ff03bfff640 1 -- 172.21.15.181:0/426681620 >> v1:172.21.15.195:6791/0 conn(0x7ff0440a6ab0 legacy=0x7ff0440a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.760+0000 7ff042ffd640 1 -- 172.21.15.181:0/426681620 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878366389 0 0) 0x7ff0440a42c0 con 0x7ff0440a66d0 2024-09-13T10:37:06.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.760+0000 7ff042ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.760+0000 7ff042ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.760+0000 7ff042ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.760+0000 7ff042ffd640 10 monclient(hunting): my global_id is 105056 2024-09-13T10:37:06.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.760+0000 7ff042ffd640 1 -- 172.21.15.181:0/426681620 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff030003520 con 0x7ff0440a66d0 2024-09-13T10:37:06.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2322033813}) 2024-09-13T10:37:06.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1607986230}) 2024-09-13T10:37:06.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2322033813}) 2024-09-13T10:37:06.767 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=487230548}) 2024-09-13T10:37:06.768 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.768 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2322033813}) 2024-09-13T10:37:06.768 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4198398874}) 2024-09-13T10:37:06.768 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.768 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2322033813}) 2024-09-13T10:37:06.768 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=360023035}) 2024-09-13T10:37:06.768 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.768 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2322033813}) 2024-09-13T10:37:06.768 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4016437786}) 2024-09-13T10:37:06.768 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.768 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.759+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2322033813}) 2024-09-13T10:37:06.769 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.760+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=167290480}) 2024-09-13T10:37:06.769 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.760+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.769 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.760+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2322033813}) 2024-09-13T10:37:06.769 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.760+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3488284755}) 2024-09-13T10:37:06.769 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.760+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.769 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.760+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2322033813}) 2024-09-13T10:37:06.769 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.760+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1579453009}) 2024-09-13T10:37:06.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.771+0000 7ff042ffd640 1 -- 172.21.15.181:0/426681620 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450424267 0 0) 0x7ff0440a5fe0 con 0x7ff04413f9a0 2024-09-13T10:37:06.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.771+0000 7ff042ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.771+0000 7ff042ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.771+0000 7ff042ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.771+0000 7ff042ffd640 10 monclient(hunting): my global_id is 114606 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.771+0000 7ff042ffd640 1 -- 172.21.15.181:0/426681620 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0440a42c0 con 0x7ff04413f9a0 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.771+0000 7ff042ffd640 1 -- 172.21.15.181:0/426681620 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 542456309 0 0) 0x7ff0440a42c0 con 0x7ff04413f9a0 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.771+0000 7ff042ffd640 1 -- 172.21.15.181:0/426681620 >> v1:172.21.15.181:6793/0 conn(0x7ff0440a66d0 legacy=0x7ff0440a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.771+0000 7ff042ffd640 1 -- 172.21.15.181:0/426681620 >> v1:172.21.15.195:6791/0 conn(0x7ff0440a6ab0 legacy=0x7ff0440a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.771+0000 7ff042ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.771+0000 7ff042ffd640 1 monclient: found mon.noname-a 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.771+0000 7ff042ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 1 -- 172.21.15.181:0/426681620 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0441464e0 con 0x7ff04413f9a0 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:06.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 1 -- 172.21.15.181:0/426681620 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff03c001dd0 con 0x7ff04413f9a0 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff049a71640 5 monclient: authenticate success, global_id 114606 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff049a71640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 10 monclient: dump: 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.776 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff049a71640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 1 -- 172.21.15.181:0/426681620 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff03c0020a0 con 0x7ff04413f9a0 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 1 -- 172.21.15.181:0/426681620 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff03c004ea0 con 0x7ff04413f9a0 2024-09-13T10:37:06.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff049a71640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff049a71640 4 set_mon_vals no callback set 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff042ffd640 10 monclient: dump: 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.778 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff049a71640 10 monclient: shutdown 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff049a71640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff049a71640 1 -- 172.21.15.181:0/426681620 >> v1:172.21.15.181:6789/0 conn(0x7ff04413f9a0 legacy=0x7ff044141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff049a71640 1 -- 172.21.15.181:0/426681620 shutdown_connections 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.772+0000 7ff049a71640 1 -- 172.21.15.181:0/426681620 >> 172.21.15.181:0/426681620 conn(0x7ff0440abcd0 msgr2=0x7ff0440ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.773+0000 7ff049a71640 1 -- 172.21.15.181:0/426681620 shutdown_connections 2024-09-13T10:37:06.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.773+0000 7ff049a71640 1 -- 172.21.15.181:0/426681620 wait complete. 2024-09-13T10:37:06.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1628290968}) 2024-09-13T10:37:06.783 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1880000993}) 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1628290968}) 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=629194880}) 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1628290968}) 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2648783463}) 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1628290968}) 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=466522652}) 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1628290968}) 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1470557428}) 2024-09-13T10:37:06.784 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1628290968}) 2024-09-13T10:37:06.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1213800958}) 2024-09-13T10:37:06.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1628290968}) 2024-09-13T10:37:06.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1947393168}) 2024-09-13T10:37:06.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1628290968}) 2024-09-13T10:37:06.785 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.771+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1181059283}) 2024-09-13T10:37:06.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.773+0000 7ff049a71640 10 monclient: build_initial_monmap 2024-09-13T10:37:06.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.773+0000 7ff049a71640 10 monclient: monmap: 2024-09-13T10:37:06.789 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:06.789 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:06.789 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:06.789 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:06.789 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:06.789 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 1 Processor -- start 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 1 -- start start 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 10 monclient: init 2024-09-13T10:37:06.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 10 monclient: _add_conns ranks=[0,5,1,6,2,8,4,3,7] 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 10 monclient(hunting): picked mon.noname-a con 0x7ff0440a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 10 monclient(hunting): picked mon.noname-h con 0x7ff0440a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 10 monclient(hunting): picked mon.noname-f con 0x7ff04413f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04413f160 con 0x7ff0440a66d0 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04413c160 con 0x7ff04413f9a0 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff044068b30 con 0x7ff0440a6ab0 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff049a71640 10 monclient(hunting): authenticate will time out at 1166.279730s 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff0437fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff0440a66d0 0x7ff04413b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53496/0 (socket says 172.21.15.181:53496) 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.774+0000 7ff0437fe640 1 -- 172.21.15.181:0/904448822 learned_addr learned my addr 172.21.15.181:0/904448822 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.776+0000 7ff0437fe640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.181:6789/0 conn(0x7ff0440a66d0 legacy=0x7ff04413b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff043fff640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.195:6789/0 conn(0x7ff04413f9a0 legacy=0x7ff0441d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff03bfff640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.195:6791/0 conn(0x7ff0440a6ab0 legacy=0x7ff04413ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707097376 0 0) 0x7ff04413f160 con 0x7ff0440a66d0 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): my global_id is 114615 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff024003520 con 0x7ff0440a66d0 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3370445444 0 0) 0x7ff024003520 con 0x7ff0440a66d0 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff04413f160 con 0x7ff0440a66d0 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff0340047e0 con 0x7ff0440a66d0 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:06.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.793 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326940831 0 0) 0x7ff04413c160 con 0x7ff04413f9a0 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): my global_id is 56998 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff024003520 con 0x7ff04413f9a0 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2562148818 0 0) 0x7ff044068b30 con 0x7ff0440a6ab0 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient(hunting): my global_id is 104801 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff04413c160 con 0x7ff0440a6ab0 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2789250966 0 0) 0x7ff04413f160 con 0x7ff0440a66d0 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.195:6791/0 conn(0x7ff0440a6ab0 legacy=0x7ff04413ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.195:6789/0 conn(0x7ff04413f9a0 legacy=0x7ff0441d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 monclient: found mon.a 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04413e2f0 con 0x7ff0440a66d0 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient: _finish_auth 0 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:37:06.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff049a71640 5 monclient: authenticate success, global_id 114615 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff049a71640 10 monclient: _renew_subs 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff049a71640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff049a71640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff04413ee80 con 0x7ff0440a66d0 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff049a71640 10 monclient: _renew_subs 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff049a71640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff049a71640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff04413f580 con 0x7ff0440a66d0 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff034004d70 con 0x7ff0440a66d0 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff0340052a0 con 0x7ff0440a66d0 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff0427fc640 4 set_mon_vals no callback set 2024-09-13T10:37:06.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.777+0000 7ff040ff9640 10 monclient: dump: 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.797 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.778+0000 7ff049a71640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.778+0000 7ff049a71640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff0280065c0 con 0x7ff028002860 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.778+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff034005540 con 0x7ff0440a66d0 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.778+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(226..226 src has 1..226) ==== 3506+0+0 (unknown 1010145293 0 0) 0x7ff03404e310 con 0x7ff0440a66d0 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.778+0000 7ff043fff640 10 monclient: get_auth_request con 0x7ff02403fd10 auth_method 0 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.780+0000 7ff03bfff640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.195:6791/0 conn(0x7ff028002860 legacy=0x7ff028004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.780+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2196363853 0 0) 0x7ff0280065c0 con 0x7ff028002860 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.780+0000 7ff040ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.780+0000 7ff040ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.780+0000 7ff040ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.780+0000 7ff040ff9640 10 monclient(hunting): my global_id is 104810 2024-09-13T10:37:06.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.780+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff04413f160 con 0x7ff028002860 2024-09-13T10:37:06.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.780+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2925723021 0 0) 0x7ff04413f160 con 0x7ff028002860 2024-09-13T10:37:06.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.781+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0280065c0 con 0x7ff028002860 2024-09-13T10:37:06.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.781+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff02c001c70 con 0x7ff028002860 2024-09-13T10:37:06.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.781+0000 7ff040ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.781+0000 7ff040ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:06.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.781+0000 7ff040ff9640 10 monclient: dump: 2024-09-13T10:37:06.799 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.799 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.799 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.800 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.800 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.800 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.800 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.800 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.800 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.800 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.800 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.800 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.800 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.800 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.800 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.801 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.781+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1251913571 0 0) 0x7ff0280065c0 con 0x7ff028002860 2024-09-13T10:37:06.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.781+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff02800a160 con 0x7ff028002860 2024-09-13T10:37:06.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.781+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff02c0057c0 con 0x7ff028002860 2024-09-13T10:37:06.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.781+0000 7ff040ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:06.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.781+0000 7ff040ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:06.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.781+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.195:6791/0 conn(0x7ff028002860 legacy=0x7ff028004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.781+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.195:6791/0 conn(0x7ff028002860 legacy=0x7ff028004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:06.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.788+0000 7ff049a71640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:06.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.788+0000 7ff049a71640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff028009e70 con 0x7ff028009130 2024-09-13T10:37:06.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.790+0000 7ff03bfff640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.195:6791/0 conn(0x7ff028009130 legacy=0x7ff0280095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.791+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054474952 0 0) 0x7ff028009e70 con 0x7ff028009130 2024-09-13T10:37:06.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.791+0000 7ff040ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.791+0000 7ff040ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.791+0000 7ff040ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.791+0000 7ff040ff9640 10 monclient(hunting): my global_id is 104819 2024-09-13T10:37:06.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.791+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0280065c0 con 0x7ff028009130 2024-09-13T10:37:06.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.792+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1806037700 0 0) 0x7ff0280065c0 con 0x7ff028009130 2024-09-13T10:37:06.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.792+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff028009e70 con 0x7ff028009130 2024-09-13T10:37:06.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.792+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff02c003d00 con 0x7ff028009130 2024-09-13T10:37:06.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.792+0000 7ff040ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.792+0000 7ff040ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:06.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.792+0000 7ff040ff9640 10 monclient: dump: 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.805 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.806 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.806 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.806 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.797+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2969333413 0 0) 0x7ff028009e70 con 0x7ff028009130 2024-09-13T10:37:06.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.798+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff02800c410 con 0x7ff028009130 2024-09-13T10:37:06.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.799+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 1463239010) 0x7ff02c003fc0 con 0x7ff028009130 2024-09-13T10:37:06.806 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:06.806 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 110497, 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:06.807 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.808 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.809 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:06.810 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.811 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:06.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.813 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:06.813 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:06.813 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.813 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.813 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.813 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:06.813 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.813 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.813 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.813 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.814 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.815 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:06.816 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:06.816 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.816 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:06.816 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.816 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.816 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:06.816 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:06.817 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.817 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.817 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.817 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:06.817 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:06.817 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:06.819 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:06.821 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.822 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.826 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:37:06.827 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.827 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.827 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:06.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.827 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.827 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.827 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:06.827 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.827 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.827 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:06.827 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:06.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.799+0000 7ff040ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:06.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.799+0000 7ff040ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:06.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.799+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.195:6791/0 conn(0x7ff028009130 legacy=0x7ff0280095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.799+0000 7ff040ff9640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.195:6791/0 conn(0x7ff028009130 legacy=0x7ff0280095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:06.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.801+0000 7ff049a71640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff02403fd10 legacy=0x7ff0240421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.801+0000 7ff049a71640 10 monclient: shutdown 2024-09-13T10:37:06.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.801+0000 7ff049a71640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.801+0000 7ff049a71640 1 -- 172.21.15.181:0/904448822 >> v1:172.21.15.181:6789/0 conn(0x7ff0440a66d0 legacy=0x7ff04413b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.801+0000 7ff043fff640 1 -- 172.21.15.181:0/904448822 reap_dead start 2024-09-13T10:37:06.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.801+0000 7ff043fff640 1 -- 172.21.15.181:0/904448822 reap_dead start 2024-09-13T10:37:06.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.802+0000 7ff049a71640 1 -- 172.21.15.181:0/904448822 shutdown_connections 2024-09-13T10:37:06.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.802+0000 7ff049a71640 1 -- 172.21.15.181:0/904448822 >> 172.21.15.181:0/904448822 conn(0x7ff0440abcd0 msgr2=0x7ff044145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.802+0000 7ff049a71640 1 -- 172.21.15.181:0/904448822 shutdown_connections 2024-09-13T10:37:06.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.802+0000 7ff049a71640 1 -- 172.21.15.181:0/904448822 wait complete. 2024-09-13T10:37:06.832 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:06.832 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:37:06.832 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:37:06.836 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.836 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3409044995}) 2024-09-13T10:37:06.836 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1746122607}) 2024-09-13T10:37:06.836 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.836 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3409044995}) 2024-09-13T10:37:06.836 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2569172523}) 2024-09-13T10:37:06.836 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.836 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3409044995}) 2024-09-13T10:37:06.836 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3947407834}) 2024-09-13T10:37:06.836 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.836 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3409044995}) 2024-09-13T10:37:06.836 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1760133729}) 2024-09-13T10:37:06.837 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.837 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.786+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3409044995}) 2024-09-13T10:37:06.837 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.787+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=91440838}) 2024-09-13T10:37:06.837 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.787+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.837 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.787+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3409044995}) 2024-09-13T10:37:06.837 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.787+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3737628317}) 2024-09-13T10:37:06.837 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.787+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.837 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.787+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3409044995}) 2024-09-13T10:37:06.837 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.787+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3507990859}) 2024-09-13T10:37:06.837 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.787+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.837 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.787+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3409044995}) 2024-09-13T10:37:06.837 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.787+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3222698607}) 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=188065240}) 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3381272709}) 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=188065240}) 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1225219955}) 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=188065240}) 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=247488384}) 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=188065240}) 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2682880900}) 2024-09-13T10:37:06.838 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=188065240}) 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1104278797}) 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=188065240}) 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=523137838}) 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=188065240}) 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=805003720}) 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=188065240}) 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.791+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2262708283}) 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.798+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.798+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1705990395}) 2024-09-13T10:37:06.839 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.798+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1982964466}) 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1705990395}) 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1016006182}) 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1705990395}) 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2577369731}) 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1705990395}) 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3875020098}) 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1705990395}) 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2989191702}) 2024-09-13T10:37:06.840 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.841 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1705990395}) 2024-09-13T10:37:06.841 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2677834306}) 2024-09-13T10:37:06.841 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.841 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1705990395}) 2024-09-13T10:37:06.841 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3412251072}) 2024-09-13T10:37:06.841 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:06.841 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1705990395}) 2024-09-13T10:37:06.841 INFO:tasks.ceph.mon.g.smithi195.stderr:2024-09-13T10:37:06.799+0000 7fa94f584640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3953809948}) 2024-09-13T10:37:06.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.931+0000 7fdea1660640 10 monclient: get_monmap_and_config 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.931+0000 7fdea1660640 10 monclient: build_initial_monmap 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.931+0000 7fdea1660640 10 monclient: monmap: 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:06.931721+0000 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:06.931721+0000 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:06.933 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:06.934 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:06.934 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:06.934 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:06.934 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:06.934 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.931+0000 7fdea1660640 1 Processor -- start 2024-09-13T10:37:06.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.931+0000 7fdea1660640 1 -- start start 2024-09-13T10:37:06.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.931+0000 7fdea1660640 10 monclient: init 2024-09-13T10:37:06.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.932+0000 7fdea1660640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:06.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.932+0000 7fdea1660640 10 monclient: _add_conns ranks=[8,5,0,4,3,6,7,2,1] 2024-09-13T10:37:06.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.932+0000 7fdea1660640 10 monclient(hunting): picked mon.noname-e con 0x7fde9c0a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:06.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.932+0000 7fdea1660640 10 monclient(hunting): picked mon.noname-h con 0x7fde9c0a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:06.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.932+0000 7fdea1660640 10 monclient(hunting): picked mon.noname-a con 0x7fde9c13f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:06.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.932+0000 7fdea1660640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde9c0a5fe0 con 0x7fde9c13f9a0 2024-09-13T10:37:06.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.932+0000 7fdea1660640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde9c0a8080 con 0x7fde9c0a6ab0 2024-09-13T10:37:06.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.932+0000 7fdea1660640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde9c0a42c0 con 0x7fde9c0a66d0 2024-09-13T10:37:06.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.932+0000 7fdea1660640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:06.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.932+0000 7fdea1660640 10 monclient(hunting): authenticate will time out at 1166.437451s 2024-09-13T10:37:06.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.932+0000 7fde9affd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fde9c0a66d0 0x7fde9c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33224/0 (socket says 172.21.15.181:33224) 2024-09-13T10:37:06.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.932+0000 7fde9affd640 1 -- 172.21.15.181:0/3879766214 learned_addr learned my addr 172.21.15.181:0/3879766214 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:06.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9b7fe640 1 -- 172.21.15.181:0/3879766214 >> v1:172.21.15.181:6789/0 conn(0x7fde9c13f9a0 legacy=0x7fde9c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9affd640 1 -- 172.21.15.181:0/3879766214 >> v1:172.21.15.181:6793/0 conn(0x7fde9c0a66d0 legacy=0x7fde9c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9a7fc640 1 -- 172.21.15.181:0/3879766214 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059261762 0 0) 0x7fde9c0a42c0 con 0x7fde9c0a66d0 2024-09-13T10:37:06.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9a7fc640 10 monclient(hunting): my global_id is 105065 2024-09-13T10:37:06.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9a7fc640 1 -- 172.21.15.181:0/3879766214 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde88003520 con 0x7fde9c0a66d0 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9a7fc640 1 -- 172.21.15.181:0/3879766214 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4079535992 0 0) 0x7fde9c0a5fe0 con 0x7fde9c13f9a0 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9a7fc640 10 monclient(hunting): my global_id is 114624 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde9a7fc640 1 -- 172.21.15.181:0/3879766214 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde9c0a42c0 con 0x7fde9c13f9a0 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.934+0000 7fde93fff640 1 -- 172.21.15.181:0/3879766214 >> v1:172.21.15.195:6791/0 conn(0x7fde9c0a6ab0 legacy=0x7fde9c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 1 -- 172.21.15.181:0/3879766214 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2388064573 0 0) 0x7fde88003520 con 0x7fde9c0a66d0 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 1 -- 172.21.15.181:0/3879766214 >> v1:172.21.15.195:6791/0 conn(0x7fde9c0a6ab0 legacy=0x7fde9c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 1 -- 172.21.15.181:0/3879766214 >> v1:172.21.15.181:6789/0 conn(0x7fde9c13f9a0 legacy=0x7fde9c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 1 monclient: found mon.noname-e 2024-09-13T10:37:06.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:06.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:37:06.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 1 -- 172.21.15.181:0/3879766214 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c1464e0 con 0x7fde9c0a66d0 2024-09-13T10:37:06.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:37:06.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:37:06.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:06.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 1 -- 172.21.15.181:0/3879766214 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde8c001ad0 con 0x7fde9c0a66d0 2024-09-13T10:37:06.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fdea1660640 5 monclient: authenticate success, global_id 105065 2024-09-13T10:37:06.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fdea1660640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:06.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:06.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 10 monclient: dump: 2024-09-13T10:37:06.942 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.943 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fdea1660640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 1 -- 172.21.15.181:0/3879766214 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde8c0048a0 con 0x7fde9c0a66d0 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fdea1660640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 1 -- 172.21.15.181:0/3879766214 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde8c004dd0 con 0x7fde9c0a66d0 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fdea1660640 4 set_mon_vals no callback set 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fde9a7fc640 10 monclient: dump: 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.944 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.945 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fdea1660640 10 monclient: shutdown 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fdea1660640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fdea1660640 1 -- 172.21.15.181:0/3879766214 >> v1:172.21.15.181:6793/0 conn(0x7fde9c0a66d0 legacy=0x7fde9c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fdea1660640 1 -- 172.21.15.181:0/3879766214 shutdown_connections 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fdea1660640 1 -- 172.21.15.181:0/3879766214 >> 172.21.15.181:0/3879766214 conn(0x7fde9c0abcd0 msgr2=0x7fde9c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fdea1660640 1 -- 172.21.15.181:0/3879766214 shutdown_connections 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.935+0000 7fdea1660640 1 -- 172.21.15.181:0/3879766214 wait complete. 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.936+0000 7fdea1660640 10 monclient: build_initial_monmap 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.936+0000 7fdea1660640 10 monclient: monmap: 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:06.946 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.936+0000 7fdea1660640 1 Processor -- start 2024-09-13T10:37:06.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.936+0000 7fdea1660640 1 -- start start 2024-09-13T10:37:06.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.936+0000 7fdea1660640 10 monclient: init 2024-09-13T10:37:06.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fdea1660640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:06.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fdea1660640 10 monclient: _add_conns ranks=[4,2,3,8,0,7,6,5,1] 2024-09-13T10:37:06.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fdea1660640 10 monclient(hunting): picked mon.noname-c con 0x7fde9c0a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:06.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fdea1660640 10 monclient(hunting): picked mon.noname-b con 0x7fde9c0a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:06.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fdea1660640 10 monclient(hunting): picked mon.noname-g con 0x7fde9c13f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:06.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fdea1660640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde9c13f090 con 0x7fde9c0a6ab0 2024-09-13T10:37:06.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fdea1660640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde9c13c130 con 0x7fde9c13f9a0 2024-09-13T10:37:06.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fdea1660640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde9c139050 con 0x7fde9c0a66d0 2024-09-13T10:37:06.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fdea1660640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:06.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fdea1660640 10 monclient(hunting): authenticate will time out at 1166.442321s 2024-09-13T10:37:06.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fde9affd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fde9c0a66d0 0x7fde9c13b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51326/0 (socket says 172.21.15.181:51326) 2024-09-13T10:37:06.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fde93fff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fde9c0a6ab0 0x7fde9c13ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55864/0 (socket says 172.21.15.181:55864) 2024-09-13T10:37:06.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.937+0000 7fde9affd640 1 -- 172.21.15.181:0/1790766445 learned_addr learned my addr 172.21.15.181:0/1790766445 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:06.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde9affd640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.181:6791/0 conn(0x7fde9c0a66d0 legacy=0x7fde9c13b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde93fff640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.181:6790/0 conn(0x7fde9c0a6ab0 legacy=0x7fde9c13ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde9b7fe640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.195:6790/0 conn(0x7fde9c13f9a0 legacy=0x7fde9c1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4075666917 0 0) 0x7fde9c139050 con 0x7fde9c0a66d0 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): my global_id is 114700 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde7c003520 con 0x7fde9c0a66d0 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346004007 0 0) 0x7fde9c13f090 con 0x7fde9c0a6ab0 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): my global_id is 124193 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde9c139050 con 0x7fde9c0a6ab0 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207242155 0 0) 0x7fde9c13c130 con 0x7fde9c13f9a0 2024-09-13T10:37:06.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): my global_id is 6735 2024-09-13T10:37:06.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde9c13f090 con 0x7fde9c13f9a0 2024-09-13T10:37:06.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3719072843 0 0) 0x7fde7c003520 con 0x7fde9c0a66d0 2024-09-13T10:37:06.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde9c13c130 con 0x7fde9c0a66d0 2024-09-13T10:37:06.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde8c004d90 con 0x7fde9c0a66d0 2024-09-13T10:37:06.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): dump: 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.957 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.939+0000 7fde937fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2042332260 0 0) 0x7fde9c139050 con 0x7fde9c0a6ab0 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde7c003520 con 0x7fde9c0a6ab0 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 747237877 0 0) 0x7fde9c13f090 con 0x7fde9c13f9a0 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde9c139050 con 0x7fde9c13f9a0 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde84001d10 con 0x7fde9c0a6ab0 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:06.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient(hunting): dump: 2024-09-13T10:37:06.959 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.959 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.959 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.959 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.959 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.959 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.959 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.959 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.959 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.959 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.959 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde940020b0 con 0x7fde9c13f9a0 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient(hunting): dump: 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.960 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2268166565 0 0) 0x7fde9c13c130 con 0x7fde9c0a66d0 2024-09-13T10:37:06.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.195:6790/0 conn(0x7fde9c13f9a0 legacy=0x7fde9c1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.181:6790/0 conn(0x7fde9c0a6ab0 legacy=0x7fde9c13ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:06.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 monclient: found mon.c 2024-09-13T10:37:06.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:06.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:06.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c13e220 con 0x7fde9c0a66d0 2024-09-13T10:37:06.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:06.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:06.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:06.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fdea1660640 5 monclient: authenticate success, global_id 114700 2024-09-13T10:37:06.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fdea1660640 10 monclient: _renew_subs 2024-09-13T10:37:06.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fdea1660640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fdea1660640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fde9c13edb0 con 0x7fde9c0a66d0 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fdea1660640 10 monclient: _renew_subs 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fdea1660640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fdea1660640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fde9c13f770 con 0x7fde9c0a66d0 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde8c001d20 con 0x7fde9c0a66d0 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde8c005700 con 0x7fde9c0a66d0 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde99ffb640 4 set_mon_vals no callback set 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.940+0000 7fde937fe640 10 monclient: dump: 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.963 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.964 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.941+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fde8c011d80 con 0x7fde9c0a66d0 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.941+0000 7fdea1660640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.941+0000 7fdea1660640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fde800065c0 con 0x7fde80002860 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.941+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(227..227 src has 1..227) ==== 3898+0+0 (unknown 728256338 0 0) 0x7fde8c04e4c0 con 0x7fde9c0a66d0 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.941+0000 7fde9b7fe640 10 monclient: get_auth_request con 0x7fde7c040780 auth_method 0 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde93fff640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.195:6792/0 conn(0x7fde80002860 legacy=0x7fde80004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 220375689 0 0) 0x7fde800065c0 con 0x7fde80002860 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde937fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde937fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde937fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde937fe640 10 monclient(hunting): my global_id is 56896 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde9c13c130 con 0x7fde80002860 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 34441086 0 0) 0x7fde9c13c130 con 0x7fde80002860 2024-09-13T10:37:06.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde800065c0 con 0x7fde80002860 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde84003d10 con 0x7fde80002860 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde937fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.943+0000 7fde937fe640 10 monclient: dump: 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.966 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.944+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2170206710 0 0) 0x7fde800065c0 con 0x7fde80002860 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.944+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde8000a160 con 0x7fde80002860 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.944+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fde84003fc0 con 0x7fde80002860 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.944+0000 7fde937fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.944+0000 7fde937fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.944+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.195:6792/0 conn(0x7fde80002860 legacy=0x7fde80004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.944+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.195:6792/0 conn(0x7fde80002860 legacy=0x7fde80004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:06.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.950+0000 7fdea1660640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:06.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.950+0000 7fdea1660640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fde80009e70 con 0x7fde80009130 2024-09-13T10:37:06.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.952+0000 7fde93fff640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.195:6792/0 conn(0x7fde80009130 legacy=0x7fde800095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:06.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 213550805 0 0) 0x7fde80009e70 con 0x7fde80009130 2024-09-13T10:37:06.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:06.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 10 monclient(hunting): my global_id is 56905 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde800065c0 con 0x7fde80009130 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1807104018 0 0) 0x7fde800065c0 con 0x7fde80009130 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde80009e70 con 0x7fde80009130 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde840043e0 con 0x7fde80009130 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 10 monclient: dump: 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.970 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1606763503 0 0) 0x7fde80009e70 con 0x7fde80009130 2024-09-13T10:37:06.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fde8000c410 con 0x7fde80009130 2024-09-13T10:37:06.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 929022232) 0x7fde84005b70 con 0x7fde80009130 2024-09-13T10:37:06.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:06.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:06.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.195:6792/0 conn(0x7fde80009130 legacy=0x7fde800095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.953+0000 7fde937fe640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.195:6792/0 conn(0x7fde80009130 legacy=0x7fde800095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:06.972 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 110, 2024-09-13T10:37:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 441373, 2024-09-13T10:37:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:06.993 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:06.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.954+0000 7fdea1660640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.195:6800/1839191919 conn(0x7fde7c040780 legacy=0x7fde7c042c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.954+0000 7fdea1660640 10 monclient: shutdown 2024-09-13T10:37:06.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.954+0000 7fdea1660640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:06.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.954+0000 7fdea1660640 1 -- 172.21.15.181:0/1790766445 >> v1:172.21.15.181:6791/0 conn(0x7fde9c0a66d0 legacy=0x7fde9c13b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:06.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.954+0000 7fde9b7fe640 1 -- 172.21.15.181:0/1790766445 reap_dead start 2024-09-13T10:37:06.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.954+0000 7fde9b7fe640 1 -- 172.21.15.181:0/1790766445 reap_dead start 2024-09-13T10:37:06.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.954+0000 7fdea1660640 1 -- 172.21.15.181:0/1790766445 shutdown_connections 2024-09-13T10:37:06.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.954+0000 7fdea1660640 1 -- 172.21.15.181:0/1790766445 >> 172.21.15.181:0/1790766445 conn(0x7fde9c0abcd0 msgr2=0x7fde9c0a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:06.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.954+0000 7fdea1660640 1 -- 172.21.15.181:0/1790766445 shutdown_connections 2024-09-13T10:37:06.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:06.954+0000 7fdea1660640 1 -- 172.21.15.181:0/1790766445 wait complete. 2024-09-13T10:37:06.995 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:06.995 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['g', 'd', 'f', 'b'] 2024-09-13T10:37:06.995 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-13T10:37:06.996 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2024-09-13T10:37:06.996 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-09-13T10:37:06.996 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-09-13T10:37:06.996 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:37:07.010 INFO:tasks.ceph.mon.g:Stopped 2024-09-13T10:37:07.010 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-09-13T10:37:07.010 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-09-13T10:37:07.010 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-09-13T10:37:07.011 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:37:07.020 INFO:tasks.ceph.mon.d:Stopped 2024-09-13T10:37:07.020 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2024-09-13T10:37:07.020 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-09-13T10:37:07.021 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-09-13T10:37:07.021 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:37:07.064 INFO:tasks.ceph.mon.f:Stopped 2024-09-13T10:37:07.064 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-13T10:37:07.065 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-13T10:37:07.065 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T10:37:07.065 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:37:07.075 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T10:37:07.075 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2024-09-13T10:37:07.075 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:37:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.211+0000 7f3e3c3f8640 10 monclient: get_monmap_and_config 2024-09-13T10:37:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.211+0000 7f3e3c3f8640 10 monclient: build_initial_monmap 2024-09-13T10:37:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.211+0000 7f3e3c3f8640 10 monclient: monmap: 2024-09-13T10:37:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:07.213 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:07.212248+0000 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:07.212248+0000 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:07.214 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:07.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 1 Processor -- start 2024-09-13T10:37:07.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 1 -- start start 2024-09-13T10:37:07.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 10 monclient: init 2024-09-13T10:37:07.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:07.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 10 monclient: _add_conns ranks=[4,1,8,3,7,2,6,0,5] 2024-09-13T10:37:07.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 10 monclient(hunting): picked mon.noname-c con 0x7f3e340a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:07.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 10 monclient(hunting): picked mon.noname-f con 0x7f3e340a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:07.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 10 monclient(hunting): picked mon.noname-e con 0x7f3e3413f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:07.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e340a4bc0 con 0x7f3e340a8340 2024-09-13T10:37:07.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e3413a320 con 0x7f3e340a6640 2024-09-13T10:37:07.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e340a8100 con 0x7f3e3413f750 2024-09-13T10:37:07.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:07.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.212+0000 7f3e3c3f8640 10 monclient(hunting): authenticate will time out at 1166.717938s 2024-09-13T10:37:07.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.213+0000 7f3e3a995640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f3e3413f750 0x7f3e34141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:33250/0 (socket says 172.21.15.181:33250) 2024-09-13T10:37:07.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.213+0000 7f3e3a995640 1 -- 172.21.15.181:0/4145623367 learned_addr learned my addr 172.21.15.181:0/4145623367 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:07.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.213+0000 7f3e39993640 1 -- 172.21.15.181:0/4145623367 >> v1:172.21.15.195:6789/0 conn(0x7f3e340a8340 legacy=0x7f3e34139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2024-09-13T10:37:07.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.213+0000 7f3e3a194640 1 --1- 172.21.15.181:0/4145623367 >> v1:172.21.15.181:6791/0 conn(0x7f3e340a6640 0x7f3e34139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51340/0 (socket says 172.21.15.181:51340) 2024-09-13T10:37:07.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e3a995640 1 -- 172.21.15.181:0/4145623367 >> v1:172.21.15.181:6793/0 conn(0x7f3e3413f750 legacy=0x7f3e34141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:07.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e3a194640 1 -- 172.21.15.181:0/4145623367 >> v1:172.21.15.181:6791/0 conn(0x7f3e340a6640 legacy=0x7f3e34139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 1 -- 172.21.15.181:0/4145623367 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 801380357 0 0) 0x7f3e3413a320 con 0x7f3e340a6640 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient(hunting): _negotiate 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient(hunting): my global_id is 114709 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 1 -- 172.21.15.181:0/4145623367 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e20003520 con 0x7f3e340a6640 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 1 -- 172.21.15.181:0/4145623367 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546696969 0 0) 0x7f3e340a8100 con 0x7f3e3413f750 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient(hunting): _negotiate 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient(hunting): my global_id is 105074 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 1 -- 172.21.15.181:0/4145623367 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e3413a320 con 0x7f3e3413f750 2024-09-13T10:37:07.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 1 -- 172.21.15.181:0/4145623367 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 439137425 0 0) 0x7f3e20003520 con 0x7f3e340a6640 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 1 -- 172.21.15.181:0/4145623367 >> v1:172.21.15.181:6793/0 conn(0x7f3e3413f750 legacy=0x7f3e34141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 1 -- 172.21.15.181:0/4145623367 >> v1:172.21.15.195:6789/0 conn(0x7f3e340a8340 legacy=0x7f3e34139c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient: _finish_hunting 0 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 1 monclient: found mon.noname-c 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 1 -- 172.21.15.181:0/4145623367 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e340a48e0 con 0x7f3e340a6640 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient: _finish_auth 0 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient: _check_auth_tickets 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 1 -- 172.21.15.181:0/4145623367 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e30001ae0 con 0x7f3e340a6640 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e3c3f8640 5 monclient: authenticate success, global_id 114709 2024-09-13T10:37:07.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e3c3f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient: dump: 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:07.223 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e3c3f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 1 -- 172.21.15.181:0/4145623367 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e300047e0 con 0x7f3e340a6640 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e3c3f8640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 1 -- 172.21.15.181:0/4145623367 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e30004d50 con 0x7f3e340a6640 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:07.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e3c3f8640 4 set_mon_vals no callback set 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.215+0000 7f3e39192640 10 monclient: dump: 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:07.225 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.216+0000 7f3e3c3f8640 10 monclient: shutdown 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.216+0000 7f3e3c3f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.216+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/4145623367 >> v1:172.21.15.181:6791/0 conn(0x7f3e340a6640 legacy=0x7f3e34139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.216+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/4145623367 shutdown_connections 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.216+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/4145623367 >> 172.21.15.181:0/4145623367 conn(0x7f3e34077170 msgr2=0x7f3e340abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.216+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/4145623367 shutdown_connections 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.216+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/4145623367 wait complete. 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.216+0000 7f3e3c3f8640 10 monclient: build_initial_monmap 2024-09-13T10:37:07.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.216+0000 7f3e3c3f8640 10 monclient: monmap: 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:07.227 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:07.228 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:07.228 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:07.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 1 Processor -- start 2024-09-13T10:37:07.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 1 -- start start 2024-09-13T10:37:07.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 10 monclient: init 2024-09-13T10:37:07.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:07.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 10 monclient: _add_conns ranks=[4,6,5,7,0,3,2,8,1] 2024-09-13T10:37:07.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 10 monclient(hunting): picked mon.noname-c con 0x7f3e340a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:07.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 10 monclient(hunting): picked mon.noname-d con 0x7f3e3413f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:07.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 10 monclient(hunting): picked mon.noname-h con 0x7f3e341d4730 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:07.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e3409f1a0 con 0x7f3e340a8340 2024-09-13T10:37:07.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e39993640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f3e3413f750 legacy=0x7f3e34138c00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:07.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e34139310 con 0x7f3e341d4730 2024-09-13T10:37:07.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e340a9bb0 con 0x7f3e3413f750 2024-09-13T10:37:07.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:07.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3c3f8640 10 monclient(hunting): authenticate will time out at 1166.722761s 2024-09-13T10:37:07.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3a194640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f3e340a8340 0x7f3e341384f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51342/0 (socket says 172.21.15.181:51342) 2024-09-13T10:37:07.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.217+0000 7f3e3a194640 1 -- 172.21.15.181:0/3456664709 learned_addr learned my addr 172.21.15.181:0/3456664709 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:07.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.219+0000 7f3e3a194640 1 -- 172.21.15.181:0/3456664709 >> v1:172.21.15.181:6791/0 conn(0x7f3e340a8340 legacy=0x7f3e341384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:07.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499449544 0 0) 0x7f3e3409f1a0 con 0x7f3e340a8340 2024-09-13T10:37:07.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:07.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:07.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:07.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient(hunting): my global_id is 114718 2024-09-13T10:37:07.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e18003520 con 0x7f3e340a8340 2024-09-13T10:37:07.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e3a995640 1 -- 172.21.15.181:0/3456664709 >> v1:172.21.15.195:6791/0 conn(0x7f3e341d4730 legacy=0x7f3e341d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:07.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2641253602 0 0) 0x7f3e18003520 con 0x7f3e340a8340 2024-09-13T10:37:07.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e3409f1a0 con 0x7f3e340a8340 2024-09-13T10:37:07.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e30004cd0 con 0x7f3e340a8340 2024-09-13T10:37:07.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient(hunting): dump: 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:07.233 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:07.234 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:07.234 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:07.234 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:07.234 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:07.234 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:07.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:07.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900843024 0 0) 0x7f3e34139310 con 0x7f3e341d4730 2024-09-13T10:37:07.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:07.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:07.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:07.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient(hunting): my global_id is 104837 2024-09-13T10:37:07.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e18003520 con 0x7f3e341d4730 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 180298889 0 0) 0x7f3e3409f1a0 con 0x7f3e340a8340 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 >> v1:172.21.15.181:6792/0 conn(0x7f3e3413f750 legacy=0x7f3e34138c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 >> v1:172.21.15.195:6791/0 conn(0x7f3e341d4730 legacy=0x7f3e341d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 monclient: found mon.c 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e34142d80 con 0x7f3e340a8340 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient: _finish_auth 0 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e3c3f8640 5 monclient: authenticate success, global_id 114718 2024-09-13T10:37:07.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e3c3f8640 10 monclient: _renew_subs 2024-09-13T10:37:07.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e3c3f8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:07.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/3456664709 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3e340a1500 con 0x7f3e340a8340 2024-09-13T10:37:07.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e3c3f8640 10 monclient: _renew_subs 2024-09-13T10:37:07.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e3c3f8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:07.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/3456664709 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f3e340a29e0 con 0x7f3e340a8340 2024-09-13T10:37:07.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e30001d30 con 0x7f3e340a8340 2024-09-13T10:37:07.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:07.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e30005680 con 0x7f3e340a8340 2024-09-13T10:37:07.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:07.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e38991640 4 set_mon_vals no callback set 2024-09-13T10:37:07.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:07.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.220+0000 7f3e2affd640 10 monclient: dump: 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:07.237 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.221+0000 7f3e3c3f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.221+0000 7f3e3c3f8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.221+0000 7f3e3c3f8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.221+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3e30011d00 con 0x7f3e340a8340 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.221+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/3456664709 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c005080 con 0x7f3e340a8340 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.222+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(227..227 src has 1..227) ==== 3898+0+0 (unknown 728256338 0 0) 0x7f3e3004e4f0 con 0x7f3e340a8340 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.222+0000 7f3e39993640 10 monclient: get_auth_request con 0x7f3e1803fa80 auth_method 0 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.226+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f3e30017920 con 0x7f3e340a8340 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.226+0000 7f3e2affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:07.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.226+0000 7f3e2affd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:07.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.466+0000 7f3e3c3f8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:37:07.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.466+0000 7f3e3c3f8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:07.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.466+0000 7f3e3c3f8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:07.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.466+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/3456664709 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3e1c005370 con 0x7f3e340a8340 2024-09-13T10:37:07.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.467+0000 7f3e2affd640 1 -- 172.21.15.181:0/3456664709 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 1286576393) 0x7f3e3001ba30 con 0x7f3e340a8340 2024-09-13T10:37:07.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.467+0000 7f3e2affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:07.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.467+0000 7f3e2affd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:07.469 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":110,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":5,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:37:07.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.469+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/3456664709 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3e1803fa80 legacy=0x7f3e18041f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:07.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.469+0000 7f3e3c3f8640 10 monclient: shutdown 2024-09-13T10:37:07.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.469+0000 7f3e3c3f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:07.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.469+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/3456664709 >> v1:172.21.15.181:6791/0 conn(0x7f3e340a8340 legacy=0x7f3e341384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:07.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.469+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/3456664709 shutdown_connections 2024-09-13T10:37:07.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.469+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/3456664709 >> 172.21.15.181:0/3456664709 conn(0x7f3e340a6640 msgr2=0x7f3e34141f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:07.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.469+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/3456664709 shutdown_connections 2024-09-13T10:37:07.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:07.469+0000 7f3e3c3f8640 1 -- 172.21.15.181:0/3456664709 wait complete. 2024-09-13T10:37:10.482 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:37:10.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.590+0000 7f8d61794640 10 monclient: get_monmap_and_config 2024-09-13T10:37:10.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.590+0000 7f8d61794640 10 monclient: build_initial_monmap 2024-09-13T10:37:10.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.590+0000 7f8d61794640 10 monclient: monmap: 2024-09-13T10:37:10.591 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:10.590766+0000 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:10.590766+0000 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:10.593 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:10.593 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:10.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.590+0000 7f8d61794640 1 Processor -- start 2024-09-13T10:37:10.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.590+0000 7f8d61794640 1 -- start start 2024-09-13T10:37:10.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.590+0000 7f8d61794640 10 monclient: init 2024-09-13T10:37:10.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d61794640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:10.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d61794640 10 monclient: _add_conns ranks=[4,6,7,0,1,8,5,2,3] 2024-09-13T10:37:10.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d61794640 10 monclient(hunting): picked mon.noname-c con 0x7f8d5c0a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:10.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d61794640 10 monclient(hunting): picked mon.noname-d con 0x7f8d5c0a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:10.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d61794640 10 monclient(hunting): picked mon.noname-i con 0x7f8d5c13f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:10.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d61794640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5c0a5fe0 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d61794640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5c0a8080 con 0x7f8d5c0a6ab0 2024-09-13T10:37:10.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d61794640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5c0a42c0 con 0x7f8d5c13f9a0 2024-09-13T10:37:10.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d61794640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:10.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d5a7fc640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f8d5c0a6ab0 legacy=0x7f8d5c0a6ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:10.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d61794640 10 monclient(hunting): authenticate will time out at 1170.096485s 2024-09-13T10:37:10.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d5affd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f8d5c0a66d0 0x7f8d5c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51356/0 (socket says 172.21.15.181:51356) 2024-09-13T10:37:10.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.591+0000 7f8d5affd640 1 -- 172.21.15.181:0/3724809777 learned_addr learned my addr 172.21.15.181:0/3724809777 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:10.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.593+0000 7f8d5affd640 1 -- 172.21.15.181:0/3724809777 >> v1:172.21.15.181:6791/0 conn(0x7f8d5c0a66d0 legacy=0x7f8d5c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:10.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d5b7fe640 1 -- 172.21.15.181:0/3724809777 >> v1:172.21.15.195:6792/0 conn(0x7f8d5c13f9a0 legacy=0x7f8d5c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:10.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 1 -- 172.21.15.181:0/3724809777 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1365739040 0 0) 0x7f8d5c0a5fe0 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient(hunting): my global_id is 114727 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 1 -- 172.21.15.181:0/3724809777 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d44003520 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 1 -- 172.21.15.181:0/3724809777 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561324636 0 0) 0x7f8d5c0a42c0 con 0x7f8d5c13f9a0 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient(hunting): my global_id is 56914 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 1 -- 172.21.15.181:0/3724809777 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d5c0a5fe0 con 0x7f8d5c13f9a0 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 1 -- 172.21.15.181:0/3724809777 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1239062708 0 0) 0x7f8d44003520 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 1 -- 172.21.15.181:0/3724809777 >> v1:172.21.15.195:6792/0 conn(0x7f8d5c13f9a0 legacy=0x7f8d5c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 1 -- 172.21.15.181:0/3724809777 >> v1:172.21.15.181:6792/0 conn(0x7f8d5c0a6ab0 legacy=0x7f8d5c0a6ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 1 monclient: found mon.noname-c 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 1 -- 172.21.15.181:0/3724809777 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c1464e0 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient: _finish_auth 0 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 1 -- 172.21.15.181:0/3724809777 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d4c001ad0 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d61794640 5 monclient: authenticate success, global_id 114727 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d61794640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:10.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient: dump: 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:10.602 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d61794640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 1 -- 172.21.15.181:0/3724809777 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d4c0048a0 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 1 -- 172.21.15.181:0/3724809777 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d4c004e10 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d61794640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d61794640 4 set_mon_vals no callback set 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d59ffb640 10 monclient: dump: 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:10.603 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:10.604 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.594+0000 7f8d61794640 10 monclient: shutdown 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.595+0000 7f8d61794640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.595+0000 7f8d61794640 1 -- 172.21.15.181:0/3724809777 >> v1:172.21.15.181:6791/0 conn(0x7f8d5c0a66d0 legacy=0x7f8d5c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.595+0000 7f8d61794640 1 -- 172.21.15.181:0/3724809777 shutdown_connections 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.595+0000 7f8d61794640 1 -- 172.21.15.181:0/3724809777 >> 172.21.15.181:0/3724809777 conn(0x7f8d5c0abcd0 msgr2=0x7f8d5c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.595+0000 7f8d61794640 1 -- 172.21.15.181:0/3724809777 shutdown_connections 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.595+0000 7f8d61794640 1 -- 172.21.15.181:0/3724809777 wait complete. 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.595+0000 7f8d61794640 10 monclient: build_initial_monmap 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.595+0000 7f8d61794640 10 monclient: monmap: 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:10.605 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:10.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 1 Processor -- start 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 1 -- start start 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 10 monclient: init 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 10 monclient: _add_conns ranks=[0,2,5,4,3,8,1,6,7] 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 10 monclient(hunting): picked mon.noname-a con 0x7f8d5c0a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 10 monclient(hunting): picked mon.noname-b con 0x7f8d5c0a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 10 monclient(hunting): picked mon.noname-h con 0x7f8d5c13f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5c13ed40 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d5a7fc640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f8d5c0a6ab0 legacy=0x7f8d5c13ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5c13c130 con 0x7f8d5c0a6ab0 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5c13e780 con 0x7f8d5c13f9a0 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:10.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d61794640 10 monclient(hunting): authenticate will time out at 1170.101814s 2024-09-13T10:37:10.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d5affd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8d5c0a66d0 0x7f8d5c13b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53506/0 (socket says 172.21.15.181:53506) 2024-09-13T10:37:10.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.596+0000 7f8d5affd640 1 -- 172.21.15.181:0/1332411152 learned_addr learned my addr 172.21.15.181:0/1332411152 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:10.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d5affd640 1 -- 172.21.15.181:0/1332411152 >> v1:172.21.15.181:6789/0 conn(0x7f8d5c0a66d0 legacy=0x7f8d5c13b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:10.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1605073046 0 0) 0x7f8d5c1464e0 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:10.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:10.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:10.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient(hunting): my global_id is 114633 2024-09-13T10:37:10.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d48003520 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d5b7fe640 1 -- 172.21.15.181:0/1332411152 >> v1:172.21.15.195:6791/0 conn(0x7f8d5c13f9a0 legacy=0x7f8d5c1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:10.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1753722404 0 0) 0x7f8d5c13e780 con 0x7f8d5c13f9a0 2024-09-13T10:37:10.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:10.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:10.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:10.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient(hunting): my global_id is 104846 2024-09-13T10:37:10.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d5c1464e0 con 0x7f8d5c13f9a0 2024-09-13T10:37:10.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4186277813 0 0) 0x7f8d48003520 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d5c13e780 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d4c004d90 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:10.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:10.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient(hunting): dump: 2024-09-13T10:37:10.612 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:10.612 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:10.612 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:10.612 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:10.612 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:10.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2570468034 0 0) 0x7f8d5c13e780 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 >> v1:172.21.15.195:6791/0 conn(0x7f8d5c13f9a0 legacy=0x7f8d5c1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 >> v1:172.21.15.181:6790/0 conn(0x7f8d5c0a6ab0 legacy=0x7f8d5c13ba20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 monclient: found mon.a 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c13ea60 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d61794640 5 monclient: authenticate success, global_id 114633 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d61794640 10 monclient: _renew_subs 2024-09-13T10:37:10.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d61794640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:10.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d61794640 1 -- 172.21.15.181:0/1332411152 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5c1374e0 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d61794640 10 monclient: _renew_subs 2024-09-13T10:37:10.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d61794640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:10.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d61794640 1 -- 172.21.15.181:0/1332411152 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8d5c0a2940 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d5affd640 1 --1- 172.21.15.181:0/1332411152 >> v1:172.21.15.181:6789/0 conn(0x7f8d5c0a66d0 0x7f8d5c13b310 :-1 s=OPENED pgs=548 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f8d4c001d20 config(0 keys) 2024-09-13T10:37:10.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d4c001d20 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d437fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:10.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.599+0000 7f8d597fa640 4 set_mon_vals no callback set 2024-09-13T10:37:10.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.600+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d4c001af0 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.600+0000 7f8d437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:10.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.600+0000 7f8d437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:10.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.600+0000 7f8d437fe640 10 monclient: dump: 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:10.616 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:10.617 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:10.617 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:10.617 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:10.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.600+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f8d4c011c20 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.600+0000 7f8d61794640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:10.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.600+0000 7f8d61794640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:10.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.600+0000 7f8d61794640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:10.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.600+0000 7f8d61794640 1 -- 172.21.15.181:0/1332411152 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3c005080 con 0x7f8d5c0a66d0 2024-09-13T10:37:10.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.601+0000 7f8d5a7fc640 10 monclient: get_auth_request con 0x7f8d4803fb00 auth_method 0 2024-09-13T10:37:10.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:10.605+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(227..227 src has 1..227) ==== 3898+0+0 (unknown 728256338 0 0) 0x7f8d4c04e410 con 0x7f8d5c0a66d0 2024-09-13T10:37:11.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.427+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f8d5c13ed40 con 0x7f8d5c0a66d0 2024-09-13T10:37:11.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.427+0000 7f8d437fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:11.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.427+0000 7f8d437fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:11.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.671+0000 7f8d61794640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:37:11.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.671+0000 7f8d61794640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:11.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.671+0000 7f8d61794640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:11.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.671+0000 7f8d61794640 1 -- 172.21.15.181:0/1332411152 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8d3c005370 con 0x7f8d5c0a66d0 2024-09-13T10:37:11.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.671+0000 7f8d437fe640 1 -- 172.21.15.181:0/1332411152 <== mon.0 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 733566776) 0x7f8d4c017900 con 0x7f8d5c0a66d0 2024-09-13T10:37:11.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.671+0000 7f8d437fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:11.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.671+0000 7f8d437fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:11.674 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":110,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"g","quorum_age":9,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:37:11.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.673+0000 7f8d61794640 1 -- 172.21.15.181:0/1332411152 >> v1:172.21.15.195:6800/1839191919 conn(0x7f8d4803fb00 legacy=0x7f8d48041fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:11.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.673+0000 7f8d61794640 10 monclient: shutdown 2024-09-13T10:37:11.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.673+0000 7f8d61794640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:11.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.673+0000 7f8d61794640 1 -- 172.21.15.181:0/1332411152 >> v1:172.21.15.181:6789/0 conn(0x7f8d5c0a66d0 legacy=0x7f8d5c13b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:11.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.673+0000 7f8d61794640 1 -- 172.21.15.181:0/1332411152 shutdown_connections 2024-09-13T10:37:11.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.673+0000 7f8d61794640 1 -- 172.21.15.181:0/1332411152 >> 172.21.15.181:0/1332411152 conn(0x7f8d5c0abcd0 msgr2=0x7f8d5c0a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:11.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.673+0000 7f8d61794640 1 -- 172.21.15.181:0/1332411152 shutdown_connections 2024-09-13T10:37:11.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:11.673+0000 7f8d61794640 1 -- 172.21.15.181:0/1332411152 wait complete. 2024-09-13T10:37:14.687 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:37:14.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.794+0000 7f03d5eb6640 10 monclient: get_monmap_and_config 2024-09-13T10:37:14.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.794+0000 7f03d5eb6640 10 monclient: build_initial_monmap 2024-09-13T10:37:14.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.794+0000 7f03d5eb6640 10 monclient: monmap: 2024-09-13T10:37:14.796 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:14.796 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:14.796 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:14.794911+0000 2024-09-13T10:37:14.796 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:14.794911+0000 2024-09-13T10:37:14.796 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:14.796 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:14.796 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:14.796 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:14.796 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:14.796 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:14.796 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:14.797 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:14.797 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:14.797 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:14.797 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:14.797 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:14.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 1 Processor -- start 2024-09-13T10:37:14.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 1 -- start start 2024-09-13T10:37:14.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 10 monclient: init 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 10 monclient: _add_conns ranks=[0,3,8,4,1,6,7,2,5] 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 10 monclient(hunting): picked mon.noname-a con 0x7f03d00a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 10 monclient(hunting): picked mon.noname-g con 0x7f03d00a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 10 monclient(hunting): picked mon.noname-e con 0x7f03d013f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d00a5fe0 con 0x7f03d00a66d0 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d00a8080 con 0x7f03d00a6ab0 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d00a42c0 con 0x7f03d013f9a0 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03d5eb6640 10 monclient(hunting): authenticate will time out at 1174.300816s 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03cf7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f03d00a66d0 0x7f03d00a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:60550/0 (socket says 172.21.15.181:60550) 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03cf7fe640 1 -- 172.21.15.181:0/1692519398 learned_addr learned my addr 172.21.15.181:0/1692519398 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:14.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03ceffd640 1 -- >> v1:172.21.15.195:6790/0 conn(0x7f03d00a6ab0 legacy=0x7f03d00a6ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:37:14.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.795+0000 7f03cffff640 1 --1- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6793/0 conn(0x7f03d013f9a0 0x7f03d0141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:38282/0 (socket says 172.21.15.181:38282) 2024-09-13T10:37:14.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.798+0000 7f03cf7fe640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6789/0 conn(0x7f03d00a66d0 legacy=0x7f03d00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:14.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.798+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6793/0 conn(0x7f03d013f9a0 legacy=0x7f03d0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:14.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:14.996+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6790/0 conn(0x7f03d00a6ab0 legacy=0x7f03d00a6ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:37:15.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:15.398+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6790/0 conn(0x7f03d00a6ab0 legacy=0x7f03d00a6ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:37:16.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:16.199+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6790/0 conn(0x7f03d00a6ab0 legacy=0x7f03d00a6ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:37:17.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.795+0000 7f03cd7fa640 10 monclient(hunting): tick 2024-09-13T10:37:17.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.795+0000 7f03cd7fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:37:17.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.795+0000 7f03cd7fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:37:17.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.795+0000 7f03cd7fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:37:17.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.795+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6793/0 conn(0x7f03d013f9a0 legacy=0x7f03d0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:17.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.795+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6790/0 conn(0x7f03d00a6ab0 legacy=0x7f03d00a6ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:17.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.795+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6789/0 conn(0x7f03d00a66d0 legacy=0x7f03d00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:17.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.796+0000 7f03cd7fa640 10 monclient: _add_conns ranks=[4,5,7,6,1,2] 2024-09-13T10:37:17.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.796+0000 7f03cd7fa640 10 monclient(hunting): picked mon.noname-c con 0x7f03bc0038c0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:17.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.796+0000 7f03cd7fa640 10 monclient(hunting): picked mon.noname-h con 0x7f03bc007530 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:17.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.796+0000 7f03cd7fa640 10 monclient(hunting): picked mon.noname-i con 0x7f03bc00b2a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:17.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d01464e0 con 0x7f03bc0038c0 2024-09-13T10:37:17.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d00a8080 con 0x7f03bc007530 2024-09-13T10:37:17.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc011110 con 0x7f03bc00b2a0 2024-09-13T10:37:17.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.796+0000 7f03cd7fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:17.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.798+0000 7f03cf7fe640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6791/0 conn(0x7f03bc0038c0 legacy=0x7f03bc005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:17.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.798+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6792/0 conn(0x7f03bc00b2a0 legacy=0x7f03bc00d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:17.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:17.798+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6791/0 conn(0x7f03bc007530 legacy=0x7f03bc0099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:20.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 10 monclient(hunting): tick 2024-09-13T10:37:20.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:37:20.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:37:20.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:37:20.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6792/0 conn(0x7f03bc00b2a0 legacy=0x7f03bc00d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:20.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6791/0 conn(0x7f03bc007530 legacy=0x7f03bc0099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:20.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6791/0 conn(0x7f03bc0038c0 legacy=0x7f03bc005cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 10 monclient: _add_conns ranks=[2,6,1] 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 reap_dead start 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 10 monclient(hunting): picked mon.noname-b con 0x7f03bc011660 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 reap_dead start 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 10 monclient(hunting): picked mon.noname-d con 0x7f03bc00df30 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 10 monclient(hunting): picked mon.noname-f con 0x7f03bc00e3b0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc0123b0 con 0x7f03bc00e3b0 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc00e930 con 0x7f03bc011660 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc00eba0 con 0x7f03bc00df30 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cd7fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cf7fe640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6790/0 conn(0x7f03bc011660 legacy=0x7f03bc011a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6792/0 conn(0x7f03bc00df30 legacy=0x7f03bc0099d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:20.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.796+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6789/0 conn(0x7f03bc00e3b0 legacy=0x7f03bc005cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2024-09-13T10:37:20.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.998+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6792/0 conn(0x7f03bc00df30 legacy=0x7f03bc0099d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:20.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.998+0000 7f03cf7fe640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6790/0 conn(0x7f03bc011660 legacy=0x7f03bc011a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:37:20.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:20.998+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6789/0 conn(0x7f03bc00e3b0 legacy=0x7f03bc005cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2024-09-13T10:37:21.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:21.399+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6792/0 conn(0x7f03bc00df30 legacy=0x7f03bc0099d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:21.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:21.399+0000 7f03cf7fe640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6790/0 conn(0x7f03bc011660 legacy=0x7f03bc011a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:37:21.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:21.399+0000 7f03ce7fc640 1 -- 172.21.15.181:0/1692519398 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:37:21.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:21.399+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6789/0 conn(0x7f03bc00e3b0 legacy=0x7f03bc005cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2024-09-13T10:37:22.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:22.200+0000 7f03cf7fe640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6790/0 conn(0x7f03bc011660 legacy=0x7f03bc011a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:37:22.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:22.200+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6792/0 conn(0x7f03bc00df30 legacy=0x7f03bc0099d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:22.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:22.200+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6789/0 conn(0x7f03bc00e3b0 legacy=0x7f03bc005cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2024-09-13T10:37:23.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 10 monclient(hunting): tick 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6792/0 conn(0x7f03bc00df30 legacy=0x7f03bc0099d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6790/0 conn(0x7f03bc011660 legacy=0x7f03bc011a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6789/0 conn(0x7f03bc00e3b0 legacy=0x7f03bc005cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 10 monclient: _add_conns ranks=[3,2,6,1,0,7,4,5,8] 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 10 monclient(hunting): picked mon.noname-g con 0x7f03bc00d9e0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 10 monclient(hunting): picked mon.noname-b con 0x7f03bc011660 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 10 monclient(hunting): picked mon.noname-d con 0x7f03bc00df30 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc00d770 con 0x7f03bc011660 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc0123b0 con 0x7f03bc00d9e0 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc00e930 con 0x7f03bc00df30 2024-09-13T10:37:23.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cd7fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:23.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6792/0 conn(0x7f03bc00df30 legacy=0x7f03bc0099d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:23.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6790/0 conn(0x7f03bc011660 legacy=0x7f03bc011a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:37:23.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.796+0000 7f03cf7fe640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6790/0 conn(0x7f03bc00d9e0 legacy=0x7f03bc00f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:37:23.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.997+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6790/0 conn(0x7f03bc011660 legacy=0x7f03bc011a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:37:23.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.997+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6792/0 conn(0x7f03bc00df30 legacy=0x7f03bc0099d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:23.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:23.998+0000 7f03cf7fe640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6790/0 conn(0x7f03bc00d9e0 legacy=0x7f03bc00f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:37:24.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:24.399+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6790/0 conn(0x7f03bc011660 legacy=0x7f03bc011a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:37:24.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:24.399+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6792/0 conn(0x7f03bc00df30 legacy=0x7f03bc0099d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:24.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:24.400+0000 7f03cf7fe640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6790/0 conn(0x7f03bc00d9e0 legacy=0x7f03bc00f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:37:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:25.201+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6790/0 conn(0x7f03bc011660 legacy=0x7f03bc011a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:37:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:25.201+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6792/0 conn(0x7f03bc00df30 legacy=0x7f03bc0099d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:25.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:25.201+0000 7f03cf7fe640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6790/0 conn(0x7f03bc00d9e0 legacy=0x7f03bc00f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:37:26.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.796+0000 7f03cd7fa640 10 monclient(hunting): tick 2024-09-13T10:37:26.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.796+0000 7f03cd7fa640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:37:26.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.796+0000 7f03cd7fa640 1 monclient(hunting): continuing hunt 2024-09-13T10:37:26.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.796+0000 7f03cd7fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:37:26.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.796+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6792/0 conn(0x7f03bc00df30 legacy=0x7f03bc0099d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:26.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.797+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6790/0 conn(0x7f03bc00d9e0 legacy=0x7f03bc00f010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:26.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.797+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6790/0 conn(0x7f03bc011660 legacy=0x7f03bc011a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:26.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.797+0000 7f03cd7fa640 10 monclient: _add_conns ranks=[7,1,4,0,8,5] 2024-09-13T10:37:26.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.797+0000 7f03cd7fa640 10 monclient(hunting): picked mon.noname-i con 0x7f03bc00f720 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.797+0000 7f03cd7fa640 10 monclient(hunting): picked mon.noname-f con 0x7f03bc00e3b0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.797+0000 7f03cd7fa640 10 monclient(hunting): picked mon.noname-c con 0x7f03bc00fb00 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.797+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc00eba0 con 0x7f03bc00e3b0 2024-09-13T10:37:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.797+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc00d770 con 0x7f03bc00fb00 2024-09-13T10:37:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.797+0000 7f03cd7fa640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc0123b0 con 0x7f03bc00f720 2024-09-13T10:37:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.797+0000 7f03cd7fa640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:26.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.797+0000 7f03ceffd640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6789/0 conn(0x7f03bc00e3b0 legacy=0x7f03bc005cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2024-09-13T10:37:26.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.799+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6791/0 conn(0x7f03bc00fb00 legacy=0x7f03bc01ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:26.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.799+0000 7f03cf7fe640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6792/0 conn(0x7f03bc00f720 legacy=0x7f03bc017710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:26.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 1 -- 172.21.15.181:0/1692519398 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213064046 0 0) 0x7f03bc00d770 con 0x7f03bc00fb00 2024-09-13T10:37:26.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:26.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:26.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:26.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 10 monclient(hunting): my global_id is 114736 2024-09-13T10:37:26.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b8003520 con 0x7f03bc00fb00 2024-09-13T10:37:26.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 1 -- 172.21.15.181:0/1692519398 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4010028290 0 0) 0x7f03b8003520 con 0x7f03bc00fb00 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6792/0 conn(0x7f03bc00f720 legacy=0x7f03bc017710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.195:6789/0 conn(0x7f03bc00e3b0 legacy=0x7f03bc005cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 1 monclient: found mon.noname-c 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 1 -- 172.21.15.181:0/1692519398 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03bc00e930 con 0x7f03bc00fb00 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 10 monclient: _finish_auth 0 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 1 -- 172.21.15.181:0/1692519398 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03c8001ca0 con 0x7f03bc00fb00 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03d5eb6640 5 monclient: authenticate success, global_id 114736 2024-09-13T10:37:26.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03d5eb6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03cffff640 1 -- 172.21.15.181:0/1692519398 reap_dead start 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.806+0000 7f03ce7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.807+0000 7f03ce7fc640 10 monclient: dump: 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:26.811 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:26.812 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.807+0000 7f03d5eb6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.807+0000 7f03ce7fc640 1 -- 172.21.15.181:0/1692519398 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03c8001f40 con 0x7f03bc00fb00 2024-09-13T10:37:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.807+0000 7f03ce7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.807+0000 7f03ce7fc640 1 -- 172.21.15.181:0/1692519398 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03c8004ea0 con 0x7f03bc00fb00 2024-09-13T10:37:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.807+0000 7f03ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:26.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.807+0000 7f03ce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.807+0000 7f03ce7fc640 10 monclient: dump: 2024-09-13T10:37:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:26.813 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:26.814 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.807+0000 7f03d5eb6640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.807+0000 7f03d5eb6640 4 set_mon_vals no callback set 2024-09-13T10:37:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.808+0000 7f03d5eb6640 10 monclient: shutdown 2024-09-13T10:37:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.808+0000 7f03d5eb6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.808+0000 7f03d5eb6640 1 -- 172.21.15.181:0/1692519398 >> v1:172.21.15.181:6791/0 conn(0x7f03bc00fb00 legacy=0x7f03bc01ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:26.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.808+0000 7f03d5eb6640 1 -- 172.21.15.181:0/1692519398 shutdown_connections 2024-09-13T10:37:26.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.808+0000 7f03d5eb6640 1 -- 172.21.15.181:0/1692519398 >> 172.21.15.181:0/1692519398 conn(0x7f03d00abcd0 msgr2=0x7f03d00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:26.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.808+0000 7f03d5eb6640 1 -- 172.21.15.181:0/1692519398 shutdown_connections 2024-09-13T10:37:26.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.808+0000 7f03d5eb6640 1 -- 172.21.15.181:0/1692519398 wait complete. 2024-09-13T10:37:26.816 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.809+0000 7f03d5eb6640 10 monclient: build_initial_monmap 2024-09-13T10:37:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.809+0000 7f03d5eb6640 10 monclient: monmap: 2024-09-13T10:37:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:26.817 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.809+0000 7f03d5eb6640 1 Processor -- start 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03d5eb6640 1 -- start start 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03d5eb6640 10 monclient: init 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03d5eb6640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03d5eb6640 10 monclient: _add_conns ranks=[3,5,7,4,1,0,2,6,8] 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03d5eb6640 10 monclient(hunting): picked mon.noname-g con 0x7f03bc00fb00 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03d5eb6640 10 monclient(hunting): picked mon.noname-h con 0x7f03d009fb30 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:26.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03d5eb6640 10 monclient(hunting): picked mon.noname-i con 0x7f03d0136e40 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03d5eb6640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d009ff30 con 0x7f03bc00fb00 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03d5eb6640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d00a2610 con 0x7f03d009fb30 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03cf7fe640 1 -- >> v1:172.21.15.195:6790/0 conn(0x7f03bc00fb00 legacy=0x7f03d0136730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03d5eb6640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d01381f0 con 0x7f03d0136e40 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03d5eb6640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03d5eb6640 10 monclient(hunting): authenticate will time out at 1186.315708s 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03ceffd640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f03d009fb30 0x7f03d01d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:57676/0 (socket says 172.21.15.181:57676) 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.810+0000 7f03ceffd640 1 -- 172.21.15.181:0/3775053829 learned_addr learned my addr 172.21.15.181:0/3775053829 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.813+0000 7f03ceffd640 1 -- 172.21.15.181:0/3775053829 >> v1:172.21.15.195:6791/0 conn(0x7f03d009fb30 legacy=0x7f03d01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.814+0000 7f03cffff640 1 -- 172.21.15.181:0/3775053829 >> v1:172.21.15.195:6792/0 conn(0x7f03d0136e40 legacy=0x7f03d01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.814+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4285598462 0 0) 0x7f03d01381f0 con 0x7f03d0136e40 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.814+0000 7f03b7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:26.819 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.814+0000 7f03b7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:26.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.814+0000 7f03b7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:26.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.814+0000 7f03b7fff640 10 monclient(hunting): my global_id is 56932 2024-09-13T10:37:26.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.814+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03bc00eba0 con 0x7f03d0136e40 2024-09-13T10:37:26.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557372733 0 0) 0x7f03d00a2610 con 0x7f03d009fb30 2024-09-13T10:37:26.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:26.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:26.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:26.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 10 monclient(hunting): my global_id is 104855 2024-09-13T10:37:26.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03d01381f0 con 0x7f03d009fb30 2024-09-13T10:37:26.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 959662636 0 0) 0x7f03bc00eba0 con 0x7f03d0136e40 2024-09-13T10:37:26.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03d00a2610 con 0x7f03d0136e40 2024-09-13T10:37:26.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03c8004ea0 con 0x7f03d0136e40 2024-09-13T10:37:26.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:26.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 10 monclient(hunting): dump: 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:26.824 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:26.825 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:26.825 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:26.825 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:26.825 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:26.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:26.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1419746266 0 0) 0x7f03d01381f0 con 0x7f03d009fb30 2024-09-13T10:37:26.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03bc00eba0 con 0x7f03d009fb30 2024-09-13T10:37:26.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03c40047c0 con 0x7f03d009fb30 2024-09-13T10:37:26.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:26.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:26.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.817+0000 7f03b7fff640 10 monclient(hunting): dump: 2024-09-13T10:37:26.825 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 99003539 0 0) 0x7f03bc00eba0 con 0x7f03d009fb30 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 >> v1:172.21.15.195:6792/0 conn(0x7f03d0136e40 legacy=0x7f03d01d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 >> v1:172.21.15.195:6790/0 conn(0x7f03bc00fb00 legacy=0x7f03d0136730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 10 monclient: _finish_hunting 0 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 1 monclient: found mon.h 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d00a28f0 con 0x7f03d009fb30 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 10 monclient: _finish_auth 0 2024-09-13T10:37:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 10 monclient: _check_auth_tickets 2024-09-13T10:37:26.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:26.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03d5eb6640 5 monclient: authenticate success, global_id 104855 2024-09-13T10:37:26.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03d5eb6640 10 monclient: _renew_subs 2024-09-13T10:37:26.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03d5eb6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:26.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03d5eb6640 1 -- 172.21.15.181:0/3775053829 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f03d0137ca0 con 0x7f03d009fb30 2024-09-13T10:37:26.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03d5eb6640 10 monclient: _renew_subs 2024-09-13T10:37:26.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03d5eb6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:26.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03d5eb6640 1 -- 172.21.15.181:0/3775053829 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f03d00a15b0 con 0x7f03d009fb30 2024-09-13T10:37:26.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03c4004d40 con 0x7f03d009fb30 2024-09-13T10:37:26.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:26.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f03c4005270 con 0x7f03d009fb30 2024-09-13T10:37:26.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03cdffb640 4 set_mon_vals no callback set 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.818+0000 7f03b7fff640 10 monclient: dump: 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:26.829 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:26.830 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:26.830 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:26.830 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:26.830 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:26.830 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:26.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.819+0000 7f03d5eb6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:26.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.819+0000 7f03d5eb6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:26.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.819+0000 7f03d5eb6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:26.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.819+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f03c4005410 con 0x7f03d009fb30 2024-09-13T10:37:26.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.819+0000 7f03d5eb6640 1 -- 172.21.15.181:0/3775053829 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b0005080 con 0x7f03d009fb30 2024-09-13T10:37:26.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.819+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(227..227 src has 1..227) ==== 3898+0+0 (unknown 728256338 0 0) 0x7f03c404e520 con 0x7f03d009fb30 2024-09-13T10:37:26.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.819+0000 7f03cf7fe640 10 monclient: get_auth_request con 0x7f03bc042160 auth_method 0 2024-09-13T10:37:26.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.824+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.5 v1:172.21.15.195:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f03c40179b0 con 0x7f03d009fb30 2024-09-13T10:37:26.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.824+0000 7f03b7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:26.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:26.824+0000 7f03b7fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:26.975 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39233]: starting. 2024-09-13T10:37:26.975 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39233]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39232 2024-09-13T10:37:26.975 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39233]: created object 0... 2024-09-13T10:37:26.975 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39233]: created object 25... 2024-09-13T10:37:26.975 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39233]: created object 49... 2024-09-13T10:37:26.975 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39233]: finishing. 2024-09-13T10:37:26.975 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39233]: shutting down. 2024-09-13T10:37:27.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.089+0000 7f03d5eb6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:37:27.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.089+0000 7f03d5eb6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:27.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.089+0000 7f03d5eb6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:27.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.089+0000 7f03d5eb6640 1 -- 172.21.15.181:0/3775053829 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f03b0005370 con 0x7f03d009fb30 2024-09-13T10:37:27.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.090+0000 7f03b7fff640 1 -- 172.21.15.181:0/3775053829 <== mon.5 v1:172.21.15.195:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2721 (unknown 254746657 0 3019425958) 0x7f03c40172b0 con 0x7f03d009fb30 2024-09-13T10:37:27.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.090+0000 7f03b7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:27.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.090+0000 7f03b7fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:27.092 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":116,"quorum":[0,4,5,7,8],"quorum_names":["a","c","h","i","e"],"quorum_leader_name":"i","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:37:27.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.092+0000 7f03d5eb6640 1 -- 172.21.15.181:0/3775053829 >> v1:172.21.15.195:6800/1839191919 conn(0x7f03bc042160 legacy=0x7f03bc044620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.092+0000 7f03d5eb6640 10 monclient: shutdown 2024-09-13T10:37:27.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.092+0000 7f03d5eb6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:27.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.092+0000 7f03d5eb6640 1 -- 172.21.15.181:0/3775053829 >> v1:172.21.15.195:6791/0 conn(0x7f03d009fb30 legacy=0x7f03d01d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.092+0000 7f03d5eb6640 1 -- 172.21.15.181:0/3775053829 shutdown_connections 2024-09-13T10:37:27.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.092+0000 7f03d5eb6640 1 -- 172.21.15.181:0/3775053829 >> 172.21.15.181:0/3775053829 conn(0x7f03d00abcd0 msgr2=0x7f03d00a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:27.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.092+0000 7f03d5eb6640 1 -- 172.21.15.181:0/3775053829 shutdown_connections 2024-09-13T10:37:27.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.092+0000 7f03d5eb6640 1 -- 172.21.15.181:0/3775053829 wait complete. 2024-09-13T10:37:27.104 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2024-09-13T10:37:27.104 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon a 2024-09-13T10:37:27.105 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:37:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.201+0000 7f575b164640 10 monclient: get_monmap_and_config 2024-09-13T10:37:27.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.201+0000 7f575b164640 10 monclient: build_initial_monmap 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.201+0000 7f575b164640 10 monclient: monmap: 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:27.201950+0000 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:27.201950+0000 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:27.203 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:27.204 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:27.204 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 1 Processor -- start 2024-09-13T10:37:27.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 1 -- start start 2024-09-13T10:37:27.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 10 monclient: init 2024-09-13T10:37:27.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:27.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 10 monclient: _add_conns ranks=[3,6,4,5,8,7,0,1,2] 2024-09-13T10:37:27.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 10 monclient(hunting): picked mon.noname-g con 0x7f57540a6f30 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:27.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 10 monclient(hunting): picked mon.noname-d con 0x7f5754074360 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:27.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 10 monclient(hunting): picked mon.noname-c con 0x7f57541342c0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:27.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5754073980 con 0x7f57540a6f30 2024-09-13T10:37:27.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57540a7310 con 0x7f57541342c0 2024-09-13T10:37:27.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57540736a0 con 0x7f5754074360 2024-09-13T10:37:27.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:27.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f5753fff640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f5754074360 legacy=0x7f575413c100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:27.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f575b164640 10 monclient(hunting): authenticate will time out at 1186.707776s 2024-09-13T10:37:27.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f5758f00640 1 -- >> v1:172.21.15.195:6790/0 conn(0x7f57540a6f30 legacy=0x7f5754133bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:37:27.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f5759701640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f57541342c0 0x7f575413f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:44476/0 (socket says 172.21.15.181:44476) 2024-09-13T10:37:27.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.202+0000 7f5759701640 1 -- 172.21.15.181:0/816265467 learned_addr learned my addr 172.21.15.181:0/816265467 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:27.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f5759701640 1 -- 172.21.15.181:0/816265467 >> v1:172.21.15.181:6791/0 conn(0x7f57541342c0 legacy=0x7f575413f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 1 -- 172.21.15.181:0/816265467 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320751241 0 0) 0x7f57540a7310 con 0x7f57541342c0 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient(hunting): my global_id is 114745 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 1 -- 172.21.15.181:0/816265467 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5734003520 con 0x7f57541342c0 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 1 -- 172.21.15.181:0/816265467 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2799826890 0 0) 0x7f5734003520 con 0x7f57541342c0 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 1 -- 172.21.15.181:0/816265467 >> v1:172.21.15.181:6792/0 conn(0x7f5754074360 legacy=0x7f575413c100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 1 -- 172.21.15.181:0/816265467 >> v1:172.21.15.195:6790/0 conn(0x7f57540a6f30 legacy=0x7f5754133bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 1 monclient: found mon.noname-c 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:27.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 1 -- 172.21.15.181:0/816265467 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5754073c60 con 0x7f57541342c0 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 1 -- 172.21.15.181:0/816265467 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f574c001f20 con 0x7f57541342c0 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient: dump: 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.211 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f575b164640 5 monclient: authenticate success, global_id 114745 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f575b164640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:27.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 1 -- 172.21.15.181:0/816265467 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f574c004c20 con 0x7f57541342c0 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f575b164640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 1 -- 172.21.15.181:0/816265467 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f574c005190 con 0x7f57541342c0 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f575b164640 4 set_mon_vals no callback set 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.205+0000 7f57537fe640 10 monclient: dump: 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.213 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.206+0000 7f575b164640 10 monclient: shutdown 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.206+0000 7f575b164640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.206+0000 7f575b164640 1 -- 172.21.15.181:0/816265467 >> v1:172.21.15.181:6791/0 conn(0x7f57541342c0 legacy=0x7f575413f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.206+0000 7f575b164640 1 -- 172.21.15.181:0/816265467 shutdown_connections 2024-09-13T10:37:27.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.206+0000 7f575b164640 1 -- 172.21.15.181:0/816265467 >> 172.21.15.181:0/816265467 conn(0x7f57540aa310 msgr2=0x7f57540a6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.206+0000 7f575b164640 1 -- 172.21.15.181:0/816265467 shutdown_connections 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.206+0000 7f575b164640 1 -- 172.21.15.181:0/816265467 wait complete. 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.206+0000 7f575b164640 10 monclient: build_initial_monmap 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.206+0000 7f575b164640 10 monclient: monmap: 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:27.215 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.206+0000 7f575b164640 1 Processor -- start 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f575b164640 1 -- start start 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f575b164640 10 monclient: init 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f575b164640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f575b164640 10 monclient: _add_conns ranks=[5,4,8,3,2,1,6,7,0] 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f575b164640 10 monclient(hunting): picked mon.noname-h con 0x7f57540a6f30 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f575b164640 10 monclient(hunting): picked mon.noname-c con 0x7f57541342c0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f575b164640 10 monclient(hunting): picked mon.noname-e con 0x7f57541d1920 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:27.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f575b164640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f575409d650 con 0x7f57541342c0 2024-09-13T10:37:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f575b164640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f575409e890 con 0x7f57540a6f30 2024-09-13T10:37:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f575b164640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f575409eb70 con 0x7f57541d1920 2024-09-13T10:37:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f575b164640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f575b164640 10 monclient(hunting): authenticate will time out at 1186.712663s 2024-09-13T10:37:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f5753fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f57541342c0 0x7f57541cbca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:44490/0 (socket says 172.21.15.181:44490) 2024-09-13T10:37:27.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.207+0000 7f5753fff640 1 -- 172.21.15.181:0/4128687845 learned_addr learned my addr 172.21.15.181:0/4128687845 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:27.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.209+0000 7f5753fff640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.181:6791/0 conn(0x7f57541342c0 legacy=0x7f57541cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.209+0000 7f5759701640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.181:6793/0 conn(0x7f57541d1920 legacy=0x7f57541d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.209+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462722382 0 0) 0x7f575409d650 con 0x7f57541342c0 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.209+0000 7f57517fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.209+0000 7f57517fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.209+0000 7f57517fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.209+0000 7f57517fa640 10 monclient(hunting): my global_id is 114754 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.209+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5738003520 con 0x7f57541342c0 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332715590 0 0) 0x7f575409eb70 con 0x7f57541d1920 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): my global_id is 105083 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f575409d650 con 0x7f57541d1920 2024-09-13T10:37:27.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f5758f00640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.195:6791/0 conn(0x7f57540a6f30 legacy=0x7f57541cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1169526754 0 0) 0x7f5738003520 con 0x7f57541342c0 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f575409eb70 con 0x7f57541342c0 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f573c004620 con 0x7f57541342c0 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): dump: 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.223 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2098982784 0 0) 0x7f575409d650 con 0x7f57541d1920 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5738003520 con 0x7f57541d1920 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f574c001ee0 con 0x7f57541d1920 2024-09-13T10:37:27.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:27.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:27.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): dump: 2024-09-13T10:37:27.225 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.225 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.225 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.225 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.225 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.225 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.225 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.225 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.225 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.228 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.228 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.228 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.228 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.228 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.228 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.228 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 981618555 0 0) 0x7f575409e890 con 0x7f57540a6f30 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient(hunting): my global_id is 104864 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f575409d650 con 0x7f57540a6f30 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1038097807 0 0) 0x7f575409eb70 con 0x7f57541342c0 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.181:6793/0 conn(0x7f57541d1920 legacy=0x7f57541d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.195:6791/0 conn(0x7f57540a6f30 legacy=0x7f57541cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient: _finish_hunting 0 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 monclient: found mon.c 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57541cc3b0 con 0x7f57541342c0 2024-09-13T10:37:27.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient: _finish_auth 0 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient: _check_auth_tickets 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f575b164640 5 monclient: authenticate success, global_id 114754 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f575b164640 10 monclient: _renew_subs 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f575b164640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f575b164640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f575409d890 con 0x7f57541342c0 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f575b164640 10 monclient: _renew_subs 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f575b164640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f575b164640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f57541d5610 con 0x7f57541342c0 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f573c0048f0 con 0x7f57541342c0 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f573c004e60 con 0x7f57541342c0 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f5752ffd640 4 set_mon_vals no callback set 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.210+0000 7f57517fa640 10 monclient: dump: 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.231 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.211+0000 7f575b164640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.211+0000 7f575b164640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f572c0065c0 con 0x7f572c002860 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.211+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f573c005000 con 0x7f57541342c0 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.211+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(228..228 src has 1..228) ==== 3898+0+0 (unknown 3216227338 0 0) 0x7f573c04e350 con 0x7f57541342c0 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.212+0000 7f5759701640 10 monclient: get_auth_request con 0x7f57380402a0 auth_method 0 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.213+0000 7f5758f00640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.181:6789/0 conn(0x7f572c002860 legacy=0x7f572c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.213+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654730241 0 0) 0x7f572c0065c0 con 0x7f572c002860 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.213+0000 7f57517fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.213+0000 7f57517fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.213+0000 7f57517fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.213+0000 7f57517fa640 10 monclient(hunting): my global_id is 114642 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.213+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f575409eb70 con 0x7f572c002860 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.213+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2511456661 0 0) 0x7f575409eb70 con 0x7f572c002860 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.213+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f572c0065c0 con 0x7f572c002860 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.213+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5744004500 con 0x7f572c002860 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.213+0000 7f57517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.213+0000 7f57517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.214+0000 7f57517fa640 10 monclient: dump: 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.233 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.214+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 411247621 0 0) 0x7f572c0065c0 con 0x7f572c002860 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.214+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f572c00a160 con 0x7f572c002860 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.214+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5744006880 con 0x7f572c002860 2024-09-13T10:37:27.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.214+0000 7f57517fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:27.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.214+0000 7f57517fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:27.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.214+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.181:6789/0 conn(0x7f572c002860 legacy=0x7f572c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.214+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.181:6789/0 conn(0x7f572c002860 legacy=0x7f572c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:27.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.220+0000 7f575b164640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:27.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.220+0000 7f575b164640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f572c009e50 con 0x7f572c009110 2024-09-13T10:37:27.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.222+0000 7f5758f00640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.181:6789/0 conn(0x7f572c009110 legacy=0x7f572c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.222+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204723480 0 0) 0x7f572c009e50 con 0x7f572c009110 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.222+0000 7f57517fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.222+0000 7f57517fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.222+0000 7f57517fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.222+0000 7f57517fa640 10 monclient(hunting): my global_id is 114651 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.222+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f572c0065c0 con 0x7f572c009110 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 258594695 0 0) 0x7f572c0065c0 con 0x7f572c009110 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f572c009e50 con 0x7f572c009110 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5744004f40 con 0x7f572c009110 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 10 monclient: dump: 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.237 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2770511184 0 0) 0x7f572c009e50 con 0x7f572c009110 2024-09-13T10:37:27.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f572c00c3f0 con 0x7f572c009110 2024-09-13T10:37:27.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7682 (unknown 0 0 1759328431) 0x7f5744006360 con 0x7f572c009110 2024-09-13T10:37:27.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:27.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:27.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.181:6789/0 conn(0x7f572c009110 legacy=0x7f572c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f57517fa640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.181:6789/0 conn(0x7f572c009110 legacy=0x7f572c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:27.239 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 116, 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 83201, 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:27.240 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:27.241 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:27.242 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:27.243 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.244 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.245 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.246 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:27.247 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.248 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:27.249 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:27.250 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:27.253 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.254 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.256 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.257 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.258 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:37:27.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.258 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.258 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.258 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:27.258 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.258 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.258 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:27.258 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:27.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f575b164640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.195:6800/1839191919 conn(0x7f57380402a0 legacy=0x7f5738042760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f575b164640 10 monclient: shutdown 2024-09-13T10:37:27.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f575b164640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:27.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f575b164640 1 -- 172.21.15.181:0/4128687845 >> v1:172.21.15.181:6791/0 conn(0x7f57541342c0 legacy=0x7f57541cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f5759701640 1 -- 172.21.15.181:0/4128687845 reap_dead start 2024-09-13T10:37:27.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f5759701640 1 -- 172.21.15.181:0/4128687845 reap_dead start 2024-09-13T10:37:27.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f575b164640 1 -- 172.21.15.181:0/4128687845 shutdown_connections 2024-09-13T10:37:27.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f575b164640 1 -- 172.21.15.181:0/4128687845 >> 172.21.15.181:0/4128687845 conn(0x7f57540aa310 msgr2=0x7f57540a7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:27.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.223+0000 7f575b164640 1 -- 172.21.15.181:0/4128687845 shutdown_connections 2024-09-13T10:37:27.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.224+0000 7f575b164640 1 -- 172.21.15.181:0/4128687845 wait complete. 2024-09-13T10:37:27.260 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-13T10:37:27.260 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon c 2024-09-13T10:37:27.261 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:37:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.358+0000 7ffb2c1a4640 10 monclient: get_monmap_and_config 2024-09-13T10:37:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.358+0000 7ffb2c1a4640 10 monclient: build_initial_monmap 2024-09-13T10:37:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.358+0000 7ffb2c1a4640 10 monclient: monmap: 2024-09-13T10:37:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.359 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:27.358783+0000 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:27.358783+0000 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:27.360 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.358+0000 7ffb2c1a4640 1 Processor -- start 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.358+0000 7ffb2c1a4640 1 -- start start 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.358+0000 7ffb2c1a4640 10 monclient: init 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb2c1a4640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb2c1a4640 10 monclient: _add_conns ranks=[1,4,7,3,5,6,2,0,8] 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb2c1a4640 10 monclient(hunting): picked mon.noname-f con 0x7ffb240a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb2c1a4640 10 monclient(hunting): picked mon.noname-c con 0x7ffb240a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb2c1a4640 10 monclient(hunting): picked mon.noname-i con 0x7ffb2413f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb2c1a4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb240a5fe0 con 0x7ffb240a66d0 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb2c1a4640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb240a8080 con 0x7ffb240a6ab0 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb2c1a4640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb240a42c0 con 0x7ffb2413f9a0 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb2c1a4640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb2c1a4640 10 monclient(hunting): authenticate will time out at 1186.864470s 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb29f40640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7ffb240a66d0 legacy=0x7ffb240a53b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2024-09-13T10:37:27.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb2973f640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ffb240a6ab0 0x7ffb240a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:44504/0 (socket says 172.21.15.181:44504) 2024-09-13T10:37:27.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.359+0000 7ffb2973f640 1 -- 172.21.15.181:0/741271660 learned_addr learned my addr 172.21.15.181:0/741271660 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.361+0000 7ffb2973f640 1 -- 172.21.15.181:0/741271660 >> v1:172.21.15.181:6791/0 conn(0x7ffb240a6ab0 legacy=0x7ffb240a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.361+0000 7ffb2a741640 1 -- 172.21.15.181:0/741271660 >> v1:172.21.15.195:6792/0 conn(0x7ffb2413f9a0 legacy=0x7ffb24141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.361+0000 7ffb28f3e640 1 -- 172.21.15.181:0/741271660 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1351133096 0 0) 0x7ffb240a8080 con 0x7ffb240a6ab0 2024-09-13T10:37:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.361+0000 7ffb28f3e640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.361+0000 7ffb28f3e640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.361+0000 7ffb28f3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.361+0000 7ffb28f3e640 10 monclient(hunting): my global_id is 114763 2024-09-13T10:37:27.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.361+0000 7ffb28f3e640 1 -- 172.21.15.181:0/741271660 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb10003520 con 0x7ffb240a6ab0 2024-09-13T10:37:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 1 -- 172.21.15.181:0/741271660 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2643678675 0 0) 0x7ffb10003520 con 0x7ffb240a6ab0 2024-09-13T10:37:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 1 -- 172.21.15.181:0/741271660 >> v1:172.21.15.195:6792/0 conn(0x7ffb2413f9a0 legacy=0x7ffb24141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 1 -- 172.21.15.181:0/741271660 >> v1:172.21.15.195:6789/0 conn(0x7ffb240a66d0 legacy=0x7ffb240a53b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 10 monclient: _finish_hunting 0 2024-09-13T10:37:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 1 monclient: found mon.noname-c 2024-09-13T10:37:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 1 -- 172.21.15.181:0/741271660 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb241464e0 con 0x7ffb240a6ab0 2024-09-13T10:37:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 10 monclient: _finish_auth 0 2024-09-13T10:37:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 10 monclient: _check_auth_tickets 2024-09-13T10:37:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:27.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 1 -- 172.21.15.181:0/741271660 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffb14001ae0 con 0x7ffb240a6ab0 2024-09-13T10:37:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb2c1a4640 5 monclient: authenticate success, global_id 114763 2024-09-13T10:37:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 10 monclient: dump: 2024-09-13T10:37:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.368 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb2c1a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 1 -- 172.21.15.181:0/741271660 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb140048a0 con 0x7ffb240a6ab0 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:27.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 1 -- 172.21.15.181:0/741271660 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffb14004e10 con 0x7ffb240a6ab0 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb2c1a4640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb2c1a4640 4 set_mon_vals no callback set 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb28f3e640 10 monclient: dump: 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.370 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb2c1a4640 10 monclient: shutdown 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb2c1a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/741271660 >> v1:172.21.15.181:6791/0 conn(0x7ffb240a6ab0 legacy=0x7ffb240a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/741271660 shutdown_connections 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/741271660 >> 172.21.15.181:0/741271660 conn(0x7ffb240abcd0 msgr2=0x7ffb240ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/741271660 shutdown_connections 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.362+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/741271660 wait complete. 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.363+0000 7ffb2c1a4640 10 monclient: build_initial_monmap 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.363+0000 7ffb2c1a4640 10 monclient: monmap: 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:27.371 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:27.372 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.363+0000 7ffb2c1a4640 1 Processor -- start 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.363+0000 7ffb2c1a4640 1 -- start start 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.363+0000 7ffb2c1a4640 10 monclient: init 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb2c1a4640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb2c1a4640 10 monclient: _add_conns ranks=[0,2,5,7,4,3,6,8,1] 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb2c1a4640 10 monclient(hunting): picked mon.noname-a con 0x7ffb240a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb2c1a4640 10 monclient(hunting): picked mon.noname-b con 0x7ffb240a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb2c1a4640 10 monclient(hunting): picked mon.noname-h con 0x7ffb2413f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb2c1a4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb2413cd10 con 0x7ffb240a66d0 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb2973f640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7ffb240a6ab0 legacy=0x7ffb2413bcc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb2c1a4640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb24068b70 con 0x7ffb240a6ab0 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb2c1a4640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb2413f070 con 0x7ffb2413f9a0 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb2c1a4640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:27.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb2c1a4640 10 monclient(hunting): authenticate will time out at 1186.869283s 2024-09-13T10:37:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb29f40640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ffb240a66d0 0x7ffb2413b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:32856/0 (socket says 172.21.15.181:32856) 2024-09-13T10:37:27.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.364+0000 7ffb29f40640 1 -- 172.21.15.181:0/4101420209 learned_addr learned my addr 172.21.15.181:0/4101420209 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb29f40640 1 -- 172.21.15.181:0/4101420209 >> v1:172.21.15.181:6789/0 conn(0x7ffb240a66d0 legacy=0x7ffb2413b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1267386958 0 0) 0x7ffb2413cd10 con 0x7ffb240a66d0 2024-09-13T10:37:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient(hunting): my global_id is 114660 2024-09-13T10:37:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb08003520 con 0x7ffb240a66d0 2024-09-13T10:37:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb2a741640 1 -- 172.21.15.181:0/4101420209 >> v1:172.21.15.195:6791/0 conn(0x7ffb2413f9a0 legacy=0x7ffb241d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3814153714 0 0) 0x7ffb08003520 con 0x7ffb240a66d0 2024-09-13T10:37:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb2413cd10 con 0x7ffb240a66d0 2024-09-13T10:37:27.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffb200046e0 con 0x7ffb240a66d0 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient(hunting): dump: 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.378 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612577254 0 0) 0x7ffb2413f070 con 0x7ffb2413f9a0 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient(hunting): my global_id is 104873 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb08003520 con 0x7ffb2413f9a0 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3077314924 0 0) 0x7ffb2413cd10 con 0x7ffb240a66d0 2024-09-13T10:37:27.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 >> v1:172.21.15.195:6791/0 conn(0x7ffb2413f9a0 legacy=0x7ffb241d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 >> v1:172.21.15.181:6790/0 conn(0x7ffb240a6ab0 legacy=0x7ffb2413bcc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 1 monclient: found mon.a 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2413db40 con 0x7ffb240a66d0 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb1a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.366+0000 7ffb2c1a4640 5 monclient: authenticate success, global_id 114660 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb2c1a4640 10 monclient: _renew_subs 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb2c1a4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffb240a28f0 con 0x7ffb240a66d0 2024-09-13T10:37:27.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb2c1a4640 10 monclient: _renew_subs 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb2c1a4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffb2413c5b0 con 0x7ffb240a66d0 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb20004900 con 0x7ffb240a66d0 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb1a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffb20004e70 con 0x7ffb240a66d0 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb1a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb1bfff640 4 set_mon_vals no callback set 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb1a7fc640 10 monclient: dump: 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.381 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb2c1a4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffb0c0065c0 con 0x7ffb0c002860 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.367+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ffb20005140 con 0x7ffb240a66d0 2024-09-13T10:37:27.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.368+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(228..228 src has 1..228) ==== 3898+0+0 (unknown 3216227338 0 0) 0x7ffb2004e4a0 con 0x7ffb240a66d0 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.368+0000 7ffb2a741640 10 monclient: get_auth_request con 0x7ffb0803faa0 auth_method 0 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb2973f640 1 -- 172.21.15.181:0/4101420209 >> v1:172.21.15.181:6791/0 conn(0x7ffb0c002860 legacy=0x7ffb0c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 120271794 0 0) 0x7ffb0c0065c0 con 0x7ffb0c002860 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 10 monclient(hunting): my global_id is 114772 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb2413cd10 con 0x7ffb0c002860 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3999458591 0 0) 0x7ffb2413cd10 con 0x7ffb0c002860 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb0c0065c0 con 0x7ffb0c002860 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffb140047e0 con 0x7ffb0c002860 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:27.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 10 monclient: dump: 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.384 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.385 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3681947944 0 0) 0x7ffb0c0065c0 con 0x7ffb0c002860 2024-09-13T10:37:27.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb0c00a160 con 0x7ffb0c002860 2024-09-13T10:37:27.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ffb14004a00 con 0x7ffb0c002860 2024-09-13T10:37:27.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:27.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:27.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 >> v1:172.21.15.181:6791/0 conn(0x7ffb0c002860 legacy=0x7ffb0c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.370+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 >> v1:172.21.15.181:6791/0 conn(0x7ffb0c002860 legacy=0x7ffb0c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:27.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.376+0000 7ffb2c1a4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.376+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffb0c009e50 con 0x7ffb0c009110 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.378+0000 7ffb2973f640 1 -- 172.21.15.181:0/4101420209 >> v1:172.21.15.181:6791/0 conn(0x7ffb0c009110 legacy=0x7ffb0c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764056153 0 0) 0x7ffb0c009e50 con 0x7ffb0c009110 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 10 monclient(hunting): my global_id is 114781 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb0c0065c0 con 0x7ffb0c009110 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1352919742 0 0) 0x7ffb0c0065c0 con 0x7ffb0c009110 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb0c009e50 con 0x7ffb0c009110 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffb14005490 con 0x7ffb0c009110 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 10 monclient: dump: 2024-09-13T10:37:27.387 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.388 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3173712339 0 0) 0x7ffb0c009e50 con 0x7ffb0c009110 2024-09-13T10:37:27.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffb0c00c3f0 con 0x7ffb0c009110 2024-09-13T10:37:27.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7515 (unknown 0 0 893325906) 0x7ffb14007d70 con 0x7ffb0c009110 2024-09-13T10:37:27.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:27.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:27.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 >> v1:172.21.15.181:6791/0 conn(0x7ffb0c009110 legacy=0x7ffb0c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb1a7fc640 1 -- 172.21.15.181:0/4101420209 >> v1:172.21.15.181:6791/0 conn(0x7ffb0c009110 legacy=0x7ffb0c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:27.389 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:27.389 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 116, 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 83357, 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:27.390 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:27.391 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.392 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:27.393 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.394 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.395 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.397 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.398 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.400 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.401 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:27.403 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:27.404 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.406 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.407 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:27.408 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:27.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/4101420209 >> v1:172.21.15.195:6800/1839191919 conn(0x7ffb0803faa0 legacy=0x7ffb08041f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb2c1a4640 10 monclient: shutdown 2024-09-13T10:37:27.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb2c1a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:27.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/4101420209 >> v1:172.21.15.181:6789/0 conn(0x7ffb240a66d0 legacy=0x7ffb2413b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb2a741640 1 -- 172.21.15.181:0/4101420209 reap_dead start 2024-09-13T10:37:27.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb2a741640 1 -- 172.21.15.181:0/4101420209 reap_dead start 2024-09-13T10:37:27.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/4101420209 shutdown_connections 2024-09-13T10:37:27.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.379+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/4101420209 >> 172.21.15.181:0/4101420209 conn(0x7ffb240abcd0 msgr2=0x7ffb240ab4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:27.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.380+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/4101420209 shutdown_connections 2024-09-13T10:37:27.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.380+0000 7ffb2c1a4640 1 -- 172.21.15.181:0/4101420209 wait complete. 2024-09-13T10:37:27.410 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-13T10:37:27.410 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon e 2024-09-13T10:37:27.410 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:37:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.507+0000 7f8c6e3f5640 10 monclient: get_monmap_and_config 2024-09-13T10:37:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.507+0000 7f8c6e3f5640 10 monclient: build_initial_monmap 2024-09-13T10:37:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.507+0000 7f8c6e3f5640 10 monclient: monmap: 2024-09-13T10:37:27.509 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:27.508565+0000 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:27.508565+0000 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:27.510 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.508+0000 7f8c6e3f5640 1 Processor -- start 2024-09-13T10:37:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.508+0000 7f8c6e3f5640 1 -- start start 2024-09-13T10:37:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.508+0000 7f8c6e3f5640 10 monclient: init 2024-09-13T10:37:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c6e3f5640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c6e3f5640 10 monclient: _add_conns ranks=[6,8,2,4,5,7,0,1,3] 2024-09-13T10:37:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c6e3f5640 10 monclient(hunting): picked mon.noname-d con 0x7f8c680a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c6e3f5640 10 monclient(hunting): picked mon.noname-e con 0x7f8c680a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c6e3f5640 10 monclient(hunting): picked mon.noname-b con 0x7f8c6813f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c6e3f5640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c680a4bc0 con 0x7f8c6813f750 2024-09-13T10:37:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c6e3f5640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c6813a320 con 0x7f8c680a6640 2024-09-13T10:37:27.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c6e3f5640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c680a8100 con 0x7f8c680a8340 2024-09-13T10:37:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c6e3f5640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c6e3f5640 10 monclient(hunting): authenticate will time out at 1187.014238s 2024-09-13T10:37:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c67fff640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f8c680a6640 legacy=0x7f8c68139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c6c992640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f8c6813f750 legacy=0x7f8c68141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:37:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c677fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f8c680a8340 0x7f8c68139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:32896/0 (socket says 172.21.15.181:32896) 2024-09-13T10:37:27.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.509+0000 7f8c677fe640 1 -- 172.21.15.181:0/772627385 learned_addr learned my addr 172.21.15.181:0/772627385 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c677fe640 1 -- 172.21.15.181:0/772627385 >> v1:172.21.15.181:6793/0 conn(0x7f8c680a8340 legacy=0x7f8c68139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 1 -- 172.21.15.181:0/772627385 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662461640 0 0) 0x7f8c680a8100 con 0x7f8c680a8340 2024-09-13T10:37:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 10 monclient(hunting): my global_id is 105092 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 1 -- 172.21.15.181:0/772627385 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c50003520 con 0x7f8c680a8340 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 1 -- 172.21.15.181:0/772627385 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3639376676 0 0) 0x7f8c50003520 con 0x7f8c680a8340 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 1 -- 172.21.15.181:0/772627385 >> v1:172.21.15.181:6792/0 conn(0x7f8c680a6640 legacy=0x7f8c68139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 1 -- 172.21.15.181:0/772627385 >> v1:172.21.15.181:6790/0 conn(0x7f8c6813f750 legacy=0x7f8c68141b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 1 monclient: found mon.noname-e 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 1 -- 172.21.15.181:0/772627385 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c680a48e0 con 0x7f8c680a8340 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:27.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 1 -- 172.21.15.181:0/772627385 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8c5c001ae0 con 0x7f8c680a8340 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c6e3f5640 5 monclient: authenticate success, global_id 105092 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c6e3f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c66ffd640 10 monclient: dump: 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.518 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.511+0000 7f8c6e3f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c66ffd640 1 -- 172.21.15.181:0/772627385 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c5c0048a0 con 0x7f8c680a8340 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c66ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c66ffd640 1 -- 172.21.15.181:0/772627385 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8c5c004e10 con 0x7f8c680a8340 2024-09-13T10:37:27.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c6e3f5640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c6e3f5640 4 set_mon_vals no callback set 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c66ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c66ffd640 10 monclient: dump: 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.520 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c6e3f5640 10 monclient: shutdown 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c6e3f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/772627385 >> v1:172.21.15.181:6793/0 conn(0x7f8c680a8340 legacy=0x7f8c68139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/772627385 shutdown_connections 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/772627385 >> 172.21.15.181:0/772627385 conn(0x7f8c68077170 msgr2=0x7f8c680abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/772627385 shutdown_connections 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.512+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/772627385 wait complete. 2024-09-13T10:37:27.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.513+0000 7f8c6e3f5640 10 monclient: build_initial_monmap 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.513+0000 7f8c6e3f5640 10 monclient: monmap: 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:27.522 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.513+0000 7f8c6e3f5640 1 Processor -- start 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.513+0000 7f8c6e3f5640 1 -- start start 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.513+0000 7f8c6e3f5640 10 monclient: init 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.513+0000 7f8c6e3f5640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c6e3f5640 10 monclient: _add_conns ranks=[2,3,7,5,4,8,0,1,6] 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c6e3f5640 10 monclient(hunting): picked mon.noname-b con 0x7f8c680a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c6e3f5640 10 monclient(hunting): picked mon.noname-g con 0x7f8c6813f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c6e3f5640 10 monclient(hunting): picked mon.noname-i con 0x7f8c681d43a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c6e3f5640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c680a0f80 con 0x7f8c680a8340 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c67fff640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f8c680a8340 legacy=0x7f8c6809d410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:37:27.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c6e3f5640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c680a1260 con 0x7f8c6813f750 2024-09-13T10:37:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c6e3f5640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c68143050 con 0x7f8c681d43a0 2024-09-13T10:37:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c6e3f5640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c6e3f5640 10 monclient(hunting): authenticate will time out at 1187.019102s 2024-09-13T10:37:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c677fe640 1 -- >> v1:172.21.15.195:6790/0 conn(0x7f8c6813f750 legacy=0x7f8c6809db20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:37:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c6c992640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f8c681d43a0 0x7f8c681d6790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:47620/0 (socket says 172.21.15.181:47620) 2024-09-13T10:37:27.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.514+0000 7f8c6c992640 1 -- 172.21.15.181:0/3582905394 learned_addr learned my addr 172.21.15.181:0/3582905394 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:27.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.516+0000 7f8c6c992640 1 -- 172.21.15.181:0/3582905394 >> v1:172.21.15.195:6792/0 conn(0x7f8c681d43a0 legacy=0x7f8c681d6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.516+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168453044 0 0) 0x7f8c68143050 con 0x7f8c681d43a0 2024-09-13T10:37:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.516+0000 7f8c64ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.516+0000 7f8c64ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.516+0000 7f8c64ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.516+0000 7f8c64ff9640 10 monclient(hunting): my global_id is 56950 2024-09-13T10:37:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.516+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c54003550 con 0x7f8c681d43a0 2024-09-13T10:37:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1425673973 0 0) 0x7f8c54003550 con 0x7f8c681d43a0 2024-09-13T10:37:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c68143050 con 0x7f8c681d43a0 2024-09-13T10:37:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8c600048c0 con 0x7f8c681d43a0 2024-09-13T10:37:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:37:27.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.529 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 399210439 0 0) 0x7f8c68143050 con 0x7f8c681d43a0 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 >> v1:172.21.15.195:6790/0 conn(0x7f8c6813f750 legacy=0x7f8c6809db20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 >> v1:172.21.15.181:6790/0 conn(0x7f8c680a8340 legacy=0x7f8c6809d410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 1 monclient: found mon.i 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c680a03f0 con 0x7f8c681d43a0 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 10 monclient: _finish_auth 0 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:37:27.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c6e3f5640 5 monclient: authenticate success, global_id 56950 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c6e3f5640 10 monclient: _renew_subs 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c6e3f5640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6809e230 con 0x7f8c681d43a0 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c6e3f5640 10 monclient: _renew_subs 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c6e3f5640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f8c6809fd00 con 0x7f8c681d43a0 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c60004bd0 con 0x7f8c681d43a0 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8c60005180 con 0x7f8c681d43a0 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c667fc640 4 set_mon_vals no callback set 2024-09-13T10:37:27.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.517+0000 7f8c64ff9640 10 monclient: dump: 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.532 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.518+0000 7f8c6e3f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.518+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8c480065c0 con 0x7f8c48002860 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.518+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f8c600053a0 con 0x7f8c681d43a0 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.518+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(228..228 src has 1..228) ==== 3898+0+0 (unknown 3216227338 0 0) 0x7f8c6004e770 con 0x7f8c681d43a0 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.518+0000 7f8c677fe640 10 monclient: get_auth_request con 0x7f8c5403f8b0 auth_method 0 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c67fff640 1 -- 172.21.15.181:0/3582905394 >> v1:172.21.15.181:6793/0 conn(0x7f8c48002860 legacy=0x7f8c48004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003134733 0 0) 0x7f8c480065c0 con 0x7f8c48002860 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 10 monclient(hunting): my global_id is 105101 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c68143050 con 0x7f8c48002860 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4196604655 0 0) 0x7f8c68143050 con 0x7f8c48002860 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c480065c0 con 0x7f8c48002860 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8c580043f0 con 0x7f8c48002860 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 10 monclient: dump: 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.534 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1893717802 0 0) 0x7f8c480065c0 con 0x7f8c48002860 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.520+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c4800a160 con 0x7f8c48002860 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.521+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8c580067a0 con 0x7f8c48002860 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.521+0000 7f8c64ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:27.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.521+0000 7f8c64ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:27.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.521+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 >> v1:172.21.15.181:6793/0 conn(0x7f8c48002860 legacy=0x7f8c48004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.521+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 >> v1:172.21.15.181:6793/0 conn(0x7f8c48002860 legacy=0x7f8c48004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.527+0000 7f8c6e3f5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.527+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8c48009e70 con 0x7f8c48009130 2024-09-13T10:37:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.529+0000 7f8c67fff640 1 -- 172.21.15.181:0/3582905394 >> v1:172.21.15.181:6793/0 conn(0x7f8c48009130 legacy=0x7f8c480095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.529+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2679246400 0 0) 0x7f8c48009e70 con 0x7f8c48009130 2024-09-13T10:37:27.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.529+0000 7f8c64ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.529+0000 7f8c64ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.529+0000 7f8c64ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.529+0000 7f8c64ff9640 10 monclient(hunting): my global_id is 105110 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.529+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c480065c0 con 0x7f8c48009130 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1446387446 0 0) 0x7f8c480065c0 con 0x7f8c48009130 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c48009e70 con 0x7f8c48009130 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8c58004e20 con 0x7f8c48009130 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 10 monclient: dump: 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.538 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3339422896 0 0) 0x7f8c48009e70 con 0x7f8c48009130 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8c4800c410 con 0x7f8c48009130 2024-09-13T10:37:27.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7683 (unknown 0 0 2063311870) 0x7f8c58006370 con 0x7f8c48009130 2024-09-13T10:37:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 >> v1:172.21.15.181:6793/0 conn(0x7f8c48009130 legacy=0x7f8c480095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c64ff9640 1 -- 172.21.15.181:0/3582905394 >> v1:172.21.15.181:6793/0 conn(0x7f8c48009130 legacy=0x7f8c480095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:27.540 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 116, 2024-09-13T10:37:27.540 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 131233, 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.541 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:27.544 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.545 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.546 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.547 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.548 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.549 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:27.550 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.551 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:27.555 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:27.557 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.558 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.559 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:27.560 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/3582905394 >> v1:172.21.15.195:6800/1839191919 conn(0x7f8c5403f8b0 legacy=0x7f8c54041d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c6e3f5640 10 monclient: shutdown 2024-09-13T10:37:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c6e3f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/3582905394 >> v1:172.21.15.195:6792/0 conn(0x7f8c681d43a0 legacy=0x7f8c681d6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c6c992640 1 -- 172.21.15.181:0/3582905394 reap_dead start 2024-09-13T10:37:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c6c992640 1 -- 172.21.15.181:0/3582905394 reap_dead start 2024-09-13T10:37:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/3582905394 shutdown_connections 2024-09-13T10:37:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/3582905394 >> 172.21.15.181:0/3582905394 conn(0x7f8c680a6640 msgr2=0x7f8c68141b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/3582905394 shutdown_connections 2024-09-13T10:37:27.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.530+0000 7f8c6e3f5640 1 -- 172.21.15.181:0/3582905394 wait complete. 2024-09-13T10:37:27.562 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-13T10:37:27.562 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon h 2024-09-13T10:37:27.562 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:37:27.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.659+0000 7f72a3156640 10 monclient: get_monmap_and_config 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.659+0000 7f72a3156640 10 monclient: build_initial_monmap 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.659+0000 7f72a3156640 10 monclient: monmap: 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:27.660125+0000 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:27.660125+0000 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:27.661 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:27.662 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:27.662 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:27.662 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:27.662 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:27.662 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 1 Processor -- start 2024-09-13T10:37:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 1 -- start start 2024-09-13T10:37:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 10 monclient: init 2024-09-13T10:37:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 10 monclient: _add_conns ranks=[3,7,8,5,1,2,6,0,4] 2024-09-13T10:37:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 10 monclient(hunting): picked mon.noname-g con 0x7f729c0a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:27.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 10 monclient(hunting): picked mon.noname-i con 0x7f729c0a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:27.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 10 monclient(hunting): picked mon.noname-e con 0x7f729c13f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:27.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729c0a5fe0 con 0x7f729c0a66d0 2024-09-13T10:37:27.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729c0a8080 con 0x7f729c0a6ab0 2024-09-13T10:37:27.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729c0a42c0 con 0x7f729c13f9a0 2024-09-13T10:37:27.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:27.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a3156640 10 monclient(hunting): authenticate will time out at 1187.165827s 2024-09-13T10:37:27.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a16f3640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f729c13f9a0 0x7f729c141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:32918/0 (socket says 172.21.15.181:32918) 2024-09-13T10:37:27.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a16f3640 1 -- 172.21.15.181:0/4021851752 learned_addr learned my addr 172.21.15.181:0/4021851752 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:27.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.660+0000 7f72a0ef2640 1 -- 172.21.15.181:0/4021851752 >> v1:172.21.15.195:6790/0 conn(0x7f729c0a66d0 legacy=0x7f729c0a53b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:37:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f72a16f3640 1 -- 172.21.15.181:0/4021851752 >> v1:172.21.15.181:6793/0 conn(0x7f729c13f9a0 legacy=0x7f729c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729bfff640 1 -- 172.21.15.181:0/4021851752 >> v1:172.21.15.195:6792/0 conn(0x7f729c0a6ab0 legacy=0x7f729c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 1 -- 172.21.15.181:0/4021851752 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620152371 0 0) 0x7f729c0a42c0 con 0x7f729c13f9a0 2024-09-13T10:37:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient(hunting): my global_id is 105119 2024-09-13T10:37:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 1 -- 172.21.15.181:0/4021851752 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7288003520 con 0x7f729c13f9a0 2024-09-13T10:37:27.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 1 -- 172.21.15.181:0/4021851752 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439600639 0 0) 0x7f729c0a8080 con 0x7f729c0a6ab0 2024-09-13T10:37:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient(hunting): my global_id is 56959 2024-09-13T10:37:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 1 -- 172.21.15.181:0/4021851752 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f729c0a42c0 con 0x7f729c0a6ab0 2024-09-13T10:37:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 1 -- 172.21.15.181:0/4021851752 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 408983630 0 0) 0x7f7288003520 con 0x7f729c13f9a0 2024-09-13T10:37:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 1 -- 172.21.15.181:0/4021851752 >> v1:172.21.15.195:6792/0 conn(0x7f729c0a6ab0 legacy=0x7f729c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 1 -- 172.21.15.181:0/4021851752 >> v1:172.21.15.195:6790/0 conn(0x7f729c0a66d0 legacy=0x7f729c0a53b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:27.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 1 monclient: found mon.noname-e 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 1 -- 172.21.15.181:0/4021851752 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729c1464e0 con 0x7f729c13f9a0 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 1 -- 172.21.15.181:0/4021851752 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7294001ad0 con 0x7f729c13f9a0 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f72a3156640 5 monclient: authenticate success, global_id 105119 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f72a3156640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient: dump: 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.670 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f72a3156640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 1 -- 172.21.15.181:0/4021851752 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f72940048a0 con 0x7f729c13f9a0 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 1 -- 172.21.15.181:0/4021851752 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7294004e10 con 0x7f729c13f9a0 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f72a3156640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f72a3156640 4 set_mon_vals no callback set 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.663+0000 7f729b7fe640 10 monclient: dump: 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.672 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.664+0000 7f72a3156640 10 monclient: shutdown 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.664+0000 7f72a3156640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.664+0000 7f72a3156640 1 -- 172.21.15.181:0/4021851752 >> v1:172.21.15.181:6793/0 conn(0x7f729c13f9a0 legacy=0x7f729c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.664+0000 7f72a3156640 1 -- 172.21.15.181:0/4021851752 shutdown_connections 2024-09-13T10:37:27.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.664+0000 7f72a3156640 1 -- 172.21.15.181:0/4021851752 >> 172.21.15.181:0/4021851752 conn(0x7f729c0abcd0 msgr2=0x7f729c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.664+0000 7f72a3156640 1 -- 172.21.15.181:0/4021851752 shutdown_connections 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.664+0000 7f72a3156640 1 -- 172.21.15.181:0/4021851752 wait complete. 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.664+0000 7f72a3156640 10 monclient: build_initial_monmap 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.664+0000 7f72a3156640 10 monclient: monmap: 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:27.674 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 1 Processor -- start 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 1 -- start start 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 10 monclient: init 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 10 monclient: _add_conns ranks=[1,7,5,4,6,0,2,3,8] 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 10 monclient(hunting): picked mon.noname-f con 0x7f729c0a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 10 monclient(hunting): picked mon.noname-i con 0x7f729c0a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:27.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 10 monclient(hunting): picked mon.noname-h con 0x7f729c13f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729c068e50 con 0x7f729c0a66d0 2024-09-13T10:37:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729c13f120 con 0x7f729c13f9a0 2024-09-13T10:37:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729c13f400 con 0x7f729c0a6ab0 2024-09-13T10:37:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a3156640 10 monclient(hunting): authenticate will time out at 1187.170745s 2024-09-13T10:37:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f72a0ef2640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7f729c0a66d0 legacy=0x7f729c1366d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6789/0 2024-09-13T10:37:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f729bfff640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f729c0a6ab0 0x7f729c1d3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:47642/0 (socket says 172.21.15.181:47642) 2024-09-13T10:37:27.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.665+0000 7f729bfff640 1 -- 172.21.15.181:0/766623621 learned_addr learned my addr 172.21.15.181:0/766623621 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72a16f3640 1 -- 172.21.15.181:0/766623621 >> v1:172.21.15.195:6791/0 conn(0x7f729c13f9a0 legacy=0x7f729c1d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f729bfff640 1 -- 172.21.15.181:0/766623621 >> v1:172.21.15.195:6792/0 conn(0x7f729c0a6ab0 legacy=0x7f729c1d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3181623609 0 0) 0x7f729c13f400 con 0x7f729c0a6ab0 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): my global_id is 56968 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f727c003550 con 0x7f729c0a6ab0 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746229336 0 0) 0x7f729c13f120 con 0x7f729c13f9a0 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): my global_id is 104882 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f729c13f400 con 0x7f729c13f9a0 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3428280844 0 0) 0x7f727c003550 con 0x7f729c0a6ab0 2024-09-13T10:37:27.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f729c13f120 con 0x7f729c0a6ab0 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7284003950 con 0x7f729c0a6ab0 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): dump: 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.682 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4212265801 0 0) 0x7f729c13f400 con 0x7f729c13f9a0 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f727c003550 con 0x7f729c13f9a0 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7294001d20 con 0x7f729c13f9a0 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 10 monclient(hunting): dump: 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.683 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.684 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1708036515 0 0) 0x7f729c13f120 con 0x7f729c0a6ab0 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.668+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 >> v1:172.21.15.195:6791/0 conn(0x7f729c13f9a0 legacy=0x7f729c1d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 >> v1:172.21.15.195:6789/0 conn(0x7f729c0a66d0 legacy=0x7f729c1366d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 10 monclient: _finish_hunting 0 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 1 monclient: found mon.i 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729c068ab0 con 0x7f729c0a6ab0 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 10 monclient: _finish_auth 0 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 10 monclient: _check_auth_tickets 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72a3156640 5 monclient: authenticate success, global_id 56968 2024-09-13T10:37:27.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72a3156640 10 monclient: _renew_subs 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72a3156640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72a3156640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f729c139070 con 0x7f729c0a6ab0 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72a3156640 10 monclient: _renew_subs 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72a3156640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72a3156640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f729c13c6b0 con 0x7f729c0a6ab0 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7284001d10 con 0x7f729c0a6ab0 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7284004160 con 0x7f729c0a6ab0 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f729affd640 4 set_mon_vals no callback set 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 10 monclient: dump: 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.686 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72a3156640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72a3156640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f72800065c0 con 0x7f7280002860 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.669+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7284011ca0 con 0x7f729c0a6ab0 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.670+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(228..228 src has 1..228) ==== 3898+0+0 (unknown 3216227338 0 0) 0x7f728404e500 con 0x7f729c0a6ab0 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.670+0000 7f72a16f3640 10 monclient: get_auth_request con 0x7f727c0400e0 auth_method 0 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72a0ef2640 1 -- 172.21.15.181:0/766623621 >> v1:172.21.15.195:6791/0 conn(0x7f7280002860 legacy=0x7f7280004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3473895907 0 0) 0x7f72800065c0 con 0x7f7280002860 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 10 monclient(hunting): my global_id is 104891 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f729c13f120 con 0x7f7280002860 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2139403773 0 0) 0x7f729c13f120 con 0x7f7280002860 2024-09-13T10:37:27.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72800065c0 con 0x7f7280002860 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f728c004900 con 0x7f7280002860 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 10 monclient: dump: 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.689 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1269402904 0 0) 0x7f72800065c0 con 0x7f7280002860 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.672+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f728000a160 con 0x7f7280002860 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.673+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f728c004d00 con 0x7f7280002860 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.673+0000 7f72997fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.673+0000 7f72997fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.673+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 >> v1:172.21.15.195:6791/0 conn(0x7f7280002860 legacy=0x7f7280004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.673+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 >> v1:172.21.15.195:6791/0 conn(0x7f7280002860 legacy=0x7f7280004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.679+0000 7f72a3156640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:27.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.679+0000 7f72a3156640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7280009e70 con 0x7f7280009130 2024-09-13T10:37:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72a0ef2640 1 -- 172.21.15.181:0/766623621 >> v1:172.21.15.195:6791/0 conn(0x7f7280009130 legacy=0x7f72800095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3365359883 0 0) 0x7f7280009e70 con 0x7f7280009130 2024-09-13T10:37:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72997fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72997fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72997fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72997fa640 10 monclient(hunting): my global_id is 104900 2024-09-13T10:37:27.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72800065c0 con 0x7f7280009130 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 363800982 0 0) 0x7f72800065c0 con 0x7f7280009130 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7280009e70 con 0x7f7280009130 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f728c005460 con 0x7f7280009130 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72997fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.681+0000 7f72997fa640 10 monclient: dump: 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.693 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4172737699 0 0) 0x7f7280009e70 con 0x7f7280009130 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f728000c410 con 0x7f7280009130 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7683 (unknown 0 0 3788341328) 0x7f728c0068d0 con 0x7f7280009130 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72997fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72997fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:27.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 >> v1:172.21.15.195:6791/0 conn(0x7f7280009130 legacy=0x7f72800095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72997fa640 1 -- 172.21.15.181:0/766623621 >> v1:172.21.15.195:6791/0 conn(0x7f7280009130 legacy=0x7f72800095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:27.695 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:27.695 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:27.695 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:27.695 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:27.695 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 116, 2024-09-13T10:37:27.695 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 131382, 2024-09-13T10:37:27.695 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:27.695 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:27.695 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.696 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.697 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.699 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.700 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.701 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.702 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:27.703 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.704 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.706 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:27.707 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:27.709 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.710 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.711 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4 2024-09-13T10:37:27.713 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.714 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:27.714 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:27.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72a3156640 1 -- 172.21.15.181:0/766623621 >> v1:172.21.15.195:6800/1839191919 conn(0x7f727c0400e0 legacy=0x7f727c0425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72a3156640 10 monclient: shutdown 2024-09-13T10:37:27.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72a3156640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:27.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72a3156640 1 -- 172.21.15.181:0/766623621 >> v1:172.21.15.195:6792/0 conn(0x7f729c0a6ab0 legacy=0x7f729c1d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72a16f3640 1 -- 172.21.15.181:0/766623621 reap_dead start 2024-09-13T10:37:27.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72a16f3640 1 -- 172.21.15.181:0/766623621 reap_dead start 2024-09-13T10:37:27.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72a3156640 1 -- 172.21.15.181:0/766623621 shutdown_connections 2024-09-13T10:37:27.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72a3156640 1 -- 172.21.15.181:0/766623621 >> 172.21.15.181:0/766623621 conn(0x7f729c0abcd0 msgr2=0x7f729c0a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:27.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72a3156640 1 -- 172.21.15.181:0/766623621 shutdown_connections 2024-09-13T10:37:27.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.682+0000 7f72a3156640 1 -- 172.21.15.181:0/766623621 wait complete. 2024-09-13T10:37:27.716 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-13T10:37:27.717 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon i 2024-09-13T10:37:27.717 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:37:27.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.813+0000 7f424e7fe640 10 monclient: get_monmap_and_config 2024-09-13T10:37:27.814 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.813+0000 7f424e7fe640 10 monclient: build_initial_monmap 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.813+0000 7f424e7fe640 10 monclient: monmap: 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:27.813799+0000 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:27.813799+0000 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:27.815 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:27.816 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:27.816 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:27.816 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:27.816 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.813+0000 7f424e7fe640 1 Processor -- start 2024-09-13T10:37:27.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.813+0000 7f424e7fe640 1 -- start start 2024-09-13T10:37:27.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.813+0000 7f424e7fe640 10 monclient: init 2024-09-13T10:37:27.817 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f424e7fe640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f424e7fe640 10 monclient: _add_conns ranks=[5,1,6,0,7,4,3,2,8] 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f424e7fe640 10 monclient(hunting): picked mon.noname-h con 0x7f42480a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f424e7fe640 10 monclient(hunting): picked mon.noname-f con 0x7f42480a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f424e7fe640 10 monclient(hunting): picked mon.noname-d con 0x7f424813f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f424e7fe640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42480a5fe0 con 0x7f42480a6ab0 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f424e7fe640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42480a8080 con 0x7f42480a66d0 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f424e7fe640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42480a42c0 con 0x7f424813f9a0 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f424e7fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f424e7fe640 10 monclient(hunting): authenticate will time out at 1187.319518s 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f424cd9b640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f424813f9a0 legacy=0x7f4248141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f42477fe640 1 -- >> v1:172.21.15.195:6789/0 conn(0x7f42480a6ab0 legacy=0x7f42480a6ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6789/0 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f4247fff640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f42480a66d0 0x7f42480a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:57736/0 (socket says 172.21.15.181:57736) 2024-09-13T10:37:27.818 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.814+0000 7f4247fff640 1 -- 172.21.15.181:0/744649020 learned_addr learned my addr 172.21.15.181:0/744649020 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4247fff640 1 -- 172.21.15.181:0/744649020 >> v1:172.21.15.195:6791/0 conn(0x7f42480a66d0 legacy=0x7f42480a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 1 -- 172.21.15.181:0/744649020 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 136787930 0 0) 0x7f42480a8080 con 0x7f42480a66d0 2024-09-13T10:37:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient(hunting): my global_id is 104909 2024-09-13T10:37:27.822 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 1 -- 172.21.15.181:0/744649020 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4234003520 con 0x7f42480a66d0 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 1 -- 172.21.15.181:0/744649020 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2471043954 0 0) 0x7f4234003520 con 0x7f42480a66d0 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 1 -- 172.21.15.181:0/744649020 >> v1:172.21.15.181:6792/0 conn(0x7f424813f9a0 legacy=0x7f4248141d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 1 -- 172.21.15.181:0/744649020 >> v1:172.21.15.195:6789/0 conn(0x7f42480a6ab0 legacy=0x7f42480a6ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 1 monclient: found mon.noname-h 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.195:6791/0 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 1 -- 172.21.15.181:0/744649020 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42481464e0 con 0x7f42480a66d0 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 1 -- 172.21.15.181:0/744649020 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4238001ba0 con 0x7f42480a66d0 2024-09-13T10:37:27.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f424e7fe640 5 monclient: authenticate success, global_id 104909 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f424e7fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient: dump: 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.824 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f424e7fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 1 -- 172.21.15.181:0/744649020 <== mon.5 v1:172.21.15.195:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42380048a0 con 0x7f42480a66d0 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f424e7fe640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f424e7fe640 4 set_mon_vals no callback set 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 1 -- 172.21.15.181:0/744649020 <== mon.5 v1:172.21.15.195:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4238004ed0 con 0x7f42480a66d0 2024-09-13T10:37:27.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.817+0000 7f4246ffd640 10 monclient: dump: 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.826 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.818+0000 7f424e7fe640 10 monclient: shutdown 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.818+0000 7f424e7fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.818+0000 7f424e7fe640 1 -- 172.21.15.181:0/744649020 >> v1:172.21.15.195:6791/0 conn(0x7f42480a66d0 legacy=0x7f42480a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.818+0000 7f424e7fe640 1 -- 172.21.15.181:0/744649020 shutdown_connections 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.818+0000 7f424e7fe640 1 -- 172.21.15.181:0/744649020 >> 172.21.15.181:0/744649020 conn(0x7f42480abcd0 msgr2=0x7f42480ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.818+0000 7f424e7fe640 1 -- 172.21.15.181:0/744649020 shutdown_connections 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.818+0000 7f424e7fe640 1 -- 172.21.15.181:0/744649020 wait complete. 2024-09-13T10:37:27.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.818+0000 7f424e7fe640 10 monclient: build_initial_monmap 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.818+0000 7f424e7fe640 10 monclient: monmap: 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:27.828 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 1 Processor -- start 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 1 -- start start 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 10 monclient: init 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 10 monclient: _add_conns ranks=[5,0,6,4,1,7,3,8,2] 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 10 monclient(hunting): picked mon.noname-h con 0x7f42480a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f42480a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 10 monclient(hunting): picked mon.noname-d con 0x7f424813f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f424813d0b0 con 0x7f42480a6ab0 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4248142f20 con 0x7f42480a66d0 2024-09-13T10:37:27.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f424813f410 con 0x7f424813f9a0 2024-09-13T10:37:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424cd9b640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f424813f9a0 legacy=0x7f42481d6440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:37:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f424e7fe640 10 monclient(hunting): authenticate will time out at 1187.324907s 2024-09-13T10:37:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f42477fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f42480a6ab0 0x7f424813bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:32862/0 (socket says 172.21.15.181:32862) 2024-09-13T10:37:27.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.819+0000 7f42477fe640 1 -- 172.21.15.181:0/2460337245 learned_addr learned my addr 172.21.15.181:0/2460337245 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f42477fe640 1 -- 172.21.15.181:0/2460337245 >> v1:172.21.15.181:6789/0 conn(0x7f42480a6ab0 legacy=0x7f424813bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4247fff640 1 -- 172.21.15.181:0/2460337245 >> v1:172.21.15.195:6791/0 conn(0x7f42480a66d0 legacy=0x7f424813b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2122714988 0 0) 0x7f424813d0b0 con 0x7f42480a6ab0 2024-09-13T10:37:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): my global_id is 114669 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4228003520 con 0x7f42480a6ab0 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843686222 0 0) 0x7f42481464e0 con 0x7f42480a66d0 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): my global_id is 104918 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f424813d0b0 con 0x7f42480a66d0 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1155623609 0 0) 0x7f4228003520 con 0x7f42480a6ab0 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42481464e0 con 0x7f42480a6ab0 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f42300046e0 con 0x7f42480a6ab0 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:27.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.836 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.837 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.837 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.837 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.837 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:27.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1401399911 0 0) 0x7f424813d0b0 con 0x7f42480a66d0 2024-09-13T10:37:27.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4228003520 con 0x7f42480a66d0 2024-09-13T10:37:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4238001b60 con 0x7f42480a66d0 2024-09-13T10:37:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:27.840 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.841 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2897628265 0 0) 0x7f42481464e0 con 0x7f42480a6ab0 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 >> v1:172.21.15.181:6792/0 conn(0x7f424813f9a0 legacy=0x7f42481d6440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 >> v1:172.21.15.195:6791/0 conn(0x7f42480a66d0 legacy=0x7f424813b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 monclient: found mon.a 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42481393c0 con 0x7f42480a6ab0 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient: _finish_auth 0 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f424e7fe640 5 monclient: authenticate success, global_id 114669 2024-09-13T10:37:27.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f424e7fe640 10 monclient: _renew_subs 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f424e7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f424e7fe640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f424813eb70 con 0x7f42480a6ab0 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f424e7fe640 10 monclient: _renew_subs 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f424e7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f424e7fe640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4248138e40 con 0x7f42480a6ab0 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4230004900 con 0x7f42480a6ab0 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4230004e30 con 0x7f42480a6ab0 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f42467fc640 4 set_mon_vals no callback set 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.822+0000 7f4244ff9640 10 monclient: dump: 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.843 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.823+0000 7f424e7fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.823+0000 7f424e7fe640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f422c0065c0 con 0x7f422c002860 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.823+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4230005140 con 0x7f42480a6ab0 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.823+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(228..228 src has 1..228) ==== 3898+0+0 (unknown 3216227338 0 0) 0x7f423004e440 con 0x7f42480a6ab0 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.824+0000 7f424cd9b640 10 monclient: get_auth_request con 0x7f42280400a0 auth_method 0 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.825+0000 7f4247fff640 1 -- 172.21.15.181:0/2460337245 >> v1:172.21.15.195:6792/0 conn(0x7f422c002860 legacy=0x7f422c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2972816927 0 0) 0x7f422c0065c0 con 0x7f422c002860 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 10 monclient(hunting): my global_id is 56977 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42481464e0 con 0x7f422c002860 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3179875633 0 0) 0x7f42481464e0 con 0x7f422c002860 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f422c0065c0 con 0x7f422c002860 2024-09-13T10:37:27.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4238001320 con 0x7f422c002860 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 10 monclient: dump: 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.846 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1031530215 0 0) 0x7f422c0065c0 con 0x7f422c002860 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.826+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f422c00a160 con 0x7f422c002860 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.827+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4238005540 con 0x7f422c002860 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.827+0000 7f4244ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.827+0000 7f4244ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.827+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 >> v1:172.21.15.195:6792/0 conn(0x7f422c002860 legacy=0x7f422c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.827+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 >> v1:172.21.15.195:6792/0 conn(0x7f422c002860 legacy=0x7f422c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.832+0000 7f424e7fe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:27.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.832+0000 7f424e7fe640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f422c009e70 con 0x7f422c009130 2024-09-13T10:37:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.835+0000 7f4247fff640 1 -- 172.21.15.181:0/2460337245 >> v1:172.21.15.195:6792/0 conn(0x7f422c009130 legacy=0x7f422c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.835+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2656571039 0 0) 0x7f422c009e70 con 0x7f422c009130 2024-09-13T10:37:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.835+0000 7f4244ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.835+0000 7f4244ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.835+0000 7f4244ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.835+0000 7f4244ff9640 10 monclient(hunting): my global_id is 56986 2024-09-13T10:37:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.835+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f422c0065c0 con 0x7f422c009130 2024-09-13T10:37:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2894128006 0 0) 0x7f422c0065c0 con 0x7f422c009130 2024-09-13T10:37:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f422c009e70 con 0x7f422c009130 2024-09-13T10:37:27.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4238005cb0 con 0x7f422c009130 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 10 monclient: dump: 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:27.850 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:27.851 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 733850148 0 0) 0x7f422c009e70 con 0x7f422c009130 2024-09-13T10:37:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f422c00c410 con 0x7f422c009130 2024-09-13T10:37:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7685 (unknown 0 0 3469936954) 0x7f4238007160 con 0x7f422c009130 2024-09-13T10:37:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 >> v1:172.21.15.195:6792/0 conn(0x7f422c009130 legacy=0x7f422c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f4244ff9640 1 -- 172.21.15.181:0/2460337245 >> v1:172.21.15.195:6792/0 conn(0x7f422c009130 legacy=0x7f422c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:27.851 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 116, 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 462256, 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.852 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.853 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.854 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:27.855 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:27.856 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.857 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:27.858 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:27.860 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.861 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:27.863 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:27.867 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:27.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.869 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:27.870 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f424e7fe640 1 -- 172.21.15.181:0/2460337245 >> v1:172.21.15.195:6800/1839191919 conn(0x7f42280400a0 legacy=0x7f4228042560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f424e7fe640 10 monclient: shutdown 2024-09-13T10:37:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f424e7fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f424e7fe640 1 -- 172.21.15.181:0/2460337245 >> v1:172.21.15.181:6789/0 conn(0x7f42480a6ab0 legacy=0x7f424813bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f424cd9b640 1 -- 172.21.15.181:0/2460337245 reap_dead start 2024-09-13T10:37:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f424cd9b640 1 -- 172.21.15.181:0/2460337245 reap_dead start 2024-09-13T10:37:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f424e7fe640 1 -- 172.21.15.181:0/2460337245 shutdown_connections 2024-09-13T10:37:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.836+0000 7f424e7fe640 1 -- 172.21.15.181:0/2460337245 >> 172.21.15.181:0/2460337245 conn(0x7f42480abcd0 msgr2=0x7f42481385b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.837+0000 7f424e7fe640 1 -- 172.21.15.181:0/2460337245 shutdown_connections 2024-09-13T10:37:27.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:27.837+0000 7f424e7fe640 1 -- 172.21.15.181:0/2460337245 wait complete. 2024-09-13T10:37:27.873 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-13T10:37:27.873 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T10:37:27.881 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39234]: starting. 2024-09-13T10:37:27.881 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39234]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39232 2024-09-13T10:37:27.881 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39234]: shutting down. 2024-09-13T10:37:30.002 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:30.002 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39269]: starting. 2024-09-13T10:37:30.002 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39269]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39232 2024-09-13T10:37:30.002 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39269]: created object 0... 2024-09-13T10:37:30.002 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39269]: created object 25... 2024-09-13T10:37:30.002 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39269]: created object 49... 2024-09-13T10:37:30.002 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39269]: finishing. 2024-09-13T10:37:30.002 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39269]: shutting down. 2024-09-13T10:37:30.872 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:30.872 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39271]: starting. 2024-09-13T10:37:30.872 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39271]: listing objects. 2024-09-13T10:37:30.872 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39271]: listed object 0... 2024-09-13T10:37:30.872 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39271]: listed object 25... 2024-09-13T10:37:30.872 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39271]: saw 50 objects 2024-09-13T10:37:30.872 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39271]: shutting down. 2024-09-13T10:37:31.974 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:31.974 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39270]: starting. 2024-09-13T10:37:31.974 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39270]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39232 2024-09-13T10:37:31.974 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39270]: shutting down. 2024-09-13T10:37:31.977 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:31.977 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:31.977 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:37:31.979 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:37:34.090 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39342]: starting. 2024-09-13T10:37:34.090 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39342]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39340 2024-09-13T10:37:34.090 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39342]: created object 0... 2024-09-13T10:37:34.090 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39342]: created object 25... 2024-09-13T10:37:34.090 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39342]: created object 49... 2024-09-13T10:37:34.091 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39342]: finishing. 2024-09-13T10:37:34.091 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39342]: shutting down. 2024-09-13T10:37:34.982 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39343]: starting. 2024-09-13T10:37:34.982 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39343]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39340 2024-09-13T10:37:34.982 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39343]: shutting down. 2024-09-13T10:37:37.622 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:37.622 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39379]: starting. 2024-09-13T10:37:37.622 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39379]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39340 2024-09-13T10:37:37.622 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39379]: created object 0... 2024-09-13T10:37:37.622 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39379]: created object 25... 2024-09-13T10:37:37.622 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39379]: created object 49... 2024-09-13T10:37:37.622 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39379]: finishing. 2024-09-13T10:37:37.623 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39379]: shutting down. 2024-09-13T10:37:37.660 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:37.660 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39381]: starting. 2024-09-13T10:37:37.660 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39381]: listing objects. 2024-09-13T10:37:37.660 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39381]: listed object 0... 2024-09-13T10:37:37.660 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39381]: listed object 25... 2024-09-13T10:37:37.660 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39381]: saw 50 objects 2024-09-13T10:37:37.660 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39381]: shutting down. 2024-09-13T10:37:38.931 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:38.931 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39380]: starting. 2024-09-13T10:37:38.931 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39380]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39340 2024-09-13T10:37:38.932 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39380]: shutting down. 2024-09-13T10:37:38.933 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:38.933 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:38.933 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:37:38.936 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:37:41.035 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39450]: starting. 2024-09-13T10:37:41.036 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39450]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39449 2024-09-13T10:37:41.036 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39450]: created object 0... 2024-09-13T10:37:41.036 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39450]: created object 25... 2024-09-13T10:37:41.036 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39450]: created object 49... 2024-09-13T10:37:41.036 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39450]: finishing. 2024-09-13T10:37:41.036 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39450]: shutting down. 2024-09-13T10:37:41.067 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39451]: starting. 2024-09-13T10:37:41.068 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39451]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39449 2024-09-13T10:37:41.068 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39451]: shutting down. 2024-09-13T10:37:43.464 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:43.464 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39486]: starting. 2024-09-13T10:37:43.464 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39486]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39449 2024-09-13T10:37:43.464 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39486]: created object 0... 2024-09-13T10:37:43.464 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39486]: created object 25... 2024-09-13T10:37:43.465 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39486]: created object 49... 2024-09-13T10:37:43.465 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39486]: finishing. 2024-09-13T10:37:43.465 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39486]: shutting down. 2024-09-13T10:37:44.131 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:44.132 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39488]: starting. 2024-09-13T10:37:44.132 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39488]: listing objects. 2024-09-13T10:37:44.132 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39488]: listed object 0... 2024-09-13T10:37:44.132 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39488]: listed object 25... 2024-09-13T10:37:44.132 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39488]: saw 50 objects 2024-09-13T10:37:44.132 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39488]: shutting down. 2024-09-13T10:37:44.370 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:44.370 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39487]: starting. 2024-09-13T10:37:44.370 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39487]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39449 2024-09-13T10:37:44.370 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39487]: shutting down. 2024-09-13T10:37:44.371 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:44.372 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:44.372 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:37:44.374 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:37:46.494 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39557]: starting. 2024-09-13T10:37:46.494 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39557]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39556 2024-09-13T10:37:46.494 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39557]: created object 0... 2024-09-13T10:37:46.495 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39557]: created object 25... 2024-09-13T10:37:46.495 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39557]: created object 49... 2024-09-13T10:37:46.495 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39557]: finishing. 2024-09-13T10:37:46.495 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39557]: shutting down. 2024-09-13T10:37:47.396 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39558]: starting. 2024-09-13T10:37:47.396 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39558]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39556 2024-09-13T10:37:47.396 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39558]: shutting down. 2024-09-13T10:37:47.874 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2024-09-13T10:37:47.874 INFO:tasks.ceph.mon.g:Restarting daemon 2024-09-13T10:37:47.874 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-09-13T10:37:47.877 INFO:tasks.ceph.mon.g:Started 2024-09-13T10:37:47.877 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-09-13T10:37:47.877 INFO:tasks.ceph.mon.d:Restarting daemon 2024-09-13T10:37:47.878 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-09-13T10:37:47.881 INFO:tasks.ceph.mon.d:Started 2024-09-13T10:37:47.881 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2024-09-13T10:37:47.881 INFO:tasks.ceph.mon.f:Restarting daemon 2024-09-13T10:37:47.881 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-09-13T10:37:47.883 INFO:tasks.ceph.mon.f:Started 2024-09-13T10:37:47.883 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-13T10:37:47.883 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T10:37:47.883 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T10:37:47.886 INFO:tasks.ceph.mon.b:Started 2024-09-13T10:37:47.886 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:37:47.886 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:37:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.015+0000 7f8c9a659640 10 monclient: get_monmap_and_config 2024-09-13T10:37:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.015+0000 7f8c9a659640 10 monclient: build_initial_monmap 2024-09-13T10:37:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.015+0000 7f8c9a659640 10 monclient: monmap: 2024-09-13T10:37:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:48.015831+0000 2024-09-13T10:37:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:48.015831+0000 2024-09-13T10:37:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:48.018 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:48.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 1 Processor -- start 2024-09-13T10:37:48.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 1 -- start start 2024-09-13T10:37:48.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 10 monclient: init 2024-09-13T10:37:48.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:48.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 10 monclient: _add_conns ranks=[0,5,2,6,8,1,4,3,7] 2024-09-13T10:37:48.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 10 monclient(hunting): picked mon.noname-a con 0x7f8c940a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:48.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 10 monclient(hunting): picked mon.noname-h con 0x7f8c940a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:48.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 10 monclient(hunting): picked mon.noname-b con 0x7f8c9413f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:48.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c940a4bc0 con 0x7f8c940a6640 2024-09-13T10:37:48.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c9413a320 con 0x7f8c9413f750 2024-09-13T10:37:48.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c940a8100 con 0x7f8c940a8340 2024-09-13T10:37:48.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:48.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c9a659640 10 monclient(hunting): authenticate will time out at 1207.521855s 2024-09-13T10:37:48.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c98bf6640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f8c9413f750 0x7f8c94141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:41494/0 (socket says 172.21.15.181:41494) 2024-09-13T10:37:48.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c98bf6640 1 -- 172.21.15.181:0/2961379095 learned_addr learned my addr 172.21.15.181:0/2961379095 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:48.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.016+0000 7f8c937fe640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f8c940a8340 0x7f8c94139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:53156/0 (socket says 172.21.15.181:53156) 2024-09-13T10:37:48.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.019+0000 7f8c937fe640 1 -- 172.21.15.181:0/2961379095 >> v1:172.21.15.195:6791/0 conn(0x7f8c940a8340 legacy=0x7f8c94139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:48.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.019+0000 7f8c98bf6640 1 -- 172.21.15.181:0/2961379095 >> v1:172.21.15.181:6790/0 conn(0x7f8c9413f750 legacy=0x7f8c94141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:48.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:48.021+0000 7f8c93fff640 1 -- 172.21.15.181:0/2961379095 >> v1:172.21.15.181:6789/0 conn(0x7f8c940a6640 legacy=0x7f8c94139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:51.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.016+0000 7f8c91ffb640 10 monclient(hunting): tick 2024-09-13T10:37:51.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.016+0000 7f8c91ffb640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:37:51.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.016+0000 7f8c91ffb640 1 monclient(hunting): continuing hunt 2024-09-13T10:37:51.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.016+0000 7f8c91ffb640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:37:51.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.016+0000 7f8c91ffb640 1 -- 172.21.15.181:0/2961379095 >> v1:172.21.15.195:6791/0 conn(0x7f8c940a8340 legacy=0x7f8c94139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:51.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.017+0000 7f8c91ffb640 1 -- 172.21.15.181:0/2961379095 >> v1:172.21.15.181:6790/0 conn(0x7f8c9413f750 legacy=0x7f8c94141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:51.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.017+0000 7f8c91ffb640 1 -- 172.21.15.181:0/2961379095 >> v1:172.21.15.181:6789/0 conn(0x7f8c940a6640 legacy=0x7f8c94139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:51.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.017+0000 7f8c91ffb640 10 monclient: _add_conns ranks=[8,3,1,7,6,4] 2024-09-13T10:37:51.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.017+0000 7f8c91ffb640 10 monclient(hunting): picked mon.noname-e con 0x7f8c80003960 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:51.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.017+0000 7f8c91ffb640 10 monclient(hunting): picked mon.noname-g con 0x7f8c800075d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:51.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.017+0000 7f8c91ffb640 10 monclient(hunting): picked mon.noname-f con 0x7f8c8000b320 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:51.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.017+0000 7f8c91ffb640 1 -- 172.21.15.181:0/2961379095 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c940a48e0 con 0x7f8c8000b320 2024-09-13T10:37:51.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.017+0000 7f8c91ffb640 1 -- 172.21.15.181:0/2961379095 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c80010160 con 0x7f8c800075d0 2024-09-13T10:37:51.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.017+0000 7f8c91ffb640 1 -- 172.21.15.181:0/2961379095 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c80011400 con 0x7f8c80003960 2024-09-13T10:37:51.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.017+0000 7f8c91ffb640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:51.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.019+0000 7f8c93fff640 1 -- 172.21.15.181:0/2961379095 >> v1:172.21.15.181:6793/0 conn(0x7f8c80003960 legacy=0x7f8c80005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:51.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.019+0000 7f8c937fe640 1 -- 172.21.15.181:0/2961379095 >> v1:172.21.15.195:6790/0 conn(0x7f8c800075d0 legacy=0x7f8c80009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:51.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:51.019+0000 7f8c98bf6640 1 -- 172.21.15.181:0/2961379095 >> v1:172.21.15.195:6789/0 conn(0x7f8c8000b320 legacy=0x7f8c8000d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:53.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.004+0000 7f8c92ffd640 1 -- 172.21.15.181:0/2961379095 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4260413554 0 0) 0x7f8c80011400 con 0x7f8c80003960 2024-09-13T10:37:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.004+0000 7f8c92ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.004+0000 7f8c92ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.004+0000 7f8c92ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.004+0000 7f8c92ffd640 10 monclient(hunting): my global_id is 105191 2024-09-13T10:37:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 1 -- 172.21.15.181:0/2961379095 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c7c003520 con 0x7f8c80003960 2024-09-13T10:37:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 1 -- 172.21.15.181:0/2961379095 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1385370620 0 0) 0x7f8c7c003520 con 0x7f8c80003960 2024-09-13T10:37:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 1 -- 172.21.15.181:0/2961379095 >> v1:172.21.15.195:6790/0 conn(0x7f8c800075d0 legacy=0x7f8c80009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 1 -- 172.21.15.181:0/2961379095 >> v1:172.21.15.195:6789/0 conn(0x7f8c8000b320 legacy=0x7f8c8000d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 1 monclient: found mon.noname-e 2024-09-13T10:37:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:53.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 1 -- 172.21.15.181:0/2961379095 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c80012760 con 0x7f8c80003960 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c98bf6640 1 -- 172.21.15.181:0/2961379095 reap_dead start 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 1 -- 172.21.15.181:0/2961379095 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8c8c001e70 con 0x7f8c80003960 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 10 monclient: dump: 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.009 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c9a659640 5 monclient: authenticate success, global_id 105191 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c9a659640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:53.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 1 -- 172.21.15.181:0/2961379095 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c8c003990 con 0x7f8c80003960 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 1 -- 172.21.15.181:0/2961379095 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8c8c003e80 con 0x7f8c80003960 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c92ffd640 10 monclient: dump: 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:53.011 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c9a659640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.005+0000 7f8c9a659640 4 set_mon_vals no callback set 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.006+0000 7f8c9a659640 10 monclient: shutdown 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.006+0000 7f8c9a659640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.006+0000 7f8c9a659640 1 -- 172.21.15.181:0/2961379095 >> v1:172.21.15.181:6793/0 conn(0x7f8c80003960 legacy=0x7f8c80005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.006+0000 7f8c9a659640 1 -- 172.21.15.181:0/2961379095 shutdown_connections 2024-09-13T10:37:53.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.006+0000 7f8c9a659640 1 -- 172.21.15.181:0/2961379095 >> 172.21.15.181:0/2961379095 conn(0x7f8c94077170 msgr2=0x7f8c940abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.006+0000 7f8c9a659640 1 -- 172.21.15.181:0/2961379095 shutdown_connections 2024-09-13T10:37:53.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.006+0000 7f8c9a659640 1 -- 172.21.15.181:0/2961379095 wait complete. 2024-09-13T10:37:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.007+0000 7f8c9a659640 10 monclient: build_initial_monmap 2024-09-13T10:37:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.007+0000 7f8c9a659640 10 monclient: monmap: 2024-09-13T10:37:53.014 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:53.015 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.007+0000 7f8c9a659640 1 Processor -- start 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c9a659640 1 -- start start 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c9a659640 10 monclient: init 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c9a659640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c9a659640 10 monclient: _add_conns ranks=[6,0,3,8,4,2,1,5,7] 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c9a659640 10 monclient(hunting): picked mon.noname-d con 0x7f8c9409f460 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c9a659640 10 monclient(hunting): picked mon.noname-a con 0x7f8c9409ff50 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c9a659640 10 monclient(hunting): picked mon.noname-g con 0x7f8c941d5240 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c9a659640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c94122670 con 0x7f8c9409ff50 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c9a659640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c94122950 con 0x7f8c941d5240 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c9a659640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c940aa720 con 0x7f8c9409f460 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c9a659640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:53.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c9a659640 10 monclient(hunting): authenticate will time out at 1212.513840s 2024-09-13T10:37:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c937fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8c9409ff50 0x7f8c941d3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:54654/0 (socket says 172.21.15.181:54654) 2024-09-13T10:37:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.008+0000 7f8c937fe640 1 -- 172.21.15.181:0/1520204263 learned_addr learned my addr 172.21.15.181:0/1520204263 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.011+0000 7f8c93fff640 1 -- 172.21.15.181:0/1520204263 >> v1:172.21.15.181:6792/0 conn(0x7f8c9409f460 legacy=0x7f8c9409f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.011+0000 7f8c98bf6640 1 -- 172.21.15.181:0/1520204263 >> v1:172.21.15.195:6790/0 conn(0x7f8c941d5240 legacy=0x7f8c941d7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:53.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.011+0000 7f8c937fe640 1 -- 172.21.15.181:0/1520204263 >> v1:172.21.15.181:6789/0 conn(0x7f8c9409ff50 legacy=0x7f8c941d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:53.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4091960845 0 0) 0x7f8c94122670 con 0x7f8c9409ff50 2024-09-13T10:37:53.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:53.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:53.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:53.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 10 monclient(hunting): my global_id is 114840 2024-09-13T10:37:53.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c80010410 con 0x7f8c9409ff50 2024-09-13T10:37:53.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4092989242 0 0) 0x7f8c80010410 con 0x7f8c9409ff50 2024-09-13T10:37:53.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c94122670 con 0x7f8c9409ff50 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8c88001d40 con 0x7f8c9409ff50 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:53.041 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.037+0000 7f8c90ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3478559468 0 0) 0x7f8c94122670 con 0x7f8c9409ff50 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 >> v1:172.21.15.181:6792/0 conn(0x7f8c9409f460 legacy=0x7f8c9409f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 >> v1:172.21.15.195:6790/0 conn(0x7f8c941d5240 legacy=0x7f8c941d7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 1 monclient: found mon.a 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:53.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c940a2410 con 0x7f8c9409ff50 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 10 monclient: _finish_auth 0 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c9a659640 5 monclient: authenticate success, global_id 114840 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c9a659640 10 monclient: _renew_subs 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c9a659640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c9a659640 1 -- 172.21.15.181:0/1520204263 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8c94122390 con 0x7f8c9409ff50 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c9a659640 10 monclient: _renew_subs 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c9a659640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c9a659640 1 -- 172.21.15.181:0/1520204263 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8c94123140 con 0x7f8c9409ff50 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c88004c20 con 0x7f8c9409ff50 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:53.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8c88005150 con 0x7f8c9409ff50 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c927fc640 4 set_mon_vals no callback set 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.038+0000 7f8c90ff9640 10 monclient: dump: 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:53.044 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:53.045 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:53.045 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.039+0000 7f8c9a659640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.039+0000 7f8c9a659640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.039+0000 7f8c9a659640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.040+0000 7f8c9a659640 1 -- 172.21.15.181:0/1520204263 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c74005080 con 0x7f8c9409ff50 2024-09-13T10:37:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.040+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f8c880052f0 con 0x7f8c9409ff50 2024-09-13T10:37:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.040+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(247..247 src has 1..247) ==== 3506+0+0 (unknown 3444397427 0 0) 0x7f8c8804e060 con 0x7f8c9409ff50 2024-09-13T10:37:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.040+0000 7f8c93fff640 10 monclient: get_auth_request con 0x7f8c800414e0 auth_method 0 2024-09-13T10:37:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.045+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f8c880176d0 con 0x7f8c9409ff50 2024-09-13T10:37:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.045+0000 7f8c90ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:53.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.045+0000 7f8c90ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:53.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.293+0000 7f8c9a659640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:37:53.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.293+0000 7f8c9a659640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:53.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.293+0000 7f8c9a659640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:53.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.293+0000 7f8c9a659640 1 -- 172.21.15.181:0/1520204263 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8c74005370 con 0x7f8c9409ff50 2024-09-13T10:37:53.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.294+0000 7f8c90ff9640 1 -- 172.21.15.181:0/1520204263 <== mon.0 v1:172.21.15.181:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 2419635811) 0x7f8c88016fd0 con 0x7f8c9409ff50 2024-09-13T10:37:53.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.294+0000 7f8c90ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:53.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.294+0000 7f8c90ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:53.296 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":120,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:37:53.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.296+0000 7f8c9a659640 1 -- 172.21.15.181:0/1520204263 >> v1:172.21.15.195:6800/1839191919 conn(0x7f8c800414e0 legacy=0x7f8c800439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:53.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.296+0000 7f8c9a659640 10 monclient: shutdown 2024-09-13T10:37:53.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.296+0000 7f8c9a659640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:53.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.296+0000 7f8c9a659640 1 -- 172.21.15.181:0/1520204263 >> v1:172.21.15.181:6789/0 conn(0x7f8c9409ff50 legacy=0x7f8c941d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:53.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.296+0000 7f8c9a659640 1 -- 172.21.15.181:0/1520204263 shutdown_connections 2024-09-13T10:37:53.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.296+0000 7f8c9a659640 1 -- 172.21.15.181:0/1520204263 >> 172.21.15.181:0/1520204263 conn(0x7f8c80003960 msgr2=0x7f8c940aa930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:53.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.296+0000 7f8c9a659640 1 -- 172.21.15.181:0/1520204263 shutdown_connections 2024-09-13T10:37:53.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.296+0000 7f8c9a659640 1 -- 172.21.15.181:0/1520204263 wait complete. 2024-09-13T10:37:53.308 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:37:53.308 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:37:53.308 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:37:53.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.406+0000 7fcf0a095640 10 monclient: get_monmap_and_config 2024-09-13T10:37:53.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.406+0000 7fcf0a095640 10 monclient: build_initial_monmap 2024-09-13T10:37:53.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.406+0000 7fcf0a095640 10 monclient: monmap: 2024-09-13T10:37:53.408 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:53.408 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:53.408 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:53.406912+0000 2024-09-13T10:37:53.408 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:53.406912+0000 2024-09-13T10:37:53.408 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:53.408 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:53.408 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:53.408 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:53.408 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:53.408 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:53.409 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:53.409 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:53.409 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:53.409 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:53.409 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:53.409 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:53.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 1 Processor -- start 2024-09-13T10:37:53.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 1 -- start start 2024-09-13T10:37:53.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 10 monclient: init 2024-09-13T10:37:53.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:53.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 10 monclient: _add_conns ranks=[0,5,6,7,2,1,4,8,3] 2024-09-13T10:37:53.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 10 monclient(hunting): picked mon.noname-a con 0x7fcf040a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:53.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 10 monclient(hunting): picked mon.noname-h con 0x7fcf040a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:53.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 10 monclient(hunting): picked mon.noname-d con 0x7fcf0413f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:53.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf040a5fe0 con 0x7fcf040a66d0 2024-09-13T10:37:53.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf040a8080 con 0x7fcf040a6ab0 2024-09-13T10:37:53.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf040a42c0 con 0x7fcf0413f9a0 2024-09-13T10:37:53.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:53.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf0a095640 10 monclient(hunting): authenticate will time out at 1212.912776s 2024-09-13T10:37:53.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf037fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fcf040a66d0 0x7fcf040a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36746/0 (socket says 172.21.15.181:36746) 2024-09-13T10:37:53.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.407+0000 7fcf037fe640 1 -- 172.21.15.181:0/4245263372 learned_addr learned my addr 172.21.15.181:0/4245263372 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:53.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.410+0000 7fcf037fe640 1 -- 172.21.15.181:0/4245263372 >> v1:172.21.15.181:6789/0 conn(0x7fcf040a66d0 legacy=0x7fcf040a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:53.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.410+0000 7fcf03fff640 1 -- 172.21.15.181:0/4245263372 >> v1:172.21.15.181:6792/0 conn(0x7fcf0413f9a0 legacy=0x7fcf04141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:53.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.410+0000 7fcefbfff640 1 -- 172.21.15.181:0/4245263372 >> v1:172.21.15.195:6791/0 conn(0x7fcf040a6ab0 legacy=0x7fcf040a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 1 -- 172.21.15.181:0/4245263372 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2945479185 0 0) 0x7fcf040a5fe0 con 0x7fcf040a66d0 2024-09-13T10:37:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:53.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient(hunting): my global_id is 114849 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 1 -- 172.21.15.181:0/4245263372 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcef0003520 con 0x7fcf040a66d0 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 1 -- 172.21.15.181:0/4245263372 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1901990652 0 0) 0x7fcf040a8080 con 0x7fcf040a6ab0 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient(hunting): my global_id is 105044 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 1 -- 172.21.15.181:0/4245263372 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf040a5fe0 con 0x7fcf040a6ab0 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 1 -- 172.21.15.181:0/4245263372 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 882837204 0 0) 0x7fcef0003520 con 0x7fcf040a66d0 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 1 -- 172.21.15.181:0/4245263372 >> v1:172.21.15.181:6792/0 conn(0x7fcf0413f9a0 legacy=0x7fcf04141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 1 -- 172.21.15.181:0/4245263372 >> v1:172.21.15.195:6791/0 conn(0x7fcf040a6ab0 legacy=0x7fcf040a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:53.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 1 monclient: found mon.noname-a 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 1 -- 172.21.15.181:0/4245263372 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf041464e0 con 0x7fcf040a66d0 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 1 -- 172.21.15.181:0/4245263372 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcef4001ad0 con 0x7fcf040a66d0 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.494+0000 7fcf02ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf02ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf02ffd640 10 monclient: dump: 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.498 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf02ffd640 1 -- 172.21.15.181:0/4245263372 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcef40048a0 con 0x7fcf040a66d0 2024-09-13T10:37:53.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf02ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf02ffd640 1 -- 172.21.15.181:0/4245263372 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcef4004e10 con 0x7fcf040a66d0 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf02ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf02ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf02ffd640 10 monclient: dump: 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:53.500 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:53.501 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf0a095640 5 monclient: authenticate success, global_id 114849 2024-09-13T10:37:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf0a095640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:53.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf0a095640 4 set_mon_vals no callback set 2024-09-13T10:37:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf0a095640 10 monclient: shutdown 2024-09-13T10:37:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf0a095640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf0a095640 1 -- 172.21.15.181:0/4245263372 >> v1:172.21.15.181:6789/0 conn(0x7fcf040a66d0 legacy=0x7fcf040a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf0a095640 1 -- 172.21.15.181:0/4245263372 shutdown_connections 2024-09-13T10:37:53.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf0a095640 1 -- 172.21.15.181:0/4245263372 >> 172.21.15.181:0/4245263372 conn(0x7fcf040abcd0 msgr2=0x7fcf040ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.495+0000 7fcf0a095640 1 -- 172.21.15.181:0/4245263372 shutdown_connections 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.496+0000 7fcf0a095640 1 -- 172.21.15.181:0/4245263372 wait complete. 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.496+0000 7fcf0a095640 10 monclient: build_initial_monmap 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.496+0000 7fcf0a095640 10 monclient: monmap: 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:53.507 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:53.508 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:53.508 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:53.508 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:53.508 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:53.508 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:53.508 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:53.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 1 Processor -- start 2024-09-13T10:37:53.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 1 -- start start 2024-09-13T10:37:53.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 10 monclient: init 2024-09-13T10:37:53.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:53.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 10 monclient: _add_conns ranks=[3,6,1,5,4,2,8,0,7] 2024-09-13T10:37:53.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 10 monclient(hunting): picked mon.noname-g con 0x7fcf040a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:53.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 10 monclient(hunting): picked mon.noname-d con 0x7fcf040a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:53.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 10 monclient(hunting): picked mon.noname-f con 0x7fcf0413f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:53.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf0413f230 con 0x7fcf0413f9a0 2024-09-13T10:37:53.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf04142fb0 con 0x7fcf040a66d0 2024-09-13T10:37:53.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf04137600 con 0x7fcf040a6ab0 2024-09-13T10:37:53.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:53.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcf0a095640 10 monclient(hunting): authenticate will time out at 1213.002715s 2024-09-13T10:37:53.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcefbfff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fcf040a6ab0 0x7fcf041d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:49150/0 (socket says 172.21.15.181:49150) 2024-09-13T10:37:53.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.497+0000 7fcefbfff640 1 -- 172.21.15.181:0/406321840 learned_addr learned my addr 172.21.15.181:0/406321840 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:53.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.499+0000 7fcefbfff640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.181:6792/0 conn(0x7fcf040a6ab0 legacy=0x7fcf041d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:53.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.499+0000 7fcf03fff640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.195:6789/0 conn(0x7fcf0413f9a0 legacy=0x7fcf041d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:53.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.499+0000 7fcf037fe640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.195:6790/0 conn(0x7fcf040a66d0 legacy=0x7fcf040a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:53.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180253921 0 0) 0x7fcf0413f230 con 0x7fcf0413f9a0 2024-09-13T10:37:53.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:53.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:53.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:53.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient(hunting): my global_id is 134101 2024-09-13T10:37:53.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcee4003550 con 0x7fcf0413f9a0 2024-09-13T10:37:53.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1165122484 0 0) 0x7fcee4003550 con 0x7fcf0413f9a0 2024-09-13T10:37:53.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf0413f230 con 0x7fcf0413f9a0 2024-09-13T10:37:53.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcefc002060 con 0x7fcf0413f9a0 2024-09-13T10:37:53.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:53.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:37:53.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:53.511 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:53.511 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:53.511 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.511 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.511 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:53.511 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:53.511 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:53.511 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:53.511 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:53.511 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:53.511 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3313457023 0 0) 0x7fcf0413f230 con 0x7fcf0413f9a0 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.181:6792/0 conn(0x7fcf040a6ab0 legacy=0x7fcf041d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.195:6790/0 conn(0x7fcf040a66d0 legacy=0x7fcf040a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 1 monclient: found mon.f 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:53.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf04068760 con 0x7fcf0413f9a0 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient: _finish_auth 0 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf0a095640 5 monclient: authenticate success, global_id 134101 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf0a095640 10 monclient: _renew_subs 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf0a095640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf0a095640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcf040a2570 con 0x7fcf0413f9a0 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf0a095640 10 monclient: _renew_subs 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf0a095640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf0a095640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcf0413def0 con 0x7fcf0413f9a0 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcefc003d80 con 0x7fcf0413f9a0 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcefc004370 con 0x7fcf0413f9a0 2024-09-13T10:37:53.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf027fc640 4 set_mon_vals no callback set 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.500+0000 7fcf00ff9640 10 monclient: dump: 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:53.515 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:53.515 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:53.515 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:53.515 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:53.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.501+0000 7fcf0a095640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:53.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.501+0000 7fcf0a095640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcee80065c0 con 0x7fcee8002860 2024-09-13T10:37:53.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.501+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fcefc004590 con 0x7fcf0413f9a0 2024-09-13T10:37:53.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.501+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(247..247 src has 1..247) ==== 3506+0+0 (unknown 3444397427 0 0) 0x7fcefc04e5c0 con 0x7fcf0413f9a0 2024-09-13T10:37:53.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.502+0000 7fcefbfff640 10 monclient: get_auth_request con 0x7fcee403fac0 auth_method 0 2024-09-13T10:37:53.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.503+0000 7fcf037fe640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.181:6789/0 conn(0x7fcee8002860 legacy=0x7fcee8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:53.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.996+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3729640132 0 0) 0x7fcee80065c0 con 0x7fcee8002860 2024-09-13T10:37:53.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.996+0000 7fcf00ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:53.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.996+0000 7fcf00ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:53.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.996+0000 7fcf00ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:53.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.996+0000 7fcf00ff9640 10 monclient(hunting): my global_id is 114858 2024-09-13T10:37:53.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.997+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf0413f230 con 0x7fcee8002860 2024-09-13T10:37:53.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.997+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4231396384 0 0) 0x7fcf0413f230 con 0x7fcee8002860 2024-09-13T10:37:53.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.997+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcee80065c0 con 0x7fcee8002860 2024-09-13T10:37:53.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.997+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcef4001d20 con 0x7fcee8002860 2024-09-13T10:37:53.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.997+0000 7fcf00ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.997+0000 7fcf00ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.997+0000 7fcf00ff9640 10 monclient: dump: 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.000 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.001 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.997+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2924056065 0 0) 0x7fcee80065c0 con 0x7fcee8002860 2024-09-13T10:37:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.997+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcee800a160 con 0x7fcee8002860 2024-09-13T10:37:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.998+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fcef4001d20 con 0x7fcee8002860 2024-09-13T10:37:54.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.998+0000 7fcf00ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:54.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.998+0000 7fcf00ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:54.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.998+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.181:6789/0 conn(0x7fcee8002860 legacy=0x7fcee8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:53.998+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.181:6789/0 conn(0x7fcee8002860 legacy=0x7fcee8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:54.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.004+0000 7fcf0a095640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:54.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.004+0000 7fcf0a095640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcee8009e50 con 0x7fcee8009110 2024-09-13T10:37:54.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf037fe640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.181:6789/0 conn(0x7fcee8009110 legacy=0x7fcee80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 691847605 0 0) 0x7fcee8009e50 con 0x7fcee8009110 2024-09-13T10:37:54.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 10 monclient(hunting): my global_id is 114867 2024-09-13T10:37:54.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcee80065c0 con 0x7fcee8009110 2024-09-13T10:37:54.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 980799804 0 0) 0x7fcee80065c0 con 0x7fcee8009110 2024-09-13T10:37:54.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcee8009e50 con 0x7fcee8009110 2024-09-13T10:37:54.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcef4004ee0 con 0x7fcee8009110 2024-09-13T10:37:54.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:54.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 10 monclient: dump: 2024-09-13T10:37:54.010 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.010 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.011 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.011 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.011 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.011 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.011 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.011 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.011 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.011 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.011 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.011 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.011 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.011 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.012 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.012 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2020758529 0 0) 0x7fcee8009e50 con 0x7fcee8009110 2024-09-13T10:37:54.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.007+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcee800c3a0 con 0x7fcee8009110 2024-09-13T10:37:54.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 1336214429) 0x7fcef4008600 con 0x7fcee8009110 2024-09-13T10:37:54.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf00ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:54.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf00ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:54.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.181:6789/0 conn(0x7fcee8009110 legacy=0x7fcee80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf00ff9640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.181:6789/0 conn(0x7fcee8009110 legacy=0x7fcee80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:54.012 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 109986, 2024-09-13T10:37:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:54.013 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:37:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:54.014 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.015 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.016 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:54.017 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.018 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.019 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.020 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.021 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:54.023 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.024 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.026 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.027 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.028 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.029 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.030 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:54.031 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:54.032 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.033 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:54.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.035 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:54.035 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:54.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf0a095640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.195:6800/1839191919 conn(0x7fcee403fac0 legacy=0x7fcee4041f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf0a095640 10 monclient: shutdown 2024-09-13T10:37:54.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf0a095640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:54.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf0a095640 1 -- 172.21.15.181:0/406321840 >> v1:172.21.15.195:6789/0 conn(0x7fcf0413f9a0 legacy=0x7fcf041d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf03fff640 1 -- 172.21.15.181:0/406321840 reap_dead start 2024-09-13T10:37:54.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf0a095640 1 -- 172.21.15.181:0/406321840 shutdown_connections 2024-09-13T10:37:54.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf0a095640 1 -- 172.21.15.181:0/406321840 >> 172.21.15.181:0/406321840 conn(0x7fcf040abcd0 msgr2=0x7fcf04137c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:54.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf0a095640 1 -- 172.21.15.181:0/406321840 shutdown_connections 2024-09-13T10:37:54.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.008+0000 7fcf0a095640 1 -- 172.21.15.181:0/406321840 wait complete. 2024-09-13T10:37:54.037 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:54.037 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:37:54.037 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:37:54.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.136+0000 7eff08650640 10 monclient: get_monmap_and_config 2024-09-13T10:37:54.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.136+0000 7eff08650640 10 monclient: build_initial_monmap 2024-09-13T10:37:54.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.136+0000 7eff08650640 10 monclient: monmap: 2024-09-13T10:37:54.138 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:54.139 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.139 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:54.137328+0000 2024-09-13T10:37:54.139 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:54.137328+0000 2024-09-13T10:37:54.139 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:54.139 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.139 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:54.139 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:54.139 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:54.139 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:54.139 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:54.139 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:54.139 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:54.140 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:54.140 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:54.140 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.137+0000 7eff08650640 1 Processor -- start 2024-09-13T10:37:54.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.137+0000 7eff08650640 1 -- start start 2024-09-13T10:37:54.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.137+0000 7eff08650640 10 monclient: init 2024-09-13T10:37:54.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.138+0000 7eff08650640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:54.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.138+0000 7eff08650640 10 monclient: _add_conns ranks=[7,5,2,3,6,0,8,4,1] 2024-09-13T10:37:54.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.138+0000 7eff08650640 10 monclient(hunting): picked mon.noname-i con 0x7eff001399b0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:54.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.138+0000 7eff08650640 10 monclient(hunting): picked mon.noname-h con 0x7eff0009d2a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:54.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.138+0000 7eff08650640 10 monclient(hunting): picked mon.noname-b con 0x7eff00139d90 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:54.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.138+0000 7eff08650640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff000a8070 con 0x7eff00139d90 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.138+0000 7eff08650640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff0009cb80 con 0x7eff0009d2a0 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.138+0000 7eff08650640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff0009e4c0 con 0x7eff001399b0 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.138+0000 7eff08650640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.138+0000 7eff08650640 10 monclient(hunting): authenticate will time out at 1213.643167s 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.138+0000 7eff06bed640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7eff00139d90 0x7eff000a72f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:45658/0 (socket says 172.21.15.181:45658) 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.138+0000 7eff06bed640 1 -- 172.21.15.181:0/1433324759 learned_addr learned my addr 172.21.15.181:0/1433324759 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.140+0000 7eff06bed640 1 -- 172.21.15.181:0/1433324759 >> v1:172.21.15.181:6790/0 conn(0x7eff00139d90 legacy=0x7eff000a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.140+0000 7eff063ec640 1 -- 172.21.15.181:0/1433324759 >> v1:172.21.15.195:6792/0 conn(0x7eff001399b0 legacy=0x7eff000a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.140+0000 7eff05beb640 1 -- 172.21.15.181:0/1433324759 >> v1:172.21.15.195:6791/0 conn(0x7eff0009d2a0 legacy=0x7eff000a6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.140+0000 7eff053ea640 1 -- 172.21.15.181:0/1433324759 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 482854005 0 0) 0x7eff0009e4c0 con 0x7eff001399b0 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.140+0000 7eff053ea640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.140+0000 7eff053ea640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.140+0000 7eff053ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.140+0000 7eff053ea640 10 monclient(hunting): my global_id is 57112 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.140+0000 7eff053ea640 1 -- 172.21.15.181:0/1433324759 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efeec003520 con 0x7eff001399b0 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 1 -- 172.21.15.181:0/1433324759 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2917330718 0 0) 0x7efeec003520 con 0x7eff001399b0 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 1 -- 172.21.15.181:0/1433324759 >> v1:172.21.15.195:6791/0 conn(0x7eff0009d2a0 legacy=0x7eff000a6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 1 -- 172.21.15.181:0/1433324759 >> v1:172.21.15.181:6790/0 conn(0x7eff00139d90 legacy=0x7eff000a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 10 monclient: _finish_hunting 0 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 1 monclient: found mon.noname-i 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 1 -- 172.21.15.181:0/1433324759 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff000a82b0 con 0x7eff001399b0 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 10 monclient: _finish_auth 0 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 10 monclient: _check_auth_tickets 2024-09-13T10:37:54.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff08650640 5 monclient: authenticate success, global_id 57112 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 1 -- 172.21.15.181:0/1433324759 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efefc001bf0 con 0x7eff001399b0 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 10 monclient: dump: 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.148 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff08650640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 1 -- 172.21.15.181:0/1433324759 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efefc003610 con 0x7eff001399b0 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff08650640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff08650640 4 set_mon_vals no callback set 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 1 -- 172.21.15.181:0/1433324759 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efefc003bc0 con 0x7eff001399b0 2024-09-13T10:37:54.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff053ea640 10 monclient: dump: 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.150 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff08650640 10 monclient: shutdown 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff08650640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff08650640 1 -- 172.21.15.181:0/1433324759 >> v1:172.21.15.195:6792/0 conn(0x7eff001399b0 legacy=0x7eff000a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff08650640 1 -- 172.21.15.181:0/1433324759 shutdown_connections 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff08650640 1 -- 172.21.15.181:0/1433324759 >> 172.21.15.181:0/1433324759 conn(0x7eff000abdb0 msgr2=0x7eff000ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff08650640 1 -- 172.21.15.181:0/1433324759 shutdown_connections 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.141+0000 7eff08650640 1 -- 172.21.15.181:0/1433324759 wait complete. 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.142+0000 7eff08650640 10 monclient: build_initial_monmap 2024-09-13T10:37:54.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.142+0000 7eff08650640 10 monclient: monmap: 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:54.152 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.142+0000 7eff08650640 1 Processor -- start 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.142+0000 7eff08650640 1 -- start start 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.142+0000 7eff08650640 10 monclient: init 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff08650640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff08650640 10 monclient: _add_conns ranks=[8,4,2,5,0,7,1,3,6] 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff08650640 10 monclient(hunting): picked mon.noname-e con 0x7eff0009d2a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff08650640 10 monclient(hunting): picked mon.noname-c con 0x7eff001399b0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff08650640 10 monclient(hunting): picked mon.noname-b con 0x7eff00139d90 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff08650640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff00137320 con 0x7eff00139d90 2024-09-13T10:37:54.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff08650640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff00137600 con 0x7eff001399b0 2024-09-13T10:37:54.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff08650640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff001378e0 con 0x7eff0009d2a0 2024-09-13T10:37:54.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff08650640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:54.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff08650640 10 monclient(hunting): authenticate will time out at 1213.648270s 2024-09-13T10:37:54.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff05beb640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7eff001399b0 0x7eff001d2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41374/0 (socket says 172.21.15.181:41374) 2024-09-13T10:37:54.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff06bed640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7eff00139d90 0x7eff001d5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:45666/0 (socket says 172.21.15.181:45666) 2024-09-13T10:37:54.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.143+0000 7eff05beb640 1 -- 172.21.15.181:0/1623151556 learned_addr learned my addr 172.21.15.181:0/1623151556 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:54.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.145+0000 7eff063ec640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.181:6793/0 conn(0x7eff0009d2a0 legacy=0x7eff00137de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.145+0000 7eff05beb640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.181:6791/0 conn(0x7eff001399b0 legacy=0x7eff001d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.145+0000 7eff06bed640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.181:6790/0 conn(0x7eff00139d90 legacy=0x7eff001d5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2190514242 0 0) 0x7eff00137320 con 0x7eff00139d90 2024-09-13T10:37:54.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 10 monclient(hunting): my global_id is 134102 2024-09-13T10:37:54.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee4003550 con 0x7eff00139d90 2024-09-13T10:37:54.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687124436 0 0) 0x7eff001378e0 con 0x7eff0009d2a0 2024-09-13T10:37:54.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 10 monclient(hunting): my global_id is 105200 2024-09-13T10:37:54.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff00137320 con 0x7eff0009d2a0 2024-09-13T10:37:54.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3821159933 0 0) 0x7eff00137600 con 0x7eff001399b0 2024-09-13T10:37:54.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 10 monclient(hunting): my global_id is 114862 2024-09-13T10:37:54.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.342+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff001378e0 con 0x7eff001399b0 2024-09-13T10:37:54.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4029827022 0 0) 0x7eff001378e0 con 0x7eff001399b0 2024-09-13T10:37:54.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff00137600 con 0x7eff001399b0 2024-09-13T10:37:54.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2270835859 0 0) 0x7efee4003550 con 0x7eff00139d90 2024-09-13T10:37:54.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff001378e0 con 0x7eff00139d90 2024-09-13T10:37:54.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3634345682 0 0) 0x7eff00137320 con 0x7eff0009d2a0 2024-09-13T10:37:54.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efee4003550 con 0x7eff0009d2a0 2024-09-13T10:37:54.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efef0003610 con 0x7eff001399b0 2024-09-13T10:37:54.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:54.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:54.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:54.347 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.347 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.348 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.348 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.348 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.348 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.348 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.348 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.348 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.348 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.348 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.348 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.348 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.349 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.349 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.349 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:54.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efef8001f20 con 0x7eff00139d90 2024-09-13T10:37:54.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:54.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:54.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:54.349 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.349 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.349 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.349 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.350 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.350 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.350 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.350 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.350 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.350 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.350 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.350 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.350 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.350 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.350 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.351 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efefc001bb0 con 0x7eff0009d2a0 2024-09-13T10:37:54.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:54.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:54.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.343+0000 7efef6ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:54.351 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.351 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.351 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.351 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.351 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.351 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.351 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.352 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.352 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.352 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.352 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.352 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.352 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.352 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.352 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.352 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2224400057 0 0) 0x7efee4003550 con 0x7eff0009d2a0 2024-09-13T10:37:54.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.181:6791/0 conn(0x7eff001399b0 legacy=0x7eff001d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.181:6790/0 conn(0x7eff00139d90 legacy=0x7eff001d5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7efef6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:54.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7efef6ffd640 1 monclient: found mon.e 2024-09-13T10:37:54.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7efef6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:54.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7efef6ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:54.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff00135710 con 0x7eff0009d2a0 2024-09-13T10:37:54.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7efef6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:54.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7efef6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:54.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7efef6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:54.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7eff08650640 5 monclient: authenticate success, global_id 105200 2024-09-13T10:37:54.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7eff08650640 10 monclient: _renew_subs 2024-09-13T10:37:54.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7eff08650640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:54.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.357+0000 7eff08650640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7eff001360e0 con 0x7eff0009d2a0 2024-09-13T10:37:54.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.358+0000 7eff08650640 10 monclient: _renew_subs 2024-09-13T10:37:54.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.358+0000 7eff08650640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:54.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.358+0000 7eff08650640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7eff001d7760 con 0x7eff0009d2a0 2024-09-13T10:37:54.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.358+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efefc003e80 con 0x7eff0009d2a0 2024-09-13T10:37:54.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.358+0000 7efef6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:54.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.358+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efefc004370 con 0x7eff0009d2a0 2024-09-13T10:37:54.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.358+0000 7efef6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.358+0000 7efef6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:54.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.358+0000 7efef6ffd640 10 monclient: dump: 2024-09-13T10:37:54.363 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.363 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.363 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.363 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.363 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.363 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.363 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.363 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.363 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.363 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.363 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.364 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.364 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.364 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.364 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.364 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.358+0000 7eff04be9640 4 set_mon_vals no callback set 2024-09-13T10:37:54.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.360+0000 7eff08650640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:54.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.360+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7efefc011ca0 con 0x7eff0009d2a0 2024-09-13T10:37:54.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.360+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(248..248 src has 1..248) ==== 3898+0+0 (unknown 3875839112 0 0) 0x7efefc04e2a0 con 0x7eff0009d2a0 2024-09-13T10:37:54.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.361+0000 7eff08650640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efee80065c0 con 0x7efee8002860 2024-09-13T10:37:54.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.361+0000 7eff05beb640 10 monclient: get_auth_request con 0x7efee40406e0 auth_method 0 2024-09-13T10:37:54.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7eff06bed640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.181:6790/0 conn(0x7efee8002860 legacy=0x7efee8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 965395486 0 0) 0x7efee80065c0 con 0x7efee8002860 2024-09-13T10:37:54.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 10 monclient(hunting): my global_id is 134111 2024-09-13T10:37:54.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee4003550 con 0x7efee8002860 2024-09-13T10:37:54.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3292639724 0 0) 0x7efee4003550 con 0x7efee8002860 2024-09-13T10:37:54.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efee80065c0 con 0x7efee8002860 2024-09-13T10:37:54.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efef8005090 con 0x7efee8002860 2024-09-13T10:37:54.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:54.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 10 monclient: dump: 2024-09-13T10:37:54.367 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.367 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.367 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.367 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.368 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.368 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.368 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.368 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.368 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.368 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.368 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.368 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.368 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.368 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.368 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.369 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1682500600 0 0) 0x7efee80065c0 con 0x7efee8002860 2024-09-13T10:37:54.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.363+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efee800a160 con 0x7efee8002860 2024-09-13T10:37:54.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.364+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7efef8006590 con 0x7efee8002860 2024-09-13T10:37:54.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.364+0000 7efef6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:54.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.364+0000 7efef6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:54.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.364+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.181:6790/0 conn(0x7efee8002860 legacy=0x7efee8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.364+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.181:6790/0 conn(0x7efee8002860 legacy=0x7efee8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:54.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.370+0000 7eff08650640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:54.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.370+0000 7eff08650640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efee8009e50 con 0x7efee8009110 2024-09-13T10:37:54.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.372+0000 7eff06bed640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.181:6790/0 conn(0x7efee8009110 legacy=0x7efee80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.372+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2427168369 0 0) 0x7efee8009e50 con 0x7efee8009110 2024-09-13T10:37:54.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.372+0000 7efef6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.372+0000 7efef6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.372+0000 7efef6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.372+0000 7efef6ffd640 10 monclient(hunting): my global_id is 134120 2024-09-13T10:37:54.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.372+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee80065c0 con 0x7efee8009110 2024-09-13T10:37:54.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.372+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3840930123 0 0) 0x7efee80065c0 con 0x7efee8009110 2024-09-13T10:37:54.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efee8009e50 con 0x7efee8009110 2024-09-13T10:37:54.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7efef8005600 con 0x7efee8009110 2024-09-13T10:37:54.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7efef6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7efef6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:54.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7efef6ffd640 10 monclient: dump: 2024-09-13T10:37:54.376 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.376 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.376 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.376 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.376 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.376 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.376 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.376 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.376 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.376 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.377 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.377 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.377 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.377 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.377 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.377 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2513243178 0 0) 0x7efee8009e50 con 0x7efee8009110 2024-09-13T10:37:54.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efee800c3f0 con 0x7efee8009110 2024-09-13T10:37:54.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 4085288402) 0x7efef8005af0 con 0x7efee8009110 2024-09-13T10:37:54.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7efef6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:54.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7efef6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:54.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.181:6790/0 conn(0x7efee8009110 legacy=0x7efee80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7efef6ffd640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.181:6790/0 conn(0x7efee8009110 legacy=0x7efee80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:54.378 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:54.378 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:54.378 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:54.378 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:54.378 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:54.378 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 6369, 2024-09-13T10:37:54.378 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:54.379 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:54.379 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:54.379 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:54.379 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:54.379 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:54.379 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:54.379 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:54.379 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:54.379 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:54.379 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.379 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:37:54.379 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:54.380 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:54.380 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:54.380 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.380 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.380 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.380 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.380 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.380 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.380 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.380 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.380 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.381 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.381 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.381 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.381 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:54.381 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:54.381 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.381 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.381 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.381 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.381 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.381 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.381 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.382 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.382 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.382 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.382 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.382 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.382 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:54.382 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:54.382 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:54.382 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:54.382 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:54.382 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:54.383 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:54.383 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:54.383 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:54.383 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:54.383 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:54.383 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:54.383 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:54.383 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:54.383 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:54.383 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:54.383 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:54.383 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.384 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.384 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.384 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.384 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.384 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.384 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.384 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.384 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.384 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.384 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.384 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.385 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:54.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.385 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:54.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.385 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:54.385 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:54.385 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.385 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.386 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:54.387 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:54.387 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.387 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.387 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.387 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:54.387 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.387 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.387 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.387 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:54.388 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:54.388 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.388 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.388 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.388 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:54.388 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:54.388 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.388 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.388 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.389 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:54.389 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.389 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.389 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.389 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:54.389 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:54.389 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.389 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.389 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.390 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:54.390 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:54.390 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.390 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.390 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.390 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:54.390 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.390 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.390 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.391 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:54.391 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:54.391 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.391 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.391 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.391 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:54.391 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:54.391 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.391 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.392 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.392 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:54.392 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.392 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.392 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.392 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:54.392 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:54.392 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.392 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.393 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.393 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:54.393 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:54.393 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.393 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.393 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.393 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:54.393 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.393 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.394 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.394 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:54.394 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:54.394 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.394 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.394 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.394 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:54.394 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:54.395 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.395 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:54.395 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.395 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.395 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.395 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:54.395 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:54.396 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.396 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.396 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.396 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:54.396 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:54.396 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.396 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:54.397 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.397 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.397 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:54.397 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:54.397 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.397 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.397 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.398 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:54.398 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:54.398 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.398 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:54.398 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.398 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.398 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:54.399 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:54.399 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.399 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.399 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.399 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.399 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.399 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:54.399 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:54.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.399 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:54.399 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:54.400 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:54.400 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.400 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.400 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:54.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.400 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:54.400 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:54.400 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:54.400 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.400 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.400 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:54.401 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:54.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7eff08650640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.195:6800/1839191919 conn(0x7efee40406e0 legacy=0x7efee4042ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7eff08650640 10 monclient: shutdown 2024-09-13T10:37:54.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7eff08650640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:54.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7eff08650640 1 -- 172.21.15.181:0/1623151556 >> v1:172.21.15.181:6793/0 conn(0x7eff0009d2a0 legacy=0x7eff00137de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7eff06bed640 1 -- 172.21.15.181:0/1623151556 reap_dead start 2024-09-13T10:37:54.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7eff06bed640 1 -- 172.21.15.181:0/1623151556 reap_dead start 2024-09-13T10:37:54.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7eff08650640 1 -- 172.21.15.181:0/1623151556 shutdown_connections 2024-09-13T10:37:54.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7eff08650640 1 -- 172.21.15.181:0/1623151556 >> 172.21.15.181:0/1623151556 conn(0x7eff000abdb0 msgr2=0x7eff001327e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:54.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7eff08650640 1 -- 172.21.15.181:0/1623151556 shutdown_connections 2024-09-13T10:37:54.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.373+0000 7eff08650640 1 -- 172.21.15.181:0/1623151556 wait complete. 2024-09-13T10:37:54.403 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:54.403 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:37:54.404 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:37:54.502 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.501+0000 7fcd92009640 10 monclient: get_monmap_and_config 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.501+0000 7fcd92009640 10 monclient: build_initial_monmap 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.501+0000 7fcd92009640 10 monclient: monmap: 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:54.501819+0000 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:54.501819+0000 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:54.503 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:54.504 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:54.504 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:54.504 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:54.504 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:54.504 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 1 Processor -- start 2024-09-13T10:37:54.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 1 -- start start 2024-09-13T10:37:54.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 10 monclient: init 2024-09-13T10:37:54.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:54.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 10 monclient: _add_conns ranks=[8,2,1,0,5,7,3,6,4] 2024-09-13T10:37:54.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 10 monclient(hunting): picked mon.noname-e con 0x7fcd8c0a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:54.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 10 monclient(hunting): picked mon.noname-b con 0x7fcd8c0a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:54.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 10 monclient(hunting): picked mon.noname-f con 0x7fcd8c13f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:54.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c0a5fe0 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c0a8080 con 0x7fcd8c0a6ab0 2024-09-13T10:37:54.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c0a42c0 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:54.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd92009640 10 monclient(hunting): authenticate will time out at 1214.007835s 2024-09-13T10:37:54.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd8b7fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fcd8c0a66d0 0x7fcd8c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41782/0 (socket says 172.21.15.181:41782) 2024-09-13T10:37:54.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.502+0000 7fcd8b7fe640 1 -- 172.21.15.181:0/713836893 learned_addr learned my addr 172.21.15.181:0/713836893 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:54.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd83fff640 1 -- 172.21.15.181:0/713836893 >> v1:172.21.15.181:6790/0 conn(0x7fcd8c0a6ab0 legacy=0x7fcd8c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8b7fe640 1 -- 172.21.15.181:0/713836893 >> v1:172.21.15.181:6793/0 conn(0x7fcd8c0a66d0 legacy=0x7fcd8c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 1 -- 172.21.15.181:0/713836893 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 653578522 0 0) 0x7fcd8c0a8080 con 0x7fcd8c0a6ab0 2024-09-13T10:37:54.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient(hunting): my global_id is 134129 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 1 -- 172.21.15.181:0/713836893 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd78003520 con 0x7fcd8c0a6ab0 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 1 -- 172.21.15.181:0/713836893 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1848736804 0 0) 0x7fcd8c0a42c0 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient(hunting): my global_id is 105209 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8bfff640 1 -- 172.21.15.181:0/713836893 >> v1:172.21.15.195:6789/0 conn(0x7fcd8c13f9a0 legacy=0x7fcd8c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 1 -- 172.21.15.181:0/713836893 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd8c0a8080 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 1 -- 172.21.15.181:0/713836893 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 465143597 0 0) 0x7fcd8c0a8080 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 1 -- 172.21.15.181:0/713836893 >> v1:172.21.15.181:6790/0 conn(0x7fcd8c0a6ab0 legacy=0x7fcd8c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 1 -- 172.21.15.181:0/713836893 >> v1:172.21.15.195:6789/0 conn(0x7fcd8c13f9a0 legacy=0x7fcd8c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 1 monclient: found mon.noname-e 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 1 -- 172.21.15.181:0/713836893 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c1464e0 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient: _finish_auth 0 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 1 -- 172.21.15.181:0/713836893 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcd7c001a50 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd92009640 5 monclient: authenticate success, global_id 105209 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd92009640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:54.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient: dump: 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.513 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd92009640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 1 -- 172.21.15.181:0/713836893 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd7c001d20 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 1 -- 172.21.15.181:0/713836893 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcd7c004be0 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd8affd640 10 monclient: dump: 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.514 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd92009640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.505+0000 7fcd92009640 4 set_mon_vals no callback set 2024-09-13T10:37:54.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.506+0000 7fcd92009640 10 monclient: shutdown 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.506+0000 7fcd92009640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.506+0000 7fcd92009640 1 -- 172.21.15.181:0/713836893 >> v1:172.21.15.181:6793/0 conn(0x7fcd8c0a66d0 legacy=0x7fcd8c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.506+0000 7fcd92009640 1 -- 172.21.15.181:0/713836893 shutdown_connections 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.506+0000 7fcd92009640 1 -- 172.21.15.181:0/713836893 >> 172.21.15.181:0/713836893 conn(0x7fcd8c0abcd0 msgr2=0x7fcd8c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.506+0000 7fcd92009640 1 -- 172.21.15.181:0/713836893 shutdown_connections 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.506+0000 7fcd92009640 1 -- 172.21.15.181:0/713836893 wait complete. 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.506+0000 7fcd92009640 10 monclient: build_initial_monmap 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.506+0000 7fcd92009640 10 monclient: monmap: 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:54.516 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 1 Processor -- start 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 1 -- start start 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 10 monclient: init 2024-09-13T10:37:54.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:54.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 10 monclient: _add_conns ranks=[4,6,2,1,7,0,8,5,3] 2024-09-13T10:37:54.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 10 monclient(hunting): picked mon.noname-c con 0x7fcd8c0a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:54.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 10 monclient(hunting): picked mon.noname-d con 0x7fcd8c0a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:54.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 10 monclient(hunting): picked mon.noname-b con 0x7fcd8c13f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:54.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c13ea30 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c13ed10 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c13d410 con 0x7fcd8c0a6ab0 2024-09-13T10:37:54.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:54.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd92009640 10 monclient(hunting): authenticate will time out at 1214.012613s 2024-09-13T10:37:54.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd8b7fe640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fcd8c0a66d0 0x7fcd8c136700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41386/0 (socket says 172.21.15.181:41386) 2024-09-13T10:37:54.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.507+0000 7fcd8b7fe640 1 -- 172.21.15.181:0/1614778530 learned_addr learned my addr 172.21.15.181:0/1614778530 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:54.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd8bfff640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.181:6790/0 conn(0x7fcd8c13f9a0 legacy=0x7fcd8c1d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd83fff640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.181:6792/0 conn(0x7fcd8c0a6ab0 legacy=0x7fcd8c1d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd8b7fe640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.181:6791/0 conn(0x7fcd8c0a66d0 legacy=0x7fcd8c136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2289584063 0 0) 0x7fcd8c13ea30 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 10 monclient(hunting): my global_id is 134138 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd6c003520 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188474740 0 0) 0x7fcd8c13d410 con 0x7fcd8c0a6ab0 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 10 monclient(hunting): my global_id is 134106 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd8c13ea30 con 0x7fcd8c0a6ab0 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366294537 0 0) 0x7fcd8c13ed10 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.509+0000 7fcd88ff9640 10 monclient(hunting): my global_id is 114871 2024-09-13T10:37:54.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd8c13d410 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3028960487 0 0) 0x7fcd6c003520 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd8c13ed10 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcd84002000 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:54.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:37:54.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:54.525 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.525 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.525 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.525 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:54.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2354184700 0 0) 0x7fcd8c13ea30 con 0x7fcd8c0a6ab0 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd6c003520 con 0x7fcd8c0a6ab0 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 106870773 0 0) 0x7fcd8c13d410 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd8c13ea30 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcd74003610 con 0x7fcd8c0a6ab0 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.527 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcd7c004b20 con 0x7fcd8c0a66d0 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:54.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:54.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient(hunting): dump: 2024-09-13T10:37:54.529 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.529 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.529 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.529 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.529 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.529 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.529 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.529 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.529 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.529 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.529 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1994873307 0 0) 0x7fcd8c13ed10 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.181:6792/0 conn(0x7fcd8c0a6ab0 legacy=0x7fcd8c1d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.181:6791/0 conn(0x7fcd8c0a66d0 legacy=0x7fcd8c136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 monclient: found mon.b 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:37:54.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c13eff0 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient: _finish_auth 0 2024-09-13T10:37:54.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:37:54.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:54.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd92009640 5 monclient: authenticate success, global_id 134138 2024-09-13T10:37:54.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd92009640 10 monclient: _renew_subs 2024-09-13T10:37:54.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd92009640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:37:54.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd92009640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8c0a29c0 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd92009640 10 monclient: _renew_subs 2024-09-13T10:37:54.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd92009640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:37:54.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd92009640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcd8c13c670 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd84003c40 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcd84004170 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd8a7fc640 4 set_mon_vals no callback set 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.510+0000 7fcd88ff9640 10 monclient: dump: 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.532 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.511+0000 7fcd92009640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.511+0000 7fcd92009640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcd700065c0 con 0x7fcd70002860 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.511+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fcd84004440 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.511+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(248..248 src has 1..248) ==== 3898+0+0 (unknown 3875839112 0 0) 0x7fcd8404e550 con 0x7fcd8c13f9a0 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.511+0000 7fcd83fff640 10 monclient: get_auth_request con 0x7fcd6c0404c0 auth_method 0 2024-09-13T10:37:54.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.513+0000 7fcd8b7fe640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.181:6791/0 conn(0x7fcd70002860 legacy=0x7fcd70004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.513+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678040008 0 0) 0x7fcd700065c0 con 0x7fcd70002860 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.513+0000 7fcd88ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.513+0000 7fcd88ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.513+0000 7fcd88ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.513+0000 7fcd88ff9640 10 monclient(hunting): my global_id is 114880 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.513+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd8c13ed10 con 0x7fcd70002860 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4233149077 0 0) 0x7fcd8c13ed10 con 0x7fcd70002860 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd700065c0 con 0x7fcd70002860 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcd7c004cc0 con 0x7fcd70002860 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 10 monclient: dump: 2024-09-13T10:37:54.534 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.535 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.536 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.536 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 836416504 0 0) 0x7fcd700065c0 con 0x7fcd70002860 2024-09-13T10:37:54.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd7000a160 con 0x7fcd70002860 2024-09-13T10:37:54.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fcd7c0052e0 con 0x7fcd70002860 2024-09-13T10:37:54.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:54.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:54.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.181:6791/0 conn(0x7fcd70002860 legacy=0x7fcd70004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.514+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.181:6791/0 conn(0x7fcd70002860 legacy=0x7fcd70004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:54.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.520+0000 7fcd92009640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:54.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.520+0000 7fcd92009640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcd70009e50 con 0x7fcd70009110 2024-09-13T10:37:54.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.522+0000 7fcd8b7fe640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.181:6791/0 conn(0x7fcd70009110 legacy=0x7fcd700095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 672056639 0 0) 0x7fcd70009e50 con 0x7fcd70009110 2024-09-13T10:37:54.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 10 monclient(hunting): my global_id is 114889 2024-09-13T10:37:54.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd700065c0 con 0x7fcd70009110 2024-09-13T10:37:54.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3888205402 0 0) 0x7fcd700065c0 con 0x7fcd70009110 2024-09-13T10:37:54.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd70009e50 con 0x7fcd70009110 2024-09-13T10:37:54.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fcd7c005a40 con 0x7fcd70009110 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 10 monclient: dump: 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.539 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.540 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.540 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.540 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.540 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.540 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3679679205 0 0) 0x7fcd70009e50 con 0x7fcd70009110 2024-09-13T10:37:54.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcd7000c3a0 con 0x7fcd70009110 2024-09-13T10:37:54.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 1955457833) 0x7fcd7c007ed0 con 0x7fcd70009110 2024-09-13T10:37:54.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:54.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:54.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.181:6791/0 conn(0x7fcd70009110 legacy=0x7fcd700095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.523+0000 7fcd88ff9640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.181:6791/0 conn(0x7fcd70009110 legacy=0x7fcd700095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:54.541 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:54.541 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:54.541 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:54.541 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:54.541 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:54.541 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 110501, 2024-09-13T10:37:54.541 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:54.541 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:54.541 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:54.541 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:54.542 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:54.542 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:54.542 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:54.542 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:54.542 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:54.542 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:54.542 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.542 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:37:54.542 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:54.542 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:54.542 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:54.542 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.543 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.543 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.543 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.543 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.543 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.543 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.543 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.543 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.543 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.543 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.543 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.543 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.544 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.545 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:54.545 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:54.545 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:54.545 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:54.545 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:54.545 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:54.545 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:54.545 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:54.545 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:54.545 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:54.545 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:54.546 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:54.546 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:54.546 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:54.546 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:54.546 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:54.546 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:54.546 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.546 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.546 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.546 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.546 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:54.547 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.548 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:54.551 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.551 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.551 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:54.551 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:54.551 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.551 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.551 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.551 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:54.552 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.553 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.554 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:54.554 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:54.554 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.554 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.554 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.555 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:54.555 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:54.555 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.555 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:54.555 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.555 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.556 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:54.556 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:54.556 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.556 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.556 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.556 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:54.556 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:54.556 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.557 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.559 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:54.561 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:54.562 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.562 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.562 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:54.562 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:54.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.524+0000 7fcd92009640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.195:6800/1839191919 conn(0x7fcd6c0404c0 legacy=0x7fcd6c042980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.524+0000 7fcd92009640 10 monclient: shutdown 2024-09-13T10:37:54.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.524+0000 7fcd92009640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:54.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.524+0000 7fcd92009640 1 -- 172.21.15.181:0/1614778530 >> v1:172.21.15.181:6790/0 conn(0x7fcd8c13f9a0 legacy=0x7fcd8c1d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.524+0000 7fcd8bfff640 1 -- 172.21.15.181:0/1614778530 reap_dead start 2024-09-13T10:37:54.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.524+0000 7fcd8bfff640 1 -- 172.21.15.181:0/1614778530 reap_dead start 2024-09-13T10:37:54.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.524+0000 7fcd92009640 1 -- 172.21.15.181:0/1614778530 shutdown_connections 2024-09-13T10:37:54.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.524+0000 7fcd92009640 1 -- 172.21.15.181:0/1614778530 >> 172.21.15.181:0/1614778530 conn(0x7fcd8c0abcd0 msgr2=0x7fcd8c0ab450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:54.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.524+0000 7fcd92009640 1 -- 172.21.15.181:0/1614778530 shutdown_connections 2024-09-13T10:37:54.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.524+0000 7fcd92009640 1 -- 172.21.15.181:0/1614778530 wait complete. 2024-09-13T10:37:54.564 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:54.564 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:37:54.564 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:37:54.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.660+0000 7f5d91068640 10 monclient: get_monmap_and_config 2024-09-13T10:37:54.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.660+0000 7f5d91068640 10 monclient: build_initial_monmap 2024-09-13T10:37:54.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.660+0000 7f5d91068640 10 monclient: monmap: 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:54.661387+0000 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:54.661387+0000 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:54.663 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:54.664 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:54.664 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:54.664 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.661+0000 7f5d91068640 1 Processor -- start 2024-09-13T10:37:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.661+0000 7f5d91068640 1 -- start start 2024-09-13T10:37:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.661+0000 7f5d91068640 10 monclient: init 2024-09-13T10:37:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.661+0000 7f5d91068640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.661+0000 7f5d91068640 10 monclient: _add_conns ranks=[2,5,0,3,7,6,4,1,8] 2024-09-13T10:37:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.662+0000 7f5d91068640 10 monclient(hunting): picked mon.noname-b con 0x7f5d8c0a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:54.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.662+0000 7f5d91068640 10 monclient(hunting): picked mon.noname-h con 0x7f5d8c0a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.662+0000 7f5d91068640 10 monclient(hunting): picked mon.noname-a con 0x7f5d8c13f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.662+0000 7f5d91068640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d8c0a4bc0 con 0x7f5d8c13f750 2024-09-13T10:37:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.662+0000 7f5d91068640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d8c13a320 con 0x7f5d8c0a6640 2024-09-13T10:37:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.662+0000 7f5d91068640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d8c0a8100 con 0x7f5d8c0a8340 2024-09-13T10:37:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.662+0000 7f5d91068640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.662+0000 7f5d91068640 10 monclient(hunting): authenticate will time out at 1214.167122s 2024-09-13T10:37:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.662+0000 7f5d8ad9d640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f5d8c0a6640 0x7f5d8c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:45702/0 (socket says 172.21.15.181:45702) 2024-09-13T10:37:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.662+0000 7f5d8ad9d640 1 -- 172.21.15.181:0/2898472407 learned_addr learned my addr 172.21.15.181:0/2898472407 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d8ad9d640 1 -- 172.21.15.181:0/2898472407 >> v1:172.21.15.181:6790/0 conn(0x7f5d8c0a6640 legacy=0x7f5d8c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d8b59e640 1 -- 172.21.15.181:0/2898472407 >> v1:172.21.15.181:6789/0 conn(0x7f5d8c13f750 legacy=0x7f5d8c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421316338 0 0) 0x7f5d8c0a4bc0 con 0x7f5d8c13f750 2024-09-13T10:37:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient(hunting): my global_id is 114876 2024-09-13T10:37:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d74003520 con 0x7f5d8c13f750 2024-09-13T10:37:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3098073893 0 0) 0x7f5d8c13a320 con 0x7f5d8c0a6640 2024-09-13T10:37:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient(hunting): my global_id is 134147 2024-09-13T10:37:54.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d8a59c640 1 -- 172.21.15.181:0/2898472407 >> v1:172.21.15.195:6791/0 conn(0x7f5d8c0a8340 legacy=0x7f5d8c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d8c0a4bc0 con 0x7f5d8c0a6640 2024-09-13T10:37:54.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1442862748 0 0) 0x7f5d8c0a8100 con 0x7f5d8c0a8340 2024-09-13T10:37:54.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient(hunting): my global_id is 105053 2024-09-13T10:37:54.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d8c13a320 con 0x7f5d8c0a8340 2024-09-13T10:37:54.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3174597056 0 0) 0x7f5d74003520 con 0x7f5d8c13f750 2024-09-13T10:37:54.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 >> v1:172.21.15.195:6791/0 conn(0x7f5d8c0a8340 legacy=0x7f5d8c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 >> v1:172.21.15.181:6790/0 conn(0x7f5d8c0a6640 legacy=0x7f5d8c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:37:54.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 monclient: found mon.noname-a 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8c0a48e0 con 0x7f5d8c13f750 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient: _finish_auth 0 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d84001eb0 con 0x7f5d8c13f750 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d91068640 5 monclient: authenticate success, global_id 114876 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d91068640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient: dump: 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.673 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.674 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d91068640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d84003990 con 0x7f5d8c13f750 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 1 -- 172.21.15.181:0/2898472407 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d84003f00 con 0x7f5d8c13f750 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d91068640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d91068640 4 set_mon_vals no callback set 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.664+0000 7f5d89d9b640 10 monclient: dump: 2024-09-13T10:37:54.675 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.676 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.665+0000 7f5d91068640 10 monclient: shutdown 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.665+0000 7f5d91068640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.665+0000 7f5d91068640 1 -- 172.21.15.181:0/2898472407 >> v1:172.21.15.181:6789/0 conn(0x7f5d8c13f750 legacy=0x7f5d8c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.665+0000 7f5d91068640 1 -- 172.21.15.181:0/2898472407 shutdown_connections 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.665+0000 7f5d91068640 1 -- 172.21.15.181:0/2898472407 >> 172.21.15.181:0/2898472407 conn(0x7f5d8c077170 msgr2=0x7f5d8c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.665+0000 7f5d91068640 1 -- 172.21.15.181:0/2898472407 shutdown_connections 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.665+0000 7f5d91068640 1 -- 172.21.15.181:0/2898472407 wait complete. 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.666+0000 7f5d91068640 10 monclient: build_initial_monmap 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.666+0000 7f5d91068640 10 monclient: monmap: 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:54.677 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.666+0000 7f5d91068640 1 Processor -- start 2024-09-13T10:37:54.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.666+0000 7f5d91068640 1 -- start start 2024-09-13T10:37:54.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.666+0000 7f5d91068640 10 monclient: init 2024-09-13T10:37:54.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d91068640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:54.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d91068640 10 monclient: _add_conns ranks=[8,6,2,7,1,0,3,4,5] 2024-09-13T10:37:54.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d91068640 10 monclient(hunting): picked mon.noname-e con 0x7f5d8c0a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:54.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d91068640 10 monclient(hunting): picked mon.noname-d con 0x7f5d8c13f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:54.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d91068640 10 monclient(hunting): picked mon.noname-b con 0x7f5d8c135320 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:54.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d91068640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d8c1cf0f0 con 0x7f5d8c135320 2024-09-13T10:37:54.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d91068640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d8c13d8f0 con 0x7f5d8c13f750 2024-09-13T10:37:54.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d91068640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d8c135770 con 0x7f5d8c0a8340 2024-09-13T10:37:54.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d91068640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:54.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d91068640 10 monclient(hunting): authenticate will time out at 1214.172246s 2024-09-13T10:37:54.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d8a59c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f5d8c13f750 0x7f5d8c1ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:49174/0 (socket says 172.21.15.181:49174) 2024-09-13T10:37:54.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d8b59e640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f5d8c135320 0x7f5d8c1d6530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:45706/0 (socket says 172.21.15.181:45706) 2024-09-13T10:37:54.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.667+0000 7f5d8a59c640 1 -- 172.21.15.181:0/3501619511 learned_addr learned my addr 172.21.15.181:0/3501619511 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:54.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d8ad9d640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.181:6793/0 conn(0x7f5d8c0a8340 legacy=0x7f5d8c1ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d8a59c640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.181:6792/0 conn(0x7f5d8c13f750 legacy=0x7f5d8c1ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d8b59e640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.181:6790/0 conn(0x7f5d8c135320 legacy=0x7f5d8c1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3100011357 0 0) 0x7f5d8c135770 con 0x7f5d8c0a8340 2024-09-13T10:37:54.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): my global_id is 105218 2024-09-13T10:37:54.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d78003550 con 0x7f5d8c0a8340 2024-09-13T10:37:54.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506925244 0 0) 0x7f5d8c13d8f0 con 0x7f5d8c13f750 2024-09-13T10:37:54.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): my global_id is 134115 2024-09-13T10:37:54.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d8c135770 con 0x7f5d8c13f750 2024-09-13T10:37:54.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827948055 0 0) 0x7f5d8c1cf0f0 con 0x7f5d8c135320 2024-09-13T10:37:54.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): my global_id is 134156 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d8c13d8f0 con 0x7f5d8c135320 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 233209983 0 0) 0x7f5d78003550 con 0x7f5d8c0a8340 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d8c1cf0f0 con 0x7f5d8c0a8340 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d7c0047e0 con 0x7f5d8c0a8340 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): dump: 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.688 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1611028587 0 0) 0x7f5d8c135770 con 0x7f5d8c13f750 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d78003550 con 0x7f5d8c13f750 2024-09-13T10:37:54.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d80003610 con 0x7f5d8c13f750 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.669+0000 7f5d737fe640 10 monclient(hunting): dump: 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.690 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2682491116 0 0) 0x7f5d8c13d8f0 con 0x7f5d8c135320 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d8c135770 con 0x7f5d8c135320 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d84003e80 con 0x7f5d8c135320 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 10 monclient(hunting): dump: 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.691 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.692 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1099148898 0 0) 0x7f5d8c1cf0f0 con 0x7f5d8c0a8340 2024-09-13T10:37:54.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.181:6792/0 conn(0x7f5d8c13f750 legacy=0x7f5d8c1ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.181:6790/0 conn(0x7f5d8c135320 legacy=0x7f5d8c1d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:54.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 1 monclient: found mon.e 2024-09-13T10:37:54.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:54.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:54.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8c134f00 con 0x7f5d8c0a8340 2024-09-13T10:37:54.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:54.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:54.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:54.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d91068640 5 monclient: authenticate success, global_id 105218 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d91068640 10 monclient: _renew_subs 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d91068640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d91068640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8c134660 con 0x7f5d8c0a8340 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d91068640 10 monclient: _renew_subs 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d91068640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d91068640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f5d8c1d7c50 con 0x7f5d8c0a8340 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d7c004c30 con 0x7f5d8c0a8340 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d7c005120 con 0x7f5d8c0a8340 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d8959a640 4 set_mon_vals no callback set 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:54.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d737fe640 10 monclient: dump: 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.695 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.670+0000 7f5d91068640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.671+0000 7f5d91068640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5d6c0065c0 con 0x7f5d6c002860 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.671+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5d7c0117a0 con 0x7f5d8c0a8340 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.671+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(248..248 src has 1..248) ==== 3898+0+0 (unknown 3875839112 0 0) 0x7f5d7c04e200 con 0x7f5d8c0a8340 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.671+0000 7f5d8b59e640 10 monclient: get_auth_request con 0x7f5d78040600 auth_method 0 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d8a59c640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.181:6792/0 conn(0x7f5d6c002860 legacy=0x7f5d6c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372224370 0 0) 0x7f5d6c0065c0 con 0x7f5d6c002860 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 10 monclient(hunting): my global_id is 134124 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d8c1cf0f0 con 0x7f5d6c002860 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2785242030 0 0) 0x7f5d8c1cf0f0 con 0x7f5d6c002860 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d6c0065c0 con 0x7f5d6c002860 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d80004010 con 0x7f5d6c002860 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 10 monclient: dump: 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.697 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2848921860 0 0) 0x7f5d6c0065c0 con 0x7f5d6c002860 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.673+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d6c00a160 con 0x7f5d6c002860 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.674+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5d80004230 con 0x7f5d6c002860 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.674+0000 7f5d737fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:54.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.674+0000 7f5d737fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.674+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.181:6792/0 conn(0x7f5d6c002860 legacy=0x7f5d6c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.674+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.181:6792/0 conn(0x7f5d6c002860 legacy=0x7f5d6c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.680+0000 7f5d91068640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.680+0000 7f5d91068640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5d6c009e50 con 0x7f5d6c009110 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d8a59c640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.181:6792/0 conn(0x7f5d6c009110 legacy=0x7f5d6c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1299319140 0 0) 0x7f5d6c009e50 con 0x7f5d6c009110 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 10 monclient(hunting): my global_id is 134133 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d6c0065c0 con 0x7f5d6c009110 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1226724373 0 0) 0x7f5d6c0065c0 con 0x7f5d6c009110 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d6c009e50 con 0x7f5d6c009110 2024-09-13T10:37:54.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5d80005cf0 con 0x7f5d6c009110 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 10 monclient: dump: 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.700 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.701 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.701 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.701 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.701 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2431903368 0 0) 0x7f5d6c009e50 con 0x7f5d6c009110 2024-09-13T10:37:54.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.682+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5d6c00c3f0 con 0x7f5d6c009110 2024-09-13T10:37:54.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 2935964664) 0x7f5d80006080 con 0x7f5d6c009110 2024-09-13T10:37:54.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d737fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:54.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d737fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:54.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.181:6792/0 conn(0x7f5d6c009110 legacy=0x7f5d6c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.702 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d737fe640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.181:6792/0 conn(0x7f5d6c009110 legacy=0x7f5d6c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:54.702 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 6706, 2024-09-13T10:37:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:54.722 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:54.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d91068640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5d78040600 legacy=0x7f5d78042ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d91068640 10 monclient: shutdown 2024-09-13T10:37:54.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d91068640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:54.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d91068640 1 -- 172.21.15.181:0/3501619511 >> v1:172.21.15.181:6793/0 conn(0x7f5d8c0a8340 legacy=0x7f5d8c1ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d8b59e640 1 -- 172.21.15.181:0/3501619511 reap_dead start 2024-09-13T10:37:54.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d8b59e640 1 -- 172.21.15.181:0/3501619511 reap_dead start 2024-09-13T10:37:54.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d91068640 1 -- 172.21.15.181:0/3501619511 shutdown_connections 2024-09-13T10:37:54.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d91068640 1 -- 172.21.15.181:0/3501619511 >> 172.21.15.181:0/3501619511 conn(0x7f5d8c0a6640 msgr2=0x7f5d8c0a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:54.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d91068640 1 -- 172.21.15.181:0/3501619511 shutdown_connections 2024-09-13T10:37:54.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.683+0000 7f5d91068640 1 -- 172.21.15.181:0/3501619511 wait complete. 2024-09-13T10:37:54.725 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:54.725 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:37:54.726 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:37:54.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.822+0000 7fac21b3d640 10 monclient: get_monmap_and_config 2024-09-13T10:37:54.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.822+0000 7fac21b3d640 10 monclient: build_initial_monmap 2024-09-13T10:37:54.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.822+0000 7fac21b3d640 10 monclient: monmap: 2024-09-13T10:37:54.824 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:54.824 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.824 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:54.823292+0000 2024-09-13T10:37:54.824 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:54.823292+0000 2024-09-13T10:37:54.824 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:54.824 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.825 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:54.825 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:54.825 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:54.825 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:54.825 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:54.825 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:54.825 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:54.825 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:54.825 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:54.825 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.823+0000 7fac21b3d640 1 Processor -- start 2024-09-13T10:37:54.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.823+0000 7fac21b3d640 1 -- start start 2024-09-13T10:37:54.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.823+0000 7fac21b3d640 10 monclient: init 2024-09-13T10:37:54.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.823+0000 7fac21b3d640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:54.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.823+0000 7fac21b3d640 10 monclient: _add_conns ranks=[7,8,3,1,4,6,0,5,2] 2024-09-13T10:37:54.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.823+0000 7fac21b3d640 10 monclient(hunting): picked mon.noname-i con 0x7fac1c0a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:54.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.823+0000 7fac21b3d640 10 monclient(hunting): picked mon.noname-e con 0x7fac1c0a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:54.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.823+0000 7fac21b3d640 10 monclient(hunting): picked mon.noname-g con 0x7fac1c13f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:54.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.824+0000 7fac21b3d640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c0a4bc0 con 0x7fac1c13f750 2024-09-13T10:37:54.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.824+0000 7fac21b3d640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c13a320 con 0x7fac1c0a6640 2024-09-13T10:37:54.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.824+0000 7fac21b3d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c0a8100 con 0x7fac1c0a8340 2024-09-13T10:37:54.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.824+0000 7fac21b3d640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:54.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.824+0000 7fac21b3d640 10 monclient(hunting): authenticate will time out at 1214.329029s 2024-09-13T10:37:54.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.824+0000 7fac1affd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fac1c0a8340 0x7fac1c139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41804/0 (socket says 172.21.15.181:41804) 2024-09-13T10:37:54.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.824+0000 7fac1affd640 1 -- 172.21.15.181:0/3237829620 learned_addr learned my addr 172.21.15.181:0/3237829620 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:54.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1affd640 1 -- 172.21.15.181:0/3237829620 >> v1:172.21.15.181:6793/0 conn(0x7fac1c0a8340 legacy=0x7fac1c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1bfff640 1 -- 172.21.15.181:0/3237829620 >> v1:172.21.15.195:6790/0 conn(0x7fac1c13f750 legacy=0x7fac1c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 1 -- 172.21.15.181:0/3237829620 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467432944 0 0) 0x7fac1c0a8100 con 0x7fac1c0a8340 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1b7fe640 1 -- 172.21.15.181:0/3237829620 >> v1:172.21.15.195:6792/0 conn(0x7fac1c0a6640 legacy=0x7fac1c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 10 monclient(hunting): my global_id is 105227 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 1 -- 172.21.15.181:0/3237829620 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac04003520 con 0x7fac1c0a8340 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 1 -- 172.21.15.181:0/3237829620 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4101690426 0 0) 0x7fac04003520 con 0x7fac1c0a8340 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 1 -- 172.21.15.181:0/3237829620 >> v1:172.21.15.195:6792/0 conn(0x7fac1c0a6640 legacy=0x7fac1c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 1 -- 172.21.15.181:0/3237829620 >> v1:172.21.15.195:6790/0 conn(0x7fac1c13f750 legacy=0x7fac1c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 1 monclient: found mon.noname-e 2024-09-13T10:37:54.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 1 -- 172.21.15.181:0/3237829620 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c0a48e0 con 0x7fac1c0a8340 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 1 -- 172.21.15.181:0/3237829620 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fac10001ae0 con 0x7fac1c0a8340 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac21b3d640 5 monclient: authenticate success, global_id 105227 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac21b3d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.826+0000 7fac1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac1a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac1a7fc640 10 monclient: dump: 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.832 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.833 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac21b3d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac1a7fc640 1 -- 172.21.15.181:0/3237829620 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac100048a0 con 0x7fac1c0a8340 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac1a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac21b3d640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac1a7fc640 1 -- 172.21.15.181:0/3237829620 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fac10004dd0 con 0x7fac1c0a8340 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac21b3d640 4 set_mon_vals no callback set 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac1a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac1a7fc640 10 monclient: dump: 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.834 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac21b3d640 10 monclient: shutdown 2024-09-13T10:37:54.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac21b3d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac21b3d640 1 -- 172.21.15.181:0/3237829620 >> v1:172.21.15.181:6793/0 conn(0x7fac1c0a8340 legacy=0x7fac1c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac21b3d640 1 -- 172.21.15.181:0/3237829620 shutdown_connections 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac21b3d640 1 -- 172.21.15.181:0/3237829620 >> 172.21.15.181:0/3237829620 conn(0x7fac1c077170 msgr2=0x7fac1c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac21b3d640 1 -- 172.21.15.181:0/3237829620 shutdown_connections 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.827+0000 7fac21b3d640 1 -- 172.21.15.181:0/3237829620 wait complete. 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.828+0000 7fac21b3d640 10 monclient: build_initial_monmap 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.828+0000 7fac21b3d640 10 monclient: monmap: 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:54.836 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.828+0000 7fac21b3d640 1 Processor -- start 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.828+0000 7fac21b3d640 1 -- start start 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.828+0000 7fac21b3d640 10 monclient: init 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.829+0000 7fac21b3d640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.829+0000 7fac21b3d640 10 monclient: _add_conns ranks=[5,8,1,0,4,6,7,2,3] 2024-09-13T10:37:54.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.829+0000 7fac21b3d640 10 monclient(hunting): picked mon.noname-h con 0x7fac1c0a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:54.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.829+0000 7fac21b3d640 10 monclient(hunting): picked mon.noname-e con 0x7fac1c13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:54.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.829+0000 7fac21b3d640 10 monclient(hunting): picked mon.noname-f con 0x7fac1c13ca90 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:54.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.829+0000 7fac21b3d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c134c50 con 0x7fac1c13ca90 2024-09-13T10:37:54.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.829+0000 7fac21b3d640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c13e700 con 0x7fac1c0a8340 2024-09-13T10:37:54.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.829+0000 7fac21b3d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c13d3c0 con 0x7fac1c13f750 2024-09-13T10:37:54.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.829+0000 7fac21b3d640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:54.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.829+0000 7fac21b3d640 10 monclient(hunting): authenticate will time out at 1214.334233s 2024-09-13T10:37:54.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.829+0000 7fac1affd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fac1c13f750 0x7fac1c13c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41808/0 (socket says 172.21.15.181:41808) 2024-09-13T10:37:54.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.829+0000 7fac1affd640 1 -- 172.21.15.181:0/1401484316 learned_addr learned my addr 172.21.15.181:0/1401484316 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:54.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac1affd640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.181:6793/0 conn(0x7fac1c13f750 legacy=0x7fac1c13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac1b7fe640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.195:6791/0 conn(0x7fac1c0a8340 legacy=0x7fac1c13bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac1bfff640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.195:6789/0 conn(0x7fac1c13ca90 legacy=0x7fac1c1d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523904086 0 0) 0x7fac1c13d3c0 con 0x7fac1c13f750 2024-09-13T10:37:54.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): my global_id is 105236 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac08003550 con 0x7fac1c13f750 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac1b7fe640 1 --1- 172.21.15.181:0/1401484316 >> v1:172.21.15.195:6791/0 conn(0x7fac1c0a8340 0x7fac1c13bc70 :-1 s=OPENED pgs=611 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fac1c13e700 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923428787 0 0) 0x7fac1c134c50 con 0x7fac1c13ca90 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): my global_id is 134119 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac1c13d3c0 con 0x7fac1c13ca90 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4237580992 0 0) 0x7fac08003550 con 0x7fac1c13f750 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac1c134c50 con 0x7fac1c13f750 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fac10004d90 con 0x7fac1c13f750 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:54.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): dump: 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.846 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 482123580 0 0) 0x7fac1c13d3c0 con 0x7fac1c13ca90 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac08003550 con 0x7fac1c13ca90 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fac14002040 con 0x7fac1c13ca90 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 10 monclient(hunting): dump: 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.847 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.831+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2864535870 0 0) 0x7fac1c134c50 con 0x7fac1c13f750 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.195:6791/0 conn(0x7fac1c0a8340 legacy=0x7fac1c13bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.195:6789/0 conn(0x7fac1c13ca90 legacy=0x7fac1c1d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 10 monclient: _finish_hunting 0 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 1 monclient: found mon.e 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c1343b0 con 0x7fac1c13f750 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 10 monclient: _finish_auth 0 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 10 monclient: _check_auth_tickets 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac21b3d640 5 monclient: authenticate success, global_id 105236 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144956306 0 0) 0x7fac1c13e700 con 0x7fac1c0a8340 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac21b3d640 10 monclient: _renew_subs 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac21b3d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac21b3d640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fac1c134690 con 0x7fac1c13f750 2024-09-13T10:37:54.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac21b3d640 10 monclient: _renew_subs 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac21b3d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac21b3d640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fac1c1d7a40 con 0x7fac1c13f750 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac10001b00 con 0x7fac1c13f750 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fac10005700 con 0x7fac1c13f750 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac19ffb640 4 set_mon_vals no callback set 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 10 monclient: dump: 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.850 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac21b3d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:54.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac21b3d640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fabfc0065c0 con 0x7fabfc002860 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.832+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fac10011d80 con 0x7fac1c13f750 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.833+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(248..248 src has 1..248) ==== 3898+0+0 (unknown 3875839112 0 0) 0x7fac1004e3f0 con 0x7fac1c13f750 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.833+0000 7fac1bfff640 10 monclient: get_auth_request con 0x7fac08040020 auth_method 0 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac1b7fe640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.181:6793/0 conn(0x7fabfc002860 legacy=0x7fabfc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3814480190 0 0) 0x7fabfc0065c0 con 0x7fabfc002860 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 10 monclient(hunting): my global_id is 105245 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac1c13e700 con 0x7fabfc002860 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1567526077 0 0) 0x7fac1c13e700 con 0x7fabfc002860 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fabfc0065c0 con 0x7fabfc002860 2024-09-13T10:37:54.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fac0c001cb0 con 0x7fabfc002860 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 10 monclient: dump: 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.853 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1520471764 0 0) 0x7fabfc0065c0 con 0x7fabfc002860 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fabfc00a160 con 0x7fabfc002860 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fac0c0068d0 con 0x7fabfc002860 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.181:6793/0 conn(0x7fabfc002860 legacy=0x7fabfc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.835+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.181:6793/0 conn(0x7fabfc002860 legacy=0x7fabfc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.841+0000 7fac21b3d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:54.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.841+0000 7fac21b3d640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fabfc009e70 con 0x7fabfc009130 2024-09-13T10:37:54.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac1b7fe640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.181:6793/0 conn(0x7fabfc009130 legacy=0x7fabfc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 411872781 0 0) 0x7fabfc009e70 con 0x7fabfc009130 2024-09-13T10:37:54.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 10 monclient(hunting): my global_id is 105254 2024-09-13T10:37:54.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabfc0065c0 con 0x7fabfc009130 2024-09-13T10:37:54.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 710379285 0 0) 0x7fabfc0065c0 con 0x7fabfc009130 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fabfc009e70 con 0x7fabfc009130 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fac0c003d40 con 0x7fabfc009130 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 10 monclient: dump: 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.857 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 905073491 0 0) 0x7fabfc009e70 con 0x7fabfc009130 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.844+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fabfc00c410 con 0x7fabfc009130 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 645364767) 0x7fac0c006a80 con 0x7fabfc009130 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac03fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac03fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:54.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.181:6793/0 conn(0x7fabfc009130 legacy=0x7fabfc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac03fff640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.181:6793/0 conn(0x7fabfc009130 legacy=0x7fabfc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:54.859 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:54.859 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:54.859 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:54.859 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:54.859 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:54.859 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 158547, 2024-09-13T10:37:54.859 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:54.859 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:54.860 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:54.861 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.862 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:54.863 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:54.864 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:54.865 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.867 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.868 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:54.871 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.872 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.873 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:54.874 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:54.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.876 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.877 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:54.877 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:54.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.877 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:54.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:54.879 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:54.879 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:54.879 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:54.879 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:54.879 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:54.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:54.879 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:54.879 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:54.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac21b3d640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.195:6800/1839191919 conn(0x7fac08040020 legacy=0x7fac080424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac21b3d640 10 monclient: shutdown 2024-09-13T10:37:54.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac21b3d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:54.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac21b3d640 1 -- 172.21.15.181:0/1401484316 >> v1:172.21.15.181:6793/0 conn(0x7fac1c13f750 legacy=0x7fac1c13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac1bfff640 1 -- 172.21.15.181:0/1401484316 reap_dead start 2024-09-13T10:37:54.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac1bfff640 1 -- 172.21.15.181:0/1401484316 reap_dead start 2024-09-13T10:37:54.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac21b3d640 1 -- 172.21.15.181:0/1401484316 shutdown_connections 2024-09-13T10:37:54.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac21b3d640 1 -- 172.21.15.181:0/1401484316 >> 172.21.15.181:0/1401484316 conn(0x7fac1c0a6640 msgr2=0x7fac1c0a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:54.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac21b3d640 1 -- 172.21.15.181:0/1401484316 shutdown_connections 2024-09-13T10:37:54.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.845+0000 7fac21b3d640 1 -- 172.21.15.181:0/1401484316 wait complete. 2024-09-13T10:37:54.881 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:54.881 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:37:54.882 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:37:54.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.979+0000 7f58dd3aa640 10 monclient: get_monmap_and_config 2024-09-13T10:37:54.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.979+0000 7f58dd3aa640 10 monclient: build_initial_monmap 2024-09-13T10:37:54.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.979+0000 7f58dd3aa640 10 monclient: monmap: 2024-09-13T10:37:54.981 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:54.981 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.981 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:54.979863+0000 2024-09-13T10:37:54.981 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:54.979863+0000 2024-09-13T10:37:54.981 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:54.981 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.981 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:54.982 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:54.982 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:54.982 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:54.982 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:54.982 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:54.982 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:54.982 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:54.982 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:54.982 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.979+0000 7f58dd3aa640 1 Processor -- start 2024-09-13T10:37:54.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.979+0000 7f58dd3aa640 1 -- start start 2024-09-13T10:37:54.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.979+0000 7f58dd3aa640 10 monclient: init 2024-09-13T10:37:54.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58dd3aa640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:54.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58dd3aa640 10 monclient: _add_conns ranks=[5,0,8,1,7,6,4,3,2] 2024-09-13T10:37:54.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58dd3aa640 10 monclient(hunting): picked mon.noname-h con 0x7f58d80a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:54.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58dd3aa640 10 monclient(hunting): picked mon.noname-a con 0x7f58d80a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:54.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58dd3aa640 10 monclient(hunting): picked mon.noname-e con 0x7f58d813f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58dd3aa640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d80a5fe0 con 0x7f58d80a6ab0 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58dd3aa640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d80a8080 con 0x7f58d80a66d0 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58dd3aa640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d80a42c0 con 0x7f58d813f9a0 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58dd3aa640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58dd3aa640 10 monclient(hunting): authenticate will time out at 1214.485399s 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58d77fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f58d813f9a0 0x7f58d8141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41830/0 (socket says 172.21.15.181:41830) 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58d67fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f58d80a6ab0 0x7f58d80a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36782/0 (socket says 172.21.15.181:36782) 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.980+0000 7f58d77fe640 1 -- 172.21.15.181:0/1988920145 learned_addr learned my addr 172.21.15.181:0/1988920145 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d77fe640 1 -- 172.21.15.181:0/1988920145 >> v1:172.21.15.181:6793/0 conn(0x7f58d813f9a0 legacy=0x7f58d8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d67fc640 1 -- 172.21.15.181:0/1988920145 >> v1:172.21.15.181:6789/0 conn(0x7f58d80a6ab0 legacy=0x7f58d80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d6ffd640 1 -- 172.21.15.181:0/1988920145 >> v1:172.21.15.195:6791/0 conn(0x7f58d80a66d0 legacy=0x7f58d80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3642333750 0 0) 0x7f58d80a42c0 con 0x7f58d813f9a0 2024-09-13T10:37:54.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d5ffb640 10 monclient(hunting): my global_id is 105263 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58c0003520 con 0x7f58d813f9a0 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198544027 0 0) 0x7f58d80a5fe0 con 0x7f58d80a6ab0 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d5ffb640 10 monclient(hunting): my global_id is 114885 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.982+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d80a42c0 con 0x7f58d80a6ab0 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704753645 0 0) 0x7f58d80a8080 con 0x7f58d80a66d0 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:54.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient(hunting): my global_id is 105071 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d80a5fe0 con 0x7f58d80a66d0 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4037076592 0 0) 0x7f58d80a42c0 con 0x7f58d80a6ab0 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 >> v1:172.21.15.181:6793/0 conn(0x7f58d813f9a0 legacy=0x7f58d8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 >> v1:172.21.15.195:6791/0 conn(0x7f58d80a66d0 legacy=0x7f58d80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 1 monclient: found mon.noname-a 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d81464e0 con 0x7f58d80a6ab0 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient: _finish_auth 0 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:37:54.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58dd3aa640 5 monclient: authenticate success, global_id 114885 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58cc001a50 con 0x7f58d80a6ab0 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58dd3aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient: dump: 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.991 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58dd3aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58cc001d20 con 0x7f58d80a6ab0 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 1 -- 172.21.15.181:0/1988920145 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58cc004b20 con 0x7f58d80a6ab0 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:54.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58d5ffb640 10 monclient: dump: 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:54.993 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58dd3aa640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58dd3aa640 4 set_mon_vals no callback set 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58dd3aa640 10 monclient: shutdown 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58dd3aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1988920145 >> v1:172.21.15.181:6789/0 conn(0x7f58d80a6ab0 legacy=0x7f58d80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1988920145 shutdown_connections 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1988920145 >> 172.21.15.181:0/1988920145 conn(0x7f58d80abcd0 msgr2=0x7f58d80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1988920145 shutdown_connections 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.983+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1988920145 wait complete. 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.984+0000 7f58dd3aa640 10 monclient: build_initial_monmap 2024-09-13T10:37:54.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.984+0000 7f58dd3aa640 10 monclient: monmap: 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:54.995 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.984+0000 7f58dd3aa640 1 Processor -- start 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58dd3aa640 1 -- start start 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58dd3aa640 10 monclient: init 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58dd3aa640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58dd3aa640 10 monclient: _add_conns ranks=[8,5,4,0,7,3,1,6,2] 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58dd3aa640 10 monclient(hunting): picked mon.noname-e con 0x7f58d80a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58dd3aa640 10 monclient(hunting): picked mon.noname-h con 0x7f58d80a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58dd3aa640 10 monclient(hunting): picked mon.noname-c con 0x7f58d813f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58dd3aa640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d813d2a0 con 0x7f58d813f9a0 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58dd3aa640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d813f600 con 0x7f58d80a6ab0 2024-09-13T10:37:54.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58dd3aa640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d80a2780 con 0x7f58d80a66d0 2024-09-13T10:37:54.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58dd3aa640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:54.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58dd3aa640 10 monclient(hunting): authenticate will time out at 1214.490573s 2024-09-13T10:37:54.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58d6ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f58d80a66d0 0x7f58d81ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41840/0 (socket says 172.21.15.181:41840) 2024-09-13T10:37:54.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.985+0000 7f58d6ffd640 1 -- 172.21.15.181:0/1441517010 learned_addr learned my addr 172.21.15.181:0/1441517010 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:55.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58d6ffd640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.181:6793/0 conn(0x7f58d80a66d0 legacy=0x7f58d81ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58d77fe640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.181:6791/0 conn(0x7f58d813f9a0 legacy=0x7f58d81d67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352209430 0 0) 0x7f58d80a2780 con 0x7f58d80a66d0 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58bf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58bf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58bf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58bf7fe640 10 monclient(hunting): my global_id is 105272 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58c4003520 con 0x7f58d80a66d0 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58d67fc640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.195:6791/0 conn(0x7f58d80a6ab0 legacy=0x7f58d81cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 813592244 0 0) 0x7f58d813d2a0 con 0x7f58d813f9a0 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58bf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58bf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58bf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58bf7fe640 10 monclient(hunting): my global_id is 114898 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.987+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d80a2780 con 0x7f58d813f9a0 2024-09-13T10:37:55.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242572642 0 0) 0x7f58d813f600 con 0x7f58d80a6ab0 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient(hunting): my global_id is 105080 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d813d2a0 con 0x7f58d80a6ab0 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3101696162 0 0) 0x7f58c4003520 con 0x7f58d80a66d0 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58d813f600 con 0x7f58d80a66d0 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58c8003610 con 0x7f58d80a66d0 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient(hunting): dump: 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.003 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.004 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 264593124 0 0) 0x7f58d80a2780 con 0x7f58d813f9a0 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58c4003520 con 0x7f58d813f9a0 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58d00020a0 con 0x7f58d813f9a0 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient(hunting): dump: 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.005 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1920015425 0 0) 0x7f58d813f600 con 0x7f58d80a66d0 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.195:6791/0 conn(0x7f58d80a6ab0 legacy=0x7f58d81cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.181:6791/0 conn(0x7f58d813f9a0 legacy=0x7f58d81d67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:55.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 monclient: found mon.e 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d813ed60 con 0x7f58d80a66d0 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58dd3aa640 5 monclient: authenticate success, global_id 105272 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58dd3aa640 10 monclient: _renew_subs 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58dd3aa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f58d813de00 con 0x7f58d80a66d0 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58dd3aa640 10 monclient: _renew_subs 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58dd3aa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f58d81d7ec0 con 0x7f58d80a66d0 2024-09-13T10:37:55.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58c8003bd0 con 0x7f58d80a66d0 2024-09-13T10:37:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58c8004140 con 0x7f58d80a66d0 2024-09-13T10:37:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58d57fa640 4 set_mon_vals no callback set 2024-09-13T10:37:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.988+0000 7f58bf7fe640 10 monclient: dump: 2024-09-13T10:37:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.008 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.989+0000 7f58dd3aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.989+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f58b80065c0 con 0x7f58b8002860 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.989+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f58c80042e0 con 0x7f58d80a66d0 2024-09-13T10:37:55.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.989+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(248..248 src has 1..248) ==== 3898+0+0 (unknown 3875839112 0 0) 0x7f58c804e480 con 0x7f58d80a66d0 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.989+0000 7f58d77fe640 10 monclient: get_auth_request con 0x7f58c40400a0 auth_method 0 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58d67fc640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.195:6789/0 conn(0x7f58b8002860 legacy=0x7f58b8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1838837589 0 0) 0x7f58b80065c0 con 0x7f58b8002860 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58bf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58bf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58bf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58bf7fe640 10 monclient(hunting): my global_id is 134128 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d813f600 con 0x7f58b8002860 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1729392778 0 0) 0x7f58d813f600 con 0x7f58b8002860 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58b80065c0 con 0x7f58b8002860 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58cc001a30 con 0x7f58b8002860 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58bf7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.991+0000 7f58bf7fe640 10 monclient: dump: 2024-09-13T10:37:55.010 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.011 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.012 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.992+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2624990103 0 0) 0x7f58b80065c0 con 0x7f58b8002860 2024-09-13T10:37:55.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.992+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f58b800a160 con 0x7f58b8002860 2024-09-13T10:37:55.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.992+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f58cc0072c0 con 0x7f58b8002860 2024-09-13T10:37:55.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.992+0000 7f58bf7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:55.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.992+0000 7f58bf7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:55.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.992+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.195:6789/0 conn(0x7f58b8002860 legacy=0x7f58b8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.992+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.195:6789/0 conn(0x7f58b8002860 legacy=0x7f58b8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:55.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.998+0000 7f58dd3aa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:55.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:54.998+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f58b8009e50 con 0x7f58b8009110 2024-09-13T10:37:55.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58d67fc640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.195:6789/0 conn(0x7f58b8009110 legacy=0x7f58b80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243638183 0 0) 0x7f58b8009e50 con 0x7f58b8009110 2024-09-13T10:37:55.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 10 monclient(hunting): my global_id is 134137 2024-09-13T10:37:55.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b80065c0 con 0x7f58b8009110 2024-09-13T10:37:55.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4101060686 0 0) 0x7f58b80065c0 con 0x7f58b8009110 2024-09-13T10:37:55.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58b8009e50 con 0x7f58b8009110 2024-09-13T10:37:55.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58cc005990 con 0x7f58b8009110 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 10 monclient: dump: 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.015 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.016 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.016 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.016 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.016 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.016 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2955189359 0 0) 0x7f58b8009e50 con 0x7f58b8009110 2024-09-13T10:37:55.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.001+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f58b800c3f0 con 0x7f58b8009110 2024-09-13T10:37:55.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 1236179833) 0x7f58cc009d90 con 0x7f58b8009110 2024-09-13T10:37:55.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58bf7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:55.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58bf7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:55.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.195:6789/0 conn(0x7f58b8009110 legacy=0x7f58b80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58bf7fe640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.195:6789/0 conn(0x7f58b8009110 legacy=0x7f58b80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:55.017 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:55.017 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:55.017 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:55.017 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:55.017 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:55.017 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 7029, 2024-09-13T10:37:55.017 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:55.017 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:55.017 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:55.017 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:55.017 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:55.017 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:55.018 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:55.019 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:55.020 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:55.021 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.022 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:55.024 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.025 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.026 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.027 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.028 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.029 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.030 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:55.032 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.033 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:55.034 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:55.035 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.035 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.035 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:55.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.035 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:55.035 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:55.035 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:55.035 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.035 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.035 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:55.035 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.195:6800/1839191919 conn(0x7f58c40400a0 legacy=0x7f58c4042560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58dd3aa640 10 monclient: shutdown 2024-09-13T10:37:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58dd3aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1441517010 >> v1:172.21.15.181:6793/0 conn(0x7f58d80a66d0 legacy=0x7f58d81ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58d77fe640 1 -- 172.21.15.181:0/1441517010 reap_dead start 2024-09-13T10:37:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58d77fe640 1 -- 172.21.15.181:0/1441517010 reap_dead start 2024-09-13T10:37:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1441517010 shutdown_connections 2024-09-13T10:37:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1441517010 >> 172.21.15.181:0/1441517010 conn(0x7f58d80abcd0 msgr2=0x7f58d80a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1441517010 shutdown_connections 2024-09-13T10:37:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.002+0000 7f58dd3aa640 1 -- 172.21.15.181:0/1441517010 wait complete. 2024-09-13T10:37:55.038 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:55.038 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:37:55.038 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:37:55.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.135+0000 7fa768e7c640 10 monclient: get_monmap_and_config 2024-09-13T10:37:55.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.135+0000 7fa768e7c640 10 monclient: build_initial_monmap 2024-09-13T10:37:55.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.135+0000 7fa768e7c640 10 monclient: monmap: 2024-09-13T10:37:55.137 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:55.137 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.137 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:55.136214+0000 2024-09-13T10:37:55.137 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:55.136214+0000 2024-09-13T10:37:55.137 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:55.137 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.137 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:55.138 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:55.138 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:55.138 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:55.138 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:55.138 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:55.138 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:55.138 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:55.138 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:55.138 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.136+0000 7fa768e7c640 1 Processor -- start 2024-09-13T10:37:55.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.136+0000 7fa768e7c640 1 -- start start 2024-09-13T10:37:55.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.136+0000 7fa768e7c640 10 monclient: init 2024-09-13T10:37:55.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.136+0000 7fa768e7c640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:55.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.136+0000 7fa768e7c640 10 monclient: _add_conns ranks=[4,6,7,2,0,1,3,5,8] 2024-09-13T10:37:55.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.136+0000 7fa768e7c640 10 monclient(hunting): picked mon.noname-c con 0x7fa7640a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:55.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.136+0000 7fa768e7c640 10 monclient(hunting): picked mon.noname-d con 0x7fa7640a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:55.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.136+0000 7fa768e7c640 10 monclient(hunting): picked mon.noname-i con 0x7fa76413f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:55.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.137+0000 7fa768e7c640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7640a4bc0 con 0x7fa7640a6640 2024-09-13T10:37:55.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.137+0000 7fa768e7c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76413a320 con 0x7fa7640a8340 2024-09-13T10:37:55.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.137+0000 7fa768e7c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7640a8100 con 0x7fa76413f750 2024-09-13T10:37:55.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.137+0000 7fa768e7c640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:55.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.137+0000 7fa768e7c640 10 monclient(hunting): authenticate will time out at 1214.642047s 2024-09-13T10:37:55.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.137+0000 7fa75bfff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fa7640a8340 0x7fa764139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:49206/0 (socket says 172.21.15.181:49206) 2024-09-13T10:37:55.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.137+0000 7fa76259c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fa7640a6640 0x7fa764139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41428/0 (socket says 172.21.15.181:41428) 2024-09-13T10:37:55.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.137+0000 7fa75bfff640 1 -- 172.21.15.181:0/489874820 learned_addr learned my addr 172.21.15.181:0/489874820 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:55.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa75bfff640 1 -- 172.21.15.181:0/489874820 >> v1:172.21.15.181:6792/0 conn(0x7fa7640a8340 legacy=0x7fa764139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa76259c640 1 -- 172.21.15.181:0/489874820 >> v1:172.21.15.181:6791/0 conn(0x7fa7640a6640 legacy=0x7fa764139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 1 -- 172.21.15.181:0/489874820 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038537974 0 0) 0x7fa7640a4bc0 con 0x7fa7640a6640 2024-09-13T10:37:55.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient(hunting): my global_id is 114907 2024-09-13T10:37:55.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 1 -- 172.21.15.181:0/489874820 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa750003520 con 0x7fa7640a6640 2024-09-13T10:37:55.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 1 -- 172.21.15.181:0/489874820 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239874997 0 0) 0x7fa76413a320 con 0x7fa7640a8340 2024-09-13T10:37:55.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient(hunting): my global_id is 134142 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 1 -- 172.21.15.181:0/489874820 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7640a4bc0 con 0x7fa7640a8340 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa762d9d640 1 -- 172.21.15.181:0/489874820 >> v1:172.21.15.195:6792/0 conn(0x7fa76413f750 legacy=0x7fa764141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 1 -- 172.21.15.181:0/489874820 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1502389973 0 0) 0x7fa750003520 con 0x7fa7640a6640 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 1 -- 172.21.15.181:0/489874820 >> v1:172.21.15.195:6792/0 conn(0x7fa76413f750 legacy=0x7fa764141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 1 -- 172.21.15.181:0/489874820 >> v1:172.21.15.181:6792/0 conn(0x7fa7640a8340 legacy=0x7fa764139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 1 monclient: found mon.noname-c 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 1 -- 172.21.15.181:0/489874820 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7640a48e0 con 0x7fa7640a6640 2024-09-13T10:37:55.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient: _finish_auth 0 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 1 -- 172.21.15.181:0/489874820 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa754001a10 con 0x7fa7640a6640 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa768e7c640 5 monclient: authenticate success, global_id 114907 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa768e7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient: dump: 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.146 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa768e7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 1 -- 172.21.15.181:0/489874820 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa754001ce0 con 0x7fa7640a6640 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 1 -- 172.21.15.181:0/489874820 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa754004b20 con 0x7fa7640a6640 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa768e7c640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:55.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa768e7c640 4 set_mon_vals no callback set 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.139+0000 7fa761d9b640 10 monclient: dump: 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.148 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.140+0000 7fa768e7c640 10 monclient: shutdown 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.140+0000 7fa768e7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.140+0000 7fa768e7c640 1 -- 172.21.15.181:0/489874820 >> v1:172.21.15.181:6791/0 conn(0x7fa7640a6640 legacy=0x7fa764139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.140+0000 7fa768e7c640 1 -- 172.21.15.181:0/489874820 shutdown_connections 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.140+0000 7fa768e7c640 1 -- 172.21.15.181:0/489874820 >> 172.21.15.181:0/489874820 conn(0x7fa764077170 msgr2=0x7fa7640abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.140+0000 7fa768e7c640 1 -- 172.21.15.181:0/489874820 shutdown_connections 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.140+0000 7fa768e7c640 1 -- 172.21.15.181:0/489874820 wait complete. 2024-09-13T10:37:55.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 10 monclient: build_initial_monmap 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 10 monclient: monmap: 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:55.150 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 1 Processor -- start 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 1 -- start start 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 10 monclient: init 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 10 monclient: _add_conns ranks=[6,8,7,3,2,0,4,5,1] 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 10 monclient(hunting): picked mon.noname-d con 0x7fa7640a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 10 monclient(hunting): picked mon.noname-e con 0x7fa76413f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 10 monclient(hunting): picked mon.noname-i con 0x7fa7641d4520 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7640a1300 con 0x7fa7640a8340 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7640aa010 con 0x7fa7641d4520 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7641cf0f0 con 0x7fa76413f750 2024-09-13T10:37:55.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:55.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa768e7c640 10 monclient(hunting): authenticate will time out at 1214.646926s 2024-09-13T10:37:55.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa76259c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fa7640a8340 0x7fa7641ce2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:49214/0 (socket says 172.21.15.181:49214) 2024-09-13T10:37:55.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.141+0000 7fa76259c640 1 -- 172.21.15.181:0/4005803211 learned_addr learned my addr 172.21.15.181:0/4005803211 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:55.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa76259c640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.181:6792/0 conn(0x7fa7640a8340 legacy=0x7fa7641ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75bfff640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.181:6793/0 conn(0x7fa76413f750 legacy=0x7fa7641ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 678410059 0 0) 0x7fa7640a1300 con 0x7fa7640a8340 2024-09-13T10:37:55.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): my global_id is 134151 2024-09-13T10:37:55.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa744003550 con 0x7fa7640a8340 2024-09-13T10:37:55.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2336986680 0 0) 0x7fa7641cf0f0 con 0x7fa76413f750 2024-09-13T10:37:55.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): my global_id is 105281 2024-09-13T10:37:55.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7640a1300 con 0x7fa76413f750 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa762d9d640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.195:6792/0 conn(0x7fa7641d4520 legacy=0x7fa7641d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1774394741 0 0) 0x7fa744003550 con 0x7fa7640a8340 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7641cf0f0 con 0x7fa7640a8340 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4157091891 0 0) 0x7fa7640a1300 con 0x7fa76413f750 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa744003550 con 0x7fa76413f750 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa754004b20 con 0x7fa7640a8340 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): dump: 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.157 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa74c0047e0 con 0x7fa76413f750 2024-09-13T10:37:55.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:55.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:55.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient(hunting): dump: 2024-09-13T10:37:55.159 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.159 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.159 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.159 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.159 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.159 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.159 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 636651615 0 0) 0x7fa7641cf0f0 con 0x7fa7640a8340 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.181:6793/0 conn(0x7fa76413f750 legacy=0x7fa7641ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.195:6792/0 conn(0x7fa7641d4520 legacy=0x7fa7641d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 monclient: found mon.d 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7640a0490 con 0x7fa7640a8340 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient: _finish_auth 0 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa768e7c640 5 monclient: authenticate success, global_id 134151 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa768e7c640 10 monclient: _renew_subs 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa768e7c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa768e7c640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa7640a0a60 con 0x7fa7640a8340 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa768e7c640 10 monclient: _renew_subs 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa768e7c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:37:55.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa768e7c640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fa76409fdd0 con 0x7fa7640a8340 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa754001ce0 con 0x7fa7640a8340 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa7540014b0 con 0x7fa7640a8340 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa76159a640 4 set_mon_vals no callback set 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.144+0000 7fa75affd640 10 monclient: dump: 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.162 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.145+0000 7fa768e7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.145+0000 7fa768e7c640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa7480065c0 con 0x7fa748002860 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.145+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa754011930 con 0x7fa7640a8340 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.145+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(248..248 src has 1..248) ==== 3898+0+0 (unknown 3875839112 0 0) 0x7fa75404e300 con 0x7fa7640a8340 2024-09-13T10:37:55.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.146+0000 7fa762d9d640 10 monclient: get_auth_request con 0x7fa744040030 auth_method 0 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.147+0000 7fa75bfff640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.195:6790/0 conn(0x7fa748002860 legacy=0x7fa748004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147566961 0 0) 0x7fa7480065c0 con 0x7fa748002860 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 10 monclient(hunting): my global_id is 134112 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7641cf0f0 con 0x7fa748002860 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 890034223 0 0) 0x7fa7641cf0f0 con 0x7fa748002860 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7480065c0 con 0x7fa748002860 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa74c004eb0 con 0x7fa748002860 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:55.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 10 monclient: dump: 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.165 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.166 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.166 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2193409928 0 0) 0x7fa7480065c0 con 0x7fa748002860 2024-09-13T10:37:55.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.148+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa74800a160 con 0x7fa748002860 2024-09-13T10:37:55.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.149+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa74c0063d0 con 0x7fa748002860 2024-09-13T10:37:55.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.149+0000 7fa75affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:55.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.149+0000 7fa75affd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:55.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.149+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.195:6790/0 conn(0x7fa748002860 legacy=0x7fa748004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.149+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.195:6790/0 conn(0x7fa748002860 legacy=0x7fa748004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:55.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.155+0000 7fa768e7c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:55.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.155+0000 7fa768e7c640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa748009e50 con 0x7fa748009110 2024-09-13T10:37:55.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.157+0000 7fa75bfff640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.195:6790/0 conn(0x7fa748009110 legacy=0x7fa7480095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.157+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3360951718 0 0) 0x7fa748009e50 con 0x7fa748009110 2024-09-13T10:37:55.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.157+0000 7fa75affd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.157+0000 7fa75affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.157+0000 7fa75affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.157+0000 7fa75affd640 10 monclient(hunting): my global_id is 134121 2024-09-13T10:37:55.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.157+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7480065c0 con 0x7fa748009110 2024-09-13T10:37:55.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2914228945 0 0) 0x7fa7480065c0 con 0x7fa748009110 2024-09-13T10:37:55.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa748009e50 con 0x7fa748009110 2024-09-13T10:37:55.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa74c005460 con 0x7fa748009110 2024-09-13T10:37:55.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 10 monclient: dump: 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.169 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.170 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.170 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.170 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.170 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3381065946 0 0) 0x7fa748009e50 con 0x7fa748009110 2024-09-13T10:37:55.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa74800c3f0 con 0x7fa748009110 2024-09-13T10:37:55.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 1251905662) 0x7fa74c005830 con 0x7fa748009110 2024-09-13T10:37:55.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:55.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:55.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.195:6790/0 conn(0x7fa748009110 legacy=0x7fa7480095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.158+0000 7fa75affd640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.195:6790/0 conn(0x7fa748009110 legacy=0x7fa7480095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:55.170 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 7187, 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:55.171 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:55.172 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:55.173 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:55.174 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:55.175 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.176 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:55.177 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.178 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.179 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:55.181 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.182 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.183 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.184 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.185 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.186 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:55.189 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.190 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:55.190 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:55.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.159+0000 7fa768e7c640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa744040030 legacy=0x7fa7440424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.159+0000 7fa768e7c640 10 monclient: shutdown 2024-09-13T10:37:55.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.159+0000 7fa768e7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:55.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.159+0000 7fa768e7c640 1 -- 172.21.15.181:0/4005803211 >> v1:172.21.15.181:6792/0 conn(0x7fa7640a8340 legacy=0x7fa7641ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.159+0000 7fa762d9d640 1 -- 172.21.15.181:0/4005803211 reap_dead start 2024-09-13T10:37:55.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.159+0000 7fa762d9d640 1 -- 172.21.15.181:0/4005803211 reap_dead start 2024-09-13T10:37:55.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.159+0000 7fa768e7c640 1 -- 172.21.15.181:0/4005803211 shutdown_connections 2024-09-13T10:37:55.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.159+0000 7fa768e7c640 1 -- 172.21.15.181:0/4005803211 >> 172.21.15.181:0/4005803211 conn(0x7fa7640a6640 msgr2=0x7fa764141cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:55.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.159+0000 7fa768e7c640 1 -- 172.21.15.181:0/4005803211 shutdown_connections 2024-09-13T10:37:55.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.159+0000 7fa768e7c640 1 -- 172.21.15.181:0/4005803211 wait complete. 2024-09-13T10:37:55.192 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:55.192 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:37:55.192 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:37:55.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.289+0000 7f92895c2640 10 monclient: get_monmap_and_config 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.289+0000 7f92895c2640 10 monclient: build_initial_monmap 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.289+0000 7f92895c2640 10 monclient: monmap: 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:55.289892+0000 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:55.289892+0000 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:55.291 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:55.292 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:55.292 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:55.292 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:55.292 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:55.292 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.289+0000 7f92895c2640 1 Processor -- start 2024-09-13T10:37:55.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.289+0000 7f92895c2640 1 -- start start 2024-09-13T10:37:55.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.289+0000 7f92895c2640 10 monclient: init 2024-09-13T10:37:55.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.290+0000 7f92895c2640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:55.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.290+0000 7f92895c2640 10 monclient: _add_conns ranks=[1,3,5,6,8,0,4,7,2] 2024-09-13T10:37:55.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.290+0000 7f92895c2640 10 monclient(hunting): picked mon.noname-f con 0x7f92840a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:55.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.290+0000 7f92895c2640 10 monclient(hunting): picked mon.noname-g con 0x7f92840a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:55.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.290+0000 7f92895c2640 10 monclient(hunting): picked mon.noname-h con 0x7f928413f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:55.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.290+0000 7f92895c2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92840a5fe0 con 0x7f92840a66d0 2024-09-13T10:37:55.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.290+0000 7f92895c2640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92840a8080 con 0x7f92840a6ab0 2024-09-13T10:37:55.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.290+0000 7f92895c2640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92840a42c0 con 0x7f928413f9a0 2024-09-13T10:37:55.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.290+0000 7f92895c2640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:55.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.290+0000 7f92895c2640 10 monclient(hunting): authenticate will time out at 1214.795556s 2024-09-13T10:37:55.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.290+0000 7f9282ffd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f92840a66d0 0x7f92840a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:45362/0 (socket says 172.21.15.181:45362) 2024-09-13T10:37:55.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.290+0000 7f9282ffd640 1 -- 172.21.15.181:0/3186842869 learned_addr learned my addr 172.21.15.181:0/3186842869 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:55.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.292+0000 7f9282ffd640 1 -- 172.21.15.181:0/3186842869 >> v1:172.21.15.195:6789/0 conn(0x7f92840a66d0 legacy=0x7f92840a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.292+0000 7f92837fe640 1 -- 172.21.15.181:0/3186842869 >> v1:172.21.15.195:6791/0 conn(0x7f928413f9a0 legacy=0x7f9284141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.292+0000 7f92827fc640 1 -- 172.21.15.181:0/3186842869 >> v1:172.21.15.195:6790/0 conn(0x7f92840a6ab0 legacy=0x7f92840a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185575489 0 0) 0x7f92840a5fe0 con 0x7f92840a66d0 2024-09-13T10:37:55.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient(hunting): my global_id is 134146 2024-09-13T10:37:55.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f926c003520 con 0x7f92840a66d0 2024-09-13T10:37:55.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828928019 0 0) 0x7f92840a42c0 con 0x7f928413f9a0 2024-09-13T10:37:55.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient(hunting): my global_id is 105089 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92840a5fe0 con 0x7f928413f9a0 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1641143660 0 0) 0x7f92840a8080 con 0x7f92840a6ab0 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient(hunting): my global_id is 134130 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92840a42c0 con 0x7f92840a6ab0 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3744865336 0 0) 0x7f926c003520 con 0x7f92840a66d0 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 >> v1:172.21.15.195:6791/0 conn(0x7f928413f9a0 legacy=0x7f9284141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 >> v1:172.21.15.195:6790/0 conn(0x7f92840a6ab0 legacy=0x7f92840a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 monclient: found mon.noname-f 2024-09-13T10:37:55.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92841464e0 con 0x7f92840a66d0 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient: _finish_auth 0 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f92895c2640 5 monclient: authenticate success, global_id 134146 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9274001b90 con 0x7f92840a66d0 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f92895c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient: dump: 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.300 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.301 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f92895c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f92740048a0 con 0x7f92840a66d0 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f92895c2640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 1 -- 172.21.15.181:0/3186842869 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9274004e90 con 0x7f92840a66d0 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f92895c2640 4 set_mon_vals no callback set 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.293+0000 7f9281ffb640 10 monclient: dump: 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.302 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.294+0000 7f92895c2640 10 monclient: shutdown 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.294+0000 7f92895c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.294+0000 7f92895c2640 1 -- 172.21.15.181:0/3186842869 >> v1:172.21.15.195:6789/0 conn(0x7f92840a66d0 legacy=0x7f92840a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.294+0000 7f92895c2640 1 -- 172.21.15.181:0/3186842869 shutdown_connections 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.294+0000 7f92895c2640 1 -- 172.21.15.181:0/3186842869 >> 172.21.15.181:0/3186842869 conn(0x7f92840abcd0 msgr2=0x7f92840ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.294+0000 7f92895c2640 1 -- 172.21.15.181:0/3186842869 shutdown_connections 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.294+0000 7f92895c2640 1 -- 172.21.15.181:0/3186842869 wait complete. 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.294+0000 7f92895c2640 10 monclient: build_initial_monmap 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.294+0000 7f92895c2640 10 monclient: monmap: 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:55.304 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 1 Processor -- start 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 1 -- start start 2024-09-13T10:37:55.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 10 monclient: init 2024-09-13T10:37:55.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:55.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 10 monclient: _add_conns ranks=[4,0,7,8,1,5,3,6,2] 2024-09-13T10:37:55.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 10 monclient(hunting): picked mon.noname-c con 0x7f92840a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:55.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 10 monclient(hunting): picked mon.noname-a con 0x7f92840a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:55.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 10 monclient(hunting): picked mon.noname-i con 0x7f928413f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:55.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9284068910 con 0x7f92840a6ab0 2024-09-13T10:37:55.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92840a2c60 con 0x7f92840a66d0 2024-09-13T10:37:55.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f928413d260 con 0x7f928413f9a0 2024-09-13T10:37:55.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:55.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f92895c2640 10 monclient(hunting): authenticate will time out at 1214.800753s 2024-09-13T10:37:55.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f9282ffd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f92840a66d0 0x7f92841ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41434/0 (socket says 172.21.15.181:41434) 2024-09-13T10:37:55.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.295+0000 7f9282ffd640 1 -- 172.21.15.181:0/605713092 learned_addr learned my addr 172.21.15.181:0/605713092 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:55.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.297+0000 7f92827fc640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.181:6789/0 conn(0x7f92840a6ab0 legacy=0x7f92841d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f9282ffd640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.181:6791/0 conn(0x7f92840a66d0 legacy=0x7f92841ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f92837fe640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.195:6792/0 conn(0x7f928413f9a0 legacy=0x7f92841d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3968231453 0 0) 0x7f9284068910 con 0x7f92840a6ab0 2024-09-13T10:37:55.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): my global_id is 114894 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9270003550 con 0x7f92840a6ab0 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209865214 0 0) 0x7f92840a2c60 con 0x7f92840a66d0 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): my global_id is 114916 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9284068910 con 0x7f92840a66d0 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989178508 0 0) 0x7f928413d260 con 0x7f928413f9a0 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): my global_id is 57148 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92840a2c60 con 0x7f928413f9a0 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 847528247 0 0) 0x7f9284068910 con 0x7f92840a66d0 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f928413d260 con 0x7f92840a66d0 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9274001b50 con 0x7f92840a66d0 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): dump: 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.313 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1058199133 0 0) 0x7f9270003550 con 0x7f92840a6ab0 2024-09-13T10:37:55.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9284068910 con 0x7f92840a6ab0 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9278003610 con 0x7f92840a6ab0 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): dump: 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.315 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1069517650 0 0) 0x7f92840a2c60 con 0x7f928413f9a0 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9270003550 con 0x7f928413f9a0 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f927c002080 con 0x7f928413f9a0 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient(hunting): dump: 2024-09-13T10:37:55.316 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.317 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4130840747 0 0) 0x7f928413d260 con 0x7f92840a66d0 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.195:6792/0 conn(0x7f928413f9a0 legacy=0x7f92841d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.181:6789/0 conn(0x7f92840a6ab0 legacy=0x7f92841d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 monclient: found mon.c 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928413f5c0 con 0x7f92840a66d0 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f92895c2640 5 monclient: authenticate success, global_id 114916 2024-09-13T10:37:55.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f92895c2640 10 monclient: _renew_subs 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f92895c2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f92895c2640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f928413ddc0 con 0x7f92840a66d0 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f92895c2640 10 monclient: _renew_subs 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f92895c2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f92895c2640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f928413c7d0 con 0x7f92840a66d0 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f92740048a0 con 0x7f92840a66d0 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9274005490 con 0x7f92840a66d0 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f92817fa640 4 set_mon_vals no callback set 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.298+0000 7f926b7fe640 10 monclient: dump: 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.319 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.320 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.299+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9274011b10 con 0x7f92840a66d0 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.299+0000 7f92895c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.299+0000 7f92895c2640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f92640065c0 con 0x7f9264002860 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.299+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(248..248 src has 1..248) ==== 3898+0+0 (unknown 3875839112 0 0) 0x7f927404e3c0 con 0x7f92840a66d0 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.300+0000 7f92837fe640 10 monclient: get_auth_request con 0x7f9270040480 auth_method 0 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f92827fc640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.195:6791/0 conn(0x7f9264002860 legacy=0x7f9264004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3569815117 0 0) 0x7f92640065c0 con 0x7f9264002860 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 10 monclient(hunting): my global_id is 105098 2024-09-13T10:37:55.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f928413d260 con 0x7f9264002860 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1447530529 0 0) 0x7f928413d260 con 0x7f9264002860 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92640065c0 con 0x7f9264002860 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9278004100 con 0x7f9264002860 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 10 monclient: dump: 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.322 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1268871910 0 0) 0x7f92640065c0 con 0x7f9264002860 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.302+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f926400a160 con 0x7f9264002860 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.303+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9278004390 con 0x7f9264002860 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.303+0000 7f926b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.303+0000 7f926b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.303+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.195:6791/0 conn(0x7f9264002860 legacy=0x7f9264004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.303+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.195:6791/0 conn(0x7f9264002860 legacy=0x7f9264004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.309+0000 7f92895c2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:55.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.309+0000 7f92895c2640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9264009e30 con 0x7f9264009110 2024-09-13T10:37:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.311+0000 7f92827fc640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.195:6791/0 conn(0x7f9264009110 legacy=0x7f9264009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.311+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3104226709 0 0) 0x7f9264009e30 con 0x7f9264009110 2024-09-13T10:37:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.311+0000 7f926b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.311+0000 7f926b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.311+0000 7f926b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.311+0000 7f926b7fe640 10 monclient(hunting): my global_id is 105107 2024-09-13T10:37:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.311+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92640065c0 con 0x7f9264009110 2024-09-13T10:37:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 370105855 0 0) 0x7f92640065c0 con 0x7f9264009110 2024-09-13T10:37:55.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9264009e30 con 0x7f9264009110 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9278005cf0 con 0x7f9264009110 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 10 monclient: dump: 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.326 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2322242549 0 0) 0x7f9264009e30 con 0x7f9264009110 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f926400c3f0 con 0x7f9264009110 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 99905205) 0x7f9278007180 con 0x7f9264009110 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.195:6791/0 conn(0x7f9264009110 legacy=0x7f9264009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.312+0000 7f926b7fe640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.195:6791/0 conn(0x7f9264009110 legacy=0x7f9264009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:55.328 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:55.328 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:55.328 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:55.328 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:55.328 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:55.328 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 159011, 2024-09-13T10:37:55.328 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:55.328 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:55.328 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:55.328 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:55.328 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:55.329 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:55.330 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:55.331 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:55.332 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.333 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:55.334 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.335 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.337 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.338 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.340 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:55.341 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.342 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.344 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.345 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4 2024-09-13T10:37:55.346 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.347 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.347 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:55.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.347 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:55.347 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:55.347 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:37:55.347 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.347 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.347 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:55.348 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:55.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.313+0000 7f92895c2640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.195:6800/1839191919 conn(0x7f9270040480 legacy=0x7f9270042940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.313+0000 7f92895c2640 10 monclient: shutdown 2024-09-13T10:37:55.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.313+0000 7f92895c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:55.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.313+0000 7f92895c2640 1 -- 172.21.15.181:0/605713092 >> v1:172.21.15.181:6791/0 conn(0x7f92840a66d0 legacy=0x7f92841ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.313+0000 7f92837fe640 1 -- 172.21.15.181:0/605713092 reap_dead start 2024-09-13T10:37:55.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.313+0000 7f92837fe640 1 -- 172.21.15.181:0/605713092 reap_dead start 2024-09-13T10:37:55.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.313+0000 7f92895c2640 1 -- 172.21.15.181:0/605713092 shutdown_connections 2024-09-13T10:37:55.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.313+0000 7f92895c2640 1 -- 172.21.15.181:0/605713092 >> 172.21.15.181:0/605713092 conn(0x7f92840abcd0 msgr2=0x7f92840a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:55.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.313+0000 7f92895c2640 1 -- 172.21.15.181:0/605713092 shutdown_connections 2024-09-13T10:37:55.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.313+0000 7f92895c2640 1 -- 172.21.15.181:0/605713092 wait complete. 2024-09-13T10:37:55.350 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:55.350 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:37:55.350 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:37:55.455 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:55.455 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39593]: starting. 2024-09-13T10:37:55.455 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39593]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39556 2024-09-13T10:37:55.455 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39593]: created object 0... 2024-09-13T10:37:55.455 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39593]: created object 25... 2024-09-13T10:37:55.455 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39593]: created object 49... 2024-09-13T10:37:55.455 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39593]: finishing. 2024-09-13T10:37:55.456 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39593]: shutting down. 2024-09-13T10:37:55.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.458+0000 7f72593d1640 10 monclient: get_monmap_and_config 2024-09-13T10:37:55.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.458+0000 7f72593d1640 10 monclient: build_initial_monmap 2024-09-13T10:37:55.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.459+0000 7f72593d1640 10 monclient: monmap: 2024-09-13T10:37:55.460 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:55.460 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.460 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:55.459616+0000 2024-09-13T10:37:55.460 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:55.459616+0000 2024-09-13T10:37:55.460 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:55.461 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.461 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:55.461 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:55.461 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:55.461 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:55.461 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:55.461 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:55.461 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:55.461 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:55.461 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:55.461 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.459+0000 7f72593d1640 1 Processor -- start 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.459+0000 7f72593d1640 1 -- start start 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.459+0000 7f72593d1640 10 monclient: init 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.460+0000 7f72593d1640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.460+0000 7f72593d1640 10 monclient: _add_conns ranks=[1,3,7,8,0,4,2,5,6] 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.460+0000 7f72593d1640 10 monclient(hunting): picked mon.noname-f con 0x7f7254132b40 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.460+0000 7f72593d1640 10 monclient(hunting): picked mon.noname-g con 0x7f725409ca60 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.460+0000 7f72593d1640 10 monclient(hunting): picked mon.noname-i con 0x7f725409ead0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.460+0000 7f72593d1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725409d850 con 0x7f7254132b40 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.460+0000 7f72593d1640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725409db30 con 0x7f725409ca60 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.460+0000 7f72593d1640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725409de10 con 0x7f725409ead0 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.460+0000 7f72593d1640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.460+0000 7f72593d1640 10 monclient(hunting): authenticate will time out at 1214.965290s 2024-09-13T10:37:55.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.460+0000 7f7252ffd640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f7254132b40 0x7f7254132f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:45366/0 (socket says 172.21.15.181:45366) 2024-09-13T10:37:55.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.460+0000 7f7252ffd640 1 -- 172.21.15.181:0/2965092681 learned_addr learned my addr 172.21.15.181:0/2965092681 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:55.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f7252ffd640 1 -- 172.21.15.181:0/2965092681 >> v1:172.21.15.195:6789/0 conn(0x7f7254132b40 legacy=0x7f7254132f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f724a7fc640 1 -- 172.21.15.181:0/2965092681 >> v1:172.21.15.195:6790/0 conn(0x7f725409ca60 legacy=0x7f725413e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72537fe640 1 -- 172.21.15.181:0/2965092681 >> v1:172.21.15.195:6792/0 conn(0x7f725409ead0 legacy=0x7f7254141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654928528 0 0) 0x7f725409d850 con 0x7f7254132b40 2024-09-13T10:37:55.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 10 monclient(hunting): my global_id is 134155 2024-09-13T10:37:55.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7240003520 con 0x7f7254132b40 2024-09-13T10:37:55.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130325881 0 0) 0x7f725409db30 con 0x7f725409ca60 2024-09-13T10:37:55.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 10 monclient(hunting): my global_id is 134139 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f725409d850 con 0x7f725409ca60 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187301990 0 0) 0x7f725409de10 con 0x7f725409ead0 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 10 monclient(hunting): my global_id is 57157 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f725409db30 con 0x7f725409ead0 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4137351275 0 0) 0x7f7240003520 con 0x7f7254132b40 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 >> v1:172.21.15.195:6792/0 conn(0x7f725409ead0 legacy=0x7f7254141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.462+0000 7f72537fe640 1 --1- 172.21.15.181:0/2965092681 >> v1:172.21.15.195:6792/0 conn(0x7f725409ead0 0x7f7254141ab0 :-1 s=OPENED pgs=671 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f725409db30 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 >> v1:172.21.15.195:6790/0 conn(0x7f725409ca60 legacy=0x7f725413e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 10 monclient: _finish_hunting 0 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 1 monclient: found mon.noname-f 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725409e0f0 con 0x7f7254132b40 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 10 monclient: _finish_auth 0 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 10 monclient: _check_auth_tickets 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7244001b90 con 0x7f7254132b40 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72593d1640 5 monclient: authenticate success, global_id 134155 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72593d1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:55.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:37:55.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 10 monclient: dump: 2024-09-13T10:37:55.471 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.471 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.471 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.471 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.471 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.471 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.471 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.471 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.471 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.471 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72593d1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f724c001dd0 con 0x7f725409ead0 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f72440048a0 con 0x7f7254132b40 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72593d1640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72593d1640 4 set_mon_vals no callback set 2024-09-13T10:37:55.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 1 -- 172.21.15.181:0/2965092681 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7244004dd0 con 0x7f7254132b40 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72527fc640 10 monclient: dump: 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.473 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72593d1640 10 monclient: shutdown 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72593d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72593d1640 1 -- 172.21.15.181:0/2965092681 >> v1:172.21.15.195:6789/0 conn(0x7f7254132b40 legacy=0x7f7254132f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72593d1640 1 -- 172.21.15.181:0/2965092681 shutdown_connections 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72593d1640 1 -- 172.21.15.181:0/2965092681 >> 172.21.15.181:0/2965092681 conn(0x7f72540a8750 msgr2=0x7f72540a4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72593d1640 1 -- 172.21.15.181:0/2965092681 shutdown_connections 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.463+0000 7f72593d1640 1 -- 172.21.15.181:0/2965092681 wait complete. 2024-09-13T10:37:55.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.464+0000 7f72593d1640 10 monclient: build_initial_monmap 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.464+0000 7f72593d1640 10 monclient: monmap: 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:55.475 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.464+0000 7f72593d1640 1 Processor -- start 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.464+0000 7f72593d1640 1 -- start start 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.464+0000 7f72593d1640 10 monclient: init 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f72593d1640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f72593d1640 10 monclient: _add_conns ranks=[3,8,0,1,2,4,6,5,7] 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f72593d1640 10 monclient(hunting): picked mon.noname-g con 0x7f725409ca60 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f72593d1640 10 monclient(hunting): picked mon.noname-e con 0x7f725409ead0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f72593d1640 10 monclient(hunting): picked mon.noname-a con 0x7f7254132b40 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f72593d1640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725413ba10 con 0x7f7254132b40 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f72593d1640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725413d900 con 0x7f725409ca60 2024-09-13T10:37:55.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f72593d1640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725413dbe0 con 0x7f725409ead0 2024-09-13T10:37:55.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f72593d1640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:55.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f72593d1640 10 monclient(hunting): authenticate will time out at 1214.970290s 2024-09-13T10:37:55.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f724a7fc640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f725409ead0 0x7f725413ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41868/0 (socket says 172.21.15.181:41868) 2024-09-13T10:37:55.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f72537fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7254132b40 0x7f72541d6410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36800/0 (socket says 172.21.15.181:36800) 2024-09-13T10:37:55.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.465+0000 7f724a7fc640 1 -- 172.21.15.181:0/266153776 learned_addr learned my addr 172.21.15.181:0/266153776 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:55.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f7252ffd640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.195:6790/0 conn(0x7f725409ca60 legacy=0x7f725413a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724a7fc640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.181:6793/0 conn(0x7f725409ead0 legacy=0x7f725413ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f72537fe640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.181:6789/0 conn(0x7f7254132b40 legacy=0x7f72541d6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1978200830 0 0) 0x7f725413d900 con 0x7f725409ca60 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): my global_id is 134148 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7234003520 con 0x7f725409ca60 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 486101874 0 0) 0x7f725413ba10 con 0x7f7254132b40 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): my global_id is 114903 2024-09-13T10:37:55.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f725413d900 con 0x7f7254132b40 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182065601 0 0) 0x7f725413dbe0 con 0x7f725409ead0 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): my global_id is 105290 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f725413ba10 con 0x7f725409ead0 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 412202083 0 0) 0x7f7234003520 con 0x7f725409ca60 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f725413dbe0 con 0x7f725409ca60 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7244001bf0 con 0x7f725409ca60 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): dump: 2024-09-13T10:37:55.483 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.484 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.467+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3112514535 0 0) 0x7f725413d900 con 0x7f7254132b40 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7234003520 con 0x7f7254132b40 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 746770150 0 0) 0x7f725413ba10 con 0x7f725409ead0 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f725413d900 con 0x7f725409ead0 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f724c003cd0 con 0x7f7254132b40 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient(hunting): dump: 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.485 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f723c003610 con 0x7f725409ead0 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient(hunting): dump: 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.487 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4157634497 0 0) 0x7f725413dbe0 con 0x7f725409ca60 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.181:6793/0 conn(0x7f725409ead0 legacy=0x7f725413ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.181:6789/0 conn(0x7f7254132b40 legacy=0x7f72541d6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 1 monclient: found mon.g 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725413dec0 con 0x7f725409ca60 2024-09-13T10:37:55.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient: _finish_auth 0 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f72593d1640 5 monclient: authenticate success, global_id 134148 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f72593d1640 10 monclient: _renew_subs 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f72593d1640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f72593d1640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f725413bf10 con 0x7f725409ca60 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f72593d1640 10 monclient: _renew_subs 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f72593d1640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f72593d1640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f725413b620 con 0x7f725409ca60 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7244005040 con 0x7f725409ca60 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7244005530 con 0x7f725409ca60 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f7251ffb640 4 set_mon_vals no callback set 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f724bfff640 10 monclient: dump: 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.490 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.468+0000 7f72593d1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.469+0000 7f72593d1640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f72380065c0 con 0x7f7238002860 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.469+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7244011bb0 con 0x7f725409ca60 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.469+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(249..249 src has 1..249) ==== 3898+0+0 (unknown 235155126 0 0) 0x7f724404e350 con 0x7f725409ca60 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.469+0000 7f72537fe640 10 monclient: get_auth_request con 0x7f7234040460 auth_method 0 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724a7fc640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.195:6792/0 conn(0x7f7238002860 legacy=0x7f7238004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128058242 0 0) 0x7f72380065c0 con 0x7f7238002860 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 10 monclient(hunting): my global_id is 57166 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f725413dbe0 con 0x7f7238002860 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2602271433 0 0) 0x7f725413dbe0 con 0x7f7238002860 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72380065c0 con 0x7f7238002860 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f723c003d60 con 0x7f7238002860 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 10 monclient: dump: 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.492 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 149478870 0 0) 0x7f72380065c0 con 0x7f7238002860 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.471+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f723800a160 con 0x7f7238002860 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.472+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f723c004010 con 0x7f7238002860 2024-09-13T10:37:55.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.472+0000 7f724bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:55.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.472+0000 7f724bfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:55.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.472+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.195:6792/0 conn(0x7f7238002860 legacy=0x7f7238004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.472+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.195:6792/0 conn(0x7f7238002860 legacy=0x7f7238004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:55.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.478+0000 7f72593d1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:55.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.478+0000 7f72593d1640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f723800c4f0 con 0x7f7238009110 2024-09-13T10:37:55.494 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:55.495 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39595]: starting. 2024-09-13T10:37:55.495 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39595]: listing objects. 2024-09-13T10:37:55.495 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39595]: listed object 0... 2024-09-13T10:37:55.495 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39595]: listed object 25... 2024-09-13T10:37:55.495 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39595]: saw 50 objects 2024-09-13T10:37:55.495 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39595]: shutting down. 2024-09-13T10:37:55.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724a7fc640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.195:6792/0 conn(0x7f7238009110 legacy=0x7f7238009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678539163 0 0) 0x7f723800c4f0 con 0x7f7238009110 2024-09-13T10:37:55.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 10 monclient(hunting): my global_id is 57175 2024-09-13T10:37:55.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72380065c0 con 0x7f7238009110 2024-09-13T10:37:55.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 616454151 0 0) 0x7f72380065c0 con 0x7f7238009110 2024-09-13T10:37:55.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f723800c4f0 con 0x7f7238009110 2024-09-13T10:37:55.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f723c004470 con 0x7f7238009110 2024-09-13T10:37:55.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:55.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 10 monclient: dump: 2024-09-13T10:37:55.497 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.498 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.499 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3469608288 0 0) 0x7f723800c4f0 con 0x7f7238009110 2024-09-13T10:37:55.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7238009ce0 con 0x7f7238009110 2024-09-13T10:37:55.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7729 (unknown 0 0 97761716) 0x7f723c005c70 con 0x7f7238009110 2024-09-13T10:37:55.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:55.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:55.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.195:6792/0 conn(0x7f7238009110 legacy=0x7f7238009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.481+0000 7f724bfff640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.195:6792/0 conn(0x7f7238009110 legacy=0x7f7238009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:55.499 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:55.499 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:55.499 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 489900, 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:55.500 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:55.501 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:55.502 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:55.503 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:55.504 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:55.505 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:55.507 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:55.508 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:55.509 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:55.511 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:55.512 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.513 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:55.515 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.516 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:55.517 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:55.518 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:55.519 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 5 2024-09-13T10:37:55.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:55.519 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:55.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:55.519 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:55.519 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:55.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.482+0000 7f72593d1640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7234040460 legacy=0x7f7234042920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.482+0000 7f72593d1640 10 monclient: shutdown 2024-09-13T10:37:55.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.482+0000 7f72593d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:55.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.482+0000 7f72593d1640 1 -- 172.21.15.181:0/266153776 >> v1:172.21.15.195:6790/0 conn(0x7f725409ca60 legacy=0x7f725413a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.482+0000 7f72537fe640 1 -- 172.21.15.181:0/266153776 reap_dead start 2024-09-13T10:37:55.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.482+0000 7f72537fe640 1 -- 172.21.15.181:0/266153776 reap_dead start 2024-09-13T10:37:55.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.482+0000 7f72593d1640 1 -- 172.21.15.181:0/266153776 shutdown_connections 2024-09-13T10:37:55.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.482+0000 7f72593d1640 1 -- 172.21.15.181:0/266153776 >> 172.21.15.181:0/266153776 conn(0x7f72540a8750 msgr2=0x7f7254134430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:55.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.482+0000 7f72593d1640 1 -- 172.21.15.181:0/266153776 shutdown_connections 2024-09-13T10:37:55.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.482+0000 7f72593d1640 1 -- 172.21.15.181:0/266153776 wait complete. 2024-09-13T10:37:55.521 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:55.521 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T10:37:55.521 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T10:37:55.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.617+0000 7fc792b64640 10 monclient: get_monmap_and_config 2024-09-13T10:37:55.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.617+0000 7fc792b64640 10 monclient: build_initial_monmap 2024-09-13T10:37:55.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.617+0000 7fc792b64640 10 monclient: monmap: 2024-09-13T10:37:55.618 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:55.619 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.619 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:55.617797+0000 2024-09-13T10:37:55.619 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:55.617797+0000 2024-09-13T10:37:55.619 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:55.619 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.619 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:55.619 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:55.619 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:55.619 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:55.619 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:55.619 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:55.619 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:55.620 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:55.620 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:55.620 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.617+0000 7fc792b64640 1 Processor -- start 2024-09-13T10:37:55.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc792b64640 1 -- start start 2024-09-13T10:37:55.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc792b64640 10 monclient: init 2024-09-13T10:37:55.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc792b64640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:55.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc792b64640 10 monclient: _add_conns ranks=[8,6,0,7,2,3,5,4,1] 2024-09-13T10:37:55.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc792b64640 10 monclient(hunting): picked mon.noname-e con 0x7fc78c0a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:55.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc792b64640 10 monclient(hunting): picked mon.noname-d con 0x7fc78c0a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:55.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc792b64640 10 monclient(hunting): picked mon.noname-a con 0x7fc78c13f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:55.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc792b64640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc78c0a5fe0 con 0x7fc78c13f9a0 2024-09-13T10:37:55.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc792b64640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc78c0a8080 con 0x7fc78c0a6ab0 2024-09-13T10:37:55.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc792b64640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc78c0a42c0 con 0x7fc78c0a66d0 2024-09-13T10:37:55.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc792b64640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:55.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc792b64640 10 monclient(hunting): authenticate will time out at 1215.123575s 2024-09-13T10:37:55.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc790900640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fc78c0a66d0 0x7fc78c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41880/0 (socket says 172.21.15.181:41880) 2024-09-13T10:37:55.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.618+0000 7fc790900640 1 -- 172.21.15.181:0/3435610173 learned_addr learned my addr 172.21.15.181:0/3435610173 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:55.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.620+0000 7fc791101640 1 -- 172.21.15.181:0/3435610173 >> v1:172.21.15.181:6789/0 conn(0x7fc78c13f9a0 legacy=0x7fc78c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.620+0000 7fc783fff640 1 -- 172.21.15.181:0/3435610173 >> v1:172.21.15.181:6792/0 conn(0x7fc78c0a6ab0 legacy=0x7fc78c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.620+0000 7fc790900640 1 -- 172.21.15.181:0/3435610173 >> v1:172.21.15.181:6793/0 conn(0x7fc78c0a66d0 legacy=0x7fc78c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2332250074 0 0) 0x7fc78c0a5fe0 con 0x7fc78c13f9a0 2024-09-13T10:37:55.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient(hunting): my global_id is 114912 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc774003520 con 0x7fc78c13f9a0 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 693158959 0 0) 0x7fc78c0a42c0 con 0x7fc78c0a66d0 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient(hunting): my global_id is 105299 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc78c0a5fe0 con 0x7fc78c0a66d0 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283000339 0 0) 0x7fc78c0a8080 con 0x7fc78c0a6ab0 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient(hunting): my global_id is 134160 2024-09-13T10:37:55.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc78c0a42c0 con 0x7fc78c0a6ab0 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2381789930 0 0) 0x7fc774003520 con 0x7fc78c13f9a0 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 >> v1:172.21.15.181:6793/0 conn(0x7fc78c0a66d0 legacy=0x7fc78c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 >> v1:172.21.15.181:6792/0 conn(0x7fc78c0a6ab0 legacy=0x7fc78c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 monclient: found mon.noname-a 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78c1464e0 con 0x7fc78c13f9a0 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc784001ea0 con 0x7fc78c13f9a0 2024-09-13T10:37:55.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient: dump: 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.629 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc792b64640 5 monclient: authenticate success, global_id 114912 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc792b64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc784003990 con 0x7fc78c13f9a0 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 1 -- 172.21.15.181:0/3435610173 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc784003ec0 con 0x7fc78c13f9a0 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc792b64640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc792b64640 4 set_mon_vals no callback set 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:55.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.621+0000 7fc7837fe640 10 monclient: dump: 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.631 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.622+0000 7fc792b64640 10 monclient: shutdown 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.622+0000 7fc792b64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.622+0000 7fc792b64640 1 -- 172.21.15.181:0/3435610173 >> v1:172.21.15.181:6789/0 conn(0x7fc78c13f9a0 legacy=0x7fc78c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.622+0000 7fc792b64640 1 -- 172.21.15.181:0/3435610173 shutdown_connections 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.622+0000 7fc792b64640 1 -- 172.21.15.181:0/3435610173 >> 172.21.15.181:0/3435610173 conn(0x7fc78c0abcd0 msgr2=0x7fc78c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.622+0000 7fc792b64640 1 -- 172.21.15.181:0/3435610173 shutdown_connections 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.622+0000 7fc792b64640 1 -- 172.21.15.181:0/3435610173 wait complete. 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.622+0000 7fc792b64640 10 monclient: build_initial_monmap 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.622+0000 7fc792b64640 10 monclient: monmap: 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:55.633 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.622+0000 7fc792b64640 1 Processor -- start 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc792b64640 1 -- start start 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc792b64640 10 monclient: init 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc792b64640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc792b64640 10 monclient: _add_conns ranks=[2,1,7,5,0,8,4,6,3] 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc792b64640 10 monclient(hunting): picked mon.noname-b con 0x7fc78c0a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc792b64640 10 monclient(hunting): picked mon.noname-f con 0x7fc78c0a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc792b64640 10 monclient(hunting): picked mon.noname-i con 0x7fc78c13f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc792b64640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc78c13f060 con 0x7fc78c0a6ab0 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc792b64640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc78c1393f0 con 0x7fc78c0a66d0 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc792b64640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc78c139030 con 0x7fc78c13f9a0 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc792b64640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc792b64640 10 monclient(hunting): authenticate will time out at 1215.128712s 2024-09-13T10:37:55.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc790900640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fc78c0a66d0 0x7fc78c13b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:45722/0 (socket says 172.21.15.181:45722) 2024-09-13T10:37:55.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.623+0000 7fc790900640 1 -- 172.21.15.181:0/3615884780 learned_addr learned my addr 172.21.15.181:0/3615884780 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:55.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.625+0000 7fc790900640 1 -- 172.21.15.181:0/3615884780 >> v1:172.21.15.181:6790/0 conn(0x7fc78c0a66d0 legacy=0x7fc78c13b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677500971 0 0) 0x7fc78c1393f0 con 0x7fc78c0a66d0 2024-09-13T10:37:55.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:55.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:55.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:55.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient(hunting): my global_id is 134165 2024-09-13T10:37:55.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc778003520 con 0x7fc78c0a66d0 2024-09-13T10:37:55.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc783fff640 1 -- 172.21.15.181:0/3615884780 >> v1:172.21.15.195:6789/0 conn(0x7fc78c0a6ab0 legacy=0x7fc78c13b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc791101640 1 -- 172.21.15.181:0/3615884780 >> v1:172.21.15.195:6792/0 conn(0x7fc78c13f9a0 legacy=0x7fc78c1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:55.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 572661733 0 0) 0x7fc778003520 con 0x7fc78c0a66d0 2024-09-13T10:37:55.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc78c1393f0 con 0x7fc78c0a66d0 2024-09-13T10:37:55.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc788001a20 con 0x7fc78c0a66d0 2024-09-13T10:37:55.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:55.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:37:55.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient(hunting): dump: 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.639 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3025044764 0 0) 0x7fc78c1393f0 con 0x7fc78c0a66d0 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 >> v1:172.21.15.195:6792/0 conn(0x7fc78c13f9a0 legacy=0x7fc78c1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 >> v1:172.21.15.195:6789/0 conn(0x7fc78c0a6ab0 legacy=0x7fc78c13b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient: _finish_hunting 0 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 1 monclient: found mon.b 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78c13e1f0 con 0x7fc78c0a66d0 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient: _finish_auth 0 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient: _check_auth_tickets 2024-09-13T10:37:55.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc792b64640 5 monclient: authenticate success, global_id 134165 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc792b64640 10 monclient: _renew_subs 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc792b64640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc792b64640 1 -- 172.21.15.181:0/3615884780 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc78c13c030 con 0x7fc78c0a66d0 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc792b64640 10 monclient: _renew_subs 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc792b64640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc792b64640 1 -- 172.21.15.181:0/3615884780 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc78c0a28a0 con 0x7fc78c0a66d0 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc788004dd0 con 0x7fc78c0a66d0 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc788005340 con 0x7fc78c0a66d0 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc782ffd640 4 set_mon_vals no callback set 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:55.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.626+0000 7fc7817fa640 10 monclient: dump: 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:55.642 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:55.643 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:55.643 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:55.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.627+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fc7880054e0 con 0x7fc78c0a66d0 2024-09-13T10:37:55.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.627+0000 7fc792b64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:55.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.627+0000 7fc792b64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:55.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.627+0000 7fc792b64640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:37:55.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.627+0000 7fc792b64640 1 -- 172.21.15.181:0/3615884780 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc76c005080 con 0x7fc78c0a66d0 2024-09-13T10:37:55.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.627+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(249..249 src has 1..249) ==== 3898+0+0 (unknown 235155126 0 0) 0x7fc78804e5c0 con 0x7fc78c0a66d0 2024-09-13T10:37:55.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.627+0000 7fc783fff640 10 monclient: get_auth_request con 0x7fc77803fa60 auth_method 0 2024-09-13T10:37:55.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.631+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fc788017a50 con 0x7fc78c0a66d0 2024-09-13T10:37:55.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.631+0000 7fc7817fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:55.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.631+0000 7fc7817fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:55.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.870+0000 7fc792b64640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-13T10:37:55.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.870+0000 7fc792b64640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-13T10:37:55.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.870+0000 7fc792b64640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:37:55.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.870+0000 7fc792b64640 1 -- 172.21.15.181:0/3615884780 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc76c005c40 con 0x7fc78c0a66d0 2024-09-13T10:37:55.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.872+0000 7fc7817fa640 1 -- 172.21.15.181:0/3615884780 <== mon.2 v1:172.21.15.181:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fc788017350 con 0x7fc78c0a66d0 2024-09-13T10:37:55.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.872+0000 7fc7817fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-13T10:37:55.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.872+0000 7fc7817fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.875+0000 7fc792b64640 1 -- 172.21.15.181:0/3615884780 >> v1:172.21.15.195:6800/1839191919 conn(0x7fc77803fa60 legacy=0x7fc778041f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.875+0000 7fc792b64640 10 monclient: shutdown 2024-09-13T10:37:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.875+0000 7fc792b64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.875+0000 7fc792b64640 1 -- 172.21.15.181:0/3615884780 >> v1:172.21.15.181:6790/0 conn(0x7fc78c0a66d0 legacy=0x7fc78c13b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.876+0000 7fc792b64640 1 -- 172.21.15.181:0/3615884780 shutdown_connections 2024-09-13T10:37:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.876+0000 7fc792b64640 1 -- 172.21.15.181:0/3615884780 >> 172.21.15.181:0/3615884780 conn(0x7fc78c0abcd0 msgr2=0x7fc78c145cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.876+0000 7fc792b64640 1 -- 172.21.15.181:0/3615884780 shutdown_connections 2024-09-13T10:37:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:55.876+0000 7fc792b64640 1 -- 172.21.15.181:0/3615884780 wait complete. 2024-09-13T10:37:55.888 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=21,config=2,health=11,kv=12,logm=54} crc {auth=3187685631,config=2586702516,health=620725803,kv=3467323233,logm=365550363}) 2024-09-13T10:37:55.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=12,kv=12,logm=52} crc {auth=2355961507,config=2586702516,health=1223181250,kv=3467323233,logm=3487605631}) 2024-09-13T10:37:55.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=21,config=2,health=11,kv=12,logm=54} crc {auth=3187685631,config=2586702516,health=620725803,kv=3467323233,logm=365550363}) 2024-09-13T10:37:55.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=22,config=2,health=10,kv=12,logm=54} crc {auth=3040800151,config=2586702516,health=2340620156,kv=3467323233,logm=4150548116}) 2024-09-13T10:37:55.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=21,config=2,health=11,kv=12,logm=54} crc {auth=3187685631,config=2586702516,health=620725803,kv=3467323233,logm=365550363}) 2024-09-13T10:37:55.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=11,kv=12,logm=54} crc {auth=1166375567,config=2586702516,health=623906710,kv=3467323233,logm=1561728256}) 2024-09-13T10:37:55.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=21,config=2,health=11,kv=12,logm=54} crc {auth=3187685631,config=2586702516,health=620725803,kv=3467323233,logm=365550363}) 2024-09-13T10:37:55.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=23,config=2,health=12,kv=11,logm=52} crc {auth=1585689740,config=2586702516,health=1223181250,kv=3662415451,logm=2080423145}) 2024-09-13T10:37:55.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=21,config=2,health=11,kv=12,logm=54} crc {auth=3187685631,config=2586702516,health=620725803,kv=3467323233,logm=365550363}) 2024-09-13T10:37:55.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=23,config=2,health=12,kv=12,logm=51} crc {auth=1585689740,config=2586702516,health=1223181250,kv=3467323233,logm=1907024958}) 2024-09-13T10:37:55.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=21,config=2,health=11,kv=12,logm=54} crc {auth=3187685631,config=2586702516,health=620725803,kv=3467323233,logm=365550363}) 2024-09-13T10:37:55.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=21,config=2,health=12,kv=12,logm=53} crc {auth=884680615,config=2586702516,health=1223181250,kv=3467323233,logm=4103958901}) 2024-09-13T10:37:55.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=21,config=2,health=11,kv=12,logm=54} crc {auth=3187685631,config=2586702516,health=620725803,kv=3467323233,logm=365550363}) 2024-09-13T10:37:55.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=20,config=2,health=12,kv=11,logm=55} crc {auth=4003810268,config=2586702516,health=1223181250,kv=2954796944,logm=564783374}) 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=21,config=2,health=11,kv=12,logm=54} crc {auth=3187685631,config=2586702516,health=620725803,kv=3467323233,logm=365550363}) 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.871+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=22,config=2,health=12,kv=11,logm=53} crc {auth=3711152211,config=2586702516,health=1223181251,kv=760235678,logm=2642922621}) 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2515883432}) 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2495801981}) 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2515883432}) 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2862709711}) 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2515883432}) 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3181599151}) 2024-09-13T10:37:55.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2515883432}) 2024-09-13T10:37:55.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1619212467}) 2024-09-13T10:37:55.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2515883432}) 2024-09-13T10:37:55.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3514457479}) 2024-09-13T10:37:55.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2515883432}) 2024-09-13T10:37:55.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3014936821}) 2024-09-13T10:37:55.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2515883432}) 2024-09-13T10:37:55.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=330016577}) 2024-09-13T10:37:55.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.893 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2515883432}) 2024-09-13T10:37:55.893 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.873+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2463494615}) 2024-09-13T10:37:55.893 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.893 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2977436650}) 2024-09-13T10:37:55.893 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=760536711}) 2024-09-13T10:37:55.893 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.893 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2977436650}) 2024-09-13T10:37:55.893 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3879554629}) 2024-09-13T10:37:55.893 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.893 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2977436650}) 2024-09-13T10:37:55.893 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2217065561}) 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2977436650}) 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3461681043}) 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2977436650}) 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3745555151}) 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2977436650}) 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3571927876}) 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2977436650}) 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2843801089}) 2024-09-13T10:37:55.894 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2977436650}) 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1926172388}) 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2565873135}) 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=632666831}) 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2565873135}) 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3240606115}) 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2565873135}) 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=719311696}) 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2565873135}) 2024-09-13T10:37:55.895 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3726568579}) 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2565873135}) 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2827603676}) 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2565873135}) 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3381342390}) 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2565873135}) 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=641303769}) 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2565873135}) 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=732586543}) 2024-09-13T10:37:55.896 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.877+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.877+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632685527}) 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.877+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2503668040}) 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.877+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632685527}) 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3036228620}) 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632685527}) 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3503044165}) 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632685527}) 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1197552538}) 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.897 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632685527}) 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1627152051}) 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632685527}) 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2463444727}) 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632685527}) 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3650620922}) 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632685527}) 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.878+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3918086681}) 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2260353061}) 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=800004519}) 2024-09-13T10:37:55.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2260353061}) 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1889163667}) 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2260353061}) 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2578667739}) 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2260353061}) 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2100320831}) 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2260353061}) 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2443527074}) 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2260353061}) 2024-09-13T10:37:55.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=809763491}) 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2260353061}) 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3040681793}) 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2260353061}) 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.879+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2533698312}) 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2812397272}) 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3284385074}) 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2812397272}) 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4024609353}) 2024-09-13T10:37:55.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2812397272}) 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2716576504}) 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2812397272}) 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1681273111}) 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2812397272}) 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1486062224}) 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2812397272}) 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2947141282}) 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2812397272}) 2024-09-13T10:37:55.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1697006452}) 2024-09-13T10:37:55.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2812397272}) 2024-09-13T10:37:55.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.880+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=39589703}) 2024-09-13T10:37:55.903 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-13T10:37:55.909 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.909 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1318760939}) 2024-09-13T10:37:55.909 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=190108538}) 2024-09-13T10:37:55.909 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.909 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1318760939}) 2024-09-13T10:37:55.909 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4146637563}) 2024-09-13T10:37:55.909 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.909 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1318760939}) 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3318302159}) 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1318760939}) 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4292567012}) 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1318760939}) 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3385094481}) 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1318760939}) 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=289377407}) 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1318760939}) 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=720983320}) 2024-09-13T10:37:55.910 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1318760939}) 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.890+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2442666516}) 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3105024357}) 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=615236962}) 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3105024357}) 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=290024123}) 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3105024357}) 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2485450110}) 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.911 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3105024357}) 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4024119364}) 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3105024357}) 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2297275400}) 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3105024357}) 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=412693428}) 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3105024357}) 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2481632821}) 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3105024357}) 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.891+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=348522857}) 2024-09-13T10:37:55.912 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=758984148}) 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2522587558}) 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=758984148}) 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1033508583}) 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=758984148}) 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2346987006}) 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=758984148}) 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2205971671}) 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=758984148}) 2024-09-13T10:37:55.913 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3197688180}) 2024-09-13T10:37:55.914 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.914 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=758984148}) 2024-09-13T10:37:55.914 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1873994870}) 2024-09-13T10:37:55.914 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.914 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=758984148}) 2024-09-13T10:37:55.914 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1375562801}) 2024-09-13T10:37:55.914 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.914 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=758984148}) 2024-09-13T10:37:55.914 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.893+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1376711287}) 2024-09-13T10:37:55.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1880558593}) 2024-09-13T10:37:55.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4047703023}) 2024-09-13T10:37:55.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1880558593}) 2024-09-13T10:37:55.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4161942079}) 2024-09-13T10:37:55.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1880558593}) 2024-09-13T10:37:55.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1619814814}) 2024-09-13T10:37:55.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1880558593}) 2024-09-13T10:37:55.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4150086858}) 2024-09-13T10:37:55.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1880558593}) 2024-09-13T10:37:55.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1169256412}) 2024-09-13T10:37:55.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1880558593}) 2024-09-13T10:37:55.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3911368524}) 2024-09-13T10:37:55.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1880558593}) 2024-09-13T10:37:55.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1243701670}) 2024-09-13T10:37:55.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:55.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1880558593}) 2024-09-13T10:37:55.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:55.993+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3722537540}) 2024-09-13T10:37:56.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4138691170}) 2024-09-13T10:37:56.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4256570279}) 2024-09-13T10:37:56.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4138691170}) 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2235837086}) 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4138691170}) 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3400009379}) 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4138691170}) 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2710281573}) 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.022+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4138691170}) 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.023+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3107119422}) 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.023+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.023+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4138691170}) 2024-09-13T10:37:56.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.023+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1937856192}) 2024-09-13T10:37:56.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.023+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.023+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4138691170}) 2024-09-13T10:37:56.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.023+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=512373512}) 2024-09-13T10:37:56.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.023+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.023+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4138691170}) 2024-09-13T10:37:56.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.023+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2237514898}) 2024-09-13T10:37:56.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1251486366}) 2024-09-13T10:37:56.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2815706153}) 2024-09-13T10:37:56.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1251486366}) 2024-09-13T10:37:56.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3511714726}) 2024-09-13T10:37:56.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1251486366}) 2024-09-13T10:37:56.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1780057758}) 2024-09-13T10:37:56.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1251486366}) 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=434511939}) 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1251486366}) 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4084056869}) 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1251486366}) 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1824776591}) 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1251486366}) 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3184669354}) 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1251486366}) 2024-09-13T10:37:56.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3715901420}) 2024-09-13T10:37:56.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=367200975}) 2024-09-13T10:37:56.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1124329200}) 2024-09-13T10:37:56.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=367200975}) 2024-09-13T10:37:56.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1390965340}) 2024-09-13T10:37:56.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=367200975}) 2024-09-13T10:37:56.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1391504172}) 2024-09-13T10:37:56.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=367200975}) 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2013130104}) 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.356+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.357+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=367200975}) 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.357+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1677660228}) 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.357+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.357+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=367200975}) 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.357+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2852411647}) 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.357+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.357+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=367200975}) 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.357+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2546090655}) 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.357+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.357+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=367200975}) 2024-09-13T10:37:56.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.357+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1216076717}) 2024-09-13T10:37:56.362 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:56.362 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39594]: starting. 2024-09-13T10:37:56.362 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39594]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39556 2024-09-13T10:37:56.362 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39594]: shutting down. 2024-09-13T10:37:56.363 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:56.364 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:37:56.364 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:37:56.367 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:37:56.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.364+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698020710}) 2024-09-13T10:37:56.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4106550198}) 2024-09-13T10:37:56.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698020710}) 2024-09-13T10:37:56.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=494385736}) 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698020710}) 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3391061103}) 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698020710}) 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4070661321}) 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698020710}) 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2944875167}) 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698020710}) 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1471283995}) 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698020710}) 2024-09-13T10:37:56.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=956536445}) 2024-09-13T10:37:56.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698020710}) 2024-09-13T10:37:56.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.365+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1972563992}) 2024-09-13T10:37:56.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=81570259}) 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1183808640}) 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=81570259}) 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=500658624}) 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=81570259}) 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1023164627}) 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=81570259}) 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2948470106}) 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=81570259}) 2024-09-13T10:37:56.383 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2530044709}) 2024-09-13T10:37:56.383 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.383 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=81570259}) 2024-09-13T10:37:56.383 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1669022635}) 2024-09-13T10:37:56.383 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.383 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=81570259}) 2024-09-13T10:37:56.383 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=260618078}) 2024-09-13T10:37:56.383 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.383 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=81570259}) 2024-09-13T10:37:56.383 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3177698198}) 2024-09-13T10:37:56.386 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3006591661}) 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723446923}) 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3006591661}) 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=55965267}) 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3006591661}) 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2630580717}) 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3006591661}) 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2961612507}) 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.387 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3006591661}) 2024-09-13T10:37:56.388 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2590816317}) 2024-09-13T10:37:56.388 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.388 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3006591661}) 2024-09-13T10:37:56.388 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1088649345}) 2024-09-13T10:37:56.388 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.388 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3006591661}) 2024-09-13T10:37:56.388 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2170948590}) 2024-09-13T10:37:56.388 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.388 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3006591661}) 2024-09-13T10:37:56.388 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=172158390}) 2024-09-13T10:37:56.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3426731756}) 2024-09-13T10:37:56.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1475370069}) 2024-09-13T10:37:56.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3426731756}) 2024-09-13T10:37:56.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1758304121}) 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3426731756}) 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3176505166}) 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3426731756}) 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3608598481}) 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3426731756}) 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=368029823}) 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3426731756}) 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2443362766}) 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3426731756}) 2024-09-13T10:37:56.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2983398024}) 2024-09-13T10:37:56.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3426731756}) 2024-09-13T10:37:56.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2055867901}) 2024-09-13T10:37:56.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3847163008}) 2024-09-13T10:37:56.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3081984235}) 2024-09-13T10:37:56.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3847163008}) 2024-09-13T10:37:56.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1269508311}) 2024-09-13T10:37:56.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3847163008}) 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1219699358}) 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3847163008}) 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2090780182}) 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3847163008}) 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4182259098}) 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3847163008}) 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1867600603}) 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3847163008}) 2024-09-13T10:37:56.601 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=281667057}) 2024-09-13T10:37:56.602 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.602 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3847163008}) 2024-09-13T10:37:56.602 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.595+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1658181525}) 2024-09-13T10:37:56.613 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.614 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3891076163}) 2024-09-13T10:37:56.614 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2756939504}) 2024-09-13T10:37:56.614 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.614 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3891076163}) 2024-09-13T10:37:56.614 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=957663464}) 2024-09-13T10:37:56.614 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.614 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3891076163}) 2024-09-13T10:37:56.614 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1033697718}) 2024-09-13T10:37:56.614 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.614 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3891076163}) 2024-09-13T10:37:56.614 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4074146384}) 2024-09-13T10:37:56.615 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.615 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3891076163}) 2024-09-13T10:37:56.615 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3115385367}) 2024-09-13T10:37:56.615 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.615 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3891076163}) 2024-09-13T10:37:56.615 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=328796013}) 2024-09-13T10:37:56.615 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.615 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3891076163}) 2024-09-13T10:37:56.615 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1511720365}) 2024-09-13T10:37:56.615 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.615 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3891076163}) 2024-09-13T10:37:56.615 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.596+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4179224696}) 2024-09-13T10:37:56.616 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.616 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587654154}) 2024-09-13T10:37:56.616 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1018658351}) 2024-09-13T10:37:56.616 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.616 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587654154}) 2024-09-13T10:37:56.616 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=719545819}) 2024-09-13T10:37:56.616 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.616 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587654154}) 2024-09-13T10:37:56.616 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3652709744}) 2024-09-13T10:37:56.616 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.616 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587654154}) 2024-09-13T10:37:56.616 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3565178778}) 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587654154}) 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3665230138}) 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587654154}) 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=954751930}) 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587654154}) 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1557264403}) 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587654154}) 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=763569186}) 2024-09-13T10:37:56.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.598+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.598+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4091858686}) 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.598+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2200268707}) 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4091858686}) 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2920266755}) 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4091858686}) 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=510368972}) 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4091858686}) 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3108570120}) 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4091858686}) 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1780380907}) 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4091858686}) 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1284031137}) 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4091858686}) 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2185904038}) 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4091858686}) 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2630359374}) 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2223187559}) 2024-09-13T10:37:56.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=662697586}) 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2223187559}) 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1912093777}) 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2223187559}) 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2310216655}) 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2223187559}) 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3396779074}) 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2223187559}) 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1176343821}) 2024-09-13T10:37:56.620 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2223187559}) 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2617768048}) 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2223187559}) 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=308611071}) 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2223187559}) 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3804409303}) 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1757863354}) 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=635937458}) 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.621 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1757863354}) 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4014242735}) 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1757863354}) 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1802316777}) 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1757863354}) 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2699546337}) 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1757863354}) 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2646873153}) 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1757863354}) 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2400988507}) 2024-09-13T10:37:56.622 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1757863354}) 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=363218459}) 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1757863354}) 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.601+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1111946950}) 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3597941574}) 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1678841940}) 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3597941574}) 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1155440978}) 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3597941574}) 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=917884148}) 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3597941574}) 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2046428021}) 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3597941574}) 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1741110866}) 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3597941574}) 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3387026298}) 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.602+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.603+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3597941574}) 2024-09-13T10:37:56.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.603+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2762365943}) 2024-09-13T10:37:56.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.603+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.603+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3597941574}) 2024-09-13T10:37:56.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.603+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4043795062}) 2024-09-13T10:37:56.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2482775830}) 2024-09-13T10:37:56.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2101050646}) 2024-09-13T10:37:56.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2482775830}) 2024-09-13T10:37:56.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3643572730}) 2024-09-13T10:37:56.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2482775830}) 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2593504657}) 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2482775830}) 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2252974998}) 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2482775830}) 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=459034918}) 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2482775830}) 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3369116283}) 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2482775830}) 2024-09-13T10:37:56.626 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2969991870}) 2024-09-13T10:37:56.627 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.627 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2482775830}) 2024-09-13T10:37:56.627 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1193939455}) 2024-09-13T10:37:56.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3635816587}) 2024-09-13T10:37:56.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1858222090}) 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3635816587}) 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1483091502}) 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3635816587}) 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=454325010}) 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3635816587}) 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3158315193}) 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3635816587}) 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2544475079}) 2024-09-13T10:37:56.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3635816587}) 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3304056142}) 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3635816587}) 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1537694042}) 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3635816587}) 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=793452179}) 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2747142497}) 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4099988464}) 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2747142497}) 2024-09-13T10:37:56.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=20969252}) 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2747142497}) 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2350369267}) 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2747142497}) 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3973580553}) 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2747142497}) 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1591996224}) 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2747142497}) 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2989027129}) 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2747142497}) 2024-09-13T10:37:56.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1610149126}) 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2747142497}) 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2559893361}) 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2523553696}) 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1136600327}) 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2523553696}) 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1143032422}) 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2523553696}) 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3849956060}) 2024-09-13T10:37:56.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2523553696}) 2024-09-13T10:37:56.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2558960902}) 2024-09-13T10:37:56.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2523553696}) 2024-09-13T10:37:56.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=295167721}) 2024-09-13T10:37:56.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2523553696}) 2024-09-13T10:37:56.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1356761932}) 2024-09-13T10:37:56.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2523553696}) 2024-09-13T10:37:56.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1802974649}) 2024-09-13T10:37:56.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2523553696}) 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=472528990}) 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=365278227}) 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3311117616}) 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=365278227}) 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3395320027}) 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=365278227}) 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1599329767}) 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=365278227}) 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1809919225}) 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=365278227}) 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3370439132}) 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=365278227}) 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1566794098}) 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=365278227}) 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3209741284}) 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=365278227}) 2024-09-13T10:37:56.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2538908808}) 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2837902843}) 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3126016543}) 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2837902843}) 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3729233626}) 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2837902843}) 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=180820546}) 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2837902843}) 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3143828239}) 2024-09-13T10:37:56.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2837902843}) 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1061227346}) 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2837902843}) 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1204628093}) 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2837902843}) 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2930076749}) 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2837902843}) 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3522502643}) 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1154031545}) 2024-09-13T10:37:56.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714570066}) 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1154031545}) 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=114776773}) 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1154031545}) 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2965113307}) 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1154031545}) 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=443677819}) 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1154031545}) 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3958050774}) 2024-09-13T10:37:56.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1154031545}) 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2720350927}) 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1154031545}) 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3514213244}) 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1154031545}) 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=571971494}) 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=519656333}) 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3068107436}) 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=519656333}) 2024-09-13T10:37:56.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4099786748}) 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=519656333}) 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3504042}) 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=519656333}) 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1634532041}) 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=519656333}) 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=49597249}) 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=519656333}) 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2997979217}) 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=519656333}) 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3978109230}) 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=519656333}) 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3843072856}) 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3129884722}) 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2852100208}) 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3129884722}) 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=31734654}) 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3129884722}) 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=831461712}) 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3129884722}) 2024-09-13T10:37:56.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1473717487}) 2024-09-13T10:37:56.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3129884722}) 2024-09-13T10:37:56.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2294547122}) 2024-09-13T10:37:56.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3129884722}) 2024-09-13T10:37:56.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4168017323}) 2024-09-13T10:37:56.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3129884722}) 2024-09-13T10:37:56.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2401845598}) 2024-09-13T10:37:56.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3129884722}) 2024-09-13T10:37:56.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3484745979}) 2024-09-13T10:37:56.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1277337371}) 2024-09-13T10:37:56.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4277697247}) 2024-09-13T10:37:56.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1277337371}) 2024-09-13T10:37:56.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=724767277}) 2024-09-13T10:37:56.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1277337371}) 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3284808293}) 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1277337371}) 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3004048648}) 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1277337371}) 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2164974594}) 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1277337371}) 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3998046062}) 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1277337371}) 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1523940570}) 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1277337371}) 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=961195372}) 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1325686245}) 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2349336837}) 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1325686245}) 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1961949874}) 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1325686245}) 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4252860814}) 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1325686245}) 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3535332582}) 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1325686245}) 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3336466838}) 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1325686245}) 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3972722470}) 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1325686245}) 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1790682093}) 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1325686245}) 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2676844801}) 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3262511849}) 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1254361718}) 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3262511849}) 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3912227648}) 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3262511849}) 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4277082023}) 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3262511849}) 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1083728602}) 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3262511849}) 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4040860621}) 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3262511849}) 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1106217238}) 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3262511849}) 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2816896644}) 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3262511849}) 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2028949972}) 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=993171857}) 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4213027140}) 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=993171857}) 2024-09-13T10:37:56.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2607047027}) 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=993171857}) 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1022177058}) 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=993171857}) 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=445817730}) 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=993171857}) 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2439709843}) 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=993171857}) 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2399739628}) 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=993171857}) 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=262559933}) 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=993171857}) 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=819808505}) 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=992509978}) 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1301738630}) 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=992509978}) 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3880599073}) 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=992509978}) 2024-09-13T10:37:56.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4031970492}) 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=992509978}) 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3907447014}) 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=992509978}) 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1643711256}) 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=992509978}) 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=304964689}) 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=992509978}) 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=201625805}) 2024-09-13T10:37:56.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=992509978}) 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2200293414}) 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028235804}) 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1853548615}) 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028235804}) 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3631024069}) 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028235804}) 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1376586939}) 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028235804}) 2024-09-13T10:37:56.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=501717691}) 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028235804}) 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1115094161}) 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028235804}) 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=100566144}) 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028235804}) 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3636295222}) 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028235804}) 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=643372851}) 2024-09-13T10:37:56.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781885905}) 2024-09-13T10:37:56.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1067712107}) 2024-09-13T10:37:56.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781885905}) 2024-09-13T10:37:56.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2020085837}) 2024-09-13T10:37:56.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781885905}) 2024-09-13T10:37:56.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3328480226}) 2024-09-13T10:37:56.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781885905}) 2024-09-13T10:37:56.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1141952812}) 2024-09-13T10:37:56.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781885905}) 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3683372524}) 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781885905}) 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1908739910}) 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781885905}) 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=446752314}) 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781885905}) 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2679409938}) 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.692 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=730371499}) 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3352035819}) 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=730371499}) 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2630206563}) 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=730371499}) 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=700329092}) 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=730371499}) 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2317622902}) 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=730371499}) 2024-09-13T10:37:56.693 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2593517576}) 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=730371499}) 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4198870800}) 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=730371499}) 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3524150273}) 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=730371499}) 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1194790017}) 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3170190582}) 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=130445260}) 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.694 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3170190582}) 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3711836353}) 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3170190582}) 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=869270102}) 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3170190582}) 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3075500335}) 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3170190582}) 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3367754829}) 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3170190582}) 2024-09-13T10:37:56.695 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2349931913}) 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3170190582}) 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=575763583}) 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3170190582}) 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4173889802}) 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2822043441}) 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=968487482}) 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2822043441}) 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1850487919}) 2024-09-13T10:37:56.696 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2822043441}) 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=166871272}) 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2822043441}) 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4217946950}) 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2822043441}) 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=235633089}) 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2822043441}) 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3417832927}) 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.697 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2822043441}) 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=204473165}) 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2822043441}) 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3606233992}) 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1819986868}) 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1525928868}) 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1819986868}) 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1108590938}) 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1819986868}) 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2972153059}) 2024-09-13T10:37:56.698 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1819986868}) 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=248406123}) 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1819986868}) 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=413641973}) 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1819986868}) 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1215388947}) 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1819986868}) 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3998273743}) 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1819986868}) 2024-09-13T10:37:56.699 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=883044693}) 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=659911289}) 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3715187759}) 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=659911289}) 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3981316608}) 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=659911289}) 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=506645371}) 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=659911289}) 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1465042297}) 2024-09-13T10:37:56.700 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=659911289}) 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=96874933}) 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=659911289}) 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1768277997}) 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=659911289}) 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1117135378}) 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=659911289}) 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.651+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3639449646}) 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2149737411}) 2024-09-13T10:37:56.701 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4029686558}) 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2149737411}) 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1025318261}) 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2149737411}) 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1932395529}) 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2149737411}) 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=562037770}) 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2149737411}) 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3095774329}) 2024-09-13T10:37:56.702 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2149737411}) 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=8639529}) 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2149737411}) 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2050595517}) 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2149737411}) 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2440782523}) 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4009527015}) 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=827335681}) 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.703 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4009527015}) 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=918726036}) 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4009527015}) 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2598248313}) 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4009527015}) 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2996185626}) 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4009527015}) 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2486408687}) 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4009527015}) 2024-09-13T10:37:56.704 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3078393761}) 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4009527015}) 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2937438482}) 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4009527015}) 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.653+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=346950028}) 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288213154}) 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1327611715}) 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288213154}) 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2331726213}) 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288213154}) 2024-09-13T10:37:56.705 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=552476395}) 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288213154}) 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1193355876}) 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288213154}) 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2220563631}) 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288213154}) 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4005127684}) 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288213154}) 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=841557484}) 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.706 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288213154}) 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=346382974}) 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=829207664}) 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3803266953}) 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=829207664}) 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3893967471}) 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=829207664}) 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3235589163}) 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=829207664}) 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1031654439}) 2024-09-13T10:37:56.707 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.708 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=829207664}) 2024-09-13T10:37:56.708 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2469193263}) 2024-09-13T10:37:56.708 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.708 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=829207664}) 2024-09-13T10:37:56.708 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=517579561}) 2024-09-13T10:37:56.708 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.708 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=829207664}) 2024-09-13T10:37:56.708 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=572364066}) 2024-09-13T10:37:56.708 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.708 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=829207664}) 2024-09-13T10:37:56.708 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1980501879}) 2024-09-13T10:37:56.710 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.665+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.710 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.665+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=201879117}) 2024-09-13T10:37:56.710 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.665+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2066523649}) 2024-09-13T10:37:56.710 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.665+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.710 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.665+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=201879117}) 2024-09-13T10:37:56.710 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.665+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3389455561}) 2024-09-13T10:37:56.710 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.665+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.710 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.665+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=201879117}) 2024-09-13T10:37:56.710 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.665+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=581646833}) 2024-09-13T10:37:56.710 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.710 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=201879117}) 2024-09-13T10:37:56.710 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1828173305}) 2024-09-13T10:37:56.711 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.711 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=201879117}) 2024-09-13T10:37:56.711 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1052333247}) 2024-09-13T10:37:56.711 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.711 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=201879117}) 2024-09-13T10:37:56.711 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3550424373}) 2024-09-13T10:37:56.711 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.711 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=201879117}) 2024-09-13T10:37:56.711 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3144499476}) 2024-09-13T10:37:56.711 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:56.711 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=201879117}) 2024-09-13T10:37:56.711 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:56.666+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1302163338}) 2024-09-13T10:37:56.905 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:37:56.905 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:37:57.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.002+0000 7f8b84d44640 10 monclient: get_monmap_and_config 2024-09-13T10:37:57.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.002+0000 7f8b84d44640 10 monclient: build_initial_monmap 2024-09-13T10:37:57.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.002+0000 7f8b84d44640 10 monclient: monmap: 2024-09-13T10:37:57.004 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:57.004 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.004 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:57.003174+0000 2024-09-13T10:37:57.004 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:57.003174+0000 2024-09-13T10:37:57.004 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:57.004 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.004 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:57.005 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:57.005 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:57.005 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:57.005 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:57.005 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:57.005 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:57.005 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:57.005 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:57.005 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 1 Processor -- start 2024-09-13T10:37:57.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 1 -- start start 2024-09-13T10:37:57.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 10 monclient: init 2024-09-13T10:37:57.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:57.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 10 monclient: _add_conns ranks=[4,0,8,5,3,7,6,2,1] 2024-09-13T10:37:57.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 10 monclient(hunting): picked mon.noname-c con 0x7f8b80139040 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:57.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 10 monclient(hunting): picked mon.noname-a con 0x7f8b8009cd50 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:57.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 10 monclient(hunting): picked mon.noname-e con 0x7f8b8013fae0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:57.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b8009dbb0 con 0x7f8b8009cd50 2024-09-13T10:37:57.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b8009de90 con 0x7f8b80139040 2024-09-13T10:37:57.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b8009e170 con 0x7f8b8013fae0 2024-09-13T10:37:57.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:57.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b84d44640 10 monclient(hunting): authenticate will time out at 1216.508905s 2024-09-13T10:37:57.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b7ed9d640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f8b8013fae0 0x7f8b80141ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41884/0 (socket says 172.21.15.181:41884) 2024-09-13T10:37:57.008 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.003+0000 7f8b7ed9d640 1 -- 172.21.15.181:0/3540815406 learned_addr learned my addr 172.21.15.181:0/3540815406 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:57.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7e59c640 1 -- 172.21.15.181:0/3540815406 >> v1:172.21.15.181:6791/0 conn(0x7f8b80139040 legacy=0x7f8b800a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7ed9d640 1 -- 172.21.15.181:0/3540815406 >> v1:172.21.15.181:6793/0 conn(0x7f8b8013fae0 legacy=0x7f8b80141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7dd9b640 1 -- 172.21.15.181:0/3540815406 >> v1:172.21.15.181:6789/0 conn(0x7f8b8009cd50 legacy=0x7f8b8013e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2135254111 0 0) 0x7f8b8009de90 con 0x7f8b80139040 2024-09-13T10:37:57.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient(hunting): my global_id is 114943 2024-09-13T10:37:57.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b68003520 con 0x7f8b80139040 2024-09-13T10:37:57.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833217224 0 0) 0x7f8b8009e170 con 0x7f8b8013fae0 2024-09-13T10:37:57.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient(hunting): my global_id is 105326 2024-09-13T10:37:57.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b8009de90 con 0x7f8b8013fae0 2024-09-13T10:37:57.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911269986 0 0) 0x7f8b8009dbb0 con 0x7f8b8009cd50 2024-09-13T10:37:57.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient(hunting): my global_id is 114921 2024-09-13T10:37:57.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b8009e170 con 0x7f8b8009cd50 2024-09-13T10:37:57.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3599549752 0 0) 0x7f8b8009de90 con 0x7f8b8013fae0 2024-09-13T10:37:57.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 >> v1:172.21.15.181:6791/0 conn(0x7f8b80139040 legacy=0x7f8b800a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 >> v1:172.21.15.181:6789/0 conn(0x7f8b8009cd50 legacy=0x7f8b8013e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient: _finish_hunting 0 2024-09-13T10:37:57.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 monclient: found mon.noname-e 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b800a5ff0 con 0x7f8b8013fae0 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient: _finish_auth 0 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient: _check_auth_tickets 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8b78001d70 con 0x7f8b8013fae0 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b84d44640 5 monclient: authenticate success, global_id 105326 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b84d44640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient: dump: 2024-09-13T10:37:57.014 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.015 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b84d44640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8b78002040 con 0x7f8b8013fae0 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 1 -- 172.21.15.181:0/3540815406 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8b78004f60 con 0x7f8b8013fae0 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b84d44640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b84d44640 4 set_mon_vals no callback set 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.006+0000 7f8b7d59a640 10 monclient: dump: 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.016 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.017 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.007+0000 7f8b84d44640 10 monclient: shutdown 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.007+0000 7f8b84d44640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.007+0000 7f8b84d44640 1 -- 172.21.15.181:0/3540815406 >> v1:172.21.15.181:6793/0 conn(0x7f8b8013fae0 legacy=0x7f8b80141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.007+0000 7f8b84d44640 1 -- 172.21.15.181:0/3540815406 shutdown_connections 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.007+0000 7f8b84d44640 1 -- 172.21.15.181:0/3540815406 >> 172.21.15.181:0/3540815406 conn(0x7f8b80077120 msgr2=0x7f8b800abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.007+0000 7f8b84d44640 1 -- 172.21.15.181:0/3540815406 shutdown_connections 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.007+0000 7f8b84d44640 1 -- 172.21.15.181:0/3540815406 wait complete. 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 10 monclient: build_initial_monmap 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 10 monclient: monmap: 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:57.018 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 1 Processor -- start 2024-09-13T10:37:57.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 1 -- start start 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 10 monclient: init 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 10 monclient: _add_conns ranks=[1,4,3,8,2,5,0,6,7] 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 10 monclient(hunting): picked mon.noname-f con 0x7f8b8009cd50 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 10 monclient(hunting): picked mon.noname-c con 0x7f8b80139040 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 10 monclient(hunting): picked mon.noname-g con 0x7f8b8013fae0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b80141990 con 0x7f8b8009cd50 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b80140f10 con 0x7f8b8013fae0 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b8013a490 con 0x7f8b80139040 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b84d44640 10 monclient(hunting): authenticate will time out at 1216.513933s 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.008+0000 7f8b7dd9b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f8b80139040 0x7f8b80140800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41450/0 (socket says 172.21.15.181:41450) 2024-09-13T10:37:57.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.009+0000 7f8b7dd9b640 1 -- 172.21.15.181:0/1672740411 learned_addr learned my addr 172.21.15.181:0/1672740411 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:57.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b7dd9b640 1 -- 172.21.15.181:0/1672740411 >> v1:172.21.15.181:6791/0 conn(0x7f8b80139040 legacy=0x7f8b80140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1214002244 0 0) 0x7f8b8013a490 con 0x7f8b80139040 2024-09-13T10:37:57.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): my global_id is 114952 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b60003550 con 0x7f8b80139040 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b7ed9d640 1 -- 172.21.15.181:0/1672740411 >> v1:172.21.15.195:6790/0 conn(0x7f8b8013fae0 legacy=0x7f8b801d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b7e59c640 1 -- 172.21.15.181:0/1672740411 >> v1:172.21.15.195:6789/0 conn(0x7f8b8009cd50 legacy=0x7f8b801400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2523467546 0 0) 0x7f8b80141990 con 0x7f8b8009cd50 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): my global_id is 134191 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b8013a490 con 0x7f8b8009cd50 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112436720 0 0) 0x7f8b80140f10 con 0x7f8b8013fae0 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): my global_id is 134175 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b80141990 con 0x7f8b8013fae0 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4269523458 0 0) 0x7f8b60003550 con 0x7f8b80139040 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8b80140f10 con 0x7f8b80139040 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8b74003950 con 0x7f8b80139040 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): dump: 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.025 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1034142789 0 0) 0x7f8b80140f10 con 0x7f8b80139040 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 >> v1:172.21.15.195:6790/0 conn(0x7f8b8013fae0 legacy=0x7f8b801d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 >> v1:172.21.15.195:6789/0 conn(0x7f8b8009cd50 legacy=0x7f8b801400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:57.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 monclient: found mon.c 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8013a770 con 0x7f8b80139040 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient: _finish_auth 0 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b84d44640 5 monclient: authenticate success, global_id 114952 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b84d44640 10 monclient: _renew_subs 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b84d44640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b84d44640 1 -- 172.21.15.181:0/1672740411 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8013aa50 con 0x7f8b80139040 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b84d44640 10 monclient: _renew_subs 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b84d44640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b84d44640 1 -- 172.21.15.181:0/1672740411 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f8b8013f020 con 0x7f8b80139040 2024-09-13T10:37:57.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8b74003af0 con 0x7f8b80139040 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8b74004060 con 0x7f8b80139040 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b7cd99640 4 set_mon_vals no callback set 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.011+0000 7f8b6effd640 10 monclient: dump: 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.028 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.029 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.029 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.029 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.029 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.029 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.029 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.029 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.012+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f8b74004200 con 0x7f8b80139040 2024-09-13T10:37:57.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.012+0000 7f8b84d44640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:57.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.012+0000 7f8b84d44640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:57.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.012+0000 7f8b84d44640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:57.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.012+0000 7f8b84d44640 1 -- 172.21.15.181:0/1672740411 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b64005080 con 0x7f8b80139040 2024-09-13T10:37:57.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.012+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(250..250 src has 1..250) ==== 3506+0+0 (unknown 1703445025 0 0) 0x7f8b7404e210 con 0x7f8b80139040 2024-09-13T10:37:57.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.012+0000 7f8b7e59c640 10 monclient: get_auth_request con 0x7f8b6003fcd0 auth_method 0 2024-09-13T10:37:57.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.017+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f8b74017760 con 0x7f8b80139040 2024-09-13T10:37:57.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.017+0000 7f8b6effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:57.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.017+0000 7f8b6effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:57.065 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.060+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.065 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.060+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=266295422}) 2024-09-13T10:37:57.065 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1177515236}) 2024-09-13T10:37:57.065 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.065 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=266295422}) 2024-09-13T10:37:57.065 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3973952935}) 2024-09-13T10:37:57.065 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.065 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=266295422}) 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1438542205}) 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=266295422}) 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3679458601}) 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=266295422}) 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=57676783}) 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=266295422}) 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=963970389}) 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=266295422}) 2024-09-13T10:37:57.066 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2786525025}) 2024-09-13T10:37:57.067 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.067 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=266295422}) 2024-09-13T10:37:57.067 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.061+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=707977096}) 2024-09-13T10:37:57.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.260+0000 7f8b84d44640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:37:57.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.260+0000 7f8b84d44640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:57.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.260+0000 7f8b84d44640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:57.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.260+0000 7f8b84d44640 1 -- 172.21.15.181:0/1672740411 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8b64005370 con 0x7f8b80139040 2024-09-13T10:37:57.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.261+0000 7f8b6effd640 1 -- 172.21.15.181:0/1672740411 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 2999645068) 0x7f8b7401b8d0 con 0x7f8b80139040 2024-09-13T10:37:57.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.261+0000 7f8b6effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:37:57.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.261+0000 7f8b6effd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:57.263 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":120,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:37:57.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.263+0000 7f8b84d44640 1 -- 172.21.15.181:0/1672740411 >> v1:172.21.15.195:6800/1839191919 conn(0x7f8b6003fcd0 legacy=0x7f8b60042190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.263+0000 7f8b84d44640 10 monclient: shutdown 2024-09-13T10:37:57.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.263+0000 7f8b84d44640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:57.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.263+0000 7f8b84d44640 1 -- 172.21.15.181:0/1672740411 >> v1:172.21.15.181:6791/0 conn(0x7f8b80139040 legacy=0x7f8b80140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.263+0000 7f8b84d44640 1 -- 172.21.15.181:0/1672740411 shutdown_connections 2024-09-13T10:37:57.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.263+0000 7f8b84d44640 1 -- 172.21.15.181:0/1672740411 >> 172.21.15.181:0/1672740411 conn(0x7f8b80077120 msgr2=0x7f8b8012c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:57.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.263+0000 7f8b84d44640 1 -- 172.21.15.181:0/1672740411 shutdown_connections 2024-09-13T10:37:57.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.263+0000 7f8b84d44640 1 -- 172.21.15.181:0/1672740411 wait complete. 2024-09-13T10:37:57.275 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:37:57.275 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T10:37:57.275 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:37:57.275 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:37:57.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.372+0000 7fbf68873640 10 monclient: get_monmap_and_config 2024-09-13T10:37:57.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.372+0000 7fbf68873640 10 monclient: build_initial_monmap 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.372+0000 7fbf68873640 10 monclient: monmap: 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:57.372965+0000 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:57.372965+0000 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:57.374 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:57.375 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:57.375 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:57.375 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.372+0000 7fbf68873640 1 Processor -- start 2024-09-13T10:37:57.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.372+0000 7fbf68873640 1 -- start start 2024-09-13T10:37:57.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.372+0000 7fbf68873640 10 monclient: init 2024-09-13T10:37:57.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.373+0000 7fbf68873640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:57.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.373+0000 7fbf68873640 10 monclient: _add_conns ranks=[3,4,0,5,8,1,6,2,7] 2024-09-13T10:37:57.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.373+0000 7fbf68873640 10 monclient(hunting): picked mon.noname-g con 0x7fbf640a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:57.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.373+0000 7fbf68873640 10 monclient(hunting): picked mon.noname-c con 0x7fbf640a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:57.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.373+0000 7fbf68873640 10 monclient(hunting): picked mon.noname-a con 0x7fbf6413f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:57.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.373+0000 7fbf68873640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf640a4bc0 con 0x7fbf6413f750 2024-09-13T10:37:57.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.373+0000 7fbf68873640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf6413a320 con 0x7fbf640a6640 2024-09-13T10:37:57.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.373+0000 7fbf68873640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf640a8100 con 0x7fbf640a8340 2024-09-13T10:37:57.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.373+0000 7fbf68873640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:57.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.373+0000 7fbf68873640 10 monclient(hunting): authenticate will time out at 1216.878601s 2024-09-13T10:37:57.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.373+0000 7fbf61d9b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fbf640a8340 0x7fbf64139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41456/0 (socket says 172.21.15.181:41456) 2024-09-13T10:37:57.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.373+0000 7fbf61d9b640 1 -- 172.21.15.181:0/2104791944 learned_addr learned my addr 172.21.15.181:0/2104791944 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:57.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3748528903}) 2024-09-13T10:37:57.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=37765543}) 2024-09-13T10:37:57.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3748528903}) 2024-09-13T10:37:57.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2502968976}) 2024-09-13T10:37:57.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3748528903}) 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4198689345}) 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3748528903}) 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3524673496}) 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3748528903}) 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3873193880}) 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3748528903}) 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2736914027}) 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3748528903}) 2024-09-13T10:37:57.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3142692865}) 2024-09-13T10:37:57.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3748528903}) 2024-09-13T10:37:57.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2669100912}) 2024-09-13T10:37:57.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.375+0000 7fbf61d9b640 1 -- 172.21.15.181:0/2104791944 >> v1:172.21.15.181:6791/0 conn(0x7fbf640a8340 legacy=0x7fbf64139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.375+0000 7fbf62d9d640 1 -- 172.21.15.181:0/2104791944 >> v1:172.21.15.181:6789/0 conn(0x7fbf6413f750 legacy=0x7fbf64141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.375+0000 7fbf6259c640 1 -- 172.21.15.181:0/2104791944 >> v1:172.21.15.195:6790/0 conn(0x7fbf640a6640 legacy=0x7fbf64139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 1 -- 172.21.15.181:0/2104791944 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 790670077 0 0) 0x7fbf640a8100 con 0x7fbf640a8340 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient(hunting): my global_id is 114961 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 1 -- 172.21.15.181:0/2104791944 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf4c003520 con 0x7fbf640a8340 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 1 -- 172.21.15.181:0/2104791944 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064035625 0 0) 0x7fbf640a4bc0 con 0x7fbf6413f750 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient(hunting): my global_id is 114930 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 1 -- 172.21.15.181:0/2104791944 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf640a8100 con 0x7fbf6413f750 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 1 -- 172.21.15.181:0/2104791944 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1502048112 0 0) 0x7fbf4c003520 con 0x7fbf640a8340 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 1 -- 172.21.15.181:0/2104791944 >> v1:172.21.15.195:6790/0 conn(0x7fbf640a6640 legacy=0x7fbf64139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 1 -- 172.21.15.181:0/2104791944 >> v1:172.21.15.181:6789/0 conn(0x7fbf6413f750 legacy=0x7fbf64141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient: _finish_hunting 0 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 1 monclient: found mon.noname-c 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 1 -- 172.21.15.181:0/2104791944 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf640a48e0 con 0x7fbf640a8340 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient: _finish_auth 0 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient: _check_auth_tickets 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:57.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 1 -- 172.21.15.181:0/2104791944 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf58001ae0 con 0x7fbf640a8340 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient: dump: 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.386 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf68873640 5 monclient: authenticate success, global_id 114961 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf68873640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 1 -- 172.21.15.181:0/2104791944 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbf580048a0 con 0x7fbf640a8340 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf68873640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 1 -- 172.21.15.181:0/2104791944 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf58004e10 con 0x7fbf640a8340 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf68873640 4 set_mon_vals no callback set 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.376+0000 7fbf6159a640 10 monclient: dump: 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.388 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.377+0000 7fbf68873640 10 monclient: shutdown 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.377+0000 7fbf68873640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.377+0000 7fbf68873640 1 -- 172.21.15.181:0/2104791944 >> v1:172.21.15.181:6791/0 conn(0x7fbf640a8340 legacy=0x7fbf64139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.377+0000 7fbf68873640 1 -- 172.21.15.181:0/2104791944 shutdown_connections 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.377+0000 7fbf68873640 1 -- 172.21.15.181:0/2104791944 >> 172.21.15.181:0/2104791944 conn(0x7fbf64077170 msgr2=0x7fbf640abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.377+0000 7fbf68873640 1 -- 172.21.15.181:0/2104791944 shutdown_connections 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.377+0000 7fbf68873640 1 -- 172.21.15.181:0/2104791944 wait complete. 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.378+0000 7fbf68873640 10 monclient: build_initial_monmap 2024-09-13T10:37:57.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.378+0000 7fbf68873640 10 monclient: monmap: 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:57.390 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.378+0000 7fbf68873640 1 Processor -- start 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.378+0000 7fbf68873640 1 -- start start 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.378+0000 7fbf68873640 10 monclient: init 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.379+0000 7fbf68873640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.379+0000 7fbf68873640 10 monclient: _add_conns ranks=[7,4,8,0,3,2,5,6,1] 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.379+0000 7fbf68873640 10 monclient(hunting): picked mon.noname-i con 0x7fbf640a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.379+0000 7fbf68873640 10 monclient(hunting): picked mon.noname-c con 0x7fbf6413f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.379+0000 7fbf68873640 10 monclient(hunting): picked mon.noname-e con 0x7fbf641d4520 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.379+0000 7fbf68873640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf640a1220 con 0x7fbf6413f750 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.379+0000 7fbf68873640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf641cf0f0 con 0x7fbf640a8340 2024-09-13T10:37:57.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.379+0000 7fbf68873640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf640a9db0 con 0x7fbf641d4520 2024-09-13T10:37:57.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.379+0000 7fbf68873640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:57.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.379+0000 7fbf68873640 10 monclient(hunting): authenticate will time out at 1216.884272s 2024-09-13T10:37:57.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.379+0000 7fbf62d9d640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fbf641d4520 0x7fbf641d6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41888/0 (socket says 172.21.15.181:41888) 2024-09-13T10:37:57.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.379+0000 7fbf62d9d640 1 -- 172.21.15.181:0/3148207606 learned_addr learned my addr 172.21.15.181:0/3148207606 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:57.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.381+0000 7fbf62d9d640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.181:6793/0 conn(0x7fbf641d4520 legacy=0x7fbf641d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.381+0000 7fbf61d9b640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.181:6791/0 conn(0x7fbf6413f750 legacy=0x7fbf641ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.381+0000 7fbf6259c640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.195:6792/0 conn(0x7fbf640a8340 legacy=0x7fbf641ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.402 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.402 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1217776028}) 2024-09-13T10:37:57.402 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4094304905}) 2024-09-13T10:37:57.402 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.402 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1217776028}) 2024-09-13T10:37:57.402 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3512492916}) 2024-09-13T10:37:57.402 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.402 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1217776028}) 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2546793824}) 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1217776028}) 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3113339780}) 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1217776028}) 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1330365703}) 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1217776028}) 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3345797712}) 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1217776028}) 2024-09-13T10:37:57.403 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2273888583}) 2024-09-13T10:37:57.404 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.404 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1217776028}) 2024-09-13T10:37:57.404 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.399+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1160060035}) 2024-09-13T10:37:57.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.403+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606924404 0 0) 0x7fbf640a1220 con 0x7fbf6413f750 2024-09-13T10:37:57.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.403+0000 7fbf52ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.403+0000 7fbf52ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.403+0000 7fbf52ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.403+0000 7fbf52ffd640 10 monclient(hunting): my global_id is 114970 2024-09-13T10:37:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.403+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf44003550 con 0x7fbf6413f750 2024-09-13T10:37:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.403+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001708898 0 0) 0x7fbf640a9db0 con 0x7fbf641d4520 2024-09-13T10:37:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.403+0000 7fbf52ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.403+0000 7fbf52ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.403+0000 7fbf52ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.403+0000 7fbf52ffd640 10 monclient(hunting): my global_id is 105335 2024-09-13T10:37:57.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.403+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf640a1220 con 0x7fbf641d4520 2024-09-13T10:37:57.413 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.413 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4249921652}) 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2201441505}) 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4249921652}) 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3085085342}) 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4249921652}) 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3790928790}) 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4249921652}) 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3956909877}) 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4249921652}) 2024-09-13T10:37:57.414 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2374761079}) 2024-09-13T10:37:57.415 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.415 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4249921652}) 2024-09-13T10:37:57.415 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=298167652}) 2024-09-13T10:37:57.415 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.415 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4249921652}) 2024-09-13T10:37:57.415 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=267740079}) 2024-09-13T10:37:57.415 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.415 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4249921652}) 2024-09-13T10:37:57.415 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1402234670}) 2024-09-13T10:37:57.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1656577440 0 0) 0x7fbf44003550 con 0x7fbf6413f750 2024-09-13T10:37:57.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf640a9db0 con 0x7fbf6413f750 2024-09-13T10:37:57.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf58004d90 con 0x7fbf6413f750 2024-09-13T10:37:57.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:57.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:57.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:57.418 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.418 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.418 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.418 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.418 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.418 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3801499387 0 0) 0x7fbf640a1220 con 0x7fbf641d4520 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf44003550 con 0x7fbf641d4520 2024-09-13T10:37:57.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf5c002010 con 0x7fbf641d4520 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.413+0000 7fbf52ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.420 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1136137547 0 0) 0x7fbf44003550 con 0x7fbf641d4520 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.195:6792/0 conn(0x7fbf640a8340 legacy=0x7fbf641ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.181:6791/0 conn(0x7fbf6413f750 legacy=0x7fbf641ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf52ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf52ffd640 1 monclient: found mon.e 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf52ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:57.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf52ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf64142e60 con 0x7fbf641d4520 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf52ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf52ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf52ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf68873640 5 monclient: authenticate success, global_id 105335 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf68873640 10 monclient: _renew_subs 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf68873640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf68873640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbf640a03b0 con 0x7fbf641d4520 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf68873640 10 monclient: _renew_subs 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf68873640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.414+0000 7fbf68873640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fbf640a0f40 con 0x7fbf641d4520 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.415+0000 7fbf50ff9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:57.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.415+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbf5c003c40 con 0x7fbf641d4520 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.415+0000 7fbf52ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.415+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf5c004130 con 0x7fbf641d4520 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.415+0000 7fbf52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.415+0000 7fbf52ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.415+0000 7fbf52ffd640 10 monclient: dump: 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.423 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.424 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.424 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.424 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.424 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.424 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.424 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.415+0000 7fbf53fff640 4 set_mon_vals no callback set 2024-09-13T10:37:57.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.416+0000 7fbf50ff9640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbf640a1640 con 0x7fbf64077170 2024-09-13T10:37:57.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.417+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fbf5c0042d0 con 0x7fbf641d4520 2024-09-13T10:37:57.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.417+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(251..251 src has 1..251) ==== 3898+0+0 (unknown 3655941179 0 0) 0x7fbf5c04e410 con 0x7fbf641d4520 2024-09-13T10:37:57.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.417+0000 7fbf61d9b640 10 monclient: get_auth_request con 0x7fbf440400d0 auth_method 0 2024-09-13T10:37:57.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf6259c640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.181:6789/0 conn(0x7fbf64077170 legacy=0x7fbf64063ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3682219505 0 0) 0x7fbf640a1640 con 0x7fbf64077170 2024-09-13T10:37:57.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 10 monclient(hunting): my global_id is 114939 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf44003550 con 0x7fbf64077170 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3887495467 0 0) 0x7fbf44003550 con 0x7fbf64077170 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf640a1640 con 0x7fbf64077170 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf54001be0 con 0x7fbf64077170 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 10 monclient: dump: 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.427 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.428 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1628064158 0 0) 0x7fbf640a1640 con 0x7fbf64077170 2024-09-13T10:37:57.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.419+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf640641c0 con 0x7fbf64077170 2024-09-13T10:37:57.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.420+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fbf540057c0 con 0x7fbf64077170 2024-09-13T10:37:57.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.420+0000 7fbf52ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:57.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.420+0000 7fbf52ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:57.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.420+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.181:6789/0 conn(0x7fbf64077170 legacy=0x7fbf64063ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.420+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.181:6789/0 conn(0x7fbf64077170 legacy=0x7fbf64063ab0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:57.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.426+0000 7fbf50ff9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:57.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.426+0000 7fbf50ff9640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbf64143260 con 0x7fbf64069b40 2024-09-13T10:37:57.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf6259c640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.181:6789/0 conn(0x7fbf64069b40 legacy=0x7fbf641dd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3350195945 0 0) 0x7fbf64143260 con 0x7fbf64069b40 2024-09-13T10:37:57.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 10 monclient(hunting): my global_id is 114948 2024-09-13T10:37:57.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf640a1640 con 0x7fbf64069b40 2024-09-13T10:37:57.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 223780479 0 0) 0x7fbf640a1640 con 0x7fbf64069b40 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf64143260 con 0x7fbf64069b40 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf54003e00 con 0x7fbf64069b40 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 10 monclient: dump: 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.432 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.433 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.433 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.433 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.433 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.433 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.433 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.433 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.433 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2272853435 0 0) 0x7fbf64143260 con 0x7fbf64069b40 2024-09-13T10:37:57.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbf6409fc90 con 0x7fbf64069b40 2024-09-13T10:37:57.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 1190191219) 0x7fbf54004020 con 0x7fbf64069b40 2024-09-13T10:37:57.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:57.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:57.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.181:6789/0 conn(0x7fbf64069b40 legacy=0x7fbf641dd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.429+0000 7fbf52ffd640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.181:6789/0 conn(0x7fbf64069b40 legacy=0x7fbf641dd060 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:57.434 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:57.434 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:57.434 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:57.434 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:57.434 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 113407, 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:37:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:57.436 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:57.437 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:57.438 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:57.439 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.441 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:57.441 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.441 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.441 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:57.442 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:57.442 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.442 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.442 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.442 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:57.442 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:57.443 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.443 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.443 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.443 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:57.443 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.516 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:57.517 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:57.519 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.520 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.522 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.523 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.524 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:57.527 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.528 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.528 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:37:57.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.528 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:57.528 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:57.528 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:57.528 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.528 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.528 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:57.528 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:57.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.430+0000 7fbf50ff9640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.195:6800/1839191919 conn(0x7fbf440400d0 legacy=0x7fbf44042590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.430+0000 7fbf50ff9640 10 monclient: shutdown 2024-09-13T10:37:57.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.430+0000 7fbf50ff9640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:57.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.430+0000 7fbf50ff9640 1 -- 172.21.15.181:0/3148207606 >> v1:172.21.15.181:6793/0 conn(0x7fbf641d4520 legacy=0x7fbf641d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.430+0000 7fbf62d9d640 1 -- 172.21.15.181:0/3148207606 reap_dead start 2024-09-13T10:37:57.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.430+0000 7fbf62d9d640 1 -- 172.21.15.181:0/3148207606 reap_dead start 2024-09-13T10:37:57.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.430+0000 7fbf50ff9640 1 -- 172.21.15.181:0/3148207606 shutdown_connections 2024-09-13T10:37:57.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.430+0000 7fbf50ff9640 1 -- 172.21.15.181:0/3148207606 >> 172.21.15.181:0/3148207606 conn(0x7fbf640a6640 msgr2=0x7fbf64141e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:57.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.430+0000 7fbf50ff9640 1 -- 172.21.15.181:0/3148207606 shutdown_connections 2024-09-13T10:37:57.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.430+0000 7fbf50ff9640 1 -- 172.21.15.181:0/3148207606 wait complete. 2024-09-13T10:37:57.531 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:57.531 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:37:57.531 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:37:57.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.636+0000 7ffa28ebf640 10 monclient: get_monmap_and_config 2024-09-13T10:37:57.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.636+0000 7ffa28ebf640 10 monclient: build_initial_monmap 2024-09-13T10:37:57.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.636+0000 7ffa28ebf640 10 monclient: monmap: 2024-09-13T10:37:57.657 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:57.657 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.657 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:57.636691+0000 2024-09-13T10:37:57.657 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:57.636691+0000 2024-09-13T10:37:57.657 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:57.657 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.657 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:57.657 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.636+0000 7ffa28ebf640 1 Processor -- start 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.636+0000 7ffa28ebf640 1 -- start start 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.636+0000 7ffa28ebf640 10 monclient: init 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.637+0000 7ffa28ebf640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:57.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.637+0000 7ffa28ebf640 10 monclient: _add_conns ranks=[3,1,2,0,8,5,4,6,7] 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.637+0000 7ffa28ebf640 10 monclient(hunting): picked mon.noname-g con 0x7ffa240a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.637+0000 7ffa28ebf640 10 monclient(hunting): picked mon.noname-f con 0x7ffa240a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.637+0000 7ffa28ebf640 10 monclient(hunting): picked mon.noname-b con 0x7ffa2413f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.637+0000 7ffa28ebf640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa240a5fe0 con 0x7ffa240a6ab0 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.637+0000 7ffa28ebf640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa240a8080 con 0x7ffa2413f9a0 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.637+0000 7ffa28ebf640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa240a42c0 con 0x7ffa240a66d0 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.637+0000 7ffa28ebf640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.637+0000 7ffa28ebf640 10 monclient(hunting): authenticate will time out at 1217.142883s 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.637+0000 7ffa22d9d640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7ffa2413f9a0 0x7ffa24141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:45738/0 (socket says 172.21.15.181:45738) 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.637+0000 7ffa22d9d640 1 -- 172.21.15.181:0/68152951 learned_addr learned my addr 172.21.15.181:0/68152951 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa22d9d640 1 -- 172.21.15.181:0/68152951 >> v1:172.21.15.181:6790/0 conn(0x7ffa2413f9a0 legacy=0x7ffa24141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2259c640 1 -- 172.21.15.181:0/68152951 >> v1:172.21.15.195:6790/0 conn(0x7ffa240a66d0 legacy=0x7ffa240a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa21d9b640 1 -- 172.21.15.181:0/68152951 >> v1:172.21.15.195:6789/0 conn(0x7ffa240a6ab0 legacy=0x7ffa240a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 1 -- 172.21.15.181:0/68152951 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225030824 0 0) 0x7ffa240a8080 con 0x7ffa2413f9a0 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient(hunting): my global_id is 134183 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 1 -- 172.21.15.181:0/68152951 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa0c003520 con 0x7ffa2413f9a0 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 1 -- 172.21.15.181:0/68152951 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4223671854 0 0) 0x7ffa240a5fe0 con 0x7ffa240a6ab0 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient(hunting): my global_id is 134200 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 1 -- 172.21.15.181:0/68152951 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa240a8080 con 0x7ffa240a6ab0 2024-09-13T10:37:57.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 1 -- 172.21.15.181:0/68152951 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 111477461 0 0) 0x7ffa0c003520 con 0x7ffa2413f9a0 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 1 -- 172.21.15.181:0/68152951 >> v1:172.21.15.195:6790/0 conn(0x7ffa240a66d0 legacy=0x7ffa240a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 1 -- 172.21.15.181:0/68152951 >> v1:172.21.15.195:6789/0 conn(0x7ffa240a6ab0 legacy=0x7ffa240a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient: _finish_hunting 0 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 1 monclient: found mon.noname-b 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 1 -- 172.21.15.181:0/68152951 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa241464e0 con 0x7ffa2413f9a0 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient: _finish_auth 0 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient: _check_auth_tickets 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 1 -- 172.21.15.181:0/68152951 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffa1c001e60 con 0x7ffa2413f9a0 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa28ebf640 5 monclient: authenticate success, global_id 134183 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa28ebf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:57.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient: dump: 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.662 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa28ebf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 1 -- 172.21.15.181:0/68152951 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffa1c004c20 con 0x7ffa2413f9a0 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa28ebf640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 1 -- 172.21.15.181:0/68152951 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffa1c005190 con 0x7ffa2413f9a0 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa28ebf640 4 set_mon_vals no callback set 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:57.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.640+0000 7ffa2159a640 10 monclient: dump: 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.664 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.641+0000 7ffa28ebf640 10 monclient: shutdown 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.641+0000 7ffa28ebf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.641+0000 7ffa28ebf640 1 -- 172.21.15.181:0/68152951 >> v1:172.21.15.181:6790/0 conn(0x7ffa2413f9a0 legacy=0x7ffa24141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.641+0000 7ffa28ebf640 1 -- 172.21.15.181:0/68152951 shutdown_connections 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.641+0000 7ffa28ebf640 1 -- 172.21.15.181:0/68152951 >> 172.21.15.181:0/68152951 conn(0x7ffa240abcd0 msgr2=0x7ffa240ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.641+0000 7ffa28ebf640 1 -- 172.21.15.181:0/68152951 shutdown_connections 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.641+0000 7ffa28ebf640 1 -- 172.21.15.181:0/68152951 wait complete. 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 10 monclient: build_initial_monmap 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 10 monclient: monmap: 2024-09-13T10:37:57.665 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:57.666 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 1 Processor -- start 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 1 -- start start 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 10 monclient: init 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 10 monclient: _add_conns ranks=[7,8,6,4,2,0,5,3,1] 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 10 monclient(hunting): picked mon.noname-i con 0x7ffa240a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 10 monclient(hunting): picked mon.noname-e con 0x7ffa240a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 10 monclient(hunting): picked mon.noname-d con 0x7ffa2413f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa24142f20 con 0x7ffa2413f9a0 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa2413efa0 con 0x7ffa240a66d0 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa2413f280 con 0x7ffa240a6ab0 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:57.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.642+0000 7ffa28ebf640 10 monclient(hunting): authenticate will time out at 1217.147995s 2024-09-13T10:37:57.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.643+0000 7ffa22d9d640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7ffa2413f9a0 0x7ffa241d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:49242/0 (socket says 172.21.15.181:49242) 2024-09-13T10:37:57.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.643+0000 7ffa22d9d640 1 -- 172.21.15.181:0/2121040981 learned_addr learned my addr 172.21.15.181:0/2121040981 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:57.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.643+0000 7ffa2259c640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7ffa240a66d0 0x7ffa241ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:54238/0 (socket says 172.21.15.181:54238) 2024-09-13T10:37:57.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa22d9d640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.181:6792/0 conn(0x7ffa2413f9a0 legacy=0x7ffa241d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa2259c640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.195:6792/0 conn(0x7ffa240a66d0 legacy=0x7ffa241ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa21d9b640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.181:6793/0 conn(0x7ffa240a6ab0 legacy=0x7ffa241d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa22d9d640 1 --1- 172.21.15.181:0/2121040981 >> v1:172.21.15.181:6792/0 conn(0x7ffa2413f9a0 0x7ffa241d6d60 :-1 s=OPENED pgs=552 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7ffa241464e0 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:37:57.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3740146606 0 0) 0x7ffa2413f280 con 0x7ffa240a6ab0 2024-09-13T10:37:57.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient(hunting): my global_id is 105344 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa04003520 con 0x7ffa240a6ab0 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3504641536 0 0) 0x7ffa04003520 con 0x7ffa240a6ab0 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa2413f280 con 0x7ffa240a6ab0 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffa18003610 con 0x7ffa240a6ab0 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient(hunting): dump: 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.669 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1002825414 0 0) 0x7ffa2413f280 con 0x7ffa240a6ab0 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.195:6792/0 conn(0x7ffa240a66d0 legacy=0x7ffa241ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.181:6792/0 conn(0x7ffa2413f9a0 legacy=0x7ffa241d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 monclient: found mon.e 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa240a28e0 con 0x7ffa240a6ab0 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa28ebf640 5 monclient: authenticate success, global_id 105344 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484672049 0 0) 0x7ffa241464e0 con 0x7ffa2413f9a0 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa28ebf640 10 monclient: _renew_subs 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa28ebf640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa28ebf640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2413da80 con 0x7ffa240a6ab0 2024-09-13T10:37:57.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:37:57.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa28ebf640 10 monclient: _renew_subs 2024-09-13T10:37:57.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa28ebf640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:57.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa28ebf640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7ffa2413e9e0 con 0x7ffa240a6ab0 2024-09-13T10:37:57.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffa18003bd0 con 0x7ffa240a6ab0 2024-09-13T10:37:57.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:57.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffa18004140 con 0x7ffa240a6ab0 2024-09-13T10:37:57.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:57.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa12ffd640 10 monclient: dump: 2024-09-13T10:37:57.672 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.672 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.672 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.645+0000 7ffa20d99640 4 set_mon_vals no callback set 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.646+0000 7ffa28ebf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.646+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ffa180042e0 con 0x7ffa240a6ab0 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.646+0000 7ffa28ebf640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffa240a3240 con 0x7ffa2413c560 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.646+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(251..251 src has 1..251) ==== 3898+0+0 (unknown 3655941179 0 0) 0x7ffa1804e410 con 0x7ffa240a6ab0 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.647+0000 7ffa22d9d640 10 monclient: get_auth_request con 0x7ffa0403fac0 auth_method 0 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.648+0000 7ffa2259c640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.181:6790/0 conn(0x7ffa2413c560 legacy=0x7ffa2413fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60387125 0 0) 0x7ffa240a3240 con 0x7ffa2413c560 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 10 monclient(hunting): my global_id is 134192 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa241464e0 con 0x7ffa2413c560 2024-09-13T10:37:57.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2137568902 0 0) 0x7ffa241464e0 con 0x7ffa2413c560 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa240a3240 con 0x7ffa2413c560 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffa14001af0 con 0x7ffa2413c560 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 10 monclient: dump: 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.675 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2243744634 0 0) 0x7ffa240a3240 con 0x7ffa2413c560 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.653+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa2413ec00 con 0x7ffa2413c560 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.654+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ffa140057c0 con 0x7ffa2413c560 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.654+0000 7ffa12ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.654+0000 7ffa12ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:57.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.654+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.181:6790/0 conn(0x7ffa2413c560 legacy=0x7ffa2413fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.654+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.181:6790/0 conn(0x7ffa2413c560 legacy=0x7ffa2413fd80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:57.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.660+0000 7ffa28ebf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:57.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.660+0000 7ffa28ebf640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffa24069af0 con 0x7ffa241ced70 2024-09-13T10:37:57.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa2259c640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.181:6790/0 conn(0x7ffa241ced70 legacy=0x7ffa24140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531022016 0 0) 0x7ffa24069af0 con 0x7ffa241ced70 2024-09-13T10:37:57.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 10 monclient(hunting): my global_id is 134201 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa240a3240 con 0x7ffa241ced70 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2947888112 0 0) 0x7ffa240a3240 con 0x7ffa241ced70 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa24069af0 con 0x7ffa241ced70 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffa14001cb0 con 0x7ffa241ced70 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 10 monclient: dump: 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.681 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.682 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 719799564 0 0) 0x7ffa24069af0 con 0x7ffa241ced70 2024-09-13T10:37:57.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffa241cf150 con 0x7ffa241ced70 2024-09-13T10:37:57.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 613466106) 0x7ffa14005a30 con 0x7ffa241ced70 2024-09-13T10:37:57.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:57.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:57.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.181:6790/0 conn(0x7ffa241ced70 legacy=0x7ffa24140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.663+0000 7ffa12ffd640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.181:6790/0 conn(0x7ffa241ced70 legacy=0x7ffa24140490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:57.683 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 9659, 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:57.706 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.664+0000 7ffa28ebf640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.195:6800/1839191919 conn(0x7ffa0403fac0 legacy=0x7ffa04041f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.664+0000 7ffa28ebf640 10 monclient: shutdown 2024-09-13T10:37:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.664+0000 7ffa28ebf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.664+0000 7ffa28ebf640 1 -- 172.21.15.181:0/2121040981 >> v1:172.21.15.181:6793/0 conn(0x7ffa240a6ab0 legacy=0x7ffa241d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.664+0000 7ffa22d9d640 1 -- 172.21.15.181:0/2121040981 reap_dead start 2024-09-13T10:37:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.664+0000 7ffa22d9d640 1 -- 172.21.15.181:0/2121040981 reap_dead start 2024-09-13T10:37:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.664+0000 7ffa28ebf640 1 -- 172.21.15.181:0/2121040981 shutdown_connections 2024-09-13T10:37:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.664+0000 7ffa28ebf640 1 -- 172.21.15.181:0/2121040981 >> 172.21.15.181:0/2121040981 conn(0x7ffa240abcd0 msgr2=0x7ffa240a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.664+0000 7ffa28ebf640 1 -- 172.21.15.181:0/2121040981 shutdown_connections 2024-09-13T10:37:57.709 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.664+0000 7ffa28ebf640 1 -- 172.21.15.181:0/2121040981 wait complete. 2024-09-13T10:37:57.710 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:57.710 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:37:57.710 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:37:57.713 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.713 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787132790}) 2024-09-13T10:37:57.713 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4260485673}) 2024-09-13T10:37:57.713 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.713 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787132790}) 2024-09-13T10:37:57.713 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3346676607}) 2024-09-13T10:37:57.713 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.713 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787132790}) 2024-09-13T10:37:57.713 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=360990534}) 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787132790}) 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2235881506}) 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787132790}) 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2666794989}) 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787132790}) 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=13156494}) 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787132790}) 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1116034793}) 2024-09-13T10:37:57.714 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787132790}) 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.604+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2692861039}) 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1205469090}) 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2111095419}) 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1205469090}) 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3953667713}) 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1205469090}) 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2765687260}) 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.715 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1205469090}) 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2768643039}) 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1205469090}) 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=953427562}) 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1205469090}) 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2353407578}) 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1205469090}) 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=540715839}) 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1205469090}) 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.605+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1783168574}) 2024-09-13T10:37:57.716 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4047607378}) 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3227089481}) 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4047607378}) 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=436941446}) 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4047607378}) 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1813121819}) 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4047607378}) 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=96445786}) 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4047607378}) 2024-09-13T10:37:57.717 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2713619455}) 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4047607378}) 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4149033129}) 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4047607378}) 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4142379122}) 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4047607378}) 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.606+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=344816369}) 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1659026168}) 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203119850}) 2024-09-13T10:37:57.718 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1659026168}) 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3365683056}) 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1659026168}) 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1140651595}) 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1659026168}) 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3974656318}) 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1659026168}) 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4290758245}) 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1659026168}) 2024-09-13T10:37:57.719 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1026658651}) 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1659026168}) 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1577290866}) 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1659026168}) 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3246212895}) 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1102637}) 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=753458271}) 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1102637}) 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2831141996}) 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.720 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1102637}) 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3272119866}) 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1102637}) 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=525942146}) 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1102637}) 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=598751306}) 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1102637}) 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3540663473}) 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1102637}) 2024-09-13T10:37:57.721 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2533798315}) 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1102637}) 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=301832846}) 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2820260894}) 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3908864685}) 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2820260894}) 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3969267084}) 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2820260894}) 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=729841948}) 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.722 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2820260894}) 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=425507388}) 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2820260894}) 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4016921361}) 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2820260894}) 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=150179385}) 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.610+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2820260894}) 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.611+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=905842625}) 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.611+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.611+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2820260894}) 2024-09-13T10:37:57.723 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.611+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3163717156}) 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2354414791}) 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3434172738}) 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2354414791}) 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3697983686}) 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2354414791}) 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3876241293}) 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2354414791}) 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3480596325}) 2024-09-13T10:37:57.724 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2354414791}) 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=412807909}) 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2354414791}) 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=752042284}) 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2354414791}) 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3608054730}) 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2354414791}) 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2852577636}) 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2192233823}) 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1522867931}) 2024-09-13T10:37:57.725 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2192233823}) 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2871534244}) 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2192233823}) 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=95633161}) 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2192233823}) 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1176677741}) 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2192233823}) 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1923182074}) 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2192233823}) 2024-09-13T10:37:57.726 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=115806783}) 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2192233823}) 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2762854512}) 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2192233823}) 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.613+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=278179565}) 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3551969593}) 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3720068241}) 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3551969593}) 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3151686616}) 2024-09-13T10:37:57.727 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3551969593}) 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=296272259}) 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3551969593}) 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2682735558}) 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3551969593}) 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=238404551}) 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3551969593}) 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3219727520}) 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.728 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3551969593}) 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3404621385}) 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.615+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3551969593}) 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.615+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1213522100}) 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1856209207}) 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3258423942}) 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1856209207}) 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=440641198}) 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1856209207}) 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=55851607}) 2024-09-13T10:37:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1856209207}) 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=245889389}) 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1856209207}) 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3731262404}) 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1856209207}) 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2249029259}) 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1856209207}) 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=702153360}) 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1856209207}) 2024-09-13T10:37:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.616+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=767598841}) 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2687076083}) 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=51126405}) 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2687076083}) 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1204400164}) 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2687076083}) 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2784593960}) 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2687076083}) 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1268157910}) 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2687076083}) 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4223127547}) 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2687076083}) 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3840217160}) 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2687076083}) 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2090766316}) 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2687076083}) 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.617+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=668434827}) 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2349522489}) 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2824460693}) 2024-09-13T10:37:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2349522489}) 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1553883661}) 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.618+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2349522489}) 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1395543222}) 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2349522489}) 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=608521157}) 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2349522489}) 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2616670167}) 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2349522489}) 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2807842238}) 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2349522489}) 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=650408422}) 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2349522489}) 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.619+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1409237093}) 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1433438029}) 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1556454596}) 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1433438029}) 2024-09-13T10:37:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3718377682}) 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1433438029}) 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2029580403}) 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1433438029}) 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1928656992}) 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1433438029}) 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3508211562}) 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1433438029}) 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=492519282}) 2024-09-13T10:37:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1433438029}) 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=417710979}) 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1433438029}) 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.620+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=467827796}) 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1179828474}) 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=228210451}) 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1179828474}) 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2502364897}) 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1179828474}) 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3408957684}) 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1179828474}) 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2327456834}) 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1179828474}) 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2856289578}) 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1179828474}) 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2097998427}) 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1179828474}) 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=759206640}) 2024-09-13T10:37:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1179828474}) 2024-09-13T10:37:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3257801122}) 2024-09-13T10:37:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3211639590}) 2024-09-13T10:37:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1382251433}) 2024-09-13T10:37:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3211639590}) 2024-09-13T10:37:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2803442210}) 2024-09-13T10:37:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3211639590}) 2024-09-13T10:37:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=923520191}) 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3211639590}) 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2298887781}) 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3211639590}) 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1607897004}) 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3211639590}) 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=856466615}) 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3211639590}) 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=888212458}) 2024-09-13T10:37:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3211639590}) 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2943775519}) 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1447698710}) 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3525067947}) 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1447698710}) 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.622+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4077027473}) 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1447698710}) 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=881368930}) 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1447698710}) 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=893060248}) 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1447698710}) 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=148041235}) 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1447698710}) 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2775412839}) 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1447698710}) 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2627739853}) 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1447698710}) 2024-09-13T10:37:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2076612888}) 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1273181017}) 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=403261744}) 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1273181017}) 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=289533934}) 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1273181017}) 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=497154032}) 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1273181017}) 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=689012181}) 2024-09-13T10:37:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.623+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1273181017}) 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3442309812}) 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1273181017}) 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1553147975}) 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1273181017}) 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1753911754}) 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1273181017}) 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3066181394}) 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3559552563}) 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1479045137}) 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3559552563}) 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4189261973}) 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3559552563}) 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3459808923}) 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3559552563}) 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3615361914}) 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3559552563}) 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3989256526}) 2024-09-13T10:37:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3559552563}) 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=533565613}) 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3559552563}) 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3572467876}) 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3559552563}) 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.624+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1718321644}) 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=216181319}) 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3333143340}) 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=216181319}) 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4175648625}) 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=216181319}) 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=926032246}) 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=216181319}) 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1474512825}) 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=216181319}) 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=974985436}) 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=216181319}) 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=656072692}) 2024-09-13T10:37:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=216181319}) 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=178935054}) 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=216181319}) 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.625+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=990149310}) 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539436193}) 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3546519765}) 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539436193}) 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=829561154}) 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539436193}) 2024-09-13T10:37:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3584906866}) 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539436193}) 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=756874757}) 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539436193}) 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1485893343}) 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539436193}) 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2883500803}) 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539436193}) 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2018270487}) 2024-09-13T10:37:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539436193}) 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.626+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3256665401}) 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=377748633}) 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3789429898}) 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=377748633}) 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2641530316}) 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=377748633}) 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=750514906}) 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=377748633}) 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3796720668}) 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=377748633}) 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3407842156}) 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=377748633}) 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1762133526}) 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=377748633}) 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3168381186}) 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=377748633}) 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=229706614}) 2024-09-13T10:37:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310725173}) 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2681464986}) 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310725173}) 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1492777205}) 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310725173}) 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2640180023}) 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310725173}) 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=912074047}) 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310725173}) 2024-09-13T10:37:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2850210838}) 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310725173}) 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3336198233}) 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310725173}) 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3396652575}) 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310725173}) 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4196182010}) 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=884692513}) 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2984754570}) 2024-09-13T10:37:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=884692513}) 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=124799093}) 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=884692513}) 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1461591667}) 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=884692513}) 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3343241614}) 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=884692513}) 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1512557745}) 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=884692513}) 2024-09-13T10:37:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3995655970}) 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=884692513}) 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2964637528}) 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=884692513}) 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1073542004}) 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2750906700}) 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3316912633}) 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2750906700}) 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3470264481}) 2024-09-13T10:37:57.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2750906700}) 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=426247168}) 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2750906700}) 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1320941519}) 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2750906700}) 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1265417646}) 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2750906700}) 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=407110272}) 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2750906700}) 2024-09-13T10:37:57.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3472409557}) 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2750906700}) 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1619088486}) 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1160472263}) 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3398708362}) 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1160472263}) 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4082543124}) 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1160472263}) 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2201958519}) 2024-09-13T10:37:57.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1160472263}) 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3343901050}) 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1160472263}) 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=296307761}) 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1160472263}) 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3443912491}) 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1160472263}) 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2312752600}) 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1160472263}) 2024-09-13T10:37:57.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3634211953}) 2024-09-13T10:37:57.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=13,mon_config_key=14} crc {logm=3718846832,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=2525333864,mon_config_key=911266346}) 2024-09-13T10:37:57.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=60,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=15} crc {logm=2035142870,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2037671894,mon_config_key=410231470}) 2024-09-13T10:37:57.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=13,mon_config_key=14} crc {logm=3718846832,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=2525333864,mon_config_key=911266346}) 2024-09-13T10:37:57.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=13} crc {logm=3604502108,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2525333864,mon_config_key=22914494}) 2024-09-13T10:37:57.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=13,mon_config_key=14} crc {logm=3718846832,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=2525333864,mon_config_key=911266346}) 2024-09-13T10:37:57.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=13} crc {logm=2930942142,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2525333864,mon_config_key=22914494}) 2024-09-13T10:37:57.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=13,mon_config_key=14} crc {logm=3718846832,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=2525333864,mon_config_key=911266346}) 2024-09-13T10:37:57.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=14} crc {logm=2047409503,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3004211646,mon_config_key=1022000342}) 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=13,mon_config_key=14} crc {logm=3718846832,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=2525333864,mon_config_key=911266346}) 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=56,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=17,monmap=3,nvmeofgw=2,osd_metadata=1} crc {logm=4165528354,mdsmap=2874252693,mgr=2806072893,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1063044196,mon_config_key=4256284388,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=812398120}) 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=13,mon_config_key=14} crc {logm=3718846832,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=2525333864,mon_config_key=911266346}) 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=60,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=14} crc {logm=3487463095,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2525333864,mon_config_key=1638562884}) 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=13,mon_config_key=14} crc {logm=3718846832,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=2525333864,mon_config_key=911266346}) 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=63,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=12,mon_config_key=13} crc {logm=1996015785,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgrstat=1027628831,mon_config_key=22914494}) 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=13,mon_config_key=14} crc {logm=3718846832,mdsmap=2874252693,mgr=2286455831,mgr_metadata=1537866486,mgrstat=2525333864,mon_config_key=911266346}) 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=60,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=14} crc {logm=2380051446,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=2525333864,mon_config_key=1022000342}) 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mon_config_key=1,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=85} crc {mon_config_key=2246496869,monmap=2763160955,nvmeofgw=598337686,osd_metadata=1311189451,osd_pg_creating=3171780744,osd_snap=3823785925,osdmap=608386914}) 2024-09-13T10:37:57.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=2,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=84} crc {mon_config_key=3143195280,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3171780744,osd_snap=1914091868,osdmap=3688928265}) 2024-09-13T10:37:57.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mon_config_key=1,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=85} crc {mon_config_key=2246496869,monmap=2763160955,nvmeofgw=598337686,osd_metadata=1311189451,osd_pg_creating=3171780744,osd_snap=3823785925,osdmap=608386914}) 2024-09-13T10:37:57.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=2,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=83} crc {mon_config_key=3143195280,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3171780744,osd_snap=4133920409,osdmap=2695897774}) 2024-09-13T10:37:57.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mon_config_key=1,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=85} crc {mon_config_key=2246496869,monmap=2763160955,nvmeofgw=598337686,osd_metadata=1311189451,osd_pg_creating=3171780744,osd_snap=3823785925,osdmap=608386914}) 2024-09-13T10:37:57.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=2,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=83} crc {mon_config_key=3143195280,monmap=2763160956,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3171780744,osd_snap=4133920409,osdmap=2612116322}) 2024-09-13T10:37:57.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mon_config_key=1,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=85} crc {mon_config_key=2246496869,monmap=2763160955,nvmeofgw=598337686,osd_metadata=1311189451,osd_pg_creating=3171780744,osd_snap=3823785925,osdmap=608386914}) 2024-09-13T10:37:57.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mon_config_key=2,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=84} crc {mon_config_key=3143195280,monmap=3140514009,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=3171780744,osd_snap=4133920409,osdmap=805568538}) 2024-09-13T10:37:57.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mon_config_key=1,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=85} crc {mon_config_key=2246496869,monmap=2763160955,nvmeofgw=598337686,osd_metadata=1311189451,osd_pg_creating=3171780744,osd_snap=3823785925,osdmap=608386914}) 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {mon_config_key=2,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=84} crc {mon_config_key=3143195280,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2327124118,osd_pg_creating=3171780744,osd_snap=4133920409,osdmap=3192782828}) 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mon_config_key=1,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=85} crc {mon_config_key=2246496869,monmap=2763160955,nvmeofgw=598337686,osd_metadata=1311189451,osd_pg_creating=3171780744,osd_snap=3823785925,osdmap=608386914}) 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {mon_config_key=1,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=85} crc {mon_config_key=2246496869,monmap=2763160955,nvmeofgw=598337686,osd_metadata=786132628,osd_pg_creating=3171780744,osd_snap=4133920409,osdmap=1276665351}) 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mon_config_key=1,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=85} crc {mon_config_key=2246496869,monmap=2763160955,nvmeofgw=598337686,osd_metadata=1311189451,osd_pg_creating=3171780744,osd_snap=3823785925,osdmap=608386914}) 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {mon_config_key=2,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=84} crc {mon_config_key=3143195280,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2008106561,osd_pg_creating=3171780744,osd_snap=4133920409,osdmap=4122024152}) 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mon_config_key=1,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=85} crc {mon_config_key=2246496869,monmap=2763160955,nvmeofgw=598337686,osd_metadata=1311189451,osd_pg_creating=3171780744,osd_snap=3823785925,osdmap=608386914}) 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {mon_config_key=2,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=84} crc {mon_config_key=3143195280,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=2159323046,osd_pg_creating=3171780744,osd_snap=4133920409,osdmap=2629308001}) 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3944942286}) 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2592235329}) 2024-09-13T10:37:57.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3944942286}) 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3634075869}) 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3944942286}) 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1876030073}) 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3944942286}) 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2083402998}) 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3944942286}) 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=2070477341}) 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3944942286}) 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=542480069}) 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3944942286}) 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=1781844866}) 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3944942286}) 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2219071744}) 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2253116130}) 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2910126876}) 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2253116130}) 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3506767298}) 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2253116130}) 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1114538926}) 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2253116130}) 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3884472450}) 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2253116130}) 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=3646007940}) 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2253116130}) 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=1542251762}) 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2253116130}) 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=1842002267}) 2024-09-13T10:37:57.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2253116130}) 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=944550922}) 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=82} crc {osdmap=3286443743}) 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=84} crc {osdmap=844219452}) 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=82} crc {osdmap=3286443743}) 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=81} crc {osdmap=473506706}) 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=82} crc {osdmap=3286443743}) 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=81} crc {osdmap=523678440}) 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=82} crc {osdmap=3286443743}) 2024-09-13T10:37:57.765 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=85} crc {osdmap=3678461571}) 2024-09-13T10:37:57.766 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.766 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=82} crc {osdmap=3286443743}) 2024-09-13T10:37:57.766 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=84} crc {osdmap=3314643407}) 2024-09-13T10:37:57.766 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.766 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.654+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=82} crc {osdmap=3286443743}) 2024-09-13T10:37:57.766 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=84} crc {osdmap=4030914558}) 2024-09-13T10:37:57.766 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.766 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=82} crc {osdmap=3286443743}) 2024-09-13T10:37:57.766 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=79} crc {osdmap=1237128679}) 2024-09-13T10:37:57.766 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:37:57.766 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=82} crc {osdmap=3286443743}) 2024-09-13T10:37:57.766 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:37:57.655+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=82} crc {osdmap=226726560}) 2024-09-13T10:37:57.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.863+0000 7f9506250640 10 monclient: get_monmap_and_config 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.863+0000 7f9506250640 10 monclient: build_initial_monmap 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.863+0000 7f9506250640 10 monclient: monmap: 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:57.863920+0000 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:57.863920+0000 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:57.865 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:57.866 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:57.866 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:57.866 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:57.866 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 1 Processor -- start 2024-09-13T10:37:57.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 1 -- start start 2024-09-13T10:37:57.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 10 monclient: init 2024-09-13T10:37:57.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:57.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 10 monclient: _add_conns ranks=[1,3,0,4,8,7,6,5,2] 2024-09-13T10:37:57.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 10 monclient(hunting): picked mon.noname-f con 0x7f95000a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:57.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 10 monclient(hunting): picked mon.noname-g con 0x7f95000a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:57.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 10 monclient(hunting): picked mon.noname-a con 0x7f950013f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:57.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95000a4bc0 con 0x7f950013f750 2024-09-13T10:37:57.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f950013a320 con 0x7f95000a6640 2024-09-13T10:37:57.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95000a8100 con 0x7f95000a8340 2024-09-13T10:37:57.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:57.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f9506250640 10 monclient(hunting): authenticate will time out at 1217.369857s 2024-09-13T10:37:57.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.864+0000 7f94fffff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f950013f750 0x7f9500141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36866/0 (socket says 172.21.15.181:36866) 2024-09-13T10:37:57.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.865+0000 7f94fffff640 1 -- 172.21.15.181:0/2155363595 learned_addr learned my addr 172.21.15.181:0/2155363595 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:57.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94fffff640 1 -- 172.21.15.181:0/2155363595 >> v1:172.21.15.181:6789/0 conn(0x7f950013f750 legacy=0x7f9500141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94ff7fe640 1 -- 172.21.15.181:0/2155363595 >> v1:172.21.15.195:6789/0 conn(0x7f95000a6640 legacy=0x7f9500139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94f7fff640 1 -- 172.21.15.181:0/2155363595 >> v1:172.21.15.195:6790/0 conn(0x7f95000a8340 legacy=0x7f9500139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558488217 0 0) 0x7f95000a4bc0 con 0x7f950013f750 2024-09-13T10:37:57.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient(hunting): my global_id is 114957 2024-09-13T10:37:57.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94ec003520 con 0x7f950013f750 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858619281 0 0) 0x7f950013a320 con 0x7f95000a6640 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient(hunting): my global_id is 134209 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95000a4bc0 con 0x7f95000a6640 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3924224811 0 0) 0x7f95000a8100 con 0x7f95000a8340 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient(hunting): my global_id is 134184 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f950013a320 con 0x7f95000a8340 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 167292220 0 0) 0x7f94ec003520 con 0x7f950013f750 2024-09-13T10:37:57.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 >> v1:172.21.15.195:6790/0 conn(0x7f95000a8340 legacy=0x7f9500139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 >> v1:172.21.15.195:6789/0 conn(0x7f95000a6640 legacy=0x7f9500139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient: _finish_hunting 0 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 monclient: found mon.noname-a 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95000a48e0 con 0x7f950013f750 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient: _finish_auth 0 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient: _check_auth_tickets 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f94f8001e60 con 0x7f950013f750 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:57.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient: dump: 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.875 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f9506250640 5 monclient: authenticate success, global_id 114957 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f9506250640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f94f8004c20 con 0x7f950013f750 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f9506250640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 1 -- 172.21.15.181:0/2155363595 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f94f8005190 con 0x7f950013f750 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f9506250640 4 set_mon_vals no callback set 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.867+0000 7f94feffd640 10 monclient: dump: 2024-09-13T10:37:57.876 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.877 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.868+0000 7f9506250640 10 monclient: shutdown 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.868+0000 7f9506250640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.868+0000 7f9506250640 1 -- 172.21.15.181:0/2155363595 >> v1:172.21.15.181:6789/0 conn(0x7f950013f750 legacy=0x7f9500141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.868+0000 7f9506250640 1 -- 172.21.15.181:0/2155363595 shutdown_connections 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.868+0000 7f9506250640 1 -- 172.21.15.181:0/2155363595 >> 172.21.15.181:0/2155363595 conn(0x7f9500077170 msgr2=0x7f95000abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.868+0000 7f9506250640 1 -- 172.21.15.181:0/2155363595 shutdown_connections 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.868+0000 7f9506250640 1 -- 172.21.15.181:0/2155363595 wait complete. 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.868+0000 7f9506250640 10 monclient: build_initial_monmap 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.868+0000 7f9506250640 10 monclient: monmap: 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:57.878 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 1 Processor -- start 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 1 -- start start 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 10 monclient: init 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 10 monclient: _add_conns ranks=[8,3,7,0,6,4,2,1,5] 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 10 monclient(hunting): picked mon.noname-e con 0x7f95000a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 10 monclient(hunting): picked mon.noname-g con 0x7f950013f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 10 monclient(hunting): picked mon.noname-i con 0x7f950013cbf0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9500134d70 con 0x7f950013f750 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f950013d450 con 0x7f950013cbf0 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95001344d0 con 0x7f95000a8340 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f9506250640 10 monclient(hunting): authenticate will time out at 1217.374836s 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f94ff7fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f95000a8340 0x7f950013bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41910/0 (socket says 172.21.15.181:41910) 2024-09-13T10:37:57.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.869+0000 7f94ff7fe640 1 -- 172.21.15.181:0/2439991256 learned_addr learned my addr 172.21.15.181:0/2439991256 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:57.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.871+0000 7f94ff7fe640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.181:6793/0 conn(0x7f95000a8340 legacy=0x7f950013bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2432878317 0 0) 0x7f95001344d0 con 0x7f95000a8340 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient(hunting): my global_id is 105353 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94e0003550 con 0x7f95000a8340 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fffff640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.195:6792/0 conn(0x7f950013cbf0 legacy=0x7f95001d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94f7fff640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.195:6790/0 conn(0x7f950013f750 legacy=0x7f950013c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1977428512 0 0) 0x7f94e0003550 con 0x7f95000a8340 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95001344d0 con 0x7f95000a8340 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f94f0003610 con 0x7f95000a8340 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:57.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient(hunting): dump: 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.886 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2391681813 0 0) 0x7f9500134d70 con 0x7f950013f750 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient(hunting): my global_id is 134193 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94e0003550 con 0x7f950013f750 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1464881496 0 0) 0x7f95001344d0 con 0x7f95000a8340 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.195:6792/0 conn(0x7f950013cbf0 legacy=0x7f95001d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.195:6790/0 conn(0x7f950013f750 legacy=0x7f950013c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient: _finish_hunting 0 2024-09-13T10:37:57.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 monclient: found mon.e 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95001347b0 con 0x7f95000a8340 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient: _finish_auth 0 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient: _check_auth_tickets 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f9506250640 5 monclient: authenticate success, global_id 105353 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f9506250640 10 monclient: _renew_subs 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f9506250640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f9506250640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f950013e670 con 0x7f95000a8340 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f9506250640 10 monclient: _renew_subs 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f9506250640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f9506250640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f95001d7a40 con 0x7f95000a8340 2024-09-13T10:37:57.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f94f0003c80 con 0x7f95000a8340 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f94f0004170 con 0x7f95000a8340 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fe7fc640 4 set_mon_vals no callback set 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.872+0000 7f94fcff9640 10 monclient: dump: 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.889 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.873+0000 7f9506250640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.873+0000 7f9506250640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f94e40065c0 con 0x7f94e4002860 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.873+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f94f0004310 con 0x7f95000a8340 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.873+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(251..251 src has 1..251) ==== 3898+0+0 (unknown 3655941179 0 0) 0x7f94f004e540 con 0x7f95000a8340 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.873+0000 7f94fffff640 10 monclient: get_auth_request con 0x7f94e003fb20 auth_method 0 2024-09-13T10:37:57.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.875+0000 7f94f7fff640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.181:6791/0 conn(0x7f94e4002860 legacy=0x7f94e4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.875+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3823265352 0 0) 0x7f94e40065c0 con 0x7f94e4002860 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.875+0000 7f94fcff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.875+0000 7f94fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.875+0000 7f94fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.875+0000 7f94fcff9640 10 monclient(hunting): my global_id is 114979 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.875+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95001344d0 con 0x7f94e4002860 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 685911664 0 0) 0x7f95001344d0 con 0x7f94e4002860 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f94e40065c0 con 0x7f94e4002860 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f94e8001bd0 con 0x7f94e4002860 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 10 monclient: dump: 2024-09-13T10:37:57.891 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.892 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.893 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1504070753 0 0) 0x7f94e40065c0 con 0x7f94e4002860 2024-09-13T10:37:57.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94e400a160 con 0x7f94e4002860 2024-09-13T10:37:57.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f94e8006850 con 0x7f94e4002860 2024-09-13T10:37:57.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:57.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:57.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.181:6791/0 conn(0x7f94e4002860 legacy=0x7f94e4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.876+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.181:6791/0 conn(0x7f94e4002860 legacy=0x7f94e4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:57.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.882+0000 7f9506250640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:57.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.882+0000 7f9506250640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f94e4009e50 con 0x7f94e4009110 2024-09-13T10:37:57.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.884+0000 7f94f7fff640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.181:6791/0 conn(0x7f94e4009110 legacy=0x7f94e40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 327204284 0 0) 0x7f94e4009e50 con 0x7f94e4009110 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 10 monclient(hunting): _negotiate 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 10 monclient(hunting): my global_id is 114988 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94e40065c0 con 0x7f94e4009110 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1239443657 0 0) 0x7f94e40065c0 con 0x7f94e4009110 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f94e4009e50 con 0x7f94e4009110 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f94e8003d80 con 0x7f94e4009110 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 10 monclient: dump: 2024-09-13T10:37:57.895 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:57.896 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:57.897 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:57.897 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:57.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2367485694 0 0) 0x7f94e4009e50 con 0x7f94e4009110 2024-09-13T10:37:57.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f94e400c3a0 con 0x7f94e4009110 2024-09-13T10:37:57.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 2341136401) 0x7f94e8004060 con 0x7f94e4009110 2024-09-13T10:37:57.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:57.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:57.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.181:6791/0 conn(0x7f94e4009110 legacy=0x7f94e40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f94fcff9640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.181:6791/0 conn(0x7f94e4009110 legacy=0x7f94e40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:57.897 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 113863, 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:57.898 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:57.899 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:57.900 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:57.901 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:57.901 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:57.901 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:57.901 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:57.901 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:57.901 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.901 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:57.901 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:57.901 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:57.901 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:57.904 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.905 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.907 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:57.908 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.909 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.911 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:57.912 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.913 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.915 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:57.916 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:57.917 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:57.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:57.919 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:57.919 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:57.919 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:57.919 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:57.919 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:57.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:57.919 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:57.919 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:57.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.885+0000 7f9506250640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.195:6800/1839191919 conn(0x7f94e003fb20 legacy=0x7f94e0041fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.886+0000 7f9506250640 10 monclient: shutdown 2024-09-13T10:37:57.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.886+0000 7f9506250640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:57.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.886+0000 7f9506250640 1 -- 172.21.15.181:0/2439991256 >> v1:172.21.15.181:6793/0 conn(0x7f95000a8340 legacy=0x7f950013bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:57.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.886+0000 7f94fffff640 1 -- 172.21.15.181:0/2439991256 reap_dead start 2024-09-13T10:37:57.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.886+0000 7f94fffff640 1 -- 172.21.15.181:0/2439991256 reap_dead start 2024-09-13T10:37:57.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.886+0000 7f9506250640 1 -- 172.21.15.181:0/2439991256 shutdown_connections 2024-09-13T10:37:57.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.886+0000 7f9506250640 1 -- 172.21.15.181:0/2439991256 >> 172.21.15.181:0/2439991256 conn(0x7f95000a6640 msgr2=0x7f95000a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:57.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.886+0000 7f9506250640 1 -- 172.21.15.181:0/2439991256 shutdown_connections 2024-09-13T10:37:57.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:57.886+0000 7f9506250640 1 -- 172.21.15.181:0/2439991256 wait complete. 2024-09-13T10:37:57.921 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:57.922 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:37:57.922 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:37:58.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.020+0000 7fd743e40640 10 monclient: get_monmap_and_config 2024-09-13T10:37:58.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.020+0000 7fd743e40640 10 monclient: build_initial_monmap 2024-09-13T10:37:58.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.020+0000 7fd743e40640 10 monclient: monmap: 2024-09-13T10:37:58.021 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:58.021 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:58.020678+0000 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:58.020678+0000 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:58.022 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:58.023 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.020+0000 7fd743e40640 1 Processor -- start 2024-09-13T10:37:58.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.020+0000 7fd743e40640 1 -- start start 2024-09-13T10:37:58.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.020+0000 7fd743e40640 10 monclient: init 2024-09-13T10:37:58.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd743e40640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:58.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd743e40640 10 monclient: _add_conns ranks=[4,3,8,1,6,0,2,5,7] 2024-09-13T10:37:58.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd743e40640 10 monclient(hunting): picked mon.noname-c con 0x7fd73c0a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:58.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd743e40640 10 monclient(hunting): picked mon.noname-g con 0x7fd73c0a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:58.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd743e40640 10 monclient(hunting): picked mon.noname-e con 0x7fd73c13f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:58.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd743e40640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd73c0a5fe0 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd743e40640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd73c0a8080 con 0x7fd73c0a66d0 2024-09-13T10:37:58.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd743e40640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd73c0a42c0 con 0x7fd73c13f9a0 2024-09-13T10:37:58.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd743e40640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:58.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd743e40640 10 monclient(hunting): authenticate will time out at 1217.526393s 2024-09-13T10:37:58.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd7423dd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fd73c13f9a0 0x7fd73c141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41924/0 (socket says 172.21.15.181:41924) 2024-09-13T10:37:58.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd7423dd640 1 -- 172.21.15.181:0/225265440 learned_addr learned my addr 172.21.15.181:0/225265440 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:58.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.021+0000 7fd741bdc640 1 --1- 172.21.15.181:0/225265440 >> v1:172.21.15.181:6791/0 conn(0x7fd73c0a66d0 0x7fd73c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41482/0 (socket says 172.21.15.181:41482) 2024-09-13T10:37:58.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd741bdc640 1 -- 172.21.15.181:0/225265440 >> v1:172.21.15.181:6791/0 conn(0x7fd73c0a66d0 legacy=0x7fd73c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd7423dd640 1 -- 172.21.15.181:0/225265440 >> v1:172.21.15.181:6793/0 conn(0x7fd73c13f9a0 legacy=0x7fd73c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd7413db640 1 -- 172.21.15.181:0/225265440 >> v1:172.21.15.195:6790/0 conn(0x7fd73c0a6ab0 legacy=0x7fd73c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd740bda640 1 -- 172.21.15.181:0/225265440 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124874951 0 0) 0x7fd73c0a8080 con 0x7fd73c0a66d0 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd740bda640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd740bda640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd740bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd740bda640 10 monclient(hunting): my global_id is 114997 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd740bda640 1 -- 172.21.15.181:0/225265440 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd724003520 con 0x7fd73c0a66d0 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd740bda640 1 -- 172.21.15.181:0/225265440 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3275777186 0 0) 0x7fd73c0a42c0 con 0x7fd73c13f9a0 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd740bda640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd740bda640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd740bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd740bda640 10 monclient(hunting): my global_id is 105362 2024-09-13T10:37:58.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.023+0000 7fd740bda640 1 -- 172.21.15.181:0/225265440 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd73c0a8080 con 0x7fd73c13f9a0 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 1 -- 172.21.15.181:0/225265440 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3650041778 0 0) 0x7fd724003520 con 0x7fd73c0a66d0 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 1 -- 172.21.15.181:0/225265440 >> v1:172.21.15.181:6793/0 conn(0x7fd73c13f9a0 legacy=0x7fd73c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 1 -- 172.21.15.181:0/225265440 >> v1:172.21.15.195:6790/0 conn(0x7fd73c0a6ab0 legacy=0x7fd73c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 10 monclient: _finish_hunting 0 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 1 monclient: found mon.noname-c 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 1 -- 172.21.15.181:0/225265440 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73c1464e0 con 0x7fd73c0a66d0 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 10 monclient: _finish_auth 0 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 10 monclient: _check_auth_tickets 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 1 -- 172.21.15.181:0/225265440 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd72c001ae0 con 0x7fd73c0a66d0 2024-09-13T10:37:58.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd743e40640 5 monclient: authenticate success, global_id 114997 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd743e40640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 10 monclient: dump: 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.031 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd743e40640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 1 -- 172.21.15.181:0/225265440 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd72c0047e0 con 0x7fd73c0a66d0 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 1 -- 172.21.15.181:0/225265440 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd72c004d50 con 0x7fd73c0a66d0 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd743e40640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd743e40640 4 set_mon_vals no callback set 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd740bda640 10 monclient: dump: 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.033 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd743e40640 10 monclient: shutdown 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd743e40640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd743e40640 1 -- 172.21.15.181:0/225265440 >> v1:172.21.15.181:6791/0 conn(0x7fd73c0a66d0 legacy=0x7fd73c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd743e40640 1 -- 172.21.15.181:0/225265440 shutdown_connections 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.024+0000 7fd743e40640 1 -- 172.21.15.181:0/225265440 >> 172.21.15.181:0/225265440 conn(0x7fd73c0abcd0 msgr2=0x7fd73c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.025+0000 7fd743e40640 1 -- 172.21.15.181:0/225265440 shutdown_connections 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.025+0000 7fd743e40640 1 -- 172.21.15.181:0/225265440 wait complete. 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.025+0000 7fd743e40640 10 monclient: build_initial_monmap 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.025+0000 7fd743e40640 10 monclient: monmap: 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:58.034 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 1 Processor -- start 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 1 -- start start 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 10 monclient: init 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 10 monclient: _add_conns ranks=[1,0,6,3,5,2,7,4,8] 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 10 monclient(hunting): picked mon.noname-f con 0x7fd73c0a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 10 monclient(hunting): picked mon.noname-a con 0x7fd73c0a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 10 monclient(hunting): picked mon.noname-d con 0x7fd73c13f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd73c13eca0 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd73c13ef80 con 0x7fd73c0a66d0 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd73c068d40 con 0x7fd73c13f9a0 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd743e40640 10 monclient(hunting): authenticate will time out at 1217.531778s 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd7423dd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fd73c13f9a0 0x7fd73c1d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:49248/0 (socket says 172.21.15.181:49248) 2024-09-13T10:37:58.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd7413db640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd73c0a6ab0 0x7fd73c1d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36872/0 (socket says 172.21.15.181:36872) 2024-09-13T10:37:58.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.026+0000 7fd7423dd640 1 -- 172.21.15.181:0/607722152 learned_addr learned my addr 172.21.15.181:0/607722152 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:58.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.028+0000 7fd7423dd640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.181:6792/0 conn(0x7fd73c13f9a0 legacy=0x7fd73c1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd7413db640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.181:6789/0 conn(0x7fd73c0a6ab0 legacy=0x7fd73c1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd741bdc640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.195:6789/0 conn(0x7fd73c0a66d0 legacy=0x7fd73c1ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 919277413 0 0) 0x7fd73c13eca0 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): my global_id is 114966 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd728003520 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2397795154 0 0) 0x7fd73c068d40 con 0x7fd73c13f9a0 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): my global_id is 134178 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd73c13eca0 con 0x7fd73c13f9a0 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 666243710 0 0) 0x7fd73c13ef80 con 0x7fd73c0a66d0 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): my global_id is 134218 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd73c068d40 con 0x7fd73c0a66d0 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 334913604 0 0) 0x7fd728003520 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd73c13ef80 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd730003610 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): dump: 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.043 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1318142786 0 0) 0x7fd73c13eca0 con 0x7fd73c13f9a0 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd728003520 con 0x7fd73c13f9a0 2024-09-13T10:37:58.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd734002090 con 0x7fd73c13f9a0 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient(hunting): dump: 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.045 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2200923783 0 0) 0x7fd73c13ef80 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.181:6792/0 conn(0x7fd73c13f9a0 legacy=0x7fd73c1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.195:6789/0 conn(0x7fd73c0a66d0 legacy=0x7fd73c1ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 monclient: found mon.a 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73c139330 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd743e40640 5 monclient: authenticate success, global_id 114966 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd743e40640 10 monclient: _renew_subs 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd743e40640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd743e40640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd73c137850 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd743e40640 10 monclient: _renew_subs 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd743e40640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd743e40640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd73c13c420 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd730003a60 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd730003f50 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73bfff640 4 set_mon_vals no callback set 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.029+0000 7fd73a7fc640 10 monclient: dump: 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.048 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.030+0000 7fd743e40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.030+0000 7fd743e40640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd71c0065c0 con 0x7fd71c002860 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.030+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fd7300041e0 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.030+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(251..251 src has 1..251) ==== 3898+0+0 (unknown 3655941179 0 0) 0x7fd73004e240 con 0x7fd73c0a6ab0 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.031+0000 7fd7423dd640 10 monclient: get_auth_request con 0x7fd728040040 auth_method 0 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.032+0000 7fd741bdc640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.181:6792/0 conn(0x7fd71c002860 legacy=0x7fd71c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.032+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327612047 0 0) 0x7fd71c0065c0 con 0x7fd71c002860 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.032+0000 7fd73a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.032+0000 7fd73a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.032+0000 7fd73a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.032+0000 7fd73a7fc640 10 monclient(hunting): my global_id is 134187 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.032+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd73c13ef80 con 0x7fd71c002860 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4279343961 0 0) 0x7fd73c13ef80 con 0x7fd71c002860 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd71c0065c0 con 0x7fd71c002860 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd72c001d30 con 0x7fd71c002860 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 10 monclient: dump: 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.050 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3094553457 0 0) 0x7fd71c0065c0 con 0x7fd71c002860 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd71c00a160 con 0x7fd71c002860 2024-09-13T10:37:58.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd72c005460 con 0x7fd71c002860 2024-09-13T10:37:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.181:6792/0 conn(0x7fd71c002860 legacy=0x7fd71c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.033+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.181:6792/0 conn(0x7fd71c002860 legacy=0x7fd71c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.039+0000 7fd743e40640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:58.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.039+0000 7fd743e40640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd71c009e50 con 0x7fd71c009110 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.041+0000 7fd741bdc640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.181:6792/0 conn(0x7fd71c009110 legacy=0x7fd71c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452842094 0 0) 0x7fd71c009e50 con 0x7fd71c009110 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 10 monclient(hunting): my global_id is 134196 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd71c0065c0 con 0x7fd71c009110 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1870204209 0 0) 0x7fd71c0065c0 con 0x7fd71c009110 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd71c009e50 con 0x7fd71c009110 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd72c005bd0 con 0x7fd71c009110 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:37:58.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 10 monclient: dump: 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.055 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.056 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.056 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1901433515 0 0) 0x7fd71c009e50 con 0x7fd71c009110 2024-09-13T10:37:58.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd71c00c3a0 con 0x7fd71c009110 2024-09-13T10:37:58.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 2854602908) 0x7fd72c007060 con 0x7fd71c009110 2024-09-13T10:37:58.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:58.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:58.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.181:6792/0 conn(0x7fd71c009110 legacy=0x7fd71c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.042+0000 7fd73a7fc640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.181:6792/0 conn(0x7fd71c009110 legacy=0x7fd71c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:58.056 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 10066, 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:58.057 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.059 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:58.060 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.061 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.062 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.063 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:58.075 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:58.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.043+0000 7fd743e40640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.195:6800/1839191919 conn(0x7fd728040040 legacy=0x7fd728042500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.043+0000 7fd743e40640 10 monclient: shutdown 2024-09-13T10:37:58.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.043+0000 7fd743e40640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:58.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.043+0000 7fd743e40640 1 -- 172.21.15.181:0/607722152 >> v1:172.21.15.181:6789/0 conn(0x7fd73c0a6ab0 legacy=0x7fd73c1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.043+0000 7fd7423dd640 1 -- 172.21.15.181:0/607722152 reap_dead start 2024-09-13T10:37:58.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.043+0000 7fd7423dd640 1 -- 172.21.15.181:0/607722152 reap_dead start 2024-09-13T10:37:58.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.043+0000 7fd743e40640 1 -- 172.21.15.181:0/607722152 shutdown_connections 2024-09-13T10:37:58.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.043+0000 7fd743e40640 1 -- 172.21.15.181:0/607722152 >> 172.21.15.181:0/607722152 conn(0x7fd73c0abcd0 msgr2=0x7fd73c0a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:58.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.043+0000 7fd743e40640 1 -- 172.21.15.181:0/607722152 shutdown_connections 2024-09-13T10:37:58.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.043+0000 7fd743e40640 1 -- 172.21.15.181:0/607722152 wait complete. 2024-09-13T10:37:58.078 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:58.078 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:37:58.078 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:37:58.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.175+0000 7f6990040640 10 monclient: get_monmap_and_config 2024-09-13T10:37:58.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.175+0000 7f6990040640 10 monclient: build_initial_monmap 2024-09-13T10:37:58.176 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.175+0000 7f6990040640 10 monclient: monmap: 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:58.175787+0000 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:58.175787+0000 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:58.177 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:58.178 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:58.178 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.175+0000 7f6990040640 1 Processor -- start 2024-09-13T10:37:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.175+0000 7f6990040640 1 -- start start 2024-09-13T10:37:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.175+0000 7f6990040640 10 monclient: init 2024-09-13T10:37:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.176+0000 7f6990040640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.176+0000 7f6990040640 10 monclient: _add_conns ranks=[7,0,5,1,2,4,3,8,6] 2024-09-13T10:37:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.176+0000 7f6990040640 10 monclient(hunting): picked mon.noname-i con 0x7f69880a54e0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.176+0000 7f6990040640 10 monclient(hunting): picked mon.noname-a con 0x7f69880a5fd0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:58.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.176+0000 7f6990040640 10 monclient(hunting): picked mon.noname-h con 0x7f69880722e0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:58.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.176+0000 7f6990040640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6988070310 con 0x7f69880a5fd0 2024-09-13T10:37:58.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.176+0000 7f6990040640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69880a7080 con 0x7f69880722e0 2024-09-13T10:37:58.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.176+0000 7f6990040640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f698806ef30 con 0x7f69880a54e0 2024-09-13T10:37:58.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.176+0000 7f6990040640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:58.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.176+0000 7f6990040640 10 monclient(hunting): authenticate will time out at 1217.681487s 2024-09-13T10:37:58.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.176+0000 7f698d5db640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f69880a5fd0 0x7f698813e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:36876/0 (socket says 172.21.15.181:36876) 2024-09-13T10:37:58.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.176+0000 7f698d5db640 1 -- 172.21.15.181:0/1594315556 learned_addr learned my addr 172.21.15.181:0/1594315556 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:58.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.178+0000 7f698d5db640 1 -- 172.21.15.181:0/1594315556 >> v1:172.21.15.181:6789/0 conn(0x7f69880a5fd0 legacy=0x7f698813e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.178+0000 7f698e5dd640 1 -- 172.21.15.181:0/1594315556 >> v1:172.21.15.195:6791/0 conn(0x7f69880722e0 legacy=0x7f6988141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.178+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009406901 0 0) 0x7f6988070310 con 0x7f69880a5fd0 2024-09-13T10:37:58.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.178+0000 7f698dddc640 1 -- 172.21.15.181:0/1594315556 >> v1:172.21.15.195:6792/0 conn(0x7f69880a54e0 legacy=0x7f69880a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.178+0000 7f698cdda640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.178+0000 7f698cdda640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.178+0000 7f698cdda640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.178+0000 7f698cdda640 10 monclient(hunting): my global_id is 114975 2024-09-13T10:37:58.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.178+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6974003520 con 0x7f69880a5fd0 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2155915507 0 0) 0x7f69880a7080 con 0x7f69880722e0 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient(hunting): my global_id is 105116 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6988070310 con 0x7f69880722e0 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3246320521 0 0) 0x7f698806ef30 con 0x7f69880a54e0 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient(hunting): my global_id is 57202 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69880a7080 con 0x7f69880a54e0 2024-09-13T10:37:58.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 275356927 0 0) 0x7f6974003520 con 0x7f69880a5fd0 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 >> v1:172.21.15.195:6792/0 conn(0x7f69880a54e0 legacy=0x7f69880a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 >> v1:172.21.15.195:6791/0 conn(0x7f69880722e0 legacy=0x7f6988141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient: _finish_hunting 0 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 1 monclient: found mon.noname-a 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698806f730 con 0x7f69880a5fd0 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient: _finish_auth 0 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient: _check_auth_tickets 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6978001ae0 con 0x7f69880a5fd0 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:37:58.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient: dump: 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.187 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f6990040640 5 monclient: authenticate success, global_id 114975 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f6990040640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69780048a0 con 0x7f69880a5fd0 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 1 -- 172.21.15.181:0/1594315556 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6978004e50 con 0x7f69880a5fd0 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f6990040640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f6990040640 4 set_mon_vals no callback set 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f698cdda640 10 monclient: dump: 2024-09-13T10:37:58.188 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.189 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f6990040640 10 monclient: shutdown 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f6990040640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f6990040640 1 -- 172.21.15.181:0/1594315556 >> v1:172.21.15.181:6789/0 conn(0x7f69880a5fd0 legacy=0x7f698813e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f6990040640 1 -- 172.21.15.181:0/1594315556 shutdown_connections 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f6990040640 1 -- 172.21.15.181:0/1594315556 >> 172.21.15.181:0/1594315556 conn(0x7f69880aa1c0 msgr2=0x7f69880a65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f6990040640 1 -- 172.21.15.181:0/1594315556 shutdown_connections 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.179+0000 7f6990040640 1 -- 172.21.15.181:0/1594315556 wait complete. 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.180+0000 7f6990040640 10 monclient: build_initial_monmap 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.180+0000 7f6990040640 10 monclient: monmap: 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:58.190 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:58.191 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:58.191 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:58.191 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:58.191 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:58.191 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:58.191 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:58.191 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:58.191 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:58.191 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:58.191 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:58.192 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.180+0000 7f6990040640 1 Processor -- start 2024-09-13T10:37:58.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.180+0000 7f6990040640 1 -- start start 2024-09-13T10:37:58.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.180+0000 7f6990040640 10 monclient: init 2024-09-13T10:37:58.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.181+0000 7f6990040640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:58.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.181+0000 7f6990040640 10 monclient: _add_conns ranks=[1,5,4,0,6,7,2,8,3] 2024-09-13T10:37:58.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.181+0000 7f6990040640 10 monclient(hunting): picked mon.noname-f con 0x7f69880722e0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:58.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.181+0000 7f6990040640 10 monclient(hunting): picked mon.noname-h con 0x7f69880a54e0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:58.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.181+0000 7f6990040640 10 monclient(hunting): picked mon.noname-c con 0x7f69880a5fd0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:58.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.181+0000 7f6990040640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69881293c0 con 0x7f69880722e0 2024-09-13T10:37:58.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.181+0000 7f6990040640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6988142450 con 0x7f69880a5fd0 2024-09-13T10:37:58.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.181+0000 7f6990040640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6988127ea0 con 0x7f69880a54e0 2024-09-13T10:37:58.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.181+0000 7f6990040640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:58.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.181+0000 7f6990040640 10 monclient(hunting): authenticate will time out at 1217.686303s 2024-09-13T10:37:58.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.181+0000 7f698e5dd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f69880a5fd0 0x7f69881d6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41484/0 (socket says 172.21.15.181:41484) 2024-09-13T10:37:58.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.181+0000 7f698e5dd640 1 -- 172.21.15.181:0/2325072568 learned_addr learned my addr 172.21.15.181:0/2325072568 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:58.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f698e5dd640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.181:6791/0 conn(0x7f69880a5fd0 legacy=0x7f69881d6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f698dddc640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.195:6789/0 conn(0x7f69880722e0 legacy=0x7f6988141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f698d5db640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.195:6791/0 conn(0x7f69880a54e0 legacy=0x7f69881d3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2354240195 0 0) 0x7f6988142450 con 0x7f69880a5fd0 2024-09-13T10:37:58.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): my global_id is 115006 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f696c003550 con 0x7f69880a5fd0 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3120541259 0 0) 0x7f69881293c0 con 0x7f69880722e0 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): my global_id is 134227 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6988142450 con 0x7f69880722e0 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 250696514 0 0) 0x7f6988127ea0 con 0x7f69880a54e0 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): my global_id is 105125 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69881293c0 con 0x7f69880a54e0 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3765526911 0 0) 0x7f696c003550 con 0x7f69880a5fd0 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6988127ea0 con 0x7f69880a5fd0 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6980003990 con 0x7f69880a5fd0 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): dump: 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.201 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 947209506 0 0) 0x7f6988142450 con 0x7f69880722e0 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.183+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f696c003550 con 0x7f69880722e0 2024-09-13T10:37:58.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6984003610 con 0x7f69880722e0 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient(hunting): dump: 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.203 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3333054778 0 0) 0x7f69881293c0 con 0x7f69880a54e0 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6988142450 con 0x7f69880a54e0 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6978001d30 con 0x7f69880a54e0 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient(hunting): dump: 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.204 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1227550374 0 0) 0x7f6988127ea0 con 0x7f69880a5fd0 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.195:6791/0 conn(0x7f69880a54e0 legacy=0x7f69881d3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.195:6789/0 conn(0x7f69880722e0 legacy=0x7f6988141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 1 monclient: found mon.c 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6988128070 con 0x7f69880a5fd0 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient: _finish_auth 0 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f6990040640 5 monclient: authenticate success, global_id 115006 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f6990040640 10 monclient: _renew_subs 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f6990040640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f6990040640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6988125ed0 con 0x7f69880a5fd0 2024-09-13T10:37:58.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f6990040640 10 monclient: _renew_subs 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f6990040640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f6990040640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f69881d8070 con 0x7f69880a5fd0 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6980003e90 con 0x7f69880a5fd0 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6980004380 con 0x7f69880a5fd0 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697ffff640 4 set_mon_vals no callback set 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.184+0000 7f697e7fc640 10 monclient: dump: 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.185+0000 7f6990040640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.185+0000 7f6990040640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f69700065c0 con 0x7f6970002860 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.185+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6980004520 con 0x7f69880a5fd0 2024-09-13T10:37:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.185+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(251..251 src has 1..251) ==== 3898+0+0 (unknown 3655941179 0 0) 0x7f698004e6c0 con 0x7f69880a5fd0 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.185+0000 7f698d5db640 10 monclient: get_auth_request con 0x7f696c0406a0 auth_method 0 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f698dddc640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.181:6793/0 conn(0x7f6970002860 legacy=0x7f6970004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758684761 0 0) 0x7f69700065c0 con 0x7f6970002860 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 10 monclient(hunting): my global_id is 105371 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6988127ea0 con 0x7f6970002860 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3084686315 0 0) 0x7f6988127ea0 con 0x7f6970002860 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69700065c0 con 0x7f6970002860 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6984003e00 con 0x7f6970002860 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 10 monclient: dump: 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 598388589 0 0) 0x7f69700065c0 con 0x7f6970002860 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f697000a160 con 0x7f6970002860 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f69840040f0 con 0x7f6970002860 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.187+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.181:6793/0 conn(0x7f6970002860 legacy=0x7f6970004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.188+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.181:6793/0 conn(0x7f6970002860 legacy=0x7f6970004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.193+0000 7f6990040640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.194+0000 7f6990040640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6970009e50 con 0x7f6970009110 2024-09-13T10:37:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f698dddc640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.181:6793/0 conn(0x7f6970009110 legacy=0x7f69700095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920952641 0 0) 0x7f6970009e50 con 0x7f6970009110 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 10 monclient(hunting): my global_id is 105380 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69700065c0 con 0x7f6970009110 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 797434503 0 0) 0x7f69700065c0 con 0x7f6970009110 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6970009e50 con 0x7f6970009110 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6984005b00 con 0x7f6970009110 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 10 monclient: dump: 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.212 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.213 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.214 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2300439625 0 0) 0x7f6970009e50 con 0x7f6970009110 2024-09-13T10:37:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f697000c3a0 con 0x7f6970009110 2024-09-13T10:37:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 380649267) 0x7f6984006fd0 con 0x7f6970009110 2024-09-13T10:37:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.181:6793/0 conn(0x7f6970009110 legacy=0x7f69700095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.196+0000 7f697e7fc640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.181:6793/0 conn(0x7f6970009110 legacy=0x7f69700095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:58.214 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:58.214 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 161899, 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:58.215 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.216 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.217 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:58.218 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.219 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:58.220 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.221 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.222 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:58.225 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.226 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.227 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.228 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:58.228 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.228 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.228 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.228 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:58.228 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:58.228 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.228 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.228 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:58.229 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.230 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.232 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.233 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.234 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:58.234 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.234 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.234 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:58.234 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:58.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.197+0000 7f6990040640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.195:6800/1839191919 conn(0x7f696c0406a0 legacy=0x7f696c042b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.197+0000 7f6990040640 10 monclient: shutdown 2024-09-13T10:37:58.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.197+0000 7f6990040640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:58.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.197+0000 7f6990040640 1 -- 172.21.15.181:0/2325072568 >> v1:172.21.15.181:6791/0 conn(0x7f69880a5fd0 legacy=0x7f69881d6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.197+0000 7f698e5dd640 1 -- 172.21.15.181:0/2325072568 reap_dead start 2024-09-13T10:37:58.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.197+0000 7f698e5dd640 1 -- 172.21.15.181:0/2325072568 reap_dead start 2024-09-13T10:37:58.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.197+0000 7f6990040640 1 -- 172.21.15.181:0/2325072568 shutdown_connections 2024-09-13T10:37:58.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.197+0000 7f6990040640 1 -- 172.21.15.181:0/2325072568 >> 172.21.15.181:0/2325072568 conn(0x7f69880aa1c0 msgr2=0x7f6988142a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:58.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.197+0000 7f6990040640 1 -- 172.21.15.181:0/2325072568 shutdown_connections 2024-09-13T10:37:58.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.197+0000 7f6990040640 1 -- 172.21.15.181:0/2325072568 wait complete. 2024-09-13T10:37:58.236 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:58.237 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:37:58.237 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:37:58.334 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.333+0000 7f696ea71640 10 monclient: get_monmap_and_config 2024-09-13T10:37:58.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.333+0000 7f696ea71640 10 monclient: build_initial_monmap 2024-09-13T10:37:58.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.333+0000 7f696ea71640 10 monclient: monmap: 2024-09-13T10:37:58.335 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:58.335 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.335 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:58.334065+0000 2024-09-13T10:37:58.335 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:58.334065+0000 2024-09-13T10:37:58.335 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:58.335 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.335 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:58.335 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:58.335 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:58.336 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:58.336 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:58.336 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:58.336 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:58.336 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:58.336 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:58.336 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 1 Processor -- start 2024-09-13T10:37:58.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 1 -- start start 2024-09-13T10:37:58.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 10 monclient: init 2024-09-13T10:37:58.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:58.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 10 monclient: _add_conns ranks=[2,5,1,6,7,3,8,4,0] 2024-09-13T10:37:58.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 10 monclient(hunting): picked mon.noname-b con 0x7f6968139500 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:58.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 10 monclient(hunting): picked mon.noname-h con 0x7f6968139ff0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:58.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 10 monclient(hunting): picked mon.noname-f con 0x7f696813fe60 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:58.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69680a8070 con 0x7f696813fe60 2024-09-13T10:37:58.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69680a2f20 con 0x7f6968139500 2024-09-13T10:37:58.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69680a84b0 con 0x7f6968139ff0 2024-09-13T10:37:58.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:58.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696ea71640 10 monclient(hunting): authenticate will time out at 1217.839843s 2024-09-13T10:37:58.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696c80d640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f6968139500 0x7f69681398e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:45760/0 (socket says 172.21.15.181:45760) 2024-09-13T10:37:58.338 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.334+0000 7f696c80d640 1 -- 172.21.15.181:0/2022042039 learned_addr learned my addr 172.21.15.181:0/2022042039 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:58.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f696c80d640 1 -- 172.21.15.181:0/2022042039 >> v1:172.21.15.181:6790/0 conn(0x7f6968139500 legacy=0x7f69681398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745881396 0 0) 0x7f69680a2f20 con 0x7f6968139500 2024-09-13T10:37:58.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient(hunting): my global_id is 134210 2024-09-13T10:37:58.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6958003520 con 0x7f6968139500 2024-09-13T10:37:58.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f6967fff640 1 -- 172.21.15.181:0/2022042039 >> v1:172.21.15.195:6791/0 conn(0x7f6968139ff0 legacy=0x7f696813e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f696d00e640 1 -- 172.21.15.181:0/2022042039 >> v1:172.21.15.195:6789/0 conn(0x7f696813fe60 legacy=0x7f6968142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481097674 0 0) 0x7f69680a8070 con 0x7f696813fe60 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient(hunting): my global_id is 134236 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69680a2f20 con 0x7f696813fe60 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 69496407 0 0) 0x7f69680a84b0 con 0x7f6968139ff0 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient(hunting): my global_id is 105134 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69680a8070 con 0x7f6968139ff0 2024-09-13T10:37:58.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 95937129 0 0) 0x7f6958003520 con 0x7f6968139500 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 >> v1:172.21.15.195:6791/0 conn(0x7f6968139ff0 legacy=0x7f696813e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 >> v1:172.21.15.195:6789/0 conn(0x7f696813fe60 legacy=0x7f6968142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient: _finish_hunting 0 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 monclient: found mon.noname-b 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69680a42a0 con 0x7f6968139500 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient: _finish_auth 0 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient: _check_auth_tickets 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f695c001b20 con 0x7f6968139500 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f696ea71640 5 monclient: authenticate success, global_id 134210 2024-09-13T10:37:58.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient: dump: 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.345 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f696ea71640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f695c001cc0 con 0x7f6968139500 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 1 -- 172.21.15.181:0/2022042039 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f695c004be0 con 0x7f6968139500 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f696ea71640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f696ea71640 4 set_mon_vals no callback set 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:58.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.337+0000 7f69677fe640 10 monclient: dump: 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.347 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.338+0000 7f696ea71640 10 monclient: shutdown 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.338+0000 7f696ea71640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.338+0000 7f696ea71640 1 -- 172.21.15.181:0/2022042039 >> v1:172.21.15.181:6790/0 conn(0x7f6968139500 legacy=0x7f69681398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.338+0000 7f696ea71640 1 -- 172.21.15.181:0/2022042039 shutdown_connections 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.338+0000 7f696ea71640 1 -- 172.21.15.181:0/2022042039 >> 172.21.15.181:0/2022042039 conn(0x7f69680abf20 msgr2=0x7f69680ac330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.338+0000 7f696ea71640 1 -- 172.21.15.181:0/2022042039 shutdown_connections 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.338+0000 7f696ea71640 1 -- 172.21.15.181:0/2022042039 wait complete. 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.338+0000 7f696ea71640 10 monclient: build_initial_monmap 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.338+0000 7f696ea71640 10 monclient: monmap: 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:58.348 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:58.349 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 1 Processor -- start 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 1 -- start start 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 10 monclient: init 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 10 monclient: _add_conns ranks=[4,0,5,6,8,2,3,7,1] 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 10 monclient(hunting): picked mon.noname-c con 0x7f6968139500 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 10 monclient(hunting): picked mon.noname-a con 0x7f6968139ff0 addr v1:172.21.15.181:6789/0 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 10 monclient(hunting): picked mon.noname-h con 0x7f696813fe60 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69680a2650 con 0x7f6968139ff0 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f696809ea60 con 0x7f6968139500 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69680a0c40 con 0x7f696813fe60 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:58.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696ea71640 10 monclient(hunting): authenticate will time out at 1217.844794s 2024-09-13T10:37:58.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696c80d640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f6968139500 0x7f69681ce320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41496/0 (socket says 172.21.15.181:41496) 2024-09-13T10:37:58.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.339+0000 7f696c80d640 1 -- 172.21.15.181:0/2273838151 learned_addr learned my addr 172.21.15.181:0/2273838151 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:58.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.341+0000 7f696c80d640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.181:6791/0 conn(0x7f6968139500 legacy=0x7f69681ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.341+0000 7f6967fff640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.181:6789/0 conn(0x7f6968139ff0 legacy=0x7f696809da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f696d00e640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.195:6791/0 conn(0x7f696813fe60 legacy=0x7f69681d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550622729 0 0) 0x7f696809ea60 con 0x7f6968139500 2024-09-13T10:37:58.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): my global_id is 115015 2024-09-13T10:37:58.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f694c003550 con 0x7f6968139500 2024-09-13T10:37:58.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3394825346 0 0) 0x7f69680a2650 con 0x7f6968139ff0 2024-09-13T10:37:58.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): my global_id is 114984 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f696809ea60 con 0x7f6968139ff0 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90893540 0 0) 0x7f69680a0c40 con 0x7f696813fe60 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): my global_id is 105143 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69680a2650 con 0x7f696813fe60 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1777166929 0 0) 0x7f694c003550 con 0x7f6968139500 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69680a0c40 con 0x7f6968139500 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1705522651 0 0) 0x7f696809ea60 con 0x7f6968139ff0 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f694c003550 con 0x7f6968139ff0 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f695c004b20 con 0x7f6968139500 2024-09-13T10:37:58.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): dump: 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.358 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6954001cd0 con 0x7f6968139ff0 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): dump: 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.359 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2548855172 0 0) 0x7f69680a2650 con 0x7f696813fe60 2024-09-13T10:37:58.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f696809ea60 con 0x7f696813fe60 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6960001f20 con 0x7f696813fe60 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient(hunting): dump: 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.361 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 88664137 0 0) 0x7f694c003550 con 0x7f6968139ff0 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.195:6791/0 conn(0x7f696813fe60 legacy=0x7f69681d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.181:6791/0 conn(0x7f6968139500 legacy=0x7f69681ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient: _finish_hunting 0 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 monclient: found mon.a 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:58.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696809f6e0 con 0x7f6968139ff0 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient: _finish_auth 0 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient: _check_auth_tickets 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f696ea71640 5 monclient: authenticate success, global_id 114984 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f696ea71640 10 monclient: _renew_subs 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f696ea71640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f696ea71640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f696809f9c0 con 0x7f6968139ff0 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f696ea71640 10 monclient: _renew_subs 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f696ea71640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f696ea71640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f69681cea30 con 0x7f6968139ff0 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6954003a80 con 0x7f6968139ff0 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6954003610 con 0x7f6968139ff0 2024-09-13T10:37:58.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f6966ffd640 4 set_mon_vals no callback set 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.342+0000 7f69657fa640 10 monclient: dump: 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.364 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.343+0000 7f696ea71640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.343+0000 7f696ea71640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f69480065c0 con 0x7f6948002860 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.343+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6954003ff0 con 0x7f6968139ff0 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.343+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(251..251 src has 1..251) ==== 3898+0+0 (unknown 3655941179 0 0) 0x7f695404e210 con 0x7f6968139ff0 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.344+0000 7f696d00e640 10 monclient: get_auth_request con 0x7f694c040480 auth_method 0 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.345+0000 7f696c80d640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.195:6789/0 conn(0x7f6948002860 legacy=0x7f6948004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568392456 0 0) 0x7f69480065c0 con 0x7f6948002860 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 10 monclient(hunting): my global_id is 134245 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f694c003550 con 0x7f6948002860 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3024791182 0 0) 0x7f694c003550 con 0x7f6948002860 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69480065c0 con 0x7f6948002860 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f695c005510 con 0x7f6948002860 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 10 monclient: dump: 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.366 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1286168885 0 0) 0x7f69480065c0 con 0x7f6948002860 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f694800a160 con 0x7f6948002860 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f695c0056b0 con 0x7f6948002860 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:58.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.195:6789/0 conn(0x7f6948002860 legacy=0x7f6948004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.346+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.195:6789/0 conn(0x7f6948002860 legacy=0x7f6948004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:58.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.352+0000 7f696ea71640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:58.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.353+0000 7f696ea71640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6948009e50 con 0x7f6948009110 2024-09-13T10:37:58.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f696c80d640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.195:6789/0 conn(0x7f6948009110 legacy=0x7f69480095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1799555729 0 0) 0x7f6948009e50 con 0x7f6948009110 2024-09-13T10:37:58.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f69657fa640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f69657fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f69657fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f69657fa640 10 monclient(hunting): my global_id is 134254 2024-09-13T10:37:58.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69480065c0 con 0x7f6948009110 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3638499345 0 0) 0x7f69480065c0 con 0x7f6948009110 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6948009e50 con 0x7f6948009110 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f695c005fa0 con 0x7f6948009110 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f69657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f69657fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.355+0000 7f69657fa640 10 monclient: dump: 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.370 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1582300866 0 0) 0x7f6948009e50 con 0x7f6948009110 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f694800c3f0 con 0x7f6948009110 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 237164059) 0x7f695c007490 con 0x7f6948009110 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f69657fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f69657fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:58.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.195:6789/0 conn(0x7f6948009110 legacy=0x7f69480095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f69657fa640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.195:6789/0 conn(0x7f6948009110 legacy=0x7f69480095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:58.372 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:58.372 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:58.372 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:58.372 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:58.372 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:58.372 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 10384, 2024-09-13T10:37:58.372 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:58.372 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:58.372 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:58.373 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:58.373 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:58.373 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:58.373 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:58.373 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:58.373 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:58.373 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:58.373 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.373 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:37:58.373 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:58.373 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:58.373 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:58.374 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:58.375 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:58.376 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.377 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.378 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.379 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:58.381 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:58.383 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.384 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:58.386 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.388 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.389 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.390 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.390 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:58.390 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.390 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.390 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:58.390 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:58.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f696ea71640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.195:6800/1839191919 conn(0x7f694c040480 legacy=0x7f694c042940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f696ea71640 10 monclient: shutdown 2024-09-13T10:37:58.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f696ea71640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:58.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f696ea71640 1 -- 172.21.15.181:0/2273838151 >> v1:172.21.15.181:6789/0 conn(0x7f6968139ff0 legacy=0x7f696809da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f696d00e640 1 -- 172.21.15.181:0/2273838151 reap_dead start 2024-09-13T10:37:58.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f696d00e640 1 -- 172.21.15.181:0/2273838151 reap_dead start 2024-09-13T10:37:58.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f696ea71640 1 -- 172.21.15.181:0/2273838151 shutdown_connections 2024-09-13T10:37:58.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.356+0000 7f696ea71640 1 -- 172.21.15.181:0/2273838151 >> 172.21.15.181:0/2273838151 conn(0x7f69680abf20 msgr2=0x7f69681377e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:58.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.357+0000 7f696ea71640 1 -- 172.21.15.181:0/2273838151 shutdown_connections 2024-09-13T10:37:58.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.357+0000 7f696ea71640 1 -- 172.21.15.181:0/2273838151 wait complete. 2024-09-13T10:37:58.392 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:58.392 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:37:58.392 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:37:58.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.504+0000 7ff91f408640 10 monclient: get_monmap_and_config 2024-09-13T10:37:58.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.504+0000 7ff91f408640 10 monclient: build_initial_monmap 2024-09-13T10:37:58.505 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.504+0000 7ff91f408640 10 monclient: monmap: 2024-09-13T10:37:58.505 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:58.505 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.505 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:58.504753+0000 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:58.504753+0000 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:58.506 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.504+0000 7ff91f408640 1 Processor -- start 2024-09-13T10:37:58.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.504+0000 7ff91f408640 1 -- start start 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.504+0000 7ff91f408640 10 monclient: init 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91f408640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91f408640 10 monclient: _add_conns ranks=[3,4,8,0,5,2,6,1,7] 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91f408640 10 monclient(hunting): picked mon.noname-g con 0x7ff9180a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91f408640 10 monclient(hunting): picked mon.noname-c con 0x7ff9180a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91f408640 10 monclient(hunting): picked mon.noname-e con 0x7ff91813f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91f408640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9180a5fe0 con 0x7ff9180a66d0 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91f408640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9180a8080 con 0x7ff9180a6ab0 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91f408640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9180a42c0 con 0x7ff91813f9a0 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91f408640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91f408640 10 monclient(hunting): authenticate will time out at 1218.010447s 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91d9a5640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7ff91813f9a0 0x7ff918141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41964/0 (socket says 172.21.15.181:41964) 2024-09-13T10:37:58.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91d9a5640 1 -- 172.21.15.181:0/3719261517 learned_addr learned my addr 172.21.15.181:0/3719261517 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:58.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.505+0000 7ff91c9a3640 1 --1- 172.21.15.181:0/3719261517 >> v1:172.21.15.181:6791/0 conn(0x7ff9180a6ab0 0x7ff9180a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41504/0 (socket says 172.21.15.181:41504) 2024-09-13T10:37:58.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff91d9a5640 1 -- 172.21.15.181:0/3719261517 >> v1:172.21.15.181:6793/0 conn(0x7ff91813f9a0 legacy=0x7ff918141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff91c9a3640 1 -- 172.21.15.181:0/3719261517 >> v1:172.21.15.181:6791/0 conn(0x7ff9180a6ab0 legacy=0x7ff9180a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff91d1a4640 1 -- 172.21.15.181:0/3719261517 >> v1:172.21.15.195:6790/0 conn(0x7ff9180a66d0 legacy=0x7ff9180a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4153962967 0 0) 0x7ff9180a42c0 con 0x7ff91813f9a0 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 10 monclient(hunting): my global_id is 105389 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff904003520 con 0x7ff91813f9a0 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483912687 0 0) 0x7ff9180a8080 con 0x7ff9180a6ab0 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 10 monclient(hunting): my global_id is 115024 2024-09-13T10:37:58.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9180a42c0 con 0x7ff9180a6ab0 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1584828466 0 0) 0x7ff9180a5fe0 con 0x7ff9180a66d0 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 10 monclient(hunting): my global_id is 134211 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.507+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9180a8080 con 0x7ff9180a66d0 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3034032099 0 0) 0x7ff904003520 con 0x7ff91813f9a0 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 >> v1:172.21.15.181:6791/0 conn(0x7ff9180a6ab0 legacy=0x7ff9180a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 >> v1:172.21.15.195:6790/0 conn(0x7ff9180a66d0 legacy=0x7ff9180a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 1 monclient: found mon.noname-e 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:37:58.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9181464e0 con 0x7ff91813f9a0 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 10 monclient: _finish_auth 0 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff910001e50 con 0x7ff91813f9a0 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 10 monclient: dump: 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.515 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff91f408640 5 monclient: authenticate success, global_id 105389 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff91f408640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff910004c20 con 0x7ff91813f9a0 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 1 -- 172.21.15.181:0/3719261517 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff910005110 con 0x7ff91813f9a0 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff91f408640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:58.516 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff91f408640 4 set_mon_vals no callback set 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.508+0000 7ff90ffff640 10 monclient: dump: 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.517 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.509+0000 7ff91f408640 10 monclient: shutdown 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.509+0000 7ff91f408640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.509+0000 7ff91f408640 1 -- 172.21.15.181:0/3719261517 >> v1:172.21.15.181:6793/0 conn(0x7ff91813f9a0 legacy=0x7ff918141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.509+0000 7ff91f408640 1 -- 172.21.15.181:0/3719261517 shutdown_connections 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.509+0000 7ff91f408640 1 -- 172.21.15.181:0/3719261517 >> 172.21.15.181:0/3719261517 conn(0x7ff9180abcd0 msgr2=0x7ff9180ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.509+0000 7ff91f408640 1 -- 172.21.15.181:0/3719261517 shutdown_connections 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.509+0000 7ff91f408640 1 -- 172.21.15.181:0/3719261517 wait complete. 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.509+0000 7ff91f408640 10 monclient: build_initial_monmap 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.509+0000 7ff91f408640 10 monclient: monmap: 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:58.518 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 1 Processor -- start 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 1 -- start start 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 10 monclient: init 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 10 monclient: _add_conns ranks=[4,5,7,6,8,2,3,0,1] 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 10 monclient(hunting): picked mon.noname-c con 0x7ff9180a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 10 monclient(hunting): picked mon.noname-h con 0x7ff9180a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 10 monclient(hunting): picked mon.noname-i con 0x7ff91813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff918143170 con 0x7ff9180a66d0 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff918142db0 con 0x7ff9180a6ab0 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91813d140 con 0x7ff91813f9a0 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91f408640 10 monclient(hunting): authenticate will time out at 1218.015799s 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91d1a4640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ff9180a66d0 0x7ff9181ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41516/0 (socket says 172.21.15.181:41516) 2024-09-13T10:37:58.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.510+0000 7ff91d1a4640 1 -- 172.21.15.181:0/3941771690 learned_addr learned my addr 172.21.15.181:0/3941771690 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:58.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff91d1a4640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.181:6791/0 conn(0x7ff9180a66d0 legacy=0x7ff9181ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff91c9a3640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.195:6791/0 conn(0x7ff9180a6ab0 legacy=0x7ff9181d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff91d9a5640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.195:6792/0 conn(0x7ff91813f9a0 legacy=0x7ff9181d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594706084 0 0) 0x7ff918143170 con 0x7ff9180a66d0 2024-09-13T10:37:58.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): my global_id is 115033 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8fc003520 con 0x7ff9180a66d0 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3473398034 0 0) 0x7ff918142db0 con 0x7ff9180a6ab0 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): my global_id is 105152 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff918143170 con 0x7ff9180a6ab0 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1805530378 0 0) 0x7ff91813d140 con 0x7ff91813f9a0 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): my global_id is 57211 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff918142db0 con 0x7ff91813f9a0 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2936919463 0 0) 0x7ff8fc003520 con 0x7ff9180a66d0 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff91813d140 con 0x7ff9180a66d0 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff914003610 con 0x7ff9180a66d0 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): dump: 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.527 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1051173264 0 0) 0x7ff918143170 con 0x7ff9180a6ab0 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8fc003520 con 0x7ff9180a6ab0 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff908001d40 con 0x7ff9180a6ab0 2024-09-13T10:37:58.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): dump: 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.529 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3551847437 0 0) 0x7ff918142db0 con 0x7ff91813f9a0 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff918143170 con 0x7ff91813f9a0 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff9100016a0 con 0x7ff91813f9a0 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient(hunting): dump: 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.530 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 822121166 0 0) 0x7ff91813d140 con 0x7ff9180a66d0 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.195:6792/0 conn(0x7ff91813f9a0 legacy=0x7ff9181d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.195:6791/0 conn(0x7ff9180a6ab0 legacy=0x7ff9181d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient: _finish_hunting 0 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 monclient: found mon.c 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91813f4a0 con 0x7ff9180a66d0 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient: _finish_auth 0 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient: _check_auth_tickets 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff91f408640 5 monclient: authenticate success, global_id 115033 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff91f408640 10 monclient: _renew_subs 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff91f408640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff91f408640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff91813dca0 con 0x7ff9180a66d0 2024-09-13T10:37:58.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff914003ba0 con 0x7ff9180a66d0 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff914004110 con 0x7ff9180a66d0 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90dffb640 10 monclient: dump: 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.533 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.513+0000 7ff90f7fe640 4 set_mon_vals no callback set 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.514+0000 7ff91f408640 10 monclient: _renew_subs 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.514+0000 7ff91f408640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.514+0000 7ff91f408640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7ff91813c820 con 0x7ff9180a66d0 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.514+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff9140042b0 con 0x7ff9180a66d0 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.515+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(252..252 src has 1..252) ==== 3898+0+0 (unknown 1295175523 0 0) 0x7ff91404d570 con 0x7ff9180a66d0 2024-09-13T10:37:58.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.515+0000 7ff91c9a3640 10 monclient: get_auth_request con 0x7ff8fc048e70 auth_method 0 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.515+0000 7ff91f408640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.515+0000 7ff91f408640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff9180a3240 con 0x7ff9181ced70 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.517+0000 7ff91d9a5640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.195:6790/0 conn(0x7ff9181ced70 legacy=0x7ff91813fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.517+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786907994 0 0) 0x7ff9180a3240 con 0x7ff9181ced70 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.517+0000 7ff90dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.517+0000 7ff90dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.517+0000 7ff90dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.517+0000 7ff90dffb640 10 monclient(hunting): my global_id is 134220 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.517+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff91813d140 con 0x7ff9181ced70 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1797129246 0 0) 0x7ff91813d140 con 0x7ff9181ced70 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9180a3240 con 0x7ff9181ced70 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff910004c20 con 0x7ff9181ced70 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:58.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 10 monclient: dump: 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.536 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.537 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.537 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1585054069 0 0) 0x7ff9180a3240 con 0x7ff9181ced70 2024-09-13T10:37:58.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9180008d0 con 0x7ff9181ced70 2024-09-13T10:37:58.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff910005580 con 0x7ff9181ced70 2024-09-13T10:37:58.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:58.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:58.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.195:6790/0 conn(0x7ff9181ced70 legacy=0x7ff91813fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.518+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.195:6790/0 conn(0x7ff9181ced70 legacy=0x7ff91813fd80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:58.538 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39786]: starting. 2024-09-13T10:37:58.538 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39786]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39785 2024-09-13T10:37:58.538 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39786]: created object 0... 2024-09-13T10:37:58.538 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39786]: created object 25... 2024-09-13T10:37:58.538 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39786]: created object 49... 2024-09-13T10:37:58.538 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39786]: finishing. 2024-09-13T10:37:58.538 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39786]: shutting down. 2024-09-13T10:37:58.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.525+0000 7ff91f408640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:58.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.525+0000 7ff91f408640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff9181cf150 con 0x7ff91802e200 2024-09-13T10:37:58.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff91d9a5640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.195:6790/0 conn(0x7ff91802e200 legacy=0x7ff918140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3870423953 0 0) 0x7ff9181cf150 con 0x7ff91802e200 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff90dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff90dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff90dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff90dffb640 10 monclient(hunting): my global_id is 134229 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9180a3240 con 0x7ff91802e200 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4212131183 0 0) 0x7ff9180a3240 con 0x7ff91802e200 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9181cf150 con 0x7ff91802e200 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff910005da0 con 0x7ff91802e200 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff90dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff90dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.527+0000 7ff90dffb640 10 monclient: dump: 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.540 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.541 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.542 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3298717282 0 0) 0x7ff9181cf150 con 0x7ff91802e200 2024-09-13T10:37:58.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff9180a4910 con 0x7ff91802e200 2024-09-13T10:37:58.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 1648130824) 0x7ff9100072f0 con 0x7ff91802e200 2024-09-13T10:37:58.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff90dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:58.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff90dffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:58.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.195:6790/0 conn(0x7ff91802e200 legacy=0x7ff918140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff90dffb640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.195:6790/0 conn(0x7ff91802e200 legacy=0x7ff918140490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:58.542 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:58.542 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:58.542 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 10557, 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:58.543 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.544 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:58.546 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.547 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:58.550 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.551 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:58.554 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:58.555 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:58.556 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.557 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:58.558 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.559 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.560 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:58.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.562 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.562 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.562 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:58.562 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.562 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.562 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:58.562 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:58.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff91f408640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff8fc048e70 legacy=0x7ff8fc04b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff91f408640 10 monclient: shutdown 2024-09-13T10:37:58.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff91f408640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:58.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff91f408640 1 -- 172.21.15.181:0/3941771690 >> v1:172.21.15.181:6791/0 conn(0x7ff9180a66d0 legacy=0x7ff9181ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff91d9a5640 1 -- 172.21.15.181:0/3941771690 reap_dead start 2024-09-13T10:37:58.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff91f408640 1 -- 172.21.15.181:0/3941771690 shutdown_connections 2024-09-13T10:37:58.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff91f408640 1 -- 172.21.15.181:0/3941771690 >> 172.21.15.181:0/3941771690 conn(0x7ff9180abcd0 msgr2=0x7ff918138ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:58.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff91f408640 1 -- 172.21.15.181:0/3941771690 shutdown_connections 2024-09-13T10:37:58.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.528+0000 7ff91f408640 1 -- 172.21.15.181:0/3941771690 wait complete. 2024-09-13T10:37:58.564 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:58.564 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:37:58.565 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:37:58.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.661+0000 7fda08095640 10 monclient: get_monmap_and_config 2024-09-13T10:37:58.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.661+0000 7fda08095640 10 monclient: build_initial_monmap 2024-09-13T10:37:58.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.661+0000 7fda08095640 10 monclient: monmap: 2024-09-13T10:37:58.663 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:58.663 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.663 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:58.662018+0000 2024-09-13T10:37:58.663 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:58.662018+0000 2024-09-13T10:37:58.663 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:58.663 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.663 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:58.663 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:58.663 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:58.664 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:58.664 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:58.664 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:58.664 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:58.664 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:58.664 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:58.664 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.661+0000 7fda08095640 1 Processor -- start 2024-09-13T10:37:58.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda08095640 1 -- start start 2024-09-13T10:37:58.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda08095640 10 monclient: init 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda08095640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda08095640 10 monclient: _add_conns ranks=[4,1,2,8,3,5,7,0,6] 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda08095640 10 monclient(hunting): picked mon.noname-c con 0x7fda000a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda08095640 10 monclient(hunting): picked mon.noname-f con 0x7fda000a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda08095640 10 monclient(hunting): picked mon.noname-b con 0x7fda0013f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda08095640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda000a4bc0 con 0x7fda000a8340 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda08095640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda0013a320 con 0x7fda0013f750 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda08095640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda000a8100 con 0x7fda000a6640 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda08095640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda08095640 10 monclient(hunting): authenticate will time out at 1218.167689s 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda06632640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fda0013f750 0x7fda00141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:45764/0 (socket says 172.21.15.181:45764) 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda06632640 1 -- 172.21.15.181:0/3985539821 learned_addr learned my addr 172.21.15.181:0/3985539821 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:58.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.662+0000 7fda05e31640 1 --1- 172.21.15.181:0/3985539821 >> v1:172.21.15.181:6791/0 conn(0x7fda000a6640 0x7fda00139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41532/0 (socket says 172.21.15.181:41532) 2024-09-13T10:37:58.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.664+0000 7fda05e31640 1 -- 172.21.15.181:0/3985539821 >> v1:172.21.15.181:6791/0 conn(0x7fda000a6640 legacy=0x7fda00139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.664+0000 7fda06632640 1 -- 172.21.15.181:0/3985539821 >> v1:172.21.15.181:6790/0 conn(0x7fda0013f750 legacy=0x7fda00141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.670 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 1 -- 172.21.15.181:0/3985539821 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4264126457 0 0) 0x7fda000a8100 con 0x7fda000a6640 2024-09-13T10:37:58.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient(hunting): my global_id is 115042 2024-09-13T10:37:58.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 1 -- 172.21.15.181:0/3985539821 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9e8003520 con 0x7fda000a6640 2024-09-13T10:37:58.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 1 -- 172.21.15.181:0/3985539821 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1907326033 0 0) 0x7fda0013a320 con 0x7fda0013f750 2024-09-13T10:37:58.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient(hunting): my global_id is 134219 2024-09-13T10:37:58.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 1 -- 172.21.15.181:0/3985539821 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda000a8100 con 0x7fda0013f750 2024-09-13T10:37:58.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda05630640 1 -- 172.21.15.181:0/3985539821 >> v1:172.21.15.195:6789/0 conn(0x7fda000a8340 legacy=0x7fda00139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 1 -- 172.21.15.181:0/3985539821 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1707276546 0 0) 0x7fd9e8003520 con 0x7fda000a6640 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 1 -- 172.21.15.181:0/3985539821 >> v1:172.21.15.181:6790/0 conn(0x7fda0013f750 legacy=0x7fda00141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 1 -- 172.21.15.181:0/3985539821 >> v1:172.21.15.195:6789/0 conn(0x7fda000a8340 legacy=0x7fda00139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient: _finish_hunting 0 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 1 monclient: found mon.noname-c 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 1 -- 172.21.15.181:0/3985539821 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda000a48e0 con 0x7fda000a6640 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient: _finish_auth 0 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient: _check_auth_tickets 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 1 -- 172.21.15.181:0/3985539821 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9f8001e60 con 0x7fda000a6640 2024-09-13T10:37:58.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda08095640 5 monclient: authenticate success, global_id 115042 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda08095640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient: dump: 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.673 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda08095640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 1 -- 172.21.15.181:0/3985539821 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9f8004b60 con 0x7fda000a6640 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 1 -- 172.21.15.181:0/3985539821 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9f80050d0 con 0x7fda000a6640 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:58.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda04e2f640 10 monclient: dump: 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.675 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda08095640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.665+0000 7fda08095640 4 set_mon_vals no callback set 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.666+0000 7fda08095640 10 monclient: shutdown 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.666+0000 7fda08095640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.666+0000 7fda08095640 1 -- 172.21.15.181:0/3985539821 >> v1:172.21.15.181:6791/0 conn(0x7fda000a6640 legacy=0x7fda00139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.666+0000 7fda08095640 1 -- 172.21.15.181:0/3985539821 shutdown_connections 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.666+0000 7fda08095640 1 -- 172.21.15.181:0/3985539821 >> 172.21.15.181:0/3985539821 conn(0x7fda00077170 msgr2=0x7fda000abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.666+0000 7fda08095640 1 -- 172.21.15.181:0/3985539821 shutdown_connections 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.666+0000 7fda08095640 1 -- 172.21.15.181:0/3985539821 wait complete. 2024-09-13T10:37:58.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.666+0000 7fda08095640 10 monclient: build_initial_monmap 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.666+0000 7fda08095640 10 monclient: monmap: 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:58.677 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 1 Processor -- start 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 1 -- start start 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 10 monclient: init 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 10 monclient: _add_conns ranks=[5,1,7,2,4,6,3,0,8] 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 10 monclient(hunting): picked mon.noname-h con 0x7fda000a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 10 monclient(hunting): picked mon.noname-f con 0x7fda0013f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 10 monclient(hunting): picked mon.noname-i con 0x7fda000a1b90 addr v1:172.21.15.195:6792/0 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda000a28e0 con 0x7fda0013f750 2024-09-13T10:37:58.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda000a1400 con 0x7fda000a8340 2024-09-13T10:37:58.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda001cf160 con 0x7fda000a1b90 2024-09-13T10:37:58.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:58.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda08095640 10 monclient(hunting): authenticate will time out at 1218.172612s 2024-09-13T10:37:58.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda05e31640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7fda000a8340 0x7fda001ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:34784/0 (socket says 172.21.15.181:34784) 2024-09-13T10:37:58.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.667+0000 7fda05e31640 1 -- 172.21.15.181:0/3222462842 learned_addr learned my addr 172.21.15.181:0/3222462842 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:58.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fda05e31640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6791/0 conn(0x7fda000a8340 legacy=0x7fda001ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fda05630640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6789/0 conn(0x7fda0013f750 legacy=0x7fda001cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fda06632640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6792/0 conn(0x7fda000a1b90 legacy=0x7fda001d6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397764899 0 0) 0x7fda000a1400 con 0x7fda000a8340 2024-09-13T10:37:58.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): my global_id is 105161 2024-09-13T10:37:58.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9ec003550 con 0x7fda000a8340 2024-09-13T10:37:58.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1667323756 0 0) 0x7fda001cf160 con 0x7fda000a1b90 2024-09-13T10:37:58.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): my global_id is 57220 2024-09-13T10:37:58.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda000a1400 con 0x7fda000a1b90 2024-09-13T10:37:58.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256806277 0 0) 0x7fda000a28e0 con 0x7fda0013f750 2024-09-13T10:37:58.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): my global_id is 134272 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda001cf160 con 0x7fda0013f750 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 718422426 0 0) 0x7fd9ec003550 con 0x7fda000a8340 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda000a28e0 con 0x7fda000a8340 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1559831158 0 0) 0x7fda000a1400 con 0x7fda000a1b90 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9ec003550 con 0x7fda000a1b90 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9f8005050 con 0x7fda000a8340 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): dump: 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.685 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9f0001c10 con 0x7fda000a1b90 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): dump: 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.687 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.688 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.688 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.688 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.688 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.688 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2715899448 0 0) 0x7fda001cf160 con 0x7fda0013f750 2024-09-13T10:37:58.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda000a1400 con 0x7fda0013f750 2024-09-13T10:37:58.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9f4001d10 con 0x7fda0013f750 2024-09-13T10:37:58.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:37:58.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient(hunting): dump: 2024-09-13T10:37:58.688 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.689 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4139179592 0 0) 0x7fda000a28e0 con 0x7fda000a8340 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6792/0 conn(0x7fda000a1b90 legacy=0x7fda001d6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6789/0 conn(0x7fda0013f750 legacy=0x7fda001cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 monclient: found mon.h 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda00142bd0 con 0x7fda000a8340 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient: _finish_auth 0 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:58.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fda08095640 5 monclient: authenticate success, global_id 105161 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fda08095640 10 monclient: _renew_subs 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fda08095640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fda08095640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda000a1120 con 0x7fda000a8340 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fda08095640 10 monclient: _renew_subs 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fda08095640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fda08095640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fda001d7d30 con 0x7fda000a8340 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9f8004b60 con 0x7fda000a8340 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9f8001e00 con 0x7fda000a8340 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fffff640 4 set_mon_vals no callback set 2024-09-13T10:37:58.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.670+0000 7fd9fe7fc640 10 monclient: dump: 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.692 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.671+0000 7fda08095640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.671+0000 7fda08095640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd9e00065c0 con 0x7fd9e0002860 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.671+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fd9f8011ee0 con 0x7fda000a8340 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.671+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(252..252 src has 1..252) ==== 3898+0+0 (unknown 1295175523 0 0) 0x7fd9f804e8a0 con 0x7fda000a8340 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.672+0000 7fda06632640 10 monclient: get_auth_request con 0x7fd9ec040370 auth_method 0 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.673+0000 7fda05630640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6791/0 conn(0x7fd9e0002860 legacy=0x7fd9e0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.673+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574340845 0 0) 0x7fd9e00065c0 con 0x7fd9e0002860 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.673+0000 7fd9fe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.673+0000 7fd9fe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.673+0000 7fd9fe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.673+0000 7fd9fe7fc640 10 monclient(hunting): my global_id is 105170 2024-09-13T10:37:58.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.673+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda000a28e0 con 0x7fd9e0002860 2024-09-13T10:37:58.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2033027905 0 0) 0x7fda000a28e0 con 0x7fd9e0002860 2024-09-13T10:37:58.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9e00065c0 con 0x7fd9e0002860 2024-09-13T10:37:58.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9f4003d10 con 0x7fd9e0002860 2024-09-13T10:37:58.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:58.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 10 monclient: dump: 2024-09-13T10:37:58.694 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.694 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.694 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.695 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2348598276 0 0) 0x7fd9e00065c0 con 0x7fd9e0002860 2024-09-13T10:37:58.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9e000a160 con 0x7fd9e0002860 2024-09-13T10:37:58.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd9f4003f60 con 0x7fd9e0002860 2024-09-13T10:37:58.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:58.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:58.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6791/0 conn(0x7fd9e0002860 legacy=0x7fd9e0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.674+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6791/0 conn(0x7fd9e0002860 legacy=0x7fd9e0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:58.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.680+0000 7fda08095640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:58.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.680+0000 7fda08095640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd9e0009e70 con 0x7fd9e0009130 2024-09-13T10:37:58.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fda05630640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6791/0 conn(0x7fd9e0009130 legacy=0x7fd9e00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3719876211 0 0) 0x7fd9e0009e70 con 0x7fd9e0009130 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 10 monclient(hunting): my global_id is 105179 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9e00065c0 con 0x7fd9e0009130 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3576578954 0 0) 0x7fd9e00065c0 con 0x7fd9e0009130 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9e0009e70 con 0x7fd9e0009130 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd9f4004410 con 0x7fd9e0009130 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 10 monclient: dump: 2024-09-13T10:37:58.698 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.699 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.700 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 585383912 0 0) 0x7fd9e0009e70 con 0x7fd9e0009130 2024-09-13T10:37:58.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd9e000c3f0 con 0x7fd9e0009130 2024-09-13T10:37:58.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 2871897291) 0x7fd9f4005b00 con 0x7fd9e0009130 2024-09-13T10:37:58.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:58.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:58.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6791/0 conn(0x7fd9e0009130 legacy=0x7fd9e00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.683+0000 7fd9fe7fc640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6791/0 conn(0x7fd9e0009130 legacy=0x7fd9e00095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:58.700 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:58.700 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 162382, 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:58.701 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.702 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.703 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:58.704 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.705 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:58.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:58.707 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.710 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:58.711 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.713 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:58.713 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:58.713 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.713 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.713 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.713 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:58.713 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.714 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.716 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:58.717 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.718 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.719 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:58.720 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:58.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.684+0000 7fda08095640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6800/1839191919 conn(0x7fd9ec040370 legacy=0x7fd9ec042830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.684+0000 7fda08095640 10 monclient: shutdown 2024-09-13T10:37:58.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.684+0000 7fda08095640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:58.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.684+0000 7fda08095640 1 -- 172.21.15.181:0/3222462842 >> v1:172.21.15.195:6791/0 conn(0x7fda000a8340 legacy=0x7fda001ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.684+0000 7fda06632640 1 -- 172.21.15.181:0/3222462842 reap_dead start 2024-09-13T10:37:58.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.684+0000 7fda06632640 1 -- 172.21.15.181:0/3222462842 reap_dead start 2024-09-13T10:37:58.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.684+0000 7fda08095640 1 -- 172.21.15.181:0/3222462842 shutdown_connections 2024-09-13T10:37:58.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.684+0000 7fda08095640 1 -- 172.21.15.181:0/3222462842 >> 172.21.15.181:0/3222462842 conn(0x7fda000a6640 msgr2=0x7fda00141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:58.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.684+0000 7fda08095640 1 -- 172.21.15.181:0/3222462842 shutdown_connections 2024-09-13T10:37:58.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.684+0000 7fda08095640 1 -- 172.21.15.181:0/3222462842 wait complete. 2024-09-13T10:37:58.725 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:58.725 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:37:58.725 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:37:58.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.821+0000 7f4f434b8640 10 monclient: get_monmap_and_config 2024-09-13T10:37:58.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.821+0000 7f4f434b8640 10 monclient: build_initial_monmap 2024-09-13T10:37:58.823 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.821+0000 7f4f434b8640 10 monclient: monmap: 2024-09-13T10:37:58.823 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:58.823 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.823 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:37:58.822330+0000 2024-09-13T10:37:58.823 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:37:58.822330+0000 2024-09-13T10:37:58.823 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:58.823 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.824 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:58.824 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:58.824 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:58.824 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:58.824 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:58.824 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:58.824 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:58.824 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:58.824 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:58.824 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 1 Processor -- start 2024-09-13T10:37:58.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 1 -- start start 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 10 monclient: init 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 10 monclient: _add_conns ranks=[2,6,5,0,8,7,1,4,3] 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 10 monclient(hunting): picked mon.noname-b con 0x7f4f3c0a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 10 monclient(hunting): picked mon.noname-d con 0x7f4f3c0a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 10 monclient(hunting): picked mon.noname-h con 0x7f4f3c13f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3c0a4bc0 con 0x7f4f3c0a6640 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3c13a320 con 0x7f4f3c13f750 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3c0a8100 con 0x7f4f3c0a8340 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.822+0000 7f4f434b8640 10 monclient(hunting): authenticate will time out at 1218.327970s 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.823+0000 7f4f41254640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f4f3c0a6640 0x7f4f3c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:45778/0 (socket says 172.21.15.181:45778) 2024-09-13T10:37:58.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.823+0000 7f4f41254640 1 -- 172.21.15.181:0/1551105304 learned_addr learned my addr 172.21.15.181:0/1551105304 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:58.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.823+0000 7f4f40a53640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f4f3c0a8340 0x7f4f3c139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:49274/0 (socket says 172.21.15.181:49274) 2024-09-13T10:37:58.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f41254640 1 -- 172.21.15.181:0/1551105304 >> v1:172.21.15.181:6790/0 conn(0x7f4f3c0a6640 legacy=0x7f4f3c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f40a53640 1 -- 172.21.15.181:0/1551105304 >> v1:172.21.15.181:6792/0 conn(0x7f4f3c0a8340 legacy=0x7f4f3c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f41a55640 1 -- 172.21.15.181:0/1551105304 >> v1:172.21.15.195:6791/0 conn(0x7f4f3c13f750 legacy=0x7f4f3c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498421572 0 0) 0x7f4f3c0a4bc0 con 0x7f4f3c0a6640 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient(hunting): my global_id is 134228 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f28003520 con 0x7f4f3c0a6640 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2012917932 0 0) 0x7f4f3c0a8100 con 0x7f4f3c0a8340 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient(hunting): my global_id is 134205 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f3c0a4bc0 con 0x7f4f3c0a8340 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656856022 0 0) 0x7f4f3c13a320 con 0x7f4f3c13f750 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient(hunting): my global_id is 105188 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f3c0a8100 con 0x7f4f3c13f750 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 391494936 0 0) 0x7f4f28003520 con 0x7f4f3c0a6640 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 >> v1:172.21.15.181:6792/0 conn(0x7f4f3c0a8340 legacy=0x7f4f3c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 >> v1:172.21.15.195:6791/0 conn(0x7f4f3c13f750 legacy=0x7f4f3c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient: _finish_hunting 0 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 monclient: found mon.noname-b 2024-09-13T10:37:58.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3c0a48e0 con 0x7f4f3c0a6640 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient: _finish_auth 0 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient: _check_auth_tickets 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4f38001ae0 con 0x7f4f3c0a6640 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f434b8640 5 monclient: authenticate success, global_id 134228 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f434b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient: dump: 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.833 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.834 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f434b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f380048a0 con 0x7f4f3c0a6640 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 1 -- 172.21.15.181:0/1551105304 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4f38004e10 con 0x7f4f3c0a6640 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f434b8640 10 monclient: get_monmap_and_config success 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f434b8640 4 set_mon_vals no callback set 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.825+0000 7f4f33fff640 10 monclient: dump: 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.835 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.836 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.836 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.836 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.836 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.836 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.836 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.836 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.836 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.836 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.836 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.836 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.826+0000 7f4f434b8640 10 monclient: shutdown 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.826+0000 7f4f434b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.826+0000 7f4f434b8640 1 -- 172.21.15.181:0/1551105304 >> v1:172.21.15.181:6790/0 conn(0x7f4f3c0a6640 legacy=0x7f4f3c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.826+0000 7f4f434b8640 1 -- 172.21.15.181:0/1551105304 shutdown_connections 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.826+0000 7f4f434b8640 1 -- 172.21.15.181:0/1551105304 >> 172.21.15.181:0/1551105304 conn(0x7f4f3c077170 msgr2=0x7f4f3c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.826+0000 7f4f434b8640 1 -- 172.21.15.181:0/1551105304 shutdown_connections 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.826+0000 7f4f434b8640 1 -- 172.21.15.181:0/1551105304 wait complete. 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.826+0000 7f4f434b8640 10 monclient: build_initial_monmap 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.826+0000 7f4f434b8640 10 monclient: monmap: 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:37:58.837 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 1 Processor -- start 2024-09-13T10:37:58.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 1 -- start start 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 10 monclient: init 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 10 monclient: _reopen_session rank -1 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 10 monclient: _add_conns ranks=[3,4,1,8,7,0,5,2,6] 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 10 monclient(hunting): picked mon.noname-g con 0x7f4f3c0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 10 monclient(hunting): picked mon.noname-c con 0x7f4f3c13f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 10 monclient(hunting): picked mon.noname-f con 0x7f4f3c12ffc0 addr v1:172.21.15.195:6789/0 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3c13da60 con 0x7f4f3c12ffc0 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3c134bd0 con 0x7f4f3c0a8340 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3c134eb0 con 0x7f4f3c13f750 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 10 monclient(hunting): _renew_subs 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f434b8640 10 monclient(hunting): authenticate will time out at 1218.332760s 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f40a53640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f4f3c13f750 0x7f4f3c12f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:41546/0 (socket says 172.21.15.181:41546) 2024-09-13T10:37:58.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.827+0000 7f4f40a53640 1 -- 172.21.15.181:0/1904825086 learned_addr learned my addr 172.21.15.181:0/1904825086 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:37:58.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.829+0000 7f4f40a53640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.181:6791/0 conn(0x7f4f3c13f750 legacy=0x7f4f3c12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f41a55640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.195:6789/0 conn(0x7f4f3c12ffc0 legacy=0x7f4f3c1d65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f41254640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.195:6790/0 conn(0x7f4f3c0a8340 legacy=0x7f4f3c1355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2238461986 0 0) 0x7f4f3c134eb0 con 0x7f4f3c13f750 2024-09-13T10:37:58.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): my global_id is 115051 2024-09-13T10:37:58.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f20003550 con 0x7f4f3c13f750 2024-09-13T10:37:58.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2152647922 0 0) 0x7f4f20003550 con 0x7f4f3c13f750 2024-09-13T10:37:58.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f3c134eb0 con 0x7f4f3c13f750 2024-09-13T10:37:58.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4f2c001d10 con 0x7f4f3c13f750 2024-09-13T10:37:58.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:37:58.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:37:58.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): dump: 2024-09-13T10:37:58.847 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.847 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.847 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.847 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.847 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.848 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.848 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.848 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.848 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.848 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.848 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.848 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.848 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151591705 0 0) 0x7f4f3c134bd0 con 0x7f4f3c0a8340 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): my global_id is 134238 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f20003550 con 0x7f4f3c0a8340 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1525191980 0 0) 0x7f4f3c13da60 con 0x7f4f3c12ffc0 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient(hunting): my global_id is 134281 2024-09-13T10:37:58.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f3c134bd0 con 0x7f4f3c12ffc0 2024-09-13T10:37:58.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4153184626 0 0) 0x7f4f3c134eb0 con 0x7f4f3c13f750 2024-09-13T10:37:58.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.195:6790/0 conn(0x7f4f3c0a8340 legacy=0x7f4f3c1355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.195:6789/0 conn(0x7f4f3c12ffc0 legacy=0x7f4f3c1d65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:37:58.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 monclient: found mon.c 2024-09-13T10:37:58.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:37:58.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:58.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3c135190 con 0x7f4f3c13f750 2024-09-13T10:37:58.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient: _finish_auth 0 2024-09-13T10:37:58.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f434b8640 5 monclient: authenticate success, global_id 115051 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f434b8640 10 monclient: _renew_subs 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f434b8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f434b8640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4f3c13e020 con 0x7f4f3c13f750 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f2c004bd0 con 0x7f4f3c13f750 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4f2c005100 con 0x7f4f3c13f750 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f31ffb640 10 monclient: dump: 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.851 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.852 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f337fe640 4 set_mon_vals no callback set 2024-09-13T10:37:58.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f434b8640 10 monclient: _renew_subs 2024-09-13T10:37:58.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f434b8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:37:58.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.830+0000 7f4f434b8640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f4f3c1d7ea0 con 0x7f4f3c13f750 2024-09-13T10:37:58.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.831+0000 7f4f434b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:58.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.831+0000 7f4f434b8640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f3c139d60 con 0x7f4f3c077170 2024-09-13T10:37:58.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.831+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4f2c0052a0 con 0x7f4f3c13f750 2024-09-13T10:37:58.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.831+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(252..252 src has 1..252) ==== 3898+0+0 (unknown 1295175523 0 0) 0x7f4f2c04e320 con 0x7f4f3c13f750 2024-09-13T10:37:58.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.832+0000 7f4f41a55640 10 monclient: get_auth_request con 0x7f4f2003fda0 auth_method 0 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.833+0000 7f4f41254640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.195:6792/0 conn(0x7f4f3c077170 legacy=0x7f4f3c13fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.833+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288257344 0 0) 0x7f4f20003550 con 0x7f4f3c077170 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.833+0000 7f4f31ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.833+0000 7f4f31ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.833+0000 7f4f31ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.833+0000 7f4f31ffb640 10 monclient(hunting): my global_id is 57229 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f3c134eb0 con 0x7f4f3c077170 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1543386616 0 0) 0x7f4f3c134eb0 con 0x7f4f3c077170 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f20003550 con 0x7f4f3c077170 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4f38001d30 con 0x7f4f3c077170 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:58.854 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 10 monclient: dump: 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.855 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 742649383 0 0) 0x7f4f20003550 con 0x7f4f3c077170 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f3c050c40 con 0x7f4f3c077170 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4f38004b20 con 0x7f4f3c077170 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.195:6792/0 conn(0x7f4f3c077170 legacy=0x7f4f3c13fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.834+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.195:6792/0 conn(0x7f4f3c077170 legacy=0x7f4f3c13fb30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.840+0000 7f4f434b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.840+0000 7f4f434b8640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f3c13e3c0 con 0x7f4f3c069b40 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f41254640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.195:6792/0 conn(0x7f4f3c069b40 legacy=0x7f4f3c140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1248377884 0 0) 0x7f4f3c13e3c0 con 0x7f4f3c069b40 2024-09-13T10:37:58.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 10 monclient(hunting): my global_id is 57238 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f20003550 con 0x7f4f3c069b40 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3393758278 0 0) 0x7f4f20003550 con 0x7f4f3c069b40 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f3c13e3c0 con 0x7f4f3c069b40 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4f38005490 con 0x7f4f3c069b40 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 10 monclient: dump: 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:37:58.857 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:37:58.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3103937082 0 0) 0x7f4f3c13e3c0 con 0x7f4f3c069b40 2024-09-13T10:37:58.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.843+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4f3c143260 con 0x7f4f3c069b40 2024-09-13T10:37:58.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7729 (unknown 0 0 320623553) 0x7f4f38008600 con 0x7f4f3c069b40 2024-09-13T10:37:58.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f31ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:37:58.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f31ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:37:58.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.195:6792/0 conn(0x7f4f3c069b40 legacy=0x7f4f3c140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f31ffb640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.195:6792/0 conn(0x7f4f3c069b40 legacy=0x7f4f3c140240 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:37:58.859 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:37:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:37:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 120, 2024-09-13T10:37:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 493262, 2024-09-13T10:37:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:37:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:37:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:37:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:37:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:37:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:37:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:37:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:37:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:37:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:37:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:37:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:37:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:37:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:37:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:37:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:37:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:37:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:37:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:37:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:37:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:37:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:37:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:37:58.879 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:37:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f434b8640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4f2003fda0 legacy=0x7f4f20042260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f434b8640 10 monclient: shutdown 2024-09-13T10:37:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f434b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:37:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f434b8640 1 -- 172.21.15.181:0/1904825086 >> v1:172.21.15.181:6791/0 conn(0x7f4f3c13f750 legacy=0x7f4f3c12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:37:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f41a55640 1 -- 172.21.15.181:0/1904825086 reap_dead start 2024-09-13T10:37:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f41a55640 1 -- 172.21.15.181:0/1904825086 reap_dead start 2024-09-13T10:37:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f434b8640 1 -- 172.21.15.181:0/1904825086 shutdown_connections 2024-09-13T10:37:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f434b8640 1 -- 172.21.15.181:0/1904825086 >> 172.21.15.181:0/1904825086 conn(0x7f4f3c0a6640 msgr2=0x7f4f3c0a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:37:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f434b8640 1 -- 172.21.15.181:0/1904825086 shutdown_connections 2024-09-13T10:37:58.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:37:58.844+0000 7f4f434b8640 1 -- 172.21.15.181:0/1904825086 wait complete. 2024-09-13T10:37:58.882 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:37:58.882 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['g'] 2024-09-13T10:37:58.882 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c', 'e', 'f'] 2024-09-13T10:37:58.882 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2024-09-13T10:37:58.882 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-09-13T10:37:58.882 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-09-13T10:37:58.883 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:37:58.894 INFO:tasks.ceph.mon.g:Stopped 2024-09-13T10:37:58.894 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-09-13T10:37:58.894 INFO:tasks.ceph.mon.c:Sent signal 19 2024-09-13T10:37:58.894 INFO:tasks.mon_thrash:Sending STOP to mon e 2024-09-13T10:37:58.894 INFO:tasks.ceph.mon.e:Sent signal 19 2024-09-13T10:37:58.894 INFO:tasks.mon_thrash:Sending STOP to mon f 2024-09-13T10:37:58.895 INFO:tasks.ceph.mon.f:Sent signal 19 2024-09-13T10:37:58.895 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-13T10:38:13.895 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-09-13T10:38:13.896 INFO:tasks.ceph.mon.c:Sent signal 18 2024-09-13T10:38:13.896 INFO:tasks.mon_thrash:Sending CONT to mon e 2024-09-13T10:38:13.896 INFO:tasks.ceph.mon.e:Sent signal 18 2024-09-13T10:38:13.896 INFO:tasks.mon_thrash:Sending CONT to mon f 2024-09-13T10:38:13.897 INFO:tasks.ceph.mon.f:Sent signal 18 2024-09-13T10:38:13.897 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-09-13T10:38:13.897 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:38:14.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.005+0000 7f4817be8640 10 monclient: get_monmap_and_config 2024-09-13T10:38:14.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.005+0000 7f4817be8640 10 monclient: build_initial_monmap 2024-09-13T10:38:14.007 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.005+0000 7f4817be8640 10 monclient: monmap: 2024-09-13T10:38:14.007 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:14.007 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:14.007 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:38:14.006546+0000 2024-09-13T10:38:14.007 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:38:14.006546+0000 2024-09-13T10:38:14.007 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:14.008 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:14.008 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:14.008 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:14.008 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:14.008 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:14.008 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:14.008 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:14.008 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:14.008 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:14.008 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:14.008 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:14.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.006+0000 7f4817be8640 1 Processor -- start 2024-09-13T10:38:14.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.006+0000 7f4817be8640 1 -- start start 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.006+0000 7f4817be8640 10 monclient: init 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.007+0000 7f4817be8640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.007+0000 7f4817be8640 10 monclient: _add_conns ranks=[1,7,2,8,6,4,0,3,5] 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.007+0000 7f4817be8640 10 monclient(hunting): picked mon.noname-f con 0x7f48100a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.007+0000 7f4817be8640 10 monclient(hunting): picked mon.noname-i con 0x7f48100a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.007+0000 7f4817be8640 10 monclient(hunting): picked mon.noname-b con 0x7f481013f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.007+0000 7f4817be8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48100a4bc0 con 0x7f48100a6640 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.007+0000 7f4817be8640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f481013a320 con 0x7f481013f750 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.007+0000 7f4817be8640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48100a8100 con 0x7f48100a8340 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.007+0000 7f4817be8640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.007+0000 7f4817be8640 10 monclient(hunting): authenticate will time out at 1233.512443s 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.007+0000 7f4816185640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f481013f750 0x7f4810141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:44760/0 (socket says 172.21.15.181:44760) 2024-09-13T10:38:14.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.007+0000 7f4816185640 1 -- 172.21.15.181:0/3922709818 learned_addr learned my addr 172.21.15.181:0/3922709818 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:14.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.009+0000 7f4816185640 1 -- 172.21.15.181:0/3922709818 >> v1:172.21.15.181:6790/0 conn(0x7f481013f750 legacy=0x7f4810141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:14.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.009+0000 7f4815183640 1 -- 172.21.15.181:0/3922709818 >> v1:172.21.15.195:6792/0 conn(0x7f48100a8340 legacy=0x7f4810139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:14.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:14.009+0000 7f4815984640 1 -- 172.21.15.181:0/3922709818 >> v1:172.21.15.195:6789/0 conn(0x7f48100a6640 legacy=0x7f4810139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:17.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 10 monclient(hunting): tick 2024-09-13T10:38:17.009 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:38:17.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 1 monclient(hunting): continuing hunt 2024-09-13T10:38:17.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:38:17.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 1 -- 172.21.15.181:0/3922709818 >> v1:172.21.15.195:6792/0 conn(0x7f48100a8340 legacy=0x7f4810139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:17.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 1 -- 172.21.15.181:0/3922709818 >> v1:172.21.15.181:6790/0 conn(0x7f481013f750 legacy=0x7f4810141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:17.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 1 -- 172.21.15.181:0/3922709818 >> v1:172.21.15.195:6789/0 conn(0x7f48100a6640 legacy=0x7f4810139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:17.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 10 monclient: _add_conns ranks=[4,8,0,6,5,3] 2024-09-13T10:38:17.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 10 monclient(hunting): picked mon.noname-c con 0x7f47f4003960 addr v1:172.21.15.181:6791/0 2024-09-13T10:38:17.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 10 monclient(hunting): picked mon.noname-e con 0x7f47f40075f0 addr v1:172.21.15.181:6793/0 2024-09-13T10:38:17.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 10 monclient(hunting): picked mon.noname-a con 0x7f47f400b340 addr v1:172.21.15.181:6789/0 2024-09-13T10:38:17.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 1 -- 172.21.15.181:0/3922709818 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48100a48e0 con 0x7f47f400b340 2024-09-13T10:38:17.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 1 -- 172.21.15.181:0/3922709818 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f4010160 con 0x7f47f4003960 2024-09-13T10:38:17.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 1 -- 172.21.15.181:0/3922709818 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f4011400 con 0x7f47f40075f0 2024-09-13T10:38:17.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.007+0000 7f48077fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:17.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.010+0000 7f4815183640 1 -- 172.21.15.181:0/3922709818 >> v1:172.21.15.181:6793/0 conn(0x7f47f40075f0 legacy=0x7f47f4009a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:17.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.010+0000 7f4815984640 1 -- 172.21.15.181:0/3922709818 >> v1:172.21.15.181:6791/0 conn(0x7f47f4003960 legacy=0x7f47f4005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:17.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:17.010+0000 7f4816185640 1 -- 172.21.15.181:0/3922709818 >> v1:172.21.15.181:6789/0 conn(0x7f47f400b340 legacy=0x7f47f400d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:18.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.906+0000 7f4814982640 1 -- 172.21.15.181:0/3922709818 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 947755383 0 0) 0x7f48100a48e0 con 0x7f47f400b340 2024-09-13T10:38:18.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.906+0000 7f4814982640 10 monclient(hunting): _negotiate 2024-09-13T10:38:18.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.906+0000 7f4814982640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:18.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.906+0000 7f4814982640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:18.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.906+0000 7f4814982640 10 monclient(hunting): my global_id is 114993 2024-09-13T10:38:18.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.906+0000 7f4814982640 1 -- 172.21.15.181:0/3922709818 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47fc003520 con 0x7f47f400b340 2024-09-13T10:38:18.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 1 -- 172.21.15.181:0/3922709818 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1348332703 0 0) 0x7f47fc003520 con 0x7f47f400b340 2024-09-13T10:38:18.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 1 -- 172.21.15.181:0/3922709818 >> v1:172.21.15.181:6793/0 conn(0x7f47f40075f0 legacy=0x7f47f4009a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:18.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 1 -- 172.21.15.181:0/3922709818 >> v1:172.21.15.181:6791/0 conn(0x7f47f4003960 legacy=0x7f47f4005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:18.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 10 monclient: _finish_hunting 0 2024-09-13T10:38:18.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 1 monclient: found mon.noname-a 2024-09-13T10:38:18.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4816185640 1 -- 172.21.15.181:0/3922709818 reap_dead start 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 1 -- 172.21.15.181:0/3922709818 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f4012760 con 0x7f47f400b340 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 10 monclient: _finish_auth 0 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 10 monclient: _check_auth_tickets 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 1 -- 172.21.15.181:0/3922709818 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4808001df0 con 0x7f47f400b340 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4817be8640 5 monclient: authenticate success, global_id 114993 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 10 monclient: dump: 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:18.911 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:18.912 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4817be8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 1 -- 172.21.15.181:0/3922709818 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4808002040 con 0x7f47f400b340 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 1 -- 172.21.15.181:0/3922709818 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4808004f60 con 0x7f47f400b340 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4814982640 10 monclient: dump: 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:18.913 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4817be8640 10 monclient: get_monmap_and_config success 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.907+0000 7f4817be8640 4 set_mon_vals no callback set 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.908+0000 7f4817be8640 10 monclient: shutdown 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.908+0000 7f4817be8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:18.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.908+0000 7f4817be8640 1 -- 172.21.15.181:0/3922709818 >> v1:172.21.15.181:6789/0 conn(0x7f47f400b340 legacy=0x7f47f400d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:18.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.908+0000 7f4817be8640 1 -- 172.21.15.181:0/3922709818 shutdown_connections 2024-09-13T10:38:18.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.908+0000 7f4817be8640 1 -- 172.21.15.181:0/3922709818 >> 172.21.15.181:0/3922709818 conn(0x7f4810077170 msgr2=0x7f48100abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:18.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.908+0000 7f4817be8640 1 -- 172.21.15.181:0/3922709818 shutdown_connections 2024-09-13T10:38:18.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.908+0000 7f4817be8640 1 -- 172.21.15.181:0/3922709818 wait complete. 2024-09-13T10:38:18.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.909+0000 7f4817be8640 10 monclient: build_initial_monmap 2024-09-13T10:38:18.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.909+0000 7f4817be8640 10 monclient: monmap: 2024-09-13T10:38:18.917 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:18.917 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:38:18.917 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:38:18.917 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:38:18.917 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:18.917 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.909+0000 7f4817be8640 1 Processor -- start 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.909+0000 7f4817be8640 1 -- start start 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.909+0000 7f4817be8640 10 monclient: init 2024-09-13T10:38:18.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.910+0000 7f4817be8640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.910+0000 7f4817be8640 10 monclient: _add_conns ranks=[5,0,8,3,6,4,7,2,1] 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.910+0000 7f4817be8640 10 monclient(hunting): picked mon.noname-h con 0x7f4810136960 addr v1:172.21.15.195:6791/0 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.910+0000 7f4817be8640 10 monclient(hunting): picked mon.noname-a con 0x7f48101cdff0 addr v1:172.21.15.181:6789/0 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.910+0000 7f4817be8640 10 monclient(hunting): picked mon.noname-e con 0x7f48100a1440 addr v1:172.21.15.181:6793/0 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.910+0000 7f4817be8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f481009fe10 con 0x7f48101cdff0 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.910+0000 7f4815183640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f48101cdff0 0x7f481009f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49614/0 (socket says 172.21.15.181:49614) 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.910+0000 7f4815183640 1 -- 172.21.15.181:0/3903749456 learned_addr learned my addr 172.21.15.181:0/3903749456 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.910+0000 7f4817be8640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48100a08e0 con 0x7f4810136960 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.910+0000 7f4817be8640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48100a2960 con 0x7f48100a1440 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.910+0000 7f4817be8640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.910+0000 7f4817be8640 10 monclient(hunting): authenticate will time out at 1238.415875s 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.912+0000 7f4815984640 1 -- 172.21.15.181:0/3903749456 >> v1:172.21.15.195:6791/0 conn(0x7f4810136960 legacy=0x7f481009eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:18.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.913+0000 7f4815183640 1 -- 172.21.15.181:0/3903749456 >> v1:172.21.15.181:6789/0 conn(0x7f48101cdff0 legacy=0x7f481009f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:18.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.913+0000 7f4816185640 1 -- 172.21.15.181:0/3903749456 >> v1:172.21.15.181:6793/0 conn(0x7f48100a1440 legacy=0x7f48101d7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:18.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3010041806 0 0) 0x7f481009fe10 con 0x7f48101cdff0 2024-09-13T10:38:18.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): _negotiate 2024-09-13T10:38:18.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:18.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:18.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): my global_id is 115002 2024-09-13T10:38:18.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f400f170 con 0x7f48101cdff0 2024-09-13T10:38:18.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3735226762 0 0) 0x7f48100a2960 con 0x7f48100a1440 2024-09-13T10:38:18.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): _negotiate 2024-09-13T10:38:18.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): my global_id is 105398 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f481009fe10 con 0x7f48100a1440 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216395845 0 0) 0x7f48100a08e0 con 0x7f4810136960 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): _negotiate 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): my global_id is 105197 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48100a2960 con 0x7f4810136960 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1212638877 0 0) 0x7f481009fe10 con 0x7f48100a1440 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48100a08e0 con 0x7f48100a1440 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4808004ea0 con 0x7f48100a1440 2024-09-13T10:38:18.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): dump: 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:18.925 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2087845925 0 0) 0x7f48100a2960 con 0x7f4810136960 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f481009fe10 con 0x7f4810136960 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1001909515 0 0) 0x7f47f400f170 con 0x7f48101cdff0 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48100a2960 con 0x7f48101cdff0 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f480c001c20 con 0x7f4810136960 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:38:18.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): dump: 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:18.927 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4800003610 con 0x7f48101cdff0 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient(hunting): dump: 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:18.928 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3165435929 0 0) 0x7f48100a08e0 con 0x7f48100a1440 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 >> v1:172.21.15.195:6791/0 conn(0x7f4810136960 legacy=0x7f481009eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 >> v1:172.21.15.181:6789/0 conn(0x7f48101cdff0 legacy=0x7f481009f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient: _finish_hunting 0 2024-09-13T10:38:18.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 monclient: found mon.e 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48100a1b20 con 0x7f48100a1440 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient: _finish_auth 0 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 10 monclient: _check_auth_tickets 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f48067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f4817be8640 5 monclient: authenticate success, global_id 105398 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f4817be8640 10 monclient: _renew_subs 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f4817be8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f4817be8640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4810136d40 con 0x7f48100a1440 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f4817be8640 10 monclient: _renew_subs 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f4817be8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:18.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.919+0000 7f4817be8640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f48101d8820 con 0x7f48100a1440 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.920+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48080052f0 con 0x7f48100a1440 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.920+0000 7f48067fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.920+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f48080057e0 con 0x7f48100a1440 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.920+0000 7f48067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.920+0000 7f48067fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.920+0000 7f4807fff640 4 set_mon_vals no callback set 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.920+0000 7f48067fc640 10 monclient: dump: 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:18.931 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.921+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4808011e60 con 0x7f48100a1440 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.921+0000 7f4817be8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.921+0000 7f4817be8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.921+0000 7f4817be8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:18.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.921+0000 7f4817be8640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f8005080 con 0x7f48100a1440 2024-09-13T10:38:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.921+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(252..252 src has 1..252) ==== 3898+0+0 (unknown 1295175523 0 0) 0x7f480804e350 con 0x7f48100a1440 2024-09-13T10:38:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.921+0000 7f4815984640 10 monclient: get_auth_request con 0x7f47f4041d60 auth_method 0 2024-09-13T10:38:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.926+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f48080177e0 con 0x7f48100a1440 2024-09-13T10:38:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.926+0000 7f48067fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:18.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:18.926+0000 7f48067fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:38:18.982 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39787]: starting. 2024-09-13T10:38:18.982 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39787]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39785 2024-09-13T10:38:18.982 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39787]: shutting down. 2024-09-13T10:38:19.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.183+0000 7f4817be8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:38:19.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.183+0000 7f4817be8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:38:19.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.183+0000 7f4817be8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:19.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.183+0000 7f4817be8640 1 -- 172.21.15.181:0/3903749456 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f47f8005370 con 0x7f48100a1440 2024-09-13T10:38:19.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.183+0000 7f48067fc640 1 -- 172.21.15.181:0/3903749456 <== mon.8 v1:172.21.15.181:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2739 (unknown 254746657 0 1560376895) 0x7f4808020340 con 0x7f48100a1440 2024-09-13T10:38:19.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.183+0000 7f48067fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:38:19.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.183+0000 7f48067fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:38:19.185 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":126,"quorum":[0,1,2,4,5,6,7,8],"quorum_names":["a","f","b","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:38:19.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.186+0000 7f4817be8640 1 -- 172.21.15.181:0/3903749456 >> v1:172.21.15.195:6800/1839191919 conn(0x7f47f4041d60 legacy=0x7f47f4044220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.186+0000 7f4817be8640 10 monclient: shutdown 2024-09-13T10:38:19.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.186+0000 7f4817be8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:19.187 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.186+0000 7f4817be8640 1 -- 172.21.15.181:0/3903749456 >> v1:172.21.15.181:6793/0 conn(0x7f48100a1440 legacy=0x7f48101d7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.186+0000 7f4817be8640 1 -- 172.21.15.181:0/3903749456 shutdown_connections 2024-09-13T10:38:19.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.186+0000 7f4817be8640 1 -- 172.21.15.181:0/3903749456 >> 172.21.15.181:0/3903749456 conn(0x7f47f400b340 msgr2=0x7f48100aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:19.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.186+0000 7f4817be8640 1 -- 172.21.15.181:0/3903749456 shutdown_connections 2024-09-13T10:38:19.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.186+0000 7f4817be8640 1 -- 172.21.15.181:0/3903749456 wait complete. 2024-09-13T10:38:19.198 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-09-13T10:38:19.198 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-09-13T10:38:19.198 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:38:19.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.295+0000 7fe728797640 10 monclient: get_monmap_and_config 2024-09-13T10:38:19.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.295+0000 7fe728797640 10 monclient: build_initial_monmap 2024-09-13T10:38:19.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.295+0000 7fe728797640 10 monclient: monmap: 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:38:19.295797+0000 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:38:19.295797+0000 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:19.297 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:19.298 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:19.298 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:19.298 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.295+0000 7fe728797640 1 Processor -- start 2024-09-13T10:38:19.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.295+0000 7fe728797640 1 -- start start 2024-09-13T10:38:19.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.295+0000 7fe728797640 10 monclient: init 2024-09-13T10:38:19.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.296+0000 7fe728797640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:19.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.296+0000 7fe728797640 10 monclient: _add_conns ranks=[0,7,4,8,6,3,5,2,1] 2024-09-13T10:38:19.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.296+0000 7fe728797640 10 monclient(hunting): picked mon.noname-a con 0x7fe7200a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:38:19.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.296+0000 7fe728797640 10 monclient(hunting): picked mon.noname-i con 0x7fe7200a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:38:19.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.296+0000 7fe728797640 10 monclient(hunting): picked mon.noname-c con 0x7fe72013f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:38:19.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.296+0000 7fe728797640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7200a5fe0 con 0x7fe7200a66d0 2024-09-13T10:38:19.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.296+0000 7fe728797640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7200a8080 con 0x7fe72013f9a0 2024-09-13T10:38:19.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.296+0000 7fe728797640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7200a42c0 con 0x7fe7200a6ab0 2024-09-13T10:38:19.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.296+0000 7fe728797640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:19.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.296+0000 7fe728797640 10 monclient(hunting): authenticate will time out at 1238.801596s 2024-09-13T10:38:19.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.296+0000 7fe726533640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe7200a66d0 0x7fe7200a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49626/0 (socket says 172.21.15.181:49626) 2024-09-13T10:38:19.300 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.296+0000 7fe726533640 1 -- 172.21.15.181:0/1742851947 learned_addr learned my addr 172.21.15.181:0/1742851947 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:19.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.298+0000 7fe726533640 1 -- 172.21.15.181:0/1742851947 >> v1:172.21.15.181:6789/0 conn(0x7fe7200a66d0 legacy=0x7fe7200a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.298+0000 7fe726d34640 1 -- 172.21.15.181:0/1742851947 >> v1:172.21.15.181:6791/0 conn(0x7fe72013f9a0 legacy=0x7fe720141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.298+0000 7fe725531640 1 -- 172.21.15.181:0/1742851947 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2669199836 0 0) 0x7fe7200a5fe0 con 0x7fe7200a66d0 2024-09-13T10:38:19.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient(hunting): my global_id is 115011 2024-09-13T10:38:19.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 1 -- 172.21.15.181:0/1742851947 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe708003520 con 0x7fe7200a66d0 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 1 -- 172.21.15.181:0/1742851947 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173789784 0 0) 0x7fe7200a8080 con 0x7fe72013f9a0 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient(hunting): my global_id is 115069 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 1 -- 172.21.15.181:0/1742851947 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7200a5fe0 con 0x7fe72013f9a0 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725d32640 1 -- 172.21.15.181:0/1742851947 >> v1:172.21.15.195:6792/0 conn(0x7fe7200a6ab0 legacy=0x7fe7200a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 1 -- 172.21.15.181:0/1742851947 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1532815485 0 0) 0x7fe7200a5fe0 con 0x7fe72013f9a0 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 1 -- 172.21.15.181:0/1742851947 >> v1:172.21.15.195:6792/0 conn(0x7fe7200a6ab0 legacy=0x7fe7200a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 1 -- 172.21.15.181:0/1742851947 >> v1:172.21.15.181:6789/0 conn(0x7fe7200a66d0 legacy=0x7fe7200a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient: _finish_hunting 0 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 1 monclient: found mon.noname-c 2024-09-13T10:38:19.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 1 -- 172.21.15.181:0/1742851947 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7201464e0 con 0x7fe72013f9a0 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient: _finish_auth 0 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient: _check_auth_tickets 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 1 -- 172.21.15.181:0/1742851947 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe710001b10 con 0x7fe72013f9a0 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe728797640 5 monclient: authenticate success, global_id 115069 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe728797640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient: dump: 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.306 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.307 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe728797640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 1 -- 172.21.15.181:0/1742851947 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe710003610 con 0x7fe72013f9a0 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 1 -- 172.21.15.181:0/1742851947 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe710003b80 con 0x7fe72013f9a0 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe728797640 10 monclient: get_monmap_and_config success 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe728797640 4 set_mon_vals no callback set 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe725531640 10 monclient: dump: 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.308 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe728797640 10 monclient: shutdown 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe728797640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:19.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe728797640 1 -- 172.21.15.181:0/1742851947 >> v1:172.21.15.181:6791/0 conn(0x7fe72013f9a0 legacy=0x7fe720141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe728797640 1 -- 172.21.15.181:0/1742851947 shutdown_connections 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.299+0000 7fe728797640 1 -- 172.21.15.181:0/1742851947 >> 172.21.15.181:0/1742851947 conn(0x7fe7200abcd0 msgr2=0x7fe7200ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.300+0000 7fe728797640 1 -- 172.21.15.181:0/1742851947 shutdown_connections 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.300+0000 7fe728797640 1 -- 172.21.15.181:0/1742851947 wait complete. 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.300+0000 7fe728797640 10 monclient: build_initial_monmap 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.300+0000 7fe728797640 10 monclient: monmap: 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:19.310 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.300+0000 7fe728797640 1 Processor -- start 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.300+0000 7fe728797640 1 -- start start 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.300+0000 7fe728797640 10 monclient: init 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.301+0000 7fe728797640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.301+0000 7fe728797640 10 monclient: _add_conns ranks=[5,8,7,4,2,0,6,1,3] 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.301+0000 7fe728797640 10 monclient(hunting): picked mon.noname-h con 0x7fe7200a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:38:19.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.301+0000 7fe728797640 10 monclient(hunting): picked mon.noname-e con 0x7fe7200a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:38:19.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.301+0000 7fe728797640 10 monclient(hunting): picked mon.noname-i con 0x7fe72013f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:38:19.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.301+0000 7fe728797640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72013f2e0 con 0x7fe7200a66d0 2024-09-13T10:38:19.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.301+0000 7fe728797640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe720068680 con 0x7fe72013f9a0 2024-09-13T10:38:19.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.301+0000 7fe728797640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7200a2930 con 0x7fe7200a6ab0 2024-09-13T10:38:19.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.301+0000 7fe728797640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:19.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.301+0000 7fe728797640 10 monclient(hunting): authenticate will time out at 1238.806354s 2024-09-13T10:38:19.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.301+0000 7fe725d32640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fe7200a6ab0 0x7fe7201d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39748/0 (socket says 172.21.15.181:39748) 2024-09-13T10:38:19.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.301+0000 7fe725d32640 1 -- 172.21.15.181:0/3617135573 learned_addr learned my addr 172.21.15.181:0/3617135573 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:19.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.303+0000 7fe725d32640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.181:6793/0 conn(0x7fe7200a6ab0 legacy=0x7fe7201d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.303+0000 7fe726d34640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.195:6792/0 conn(0x7fe72013f9a0 legacy=0x7fe7201d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.303+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744128353 0 0) 0x7fe7200a2930 con 0x7fe7200a6ab0 2024-09-13T10:38:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.303+0000 7fe71effd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.303+0000 7fe71effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.303+0000 7fe71effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.303+0000 7fe71effd640 10 monclient(hunting): my global_id is 105416 2024-09-13T10:38:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.303+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe70c003520 con 0x7fe7200a6ab0 2024-09-13T10:38:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.303+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:38:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.303+0000 7fe726533640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.195:6791/0 conn(0x7fe7200a66d0 legacy=0x7fe7201ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2598850273 0 0) 0x7fe720068680 con 0x7fe72013f9a0 2024-09-13T10:38:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 10 monclient(hunting): my global_id is 57265 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7200a2930 con 0x7fe72013f9a0 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746889089 0 0) 0x7fe72013f2e0 con 0x7fe7200a66d0 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 10 monclient(hunting): my global_id is 105215 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe720068680 con 0x7fe7200a66d0 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 349108051 0 0) 0x7fe70c003520 con 0x7fe7200a6ab0 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe72013f2e0 con 0x7fe7200a6ab0 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe714003990 con 0x7fe7200a6ab0 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:38:19.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 10 monclient(hunting): dump: 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.318 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.305+0000 7fe71effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 724955594 0 0) 0x7fe72013f2e0 con 0x7fe7200a6ab0 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.195:6792/0 conn(0x7fe72013f9a0 legacy=0x7fe7201d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.195:6791/0 conn(0x7fe7200a66d0 legacy=0x7fe7201ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 10 monclient: _finish_hunting 0 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 1 monclient: found mon.e 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72013cf80 con 0x7fe7200a6ab0 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 10 monclient: _finish_auth 0 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 10 monclient: _check_auth_tickets 2024-09-13T10:38:19.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe728797640 5 monclient: authenticate success, global_id 105416 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe728797640 10 monclient: _renew_subs 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe728797640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe728797640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe72013f000 con 0x7fe7200a6ab0 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe728797640 10 monclient: _renew_subs 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe728797640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe728797640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fe72013c530 con 0x7fe7200a6ab0 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe714003e40 con 0x7fe7200a6ab0 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe714004330 con 0x7fe7200a6ab0 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:38:19.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe724d30640 4 set_mon_vals no callback set 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 10 monclient: dump: 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.321 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe728797640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe728797640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe7000065c0 con 0x7fe700002860 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.306+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe7140045d0 con 0x7fe7200a6ab0 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.307+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(253..253 src has 1..253) ==== 3506+0+0 (unknown 4160528110 0 0) 0x7fe71404e570 con 0x7fe7200a6ab0 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.307+0000 7fe726d34640 10 monclient: get_auth_request con 0x7fe70c03fd50 auth_method 0 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe726533640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.181:6789/0 conn(0x7fe700002860 legacy=0x7fe700004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2402728794 0 0) 0x7fe7000065c0 con 0x7fe700002860 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 10 monclient(hunting): my global_id is 115020 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe72013f2e0 con 0x7fe700002860 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1650150294 0 0) 0x7fe72013f2e0 con 0x7fe700002860 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7000065c0 con 0x7fe700002860 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe718001320 con 0x7fe700002860 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 10 monclient: dump: 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.323 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2710258255 0 0) 0x7fe7000065c0 con 0x7fe700002860 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe70000a160 con 0x7fe700002860 2024-09-13T10:38:19.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe718004910 con 0x7fe700002860 2024-09-13T10:38:19.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:19.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:38:19.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.181:6789/0 conn(0x7fe700002860 legacy=0x7fe700004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.309+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.181:6789/0 conn(0x7fe700002860 legacy=0x7fe700004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:19.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.315+0000 7fe728797640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:38:19.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.315+0000 7fe728797640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe700009e70 con 0x7fe700009130 2024-09-13T10:38:19.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe726533640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.181:6789/0 conn(0x7fe700009130 legacy=0x7fe7000095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4191159492 0 0) 0x7fe700009e70 con 0x7fe700009130 2024-09-13T10:38:19.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 10 monclient(hunting): my global_id is 115029 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7000065c0 con 0x7fe700009130 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 95974064 0 0) 0x7fe7000065c0 con 0x7fe700009130 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe700009e70 con 0x7fe700009130 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe718005210 con 0x7fe700009130 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 10 monclient: dump: 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.327 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.328 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2389333235 0 0) 0x7fe700009e70 con 0x7fe700009130 2024-09-13T10:38:19.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe70000c3f0 con 0x7fe700009130 2024-09-13T10:38:19.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7716 (unknown 0 0 2107598549) 0x7fe718007590 con 0x7fe700009130 2024-09-13T10:38:19.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:38:19.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:38:19.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.181:6789/0 conn(0x7fe700009130 legacy=0x7fe7000095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.329 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.318+0000 7fe71effd640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.181:6789/0 conn(0x7fe700009130 legacy=0x7fe7000095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:19.329 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:38:19.329 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:38:19.329 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:38:19.329 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 126, 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 135296, 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:19.330 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.331 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.332 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:38:19.333 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.334 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:38:19.335 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.336 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:38:19.338 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.340 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:38:19.341 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.342 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.343 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:38:19.344 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:38:19.345 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.346 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:19.347 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:38:19.348 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:38:19.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.319+0000 7fe728797640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.195:6800/1839191919 conn(0x7fe70c03fd50 legacy=0x7fe70c042210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.319+0000 7fe728797640 10 monclient: shutdown 2024-09-13T10:38:19.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.319+0000 7fe728797640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:19.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.319+0000 7fe728797640 1 -- 172.21.15.181:0/3617135573 >> v1:172.21.15.181:6793/0 conn(0x7fe7200a6ab0 legacy=0x7fe7201d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.319+0000 7fe726d34640 1 -- 172.21.15.181:0/3617135573 reap_dead start 2024-09-13T10:38:19.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.319+0000 7fe726d34640 1 -- 172.21.15.181:0/3617135573 reap_dead start 2024-09-13T10:38:19.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.319+0000 7fe728797640 1 -- 172.21.15.181:0/3617135573 shutdown_connections 2024-09-13T10:38:19.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.319+0000 7fe728797640 1 -- 172.21.15.181:0/3617135573 >> 172.21.15.181:0/3617135573 conn(0x7fe7200abcd0 msgr2=0x7fe7200a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:19.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.319+0000 7fe728797640 1 -- 172.21.15.181:0/3617135573 shutdown_connections 2024-09-13T10:38:19.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.319+0000 7fe728797640 1 -- 172.21.15.181:0/3617135573 wait complete. 2024-09-13T10:38:19.351 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:38:19.351 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-09-13T10:38:19.351 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:38:19.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.448+0000 7f4d92ad4640 10 monclient: get_monmap_and_config 2024-09-13T10:38:19.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.448+0000 7f4d92ad4640 10 monclient: build_initial_monmap 2024-09-13T10:38:19.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.448+0000 7f4d92ad4640 10 monclient: monmap: 2024-09-13T10:38:19.450 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:19.450 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.450 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:38:19.449411+0000 2024-09-13T10:38:19.451 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:38:19.449411+0000 2024-09-13T10:38:19.451 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:19.451 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.451 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:19.451 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:19.451 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:19.451 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:19.451 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:19.451 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:19.451 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:19.451 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:19.451 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:19.452 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.449+0000 7f4d92ad4640 1 Processor -- start 2024-09-13T10:38:19.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.449+0000 7f4d92ad4640 1 -- start start 2024-09-13T10:38:19.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.449+0000 7f4d92ad4640 10 monclient: init 2024-09-13T10:38:19.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.449+0000 7f4d92ad4640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.449+0000 7f4d92ad4640 10 monclient: _add_conns ranks=[8,3,2,4,5,0,6,1,7] 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.449+0000 7f4d92ad4640 10 monclient(hunting): picked mon.noname-e con 0x7f4d8c0a6740 addr v1:172.21.15.181:6793/0 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.449+0000 7f4d92ad4640 10 monclient(hunting): picked mon.noname-g con 0x7f4d8c0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.450+0000 7f4d92ad4640 10 monclient(hunting): picked mon.noname-b con 0x7f4d8c13f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.450+0000 7f4d92ad4640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d8c0a2f40 con 0x7f4d8c13f750 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.450+0000 7f4d92ad4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d8c0a4bc0 con 0x7f4d8c0a8340 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.450+0000 7f4d92ad4640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d8c0a5360 con 0x7f4d8c0a6740 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.450+0000 7f4d92ad4640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.450+0000 7f4d92ad4640 10 monclient(hunting): authenticate will time out at 1238.955053s 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.450+0000 7f4d90870640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f4d8c0a6740 0x7f4d8c0a6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39750/0 (socket says 172.21.15.181:39750) 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.450+0000 7f4d90870640 1 -- 172.21.15.181:0/3614413584 learned_addr learned my addr 172.21.15.181:0/3614413584 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.450+0000 7f4d8bfff640 1 -- 172.21.15.181:0/3614413584 >> v1:172.21.15.195:6790/0 conn(0x7f4d8c0a8340 legacy=0x7f4d8c0a7230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:38:19.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.450+0000 7f4d91071640 1 --1- 172.21.15.181:0/3614413584 >> v1:172.21.15.181:6790/0 conn(0x7f4d8c13f750 0x7f4d8c141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:44776/0 (socket says 172.21.15.181:44776) 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d91071640 1 -- 172.21.15.181:0/3614413584 >> v1:172.21.15.181:6790/0 conn(0x7f4d8c13f750 legacy=0x7f4d8c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d90870640 1 -- 172.21.15.181:0/3614413584 >> v1:172.21.15.181:6793/0 conn(0x7f4d8c0a6740 legacy=0x7f4d8c0a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 1 -- 172.21.15.181:0/3614413584 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2804901512 0 0) 0x7f4d8c0a2f40 con 0x7f4d8c13f750 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient(hunting): my global_id is 134264 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 1 -- 172.21.15.181:0/3614413584 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d7c003520 con 0x7f4d8c13f750 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 1 -- 172.21.15.181:0/3614413584 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352802885 0 0) 0x7f4d8c0a5360 con 0x7f4d8c0a6740 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient(hunting): my global_id is 105425 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 1 -- 172.21.15.181:0/3614413584 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d8c0a2f40 con 0x7f4d8c0a6740 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 1 -- 172.21.15.181:0/3614413584 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 487552439 0 0) 0x7f4d7c003520 con 0x7f4d8c13f750 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 1 -- 172.21.15.181:0/3614413584 >> v1:172.21.15.181:6793/0 conn(0x7f4d8c0a6740 legacy=0x7f4d8c0a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 1 -- 172.21.15.181:0/3614413584 >> v1:172.21.15.195:6790/0 conn(0x7f4d8c0a8340 legacy=0x7f4d8c0a7230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 1 monclient: found mon.noname-b 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 1 -- 172.21.15.181:0/3614413584 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c146290 con 0x7f4d8c13f750 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d92ad4640 5 monclient: authenticate success, global_id 134264 2024-09-13T10:38:19.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d92ad4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 1 -- 172.21.15.181:0/3614413584 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4d84001e60 con 0x7f4d8c13f750 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient: dump: 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.459 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d92ad4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 1 -- 172.21.15.181:0/3614413584 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d84004b60 con 0x7f4d8c13f750 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 1 -- 172.21.15.181:0/3614413584 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4d840050d0 con 0x7f4d8c13f750 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d92ad4640 10 monclient: get_monmap_and_config success 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d92ad4640 4 set_mon_vals no callback set 2024-09-13T10:38:19.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.452+0000 7f4d8b7fe640 10 monclient: dump: 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.461 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.453+0000 7f4d92ad4640 10 monclient: shutdown 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.453+0000 7f4d92ad4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.453+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3614413584 >> v1:172.21.15.181:6790/0 conn(0x7f4d8c13f750 legacy=0x7f4d8c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.453+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3614413584 shutdown_connections 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.453+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3614413584 >> 172.21.15.181:0/3614413584 conn(0x7f4d8c0abd40 msgr2=0x7f4d8c0ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.453+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3614413584 shutdown_connections 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.453+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3614413584 wait complete. 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.453+0000 7f4d92ad4640 10 monclient: build_initial_monmap 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.453+0000 7f4d92ad4640 10 monclient: monmap: 2024-09-13T10:38:19.462 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:19.463 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 1 Processor -- start 2024-09-13T10:38:19.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 1 -- start start 2024-09-13T10:38:19.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 10 monclient: init 2024-09-13T10:38:19.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 10 monclient: _add_conns ranks=[3,7,4,5,1,6,2,0,8] 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 10 monclient(hunting): picked mon.noname-g con 0x7f4d8c0a6740 addr v1:172.21.15.195:6790/0 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 10 monclient(hunting): picked mon.noname-i con 0x7f4d8c0a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 10 monclient(hunting): picked mon.noname-c con 0x7f4d8c13f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d8c09fee0 con 0x7f4d8c0a6740 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d8c09f640 con 0x7f4d8c13f750 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d8c09f920 con 0x7f4d8c0a8340 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.454+0000 7f4d92ad4640 10 monclient(hunting): authenticate will time out at 1238.959938s 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.455+0000 7f4d91071640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f4d8c13f750 0x7f4d8c1d6900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38866/0 (socket says 172.21.15.181:38866) 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.455+0000 7f4d91071640 1 -- 172.21.15.181:0/3477829572 learned_addr learned my addr 172.21.15.181:0/3477829572 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.455+0000 7f4d90870640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.195:6790/0 conn(0x7f4d8c0a6740 legacy=0x7f4d8c0a2020 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:38:19.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d91071640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.181:6791/0 conn(0x7f4d8c13f750 legacy=0x7f4d8c1d6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2635159007 0 0) 0x7f4d8c09f640 con 0x7f4d8c13f750 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 10 monclient(hunting): my global_id is 115078 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d70003520 con 0x7f4d8c13f750 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d8bfff640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.195:6792/0 conn(0x7f4d8c0a8340 legacy=0x7f4d8c1d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3166708022 0 0) 0x7f4d70003520 con 0x7f4d8c13f750 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d8c09f640 con 0x7f4d8c13f750 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4d84005050 con 0x7f4d8c13f750 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 10 monclient(hunting): dump: 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.470 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:38:19.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d91071640 1 --1- 172.21.15.181:0/3477829572 >> v1:172.21.15.181:6791/0 conn(0x7f4d8c13f750 0x7f4d8c1d6900 :-1 s=OPENED pgs=667 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f4d8c09f640 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:38:19.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597711379 0 0) 0x7f4d8c09f920 con 0x7f4d8c0a8340 2024-09-13T10:38:19.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 10 monclient(hunting): my global_id is 57274 2024-09-13T10:38:19.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d70003520 con 0x7f4d8c0a8340 2024-09-13T10:38:19.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.457+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4173518185 0 0) 0x7f4d70003520 con 0x7f4d8c0a8340 2024-09-13T10:38:19.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d8c09f920 con 0x7f4d8c0a8340 2024-09-13T10:38:19.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4d78004620 con 0x7f4d8c0a8340 2024-09-13T10:38:19.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:19.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:38:19.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 10 monclient(hunting): dump: 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.473 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3087929218 0 0) 0x7f4d8c09f920 con 0x7f4d8c0a8340 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.181:6791/0 conn(0x7f4d8c13f750 legacy=0x7f4d8c1d6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.195:6790/0 conn(0x7f4d8c0a6740 legacy=0x7f4d8c0a2020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 10 monclient: _finish_hunting 0 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 1 monclient: found mon.i 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c09fc00 con 0x7f4d8c0a8340 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 10 monclient: _finish_auth 0 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 10 monclient: _check_auth_tickets 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3093861614 0 0) 0x7f4d8c09f640 con 0x7f4d8c13f750 2024-09-13T10:38:19.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d92ad4640 5 monclient: authenticate success, global_id 57274 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d92ad4640 10 monclient: _renew_subs 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d92ad4640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8c142650 con 0x7f4d8c0a8340 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d92ad4640 10 monclient: _renew_subs 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d92ad4640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f4d8c09dc80 con 0x7f4d8c0a8340 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d78004a70 con 0x7f4d8c0a8340 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4d78004f60 con 0x7f4d8c0a8340 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d8affd640 4 set_mon_vals no callback set 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.458+0000 7f4d897fa640 10 monclient: dump: 2024-09-13T10:38:19.475 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.476 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.459+0000 7f4d92ad4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.459+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4d6c0065c0 con 0x7f4d6c002860 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.459+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4d78005200 con 0x7f4d8c0a8340 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.459+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(253..253 src has 1..253) ==== 3506+0+0 (unknown 4160528110 0 0) 0x7f4d7804e0d0 con 0x7f4d8c0a8340 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.460+0000 7f4d91071640 10 monclient: get_auth_request con 0x7f4d7003ffd0 auth_method 0 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d90870640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.181:6790/0 conn(0x7f4d6c002860 legacy=0x7f4d6c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2366084604 0 0) 0x7f4d6c0065c0 con 0x7f4d6c002860 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 10 monclient(hunting): my global_id is 134273 2024-09-13T10:38:19.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d8c09f640 con 0x7f4d6c002860 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3356230452 0 0) 0x7f4d8c09f640 con 0x7f4d6c002860 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d6c0065c0 con 0x7f4d6c002860 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4d80001320 con 0x7f4d6c002860 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 10 monclient: dump: 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.478 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2264552850 0 0) 0x7f4d6c0065c0 con 0x7f4d6c002860 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.461+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d6c00a160 con 0x7f4d6c002860 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.462+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4d800049a0 con 0x7f4d6c002860 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.462+0000 7f4d897fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.462+0000 7f4d897fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:38:19.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.462+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.181:6790/0 conn(0x7f4d6c002860 legacy=0x7f4d6c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.462+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.181:6790/0 conn(0x7f4d6c002860 legacy=0x7f4d6c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:19.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.468+0000 7f4d92ad4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:38:19.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.468+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4d6c009e50 con 0x7f4d6c009110 2024-09-13T10:38:19.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d90870640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.181:6790/0 conn(0x7f4d6c009110 legacy=0x7f4d6c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3545761880 0 0) 0x7f4d6c009e50 con 0x7f4d6c009110 2024-09-13T10:38:19.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 10 monclient(hunting): my global_id is 134282 2024-09-13T10:38:19.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d6c0065c0 con 0x7f4d6c009110 2024-09-13T10:38:19.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3741743619 0 0) 0x7f4d6c0065c0 con 0x7f4d6c009110 2024-09-13T10:38:19.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d6c009e50 con 0x7f4d6c009110 2024-09-13T10:38:19.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4d80005110 con 0x7f4d6c009110 2024-09-13T10:38:19.482 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 10 monclient: dump: 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.483 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.484 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.484 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.484 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.484 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3633423388 0 0) 0x7f4d6c009e50 con 0x7f4d6c009110 2024-09-13T10:38:19.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.470+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4d6c00c3f0 con 0x7f4d6c009110 2024-09-13T10:38:19.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7715 (unknown 0 0 2397055143) 0x7f4d80007330 con 0x7f4d6c009110 2024-09-13T10:38:19.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d897fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:38:19.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d897fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:38:19.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.181:6790/0 conn(0x7f4d6c009110 legacy=0x7f4d6c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.484 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d897fa640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.181:6790/0 conn(0x7f4d6c009110 legacy=0x7f4d6c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:19.485 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:38:19.485 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:38:19.485 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:38:19.485 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:38:19.485 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 126, 2024-09-13T10:38:19.485 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 31466, 2024-09-13T10:38:19.485 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:38:19.485 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:38:19.485 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:38:19.485 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:38:19.485 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:38:19.485 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.486 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.487 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:38:19.488 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:38:19.489 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:19.489 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:19.489 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:38:19.489 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:38:19.489 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:38:19.489 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:38:19.489 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:38:19.489 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:38:19.489 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:38:19.489 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.490 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.491 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.493 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.493 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:38:19.493 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.493 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.493 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.493 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:38:19.493 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:38:19.493 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.493 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.495 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.496 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.497 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.499 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.500 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.501 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.502 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.502 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:38:19.502 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:38:19.502 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.502 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.502 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.502 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:38:19.502 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.502 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:38:19.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.504 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:38:19.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.505 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:19.505 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:19.505 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:38:19.505 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.505 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.505 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:38:19.505 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:38:19.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4d7003ffd0 legacy=0x7f4d70042490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d92ad4640 10 monclient: shutdown 2024-09-13T10:38:19.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d92ad4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:19.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3477829572 >> v1:172.21.15.195:6792/0 conn(0x7f4d8c0a8340 legacy=0x7f4d8c1d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d91071640 1 -- 172.21.15.181:0/3477829572 reap_dead start 2024-09-13T10:38:19.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d91071640 1 -- 172.21.15.181:0/3477829572 reap_dead start 2024-09-13T10:38:19.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3477829572 shutdown_connections 2024-09-13T10:38:19.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3477829572 >> 172.21.15.181:0/3477829572 conn(0x7f4d8c0abd40 msgr2=0x7f4d8c0a9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:19.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3477829572 shutdown_connections 2024-09-13T10:38:19.507 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.471+0000 7f4d92ad4640 1 -- 172.21.15.181:0/3477829572 wait complete. 2024-09-13T10:38:19.508 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:38:19.508 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-09-13T10:38:19.508 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:38:19.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.605+0000 7f56b6b9f640 10 monclient: get_monmap_and_config 2024-09-13T10:38:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.605+0000 7f56b6b9f640 10 monclient: build_initial_monmap 2024-09-13T10:38:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.605+0000 7f56b6b9f640 10 monclient: monmap: 2024-09-13T10:38:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:38:19.605937+0000 2024-09-13T10:38:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:38:19.605937+0000 2024-09-13T10:38:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:19.610 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.605+0000 7f56b6b9f640 1 Processor -- start 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b6b9f640 1 -- start start 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b6b9f640 10 monclient: init 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b6b9f640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b6b9f640 10 monclient: _add_conns ranks=[1,6,2,4,0,3,5,7,8] 2024-09-13T10:38:19.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b6b9f640 10 monclient(hunting): picked mon.noname-f con 0x7f56b009ca60 addr v1:172.21.15.195:6789/0 2024-09-13T10:38:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b6b9f640 10 monclient(hunting): picked mon.noname-d con 0x7f56b00a5710 addr v1:172.21.15.181:6792/0 2024-09-13T10:38:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b6b9f640 10 monclient(hunting): picked mon.noname-b con 0x7f56b00a5b30 addr v1:172.21.15.181:6790/0 2024-09-13T10:38:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b6b9f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b009d970 con 0x7f56b009ca60 2024-09-13T10:38:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b6b9f640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b00a5f90 con 0x7f56b00a5b30 2024-09-13T10:38:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b6b9f640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b009dbe0 con 0x7f56b00a5710 2024-09-13T10:38:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b6b9f640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b6b9f640 10 monclient(hunting): authenticate will time out at 1239.111707s 2024-09-13T10:38:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b639e640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f56b00a5b30 0x7f56b01417a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:44792/0 (socket says 172.21.15.181:44792) 2024-09-13T10:38:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b639e640 1 -- 172.21.15.181:0/3542092815 learned_addr learned my addr 172.21.15.181:0/3542092815 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:19.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.606+0000 7f56b539c640 1 --1- 172.21.15.181:0/3542092815 >> v1:172.21.15.181:6792/0 conn(0x7f56b00a5710 0x7f56b013e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:56860/0 (socket says 172.21.15.181:56860) 2024-09-13T10:38:19.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.608+0000 7f56b639e640 1 -- 172.21.15.181:0/3542092815 >> v1:172.21.15.181:6790/0 conn(0x7f56b00a5b30 legacy=0x7f56b01417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.608+0000 7f56b539c640 1 -- 172.21.15.181:0/3542092815 >> v1:172.21.15.181:6792/0 conn(0x7f56b00a5710 legacy=0x7f56b013e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 1 -- 172.21.15.181:0/3542092815 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508370484 0 0) 0x7f56a80017d0 con 0x7f56b00a5b30 2024-09-13T10:38:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient(hunting): my global_id is 134291 2024-09-13T10:38:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 1 -- 172.21.15.181:0/3542092815 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f569c003520 con 0x7f56b00a5b30 2024-09-13T10:38:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 1 -- 172.21.15.181:0/3542092815 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1602790826 0 0) 0x7f56b009dbe0 con 0x7f56b00a5710 2024-09-13T10:38:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient(hunting): my global_id is 134232 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 1 -- 172.21.15.181:0/3542092815 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56a80017d0 con 0x7f56b00a5710 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b5b9d640 1 -- 172.21.15.181:0/3542092815 >> v1:172.21.15.195:6789/0 conn(0x7f56b009ca60 legacy=0x7f56b0135d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 1 -- 172.21.15.181:0/3542092815 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1369178941 0 0) 0x7f569c003520 con 0x7f56b00a5b30 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 1 -- 172.21.15.181:0/3542092815 >> v1:172.21.15.181:6792/0 conn(0x7f56b00a5710 legacy=0x7f56b013e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 1 -- 172.21.15.181:0/3542092815 >> v1:172.21.15.195:6789/0 conn(0x7f56b009ca60 legacy=0x7f56b0135d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient: _finish_hunting 0 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 1 monclient: found mon.noname-b 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 1 -- 172.21.15.181:0/3542092815 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b009dec0 con 0x7f56b00a5b30 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient: _finish_auth 0 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient: _check_auth_tickets 2024-09-13T10:38:19.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 1 -- 172.21.15.181:0/3542092815 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56a8002030 con 0x7f56b00a5b30 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b6b9f640 5 monclient: authenticate success, global_id 134291 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient: dump: 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.622 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b6b9f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 1 -- 172.21.15.181:0/3542092815 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56a8004cd0 con 0x7f56b00a5b30 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 1 -- 172.21.15.181:0/3542092815 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56a8005240 con 0x7f56b00a5b30 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b6b9f640 10 monclient: get_monmap_and_config success 2024-09-13T10:38:19.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b6b9f640 4 set_mon_vals no callback set 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.609+0000 7f56b4b9b640 10 monclient: dump: 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.624 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.610+0000 7f56b6b9f640 10 monclient: shutdown 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.610+0000 7f56b6b9f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.610+0000 7f56b6b9f640 1 -- 172.21.15.181:0/3542092815 >> v1:172.21.15.181:6790/0 conn(0x7f56b00a5b30 legacy=0x7f56b01417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.610+0000 7f56b6b9f640 1 -- 172.21.15.181:0/3542092815 shutdown_connections 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.610+0000 7f56b6b9f640 1 -- 172.21.15.181:0/3542092815 >> 172.21.15.181:0/3542092815 conn(0x7f56b0076e90 msgr2=0x7f56b00aba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.610+0000 7f56b6b9f640 1 -- 172.21.15.181:0/3542092815 shutdown_connections 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.610+0000 7f56b6b9f640 1 -- 172.21.15.181:0/3542092815 wait complete. 2024-09-13T10:38:19.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.610+0000 7f56b6b9f640 10 monclient: build_initial_monmap 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.610+0000 7f56b6b9f640 10 monclient: monmap: 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 1 Processor -- start 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 1 -- start start 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 10 monclient: init 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 10 monclient: _add_conns ranks=[1,7,3,4,8,0,6,5,2] 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 10 monclient(hunting): picked mon.noname-f con 0x7f56b009ca60 addr v1:172.21.15.195:6789/0 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 10 monclient(hunting): picked mon.noname-i con 0x7f56b00a5710 addr v1:172.21.15.195:6792/0 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 10 monclient(hunting): picked mon.noname-g con 0x7f56b00a5b30 addr v1:172.21.15.195:6790/0 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b01ced50 con 0x7f56b009ca60 2024-09-13T10:38:19.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b00a28f0 con 0x7f56b00a5b30 2024-09-13T10:38:19.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b00a2bd0 con 0x7f56b00a5710 2024-09-13T10:38:19.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:19.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b6b9f640 10 monclient(hunting): authenticate will time out at 1239.116615s 2024-09-13T10:38:19.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b639e640 1 -- >> v1:172.21.15.195:6790/0 conn(0x7f56b00a5b30 legacy=0x7f56b01d6190 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:38:19.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b5b9d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f56b009ca60 0x7f56b01cdf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:38340/0 (socket says 172.21.15.181:38340) 2024-09-13T10:38:19.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b539c640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f56b00a5710 0x7f56b01ce640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:54568/0 (socket says 172.21.15.181:54568) 2024-09-13T10:38:19.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.611+0000 7f56b5b9d640 1 -- 172.21.15.181:0/834742765 learned_addr learned my addr 172.21.15.181:0/834742765 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:19.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.613+0000 7f56b5b9d640 1 -- 172.21.15.181:0/834742765 >> v1:172.21.15.195:6789/0 conn(0x7f56b009ca60 legacy=0x7f56b01cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56b539c640 1 -- 172.21.15.181:0/834742765 >> v1:172.21.15.195:6792/0 conn(0x7f56b00a5710 legacy=0x7f56b01ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2469969134 0 0) 0x7f56b01ced50 con 0x7f56b009ca60 2024-09-13T10:38:19.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient(hunting): my global_id is 134317 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56b539c640 1 --1- 172.21.15.181:0/834742765 >> v1:172.21.15.195:6792/0 conn(0x7f56b00a5710 0x7f56b01ce640 :-1 s=OPENED pgs=720 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f56b00a2bd0 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5694003520 con 0x7f56b009ca60 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2008643260 0 0) 0x7f5694003520 con 0x7f56b009ca60 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56b01ced50 con 0x7f56b009ca60 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56a4003610 con 0x7f56b009ca60 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient(hunting): dump: 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.629 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4070363713 0 0) 0x7f56b01ced50 con 0x7f56b009ca60 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 >> v1:172.21.15.195:6792/0 conn(0x7f56b00a5710 legacy=0x7f56b01ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 >> v1:172.21.15.195:6790/0 conn(0x7f56b00a5b30 legacy=0x7f56b01d6190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient: _finish_hunting 0 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 monclient: found mon.f 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b00a2eb0 con 0x7f56b009ca60 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient: _finish_auth 0 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient: _check_auth_tickets 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56b6b9f640 5 monclient: authenticate success, global_id 134317 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642965300 0 0) 0x7f56b00a2bd0 con 0x7f56b00a5710 2024-09-13T10:38:19.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56b6b9f640 10 monclient: _renew_subs 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56b6b9f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56b6b9f640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f56b00a0c70 con 0x7f56b009ca60 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56b6b9f640 10 monclient: _renew_subs 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56b6b9f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56b6b9f640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f56b00a0270 con 0x7f56b009ca60 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56a4003c00 con 0x7f56b009ca60 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56a4004130 con 0x7f56b009ca60 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a3fff640 4 set_mon_vals no callback set 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:38:19.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.614+0000 7f56a27fc640 10 monclient: dump: 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.633 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.615+0000 7f56b6b9f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.615+0000 7f56b6b9f640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f56980065c0 con 0x7f5698002860 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.615+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f56a40042d0 con 0x7f56b009ca60 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.616+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(253..253 src has 1..253) ==== 3506+0+0 (unknown 4160528110 0 0) 0x7f56a404e370 con 0x7f56b009ca60 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.616+0000 7f56b639e640 10 monclient: get_auth_request con 0x7f569403f8d0 auth_method 0 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.617+0000 7f56b539c640 1 -- 172.21.15.181:0/834742765 >> v1:172.21.15.181:6791/0 conn(0x7f5698002860 legacy=0x7f5698004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.617+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116029853 0 0) 0x7f56980065c0 con 0x7f5698002860 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.617+0000 7f56a27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.617+0000 7f56a27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.617+0000 7f56a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.634 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.617+0000 7f56a27fc640 10 monclient(hunting): my global_id is 115087 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.617+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56b00a2bd0 con 0x7f5698002860 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1262684114 0 0) 0x7f56b00a2bd0 con 0x7f5698002860 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56980065c0 con 0x7f5698002860 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56ac001b30 con 0x7f5698002860 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 10 monclient: dump: 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.635 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3283880637 0 0) 0x7f56980065c0 con 0x7f5698002860 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f569800a160 con 0x7f5698002860 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f56ac006860 con 0x7f5698002860 2024-09-13T10:38:19.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:19.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:38:19.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 >> v1:172.21.15.181:6791/0 conn(0x7f5698002860 legacy=0x7f5698004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.618+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 >> v1:172.21.15.181:6791/0 conn(0x7f5698002860 legacy=0x7f5698004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:19.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.624+0000 7f56b6b9f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:38:19.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.624+0000 7f56b6b9f640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5698009e50 con 0x7f5698009110 2024-09-13T10:38:19.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.626+0000 7f56b539c640 1 -- 172.21.15.181:0/834742765 >> v1:172.21.15.181:6791/0 conn(0x7f5698009110 legacy=0x7f56980095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.626+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73974368 0 0) 0x7f5698009e50 con 0x7f5698009110 2024-09-13T10:38:19.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.626+0000 7f56a27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.626+0000 7f56a27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.626+0000 7f56a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.626+0000 7f56a27fc640 10 monclient(hunting): my global_id is 115096 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.626+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56980065c0 con 0x7f5698009110 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1332346731 0 0) 0x7f56980065c0 con 0x7f5698009110 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5698009e50 con 0x7f5698009110 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f56ac0050f0 con 0x7f5698009110 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 10 monclient: dump: 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.639 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 756327047 0 0) 0x7f5698009e50 con 0x7f5698009110 2024-09-13T10:38:19.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f569800c3f0 con 0x7f5698009110 2024-09-13T10:38:19.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7549 (unknown 0 0 320350122) 0x7f56ac006600 con 0x7f5698009110 2024-09-13T10:38:19.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:38:19.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:38:19.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 >> v1:172.21.15.181:6791/0 conn(0x7f5698009110 legacy=0x7f56980095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56a27fc640 1 -- 172.21.15.181:0/834742765 >> v1:172.21.15.181:6791/0 conn(0x7f5698009110 legacy=0x7f56980095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:19.641 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:38:19.641 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:38:19.641 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:38:19.641 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 126, 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 135605, 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.642 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.643 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.644 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:38:19.645 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.646 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.649 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:38:19.650 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:38:19.653 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.654 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.655 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:38:19.656 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.657 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.658 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:19.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.660 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.660 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:38:19.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.660 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:19.660 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:19.660 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:19.660 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.660 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.660 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:38:19.660 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:38:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56b6b9f640 1 -- 172.21.15.181:0/834742765 >> v1:172.21.15.195:6800/1839191919 conn(0x7f569403f8d0 legacy=0x7f5694041d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56b6b9f640 10 monclient: shutdown 2024-09-13T10:38:19.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56b6b9f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:19.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56b6b9f640 1 -- 172.21.15.181:0/834742765 >> v1:172.21.15.195:6789/0 conn(0x7f56b009ca60 legacy=0x7f56b01cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56b639e640 1 -- 172.21.15.181:0/834742765 reap_dead start 2024-09-13T10:38:19.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56b639e640 1 -- 172.21.15.181:0/834742765 reap_dead start 2024-09-13T10:38:19.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56b6b9f640 1 -- 172.21.15.181:0/834742765 shutdown_connections 2024-09-13T10:38:19.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56b6b9f640 1 -- 172.21.15.181:0/834742765 >> 172.21.15.181:0/834742765 conn(0x7f56b0076e90 msgr2=0x7f56b00a6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:19.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56b6b9f640 1 -- 172.21.15.181:0/834742765 shutdown_connections 2024-09-13T10:38:19.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.627+0000 7f56b6b9f640 1 -- 172.21.15.181:0/834742765 wait complete. 2024-09-13T10:38:19.662 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:38:19.663 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-09-13T10:38:19.663 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:38:19.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.760+0000 7fde1cb4c640 10 monclient: get_monmap_and_config 2024-09-13T10:38:19.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.760+0000 7fde1cb4c640 10 monclient: build_initial_monmap 2024-09-13T10:38:19.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.760+0000 7fde1cb4c640 10 monclient: monmap: 2024-09-13T10:38:19.762 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:19.762 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.762 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:38:19.760896+0000 2024-09-13T10:38:19.762 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:38:19.760896+0000 2024-09-13T10:38:19.762 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:19.762 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.762 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:19.762 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:19.763 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:19.763 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:19.763 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:19.763 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:19.763 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:19.763 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:19.763 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:19.763 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.760+0000 7fde1cb4c640 1 Processor -- start 2024-09-13T10:38:19.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.760+0000 7fde1cb4c640 1 -- start start 2024-09-13T10:38:19.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.760+0000 7fde1cb4c640 10 monclient: init 2024-09-13T10:38:19.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde1cb4c640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:19.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde1cb4c640 10 monclient: _add_conns ranks=[0,1,6,7,4,8,5,3,2] 2024-09-13T10:38:19.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde1cb4c640 10 monclient(hunting): picked mon.noname-a con 0x7fde180a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:38:19.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde1cb4c640 10 monclient(hunting): picked mon.noname-f con 0x7fde180a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:38:19.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde1cb4c640 10 monclient(hunting): picked mon.noname-d con 0x7fde1813f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:38:19.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde1cb4c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde180a5fe0 con 0x7fde180a66d0 2024-09-13T10:38:19.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde1cb4c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde180a8080 con 0x7fde180a6ab0 2024-09-13T10:38:19.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde1cb4c640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde180a42c0 con 0x7fde1813f9a0 2024-09-13T10:38:19.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde1cb4c640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde1cb4c640 10 monclient(hunting): authenticate will time out at 1239.266543s 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde16d9d640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fde1813f9a0 0x7fde18141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:56862/0 (socket says 172.21.15.181:56862) 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde1659c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fde180a66d0 0x7fde180a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49648/0 (socket says 172.21.15.181:49648) 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.761+0000 7fde16d9d640 1 -- 172.21.15.181:0/2245040124 learned_addr learned my addr 172.21.15.181:0/2245040124 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde1659c640 1 -- 172.21.15.181:0/2245040124 >> v1:172.21.15.181:6789/0 conn(0x7fde180a66d0 legacy=0x7fde180a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde16d9d640 1 -- 172.21.15.181:0/2245040124 >> v1:172.21.15.181:6792/0 conn(0x7fde1813f9a0 legacy=0x7fde18141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde1559a640 1 -- 172.21.15.181:0/2245040124 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779154063 0 0) 0x7fde180a5fe0 con 0x7fde180a66d0 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde1559a640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde1559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde1559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde1559a640 10 monclient(hunting): my global_id is 115038 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde1559a640 1 -- 172.21.15.181:0/2245040124 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde00003520 con 0x7fde180a66d0 2024-09-13T10:38:19.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde1559a640 1 -- 172.21.15.181:0/2245040124 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49646113 0 0) 0x7fde180a42c0 con 0x7fde1813f9a0 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde1559a640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde1559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde1559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.763+0000 7fde1559a640 10 monclient(hunting): my global_id is 134241 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 1 -- 172.21.15.181:0/2245040124 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde180a5fe0 con 0x7fde1813f9a0 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde15d9b640 1 -- 172.21.15.181:0/2245040124 >> v1:172.21.15.195:6789/0 conn(0x7fde180a6ab0 legacy=0x7fde180a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 1 -- 172.21.15.181:0/2245040124 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2582417114 0 0) 0x7fde00003520 con 0x7fde180a66d0 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 1 -- 172.21.15.181:0/2245040124 >> v1:172.21.15.181:6792/0 conn(0x7fde1813f9a0 legacy=0x7fde18141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 1 -- 172.21.15.181:0/2245040124 >> v1:172.21.15.195:6789/0 conn(0x7fde180a6ab0 legacy=0x7fde180a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 10 monclient: _finish_hunting 0 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 1 monclient: found mon.noname-a 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:38:19.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 1 -- 172.21.15.181:0/2245040124 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde181464e0 con 0x7fde180a66d0 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 10 monclient: _finish_auth 0 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 10 monclient: _check_auth_tickets 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1cb4c640 5 monclient: authenticate success, global_id 115038 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 1 -- 172.21.15.181:0/2245040124 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde08001ad0 con 0x7fde180a66d0 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1cb4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 10 monclient: dump: 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.770 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1cb4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:19.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 1 -- 172.21.15.181:0/2245040124 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde080047e0 con 0x7fde180a66d0 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1cb4c640 10 monclient: get_monmap_and_config success 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 1 -- 172.21.15.181:0/2245040124 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde08004d50 con 0x7fde180a66d0 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1cb4c640 4 set_mon_vals no callback set 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1559a640 10 monclient: dump: 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.772 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1cb4c640 10 monclient: shutdown 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1cb4c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1cb4c640 1 -- 172.21.15.181:0/2245040124 >> v1:172.21.15.181:6789/0 conn(0x7fde180a66d0 legacy=0x7fde180a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1cb4c640 1 -- 172.21.15.181:0/2245040124 shutdown_connections 2024-09-13T10:38:19.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1cb4c640 1 -- 172.21.15.181:0/2245040124 >> 172.21.15.181:0/2245040124 conn(0x7fde180abcd0 msgr2=0x7fde180ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.764+0000 7fde1cb4c640 1 -- 172.21.15.181:0/2245040124 shutdown_connections 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.765+0000 7fde1cb4c640 1 -- 172.21.15.181:0/2245040124 wait complete. 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.765+0000 7fde1cb4c640 10 monclient: build_initial_monmap 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.765+0000 7fde1cb4c640 10 monclient: monmap: 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:19.774 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:19.775 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 1 Processor -- start 2024-09-13T10:38:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 1 -- start start 2024-09-13T10:38:19.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 10 monclient: init 2024-09-13T10:38:19.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:19.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 10 monclient: _add_conns ranks=[3,2,0,1,7,6,4,5,8] 2024-09-13T10:38:19.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 10 monclient(hunting): picked mon.noname-g con 0x7fde180a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:38:19.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 10 monclient(hunting): picked mon.noname-b con 0x7fde180a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:38:19.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 10 monclient(hunting): picked mon.noname-a con 0x7fde1813f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:38:19.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde1813f1a0 con 0x7fde1813f9a0 2024-09-13T10:38:19.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde180a2840 con 0x7fde180a6ab0 2024-09-13T10:38:19.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde1813ce40 con 0x7fde180a66d0 2024-09-13T10:38:19.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:19.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1cb4c640 10 monclient(hunting): authenticate will time out at 1239.271570s 2024-09-13T10:38:19.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde1659c640 1 -- >> v1:172.21.15.195:6790/0 conn(0x7fde180a66d0 legacy=0x7fde181ce690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:38:19.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde16d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fde1813f9a0 0x7fde181d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49662/0 (socket says 172.21.15.181:49662) 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde16d9d640 1 -- 172.21.15.181:0/1454746985 learned_addr learned my addr 172.21.15.181:0/1454746985 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.766+0000 7fde15d9b640 1 --1- 172.21.15.181:0/1454746985 >> v1:172.21.15.181:6790/0 conn(0x7fde180a6ab0 0x7fde181d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:44802/0 (socket says 172.21.15.181:44802) 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde16d9d640 1 -- 172.21.15.181:0/1454746985 >> v1:172.21.15.181:6789/0 conn(0x7fde1813f9a0 legacy=0x7fde181d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde15d9b640 1 -- 172.21.15.181:0/1454746985 >> v1:172.21.15.181:6790/0 conn(0x7fde180a6ab0 legacy=0x7fde181d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242298855 0 0) 0x7fde1813f1a0 con 0x7fde1813f9a0 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde06ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde06ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde06ffd640 10 monclient(hunting): my global_id is 115047 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddf8003520 con 0x7fde1813f9a0 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3114381991 0 0) 0x7fde180a2840 con 0x7fde180a6ab0 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde06ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde06ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde06ffd640 10 monclient(hunting): my global_id is 134300 2024-09-13T10:38:19.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.768+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde1813f1a0 con 0x7fde180a6ab0 2024-09-13T10:38:19.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 442099367 0 0) 0x7fddf8003520 con 0x7fde1813f9a0 2024-09-13T10:38:19.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde180a2840 con 0x7fde1813f9a0 2024-09-13T10:38:19.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde10004b60 con 0x7fde1813f9a0 2024-09-13T10:38:19.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:19.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:38:19.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient(hunting): dump: 2024-09-13T10:38:19.782 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.782 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.782 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.783 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.783 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.783 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.783 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.783 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.783 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.783 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.783 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.783 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1778597910 0 0) 0x7fde1813f1a0 con 0x7fde180a6ab0 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fddf8003520 con 0x7fde180a6ab0 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde0c001cd0 con 0x7fde180a6ab0 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient(hunting): dump: 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.784 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3964244144 0 0) 0x7fde180a2840 con 0x7fde1813f9a0 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 >> v1:172.21.15.195:6790/0 conn(0x7fde180a66d0 legacy=0x7fde181ce690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 >> v1:172.21.15.181:6790/0 conn(0x7fde180a6ab0 legacy=0x7fde181d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 monclient: found mon.a 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1813e900 con 0x7fde1813f9a0 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient: _finish_auth 0 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde1cb4c640 5 monclient: authenticate success, global_id 115047 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde1cb4c640 10 monclient: _renew_subs 2024-09-13T10:38:19.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde1cb4c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde1cb4c640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fde1813ebe0 con 0x7fde1813f9a0 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde1cb4c640 10 monclient: _renew_subs 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde1cb4c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde1cb4c640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fde1813f5c0 con 0x7fde1813f9a0 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde10004fb0 con 0x7fde1813f9a0 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde100054a0 con 0x7fde1813f9a0 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde14d99640 4 set_mon_vals no callback set 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.769+0000 7fde06ffd640 10 monclient: dump: 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.787 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.788 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.770+0000 7fde1cb4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.770+0000 7fde1cb4c640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fddfc0065c0 con 0x7fddfc002860 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.770+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fde10011b20 con 0x7fde1813f9a0 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.770+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(253..253 src has 1..253) ==== 3506+0+0 (unknown 4160528110 0 0) 0x7fde1004e4c0 con 0x7fde1813f9a0 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.770+0000 7fde15d9b640 10 monclient: get_auth_request con 0x7fddf80400b0 auth_method 0 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde1659c640 1 -- 172.21.15.181:0/1454746985 >> v1:172.21.15.181:6792/0 conn(0x7fddfc002860 legacy=0x7fddfc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 91727670 0 0) 0x7fddfc0065c0 con 0x7fddfc002860 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 10 monclient(hunting): my global_id is 134250 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde180a2840 con 0x7fddfc002860 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1981201825 0 0) 0x7fde180a2840 con 0x7fddfc002860 2024-09-13T10:38:19.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fddfc0065c0 con 0x7fddfc002860 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde080047e0 con 0x7fddfc002860 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 10 monclient: dump: 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.790 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2122274865 0 0) 0x7fddfc0065c0 con 0x7fddfc002860 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.772+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fddfc00a160 con 0x7fddfc002860 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.773+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fde080015c0 con 0x7fddfc002860 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.773+0000 7fde06ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.773+0000 7fde06ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.773+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 >> v1:172.21.15.181:6792/0 conn(0x7fddfc002860 legacy=0x7fddfc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.773+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 >> v1:172.21.15.181:6792/0 conn(0x7fddfc002860 legacy=0x7fddfc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:19.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.779+0000 7fde1cb4c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:38:19.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.779+0000 7fde1cb4c640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fddfc009e50 con 0x7fddfc009110 2024-09-13T10:38:19.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde1659c640 1 -- 172.21.15.181:0/1454746985 >> v1:172.21.15.181:6792/0 conn(0x7fddfc009110 legacy=0x7fddfc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 965419396 0 0) 0x7fddfc009e50 con 0x7fddfc009110 2024-09-13T10:38:19.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde06ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde06ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde06ffd640 10 monclient(hunting): my global_id is 134259 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddfc0065c0 con 0x7fddfc009110 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 124465952 0 0) 0x7fddfc0065c0 con 0x7fddfc009110 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fddfc009e50 con 0x7fddfc009110 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fde080053d0 con 0x7fddfc009110 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde06ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.781+0000 7fde06ffd640 10 monclient: dump: 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.794 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2907176058 0 0) 0x7fddfc009e50 con 0x7fddfc009110 2024-09-13T10:38:19.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fddfc00c3f0 con 0x7fddfc009110 2024-09-13T10:38:19.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7548 (unknown 0 0 3944151414) 0x7fde08007d90 con 0x7fddfc009110 2024-09-13T10:38:19.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde06ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:38:19.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde06ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:38:19.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 >> v1:172.21.15.181:6792/0 conn(0x7fddfc009110 legacy=0x7fddfc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde06ffd640 1 -- 172.21.15.181:0/1454746985 >> v1:172.21.15.181:6792/0 conn(0x7fddfc009110 legacy=0x7fddfc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:19.796 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:38:19.796 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:38:19.796 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 126, 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 31806, 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:38:19.797 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.798 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.799 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:19.800 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.801 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:38:19.802 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.803 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.804 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.805 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.806 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.807 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.808 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.810 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.811 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.812 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:38:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:38:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.813 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:38:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:38:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.816 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:38:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:38:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:38:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.817 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.818 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:38:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.819 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:38:19.819 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:38:19.820 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde1cb4c640 1 -- 172.21.15.181:0/1454746985 >> v1:172.21.15.195:6800/1839191919 conn(0x7fddf80400b0 legacy=0x7fddf8042570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde1cb4c640 10 monclient: shutdown 2024-09-13T10:38:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde1cb4c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde1cb4c640 1 -- 172.21.15.181:0/1454746985 >> v1:172.21.15.181:6789/0 conn(0x7fde1813f9a0 legacy=0x7fde181d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde16d9d640 1 -- 172.21.15.181:0/1454746985 reap_dead start 2024-09-13T10:38:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde16d9d640 1 -- 172.21.15.181:0/1454746985 reap_dead start 2024-09-13T10:38:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde1cb4c640 1 -- 172.21.15.181:0/1454746985 shutdown_connections 2024-09-13T10:38:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde1cb4c640 1 -- 172.21.15.181:0/1454746985 >> 172.21.15.181:0/1454746985 conn(0x7fde180abcd0 msgr2=0x7fde180a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde1cb4c640 1 -- 172.21.15.181:0/1454746985 shutdown_connections 2024-09-13T10:38:19.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.782+0000 7fde1cb4c640 1 -- 172.21.15.181:0/1454746985 wait complete. 2024-09-13T10:38:19.822 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:38:19.822 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-09-13T10:38:19.822 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:38:19.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.920+0000 7f26adc08640 10 monclient: get_monmap_and_config 2024-09-13T10:38:19.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.920+0000 7f26adc08640 10 monclient: build_initial_monmap 2024-09-13T10:38:19.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.920+0000 7f26adc08640 10 monclient: monmap: 2024-09-13T10:38:19.921 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:38:19.920657+0000 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:38:19.920657+0000 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:19.922 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.920+0000 7f26adc08640 1 Processor -- start 2024-09-13T10:38:19.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.920+0000 7f26adc08640 1 -- start start 2024-09-13T10:38:19.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.920+0000 7f26adc08640 10 monclient: init 2024-09-13T10:38:19.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.921+0000 7f26adc08640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:19.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.921+0000 7f26adc08640 10 monclient: _add_conns ranks=[0,1,5,4,7,3,6,8,2] 2024-09-13T10:38:19.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.921+0000 7f26adc08640 10 monclient(hunting): picked mon.noname-a con 0x7f26a80a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:38:19.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.921+0000 7f26adc08640 10 monclient(hunting): picked mon.noname-f con 0x7f26a80a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:38:19.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.921+0000 7f26adc08640 10 monclient(hunting): picked mon.noname-h con 0x7f26a813f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:38:19.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.921+0000 7f26adc08640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26a80a5fe0 con 0x7f26a80a66d0 2024-09-13T10:38:19.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.921+0000 7f26adc08640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26a80a8080 con 0x7f26a80a6ab0 2024-09-13T10:38:19.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.921+0000 7f26adc08640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26a80a42c0 con 0x7f26a813f9a0 2024-09-13T10:38:19.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.921+0000 7f26adc08640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:19.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.921+0000 7f26adc08640 10 monclient(hunting): authenticate will time out at 1239.426290s 2024-09-13T10:38:19.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.921+0000 7f26a77fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f26a80a66d0 0x7f26a80a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49664/0 (socket says 172.21.15.181:49664) 2024-09-13T10:38:19.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.921+0000 7f26a77fe640 1 -- 172.21.15.181:0/3773528726 learned_addr learned my addr 172.21.15.181:0/3773528726 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:19.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a77fe640 1 -- 172.21.15.181:0/3773528726 >> v1:172.21.15.181:6789/0 conn(0x7f26a80a66d0 legacy=0x7f26a80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 1 -- 172.21.15.181:0/3773528726 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1650576499 0 0) 0x7f26a80a5fe0 con 0x7f26a80a66d0 2024-09-13T10:38:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 10 monclient(hunting): my global_id is 115056 2024-09-13T10:38:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 1 -- 172.21.15.181:0/3773528726 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2690003520 con 0x7f26a80a66d0 2024-09-13T10:38:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a6ffd640 1 -- 172.21.15.181:0/3773528726 >> v1:172.21.15.195:6789/0 conn(0x7f26a80a6ab0 legacy=0x7f26a80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a7fff640 1 -- 172.21.15.181:0/3773528726 >> v1:172.21.15.195:6791/0 conn(0x7f26a813f9a0 legacy=0x7f26a8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 1 -- 172.21.15.181:0/3773528726 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2784516528 0 0) 0x7f2690003520 con 0x7f26a80a66d0 2024-09-13T10:38:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 1 -- 172.21.15.181:0/3773528726 >> v1:172.21.15.195:6791/0 conn(0x7f26a813f9a0 legacy=0x7f26a8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 1 -- 172.21.15.181:0/3773528726 >> v1:172.21.15.195:6789/0 conn(0x7f26a80a6ab0 legacy=0x7f26a80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:38:19.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 1 monclient: found mon.noname-a 2024-09-13T10:38:19.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:19.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:38:19.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 1 -- 172.21.15.181:0/3773528726 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a81464e0 con 0x7f26a80a66d0 2024-09-13T10:38:19.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 10 monclient: _finish_auth 0 2024-09-13T10:38:19.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:38:19.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:19.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 1 -- 172.21.15.181:0/3773528726 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2698001ad0 con 0x7f26a80a66d0 2024-09-13T10:38:19.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:38:19.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26a67fc640 10 monclient: dump: 2024-09-13T10:38:19.930 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.931 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.932 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26adc08640 5 monclient: authenticate success, global_id 115056 2024-09-13T10:38:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.923+0000 7f26adc08640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26a67fc640 1 -- 172.21.15.181:0/3773528726 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26980048a0 con 0x7f26a80a66d0 2024-09-13T10:38:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26a67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26a67fc640 1 -- 172.21.15.181:0/3773528726 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2698004dd0 con 0x7f26a80a66d0 2024-09-13T10:38:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:38:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26a67fc640 10 monclient: dump: 2024-09-13T10:38:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.932 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26adc08640 10 monclient: get_monmap_and_config success 2024-09-13T10:38:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26adc08640 4 set_mon_vals no callback set 2024-09-13T10:38:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26adc08640 10 monclient: shutdown 2024-09-13T10:38:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26adc08640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26adc08640 1 -- 172.21.15.181:0/3773528726 >> v1:172.21.15.181:6789/0 conn(0x7f26a80a66d0 legacy=0x7f26a80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26adc08640 1 -- 172.21.15.181:0/3773528726 shutdown_connections 2024-09-13T10:38:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26adc08640 1 -- 172.21.15.181:0/3773528726 >> 172.21.15.181:0/3773528726 conn(0x7f26a80abcd0 msgr2=0x7f26a80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26adc08640 1 -- 172.21.15.181:0/3773528726 shutdown_connections 2024-09-13T10:38:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.924+0000 7f26adc08640 1 -- 172.21.15.181:0/3773528726 wait complete. 2024-09-13T10:38:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.925+0000 7f26adc08640 10 monclient: build_initial_monmap 2024-09-13T10:38:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.925+0000 7f26adc08640 10 monclient: monmap: 2024-09-13T10:38:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:19.934 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:38:19.935 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:38:19.935 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:38:19.935 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:19.935 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:38:19.935 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:19.935 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:19.935 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:19.935 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:19.935 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:19.935 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:19.935 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:19.935 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.925+0000 7f26adc08640 1 Processor -- start 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.925+0000 7f26adc08640 1 -- start start 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.925+0000 7f26adc08640 10 monclient: init 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26adc08640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26adc08640 10 monclient: _add_conns ranks=[8,3,2,1,6,4,7,5,0] 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26adc08640 10 monclient(hunting): picked mon.noname-e con 0x7f26a80a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26adc08640 10 monclient(hunting): picked mon.noname-g con 0x7f26a80a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26adc08640 10 monclient(hunting): picked mon.noname-b con 0x7f26a813f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26adc08640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26a80a2350 con 0x7f26a813f9a0 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26adc08640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26a813f310 con 0x7f26a80a6ab0 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26adc08640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26a813e770 con 0x7f26a80a66d0 2024-09-13T10:38:19.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26adc08640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:19.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26adc08640 10 monclient(hunting): authenticate will time out at 1239.431170s 2024-09-13T10:38:19.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26a77fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f26a80a66d0 0x7f26a813b990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39764/0 (socket says 172.21.15.181:39764) 2024-09-13T10:38:19.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26a77fe640 1 -- 172.21.15.181:0/3718922220 learned_addr learned my addr 172.21.15.181:0/3718922220 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:19.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.926+0000 7f26a6ffd640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.195:6790/0 conn(0x7f26a80a6ab0 legacy=0x7f26a813c0a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:38:19.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f26a77fe640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.181:6793/0 conn(0x7f26a80a66d0 legacy=0x7f26a813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f26a7fff640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.181:6790/0 conn(0x7f26a813f9a0 legacy=0x7f26a81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3539721386 0 0) 0x7f26a813e770 con 0x7f26a80a66d0 2024-09-13T10:38:19.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): my global_id is 105434 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2694003550 con 0x7f26a80a66d0 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3760568261 0 0) 0x7f26a80a2350 con 0x7f26a813f9a0 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): my global_id is 134309 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26a813e770 con 0x7f26a813f9a0 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2304635006 0 0) 0x7f2694003550 con 0x7f26a80a66d0 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26a80a2350 con 0x7f26a80a66d0 2024-09-13T10:38:19.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2698004d90 con 0x7f26a80a66d0 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): dump: 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.943 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2674612842 0 0) 0x7f26a813e770 con 0x7f26a813f9a0 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2694003550 con 0x7f26a813f9a0 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f26a0001ef0 con 0x7f26a813f9a0 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:38:19.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient(hunting): dump: 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.945 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3938071853 0 0) 0x7f26a80a2350 con 0x7f26a80a66d0 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.195:6790/0 conn(0x7f26a80a6ab0 legacy=0x7f26a813c0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.181:6790/0 conn(0x7f26a813f9a0 legacy=0x7f26a81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 monclient: found mon.e 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a813cfb0 con 0x7f26a80a66d0 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient: _finish_auth 0 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:38:19.946 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f268ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f26adc08640 5 monclient: authenticate success, global_id 105434 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f26adc08640 10 monclient: _renew_subs 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f26adc08640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f26adc08640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f26a813f030 con 0x7f26a80a66d0 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f26adc08640 10 monclient: _renew_subs 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f26adc08640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.928+0000 7f26adc08640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f26a813c990 con 0x7f26a80a66d0 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.929+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26980048a0 con 0x7f26a80a66d0 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.929+0000 7f268ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.929+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2698001d20 con 0x7f26a80a66d0 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.929+0000 7f268ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.929+0000 7f268ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:38:19.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.929+0000 7f26a5ffb640 4 set_mon_vals no callback set 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.929+0000 7f268ffff640 10 monclient: dump: 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.948 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.929+0000 7f26adc08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.929+0000 7f26adc08640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f26880065c0 con 0x7f2688002860 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.929+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2698011be0 con 0x7f26a80a66d0 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.930+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(253..253 src has 1..253) ==== 3506+0+0 (unknown 4160528110 0 0) 0x7f269804e350 con 0x7f26a80a66d0 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.930+0000 7f26a7fff640 10 monclient: get_auth_request con 0x7f26940400e0 auth_method 0 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.931+0000 7f26a6ffd640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.181:6793/0 conn(0x7f2688002860 legacy=0x7f2688004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866085967 0 0) 0x7f26880065c0 con 0x7f2688002860 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 10 monclient(hunting): my global_id is 105443 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26a80a2350 con 0x7f2688002860 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1178198254 0 0) 0x7f26a80a2350 con 0x7f2688002860 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26880065c0 con 0x7f2688002860 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f269c001ae0 con 0x7f2688002860 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 10 monclient: dump: 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.950 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1752434652 0 0) 0x7f26880065c0 con 0x7f2688002860 2024-09-13T10:38:19.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f268800a160 con 0x7f2688002860 2024-09-13T10:38:19.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f269c0057c0 con 0x7f2688002860 2024-09-13T10:38:19.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:19.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:38:19.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.181:6793/0 conn(0x7f2688002860 legacy=0x7f2688004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.932+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.181:6793/0 conn(0x7f2688002860 legacy=0x7f2688004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:19.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.938+0000 7f26adc08640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:38:19.952 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.938+0000 7f26adc08640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2688009e70 con 0x7f2688009130 2024-09-13T10:38:19.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.940+0000 7f26a6ffd640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.181:6793/0 conn(0x7f2688009130 legacy=0x7f26880095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747700623 0 0) 0x7f2688009e70 con 0x7f2688009130 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 10 monclient(hunting): my global_id is 105452 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26880065c0 con 0x7f2688009130 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3939945683 0 0) 0x7f26880065c0 con 0x7f2688009130 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2688009e70 con 0x7f2688009130 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f269c003cc0 con 0x7f2688009130 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 10 monclient: dump: 2024-09-13T10:38:19.954 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:19.955 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:19.956 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:19.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1100301411 0 0) 0x7f2688009e70 con 0x7f2688009130 2024-09-13T10:38:19.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f268800c410 con 0x7f2688009130 2024-09-13T10:38:19.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7549 (unknown 0 0 2924843753) 0x7f269c005970 con 0x7f2688009130 2024-09-13T10:38:19.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:38:19.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:38:19.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.181:6793/0 conn(0x7f2688009130 legacy=0x7f26880095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f268ffff640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.181:6793/0 conn(0x7f2688009130 legacy=0x7f26880095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:19.956 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:38:19.956 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:38:19.956 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 126, 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 183644, 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:38:19.957 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.958 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.959 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:38:19.960 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:19.961 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.962 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.964 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.965 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:38:19.966 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.967 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.968 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.969 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:38:19.970 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:38:19.972 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:38:19.973 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:38:19.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:19.975 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:38:19.976 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:38:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f26adc08640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.195:6800/1839191919 conn(0x7f26940400e0 legacy=0x7f26940425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f26adc08640 10 monclient: shutdown 2024-09-13T10:38:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f26adc08640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f26adc08640 1 -- 172.21.15.181:0/3718922220 >> v1:172.21.15.181:6793/0 conn(0x7f26a80a66d0 legacy=0x7f26a813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f26a7fff640 1 -- 172.21.15.181:0/3718922220 reap_dead start 2024-09-13T10:38:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f26a7fff640 1 -- 172.21.15.181:0/3718922220 reap_dead start 2024-09-13T10:38:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f26adc08640 1 -- 172.21.15.181:0/3718922220 shutdown_connections 2024-09-13T10:38:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.941+0000 7f26adc08640 1 -- 172.21.15.181:0/3718922220 >> 172.21.15.181:0/3718922220 conn(0x7f26a80abcd0 msgr2=0x7f26a8137cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.942+0000 7f26adc08640 1 -- 172.21.15.181:0/3718922220 shutdown_connections 2024-09-13T10:38:19.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:19.942+0000 7f26adc08640 1 -- 172.21.15.181:0/3718922220 wait complete. 2024-09-13T10:38:19.978 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:38:19.978 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-09-13T10:38:19.978 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:38:20.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.080+0000 7f36c9bc3640 10 monclient: get_monmap_and_config 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.080+0000 7f36c9bc3640 10 monclient: build_initial_monmap 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.080+0000 7f36c9bc3640 10 monclient: monmap: 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:38:20.081123+0000 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:38:20.081123+0000 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:20.082 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:20.083 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:20.083 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:20.083 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 1 Processor -- start 2024-09-13T10:38:20.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 1 -- start start 2024-09-13T10:38:20.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 10 monclient: init 2024-09-13T10:38:20.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:20.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 10 monclient: _add_conns ranks=[2,5,3,6,4,1,0,7,8] 2024-09-13T10:38:20.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 10 monclient(hunting): picked mon.noname-b con 0x7f36c4139040 addr v1:172.21.15.181:6790/0 2024-09-13T10:38:20.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 10 monclient(hunting): picked mon.noname-h con 0x7f36c409cd50 addr v1:172.21.15.195:6791/0 2024-09-13T10:38:20.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 10 monclient(hunting): picked mon.noname-g con 0x7f36c413fae0 addr v1:172.21.15.195:6790/0 2024-09-13T10:38:20.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c409dbb0 con 0x7f36c4139040 2024-09-13T10:38:20.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c409de90 con 0x7f36c413fae0 2024-09-13T10:38:20.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c409e170 con 0x7f36c409cd50 2024-09-13T10:38:20.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:20.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c9bc3640 10 monclient(hunting): authenticate will time out at 1239.586847s 2024-09-13T10:38:20.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c3fff640 1 -- >> v1:172.21.15.195:6790/0 conn(0x7f36c413fae0 legacy=0x7f36c4141ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:38:20.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c37fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f36c4139040 0x7f36c40a58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:44830/0 (socket says 172.21.15.181:44830) 2024-09-13T10:38:20.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.081+0000 7f36c37fe640 1 -- 172.21.15.181:0/1758115604 learned_addr learned my addr 172.21.15.181:0/1758115604 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:20.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c37fe640 1 -- 172.21.15.181:0/1758115604 >> v1:172.21.15.181:6790/0 conn(0x7f36c4139040 legacy=0x7f36c40a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 1 -- 172.21.15.181:0/1758115604 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3219821236 0 0) 0x7f36c409dbb0 con 0x7f36c4139040 2024-09-13T10:38:20.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c2ffd640 1 -- 172.21.15.181:0/1758115604 >> v1:172.21.15.195:6791/0 conn(0x7f36c409cd50 legacy=0x7f36c413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient(hunting): my global_id is 134318 2024-09-13T10:38:20.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 1 -- 172.21.15.181:0/1758115604 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36ac003520 con 0x7f36c4139040 2024-09-13T10:38:20.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 1 -- 172.21.15.181:0/1758115604 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870612850 0 0) 0x7f36c409e170 con 0x7f36c409cd50 2024-09-13T10:38:20.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient(hunting): my global_id is 105233 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 1 -- 172.21.15.181:0/1758115604 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36c409dbb0 con 0x7f36c409cd50 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 1 -- 172.21.15.181:0/1758115604 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1409938533 0 0) 0x7f36ac003520 con 0x7f36c4139040 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 1 -- 172.21.15.181:0/1758115604 >> v1:172.21.15.195:6791/0 conn(0x7f36c409cd50 legacy=0x7f36c413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 1 -- 172.21.15.181:0/1758115604 >> v1:172.21.15.195:6790/0 conn(0x7f36c413fae0 legacy=0x7f36c4141ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient: _finish_hunting 0 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 1 monclient: found mon.noname-b 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 1 -- 172.21.15.181:0/1758115604 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c40a5ff0 con 0x7f36c4139040 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient: _finish_auth 0 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient: _check_auth_tickets 2024-09-13T10:38:20.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 1 -- 172.21.15.181:0/1758115604 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f36b8001ae0 con 0x7f36c4139040 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient: dump: 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.092 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c9bc3640 5 monclient: authenticate success, global_id 134318 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c9bc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 1 -- 172.21.15.181:0/1758115604 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f36b80048a0 con 0x7f36c4139040 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 1 -- 172.21.15.181:0/1758115604 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f36b8004e10 con 0x7f36c4139040 2024-09-13T10:38:20.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c9bc3640 10 monclient: get_monmap_and_config success 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c9bc3640 4 set_mon_vals no callback set 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.084+0000 7f36c27fc640 10 monclient: dump: 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.094 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.085+0000 7f36c9bc3640 10 monclient: shutdown 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.085+0000 7f36c9bc3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.085+0000 7f36c9bc3640 1 -- 172.21.15.181:0/1758115604 >> v1:172.21.15.181:6790/0 conn(0x7f36c4139040 legacy=0x7f36c40a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.085+0000 7f36c9bc3640 1 -- 172.21.15.181:0/1758115604 shutdown_connections 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.085+0000 7f36c9bc3640 1 -- 172.21.15.181:0/1758115604 >> 172.21.15.181:0/1758115604 conn(0x7f36c4077120 msgr2=0x7f36c40abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.085+0000 7f36c9bc3640 1 -- 172.21.15.181:0/1758115604 shutdown_connections 2024-09-13T10:38:20.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.085+0000 7f36c9bc3640 1 -- 172.21.15.181:0/1758115604 wait complete. 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.085+0000 7f36c9bc3640 10 monclient: build_initial_monmap 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.085+0000 7f36c9bc3640 10 monclient: monmap: 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:20.096 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.085+0000 7f36c9bc3640 1 Processor -- start 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c9bc3640 1 -- start start 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c9bc3640 10 monclient: init 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c9bc3640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c9bc3640 10 monclient: _add_conns ranks=[8,0,6,5,7,2,3,1,4] 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c9bc3640 10 monclient(hunting): picked mon.noname-e con 0x7f36c409cd50 addr v1:172.21.15.181:6793/0 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c9bc3640 10 monclient(hunting): picked mon.noname-a con 0x7f36c4139040 addr v1:172.21.15.181:6789/0 2024-09-13T10:38:20.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c9bc3640 10 monclient(hunting): picked mon.noname-d con 0x7f36c413fae0 addr v1:172.21.15.181:6792/0 2024-09-13T10:38:20.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c9bc3640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c4134bf0 con 0x7f36c4139040 2024-09-13T10:38:20.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c9bc3640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c413a5e0 con 0x7f36c413fae0 2024-09-13T10:38:20.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c9bc3640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c413a8c0 con 0x7f36c409cd50 2024-09-13T10:38:20.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c9bc3640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:20.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c9bc3640 10 monclient(hunting): authenticate will time out at 1239.591704s 2024-09-13T10:38:20.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c37fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f36c409cd50 0x7f36c4133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39786/0 (socket says 172.21.15.181:39786) 2024-09-13T10:38:20.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.086+0000 7f36c37fe640 1 -- 172.21.15.181:0/3566820295 learned_addr learned my addr 172.21.15.181:0/3566820295 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:20.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.088+0000 7f36c37fe640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.181:6793/0 conn(0x7f36c409cd50 legacy=0x7f36c4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.088+0000 7f36c2ffd640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.181:6789/0 conn(0x7f36c4139040 legacy=0x7f36c41344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.088+0000 7f36c3fff640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.181:6792/0 conn(0x7f36c413fae0 legacy=0x7f36c41d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.088+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57030235 0 0) 0x7f36c413a8c0 con 0x7f36c409cd50 2024-09-13T10:38:20.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): my global_id is 105461 2024-09-13T10:38:20.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36b0003520 con 0x7f36c409cd50 2024-09-13T10:38:20.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4234798745 0 0) 0x7f36c4134bf0 con 0x7f36c4139040 2024-09-13T10:38:20.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): my global_id is 115065 2024-09-13T10:38:20.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36c413a8c0 con 0x7f36c4139040 2024-09-13T10:38:20.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3725156704 0 0) 0x7f36c413a5e0 con 0x7f36c413fae0 2024-09-13T10:38:20.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): my global_id is 134268 2024-09-13T10:38:20.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36c4134bf0 con 0x7f36c413fae0 2024-09-13T10:38:20.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2535361962 0 0) 0x7f36b0003520 con 0x7f36c409cd50 2024-09-13T10:38:20.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36c413a5e0 con 0x7f36c409cd50 2024-09-13T10:38:20.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f36b8004d90 con 0x7f36c409cd50 2024-09-13T10:38:20.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:20.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:38:20.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): dump: 2024-09-13T10:38:20.105 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.105 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.105 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.105 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.105 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3356122922 0 0) 0x7f36c413a8c0 con 0x7f36c4139040 2024-09-13T10:38:20.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36b0003520 con 0x7f36c4139040 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1831905245 0 0) 0x7f36c4134bf0 con 0x7f36c413fae0 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36c413a8c0 con 0x7f36c413fae0 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f36b4003610 con 0x7f36c4139040 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): dump: 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.107 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f36bc004780 con 0x7f36c413fae0 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient(hunting): dump: 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.108 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2331163658 0 0) 0x7f36c413a5e0 con 0x7f36c409cd50 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.181:6792/0 conn(0x7f36c413fae0 legacy=0x7f36c41d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.181:6789/0 conn(0x7f36c4139040 legacy=0x7f36c41344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient: _finish_hunting 0 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 monclient: found mon.e 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c413aba0 con 0x7f36c409cd50 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient: _finish_auth 0 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient: _check_auth_tickets 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36c9bc3640 5 monclient: authenticate success, global_id 105461 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36c9bc3640 10 monclient: _renew_subs 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36c9bc3640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:20.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36c9bc3640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f36c41355e0 con 0x7f36c409cd50 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36c9bc3640 10 monclient: _renew_subs 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36c9bc3640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36c9bc3640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f36c4133070 con 0x7f36c409cd50 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f36b8001d30 con 0x7f36c409cd50 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f36b8001b00 con 0x7f36c409cd50 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36abfff640 10 monclient: dump: 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.111 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.089+0000 7f36c1ffb640 4 set_mon_vals no callback set 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.090+0000 7f36c9bc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:20.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.090+0000 7f36c9bc3640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f36c413ade0 con 0x7f36c4137e40 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.090+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f36b8011c20 con 0x7f36c409cd50 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.090+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(254..254 src has 1..254) ==== 3898+0+0 (unknown 2598362606 0 0) 0x7f36b804e350 con 0x7f36c409cd50 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.090+0000 7f36c3fff640 10 monclient: get_auth_request con 0x7f36b00405c0 auth_method 0 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.092+0000 7f36c2ffd640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.195:6789/0 conn(0x7f36c4137e40 legacy=0x7f36c4138220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.092+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2308725443 0 0) 0x7f36c413ade0 con 0x7f36c4137e40 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 10 monclient(hunting): my global_id is 134344 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36c413a5e0 con 0x7f36c4137e40 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4204373358 0 0) 0x7f36c413a5e0 con 0x7f36c4137e40 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36c413ade0 con 0x7f36c4137e40 2024-09-13T10:38:20.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f36b4003e50 con 0x7f36c4137e40 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 10 monclient: dump: 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.114 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3674910980 0 0) 0x7f36c413ade0 con 0x7f36c4137e40 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36c413f150 con 0x7f36c4137e40 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f36b4004160 con 0x7f36c4137e40 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.195:6789/0 conn(0x7f36c4137e40 legacy=0x7f36c4138220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.093+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.195:6789/0 conn(0x7f36c4137e40 legacy=0x7f36c4138220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.099+0000 7f36c9bc3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:38:20.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.099+0000 7f36c9bc3640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f36c406d240 con 0x7f36c402e200 2024-09-13T10:38:20.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36c2ffd640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.195:6789/0 conn(0x7f36c402e200 legacy=0x7f36c4138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124830497 0 0) 0x7f36c406d240 con 0x7f36c402e200 2024-09-13T10:38:20.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 10 monclient(hunting): my global_id is 134353 2024-09-13T10:38:20.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36c413ade0 con 0x7f36c402e200 2024-09-13T10:38:20.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3315477117 0 0) 0x7f36c413ade0 con 0x7f36c402e200 2024-09-13T10:38:20.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36c406d240 con 0x7f36c402e200 2024-09-13T10:38:20.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f36b4005b00 con 0x7f36c402e200 2024-09-13T10:38:20.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 10 monclient: dump: 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.118 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.119 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.119 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.119 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.119 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 986880738 0 0) 0x7f36c406d240 con 0x7f36c402e200 2024-09-13T10:38:20.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.102+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f36c4133360 con 0x7f36c402e200 2024-09-13T10:38:20.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7548 (unknown 0 0 3115117500) 0x7f36b4005e70 con 0x7f36c402e200 2024-09-13T10:38:20.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36abfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:38:20.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36abfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:38:20.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.195:6789/0 conn(0x7f36c402e200 legacy=0x7f36c4138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36abfff640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.195:6789/0 conn(0x7f36c402e200 legacy=0x7f36c4138930 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:20.120 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:38:20.120 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:38:20.120 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:38:20.120 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:38:20.120 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 126, 2024-09-13T10:38:20.120 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 32131, 2024-09-13T10:38:20.120 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:38:20.120 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:38:20.120 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:38:20.120 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:38:20.120 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:38:20.120 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:20.121 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:20.122 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:38:20.123 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:38:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:38:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:38:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:38:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:38:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:38:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:38:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:38:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:38:20.124 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.125 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:38:20.126 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:38:20.127 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.128 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.128 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.128 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:38:20.128 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:38:20.128 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.128 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.129 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.129 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:38:20.129 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:38:20.129 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.129 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.129 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.129 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:38:20.129 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.129 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:38:20.132 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.133 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.134 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:38:20.136 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:38:20.137 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:38:20.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.139 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:38:20.140 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:38:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36c9bc3640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.195:6800/1839191919 conn(0x7f36b00405c0 legacy=0x7f36b0042a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36c9bc3640 10 monclient: shutdown 2024-09-13T10:38:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36c9bc3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36c9bc3640 1 -- 172.21.15.181:0/3566820295 >> v1:172.21.15.181:6793/0 conn(0x7f36c409cd50 legacy=0x7f36c4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36c3fff640 1 -- 172.21.15.181:0/3566820295 reap_dead start 2024-09-13T10:38:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36c9bc3640 1 -- 172.21.15.181:0/3566820295 shutdown_connections 2024-09-13T10:38:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36c9bc3640 1 -- 172.21.15.181:0/3566820295 >> 172.21.15.181:0/3566820295 conn(0x7f36c4077120 msgr2=0x7f36c40a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36c9bc3640 1 -- 172.21.15.181:0/3566820295 shutdown_connections 2024-09-13T10:38:20.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.103+0000 7f36c9bc3640 1 -- 172.21.15.181:0/3566820295 wait complete. 2024-09-13T10:38:20.142 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:38:20.142 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-09-13T10:38:20.142 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:38:20.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.239+0000 7f6af71ab640 10 monclient: get_monmap_and_config 2024-09-13T10:38:20.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.239+0000 7f6af71ab640 10 monclient: build_initial_monmap 2024-09-13T10:38:20.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.239+0000 7f6af71ab640 10 monclient: monmap: 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:38:20.239778+0000 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:38:20.239778+0000 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:20.241 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:20.242 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:20.242 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.239+0000 7f6af71ab640 1 Processor -- start 2024-09-13T10:38:20.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.239+0000 7f6af71ab640 1 -- start start 2024-09-13T10:38:20.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.239+0000 7f6af71ab640 10 monclient: init 2024-09-13T10:38:20.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6af71ab640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:20.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6af71ab640 10 monclient: _add_conns ranks=[4,3,1,5,2,6,0,7,8] 2024-09-13T10:38:20.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6af71ab640 10 monclient(hunting): picked mon.noname-c con 0x7f6af00a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:38:20.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6af71ab640 10 monclient(hunting): picked mon.noname-g con 0x7f6af00a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:38:20.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6af71ab640 10 monclient(hunting): picked mon.noname-f con 0x7f6af013f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:38:20.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6af71ab640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af00a5fe0 con 0x7f6af013f9a0 2024-09-13T10:38:20.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6af71ab640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af00a8080 con 0x7f6af00a6ab0 2024-09-13T10:38:20.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6af71ab640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af00a42c0 con 0x7f6af00a66d0 2024-09-13T10:38:20.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6af71ab640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:20.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6af71ab640 10 monclient(hunting): authenticate will time out at 1239.745431s 2024-09-13T10:38:20.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6aeffff640 1 -- >> v1:172.21.15.195:6790/0 conn(0x7f6af00a6ab0 legacy=0x7f6af00a6ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:38:20.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6af4f47640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f6af00a66d0 0x7f6af00a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38892/0 (socket says 172.21.15.181:38892) 2024-09-13T10:38:20.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.240+0000 7f6af4f47640 1 -- 172.21.15.181:0/1864883215 learned_addr learned my addr 172.21.15.181:0/1864883215 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:20.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.242+0000 7f6af4f47640 1 -- 172.21.15.181:0/1864883215 >> v1:172.21.15.181:6791/0 conn(0x7f6af00a66d0 legacy=0x7f6af00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.242+0000 7f6aef7fe640 1 -- 172.21.15.181:0/1864883215 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404717015 0 0) 0x7f6af00a42c0 con 0x7f6af00a66d0 2024-09-13T10:38:20.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.242+0000 7f6aef7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.242+0000 7f6aef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.242+0000 7f6aef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.242+0000 7f6aef7fe640 10 monclient(hunting): my global_id is 115105 2024-09-13T10:38:20.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.242+0000 7f6aef7fe640 1 -- 172.21.15.181:0/1864883215 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ae0003520 con 0x7f6af00a66d0 2024-09-13T10:38:20.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.242+0000 7f6af5748640 1 -- 172.21.15.181:0/1864883215 >> v1:172.21.15.195:6789/0 conn(0x7f6af013f9a0 legacy=0x7f6af0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 1 -- 172.21.15.181:0/1864883215 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1621649646 0 0) 0x7f6ae0003520 con 0x7f6af00a66d0 2024-09-13T10:38:20.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 1 -- 172.21.15.181:0/1864883215 >> v1:172.21.15.195:6790/0 conn(0x7f6af00a6ab0 legacy=0x7f6af00a6ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:38:20.248 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 1 -- 172.21.15.181:0/1864883215 >> v1:172.21.15.195:6789/0 conn(0x7f6af013f9a0 legacy=0x7f6af0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 1 monclient: found mon.noname-c 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 1 -- 172.21.15.181:0/1864883215 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af01464e0 con 0x7f6af00a66d0 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 10 monclient: _finish_auth 0 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 1 -- 172.21.15.181:0/1864883215 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6ae4001ad0 con 0x7f6af00a66d0 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6af71ab640 5 monclient: authenticate success, global_id 115105 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6af71ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 10 monclient: dump: 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.250 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6af71ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 1 -- 172.21.15.181:0/1864883215 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ae40048a0 con 0x7f6af00a66d0 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 1 -- 172.21.15.181:0/1864883215 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6ae4004e10 con 0x7f6af00a66d0 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6af71ab640 10 monclient: get_monmap_and_config success 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6af71ab640 4 set_mon_vals no callback set 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6aef7fe640 10 monclient: dump: 2024-09-13T10:38:20.251 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.252 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6af71ab640 10 monclient: shutdown 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6af71ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6af71ab640 1 -- 172.21.15.181:0/1864883215 >> v1:172.21.15.181:6791/0 conn(0x7f6af00a66d0 legacy=0x7f6af00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6af71ab640 1 -- 172.21.15.181:0/1864883215 shutdown_connections 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6af71ab640 1 -- 172.21.15.181:0/1864883215 >> 172.21.15.181:0/1864883215 conn(0x7f6af00abcd0 msgr2=0x7f6af00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6af71ab640 1 -- 172.21.15.181:0/1864883215 shutdown_connections 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.243+0000 7f6af71ab640 1 -- 172.21.15.181:0/1864883215 wait complete. 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.244+0000 7f6af71ab640 10 monclient: build_initial_monmap 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.244+0000 7f6af71ab640 10 monclient: monmap: 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:20.253 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:20.254 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.244+0000 7f6af71ab640 1 Processor -- start 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.244+0000 7f6af71ab640 1 -- start start 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.244+0000 7f6af71ab640 10 monclient: init 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6af71ab640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6af71ab640 10 monclient: _add_conns ranks=[1,3,8,5,2,7,6,4,0] 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6af71ab640 10 monclient(hunting): picked mon.noname-f con 0x7f6af00a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6af71ab640 10 monclient(hunting): picked mon.noname-g con 0x7f6af00a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6af71ab640 10 monclient(hunting): picked mon.noname-e con 0x7f6af013f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6af71ab640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af013ea30 con 0x7f6af00a66d0 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6af71ab640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af0068be0 con 0x7f6af00a6ab0 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6af71ab640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af013f2d0 con 0x7f6af013f9a0 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6af71ab640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6af71ab640 10 monclient(hunting): authenticate will time out at 1239.750356s 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6aeffff640 1 -- >> v1:172.21.15.195:6790/0 conn(0x7f6af00a6ab0 legacy=0x7f6af013bfa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:38:20.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6af5748640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f6af013f9a0 0x7f6af01d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39792/0 (socket says 172.21.15.181:39792) 2024-09-13T10:38:20.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.245+0000 7f6af5748640 1 -- 172.21.15.181:0/3191890734 learned_addr learned my addr 172.21.15.181:0/3191890734 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:20.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6af5748640 1 -- 172.21.15.181:0/3191890734 >> v1:172.21.15.181:6793/0 conn(0x7f6af013f9a0 legacy=0x7f6af01d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1413366104 0 0) 0x7f6af013f2d0 con 0x7f6af013f9a0 2024-09-13T10:38:20.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 10 monclient(hunting): my global_id is 105470 2024-09-13T10:38:20.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad4003520 con 0x7f6af013f9a0 2024-09-13T10:38:20.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6af4f47640 1 -- 172.21.15.181:0/3191890734 >> v1:172.21.15.195:6789/0 conn(0x7f6af00a66d0 legacy=0x7f6af013b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2964581191 0 0) 0x7f6ad4003520 con 0x7f6af013f9a0 2024-09-13T10:38:20.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6af013f2d0 con 0x7f6af013f9a0 2024-09-13T10:38:20.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6ae8003990 con 0x7f6af013f9a0 2024-09-13T10:38:20.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:20.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:38:20.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 10 monclient(hunting): dump: 2024-09-13T10:38:20.260 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.261 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.247+0000 7f6aed7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2988020043 0 0) 0x7f6af01464e0 con 0x7f6af00a66d0 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 10 monclient(hunting): my global_id is 134371 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad4003520 con 0x7f6af00a66d0 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3874272109 0 0) 0x7f6af013f2d0 con 0x7f6af013f9a0 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 >> v1:172.21.15.195:6790/0 conn(0x7f6af00a6ab0 legacy=0x7f6af013bfa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 >> v1:172.21.15.195:6789/0 conn(0x7f6af00a66d0 legacy=0x7f6af013b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 1 monclient: found mon.e 2024-09-13T10:38:20.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af00a2450 con 0x7f6af013f9a0 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 10 monclient: _finish_auth 0 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6af71ab640 5 monclient: authenticate success, global_id 105470 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6af71ab640 10 monclient: _renew_subs 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6af71ab640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6af71ab640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6af013dad0 con 0x7f6af013f9a0 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6af71ab640 10 monclient: _renew_subs 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6af71ab640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6af71ab640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f6af013c6b0 con 0x7f6af013f9a0 2024-09-13T10:38:20.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ae8003ed0 con 0x7f6af013f9a0 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6ae8004400 con 0x7f6af013f9a0 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aeeffd640 4 set_mon_vals no callback set 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6aed7fa640 10 monclient: dump: 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.264 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6af71ab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.248+0000 7f6af71ab640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6ad00065c0 con 0x7f6ad0002860 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.249+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6ae80045a0 con 0x7f6af013f9a0 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.249+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(254..254 src has 1..254) ==== 3898+0+0 (unknown 2598362606 0 0) 0x7f6ae804e6a0 con 0x7f6af013f9a0 2024-09-13T10:38:20.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.249+0000 7f6aeffff640 10 monclient: get_auth_request con 0x7f6ad403fad0 auth_method 0 2024-09-13T10:38:20.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6af4f47640 1 -- 172.21.15.181:0/3191890734 >> v1:172.21.15.195:6791/0 conn(0x7f6ad0002860 legacy=0x7f6ad0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1701339473 0 0) 0x7f6ad00065c0 con 0x7f6ad0002860 2024-09-13T10:38:20.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 10 monclient(hunting): my global_id is 105242 2024-09-13T10:38:20.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6af013f2d0 con 0x7f6ad0002860 2024-09-13T10:38:20.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 808473854 0 0) 0x7f6af013f2d0 con 0x7f6ad0002860 2024-09-13T10:38:20.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ad00065c0 con 0x7f6ad0002860 2024-09-13T10:38:20.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6ae4004be0 con 0x7f6ad0002860 2024-09-13T10:38:20.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 10 monclient: dump: 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.267 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3670071925 0 0) 0x7f6ad00065c0 con 0x7f6ad0002860 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.251+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ad000a160 con 0x7f6ad0002860 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.252+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6ae4001d20 con 0x7f6ad0002860 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.252+0000 7f6aed7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.252+0000 7f6aed7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.252+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 >> v1:172.21.15.195:6791/0 conn(0x7f6ad0002860 legacy=0x7f6ad0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.252+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 >> v1:172.21.15.195:6791/0 conn(0x7f6ad0002860 legacy=0x7f6ad0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:20.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.258+0000 7f6af71ab640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:38:20.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.258+0000 7f6af71ab640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6ad0009e70 con 0x7f6ad0009130 2024-09-13T10:38:20.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.260+0000 7f6af4f47640 1 -- 172.21.15.181:0/3191890734 >> v1:172.21.15.195:6791/0 conn(0x7f6ad0009130 legacy=0x7f6ad00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.260+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163690531 0 0) 0x7f6ad0009e70 con 0x7f6ad0009130 2024-09-13T10:38:20.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.260+0000 7f6aed7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.260+0000 7f6aed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.260+0000 7f6aed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.260+0000 7f6aed7fa640 10 monclient(hunting): my global_id is 105251 2024-09-13T10:38:20.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.260+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad00065c0 con 0x7f6ad0009130 2024-09-13T10:38:20.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2128670545 0 0) 0x7f6ad00065c0 con 0x7f6ad0009130 2024-09-13T10:38:20.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ad0009e70 con 0x7f6ad0009130 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6ae4005490 con 0x7f6ad0009130 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 10 monclient: dump: 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.271 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2065883997 0 0) 0x7f6ad0009e70 con 0x7f6ad0009130 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6ad000c410 con 0x7f6ad0009130 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7716 (unknown 0 0 1233997214) 0x7f6ae4007e30 con 0x7f6ad0009130 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 >> v1:172.21.15.195:6791/0 conn(0x7f6ad0009130 legacy=0x7f6ad00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6aed7fa640 1 -- 172.21.15.181:0/3191890734 >> v1:172.21.15.195:6791/0 conn(0x7f6ad0009130 legacy=0x7f6ad00095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:20.273 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:38:20.273 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:38:20.273 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:38:20.273 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:38:20.273 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 126, 2024-09-13T10:38:20.273 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 183961, 2024-09-13T10:38:20.273 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:38:20.273 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:38:20.273 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:38:20.273 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:20.274 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:20.275 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:38:20.276 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:38:20.277 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:38:20.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:38:20.281 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:38:20.283 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.284 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.284 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.284 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:38:20.284 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:38:20.284 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.284 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.284 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.284 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:38:20.285 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.285 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.285 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.285 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:38:20.285 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:38:20.285 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.287 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:38:20.288 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.289 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:20.291 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:20.292 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:20.293 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:38:20.293 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.293 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.293 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:38:20.293 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:38:20.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6af71ab640 1 -- 172.21.15.181:0/3191890734 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6ad403fad0 legacy=0x7f6ad4041f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6af71ab640 10 monclient: shutdown 2024-09-13T10:38:20.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6af71ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:20.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6af71ab640 1 -- 172.21.15.181:0/3191890734 >> v1:172.21.15.181:6793/0 conn(0x7f6af013f9a0 legacy=0x7f6af01d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6af5748640 1 -- 172.21.15.181:0/3191890734 reap_dead start 2024-09-13T10:38:20.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6af5748640 1 -- 172.21.15.181:0/3191890734 reap_dead start 2024-09-13T10:38:20.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6af71ab640 1 -- 172.21.15.181:0/3191890734 shutdown_connections 2024-09-13T10:38:20.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.261+0000 7f6af71ab640 1 -- 172.21.15.181:0/3191890734 >> 172.21.15.181:0/3191890734 conn(0x7f6af00abcd0 msgr2=0x7f6af00a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:20.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.262+0000 7f6af71ab640 1 -- 172.21.15.181:0/3191890734 shutdown_connections 2024-09-13T10:38:20.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.262+0000 7f6af71ab640 1 -- 172.21.15.181:0/3191890734 wait complete. 2024-09-13T10:38:20.295 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:38:20.295 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-09-13T10:38:20.296 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:38:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.392+0000 7fe61c517640 10 monclient: get_monmap_and_config 2024-09-13T10:38:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.392+0000 7fe61c517640 10 monclient: build_initial_monmap 2024-09-13T10:38:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.392+0000 7fe61c517640 10 monclient: monmap: 2024-09-13T10:38:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:38:20.393310+0000 2024-09-13T10:38:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:38:20.393310+0000 2024-09-13T10:38:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.394 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:20.395 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:20.395 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:20.395 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:20.395 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:20.395 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:20.395 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:20.395 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:20.395 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:20.395 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 1 Processor -- start 2024-09-13T10:38:20.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 1 -- start start 2024-09-13T10:38:20.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 10 monclient: init 2024-09-13T10:38:20.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:20.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 10 monclient: _add_conns ranks=[7,4,5,2,6,8,0,1,3] 2024-09-13T10:38:20.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 10 monclient(hunting): picked mon.noname-i con 0x7fe6140a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:38:20.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 10 monclient(hunting): picked mon.noname-c con 0x7fe6140a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:38:20.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 10 monclient(hunting): picked mon.noname-h con 0x7fe61413f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:38:20.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6140a4bc0 con 0x7fe6140a8340 2024-09-13T10:38:20.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe61413a320 con 0x7fe61413f750 2024-09-13T10:38:20.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6140a8100 con 0x7fe6140a6640 2024-09-13T10:38:20.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:20.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.393+0000 7fe61c517640 10 monclient(hunting): authenticate will time out at 1239.898980s 2024-09-13T10:38:20.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.394+0000 7fe619ab2640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fe6140a8340 0x7fe614139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:38902/0 (socket says 172.21.15.181:38902) 2024-09-13T10:38:20.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.394+0000 7fe619ab2640 1 -- 172.21.15.181:0/207057542 learned_addr learned my addr 172.21.15.181:0/207057542 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:20.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe619ab2640 1 -- 172.21.15.181:0/207057542 >> v1:172.21.15.181:6791/0 conn(0x7fe6140a8340 legacy=0x7fe614139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe61aab4640 1 -- 172.21.15.181:0/207057542 >> v1:172.21.15.195:6791/0 conn(0x7fe61413f750 legacy=0x7fe614141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe61a2b3640 1 -- 172.21.15.181:0/207057542 >> v1:172.21.15.195:6792/0 conn(0x7fe6140a6640 legacy=0x7fe614139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283995761 0 0) 0x7fe6140a4bc0 con 0x7fe6140a8340 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient(hunting): my global_id is 115114 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe600003520 con 0x7fe6140a8340 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3877147331 0 0) 0x7fe61413a320 con 0x7fe61413f750 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient(hunting): my global_id is 105260 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6140a4bc0 con 0x7fe61413f750 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3874765054 0 0) 0x7fe6140a8100 con 0x7fe6140a6640 2024-09-13T10:38:20.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient(hunting): my global_id is 57292 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe61413a320 con 0x7fe6140a6640 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1824877915 0 0) 0x7fe600003520 con 0x7fe6140a8340 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 >> v1:172.21.15.195:6792/0 conn(0x7fe6140a6640 legacy=0x7fe614139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 >> v1:172.21.15.195:6791/0 conn(0x7fe61413f750 legacy=0x7fe614141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient: _finish_hunting 0 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 monclient: found mon.noname-c 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6140a48e0 con 0x7fe6140a8340 2024-09-13T10:38:20.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient: _finish_auth 0 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient: _check_auth_tickets 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe604001ae0 con 0x7fe6140a8340 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe61c517640 5 monclient: authenticate success, global_id 115114 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe61c517640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient: dump: 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.407 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe61c517640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6040048a0 con 0x7fe6140a8340 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 1 -- 172.21.15.181:0/207057542 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe604004e10 con 0x7fe6140a8340 2024-09-13T10:38:20.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe61c517640 10 monclient: get_monmap_and_config success 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe61c517640 4 set_mon_vals no callback set 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.396+0000 7fe6192b1640 10 monclient: dump: 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.409 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.397+0000 7fe61c517640 10 monclient: shutdown 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.397+0000 7fe61c517640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.397+0000 7fe61c517640 1 -- 172.21.15.181:0/207057542 >> v1:172.21.15.181:6791/0 conn(0x7fe6140a8340 legacy=0x7fe614139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.397+0000 7fe61c517640 1 -- 172.21.15.181:0/207057542 shutdown_connections 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.397+0000 7fe61c517640 1 -- 172.21.15.181:0/207057542 >> 172.21.15.181:0/207057542 conn(0x7fe614077170 msgr2=0x7fe6140abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.397+0000 7fe61c517640 1 -- 172.21.15.181:0/207057542 shutdown_connections 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.397+0000 7fe61c517640 1 -- 172.21.15.181:0/207057542 wait complete. 2024-09-13T10:38:20.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.397+0000 7fe61c517640 10 monclient: build_initial_monmap 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.397+0000 7fe61c517640 10 monclient: monmap: 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:20.411 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 1 Processor -- start 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 1 -- start start 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 10 monclient: init 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 10 monclient: _add_conns ranks=[8,0,7,3,5,2,1,6,4] 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 10 monclient(hunting): picked mon.noname-e con 0x7fe6140a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 10 monclient(hunting): picked mon.noname-a con 0x7fe61413f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 10 monclient(hunting): picked mon.noname-i con 0x7fe614142030 addr v1:172.21.15.195:6792/0 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6140a9c40 con 0x7fe61413f750 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe614142a00 con 0x7fe614142030 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe61413bb70 con 0x7fe6140a8340 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:20.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61c517640 10 monclient(hunting): authenticate will time out at 1239.903779s 2024-09-13T10:38:20.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61a2b3640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fe6140a8340 0x7fe6141ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:39798/0 (socket says 172.21.15.181:39798) 2024-09-13T10:38:20.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.398+0000 7fe61a2b3640 1 -- 172.21.15.181:0/4108034085 learned_addr learned my addr 172.21.15.181:0/4108034085 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:20.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.400+0000 7fe619ab2640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.181:6789/0 conn(0x7fe61413f750 legacy=0x7fe6141d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.400+0000 7fe61a2b3640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.181:6793/0 conn(0x7fe6140a8340 legacy=0x7fe6141ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe61a2b3640 1 --1- 172.21.15.181:0/4108034085 >> v1:172.21.15.181:6793/0 conn(0x7fe6140a8340 0x7fe6141ce540 :-1 s=OPENED pgs=600 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fe61413bb70 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:38:20.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 703659521 0 0) 0x7fe6140a9c40 con 0x7fe61413f750 2024-09-13T10:38:20.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient(hunting): my global_id is 115074 2024-09-13T10:38:20.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5f8003550 con 0x7fe61413f750 2024-09-13T10:38:20.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe61aab4640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.195:6792/0 conn(0x7fe614142030 legacy=0x7fe6141d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 497571584 0 0) 0x7fe5f8003550 con 0x7fe61413f750 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6140a9c40 con 0x7fe61413f750 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe604004d90 con 0x7fe61413f750 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient(hunting): dump: 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.414 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794456777 0 0) 0x7fe614142a00 con 0x7fe614142030 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient(hunting): my global_id is 57301 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5f8003550 con 0x7fe614142030 2024-09-13T10:38:20.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3207494826 0 0) 0x7fe6140a9c40 con 0x7fe61413f750 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.181:6793/0 conn(0x7fe6140a8340 legacy=0x7fe6141ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.195:6792/0 conn(0x7fe614142030 legacy=0x7fe6141d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient: _finish_hunting 0 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 monclient: found mon.a 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61413b840 con 0x7fe61413f750 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient: _finish_auth 0 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient: _check_auth_tickets 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe61c517640 5 monclient: authenticate success, global_id 115074 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 384815925 0 0) 0x7fe61413bb70 con 0x7fe6140a8340 2024-09-13T10:38:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe61c517640 10 monclient: _renew_subs 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe61c517640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe61c517640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe61413cdf0 con 0x7fe61413f750 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe61c517640 10 monclient: _renew_subs 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe61c517640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe61c517640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe6141cec50 con 0x7fe61413f750 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe604001d30 con 0x7fe61413f750 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe604005740 con 0x7fe61413f750 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe60affd640 10 monclient: dump: 2024-09-13T10:38:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.418 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.401+0000 7fe618ab0640 4 set_mon_vals no callback set 2024-09-13T10:38:20.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.402+0000 7fe61c517640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:20.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.402+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe604011dc0 con 0x7fe61413f750 2024-09-13T10:38:20.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.402+0000 7fe61c517640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe61413bd90 con 0x7fe614077170 2024-09-13T10:38:20.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.402+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(254..254 src has 1..254) ==== 3898+0+0 (unknown 2598362606 0 0) 0x7fe60404e370 con 0x7fe61413f750 2024-09-13T10:38:20.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.402+0000 7fe61aab4640 10 monclient: get_auth_request con 0x7fe5f803fa30 auth_method 0 2024-09-13T10:38:20.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.404+0000 7fe61a2b3640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.195:6792/0 conn(0x7fe614077170 legacy=0x7fe61412d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.404+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1580659347 0 0) 0x7fe61413bd90 con 0x7fe614077170 2024-09-13T10:38:20.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.404+0000 7fe60affd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.404+0000 7fe60affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.404+0000 7fe60affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.404+0000 7fe60affd640 10 monclient(hunting): my global_id is 57310 2024-09-13T10:38:20.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.404+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe61413bb70 con 0x7fe614077170 2024-09-13T10:38:20.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 177613073 0 0) 0x7fe61413bb70 con 0x7fe614077170 2024-09-13T10:38:20.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe61413bd90 con 0x7fe614077170 2024-09-13T10:38:20.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe610001d20 con 0x7fe614077170 2024-09-13T10:38:20.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:38:20.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 10 monclient: dump: 2024-09-13T10:38:20.425 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.426 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3870372996 0 0) 0x7fe61413bd90 con 0x7fe614077170 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6141cefe0 con 0x7fe614077170 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe6100057c0 con 0x7fe614077170 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.195:6792/0 conn(0x7fe614077170 legacy=0x7fe61412d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.405+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.195:6792/0 conn(0x7fe614077170 legacy=0x7fe61412d540 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.411+0000 7fe61c517640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.411+0000 7fe61c517640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe614143260 con 0x7fe614069b40 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe61a2b3640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.195:6792/0 conn(0x7fe614069b40 legacy=0x7fe61412dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115223008 0 0) 0x7fe614143260 con 0x7fe614069b40 2024-09-13T10:38:20.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 10 monclient(hunting): _negotiate 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 10 monclient(hunting): my global_id is 57319 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe61413bd90 con 0x7fe614069b40 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1461252794 0 0) 0x7fe61413bd90 con 0x7fe614069b40 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe614143260 con 0x7fe614069b40 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe610003df0 con 0x7fe614069b40 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 10 monclient: dump: 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:20.428 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:38:20.429 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:20.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3646143790 0 0) 0x7fe614143260 con 0x7fe614069b40 2024-09-13T10:38:20.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.414+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe61412e360 con 0x7fe614069b40 2024-09-13T10:38:20.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7718 (unknown 0 0 3887958988) 0x7fe610004100 con 0x7fe614069b40 2024-09-13T10:38:20.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe60affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:38:20.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe60affd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:38:20.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.195:6792/0 conn(0x7fe614069b40 legacy=0x7fe61412dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe60affd640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.195:6792/0 conn(0x7fe614069b40 legacy=0x7fe61412dc50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:38:20.430 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:38:20.430 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:38:20.430 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 126, 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 514834, 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:38:20.431 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:20.432 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:20.433 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:38:20.434 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:38:20.435 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:38:20.436 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.439 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:38:20.440 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.441 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.444 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:38:20.446 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:38:20.447 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:38:20.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:38:20.449 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:38:20.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:38:20.450 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:38:20.450 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:38:20.450 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4 2024-09-13T10:38:20.450 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:38:20.450 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:38:20.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:38:20.450 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:38:20.450 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:38:20.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe61c517640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.195:6800/1839191919 conn(0x7fe5f803fa30 legacy=0x7fe5f8041ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe61c517640 10 monclient: shutdown 2024-09-13T10:38:20.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe61c517640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:38:20.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe61c517640 1 -- 172.21.15.181:0/4108034085 >> v1:172.21.15.181:6789/0 conn(0x7fe61413f750 legacy=0x7fe6141d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:20.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe61aab4640 1 -- 172.21.15.181:0/4108034085 reap_dead start 2024-09-13T10:38:20.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe61aab4640 1 -- 172.21.15.181:0/4108034085 reap_dead start 2024-09-13T10:38:20.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe61c517640 1 -- 172.21.15.181:0/4108034085 shutdown_connections 2024-09-13T10:38:20.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe61c517640 1 -- 172.21.15.181:0/4108034085 >> 172.21.15.181:0/4108034085 conn(0x7fe6140a6640 msgr2=0x7fe6140a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:38:20.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe61c517640 1 -- 172.21.15.181:0/4108034085 shutdown_connections 2024-09-13T10:38:20.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:20.415+0000 7fe61c517640 1 -- 172.21.15.181:0/4108034085 wait complete. 2024-09-13T10:38:20.453 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-13T10:38:20.453 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T10:38:21.095 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:21.095 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39822]: starting. 2024-09-13T10:38:21.095 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39822]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39785 2024-09-13T10:38:21.096 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39822]: created object 0... 2024-09-13T10:38:21.096 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39822]: created object 25... 2024-09-13T10:38:21.096 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39822]: created object 49... 2024-09-13T10:38:21.096 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39822]: finishing. 2024-09-13T10:38:21.096 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39822]: shutting down. 2024-09-13T10:38:21.314 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:21.314 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39824]: starting. 2024-09-13T10:38:21.314 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39824]: listing objects. 2024-09-13T10:38:21.314 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39824]: listed object 0... 2024-09-13T10:38:21.315 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39824]: listed object 25... 2024-09-13T10:38:21.315 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39824]: saw 50 objects 2024-09-13T10:38:21.315 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39824]: shutting down. 2024-09-13T10:38:21.997 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:21.997 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39823]: starting. 2024-09-13T10:38:21.997 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39823]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39785 2024-09-13T10:38:21.997 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39823]: shutting down. 2024-09-13T10:38:21.998 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:21.998 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:21.998 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:38:22.001 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:38:24.137 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39893]: starting. 2024-09-13T10:38:24.137 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39893]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39892 2024-09-13T10:38:24.138 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39893]: created object 0... 2024-09-13T10:38:24.138 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39893]: created object 25... 2024-09-13T10:38:24.138 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39893]: created object 49... 2024-09-13T10:38:24.138 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39893]: finishing. 2024-09-13T10:38:24.138 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[39893]: shutting down. 2024-09-13T10:38:25.029 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39894]: starting. 2024-09-13T10:38:25.029 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39894]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39892 2024-09-13T10:38:25.029 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[39894]: shutting down. 2024-09-13T10:38:26.174 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:26.174 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39929]: starting. 2024-09-13T10:38:26.174 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39929]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39892 2024-09-13T10:38:26.174 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39929]: created object 0... 2024-09-13T10:38:26.174 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39929]: created object 25... 2024-09-13T10:38:26.174 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39929]: created object 49... 2024-09-13T10:38:26.174 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39929]: finishing. 2024-09-13T10:38:26.174 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[39929]: shutting down. 2024-09-13T10:38:26.211 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:26.211 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39931]: starting. 2024-09-13T10:38:26.211 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39931]: listing objects. 2024-09-13T10:38:26.211 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39931]: listed object 0... 2024-09-13T10:38:26.211 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39931]: listed object 25... 2024-09-13T10:38:26.211 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39931]: saw 50 objects 2024-09-13T10:38:26.211 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[39931]: shutting down. 2024-09-13T10:38:27.074 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:27.074 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39930]: starting. 2024-09-13T10:38:27.074 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39930]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39892 2024-09-13T10:38:27.074 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[39930]: shutting down. 2024-09-13T10:38:27.075 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:27.075 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:27.075 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:38:27.078 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:38:30.143 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40000]: starting. 2024-09-13T10:38:30.144 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40000]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39999 2024-09-13T10:38:30.144 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40000]: created object 0... 2024-09-13T10:38:30.144 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40000]: created object 25... 2024-09-13T10:38:30.144 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40000]: created object 49... 2024-09-13T10:38:30.144 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40000]: finishing. 2024-09-13T10:38:30.144 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40000]: shutting down. 2024-09-13T10:38:31.037 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40001]: starting. 2024-09-13T10:38:31.038 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40001]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39999 2024-09-13T10:38:31.038 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40001]: shutting down. 2024-09-13T10:38:33.607 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:33.608 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40036]: starting. 2024-09-13T10:38:33.608 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40036]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-39999 2024-09-13T10:38:33.608 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40036]: created object 0... 2024-09-13T10:38:33.608 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40036]: created object 25... 2024-09-13T10:38:33.608 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40036]: created object 49... 2024-09-13T10:38:33.608 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40036]: finishing. 2024-09-13T10:38:33.608 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40036]: shutting down. 2024-09-13T10:38:33.644 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:33.644 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40038]: starting. 2024-09-13T10:38:33.644 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40038]: listing objects. 2024-09-13T10:38:33.645 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40038]: listed object 0... 2024-09-13T10:38:33.645 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40038]: listed object 25... 2024-09-13T10:38:33.645 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40038]: saw 50 objects 2024-09-13T10:38:33.645 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40038]: shutting down. 2024-09-13T10:38:35.080 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:35.080 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40037]: starting. 2024-09-13T10:38:35.080 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40037]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-39999 2024-09-13T10:38:35.080 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40037]: shutting down. 2024-09-13T10:38:35.082 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:35.082 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:35.082 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:38:35.084 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:38:37.180 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40107]: starting. 2024-09-13T10:38:37.180 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40107]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40106 2024-09-13T10:38:37.180 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40107]: created object 0... 2024-09-13T10:38:37.180 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40107]: created object 25... 2024-09-13T10:38:37.180 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40107]: created object 49... 2024-09-13T10:38:37.181 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40107]: finishing. 2024-09-13T10:38:37.181 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40107]: shutting down. 2024-09-13T10:38:38.083 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40108]: starting. 2024-09-13T10:38:38.084 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40108]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40106 2024-09-13T10:38:38.084 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40108]: shutting down. 2024-09-13T10:38:40.195 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:40.195 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40143]: starting. 2024-09-13T10:38:40.195 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40143]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40106 2024-09-13T10:38:40.195 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40143]: created object 0... 2024-09-13T10:38:40.196 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40143]: created object 25... 2024-09-13T10:38:40.196 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40143]: created object 49... 2024-09-13T10:38:40.196 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40143]: finishing. 2024-09-13T10:38:40.196 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40143]: shutting down. 2024-09-13T10:38:40.232 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:40.232 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40145]: starting. 2024-09-13T10:38:40.232 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40145]: listing objects. 2024-09-13T10:38:40.232 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40145]: listed object 0... 2024-09-13T10:38:40.232 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40145]: listed object 25... 2024-09-13T10:38:40.232 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40145]: saw 50 objects 2024-09-13T10:38:40.232 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40145]: shutting down. 2024-09-13T10:38:40.454 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2024-09-13T10:38:40.454 INFO:tasks.ceph.mon.g:Restarting daemon 2024-09-13T10:38:40.455 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-09-13T10:38:40.457 INFO:tasks.ceph.mon.g:Started 2024-09-13T10:38:40.457 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-09-13T10:38:40.458 INFO:tasks.ceph.mon.c:Sent signal 19 2024-09-13T10:38:40.458 INFO:tasks.mon_thrash:Sending STOP to mon e 2024-09-13T10:38:40.458 INFO:tasks.ceph.mon.e:Sent signal 19 2024-09-13T10:38:40.458 INFO:tasks.mon_thrash:Sending STOP to mon f 2024-09-13T10:38:40.459 INFO:tasks.ceph.mon.f:Sent signal 19 2024-09-13T10:38:40.459 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-13T10:38:46.148 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:46.148 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40144]: starting. 2024-09-13T10:38:46.149 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40144]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40106 2024-09-13T10:38:46.149 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40144]: shutting down. 2024-09-13T10:38:46.150 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:46.150 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:46.150 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:38:46.153 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:38:48.348 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40273]: starting. 2024-09-13T10:38:48.348 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40273]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40272 2024-09-13T10:38:48.348 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40273]: created object 0... 2024-09-13T10:38:48.348 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40273]: created object 25... 2024-09-13T10:38:48.348 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40273]: created object 49... 2024-09-13T10:38:48.348 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40273]: finishing. 2024-09-13T10:38:48.348 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40273]: shutting down. 2024-09-13T10:38:49.225 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40274]: starting. 2024-09-13T10:38:49.225 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40274]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40272 2024-09-13T10:38:49.225 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40274]: shutting down. 2024-09-13T10:38:52.673 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:52.673 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40309]: starting. 2024-09-13T10:38:52.673 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40309]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40272 2024-09-13T10:38:52.673 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40309]: created object 0... 2024-09-13T10:38:52.673 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40309]: created object 25... 2024-09-13T10:38:52.673 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40309]: created object 49... 2024-09-13T10:38:52.673 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40309]: finishing. 2024-09-13T10:38:52.674 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40309]: shutting down. 2024-09-13T10:38:52.895 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:52.896 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40311]: starting. 2024-09-13T10:38:52.896 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40311]: listing objects. 2024-09-13T10:38:52.896 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40311]: listed object 0... 2024-09-13T10:38:52.896 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40311]: listed object 25... 2024-09-13T10:38:52.896 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40311]: saw 50 objects 2024-09-13T10:38:52.896 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40311]: shutting down. 2024-09-13T10:38:53.579 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:53.579 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40310]: starting. 2024-09-13T10:38:53.580 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40310]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40272 2024-09-13T10:38:53.580 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40310]: shutting down. 2024-09-13T10:38:53.581 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:53.581 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:38:53.581 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:38:53.584 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:38:55.459 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-09-13T10:38:55.460 INFO:tasks.ceph.mon.c:Sent signal 18 2024-09-13T10:38:55.460 INFO:tasks.mon_thrash:Sending CONT to mon e 2024-09-13T10:38:55.460 INFO:tasks.ceph.mon.e:Sent signal 18 2024-09-13T10:38:55.460 INFO:tasks.mon_thrash:Sending CONT to mon f 2024-09-13T10:38:55.460 INFO:tasks.ceph.mon.f:Sent signal 18 2024-09-13T10:38:55.461 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:38:55.461 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:38:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.569+0000 7f53069e2640 10 monclient: get_monmap_and_config 2024-09-13T10:38:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.569+0000 7f53069e2640 10 monclient: build_initial_monmap 2024-09-13T10:38:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.569+0000 7f53069e2640 10 monclient: monmap: 2024-09-13T10:38:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:38:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:38:55.569751+0000 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:38:55.569751+0000 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:38:55.571 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:38:55.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.569+0000 7f53069e2640 1 Processor -- start 2024-09-13T10:38:55.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.569+0000 7f53069e2640 1 -- start start 2024-09-13T10:38:55.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.569+0000 7f53069e2640 10 monclient: init 2024-09-13T10:38:55.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f53069e2640 10 monclient: _reopen_session rank -1 2024-09-13T10:38:55.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f53069e2640 10 monclient: _add_conns ranks=[5,1,3,6,0,7,4,8,2] 2024-09-13T10:38:55.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f53069e2640 10 monclient(hunting): picked mon.noname-h con 0x7f53000a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:38:55.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f53069e2640 10 monclient(hunting): picked mon.noname-f con 0x7f53000a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:38:55.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f53069e2640 10 monclient(hunting): picked mon.noname-g con 0x7f530013f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:38:55.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f53069e2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53000a5fe0 con 0x7f53000a6ab0 2024-09-13T10:38:55.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f53069e2640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53000a8080 con 0x7f530013f9a0 2024-09-13T10:38:55.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f53069e2640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53000a42c0 con 0x7f53000a66d0 2024-09-13T10:38:55.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f53069e2640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:55.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f53069e2640 10 monclient(hunting): authenticate will time out at 1275.075424s 2024-09-13T10:38:55.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f52fffff640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f53000a66d0 0x7f53000a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:51574/0 (socket says 172.21.15.181:51574) 2024-09-13T10:38:55.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f52fffff640 1 -- 172.21.15.181:0/1050964938 learned_addr learned my addr 172.21.15.181:0/1050964938 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:38:55.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f52ff7fe640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f53000a6ab0 0x7f53000a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:60714/0 (socket says 172.21.15.181:60714) 2024-09-13T10:38:55.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.570+0000 7f5304f7f640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f530013f9a0 0x7f5300141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:57922/0 (socket says 172.21.15.181:57922) 2024-09-13T10:38:55.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.572+0000 7f5304f7f640 1 -- 172.21.15.181:0/1050964938 >> v1:172.21.15.195:6790/0 conn(0x7f530013f9a0 legacy=0x7f5300141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:55.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.572+0000 7f52fffff640 1 -- 172.21.15.181:0/1050964938 >> v1:172.21.15.195:6791/0 conn(0x7f53000a66d0 legacy=0x7f53000a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:55.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:55.572+0000 7f52ff7fe640 1 -- 172.21.15.181:0/1050964938 >> v1:172.21.15.195:6789/0 conn(0x7f53000a6ab0 legacy=0x7f53000a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:58.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 10 monclient(hunting): tick 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 1 monclient(hunting): continuing hunt 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 1 -- 172.21.15.181:0/1050964938 >> v1:172.21.15.195:6791/0 conn(0x7f53000a66d0 legacy=0x7f53000a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 1 -- 172.21.15.181:0/1050964938 >> v1:172.21.15.195:6790/0 conn(0x7f530013f9a0 legacy=0x7f5300141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 1 -- 172.21.15.181:0/1050964938 >> v1:172.21.15.195:6789/0 conn(0x7f53000a6ab0 legacy=0x7f53000a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 10 monclient: _add_conns ranks=[4,8,2,0,7,6] 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 10 monclient(hunting): picked mon.noname-c con 0x7f52e0003960 addr v1:172.21.15.181:6791/0 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 10 monclient(hunting): picked mon.noname-e con 0x7f52e0007590 addr v1:172.21.15.181:6793/0 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 10 monclient(hunting): picked mon.noname-b con 0x7f52e000b320 addr v1:172.21.15.181:6790/0 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 1 -- 172.21.15.181:0/1050964938 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53001464e0 con 0x7f52e000b320 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 1 -- 172.21.15.181:0/1050964938 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e0010160 con 0x7f52e0003960 2024-09-13T10:38:58.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 1 -- 172.21.15.181:0/1050964938 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e0011400 con 0x7f52e0007590 2024-09-13T10:38:58.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.570+0000 7f52fdffb640 10 monclient(hunting): _renew_subs 2024-09-13T10:38:58.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.572+0000 7f5304f7f640 1 -- 172.21.15.181:0/1050964938 >> v1:172.21.15.181:6790/0 conn(0x7f52e000b320 legacy=0x7f52e000d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:58.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.572+0000 7f52fffff640 1 -- 172.21.15.181:0/1050964938 >> v1:172.21.15.181:6791/0 conn(0x7f52e0003960 legacy=0x7f52e0005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:38:58.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:38:58.572+0000 7f52ff7fe640 1 -- 172.21.15.181:0/1050964938 >> v1:172.21.15.181:6793/0 conn(0x7f52e0007590 legacy=0x7f52e0009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:00.477 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.474+0000 7f52feffd640 1 -- 172.21.15.181:0/1050964938 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655442605 0 0) 0x7f53001464e0 con 0x7f52e000b320 2024-09-13T10:39:00.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.474+0000 7f52feffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:00.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.474+0000 7f52feffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:00.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.474+0000 7f52feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:00.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.474+0000 7f52feffd640 10 monclient(hunting): my global_id is 134471 2024-09-13T10:39:00.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.474+0000 7f52feffd640 1 -- 172.21.15.181:0/1050964938 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52ec003520 con 0x7f52e000b320 2024-09-13T10:39:00.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.474+0000 7f52feffd640 1 -- 172.21.15.181:0/1050964938 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209232239 0 0) 0x7f52e0010160 con 0x7f52e0003960 2024-09-13T10:39:00.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.474+0000 7f52feffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:00.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.474+0000 7f52feffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:00.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.474+0000 7f52feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:00.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.474+0000 7f52feffd640 10 monclient(hunting): my global_id is 115222 2024-09-13T10:39:00.478 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.474+0000 7f52feffd640 1 -- 172.21.15.181:0/1050964938 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53001464e0 con 0x7f52e0003960 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 1 -- 172.21.15.181:0/1050964938 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1738056201 0 0) 0x7f52ec003520 con 0x7f52e000b320 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 1 -- 172.21.15.181:0/1050964938 >> v1:172.21.15.181:6793/0 conn(0x7f52e0007590 legacy=0x7f52e0009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 1 -- 172.21.15.181:0/1050964938 >> v1:172.21.15.181:6791/0 conn(0x7f52e0003960 legacy=0x7f52e0005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 1 monclient: found mon.noname-b 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f5304f7f640 1 -- 172.21.15.181:0/1050964938 reap_dead start 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 1 -- 172.21.15.181:0/1050964938 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e00126a0 con 0x7f52e000b320 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 10 monclient: _finish_auth 0 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:00.479 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 1 -- 172.21.15.181:0/1050964938 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f52f8001e20 con 0x7f52e000b320 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f53069e2640 5 monclient: authenticate success, global_id 134471 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f53069e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 10 monclient: dump: 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:00.480 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f53069e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 1 -- 172.21.15.181:0/1050964938 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52f8004b60 con 0x7f52e000b320 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 1 -- 172.21.15.181:0/1050964938 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f52f8005050 con 0x7f52e000b320 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:00.481 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f52feffd640 10 monclient: dump: 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:00.482 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:00.483 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f53069e2640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:00.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.475+0000 7f53069e2640 4 set_mon_vals no callback set 2024-09-13T10:39:00.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.476+0000 7f53069e2640 10 monclient: shutdown 2024-09-13T10:39:00.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.476+0000 7f53069e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:00.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.476+0000 7f53069e2640 1 -- 172.21.15.181:0/1050964938 >> v1:172.21.15.181:6790/0 conn(0x7f52e000b320 legacy=0x7f52e000d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.476+0000 7f53069e2640 1 -- 172.21.15.181:0/1050964938 shutdown_connections 2024-09-13T10:39:00.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.476+0000 7f53069e2640 1 -- 172.21.15.181:0/1050964938 >> 172.21.15.181:0/1050964938 conn(0x7f53000abcd0 msgr2=0x7f53000ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:00.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.476+0000 7f53069e2640 1 -- 172.21.15.181:0/1050964938 shutdown_connections 2024-09-13T10:39:00.483 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.476+0000 7f53069e2640 1 -- 172.21.15.181:0/1050964938 wait complete. 2024-09-13T10:39:00.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.477+0000 7f53069e2640 10 monclient: build_initial_monmap 2024-09-13T10:39:00.486 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.477+0000 7f53069e2640 10 monclient: monmap: 2024-09-13T10:39:00.486 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:00.486 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:00.486 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:00.486 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:00.486 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:00.486 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.477+0000 7f53069e2640 1 Processor -- start 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f53069e2640 1 -- start start 2024-09-13T10:39:00.487 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f53069e2640 10 monclient: init 2024-09-13T10:39:00.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f53069e2640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:00.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f53069e2640 10 monclient: _add_conns ranks=[3,2,4,5,7,0,8,6,1] 2024-09-13T10:39:00.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f53069e2640 10 monclient(hunting): picked mon.noname-g con 0x7f52e000b320 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:00.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f53069e2640 10 monclient(hunting): picked mon.noname-b con 0x7f53001371e0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:00.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f53069e2640 10 monclient(hunting): picked mon.noname-c con 0x7f53000a17e0 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:00.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f53069e2640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53000ab500 con 0x7f53001371e0 2024-09-13T10:39:00.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f53069e2640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5300137e80 con 0x7f52e000b320 2024-09-13T10:39:00.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f5304f7f640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f53000a17e0 0x7f53001d68f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:49682/0 (socket says 172.21.15.181:49682) 2024-09-13T10:39:00.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f5304f7f640 1 -- 172.21.15.181:0/31565036 learned_addr learned my addr 172.21.15.181:0/31565036 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:00.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f53069e2640 1 -- 172.21.15.181:0/31565036 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5300137aa0 con 0x7f53000a17e0 2024-09-13T10:39:00.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f53069e2640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:00.488 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.478+0000 7f53069e2640 10 monclient(hunting): authenticate will time out at 1279.983955s 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.481+0000 7f52ff7fe640 1 -- 172.21.15.181:0/31565036 >> v1:172.21.15.181:6790/0 conn(0x7f53001371e0 legacy=0x7f53001d31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.481+0000 7f52fffff640 1 -- 172.21.15.181:0/31565036 >> v1:172.21.15.195:6790/0 conn(0x7f52e000b320 legacy=0x7f5300136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.481+0000 7f5304f7f640 1 -- 172.21.15.181:0/31565036 >> v1:172.21.15.181:6791/0 conn(0x7f53000a17e0 legacy=0x7f53001d68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1287506825 0 0) 0x7f5300137aa0 con 0x7f53000a17e0 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 10 monclient(hunting): my global_id is 115231 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52e0005530 con 0x7f53000a17e0 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3507475536 0 0) 0x7f52e0005530 con 0x7f53000a17e0 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5300137aa0 con 0x7f53000a17e0 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f52f8002070 con 0x7f53000a17e0 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:00.489 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 10 monclient(hunting): dump: 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:00.490 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:00.491 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:00.491 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:00.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f5304f7f640 1 -- 172.21.15.181:0/31565036 >> v1:172.21.15.181:6791/0 conn(0x7f53000a17e0 legacy=0x7f53001d68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-13T10:39:00.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f5304f7f640 1 -- 172.21.15.181:0/31565036 >> v1:172.21.15.181:6791/0 conn(0x7f53000a17e0 legacy=0x7f53001d68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:39:00.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f5304f7f640 1 --1- 172.21.15.181:0/31565036 >> v1:172.21.15.181:6791/0 conn(0x7f53000a17e0 0x7f53001d68f0 :-1 s=OPENED pgs=690 cs=1 l=1).handle_message read tag failed 2024-09-13T10:39:00.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f5304f7f640 1 --1- 172.21.15.181:0/31565036 >> v1:172.21.15.181:6791/0 conn(0x7f53000a17e0 0x7f53001d68f0 :-1 s=OPENED pgs=690 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:39:00.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.483+0000 7f52fcff9640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.181:6791/0 2024-09-13T10:39:00.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.485+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935172938 0 0) 0x7f53000ab500 con 0x7f53001371e0 2024-09-13T10:39:00.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.485+0000 7f52fcff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:00.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.485+0000 7f52fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:00.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.485+0000 7f52fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:00.493 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.485+0000 7f52fcff9640 10 monclient(hunting): my global_id is 134480 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.485+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52e0005530 con 0x7f53001371e0 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.485+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 424925390 0 0) 0x7f52e0005530 con 0x7f53001371e0 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.485+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53000ab500 con 0x7f53001371e0 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.485+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f52e8001b80 con 0x7f53001371e0 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.485+0000 7f52fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.485+0000 7f52fcff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.485+0000 7f52fcff9640 10 monclient(hunting): dump: 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:00.494 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.495 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:00.495 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:00.495 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:00.495 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:00.495 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:00.495 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:00.495 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:00.495 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:00.495 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:00.495 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3531385665 0 0) 0x7f53000ab500 con 0x7f53001371e0 2024-09-13T10:39:00.495 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 >> v1:172.21.15.181:6791/0 conn(0x7f53000a17e0 legacy=0x7f53001d68f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:00.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 >> v1:172.21.15.195:6790/0 conn(0x7f52e000b320 legacy=0x7f5300136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 10 monclient: _finish_hunting 0 2024-09-13T10:39:00.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 1 monclient: found mon.b 2024-09-13T10:39:00.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:00.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:00.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53000a0c80 con 0x7f53001371e0 2024-09-13T10:39:00.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 10 monclient: _finish_auth 0 2024-09-13T10:39:00.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 10 monclient: _check_auth_tickets 2024-09-13T10:39:00.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:00.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f53069e2640 5 monclient: authenticate success, global_id 134480 2024-09-13T10:39:00.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f53069e2640 10 monclient: _renew_subs 2024-09-13T10:39:00.496 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f53069e2640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f53069e2640 1 -- 172.21.15.181:0/31565036 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f53000a2740 con 0x7f53001371e0 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f53069e2640 10 monclient: _renew_subs 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f53069e2640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f53069e2640 1 -- 172.21.15.181:0/31565036 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f53001ce080 con 0x7f53001371e0 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52e8004a90 con 0x7f53001371e0 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f52e8004f80 con 0x7f53001371e0 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fcff9640 10 monclient: dump: 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.497 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.486+0000 7f52fe7fc640 4 set_mon_vals no callback set 2024-09-13T10:39:00.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.487+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f52e8011600 con 0x7f53001371e0 2024-09-13T10:39:00.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.487+0000 7f53069e2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:00.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.487+0000 7f53069e2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:00.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.487+0000 7f53069e2640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:00.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.487+0000 7f53069e2640 1 -- 172.21.15.181:0/31565036 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53000a3240 con 0x7f53001371e0 2024-09-13T10:39:00.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.487+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(281..281 src has 1..281) ==== 3898+0+0 (unknown 3569662414 0 0) 0x7f52e804e060 con 0x7f53001371e0 2024-09-13T10:39:00.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.488+0000 7f52fffff640 10 monclient: get_auth_request con 0x7f52e0041820 auth_method 0 2024-09-13T10:39:00.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.492+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f52e8017490 con 0x7f53001371e0 2024-09-13T10:39:00.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.492+0000 7f52fcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:00.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.492+0000 7f52fcff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:00.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.741+0000 7f53069e2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:39:00.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.741+0000 7f53069e2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:00.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.741+0000 7f53069e2640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:00.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.741+0000 7f53069e2640 1 -- 172.21.15.181:0/31565036 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5300069af0 con 0x7f53001371e0 2024-09-13T10:39:00.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.741+0000 7f52fcff9640 1 -- 172.21.15.181:0/31565036 <== mon.2 v1:172.21.15.181:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 2603443332) 0x7f52e8016d90 con 0x7f53001371e0 2024-09-13T10:39:00.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.741+0000 7f52fcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:00.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.741+0000 7f52fcff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:00.743 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":132,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:39:00.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.744+0000 7f53069e2640 1 -- 172.21.15.181:0/31565036 >> v1:172.21.15.195:6800/1839191919 conn(0x7f52e0041820 legacy=0x7f52e0043ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.744+0000 7f53069e2640 10 monclient: shutdown 2024-09-13T10:39:00.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.744+0000 7f53069e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:00.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.744+0000 7f53069e2640 1 -- 172.21.15.181:0/31565036 >> v1:172.21.15.181:6790/0 conn(0x7f53001371e0 legacy=0x7f53001d31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.744+0000 7f53069e2640 1 -- 172.21.15.181:0/31565036 shutdown_connections 2024-09-13T10:39:00.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.744+0000 7f53069e2640 1 -- 172.21.15.181:0/31565036 >> 172.21.15.181:0/31565036 conn(0x7f53000abcd0 msgr2=0x7f53000aa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:00.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.744+0000 7f53069e2640 1 -- 172.21.15.181:0/31565036 shutdown_connections 2024-09-13T10:39:00.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.744+0000 7f53069e2640 1 -- 172.21.15.181:0/31565036 wait complete. 2024-09-13T10:39:00.756 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:39:00.757 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:39:00.757 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:39:00.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.853+0000 7fb1ff1d1640 10 monclient: get_monmap_and_config 2024-09-13T10:39:00.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.853+0000 7fb1ff1d1640 10 monclient: build_initial_monmap 2024-09-13T10:39:00.855 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.853+0000 7fb1ff1d1640 10 monclient: monmap: 2024-09-13T10:39:00.855 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:00.855 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.855 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:00.854561+0000 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:00.854561+0000 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:00.856 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.854+0000 7fb1ff1d1640 1 Processor -- start 2024-09-13T10:39:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.854+0000 7fb1ff1d1640 1 -- start start 2024-09-13T10:39:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.854+0000 7fb1ff1d1640 10 monclient: init 2024-09-13T10:39:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.855+0000 7fb1ff1d1640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.855+0000 7fb1ff1d1640 10 monclient: _add_conns ranks=[5,3,8,1,4,7,2,6,0] 2024-09-13T10:39:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.855+0000 7fb1ff1d1640 10 monclient(hunting): picked mon.noname-h con 0x7fb1f80a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.855+0000 7fb1ff1d1640 10 monclient(hunting): picked mon.noname-g con 0x7fb1f80a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.855+0000 7fb1ff1d1640 10 monclient(hunting): picked mon.noname-e con 0x7fb1f813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.855+0000 7fb1ff1d1640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f80a4bc0 con 0x7fb1f80a8340 2024-09-13T10:39:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.855+0000 7fb1ff1d1640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f813a320 con 0x7fb1f80a6640 2024-09-13T10:39:00.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.855+0000 7fb1ff1d1640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f80a8100 con 0x7fb1f813f750 2024-09-13T10:39:00.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.855+0000 7fb1ff1d1640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:00.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.855+0000 7fb1ff1d1640 10 monclient(hunting): authenticate will time out at 1280.360385s 2024-09-13T10:39:00.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.855+0000 7fb1fd76e640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fb1f813f750 0x7fb1f8141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:48562/0 (socket says 172.21.15.181:48562) 2024-09-13T10:39:00.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.855+0000 7fb1fd76e640 1 -- 172.21.15.181:0/2086136138 learned_addr learned my addr 172.21.15.181:0/2086136138 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:00.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.857+0000 7fb1fd76e640 1 -- 172.21.15.181:0/2086136138 >> v1:172.21.15.181:6793/0 conn(0x7fb1f813f750 legacy=0x7fb1f8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:00.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.857+0000 7fb1fcf6d640 1 -- 172.21.15.181:0/2086136138 >> v1:172.21.15.195:6791/0 conn(0x7fb1f80a6640 legacy=0x7fb1f8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:00.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.857+0000 7fb1f7fff640 1 -- 172.21.15.181:0/2086136138 >> v1:172.21.15.195:6790/0 conn(0x7fb1f80a8340 legacy=0x7fb1f8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:00.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.857+0000 7fb1f77fe640 1 -- 172.21.15.181:0/2086136138 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149602996 0 0) 0x7fb1f80a8100 con 0x7fb1f813f750 2024-09-13T10:39:00.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.857+0000 7fb1f77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:00.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.857+0000 7fb1f77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:00.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.857+0000 7fb1f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.857+0000 7fb1f77fe640 10 monclient(hunting): my global_id is 105551 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.857+0000 7fb1f77fe640 1 -- 172.21.15.181:0/2086136138 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1e4003520 con 0x7fb1f813f750 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 1 -- 172.21.15.181:0/2086136138 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2721100719 0 0) 0x7fb1e4003520 con 0x7fb1f813f750 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 1 -- 172.21.15.181:0/2086136138 >> v1:172.21.15.195:6791/0 conn(0x7fb1f80a6640 legacy=0x7fb1f8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 1 -- 172.21.15.181:0/2086136138 >> v1:172.21.15.195:6790/0 conn(0x7fb1f80a8340 legacy=0x7fb1f8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 1 monclient: found mon.noname-e 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 1 -- 172.21.15.181:0/2086136138 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f80a48e0 con 0x7fb1f813f750 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:00.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 1 -- 172.21.15.181:0/2086136138 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb1f0001e60 con 0x7fb1f813f750 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1ff1d1640 5 monclient: authenticate success, global_id 105551 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1ff1d1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 10 monclient: dump: 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:00.864 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1ff1d1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 1 -- 172.21.15.181:0/2086136138 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb1f0004c20 con 0x7fb1f813f750 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1ff1d1640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 1 -- 172.21.15.181:0/2086136138 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb1f0005190 con 0x7fb1f813f750 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:00.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1ff1d1640 4 set_mon_vals no callback set 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1f77fe640 10 monclient: dump: 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:00.866 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1ff1d1640 10 monclient: shutdown 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1ff1d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/2086136138 >> v1:172.21.15.181:6793/0 conn(0x7fb1f813f750 legacy=0x7fb1f8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/2086136138 shutdown_connections 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/2086136138 >> 172.21.15.181:0/2086136138 conn(0x7fb1f8077170 msgr2=0x7fb1f80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/2086136138 shutdown_connections 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.858+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/2086136138 wait complete. 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.859+0000 7fb1ff1d1640 10 monclient: build_initial_monmap 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.859+0000 7fb1ff1d1640 10 monclient: monmap: 2024-09-13T10:39:00.867 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:00.868 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.859+0000 7fb1ff1d1640 1 Processor -- start 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.859+0000 7fb1ff1d1640 1 -- start start 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.859+0000 7fb1ff1d1640 10 monclient: init 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.860+0000 7fb1ff1d1640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.860+0000 7fb1ff1d1640 10 monclient: _add_conns ranks=[7,6,4,2,3,5,1,0,8] 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.860+0000 7fb1ff1d1640 10 monclient(hunting): picked mon.noname-i con 0x7fb1f80a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.860+0000 7fb1ff1d1640 10 monclient(hunting): picked mon.noname-d con 0x7fb1f813f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.860+0000 7fb1ff1d1640 10 monclient(hunting): picked mon.noname-c con 0x7fb1f813cef0 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.860+0000 7fb1ff1d1640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f8134cf0 con 0x7fb1f813cef0 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.860+0000 7fb1ff1d1640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f813e0d0 con 0x7fb1f813f750 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.860+0000 7fb1ff1d1640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f8134450 con 0x7fb1f80a8340 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.860+0000 7fb1ff1d1640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:00.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.860+0000 7fb1ff1d1640 10 monclient(hunting): authenticate will time out at 1280.365420s 2024-09-13T10:39:00.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.860+0000 7fb1f7fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fb1f813f750 0x7fb1f81d3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:33118/0 (socket says 172.21.15.181:33118) 2024-09-13T10:39:00.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.860+0000 7fb1f7fff640 1 -- 172.21.15.181:0/300946386 learned_addr learned my addr 172.21.15.181:0/300946386 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:00.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f7fff640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.181:6792/0 conn(0x7fb1f813f750 legacy=0x7fb1f81d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:00.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1fd76e640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.181:6791/0 conn(0x7fb1f813cef0 legacy=0x7fb1f81d6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:00.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372351194 0 0) 0x7fb1f8134cf0 con 0x7fb1f813cef0 2024-09-13T10:39:00.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:00.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:00.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:00.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 10 monclient(hunting): my global_id is 115240 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1fcf6d640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.195:6792/0 conn(0x7fb1f80a8340 legacy=0x7fb1f81ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1d8003550 con 0x7fb1f813cef0 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546893493 0 0) 0x7fb1f813e0d0 con 0x7fb1f813f750 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 10 monclient(hunting): my global_id is 134376 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f8134cf0 con 0x7fb1f813f750 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2223870336 0 0) 0x7fb1d8003550 con 0x7fb1f813cef0 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1f813e0d0 con 0x7fb1f813cef0 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb1f00020b0 con 0x7fb1f813cef0 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:00.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.862+0000 7fb1f57fa640 10 monclient(hunting): dump: 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:00.876 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1888493027 0 0) 0x7fb1f8134cf0 con 0x7fb1f813f750 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1d8003550 con 0x7fb1f813f750 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb1e0003610 con 0x7fb1f813f750 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient(hunting): dump: 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.877 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3348369301 0 0) 0x7fb1f8134450 con 0x7fb1f80a8340 2024-09-13T10:39:00.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient(hunting): my global_id is 57454 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f8134cf0 con 0x7fb1f80a8340 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1913556966 0 0) 0x7fb1f813e0d0 con 0x7fb1f813cef0 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.195:6792/0 conn(0x7fb1f80a8340 legacy=0x7fb1f81ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.181:6792/0 conn(0x7fb1f813f750 legacy=0x7fb1f81d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient: _finish_hunting 0 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 1 monclient: found mon.c 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f813e430 con 0x7fb1f813cef0 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient: _finish_auth 0 2024-09-13T10:39:00.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient: _check_auth_tickets 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1ff1d1640 5 monclient: authenticate success, global_id 115240 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1ff1d1640 10 monclient: _renew_subs 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1ff1d1640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f813de30 con 0x7fb1f813cef0 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1ff1d1640 10 monclient: _renew_subs 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1ff1d1640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fb1f81cecb0 con 0x7fb1f813cef0 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb1f0004c20 con 0x7fb1f813cef0 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb1f0005700 con 0x7fb1f813cef0 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f6ffd640 4 set_mon_vals no callback set 2024-09-13T10:39:00.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.863+0000 7fb1f57fa640 10 monclient: dump: 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:00.881 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.864+0000 7fb1ff1d1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.864+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb1dc0065c0 con 0x7fb1dc002860 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.864+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb1f0011d80 con 0x7fb1f813cef0 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.864+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(281..281 src has 1..281) ==== 3898+0+0 (unknown 3569662414 0 0) 0x7fb1f004e580 con 0x7fb1f813cef0 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.864+0000 7fb1f7fff640 10 monclient: get_auth_request con 0x7fb1d80403b0 auth_method 0 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1fcf6d640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.181:6789/0 conn(0x7fb1dc002860 legacy=0x7fb1dc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96979133 0 0) 0x7fb1dc0065c0 con 0x7fb1dc002860 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:00.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 10 monclient(hunting): my global_id is 115200 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f813e0d0 con 0x7fb1dc002860 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 94222872 0 0) 0x7fb1f813e0d0 con 0x7fb1dc002860 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1dc0065c0 con 0x7fb1dc002860 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb1e8001c20 con 0x7fb1dc002860 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 10 monclient: dump: 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.883 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 92096612 0 0) 0x7fb1dc0065c0 con 0x7fb1dc002860 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.866+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1dc00a160 con 0x7fb1dc002860 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.867+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb1e8006830 con 0x7fb1dc002860 2024-09-13T10:39:00.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.867+0000 7fb1f57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:00.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.867+0000 7fb1f57fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:00.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.867+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.181:6789/0 conn(0x7fb1dc002860 legacy=0x7fb1dc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.867+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.181:6789/0 conn(0x7fb1dc002860 legacy=0x7fb1dc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:00.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.873+0000 7fb1ff1d1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:00.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.873+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb1dc009e70 con 0x7fb1dc009130 2024-09-13T10:39:00.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1fcf6d640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.181:6789/0 conn(0x7fb1dc009130 legacy=0x7fb1dc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:00.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698832462 0 0) 0x7fb1dc009e70 con 0x7fb1dc009130 2024-09-13T10:39:00.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:00.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:00.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 10 monclient(hunting): my global_id is 115209 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1dc0065c0 con 0x7fb1dc009130 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2629938394 0 0) 0x7fb1dc0065c0 con 0x7fb1dc009130 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1dc009e70 con 0x7fb1dc009130 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb1e8003d40 con 0x7fb1dc009130 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 10 monclient: dump: 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:00.887 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3772552416 0 0) 0x7fb1dc009e70 con 0x7fb1dc009130 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.875+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb1dc00c410 con 0x7fb1dc009130 2024-09-13T10:39:00.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7894 (unknown 0 0 3523322795) 0x7fb1e8004100 con 0x7fb1dc009130 2024-09-13T10:39:00.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1f57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:00.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1f57fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:00.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.181:6789/0 conn(0x7fb1dc009130 legacy=0x7fb1dc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1f57fa640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.181:6789/0 conn(0x7fb1dc009130 legacy=0x7fb1dc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:00.889 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:00.889 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:00.889 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:00.889 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:00.889 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 176853, 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:39:00.890 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:00.891 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:00.892 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:00.893 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:00.894 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:00.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:00.897 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.898 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.899 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.900 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:00.901 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.902 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.903 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.904 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:00.905 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:00.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:00.907 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:00.908 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:00.909 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.909 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:00.909 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:39:00.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:00.909 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:00.909 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:00.909 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:00.909 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:00.909 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:00.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:00.909 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:00.909 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:00.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb1d80403b0 legacy=0x7fb1d8042870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1ff1d1640 10 monclient: shutdown 2024-09-13T10:39:00.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1ff1d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:00.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/300946386 >> v1:172.21.15.181:6791/0 conn(0x7fb1f813cef0 legacy=0x7fb1f81d6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:00.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1fd76e640 1 -- 172.21.15.181:0/300946386 reap_dead start 2024-09-13T10:39:00.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1fd76e640 1 -- 172.21.15.181:0/300946386 reap_dead start 2024-09-13T10:39:00.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/300946386 shutdown_connections 2024-09-13T10:39:00.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/300946386 >> 172.21.15.181:0/300946386 conn(0x7fb1f80a6640 msgr2=0x7fb1f80a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:00.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/300946386 shutdown_connections 2024-09-13T10:39:00.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:00.876+0000 7fb1ff1d1640 1 -- 172.21.15.181:0/300946386 wait complete. 2024-09-13T10:39:00.912 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:00.912 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:39:00.912 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.008+0000 7f6e0fbec640 10 monclient: get_monmap_and_config 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.008+0000 7f6e0fbec640 10 monclient: build_initial_monmap 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.008+0000 7f6e0fbec640 10 monclient: monmap: 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:01.009171+0000 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:01.009171+0000 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:01.010 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:01.011 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:01.011 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:01.011 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:01.011 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:01.011 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:01.011 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 1 Processor -- start 2024-09-13T10:39:01.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 1 -- start start 2024-09-13T10:39:01.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 10 monclient: init 2024-09-13T10:39:01.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:01.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 10 monclient: _add_conns ranks=[0,7,4,5,1,8,6,3,2] 2024-09-13T10:39:01.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 10 monclient(hunting): picked mon.noname-a con 0x7f6e080a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:01.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 10 monclient(hunting): picked mon.noname-i con 0x7f6e080a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:01.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 10 monclient(hunting): picked mon.noname-c con 0x7f6e0813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:01.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e080a4bc0 con 0x7f6e080a6640 2024-09-13T10:39:01.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e0813a320 con 0x7f6e0813f750 2024-09-13T10:39:01.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e080a8100 con 0x7f6e080a8340 2024-09-13T10:39:01.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:01.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.009+0000 7f6e0fbec640 10 monclient(hunting): authenticate will time out at 1280.514926s 2024-09-13T10:39:01.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.010+0000 7f6e0d988640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6e080a6640 0x7f6e08139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:52086/0 (socket says 172.21.15.181:52086) 2024-09-13T10:39:01.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.010+0000 7f6e0d988640 1 -- 172.21.15.181:0/498342369 learned_addr learned my addr 172.21.15.181:0/498342369 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:01.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0d988640 1 -- 172.21.15.181:0/498342369 >> v1:172.21.15.181:6789/0 conn(0x7f6e080a6640 legacy=0x7f6e08139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0e189640 1 -- 172.21.15.181:0/498342369 >> v1:172.21.15.181:6791/0 conn(0x7f6e0813f750 legacy=0x7f6e08141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 -- 172.21.15.181:0/498342369 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4032415974 0 0) 0x7f6e080a4bc0 con 0x7f6e080a6640 2024-09-13T10:39:01.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient(hunting): my global_id is 115218 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 -- 172.21.15.181:0/498342369 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df4003520 con 0x7f6e080a6640 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 -- 172.21.15.181:0/498342369 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437412492 0 0) 0x7f6e0813a320 con 0x7f6e0813f750 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient(hunting): my global_id is 115249 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 -- 172.21.15.181:0/498342369 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e080a4bc0 con 0x7f6e0813f750 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0d187640 1 -- 172.21.15.181:0/498342369 >> v1:172.21.15.195:6792/0 conn(0x7f6e080a8340 legacy=0x7f6e08139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 -- 172.21.15.181:0/498342369 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1473877546 0 0) 0x7f6df4003520 con 0x7f6e080a6640 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 -- 172.21.15.181:0/498342369 >> v1:172.21.15.195:6792/0 conn(0x7f6e080a8340 legacy=0x7f6e08139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 -- 172.21.15.181:0/498342369 >> v1:172.21.15.181:6791/0 conn(0x7f6e0813f750 legacy=0x7f6e08141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient: _finish_hunting 0 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 monclient: found mon.noname-a 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 -- 172.21.15.181:0/498342369 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e080a48e0 con 0x7f6e080a6640 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient: _finish_auth 0 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient: _check_auth_tickets 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 -- 172.21.15.181:0/498342369 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6df8001ae0 con 0x7f6e080a6640 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0fbec640 5 monclient: authenticate success, global_id 115218 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0fbec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient: dump: 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.019 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0fbec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 -- 172.21.15.181:0/498342369 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3141101334 0 0) 0x7f6e080a8100 con 0x7f6e080a8340 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 -- 172.21.15.181:0/498342369 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6df80048a0 con 0x7f6e080a6640 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 1 -- 172.21.15.181:0/498342369 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6df8004e10 con 0x7f6e080a6640 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0fbec640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0fbec640 4 set_mon_vals no callback set 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.012+0000 7f6e0c986640 10 monclient: dump: 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.021 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.013+0000 7f6e0fbec640 10 monclient: shutdown 2024-09-13T10:39:01.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.013+0000 7f6e0fbec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.013+0000 7f6e0fbec640 1 -- 172.21.15.181:0/498342369 >> v1:172.21.15.181:6789/0 conn(0x7f6e080a6640 legacy=0x7f6e08139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.013+0000 7f6e0fbec640 1 -- 172.21.15.181:0/498342369 shutdown_connections 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.013+0000 7f6e0fbec640 1 -- 172.21.15.181:0/498342369 >> 172.21.15.181:0/498342369 conn(0x7f6e08077170 msgr2=0x7f6e080abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.013+0000 7f6e0fbec640 1 -- 172.21.15.181:0/498342369 shutdown_connections 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.013+0000 7f6e0fbec640 1 -- 172.21.15.181:0/498342369 wait complete. 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.013+0000 7f6e0fbec640 10 monclient: build_initial_monmap 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.013+0000 7f6e0fbec640 10 monclient: monmap: 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:01.023 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 1 Processor -- start 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 1 -- start start 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 10 monclient: init 2024-09-13T10:39:01.024 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:01.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 10 monclient: _add_conns ranks=[2,5,6,8,0,1,3,7,4] 2024-09-13T10:39:01.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 10 monclient(hunting): picked mon.noname-b con 0x7f6e080a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:01.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 10 monclient(hunting): picked mon.noname-h con 0x7f6e0813f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:01.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 10 monclient(hunting): picked mon.noname-d con 0x7f6e081d4520 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:01.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e080a0fd0 con 0x7f6e080a8340 2024-09-13T10:39:01.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e080a12b0 con 0x7f6e0813f750 2024-09-13T10:39:01.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e0809e2b0 con 0x7f6e081d4520 2024-09-13T10:39:01.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:01.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0fbec640 10 monclient(hunting): authenticate will time out at 1280.519761s 2024-09-13T10:39:01.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0d988640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f6e080a8340 0x7f6e0809d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:56224/0 (socket says 172.21.15.181:56224) 2024-09-13T10:39:01.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0e189640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f6e081d4520 0x7f6e081d6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:33122/0 (socket says 172.21.15.181:33122) 2024-09-13T10:39:01.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.014+0000 7f6e0d988640 1 -- 172.21.15.181:0/1189125379 learned_addr learned my addr 172.21.15.181:0/1189125379 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:01.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.016+0000 7f6e0d988640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.181:6790/0 conn(0x7f6e080a8340 legacy=0x7f6e0809d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.016+0000 7f6e0e189640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.181:6792/0 conn(0x7f6e081d4520 legacy=0x7f6e081d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6e0d187640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.195:6791/0 conn(0x7f6e0813f750 legacy=0x7f6e0809dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 129610673 0 0) 0x7f6e0809e2b0 con 0x7f6e081d4520 2024-09-13T10:39:01.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): my global_id is 134385 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dec003550 con 0x7f6e081d4520 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 452332523 0 0) 0x7f6e080a0fd0 con 0x7f6e080a8340 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): my global_id is 134489 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e0809e2b0 con 0x7f6e080a8340 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2881419170 0 0) 0x7f6dec003550 con 0x7f6e081d4520 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e080a0fd0 con 0x7f6e081d4520 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6e00003990 con 0x7f6e081d4520 2024-09-13T10:39:01.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): dump: 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.031 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3719685954 0 0) 0x7f6e0809e2b0 con 0x7f6e080a8340 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6dec003550 con 0x7f6e080a8340 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6df8004d90 con 0x7f6e080a8340 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): dump: 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.032 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099753261 0 0) 0x7f6e080a12b0 con 0x7f6e0813f750 2024-09-13T10:39:01.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient(hunting): my global_id is 105395 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e0809e2b0 con 0x7f6e0813f750 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3993582457 0 0) 0x7f6e080a0fd0 con 0x7f6e081d4520 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.195:6791/0 conn(0x7f6e0813f750 legacy=0x7f6e0809dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.181:6790/0 conn(0x7f6e080a8340 legacy=0x7f6e0809d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 monclient: found mon.d 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e080a1760 con 0x7f6e081d4520 2024-09-13T10:39:01.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6e0fbec640 5 monclient: authenticate success, global_id 134385 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6e0fbec640 10 monclient: _renew_subs 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6e0fbec640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6e0fbec640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6e080a9f70 con 0x7f6e081d4520 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6e0fbec640 10 monclient: _renew_subs 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6e0fbec640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6e0fbec640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f6e08142b60 con 0x7f6e081d4520 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e00003e60 con 0x7f6e081d4520 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6e000043d0 con 0x7f6e081d4520 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:01.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfffff640 4 set_mon_vals no callback set 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.017+0000 7f6dfe7fc640 10 monclient: dump: 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.036 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.018+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6e00004570 con 0x7f6e081d4520 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.018+0000 7f6e0fbec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.018+0000 7f6e0fbec640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6df00065c0 con 0x7f6df0002860 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.018+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(281..281 src has 1..281) ==== 3898+0+0 (unknown 3569662414 0 0) 0x7f6e0004e5a0 con 0x7f6e081d4520 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.019+0000 7f6e0d187640 10 monclient: get_auth_request con 0x7f6dec040270 auth_method 0 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.020+0000 7f6e0d988640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.181:6790/0 conn(0x7f6df0002860 legacy=0x7f6df0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.020+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4077860251 0 0) 0x7f6df00065c0 con 0x7f6df0002860 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.020+0000 7f6dfe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.020+0000 7f6dfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.020+0000 7f6dfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.020+0000 7f6dfe7fc640 10 monclient(hunting): my global_id is 134498 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.020+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e080a0fd0 con 0x7f6df0002860 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1389676395 0 0) 0x7f6e080a0fd0 con 0x7f6df0002860 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6df00065c0 con 0x7f6df0002860 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6df8001d30 con 0x7f6df0002860 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 10 monclient: dump: 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.038 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3274697279 0 0) 0x7f6df00065c0 con 0x7f6df0002860 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6df000a160 con 0x7f6df0002860 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6df8005490 con 0x7f6df0002860 2024-09-13T10:39:01.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:01.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:01.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.181:6790/0 conn(0x7f6df0002860 legacy=0x7f6df0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.021+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.181:6790/0 conn(0x7f6df0002860 legacy=0x7f6df0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:01.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.027+0000 7f6e0fbec640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:01.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.027+0000 7f6e0fbec640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6df0009e50 con 0x7f6df0009110 2024-09-13T10:39:01.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.029+0000 7f6e0d988640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.181:6790/0 conn(0x7f6df0009110 legacy=0x7f6df00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11909923 0 0) 0x7f6df0009e50 con 0x7f6df0009110 2024-09-13T10:39:01.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 10 monclient(hunting): my global_id is 134507 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df00065c0 con 0x7f6df0009110 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 762530420 0 0) 0x7f6df00065c0 con 0x7f6df0009110 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6df0009e50 con 0x7f6df0009110 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6df8005b70 con 0x7f6df0009110 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 10 monclient: dump: 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.042 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3808279925 0 0) 0x7f6df0009e50 con 0x7f6df0009110 2024-09-13T10:39:01.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6df000c3a0 con 0x7f6df0009110 2024-09-13T10:39:01.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 2918950335) 0x7f6df8005e50 con 0x7f6df0009110 2024-09-13T10:39:01.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:01.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:01.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.181:6790/0 conn(0x7f6df0009110 legacy=0x7f6df00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.030+0000 7f6dfe7fc640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.181:6790/0 conn(0x7f6df0009110 legacy=0x7f6df00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:01.044 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:01.044 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:01.044 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:01.044 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 73026, 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.045 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.046 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.047 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:01.048 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.049 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.050 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:01.051 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:01.052 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.052 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.052 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.052 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:01.052 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.052 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.052 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.052 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:01.052 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:01.052 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.053 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.054 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:01.055 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.056 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.057 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.058 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:01.059 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.061 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:01.062 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.064 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:01.064 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:01.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.031+0000 7f6e0fbec640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6dec040270 legacy=0x7f6dec042730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.031+0000 7f6e0fbec640 10 monclient: shutdown 2024-09-13T10:39:01.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.031+0000 7f6e0fbec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:01.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.031+0000 7f6e0fbec640 1 -- 172.21.15.181:0/1189125379 >> v1:172.21.15.181:6792/0 conn(0x7f6e081d4520 legacy=0x7f6e081d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.031+0000 7f6e0e189640 1 -- 172.21.15.181:0/1189125379 reap_dead start 2024-09-13T10:39:01.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.031+0000 7f6e0e189640 1 -- 172.21.15.181:0/1189125379 reap_dead start 2024-09-13T10:39:01.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.031+0000 7f6e0fbec640 1 -- 172.21.15.181:0/1189125379 shutdown_connections 2024-09-13T10:39:01.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.031+0000 7f6e0fbec640 1 -- 172.21.15.181:0/1189125379 >> 172.21.15.181:0/1189125379 conn(0x7f6e080a6640 msgr2=0x7f6e08141bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:01.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.031+0000 7f6e0fbec640 1 -- 172.21.15.181:0/1189125379 shutdown_connections 2024-09-13T10:39:01.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.031+0000 7f6e0fbec640 1 -- 172.21.15.181:0/1189125379 wait complete. 2024-09-13T10:39:01.066 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:01.066 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:39:01.066 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:39:01.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.162+0000 7f735acfe640 10 monclient: get_monmap_and_config 2024-09-13T10:39:01.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.162+0000 7f735acfe640 10 monclient: build_initial_monmap 2024-09-13T10:39:01.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.163+0000 7f735acfe640 10 monclient: monmap: 2024-09-13T10:39:01.164 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:01.164 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:01.163588+0000 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:01.163588+0000 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:01.165 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.163+0000 7f735acfe640 1 Processor -- start 2024-09-13T10:39:01.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.163+0000 7f735acfe640 1 -- start start 2024-09-13T10:39:01.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.163+0000 7f735acfe640 10 monclient: init 2024-09-13T10:39:01.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.164+0000 7f735acfe640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:01.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.164+0000 7f735acfe640 10 monclient: _add_conns ranks=[7,3,4,8,5,6,1,2,0] 2024-09-13T10:39:01.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.164+0000 7f735acfe640 10 monclient(hunting): picked mon.noname-i con 0x7f73540a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:01.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.164+0000 7f735acfe640 10 monclient(hunting): picked mon.noname-g con 0x7f73540a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:01.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.164+0000 7f735acfe640 10 monclient(hunting): picked mon.noname-c con 0x7f735413f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:01.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.164+0000 7f735acfe640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73540a4bc0 con 0x7f73540a8340 2024-09-13T10:39:01.167 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.164+0000 7f735acfe640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f735413a320 con 0x7f735413f750 2024-09-13T10:39:01.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.164+0000 7f735acfe640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73540a8100 con 0x7f73540a6640 2024-09-13T10:39:01.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.164+0000 7f735acfe640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:01.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.164+0000 7f735acfe640 10 monclient(hunting): authenticate will time out at 1280.669208s 2024-09-13T10:39:01.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.164+0000 7f735929b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f735413f750 0x7f7354141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:49698/0 (socket says 172.21.15.181:49698) 2024-09-13T10:39:01.168 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.164+0000 7f735929b640 1 -- 172.21.15.181:0/661387838 learned_addr learned my addr 172.21.15.181:0/661387838 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:01.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f735929b640 1 -- 172.21.15.181:0/661387838 >> v1:172.21.15.181:6791/0 conn(0x7f735413f750 legacy=0x7f7354141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f7353fff640 1 -- 172.21.15.181:0/661387838 >> v1:172.21.15.195:6790/0 conn(0x7f73540a8340 legacy=0x7f7354139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f7358a9a640 1 -- 172.21.15.181:0/661387838 >> v1:172.21.15.195:6792/0 conn(0x7f73540a6640 legacy=0x7f7354139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f73537fe640 1 -- 172.21.15.181:0/661387838 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1126592347 0 0) 0x7f73540a4bc0 con 0x7f73540a8340 2024-09-13T10:39:01.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f73537fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f73537fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f73537fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f73537fe640 10 monclient(hunting): my global_id is 164109 2024-09-13T10:39:01.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f73537fe640 1 -- 172.21.15.181:0/661387838 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7344003520 con 0x7f73540a8340 2024-09-13T10:39:01.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f73537fe640 1 -- 172.21.15.181:0/661387838 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 553847456 0 0) 0x7f73540a8100 con 0x7f73540a6640 2024-09-13T10:39:01.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f73537fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f73537fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f73537fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f73537fe640 10 monclient(hunting): my global_id is 57472 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.166+0000 7f73537fe640 1 -- 172.21.15.181:0/661387838 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73540a4bc0 con 0x7f73540a6640 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 1 -- 172.21.15.181:0/661387838 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3954316528 0 0) 0x7f7344003520 con 0x7f73540a8340 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 1 -- 172.21.15.181:0/661387838 >> v1:172.21.15.195:6792/0 conn(0x7f73540a6640 legacy=0x7f7354139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 1 -- 172.21.15.181:0/661387838 >> v1:172.21.15.181:6791/0 conn(0x7f735413f750 legacy=0x7f7354141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 1 monclient: found mon.noname-g 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.195:6790/0 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 1 -- 172.21.15.181:0/661387838 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73540a48e0 con 0x7f73540a8340 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:01.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 1 -- 172.21.15.181:0/661387838 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7340001b30 con 0x7f73540a8340 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 10 monclient: dump: 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.174 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f735acfe640 5 monclient: authenticate success, global_id 164109 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f735acfe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 1 -- 172.21.15.181:0/661387838 <== mon.3 v1:172.21.15.195:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7340003610 con 0x7f73540a8340 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f735acfe640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f735acfe640 4 set_mon_vals no callback set 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 1 -- 172.21.15.181:0/661387838 <== mon.3 v1:172.21.15.195:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7340003bc0 con 0x7f73540a8340 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:01.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f73537fe640 10 monclient: dump: 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.176 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f735acfe640 10 monclient: shutdown 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f735acfe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f735acfe640 1 -- 172.21.15.181:0/661387838 >> v1:172.21.15.195:6790/0 conn(0x7f73540a8340 legacy=0x7f7354139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f735acfe640 1 -- 172.21.15.181:0/661387838 shutdown_connections 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f735acfe640 1 -- 172.21.15.181:0/661387838 >> 172.21.15.181:0/661387838 conn(0x7f7354077170 msgr2=0x7f73540abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f735acfe640 1 -- 172.21.15.181:0/661387838 shutdown_connections 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.167+0000 7f735acfe640 1 -- 172.21.15.181:0/661387838 wait complete. 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.168+0000 7f735acfe640 10 monclient: build_initial_monmap 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.168+0000 7f735acfe640 10 monclient: monmap: 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:01.177 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.168+0000 7f735acfe640 1 Processor -- start 2024-09-13T10:39:01.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.168+0000 7f735acfe640 1 -- start start 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.168+0000 7f735acfe640 10 monclient: init 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f735acfe640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f735acfe640 10 monclient: _add_conns ranks=[3,6,4,0,7,8,2,5,1] 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f735acfe640 10 monclient(hunting): picked mon.noname-g con 0x7f73540a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f735acfe640 10 monclient(hunting): picked mon.noname-d con 0x7f735413f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f735acfe640 10 monclient(hunting): picked mon.noname-c con 0x7f73541d4310 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f735acfe640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73540a1190 con 0x7f73540a8340 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f735acfe640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f735409e190 con 0x7f73541d4310 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f735acfe640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7354142f10 con 0x7f735413f750 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f735acfe640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f735acfe640 10 monclient(hunting): authenticate will time out at 1280.674449s 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f7353fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f735413f750 0x7f735409da80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:33126/0 (socket says 172.21.15.181:33126) 2024-09-13T10:39:01.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f7353fff640 1 -- 172.21.15.181:0/3494854706 learned_addr learned my addr 172.21.15.181:0/3494854706 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:01.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.169+0000 7f735929b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f73541d4310 0x7f73541d6700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:49710/0 (socket says 172.21.15.181:49710) 2024-09-13T10:39:01.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.171+0000 7f735929b640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.181:6791/0 conn(0x7f73541d4310 legacy=0x7f73541d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.171+0000 7f7353fff640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.181:6792/0 conn(0x7f735413f750 legacy=0x7f735409da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.171+0000 7f7358a9a640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.195:6790/0 conn(0x7f73540a8340 legacy=0x7f735409d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970175999 0 0) 0x7f73540a1190 con 0x7f73540a8340 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient(hunting): my global_id is 164118 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7338003550 con 0x7f73540a8340 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 537679310 0 0) 0x7f7338003550 con 0x7f73540a8340 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73540a1190 con 0x7f73540a8340 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7348003610 con 0x7f73540a8340 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:39:01.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient(hunting): dump: 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.184 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1671012212 0 0) 0x7f73540a1190 con 0x7f73540a8340 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.181:6792/0 conn(0x7f735413f750 legacy=0x7f735409da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.181:6791/0 conn(0x7f73541d4310 legacy=0x7f73541d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient: _finish_hunting 0 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 1 monclient: found mon.g 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73540a0320 con 0x7f73540a8340 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient: _finish_auth 0 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient: _check_auth_tickets 2024-09-13T10:39:01.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f735acfe640 5 monclient: authenticate success, global_id 164118 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f735acfe640 10 monclient: _renew_subs 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f735acfe640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f735acfe640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f735409ee30 con 0x7f73540a8340 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f735acfe640 10 monclient: _renew_subs 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f735acfe640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f735acfe640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f73540a29f0 con 0x7f73540a8340 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7348003b80 con 0x7f73540a8340 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7348004070 con 0x7f73540a8340 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f7352ffd640 4 set_mon_vals no callback set 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.172+0000 7f73517fa640 10 monclient: dump: 2024-09-13T10:39:01.186 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.187 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.173+0000 7f735acfe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:01.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.173+0000 7f735acfe640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f73340065c0 con 0x7f7334002860 2024-09-13T10:39:01.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.173+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7348004310 con 0x7f73540a8340 2024-09-13T10:39:01.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.173+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(281..281 src has 1..281) ==== 3898+0+0 (unknown 3569662414 0 0) 0x7f734804e400 con 0x7f73540a8340 2024-09-13T10:39:01.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.174+0000 7f735929b640 10 monclient: get_auth_request con 0x7f733803fa90 auth_method 0 2024-09-13T10:39:01.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.175+0000 7f7353fff640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.181:6791/0 conn(0x7f7334002860 legacy=0x7f7334004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.253+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017443948 0 0) 0x7f73340065c0 con 0x7f7334002860 2024-09-13T10:39:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.253+0000 7f73517fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.253+0000 7f73517fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.253+0000 7f73517fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.253+0000 7f73517fa640 10 monclient(hunting): my global_id is 115258 2024-09-13T10:39:01.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.253+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73540a1190 con 0x7f7334002860 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.254+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3066249383 0 0) 0x7f73540a1190 con 0x7f7334002860 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.254+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73340065c0 con 0x7f7334002860 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.254+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7340003610 con 0x7f7334002860 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.254+0000 7f73517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.254+0000 7f73517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.254+0000 7f73517fa640 10 monclient: dump: 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.256 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.257 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.255+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1894235275 0 0) 0x7f73340065c0 con 0x7f7334002860 2024-09-13T10:39:01.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.255+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f733400a160 con 0x7f7334002860 2024-09-13T10:39:01.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.256+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7340003610 con 0x7f7334002860 2024-09-13T10:39:01.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.256+0000 7f73517fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:01.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.256+0000 7f73517fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:01.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.256+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.181:6791/0 conn(0x7f7334002860 legacy=0x7f7334004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.256+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.181:6791/0 conn(0x7f7334002860 legacy=0x7f7334004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:01.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.269+0000 7f735acfe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:01.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.269+0000 7f735acfe640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7334009e40 con 0x7f7334009100 2024-09-13T10:39:01.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.272+0000 7f7353fff640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.181:6791/0 conn(0x7f7334009100 legacy=0x7f7334009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.272+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266640478 0 0) 0x7f7334009e40 con 0x7f7334009100 2024-09-13T10:39:01.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.272+0000 7f73517fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.272+0000 7f73517fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.272+0000 7f73517fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.272+0000 7f73517fa640 10 monclient(hunting): my global_id is 115267 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.272+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73340065c0 con 0x7f7334009100 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 185738319 0 0) 0x7f73340065c0 con 0x7f7334009100 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7334009e40 con 0x7f7334009100 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7340004140 con 0x7f7334009100 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 10 monclient: dump: 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.275 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3009482872 0 0) 0x7f7334009e40 con 0x7f7334009100 2024-09-13T10:39:01.276 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f733400c3a0 con 0x7f7334009100 2024-09-13T10:39:01.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 1900404369) 0x7f73400041a0 con 0x7f7334009100 2024-09-13T10:39:01.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:01.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:01.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.181:6791/0 conn(0x7f7334009100 legacy=0x7f7334009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.273+0000 7f73517fa640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.181:6791/0 conn(0x7f7334009100 legacy=0x7f7334009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:01.277 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:01.278 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:01.278 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:01.278 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:01.278 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:01.278 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 177251, 2024-09-13T10:39:01.278 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:01.278 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:01.278 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:01.278 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:01.278 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:01.278 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:01.278 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.279 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.280 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.281 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.281 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.281 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.281 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.281 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.281 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.281 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.281 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:01.281 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:01.282 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.283 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.284 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.286 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.287 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.289 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:01.290 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:01.292 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.293 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.294 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.295 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.296 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.297 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:01.297 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:01.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.274+0000 7f735acfe640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.195:6800/1839191919 conn(0x7f733803fa90 legacy=0x7f7338041f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.274+0000 7f735acfe640 10 monclient: shutdown 2024-09-13T10:39:01.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.274+0000 7f735acfe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:01.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.274+0000 7f735acfe640 1 -- 172.21.15.181:0/3494854706 >> v1:172.21.15.195:6790/0 conn(0x7f73540a8340 legacy=0x7f735409d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.274+0000 7f735929b640 1 -- 172.21.15.181:0/3494854706 reap_dead start 2024-09-13T10:39:01.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.274+0000 7f735929b640 1 -- 172.21.15.181:0/3494854706 reap_dead start 2024-09-13T10:39:01.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.274+0000 7f735acfe640 1 -- 172.21.15.181:0/3494854706 shutdown_connections 2024-09-13T10:39:01.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.274+0000 7f735acfe640 1 -- 172.21.15.181:0/3494854706 >> 172.21.15.181:0/3494854706 conn(0x7f73540a6640 msgr2=0x7f735413eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:01.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.274+0000 7f735acfe640 1 -- 172.21.15.181:0/3494854706 shutdown_connections 2024-09-13T10:39:01.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.274+0000 7f735acfe640 1 -- 172.21.15.181:0/3494854706 wait complete. 2024-09-13T10:39:01.299 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:01.299 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:39:01.299 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:39:01.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.396+0000 7f5e3fb89640 10 monclient: get_monmap_and_config 2024-09-13T10:39:01.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.396+0000 7f5e3fb89640 10 monclient: build_initial_monmap 2024-09-13T10:39:01.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.396+0000 7f5e3fb89640 10 monclient: monmap: 2024-09-13T10:39:01.398 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:01.398 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.398 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:01.397186+0000 2024-09-13T10:39:01.398 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:01.397186+0000 2024-09-13T10:39:01.398 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:01.398 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.399 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:01.399 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:01.399 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:01.399 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:01.399 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:01.399 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:01.399 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:01.399 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:01.399 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:01.399 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 1 Processor -- start 2024-09-13T10:39:01.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 1 -- start start 2024-09-13T10:39:01.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 10 monclient: init 2024-09-13T10:39:01.400 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:01.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 10 monclient: _add_conns ranks=[3,0,1,2,4,8,5,7,6] 2024-09-13T10:39:01.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 10 monclient(hunting): picked mon.noname-g con 0x7f5e380a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:01.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 10 monclient(hunting): picked mon.noname-a con 0x7f5e380a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:01.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 10 monclient(hunting): picked mon.noname-f con 0x7f5e3813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:01.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e380a4bc0 con 0x7f5e380a8340 2024-09-13T10:39:01.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e3813a320 con 0x7f5e3813f750 2024-09-13T10:39:01.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e380a8100 con 0x7f5e380a6640 2024-09-13T10:39:01.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:01.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.397+0000 7f5e3fb89640 10 monclient(hunting): authenticate will time out at 1280.902903s 2024-09-13T10:39:01.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.398+0000 7f5e3d124640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5e380a8340 0x7f5e38139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:52096/0 (socket says 172.21.15.181:52096) 2024-09-13T10:39:01.401 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.398+0000 7f5e3d124640 1 -- 172.21.15.181:0/3628943922 learned_addr learned my addr 172.21.15.181:0/3628943922 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:01.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3d124640 1 -- 172.21.15.181:0/3628943922 >> v1:172.21.15.181:6789/0 conn(0x7f5e380a8340 legacy=0x7f5e38139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3e126640 1 -- 172.21.15.181:0/3628943922 >> v1:172.21.15.195:6789/0 conn(0x7f5e3813f750 legacy=0x7f5e38141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3d925640 1 -- 172.21.15.181:0/3628943922 >> v1:172.21.15.195:6790/0 conn(0x7f5e380a6640 legacy=0x7f5e38139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 1 -- 172.21.15.181:0/3628943922 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669583093 0 0) 0x7f5e380a4bc0 con 0x7f5e380a8340 2024-09-13T10:39:01.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient(hunting): my global_id is 115227 2024-09-13T10:39:01.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 1 -- 172.21.15.181:0/3628943922 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e24003520 con 0x7f5e380a8340 2024-09-13T10:39:01.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 1 -- 172.21.15.181:0/3628943922 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2283764765 0 0) 0x7f5e24003520 con 0x7f5e380a8340 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 1 -- 172.21.15.181:0/3628943922 >> v1:172.21.15.195:6790/0 conn(0x7f5e380a6640 legacy=0x7f5e38139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 1 -- 172.21.15.181:0/3628943922 >> v1:172.21.15.195:6789/0 conn(0x7f5e3813f750 legacy=0x7f5e38141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient: _finish_hunting 0 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 1 monclient: found mon.noname-a 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 1 -- 172.21.15.181:0/3628943922 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e380a48e0 con 0x7f5e380a8340 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient: _finish_auth 0 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient: _check_auth_tickets 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3fb89640 5 monclient: authenticate success, global_id 115227 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 1 -- 172.21.15.181:0/3628943922 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e28001ae0 con 0x7f5e380a8340 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient: dump: 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.407 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3fb89640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 1 -- 172.21.15.181:0/3628943922 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5e280048a0 con 0x7f5e380a8340 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3fb89640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 1 -- 172.21.15.181:0/3628943922 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e28004e10 con 0x7f5e380a8340 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3fb89640 4 set_mon_vals no callback set 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.400+0000 7f5e3c923640 10 monclient: dump: 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.408 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.401+0000 7f5e3fb89640 10 monclient: shutdown 2024-09-13T10:39:01.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.401+0000 7f5e3fb89640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:01.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.401+0000 7f5e3fb89640 1 -- 172.21.15.181:0/3628943922 >> v1:172.21.15.181:6789/0 conn(0x7f5e380a8340 legacy=0x7f5e38139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.401+0000 7f5e3fb89640 1 -- 172.21.15.181:0/3628943922 shutdown_connections 2024-09-13T10:39:01.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.401+0000 7f5e3fb89640 1 -- 172.21.15.181:0/3628943922 >> 172.21.15.181:0/3628943922 conn(0x7f5e38077170 msgr2=0x7f5e380abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:01.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.401+0000 7f5e3fb89640 1 -- 172.21.15.181:0/3628943922 shutdown_connections 2024-09-13T10:39:01.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.401+0000 7f5e3fb89640 1 -- 172.21.15.181:0/3628943922 wait complete. 2024-09-13T10:39:01.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.401+0000 7f5e3fb89640 10 monclient: build_initial_monmap 2024-09-13T10:39:01.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.401+0000 7f5e3fb89640 10 monclient: monmap: 2024-09-13T10:39:01.410 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:01.411 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 1 Processor -- start 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 1 -- start start 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 10 monclient: init 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 10 monclient: _add_conns ranks=[5,6,2,4,3,0,1,8,7] 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 10 monclient(hunting): picked mon.noname-h con 0x7f5e380a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 10 monclient(hunting): picked mon.noname-d con 0x7f5e3813f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 10 monclient(hunting): picked mon.noname-b con 0x7f5e3813cc10 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e381343f0 con 0x7f5e3813cc10 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e381346d0 con 0x7f5e380a8340 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e381349b0 con 0x7f5e3813f750 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:01.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3fb89640 10 monclient(hunting): authenticate will time out at 1280.907814s 2024-09-13T10:39:01.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3d124640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f5e3813f750 0x7f5e3813c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:33132/0 (socket says 172.21.15.181:33132) 2024-09-13T10:39:01.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.402+0000 7f5e3d124640 1 -- 172.21.15.181:0/120503780 learned_addr learned my addr 172.21.15.181:0/120503780 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:01.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.404+0000 7f5e3d124640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.181:6792/0 conn(0x7f5e3813f750 legacy=0x7f5e3813c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e3e126640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.181:6790/0 conn(0x7f5e3813cc10 legacy=0x7f5e381d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3196493238 0 0) 0x7f5e381349b0 con 0x7f5e3813f750 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): my global_id is 134394 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e1c003550 con 0x7f5e3813f750 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 970864446 0 0) 0x7f5e381343f0 con 0x7f5e3813cc10 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): my global_id is 134516 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e381349b0 con 0x7f5e3813cc10 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e3d925640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.195:6791/0 conn(0x7f5e380a8340 legacy=0x7f5e3813bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1213304511 0 0) 0x7f5e1c003550 con 0x7f5e3813f750 2024-09-13T10:39:01.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e381343f0 con 0x7f5e3813f750 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e28004d90 con 0x7f5e3813f750 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): dump: 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.419 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1418466632 0 0) 0x7f5e381349b0 con 0x7f5e3813cc10 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e1c003550 con 0x7f5e3813cc10 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756265764 0 0) 0x7f5e381346d0 con 0x7f5e380a8340 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): my global_id is 105404 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e381349b0 con 0x7f5e380a8340 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e30002000 con 0x7f5e3813cc10 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient(hunting): dump: 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.421 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 211924704 0 0) 0x7f5e381343f0 con 0x7f5e3813f750 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.195:6791/0 conn(0x7f5e380a8340 legacy=0x7f5e3813bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.181:6790/0 conn(0x7f5e3813cc10 legacy=0x7f5e381d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 monclient: found mon.d 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:01.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3813dff0 con 0x7f5e3813f750 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e3fb89640 5 monclient: authenticate success, global_id 134394 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e3fb89640 10 monclient: _renew_subs 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e3fb89640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e3fb89640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3813e6b0 con 0x7f5e3813f750 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e3fb89640 10 monclient: _renew_subs 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e3fb89640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e3fb89640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f5e381d7a40 con 0x7f5e3813f750 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5e28001d30 con 0x7f5e3813f750 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e28001a80 con 0x7f5e3813f750 2024-09-13T10:39:01.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2ffff640 4 set_mon_vals no callback set 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.405+0000 7f5e2e7fc640 10 monclient: dump: 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.424 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.406+0000 7f5e3fb89640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.406+0000 7f5e3fb89640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5e200065c0 con 0x7f5e20002860 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.406+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5e28011c20 con 0x7f5e3813f750 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.406+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(281..281 src has 1..281) ==== 3898+0+0 (unknown 3569662414 0 0) 0x7f5e2804e490 con 0x7f5e3813f750 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.407+0000 7f5e3e126640 10 monclient: get_auth_request con 0x7f5e1c040310 auth_method 0 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.408+0000 7f5e3d925640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.181:6792/0 conn(0x7f5e20002860 legacy=0x7f5e20004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.408+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053815520 0 0) 0x7f5e200065c0 con 0x7f5e20002860 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.408+0000 7f5e2e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.408+0000 7f5e2e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.408+0000 7f5e2e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.408+0000 7f5e2e7fc640 10 monclient(hunting): my global_id is 134403 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.408+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e381343f0 con 0x7f5e20002860 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.408+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1576872979 0 0) 0x7f5e381343f0 con 0x7f5e20002860 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.409+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e200065c0 con 0x7f5e20002860 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.409+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e34001be0 con 0x7f5e20002860 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.409+0000 7f5e2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.409+0000 7f5e2e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.409+0000 7f5e2e7fc640 10 monclient: dump: 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.426 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.409+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3288317605 0 0) 0x7f5e200065c0 con 0x7f5e20002860 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.409+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e2000a160 con 0x7f5e20002860 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.409+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5e340057c0 con 0x7f5e20002860 2024-09-13T10:39:01.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.409+0000 7f5e2e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:01.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.409+0000 7f5e2e7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:01.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.409+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.181:6792/0 conn(0x7f5e20002860 legacy=0x7f5e20004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.409+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.181:6792/0 conn(0x7f5e20002860 legacy=0x7f5e20004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:01.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.415+0000 7f5e3fb89640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:01.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.415+0000 7f5e3fb89640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5e20009e50 con 0x7f5e20009110 2024-09-13T10:39:01.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.417+0000 7f5e3d925640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.181:6792/0 conn(0x7f5e20009110 legacy=0x7f5e200095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 686494113 0 0) 0x7f5e20009e50 con 0x7f5e20009110 2024-09-13T10:39:01.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 10 monclient(hunting): my global_id is 134412 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e200065c0 con 0x7f5e20009110 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2737071768 0 0) 0x7f5e200065c0 con 0x7f5e20009110 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e20009e50 con 0x7f5e20009110 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e34003c50 con 0x7f5e20009110 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 10 monclient: dump: 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.430 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2529158755 0 0) 0x7f5e20009e50 con 0x7f5e20009110 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5e2000c3a0 con 0x7f5e20009110 2024-09-13T10:39:01.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 4109544349) 0x7f5e34005970 con 0x7f5e20009110 2024-09-13T10:39:01.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:01.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:01.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.181:6792/0 conn(0x7f5e20009110 legacy=0x7f5e200095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e2e7fc640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.181:6792/0 conn(0x7f5e20009110 legacy=0x7f5e200095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:01.432 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 73442, 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:01.439 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.440 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:01.442 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.443 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:01.445 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.446 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.447 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:01.448 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.449 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.451 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.451 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:39:01.451 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.451 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.451 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:01.451 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:01.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e3fb89640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5e1c040310 legacy=0x7f5e1c0427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e3fb89640 10 monclient: shutdown 2024-09-13T10:39:01.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e3fb89640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:01.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e3fb89640 1 -- 172.21.15.181:0/120503780 >> v1:172.21.15.181:6792/0 conn(0x7f5e3813f750 legacy=0x7f5e3813c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e3e126640 1 -- 172.21.15.181:0/120503780 reap_dead start 2024-09-13T10:39:01.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e3e126640 1 -- 172.21.15.181:0/120503780 reap_dead start 2024-09-13T10:39:01.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.418+0000 7f5e3fb89640 1 -- 172.21.15.181:0/120503780 shutdown_connections 2024-09-13T10:39:01.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.419+0000 7f5e3fb89640 1 -- 172.21.15.181:0/120503780 >> 172.21.15.181:0/120503780 conn(0x7f5e380a6640 msgr2=0x7f5e380a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:01.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.419+0000 7f5e3fb89640 1 -- 172.21.15.181:0/120503780 shutdown_connections 2024-09-13T10:39:01.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.419+0000 7f5e3fb89640 1 -- 172.21.15.181:0/120503780 wait complete. 2024-09-13T10:39:01.453 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:01.453 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:39:01.453 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:39:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.559+0000 7f3e098ef640 10 monclient: get_monmap_and_config 2024-09-13T10:39:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.559+0000 7f3e098ef640 10 monclient: build_initial_monmap 2024-09-13T10:39:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.559+0000 7f3e098ef640 10 monclient: monmap: 2024-09-13T10:39:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:01.560387+0000 2024-09-13T10:39:01.563 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:01.560387+0000 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.560+0000 7f3e098ef640 1 Processor -- start 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.560+0000 7f3e098ef640 1 -- start start 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.560+0000 7f3e098ef640 10 monclient: init 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.561+0000 7f3e098ef640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.561+0000 7f3e098ef640 10 monclient: _add_conns ranks=[4,1,6,0,2,5,3,7,8] 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.561+0000 7f3e098ef640 10 monclient(hunting): picked mon.noname-c con 0x7f3e04133e10 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.561+0000 7f3e098ef640 10 monclient(hunting): picked mon.noname-f con 0x7f3e04072d20 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.561+0000 7f3e098ef640 10 monclient(hunting): picked mon.noname-d con 0x7f3e04074210 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.561+0000 7f3e098ef640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e04073550 con 0x7f3e04072d20 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.561+0000 7f3e098ef640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e04073830 con 0x7f3e04133e10 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.561+0000 7f3e098ef640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e04073b10 con 0x7f3e04074210 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.561+0000 7f3e098ef640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.561+0000 7f3e098ef640 10 monclient(hunting): authenticate will time out at 1281.066778s 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.561+0000 7f3e037fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f3e04074210 0x7f3e0413f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:33160/0 (socket says 172.21.15.181:33160) 2024-09-13T10:39:01.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.561+0000 7f3e037fe640 1 -- 172.21.15.181:0/3833996488 learned_addr learned my addr 172.21.15.181:0/3833996488 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.563+0000 7f3e037fe640 1 -- 172.21.15.181:0/3833996488 >> v1:172.21.15.181:6792/0 conn(0x7f3e04074210 legacy=0x7f3e0413f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.563+0000 7f3e02ffd640 1 -- 172.21.15.181:0/3833996488 >> v1:172.21.15.181:6791/0 conn(0x7f3e04133e10 legacy=0x7f3e041341f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.563+0000 7f3e027fc640 1 -- 172.21.15.181:0/3833996488 >> v1:172.21.15.195:6789/0 conn(0x7f3e04072d20 legacy=0x7f3e0413c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 549982811 0 0) 0x7f3e04073830 con 0x7f3e04133e10 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient(hunting): my global_id is 115276 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dec003520 con 0x7f3e04133e10 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230904410 0 0) 0x7f3e04073b10 con 0x7f3e04074210 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient(hunting): my global_id is 134421 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e04073830 con 0x7f3e04074210 2024-09-13T10:39:01.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2007159865 0 0) 0x7f3e04073550 con 0x7f3e04072d20 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient(hunting): my global_id is 134443 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e04073b10 con 0x7f3e04072d20 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3090501680 0 0) 0x7f3dec003520 con 0x7f3e04133e10 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e027fc640 1 --1- 172.21.15.181:0/3833996488 >> v1:172.21.15.195:6789/0 conn(0x7f3e04072d20 0x7f3e0413c150 :-1 s=OPENED pgs=685 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f3df8001b10 mon_map magic: 0 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 >> v1:172.21.15.181:6792/0 conn(0x7f3e04074210 legacy=0x7f3e0413f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 >> v1:172.21.15.195:6789/0 conn(0x7f3e04072d20 legacy=0x7f3e0413c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 monclient: found mon.noname-c 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:39:01.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e04073df0 con 0x7f3e04133e10 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient: _finish_auth 0 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3dfc001eb0 con 0x7f3e04133e10 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e098ef640 5 monclient: authenticate success, global_id 115276 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e098ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient: dump: 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.572 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e098ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3df8001b10 con 0x7f3e04072d20 2024-09-13T10:39:01.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3dfc003990 con 0x7f3e04133e10 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 1 -- 172.21.15.181:0/3833996488 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3dfc003f00 con 0x7f3e04133e10 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e098ef640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e098ef640 4 set_mon_vals no callback set 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.564+0000 7f3e01ffb640 10 monclient: dump: 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.574 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.565+0000 7f3e098ef640 10 monclient: shutdown 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.565+0000 7f3e098ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:01.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.565+0000 7f3e098ef640 1 -- 172.21.15.181:0/3833996488 >> v1:172.21.15.181:6791/0 conn(0x7f3e04133e10 legacy=0x7f3e041341f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.565+0000 7f3e098ef640 1 -- 172.21.15.181:0/3833996488 shutdown_connections 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.565+0000 7f3e098ef640 1 -- 172.21.15.181:0/3833996488 >> 172.21.15.181:0/3833996488 conn(0x7f3e040a80e0 msgr2=0x7f3e040a45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.565+0000 7f3e098ef640 1 -- 172.21.15.181:0/3833996488 shutdown_connections 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.565+0000 7f3e098ef640 1 -- 172.21.15.181:0/3833996488 wait complete. 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.565+0000 7f3e098ef640 10 monclient: build_initial_monmap 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.565+0000 7f3e098ef640 10 monclient: monmap: 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:01.576 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.566+0000 7f3e098ef640 1 Processor -- start 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.566+0000 7f3e098ef640 1 -- start start 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.566+0000 7f3e098ef640 10 monclient: init 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.566+0000 7f3e098ef640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.566+0000 7f3e098ef640 10 monclient: _add_conns ranks=[6,8,0,3,4,5,7,2,1] 2024-09-13T10:39:01.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.566+0000 7f3e098ef640 10 monclient(hunting): picked mon.noname-d con 0x7f3e04072d20 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:01.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.566+0000 7f3e098ef640 10 monclient(hunting): picked mon.noname-e con 0x7f3e04074210 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:01.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.566+0000 7f3e098ef640 10 monclient(hunting): picked mon.noname-a con 0x7f3e04133e10 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:01.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.566+0000 7f3e098ef640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e04130a10 con 0x7f3e04133e10 2024-09-13T10:39:01.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.566+0000 7f3e098ef640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e040a6d10 con 0x7f3e04072d20 2024-09-13T10:39:01.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.567+0000 7f3e02ffd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f3e04072d20 0x7f3e04070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:33164/0 (socket says 172.21.15.181:33164) 2024-09-13T10:39:01.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.567+0000 7f3e02ffd640 1 -- 172.21.15.181:0/2787878957 learned_addr learned my addr 172.21.15.181:0/2787878957 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:01.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.567+0000 7f3e098ef640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e040a4930 con 0x7f3e04074210 2024-09-13T10:39:01.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.567+0000 7f3e098ef640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:01.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.567+0000 7f3e098ef640 10 monclient(hunting): authenticate will time out at 1281.072141s 2024-09-13T10:39:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3e027fc640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.181:6793/0 conn(0x7f3e04074210 legacy=0x7f3e04071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3e02ffd640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.181:6792/0 conn(0x7f3e04072d20 legacy=0x7f3e04070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3e037fe640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.181:6789/0 conn(0x7f3e04133e10 legacy=0x7f3e041d6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796071969 0 0) 0x7f3e040a6d10 con 0x7f3e04072d20 2024-09-13T10:39:01.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): my global_id is 134430 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3df0003520 con 0x7f3e04072d20 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 676819700 0 0) 0x7f3e040a4930 con 0x7f3e04074210 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): my global_id is 105560 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e040a6d10 con 0x7f3e04074210 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2295827631 0 0) 0x7f3e04130a10 con 0x7f3e04133e10 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): my global_id is 115236 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e040a4930 con 0x7f3e04133e10 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2446493642 0 0) 0x7f3e040a6d10 con 0x7f3e04074210 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e04130a10 con 0x7f3e04074210 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 474242338 0 0) 0x7f3df0003520 con 0x7f3e04072d20 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e040a6d10 con 0x7f3e04072d20 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3df8001350 con 0x7f3e04074210 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): dump: 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.584 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3dfc003e80 con 0x7f3e04072d20 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): dump: 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.586 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 432658243 0 0) 0x7f3e040a4930 con 0x7f3e04133e10 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3df0003520 con 0x7f3e04133e10 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3df40047e0 con 0x7f3e04133e10 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.569+0000 7f3debfff640 10 monclient(hunting): dump: 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.587 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.588 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2956116767 0 0) 0x7f3e04130a10 con 0x7f3e04074210 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.181:6792/0 conn(0x7f3e04072d20 legacy=0x7f3e04070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.181:6789/0 conn(0x7f3e04133e10 legacy=0x7f3e041d6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 10 monclient: _finish_hunting 0 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 1 monclient: found mon.e 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e04072a40 con 0x7f3e04074210 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 10 monclient: _finish_auth 0 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 10 monclient: _check_auth_tickets 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3e098ef640 5 monclient: authenticate success, global_id 105560 2024-09-13T10:39:01.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3e098ef640 10 monclient: _renew_subs 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3e098ef640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3e098ef640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3e04072580 con 0x7f3e04074210 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3e098ef640 10 monclient: _renew_subs 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3e098ef640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3e098ef640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f3e041302a0 con 0x7f3e04074210 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3df8003b00 con 0x7f3e04074210 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3df8003ff0 con 0x7f3e04074210 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3e017fa640 4 set_mon_vals no callback set 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3debfff640 10 monclient: dump: 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.590 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.570+0000 7f3e098ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.571+0000 7f3e098ef640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3de40065c0 con 0x7f3de4002860 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.571+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3df8004210 con 0x7f3e04074210 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.571+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(282..282 src has 1..282) ==== 3898+0+0 (unknown 3928562045 0 0) 0x7f3df804e2d0 con 0x7f3e04074210 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.571+0000 7f3e037fe640 10 monclient: get_auth_request con 0x7f3df0040590 auth_method 0 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3e02ffd640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.181:6793/0 conn(0x7f3de4002860 legacy=0x7f3de4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2808279045 0 0) 0x7f3de40065c0 con 0x7f3de4002860 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 10 monclient(hunting): my global_id is 105569 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e04130a10 con 0x7f3de4002860 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4213312631 0 0) 0x7f3e04130a10 con 0x7f3de4002860 2024-09-13T10:39:01.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3de40065c0 con 0x7f3de4002860 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3dfc0046c0 con 0x7f3de4002860 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 10 monclient: dump: 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.593 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 121698698 0 0) 0x7f3de40065c0 con 0x7f3de4002860 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.573+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3de400a160 con 0x7f3de4002860 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.574+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3dfc001ef0 con 0x7f3de4002860 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.574+0000 7f3debfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.574+0000 7f3debfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.574+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.181:6793/0 conn(0x7f3de4002860 legacy=0x7f3de4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.574+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.181:6793/0 conn(0x7f3de4002860 legacy=0x7f3de4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:01.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.580+0000 7f3e098ef640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:01.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.581+0000 7f3e098ef640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3de4009e50 con 0x7f3de4009110 2024-09-13T10:39:01.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3e02ffd640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.181:6793/0 conn(0x7f3de4009110 legacy=0x7f3de40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900607433 0 0) 0x7f3de4009e50 con 0x7f3de4009110 2024-09-13T10:39:01.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 10 monclient(hunting): my global_id is 105578 2024-09-13T10:39:01.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de40065c0 con 0x7f3de4009110 2024-09-13T10:39:01.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2410597998 0 0) 0x7f3de40065c0 con 0x7f3de4009110 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3de4009e50 con 0x7f3de4009110 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3dfc005e80 con 0x7f3de4009110 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 10 monclient: dump: 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.597 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 100021968 0 0) 0x7f3de4009e50 con 0x7f3de4009110 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3de400c3a0 con 0x7f3de4009110 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 2510182604) 0x7f3dfc0081a0 con 0x7f3de4009110 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.181:6793/0 conn(0x7f3de4009110 legacy=0x7f3de40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.583+0000 7f3debfff640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.181:6793/0 conn(0x7f3de4009110 legacy=0x7f3de40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:01.599 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:01.599 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:01.599 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:01.599 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:01.599 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:01.599 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 225286, 2024-09-13T10:39:01.599 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:01.599 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:01.599 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:01.599 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:01.599 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.600 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.601 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:01.602 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:01.603 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:01.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:01.618 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:01.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.584+0000 7f3e098ef640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3df0040590 legacy=0x7f3df0042a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.584+0000 7f3e098ef640 10 monclient: shutdown 2024-09-13T10:39:01.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.584+0000 7f3e098ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:01.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.584+0000 7f3e098ef640 1 -- 172.21.15.181:0/2787878957 >> v1:172.21.15.181:6793/0 conn(0x7f3e04074210 legacy=0x7f3e04071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.584+0000 7f3e037fe640 1 -- 172.21.15.181:0/2787878957 reap_dead start 2024-09-13T10:39:01.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.584+0000 7f3e037fe640 1 -- 172.21.15.181:0/2787878957 reap_dead start 2024-09-13T10:39:01.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.584+0000 7f3e098ef640 1 -- 172.21.15.181:0/2787878957 shutdown_connections 2024-09-13T10:39:01.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.584+0000 7f3e098ef640 1 -- 172.21.15.181:0/2787878957 >> 172.21.15.181:0/2787878957 conn(0x7f3e040a80e0 msgr2=0x7f3e040a2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:01.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.584+0000 7f3e098ef640 1 -- 172.21.15.181:0/2787878957 shutdown_connections 2024-09-13T10:39:01.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.584+0000 7f3e098ef640 1 -- 172.21.15.181:0/2787878957 wait complete. 2024-09-13T10:39:01.620 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:01.620 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:39:01.620 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:39:01.661 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40380]: starting. 2024-09-13T10:39:01.662 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40380]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40379 2024-09-13T10:39:01.662 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40380]: created object 0... 2024-09-13T10:39:01.662 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40380]: created object 25... 2024-09-13T10:39:01.662 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40380]: created object 49... 2024-09-13T10:39:01.662 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40380]: finishing. 2024-09-13T10:39:01.662 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40380]: shutting down. 2024-09-13T10:39:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.719+0000 7f7ce68c6640 10 monclient: get_monmap_and_config 2024-09-13T10:39:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.719+0000 7f7ce68c6640 10 monclient: build_initial_monmap 2024-09-13T10:39:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.719+0000 7f7ce68c6640 10 monclient: monmap: 2024-09-13T10:39:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.720 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:01.719672+0000 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:01.719672+0000 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:01.721 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.719+0000 7f7ce68c6640 1 Processor -- start 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.719+0000 7f7ce68c6640 1 -- start start 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.719+0000 7f7ce68c6640 10 monclient: init 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7ce68c6640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7ce68c6640 10 monclient: _add_conns ranks=[2,7,8,3,4,0,5,6,1] 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7ce68c6640 10 monclient(hunting): picked mon.noname-b con 0x7f7ce00a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7ce68c6640 10 monclient(hunting): picked mon.noname-i con 0x7f7ce00a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7ce68c6640 10 monclient(hunting): picked mon.noname-e con 0x7f7ce013f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7ce68c6640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce00a5fe0 con 0x7f7ce00a66d0 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7ce68c6640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce00a8080 con 0x7f7ce00a6ab0 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7ce68c6640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce00a42c0 con 0x7f7ce013f9a0 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7ce68c6640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7ce68c6640 10 monclient(hunting): authenticate will time out at 1281.225509s 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7ce4e63640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f7ce013f9a0 0x7f7ce0141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:48598/0 (socket says 172.21.15.181:48598) 2024-09-13T10:39:01.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7ce4e63640 1 -- 172.21.15.181:0/186559067 learned_addr learned my addr 172.21.15.181:0/186559067 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:01.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.720+0000 7f7cdffff640 1 --1- 172.21.15.181:0/186559067 >> v1:172.21.15.181:6790/0 conn(0x7f7ce00a66d0 0x7f7ce00a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:56274/0 (socket says 172.21.15.181:56274) 2024-09-13T10:39:01.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.722+0000 7f7ce4e63640 1 -- 172.21.15.181:0/186559067 >> v1:172.21.15.181:6793/0 conn(0x7f7ce013f9a0 legacy=0x7f7ce0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.722+0000 7f7cdffff640 1 -- 172.21.15.181:0/186559067 >> v1:172.21.15.181:6790/0 conn(0x7f7ce00a66d0 legacy=0x7f7ce00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.722+0000 7f7cd7fff640 1 -- 172.21.15.181:0/186559067 >> v1:172.21.15.195:6792/0 conn(0x7f7ce00a6ab0 legacy=0x7f7ce00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3691663008 0 0) 0x7f7ce00a42c0 con 0x7f7ce013f9a0 2024-09-13T10:39:01.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient(hunting): my global_id is 105587 2024-09-13T10:39:01.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ccc003520 con 0x7f7ce013f9a0 2024-09-13T10:39:01.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464733672 0 0) 0x7f7ce00a5fe0 con 0x7f7ce00a66d0 2024-09-13T10:39:01.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient(hunting): my global_id is 134525 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce00a42c0 con 0x7f7ce00a66d0 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3189845912 0 0) 0x7f7ce00a8080 con 0x7f7ce00a6ab0 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient(hunting): my global_id is 57481 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce00a5fe0 con 0x7f7ce00a6ab0 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3446992110 0 0) 0x7f7ce00a42c0 con 0x7f7ce00a66d0 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 >> v1:172.21.15.181:6793/0 conn(0x7f7ce013f9a0 legacy=0x7f7ce0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 >> v1:172.21.15.195:6792/0 conn(0x7f7ce00a6ab0 legacy=0x7f7ce00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:01.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 monclient: found mon.noname-b 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce01464e0 con 0x7f7ce00a66d0 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cd0001900 con 0x7f7ce00a66d0 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7ce68c6640 5 monclient: authenticate success, global_id 134525 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7ce68c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient: dump: 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.730 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7ce68c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cd0001bd0 con 0x7f7ce00a66d0 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 1 -- 172.21.15.181:0/186559067 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cd0004b20 con 0x7f7ce00a66d0 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7cdf7fe640 10 monclient: dump: 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.732 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7ce68c6640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.723+0000 7f7ce68c6640 4 set_mon_vals no callback set 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.724+0000 7f7ce68c6640 10 monclient: shutdown 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.724+0000 7f7ce68c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.724+0000 7f7ce68c6640 1 -- 172.21.15.181:0/186559067 >> v1:172.21.15.181:6790/0 conn(0x7f7ce00a66d0 legacy=0x7f7ce00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.724+0000 7f7ce68c6640 1 -- 172.21.15.181:0/186559067 shutdown_connections 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.724+0000 7f7ce68c6640 1 -- 172.21.15.181:0/186559067 >> 172.21.15.181:0/186559067 conn(0x7f7ce00abcd0 msgr2=0x7f7ce00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.724+0000 7f7ce68c6640 1 -- 172.21.15.181:0/186559067 shutdown_connections 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.724+0000 7f7ce68c6640 1 -- 172.21.15.181:0/186559067 wait complete. 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.724+0000 7f7ce68c6640 10 monclient: build_initial_monmap 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.724+0000 7f7ce68c6640 10 monclient: monmap: 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:01.734 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 1 Processor -- start 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 1 -- start start 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 10 monclient: init 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 10 monclient: _add_conns ranks=[2,1,5,0,6,8,3,7,4] 2024-09-13T10:39:01.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 10 monclient(hunting): picked mon.noname-b con 0x7f7ce00a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:01.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 10 monclient(hunting): picked mon.noname-f con 0x7f7ce00a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:01.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 10 monclient(hunting): picked mon.noname-h con 0x7f7ce013f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:01.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce013d2a0 con 0x7f7ce00a6ab0 2024-09-13T10:39:01.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce013f600 con 0x7f7ce00a66d0 2024-09-13T10:39:01.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce00a2780 con 0x7f7ce013f9a0 2024-09-13T10:39:01.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:01.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7ce68c6640 10 monclient(hunting): authenticate will time out at 1281.230535s 2024-09-13T10:39:01.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7cdffff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f7ce00a66d0 0x7f7ce01ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:56278/0 (socket says 172.21.15.181:56278) 2024-09-13T10:39:01.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.725+0000 7f7cdffff640 1 -- 172.21.15.181:0/848917174 learned_addr learned my addr 172.21.15.181:0/848917174 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:01.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.727+0000 7f7cdffff640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.181:6790/0 conn(0x7f7ce00a66d0 legacy=0x7f7ce01ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.727+0000 7f7cd7fff640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.195:6789/0 conn(0x7f7ce00a6ab0 legacy=0x7f7ce01cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.727+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2037214428 0 0) 0x7f7ce013f600 con 0x7f7ce00a66d0 2024-09-13T10:39:01.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.727+0000 7f7cdd7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.727+0000 7f7cdd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.727+0000 7f7cdd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.727+0000 7f7cdd7fa640 10 monclient(hunting): my global_id is 134534 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.727+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc0003520 con 0x7f7ce00a66d0 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.727+0000 7f7ce4e63640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.195:6791/0 conn(0x7f7ce013f9a0 legacy=0x7f7ce01d67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1481530141 0 0) 0x7f7ce00a2780 con 0x7f7ce013f9a0 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient(hunting): my global_id is 105413 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce013f600 con 0x7f7ce013f9a0 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1741659238 0 0) 0x7f7cc0003520 con 0x7f7ce00a66d0 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ce00a2780 con 0x7f7ce00a66d0 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557651305 0 0) 0x7f7ce013d2a0 con 0x7f7ce00a6ab0 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient(hunting): my global_id is 134452 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc0003520 con 0x7f7ce00a6ab0 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cd0004b20 con 0x7f7ce00a66d0 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient(hunting): dump: 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.742 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1868667349 0 0) 0x7f7ce00a2780 con 0x7f7ce00a66d0 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.195:6791/0 conn(0x7f7ce013f9a0 legacy=0x7f7ce01d67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.195:6789/0 conn(0x7f7ce00a6ab0 legacy=0x7f7ce01cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:39:01.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 monclient: found mon.b 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce013ed60 con 0x7f7ce00a66d0 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient: _finish_auth 0 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7ce68c6640 5 monclient: authenticate success, global_id 134534 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7ce68c6640 10 monclient: _renew_subs 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7ce68c6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7ce68c6640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce013de00 con 0x7f7ce00a66d0 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7ce68c6640 10 monclient: _renew_subs 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7ce68c6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:01.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7ce68c6640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7ce01d7ec0 con 0x7f7ce00a66d0 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cd0001bd0 con 0x7f7ce00a66d0 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cd00018e0 con 0x7f7ce00a66d0 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdeffd640 4 set_mon_vals no callback set 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.728+0000 7f7cdd7fa640 10 monclient: dump: 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.745 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.729+0000 7f7ce68c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.729+0000 7f7ce68c6640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7cc40065c0 con 0x7f7cc4002860 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.729+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7cd00119b0 con 0x7f7ce00a66d0 2024-09-13T10:39:01.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.729+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(282..282 src has 1..282) ==== 3898+0+0 (unknown 3928562045 0 0) 0x7f7cd004e230 con 0x7f7ce00a66d0 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.729+0000 7f7ce4e63640 10 monclient: get_auth_request con 0x7f7cc003fe20 auth_method 0 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cd7fff640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.195:6789/0 conn(0x7f7cc4002860 legacy=0x7f7cc4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078261461 0 0) 0x7f7cc40065c0 con 0x7f7cc4002860 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 10 monclient(hunting): my global_id is 134461 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce00a2780 con 0x7f7cc4002860 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1337375151 0 0) 0x7f7ce00a2780 con 0x7f7cc4002860 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cc40065c0 con 0x7f7cc4002860 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cc8003610 con 0x7f7cc4002860 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:01.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 10 monclient: dump: 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.748 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.749 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.749 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1847119490 0 0) 0x7f7cc40065c0 con 0x7f7cc4002860 2024-09-13T10:39:01.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.731+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7cc400a160 con 0x7f7cc4002860 2024-09-13T10:39:01.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.732+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7cc80057c0 con 0x7f7cc4002860 2024-09-13T10:39:01.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.732+0000 7f7cdd7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:01.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.732+0000 7f7cdd7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:01.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.732+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.195:6789/0 conn(0x7f7cc4002860 legacy=0x7f7cc4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.732+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.195:6789/0 conn(0x7f7cc4002860 legacy=0x7f7cc4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:01.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.738+0000 7f7ce68c6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:01.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.738+0000 7f7ce68c6640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7cc4009e50 con 0x7f7cc4009110 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.740+0000 7f7cd7fff640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.195:6789/0 conn(0x7f7cc4009110 legacy=0x7f7cc40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.740+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861472233 0 0) 0x7f7cc4009e50 con 0x7f7cc4009110 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.740+0000 7f7cdd7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.740+0000 7f7cdd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.740+0000 7f7cdd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.740+0000 7f7cdd7fa640 10 monclient(hunting): my global_id is 134470 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.740+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc40065c0 con 0x7f7cc4009110 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1594670808 0 0) 0x7f7cc40065c0 con 0x7f7cc4009110 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cc4009e50 con 0x7f7cc4009110 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7cc8003e00 con 0x7f7cc4009110 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:01.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 10 monclient: dump: 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.752 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.753 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2597056408 0 0) 0x7f7cc4009e50 con 0x7f7cc4009110 2024-09-13T10:39:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7cc400c3f0 con 0x7f7cc4009110 2024-09-13T10:39:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 34996799) 0x7f7cc8005a70 con 0x7f7cc4009110 2024-09-13T10:39:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.195:6789/0 conn(0x7f7cc4009110 legacy=0x7f7cc40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7cdd7fa640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.195:6789/0 conn(0x7f7cc4009110 legacy=0x7f7cc40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:01.753 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 73770, 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:01.754 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.755 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.756 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:01.757 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.758 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.759 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.760 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.761 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.762 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:01.763 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.764 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.765 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:01.766 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:01.767 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.768 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.769 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:01.770 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:01.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.772 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:01.773 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:01.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7ce68c6640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7cc003fe20 legacy=0x7f7cc00422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7ce68c6640 10 monclient: shutdown 2024-09-13T10:39:01.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7ce68c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:01.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7ce68c6640 1 -- 172.21.15.181:0/848917174 >> v1:172.21.15.181:6790/0 conn(0x7f7ce00a66d0 legacy=0x7f7ce01ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7ce4e63640 1 -- 172.21.15.181:0/848917174 reap_dead start 2024-09-13T10:39:01.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7ce4e63640 1 -- 172.21.15.181:0/848917174 reap_dead start 2024-09-13T10:39:01.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7ce68c6640 1 -- 172.21.15.181:0/848917174 shutdown_connections 2024-09-13T10:39:01.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7ce68c6640 1 -- 172.21.15.181:0/848917174 >> 172.21.15.181:0/848917174 conn(0x7f7ce00abcd0 msgr2=0x7f7ce00a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:01.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7ce68c6640 1 -- 172.21.15.181:0/848917174 shutdown_connections 2024-09-13T10:39:01.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.741+0000 7f7ce68c6640 1 -- 172.21.15.181:0/848917174 wait complete. 2024-09-13T10:39:01.775 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:01.775 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:39:01.775 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:39:01.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.872+0000 7f9bd43cd640 10 monclient: get_monmap_and_config 2024-09-13T10:39:01.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.872+0000 7f9bd43cd640 10 monclient: build_initial_monmap 2024-09-13T10:39:01.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.872+0000 7f9bd43cd640 10 monclient: monmap: 2024-09-13T10:39:01.873 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:01.873 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:01.872714+0000 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:01.872714+0000 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:01.874 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:01.875 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.872+0000 7f9bd43cd640 1 Processor -- start 2024-09-13T10:39:01.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.872+0000 7f9bd43cd640 1 -- start start 2024-09-13T10:39:01.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.872+0000 7f9bd43cd640 10 monclient: init 2024-09-13T10:39:01.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.873+0000 7f9bd43cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:01.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.873+0000 7f9bd43cd640 10 monclient: _add_conns ranks=[5,6,1,4,8,2,7,0,3] 2024-09-13T10:39:01.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.873+0000 7f9bd43cd640 10 monclient(hunting): picked mon.noname-h con 0x7f9bcc0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:01.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.873+0000 7f9bd43cd640 10 monclient(hunting): picked mon.noname-d con 0x7f9bcc0a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:01.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.873+0000 7f9bd43cd640 10 monclient(hunting): picked mon.noname-f con 0x7f9bcc13f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:01.876 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.873+0000 7f9bd43cd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bcc0a5fe0 con 0x7f9bcc13f9a0 2024-09-13T10:39:01.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.873+0000 7f9bd43cd640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bcc0a8080 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.873+0000 7f9bd43cd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bcc0a42c0 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.873+0000 7f9bd43cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:01.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.873+0000 7f9bd43cd640 10 monclient(hunting): authenticate will time out at 1281.378401s 2024-09-13T10:39:01.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.873+0000 7f9bd1968640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f9bcc0a6ab0 0x7f9bcc0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:33166/0 (socket says 172.21.15.181:33166) 2024-09-13T10:39:01.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.873+0000 7f9bd1968640 1 -- 172.21.15.181:0/2931191939 learned_addr learned my addr 172.21.15.181:0/2931191939 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:01.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1968640 1 -- 172.21.15.181:0/2931191939 >> v1:172.21.15.181:6792/0 conn(0x7f9bcc0a6ab0 legacy=0x7f9bcc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd296a640 1 -- 172.21.15.181:0/2931191939 >> v1:172.21.15.195:6789/0 conn(0x7f9bcc13f9a0 legacy=0x7f9bcc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd2169640 1 -- 172.21.15.181:0/2931191939 >> v1:172.21.15.195:6791/0 conn(0x7f9bcc0a66d0 legacy=0x7f9bcc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059716858 0 0) 0x7f9bcc0a42c0 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 10 monclient(hunting): my global_id is 134439 2024-09-13T10:39:01.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bb8003520 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052189934 0 0) 0x7f9bcc0a5fe0 con 0x7f9bcc13f9a0 2024-09-13T10:39:01.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 10 monclient(hunting): my global_id is 134479 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bcc0a42c0 con 0x7f9bcc13f9a0 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839187389 0 0) 0x7f9bcc0a8080 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 10 monclient(hunting): my global_id is 105422 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.875+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bcc0a5fe0 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3573910345 0 0) 0x7f9bb8003520 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 >> v1:172.21.15.195:6791/0 conn(0x7f9bcc0a66d0 legacy=0x7f9bcc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 >> v1:172.21.15.195:6789/0 conn(0x7f9bcc13f9a0 legacy=0x7f9bcc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 10 monclient: _finish_hunting 0 2024-09-13T10:39:01.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 1 monclient: found mon.noname-d 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc1464e0 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 10 monclient: _finish_auth 0 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 10 monclient: _check_auth_tickets 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bbc001ad0 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd43cd640 5 monclient: authenticate success, global_id 134439 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd43cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 10 monclient: dump: 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.887 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd43cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9bbc0048a0 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 1 -- 172.21.15.181:0/2931191939 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bbc004e10 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd43cd640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd43cd640 4 set_mon_vals no callback set 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd1167640 10 monclient: dump: 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.889 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd43cd640 10 monclient: shutdown 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd43cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2931191939 >> v1:172.21.15.181:6792/0 conn(0x7f9bcc0a6ab0 legacy=0x7f9bcc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2931191939 shutdown_connections 2024-09-13T10:39:01.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2931191939 >> 172.21.15.181:0/2931191939 conn(0x7f9bcc0abcd0 msgr2=0x7f9bcc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2931191939 shutdown_connections 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.876+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2931191939 wait complete. 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.877+0000 7f9bd43cd640 10 monclient: build_initial_monmap 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.877+0000 7f9bd43cd640 10 monclient: monmap: 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:01.891 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:01.892 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:01.892 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:01.892 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:01.892 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:01.892 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:01.892 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.877+0000 7f9bd43cd640 1 Processor -- start 2024-09-13T10:39:01.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.877+0000 7f9bd43cd640 1 -- start start 2024-09-13T10:39:01.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.877+0000 7f9bd43cd640 10 monclient: init 2024-09-13T10:39:01.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.878+0000 7f9bd43cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.878+0000 7f9bd43cd640 10 monclient: _add_conns ranks=[2,6,1,0,8,5,3,7,4] 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.878+0000 7f9bd43cd640 10 monclient(hunting): picked mon.noname-b con 0x7f9bcc0a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.878+0000 7f9bd43cd640 10 monclient(hunting): picked mon.noname-d con 0x7f9bcc0a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.878+0000 7f9bd43cd640 10 monclient(hunting): picked mon.noname-f con 0x7f9bcc13f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.878+0000 7f9bd43cd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bcc13d1e0 con 0x7f9bcc13f9a0 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.878+0000 7f9bd43cd640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bcc068a90 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.878+0000 7f9bd43cd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bcc1cb9e0 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.878+0000 7f9bd43cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.878+0000 7f9bd43cd640 10 monclient(hunting): authenticate will time out at 1281.383292s 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.878+0000 7f9bd1968640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f9bcc0a6ab0 0x7f9bcc1d36e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:33178/0 (socket says 172.21.15.181:33178) 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.878+0000 7f9bd1968640 1 -- 172.21.15.181:0/2612979108 learned_addr learned my addr 172.21.15.181:0/2612979108 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bd2169640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.181:6790/0 conn(0x7f9bcc0a66d0 legacy=0x7f9bcc0a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bd1968640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.181:6792/0 conn(0x7f9bcc0a6ab0 legacy=0x7f9bcc1d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bd296a640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.195:6789/0 conn(0x7f9bcc13f9a0 legacy=0x7f9bcc1d6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2012674042 0 0) 0x7f9bcc068a90 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): my global_id is 134543 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bb0003520 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180188877 0 0) 0x7f9bcc1cb9e0 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): my global_id is 134448 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bcc068a90 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1096926809 0 0) 0x7f9bcc13d1e0 con 0x7f9bcc13f9a0 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): my global_id is 134488 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bcc1cb9e0 con 0x7f9bcc13f9a0 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 69684429 0 0) 0x7f9bb0003520 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bcc13d1e0 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bc8003610 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): dump: 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.895 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2374738937 0 0) 0x7f9bcc068a90 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bb0003520 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2849280943 0 0) 0x7f9bcc1cb9e0 con 0x7f9bcc13f9a0 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bcc068a90 con 0x7f9bcc13f9a0 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bbc004d90 con 0x7f9bcc0a6ab0 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.880+0000 7f9bc2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient(hunting): dump: 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.897 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bc4002040 con 0x7f9bcc13f9a0 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient(hunting): dump: 2024-09-13T10:39:01.898 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.899 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2112918905 0 0) 0x7f9bcc13d1e0 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.181:6792/0 conn(0x7f9bcc0a6ab0 legacy=0x7f9bcc1d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.195:6789/0 conn(0x7f9bcc13f9a0 legacy=0x7f9bcc1d6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 1 monclient: found mon.b 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc13f540 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient: _finish_auth 0 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bd43cd640 5 monclient: authenticate success, global_id 134543 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bd43cd640 10 monclient: _renew_subs 2024-09-13T10:39:01.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bd43cd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9bcc13dd40 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bd43cd640 10 monclient: _renew_subs 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bd43cd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9bcc0a2680 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9bc8003be0 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bc80040d0 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bd0966640 4 set_mon_vals no callback set 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bc2ffd640 10 monclient: dump: 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.901 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bd43cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:01.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.881+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9bb40065c0 con 0x7f9bb4002860 2024-09-13T10:39:01.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.882+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9bc8004270 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.882+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(282..282 src has 1..282) ==== 3898+0+0 (unknown 3928562045 0 0) 0x7f9bc804e460 con 0x7f9bcc0a66d0 2024-09-13T10:39:01.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.882+0000 7f9bd296a640 10 monclient: get_auth_request con 0x7f9bb0040650 auth_method 0 2024-09-13T10:39:01.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bd1968640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.195:6790/0 conn(0x7f9bb4002860 legacy=0x7f9bb4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2408118160 0 0) 0x7f9bb40065c0 con 0x7f9bb4002860 2024-09-13T10:39:01.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 10 monclient(hunting): my global_id is 164136 2024-09-13T10:39:01.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bcc13d1e0 con 0x7f9bb4002860 2024-09-13T10:39:01.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4003126152 0 0) 0x7f9bcc13d1e0 con 0x7f9bb4002860 2024-09-13T10:39:01.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bb40065c0 con 0x7f9bb4002860 2024-09-13T10:39:01.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bbc0048a0 con 0x7f9bb4002860 2024-09-13T10:39:01.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 10 monclient: dump: 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.907 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3078076259 0 0) 0x7f9bb40065c0 con 0x7f9bb4002860 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.884+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9bb400a160 con 0x7f9bb4002860 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.885+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9bbc005490 con 0x7f9bb4002860 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.885+0000 7f9bc2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.885+0000 7f9bc2ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.885+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.195:6790/0 conn(0x7f9bb4002860 legacy=0x7f9bb4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.885+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.195:6790/0 conn(0x7f9bb4002860 legacy=0x7f9bb4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.891+0000 7f9bd43cd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.891+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9bb4009e70 con 0x7f9bb4009130 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.893+0000 7f9bd1968640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.195:6790/0 conn(0x7f9bb4009130 legacy=0x7f9bb40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:01.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.893+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911517549 0 0) 0x7f9bb4009e70 con 0x7f9bb4009130 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.893+0000 7f9bc2ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.893+0000 7f9bc2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.893+0000 7f9bc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.893+0000 7f9bc2ffd640 10 monclient(hunting): my global_id is 164145 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.893+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bb40065c0 con 0x7f9bb4009130 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2359458845 0 0) 0x7f9bb40065c0 con 0x7f9bb4009130 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bb4009e70 con 0x7f9bb4009130 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9bbc005c30 con 0x7f9bb4009130 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 10 monclient: dump: 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:01.909 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:01.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 395418392 0 0) 0x7f9bb4009e70 con 0x7f9bb4009130 2024-09-13T10:39:01.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9bb400c410 con 0x7f9bb4009130 2024-09-13T10:39:01.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 2498533139) 0x7f9bbc005fc0 con 0x7f9bb4009130 2024-09-13T10:39:01.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:01.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:01.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.195:6790/0 conn(0x7f9bb4009130 legacy=0x7f9bb40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bc2ffd640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.195:6790/0 conn(0x7f9bb4009130 legacy=0x7f9bb40095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:01.911 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:01.911 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 21353, 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:01.912 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.913 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.914 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:01.915 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:01.916 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:01.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.920 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.922 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:01.923 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.924 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.925 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:01.926 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:01.928 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.929 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:01.930 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:01.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:01.930 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:01.930 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:01.930 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:01.930 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:01.930 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:01.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:01.930 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:01.930 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:01.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.195:6800/1839191919 conn(0x7f9bb0040650 legacy=0x7f9bb0042b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bd43cd640 10 monclient: shutdown 2024-09-13T10:39:01.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bd43cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:01.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2612979108 >> v1:172.21.15.181:6790/0 conn(0x7f9bcc0a66d0 legacy=0x7f9bcc0a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:01.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bd296a640 1 -- 172.21.15.181:0/2612979108 reap_dead start 2024-09-13T10:39:01.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bd296a640 1 -- 172.21.15.181:0/2612979108 reap_dead start 2024-09-13T10:39:01.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2612979108 shutdown_connections 2024-09-13T10:39:01.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2612979108 >> 172.21.15.181:0/2612979108 conn(0x7f9bcc0abcd0 msgr2=0x7f9bcc0a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:01.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2612979108 shutdown_connections 2024-09-13T10:39:01.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:01.894+0000 7f9bd43cd640 1 -- 172.21.15.181:0/2612979108 wait complete. 2024-09-13T10:39:01.932 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:01.933 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:39:01.933 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:39:02.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.030+0000 7f0734d1e640 10 monclient: get_monmap_and_config 2024-09-13T10:39:02.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.030+0000 7f0734d1e640 10 monclient: build_initial_monmap 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.030+0000 7f0734d1e640 10 monclient: monmap: 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:02.031046+0000 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:02.031046+0000 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:02.032 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:02.033 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:02.033 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:02.033 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:02.033 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.030+0000 7f0734d1e640 1 Processor -- start 2024-09-13T10:39:02.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f0734d1e640 1 -- start start 2024-09-13T10:39:02.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f0734d1e640 10 monclient: init 2024-09-13T10:39:02.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f0734d1e640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:02.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f0734d1e640 10 monclient: _add_conns ranks=[8,4,5,6,7,0,3,2,1] 2024-09-13T10:39:02.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f0734d1e640 10 monclient(hunting): picked mon.noname-e con 0x7f07300a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:02.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f0734d1e640 10 monclient(hunting): picked mon.noname-c con 0x7f07300a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:02.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f0734d1e640 10 monclient(hunting): picked mon.noname-h con 0x7f073013f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:02.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f0734d1e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07300a4bc0 con 0x7f07300a8340 2024-09-13T10:39:02.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f0734d1e640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f073013a320 con 0x7f073013f750 2024-09-13T10:39:02.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f0734d1e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07300a8100 con 0x7f07300a6640 2024-09-13T10:39:02.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f0734d1e640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:02.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f0734d1e640 10 monclient(hunting): authenticate will time out at 1281.536684s 2024-09-13T10:39:02.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f072e59c640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f07300a6640 0x7f0730139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:48604/0 (socket says 172.21.15.181:48604) 2024-09-13T10:39:02.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.031+0000 7f072e59c640 1 -- 172.21.15.181:0/401122840 learned_addr learned my addr 172.21.15.181:0/401122840 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:02.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.033+0000 7f072e59c640 1 -- 172.21.15.181:0/401122840 >> v1:172.21.15.181:6793/0 conn(0x7f07300a6640 legacy=0x7f0730139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.033+0000 7f072dd9b640 1 -- 172.21.15.181:0/401122840 >> v1:172.21.15.181:6791/0 conn(0x7f07300a8340 legacy=0x7f0730139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381942570 0 0) 0x7f07300a8100 con 0x7f07300a6640 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient(hunting): my global_id is 105596 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0718003520 con 0x7f07300a6640 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014414500 0 0) 0x7f07300a4bc0 con 0x7f07300a8340 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient(hunting): my global_id is 115285 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07300a8100 con 0x7f07300a8340 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072ed9d640 1 -- 172.21.15.181:0/401122840 >> v1:172.21.15.195:6791/0 conn(0x7f073013f750 legacy=0x7f0730141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 626713195 0 0) 0x7f073013a320 con 0x7f073013f750 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient(hunting): my global_id is 105431 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07300a4bc0 con 0x7f073013f750 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1183712171 0 0) 0x7f0718003520 con 0x7f07300a6640 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 >> v1:172.21.15.195:6791/0 conn(0x7f073013f750 legacy=0x7f0730141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 >> v1:172.21.15.181:6791/0 conn(0x7f07300a8340 legacy=0x7f0730139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient: _finish_hunting 0 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 monclient: found mon.noname-e 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:02.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07300a48e0 con 0x7f07300a6640 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient: _finish_auth 0 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient: _check_auth_tickets 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0720001ae0 con 0x7f07300a6640 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient: dump: 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.041 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f0734d1e640 5 monclient: authenticate success, global_id 105596 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f0734d1e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f07200048a0 con 0x7f07300a6640 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 1 -- 172.21.15.181:0/401122840 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0720004d90 con 0x7f07300a6640 2024-09-13T10:39:02.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f0734d1e640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f0734d1e640 4 set_mon_vals no callback set 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f072d59a640 10 monclient: dump: 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.043 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.044 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.044 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.044 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.044 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.044 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f0734d1e640 10 monclient: shutdown 2024-09-13T10:39:02.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f0734d1e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:02.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.034+0000 7f0734d1e640 1 -- 172.21.15.181:0/401122840 >> v1:172.21.15.181:6793/0 conn(0x7f07300a6640 legacy=0x7f0730139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.035+0000 7f0734d1e640 1 -- 172.21.15.181:0/401122840 shutdown_connections 2024-09-13T10:39:02.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.035+0000 7f0734d1e640 1 -- 172.21.15.181:0/401122840 >> 172.21.15.181:0/401122840 conn(0x7f0730077170 msgr2=0x7f07300abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.035+0000 7f0734d1e640 1 -- 172.21.15.181:0/401122840 shutdown_connections 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.035+0000 7f0734d1e640 1 -- 172.21.15.181:0/401122840 wait complete. 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.035+0000 7f0734d1e640 10 monclient: build_initial_monmap 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.035+0000 7f0734d1e640 10 monclient: monmap: 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:02.045 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 1 Processor -- start 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 1 -- start start 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 10 monclient: init 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 10 monclient: _add_conns ranks=[6,4,0,3,8,2,5,1,7] 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 10 monclient(hunting): picked mon.noname-d con 0x7f07300a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 10 monclient(hunting): picked mon.noname-c con 0x7f073013f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 10 monclient(hunting): picked mon.noname-a con 0x7f07300a1d80 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:02.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0730139310 con 0x7f07300a1d80 2024-09-13T10:39:02.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07300a9db0 con 0x7f073013f750 2024-09-13T10:39:02.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0730142e60 con 0x7f07300a8340 2024-09-13T10:39:02.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:02.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f0734d1e640 10 monclient(hunting): authenticate will time out at 1281.541751s 2024-09-13T10:39:02.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f072e59c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f07300a8340 0x7f07301384f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:33192/0 (socket says 172.21.15.181:33192) 2024-09-13T10:39:02.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f072dd9b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f073013f750 0x7f0730138c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:49742/0 (socket says 172.21.15.181:49742) 2024-09-13T10:39:02.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.036+0000 7f072e59c640 1 -- 172.21.15.181:0/385499638 learned_addr learned my addr 172.21.15.181:0/385499638 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:02.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.038+0000 7f072dd9b640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.181:6791/0 conn(0x7f073013f750 legacy=0x7f0730138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.038+0000 7f072e59c640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.181:6792/0 conn(0x7f07300a8340 legacy=0x7f07301384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.038+0000 7f072ed9d640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.181:6789/0 conn(0x7f07300a1d80 legacy=0x7f07301d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1746174860 0 0) 0x7f07300a9db0 con 0x7f073013f750 2024-09-13T10:39:02.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): my global_id is 115294 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0710003550 con 0x7f073013f750 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082784353 0 0) 0x7f0730142e60 con 0x7f07300a8340 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): my global_id is 134457 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07300a9db0 con 0x7f07300a8340 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838916086 0 0) 0x7f0730139310 con 0x7f07300a1d80 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): my global_id is 115245 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0730142e60 con 0x7f07300a1d80 2024-09-13T10:39:02.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 105918234 0 0) 0x7f07300a9db0 con 0x7f07300a8340 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0730139310 con 0x7f07300a8340 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0720004d90 con 0x7f07300a8340 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): dump: 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.054 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4012469236 0 0) 0x7f0710003550 con 0x7f073013f750 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07300a9db0 con 0x7f073013f750 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 571138513 0 0) 0x7f0730142e60 con 0x7f07300a1d80 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0710003550 con 0x7f07300a1d80 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f07240036b0 con 0x7f073013f750 2024-09-13T10:39:02.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): dump: 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.056 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0728002070 con 0x7f07300a1d80 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient(hunting): dump: 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.057 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2892235242 0 0) 0x7f0730139310 con 0x7f07300a8340 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.181:6791/0 conn(0x7f073013f750 legacy=0x7f0730138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.181:6789/0 conn(0x7f07300a1d80 legacy=0x7f07301d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 monclient: found mon.d 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073009f260 con 0x7f07300a8340 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient: _finish_auth 0 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f0734d1e640 5 monclient: authenticate success, global_id 134457 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2277119628 0 0) 0x7f07300a9db0 con 0x7f073013f750 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f0734d1e640 10 monclient: _renew_subs 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f0734d1e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f0734d1e640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f07300a12e0 con 0x7f07300a8340 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2918402472 0 0) 0x7f0710003550 con 0x7f07300a1d80 2024-09-13T10:39:02.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f0734d1e640 10 monclient: _renew_subs 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f0734d1e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f0734d1e640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f073009fdc0 con 0x7f07300a8340 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0720001a80 con 0x7f07300a8340 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0720004880 con 0x7f07300a8340 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f072cd99640 4 set_mon_vals no callback set 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.039+0000 7f071effd640 10 monclient: dump: 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.060 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.040+0000 7f0734d1e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.040+0000 7f0734d1e640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f07140065c0 con 0x7f0714002860 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.040+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0720011ba0 con 0x7f07300a8340 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.040+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(282..282 src has 1..282) ==== 3898+0+0 (unknown 3928562045 0 0) 0x7f072004e370 con 0x7f07300a8340 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.041+0000 7f072ed9d640 10 monclient: get_auth_request con 0x7f0710040490 auth_method 0 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.042+0000 7f072dd9b640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.195:6791/0 conn(0x7f0714002860 legacy=0x7f0714004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2648399780 0 0) 0x7f07140065c0 con 0x7f0714002860 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 10 monclient(hunting): my global_id is 105440 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0710003550 con 0x7f0714002860 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3930220718 0 0) 0x7f0710003550 con 0x7f0714002860 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07140065c0 con 0x7f0714002860 2024-09-13T10:39:02.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f07240040f0 con 0x7f0714002860 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 10 monclient: dump: 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.063 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3984019826 0 0) 0x7f07140065c0 con 0x7f0714002860 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f071400a160 con 0x7f0714002860 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f07240057c0 con 0x7f0714002860 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.195:6791/0 conn(0x7f0714002860 legacy=0x7f0714004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.043+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.195:6791/0 conn(0x7f0714002860 legacy=0x7f0714004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.049+0000 7f0734d1e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:02.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.049+0000 7f0734d1e640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0714009e50 con 0x7f0714009110 2024-09-13T10:39:02.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f072dd9b640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.195:6791/0 conn(0x7f0714009110 legacy=0x7f07140095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192290611 0 0) 0x7f0714009e50 con 0x7f0714009110 2024-09-13T10:39:02.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 10 monclient(hunting): my global_id is 105449 2024-09-13T10:39:02.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07140065c0 con 0x7f0714009110 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3422745961 0 0) 0x7f07140065c0 con 0x7f0714009110 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0714009e50 con 0x7f0714009110 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0724005ea0 con 0x7f0714009110 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 10 monclient: dump: 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.067 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2131195625 0 0) 0x7f0714009e50 con 0x7f0714009110 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.052+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f071400c3a0 con 0x7f0714009110 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 1629876366) 0x7f07240081e0 con 0x7f0714009110 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f071effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:02.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f071effd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:02.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.195:6791/0 conn(0x7f0714009110 legacy=0x7f07140095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f071effd640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.195:6791/0 conn(0x7f0714009110 legacy=0x7f07140095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:02.069 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:02.069 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:02.069 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:02.069 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:02.069 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:02.069 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 225752, 2024-09-13T10:39:02.069 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:02.069 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:02.070 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:02.072 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:02.073 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.074 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:02.075 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.076 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:02.079 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.080 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.082 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.083 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.084 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:39:02.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.088 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:02.088 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:02.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.088 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:02.088 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:02.088 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:02.088 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.088 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.088 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:02.088 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:02.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f0734d1e640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0710040490 legacy=0x7f0710042950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f0734d1e640 10 monclient: shutdown 2024-09-13T10:39:02.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f0734d1e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:02.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f0734d1e640 1 -- 172.21.15.181:0/385499638 >> v1:172.21.15.181:6792/0 conn(0x7f07300a8340 legacy=0x7f07301384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f072ed9d640 1 -- 172.21.15.181:0/385499638 reap_dead start 2024-09-13T10:39:02.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f072ed9d640 1 -- 172.21.15.181:0/385499638 reap_dead start 2024-09-13T10:39:02.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f0734d1e640 1 -- 172.21.15.181:0/385499638 shutdown_connections 2024-09-13T10:39:02.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f0734d1e640 1 -- 172.21.15.181:0/385499638 >> 172.21.15.181:0/385499638 conn(0x7f07300a6640 msgr2=0x7f073013eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:02.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f0734d1e640 1 -- 172.21.15.181:0/385499638 shutdown_connections 2024-09-13T10:39:02.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.053+0000 7f0734d1e640 1 -- 172.21.15.181:0/385499638 wait complete. 2024-09-13T10:39:02.091 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:02.091 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:39:02.091 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:39:02.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.188+0000 7f728b050640 10 monclient: get_monmap_and_config 2024-09-13T10:39:02.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.188+0000 7f728b050640 10 monclient: build_initial_monmap 2024-09-13T10:39:02.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.188+0000 7f728b050640 10 monclient: monmap: 2024-09-13T10:39:02.190 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:02.190 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.190 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:02.189133+0000 2024-09-13T10:39:02.190 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:02.189133+0000 2024-09-13T10:39:02.190 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:02.190 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.190 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:02.190 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:02.190 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:02.191 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:02.191 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:02.191 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:02.191 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:02.191 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:02.191 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:02.191 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 1 Processor -- start 2024-09-13T10:39:02.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 1 -- start start 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 10 monclient: init 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 10 monclient: _add_conns ranks=[3,5,4,0,2,6,8,1,7] 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 10 monclient(hunting): picked mon.noname-g con 0x7f7284139040 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 10 monclient(hunting): picked mon.noname-h con 0x7f728409cd50 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 10 monclient(hunting): picked mon.noname-c con 0x7f728413fae0 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f728409dbb0 con 0x7f7284139040 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f728409de90 con 0x7f728413fae0 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f728409e170 con 0x7f728409cd50 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f728b050640 10 monclient(hunting): authenticate will time out at 1281.694859s 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f72895ed640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f728413fae0 0x7f7284141ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:49758/0 (socket says 172.21.15.181:49758) 2024-09-13T10:39:02.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.189+0000 7f72895ed640 1 -- 172.21.15.181:0/1871204066 learned_addr learned my addr 172.21.15.181:0/1871204066 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:02.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72895ed640 1 -- 172.21.15.181:0/1871204066 >> v1:172.21.15.181:6791/0 conn(0x7f728413fae0 legacy=0x7f7284141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f7288dec640 1 -- 172.21.15.181:0/1871204066 >> v1:172.21.15.195:6790/0 conn(0x7f7284139040 legacy=0x7f72840a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f7283fff640 1 -- 172.21.15.181:0/1871204066 >> v1:172.21.15.195:6791/0 conn(0x7f728409cd50 legacy=0x7f728413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2970962408 0 0) 0x7f728409de90 con 0x7f728413fae0 2024-09-13T10:39:02.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient(hunting): my global_id is 115303 2024-09-13T10:39:02.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7274003520 con 0x7f728413fae0 2024-09-13T10:39:02.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558278688 0 0) 0x7f728409dbb0 con 0x7f7284139040 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient(hunting): my global_id is 164154 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f728409de90 con 0x7f7284139040 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3538955867 0 0) 0x7f728409e170 con 0x7f728409cd50 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient(hunting): my global_id is 105458 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f728409dbb0 con 0x7f728409cd50 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2119817388 0 0) 0x7f7274003520 con 0x7f728413fae0 2024-09-13T10:39:02.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 >> v1:172.21.15.195:6791/0 conn(0x7f728409cd50 legacy=0x7f728413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 >> v1:172.21.15.195:6790/0 conn(0x7f7284139040 legacy=0x7f72840a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 monclient: found mon.noname-c 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72840a5ff0 con 0x7f728413fae0 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f727c001e60 con 0x7f728413fae0 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f728b050640 5 monclient: authenticate success, global_id 115303 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f728b050640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:02.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient: dump: 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.204 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.205 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.205 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.205 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f728b050640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:02.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f727c004c20 con 0x7f728413fae0 2024-09-13T10:39:02.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 1 -- 172.21.15.181:0/1871204066 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f727c005190 con 0x7f728413fae0 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f72837fe640 10 monclient: dump: 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.206 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f728b050640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.192+0000 7f728b050640 4 set_mon_vals no callback set 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.193+0000 7f728b050640 10 monclient: shutdown 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.193+0000 7f728b050640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.193+0000 7f728b050640 1 -- 172.21.15.181:0/1871204066 >> v1:172.21.15.181:6791/0 conn(0x7f728413fae0 legacy=0x7f7284141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.193+0000 7f728b050640 1 -- 172.21.15.181:0/1871204066 shutdown_connections 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.193+0000 7f728b050640 1 -- 172.21.15.181:0/1871204066 >> 172.21.15.181:0/1871204066 conn(0x7f7284077120 msgr2=0x7f72840abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.193+0000 7f728b050640 1 -- 172.21.15.181:0/1871204066 shutdown_connections 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.193+0000 7f728b050640 1 -- 172.21.15.181:0/1871204066 wait complete. 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.193+0000 7f728b050640 10 monclient: build_initial_monmap 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.193+0000 7f728b050640 10 monclient: monmap: 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:02.208 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 1 Processor -- start 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 1 -- start start 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 10 monclient: init 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:02.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 10 monclient: _add_conns ranks=[6,1,7,4,3,5,0,2,8] 2024-09-13T10:39:02.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 10 monclient(hunting): picked mon.noname-d con 0x7f728409cd50 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:02.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 10 monclient(hunting): picked mon.noname-f con 0x7f7284139040 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:02.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 10 monclient(hunting): picked mon.noname-i con 0x7f728413fae0 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:02.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f728413e900 con 0x7f7284139040 2024-09-13T10:39:02.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72840a57a0 con 0x7f728409cd50 2024-09-13T10:39:02.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f728413c5a0 con 0x7f728413fae0 2024-09-13T10:39:02.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:02.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f728b050640 10 monclient(hunting): authenticate will time out at 1281.699897s 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f7288dec640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f728409cd50 0x7f728413ab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:33200/0 (socket says 172.21.15.181:33200) 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.194+0000 7f7288dec640 1 -- 172.21.15.181:0/1966601654 learned_addr learned my addr 172.21.15.181:0/1966601654 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f7288dec640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.181:6792/0 conn(0x7f728409cd50 legacy=0x7f728413ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012654772 0 0) 0x7f72840a57a0 con 0x7f728409cd50 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): my global_id is 134466 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7268003520 con 0x7f728409cd50 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72895ed640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.195:6792/0 conn(0x7f728413fae0 legacy=0x7f728413b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f7283fff640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.195:6789/0 conn(0x7f7284139040 legacy=0x7f728413b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2724300354 0 0) 0x7f7268003520 con 0x7f728409cd50 2024-09-13T10:39:02.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72840a57a0 con 0x7f728409cd50 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7278003610 con 0x7f728409cd50 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): dump: 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.212 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115139956 0 0) 0x7f728413c5a0 con 0x7f728413fae0 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.213 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): my global_id is 57490 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7268003520 con 0x7f728413fae0 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2045105972 0 0) 0x7f728413e900 con 0x7f7284139040 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient(hunting): my global_id is 134497 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f728413c5a0 con 0x7f7284139040 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1991287607 0 0) 0x7f72840a57a0 con 0x7f728409cd50 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.195:6792/0 conn(0x7f728413fae0 legacy=0x7f728413b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.195:6789/0 conn(0x7f7284139040 legacy=0x7f728413b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient: _finish_hunting 0 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 monclient: found mon.d 2024-09-13T10:39:02.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728413e060 con 0x7f728409cd50 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient: _finish_auth 0 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient: _check_auth_tickets 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f728b050640 5 monclient: authenticate success, global_id 134466 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f728b050640 10 monclient: _renew_subs 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f728b050640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f728b050640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f728413ed20 con 0x7f728409cd50 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f728b050640 10 monclient: _renew_subs 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f728b050640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f728b050640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f72841d78a0 con 0x7f728409cd50 2024-09-13T10:39:02.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7278003c80 con 0x7f728409cd50 2024-09-13T10:39:02.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:02.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7278004170 con 0x7f728409cd50 2024-09-13T10:39:02.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f7282ffd640 4 set_mon_vals no callback set 2024-09-13T10:39:02.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:02.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.197+0000 7f72817fa640 10 monclient: dump: 2024-09-13T10:39:02.216 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.216 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.216 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.216 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.216 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.216 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.198+0000 7f728b050640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.198+0000 7f728b050640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f72640065c0 con 0x7f7264002860 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.198+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7278004310 con 0x7f728409cd50 2024-09-13T10:39:02.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.198+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(282..282 src has 1..282) ==== 3898+0+0 (unknown 3928562045 0 0) 0x7f727804e500 con 0x7f728409cd50 2024-09-13T10:39:02.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.198+0000 7f72895ed640 10 monclient: get_auth_request con 0x7f726803fd60 auth_method 0 2024-09-13T10:39:02.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.200+0000 7f7283fff640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.195:6792/0 conn(0x7f7264002860 legacy=0x7f7264004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.200+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213702009 0 0) 0x7f72640065c0 con 0x7f7264002860 2024-09-13T10:39:02.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.200+0000 7f72817fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.200+0000 7f72817fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.200+0000 7f72817fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.200+0000 7f72817fa640 10 monclient(hunting): my global_id is 57499 2024-09-13T10:39:02.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.200+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72840a57a0 con 0x7f7264002860 2024-09-13T10:39:02.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.200+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2074337245 0 0) 0x7f72840a57a0 con 0x7f7264002860 2024-09-13T10:39:02.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.200+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72640065c0 con 0x7f7264002860 2024-09-13T10:39:02.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.200+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7270001c10 con 0x7f7264002860 2024-09-13T10:39:02.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.200+0000 7f72817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.200+0000 7f72817fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.201+0000 7f72817fa640 10 monclient: dump: 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.222 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.201+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 267605529 0 0) 0x7f72640065c0 con 0x7f7264002860 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.201+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f726400a160 con 0x7f7264002860 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.201+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f72700057c0 con 0x7f7264002860 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.201+0000 7f72817fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.201+0000 7f72817fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.201+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.195:6792/0 conn(0x7f7264002860 legacy=0x7f7264004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.201+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.195:6792/0 conn(0x7f7264002860 legacy=0x7f7264004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.207+0000 7f728b050640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:02.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.207+0000 7f728b050640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7264009e50 con 0x7f7264009110 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.209+0000 7f7283fff640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.195:6792/0 conn(0x7f7264009110 legacy=0x7f72640095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2826344637 0 0) 0x7f7264009e50 con 0x7f7264009110 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 10 monclient(hunting): my global_id is 57508 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72640065c0 con 0x7f7264009110 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1648418125 0 0) 0x7f72640065c0 con 0x7f7264009110 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7264009e50 con 0x7f7264009110 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7270003e00 con 0x7f7264009110 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 10 monclient: dump: 2024-09-13T10:39:02.224 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.225 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.226 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.226 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4034500820 0 0) 0x7f7264009e50 con 0x7f7264009110 2024-09-13T10:39:02.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f726400c3f0 con 0x7f7264009110 2024-09-13T10:39:02.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7729 (unknown 0 0 3420928287) 0x7f7270004020 con 0x7f7264009110 2024-09-13T10:39:02.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:02.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:02.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.195:6792/0 conn(0x7f7264009110 legacy=0x7f72640095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72817fa640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.195:6792/0 conn(0x7f7264009110 legacy=0x7f72640095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:02.226 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:39:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 556630, 2024-09-13T10:39:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:39:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:02.248 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:02.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f728b050640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.195:6800/1839191919 conn(0x7f726803fd60 legacy=0x7f7268042220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f728b050640 10 monclient: shutdown 2024-09-13T10:39:02.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f728b050640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:02.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f728b050640 1 -- 172.21.15.181:0/1966601654 >> v1:172.21.15.181:6792/0 conn(0x7f728409cd50 legacy=0x7f728413ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72895ed640 1 -- 172.21.15.181:0/1966601654 reap_dead start 2024-09-13T10:39:02.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.210+0000 7f72895ed640 1 -- 172.21.15.181:0/1966601654 reap_dead start 2024-09-13T10:39:02.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.211+0000 7f728b050640 1 -- 172.21.15.181:0/1966601654 shutdown_connections 2024-09-13T10:39:02.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.211+0000 7f728b050640 1 -- 172.21.15.181:0/1966601654 >> 172.21.15.181:0/1966601654 conn(0x7f7284077120 msgr2=0x7f72841379a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:02.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.211+0000 7f728b050640 1 -- 172.21.15.181:0/1966601654 shutdown_connections 2024-09-13T10:39:02.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.211+0000 7f728b050640 1 -- 172.21.15.181:0/1966601654 wait complete. 2024-09-13T10:39:02.250 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:02.250 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T10:39:02.251 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T10:39:02.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.346+0000 7f28f6e50640 10 monclient: get_monmap_and_config 2024-09-13T10:39:02.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.346+0000 7f28f6e50640 10 monclient: build_initial_monmap 2024-09-13T10:39:02.348 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.346+0000 7f28f6e50640 10 monclient: monmap: 2024-09-13T10:39:02.348 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:02.348 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.348 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:02.346795+0000 2024-09-13T10:39:02.348 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:02.346795+0000 2024-09-13T10:39:02.348 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:02.348 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.348 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:02.348 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:02.348 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:02.348 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:02.348 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:02.349 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:02.349 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:02.349 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:02.349 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:02.349 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.346+0000 7f28f6e50640 1 Processor -- start 2024-09-13T10:39:02.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.346+0000 7f28f6e50640 1 -- start start 2024-09-13T10:39:02.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.346+0000 7f28f6e50640 10 monclient: init 2024-09-13T10:39:02.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28f6e50640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:02.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28f6e50640 10 monclient: _add_conns ranks=[8,2,0,7,5,4,1,6,3] 2024-09-13T10:39:02.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28f6e50640 10 monclient(hunting): picked mon.noname-e con 0x7f28f00a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:02.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28f6e50640 10 monclient(hunting): picked mon.noname-b con 0x7f28f00a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:02.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28f6e50640 10 monclient(hunting): picked mon.noname-a con 0x7f28f013f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:02.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28f6e50640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f00a5fe0 con 0x7f28f013f9a0 2024-09-13T10:39:02.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28f6e50640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f00a8080 con 0x7f28f00a6ab0 2024-09-13T10:39:02.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28f6e50640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f00a42c0 con 0x7f28f00a66d0 2024-09-13T10:39:02.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28f6e50640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:02.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28f6e50640 10 monclient(hunting): authenticate will time out at 1281.852556s 2024-09-13T10:39:02.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28effff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f28f00a6ab0 0x7f28f00a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:56304/0 (socket says 172.21.15.181:56304) 2024-09-13T10:39:02.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28f53ed640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f28f013f9a0 0x7f28f0141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:52116/0 (socket says 172.21.15.181:52116) 2024-09-13T10:39:02.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.347+0000 7f28effff640 1 -- 172.21.15.181:0/2557071161 learned_addr learned my addr 172.21.15.181:0/2557071161 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:02.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.349+0000 7f28f53ed640 1 -- 172.21.15.181:0/2557071161 >> v1:172.21.15.181:6789/0 conn(0x7f28f013f9a0 legacy=0x7f28f0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.349+0000 7f28f4bec640 1 -- 172.21.15.181:0/2557071161 >> v1:172.21.15.181:6793/0 conn(0x7f28f00a66d0 legacy=0x7f28f00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.349+0000 7f28effff640 1 -- 172.21.15.181:0/2557071161 >> v1:172.21.15.181:6790/0 conn(0x7f28f00a6ab0 legacy=0x7f28f00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859535028 0 0) 0x7f28f00a5fe0 con 0x7f28f013f9a0 2024-09-13T10:39:02.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient(hunting): my global_id is 115254 2024-09-13T10:39:02.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28e0003520 con 0x7f28f013f9a0 2024-09-13T10:39:02.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3822604861 0 0) 0x7f28f00a42c0 con 0x7f28f00a66d0 2024-09-13T10:39:02.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient(hunting): my global_id is 105605 2024-09-13T10:39:02.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28f00a5fe0 con 0x7f28f00a66d0 2024-09-13T10:39:02.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469955251 0 0) 0x7f28f00a8080 con 0x7f28f00a6ab0 2024-09-13T10:39:02.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient(hunting): my global_id is 134552 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28f00a42c0 con 0x7f28f00a6ab0 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4064116258 0 0) 0x7f28e0003520 con 0x7f28f013f9a0 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 >> v1:172.21.15.181:6793/0 conn(0x7f28f00a66d0 legacy=0x7f28f00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 >> v1:172.21.15.181:6790/0 conn(0x7f28f00a6ab0 legacy=0x7f28f00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 monclient: found mon.noname-a 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f01464e0 con 0x7f28f013f9a0 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:02.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28e8001e50 con 0x7f28f013f9a0 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient: dump: 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.358 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.359 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.359 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.359 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.359 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.359 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.359 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.359 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28f6e50640 5 monclient: authenticate success, global_id 115254 2024-09-13T10:39:02.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28f6e50640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:02.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28e8004b60 con 0x7f28f013f9a0 2024-09-13T10:39:02.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:02.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 1 -- 172.21.15.181:0/2557071161 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28e8005050 con 0x7f28f013f9a0 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28f6e50640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28f6e50640 4 set_mon_vals no callback set 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.350+0000 7f28ef7fe640 10 monclient: dump: 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.360 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.361 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.361 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.361 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.361 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.361 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.361 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.361 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.361 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.351+0000 7f28f6e50640 10 monclient: shutdown 2024-09-13T10:39:02.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.351+0000 7f28f6e50640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:02.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.351+0000 7f28f6e50640 1 -- 172.21.15.181:0/2557071161 >> v1:172.21.15.181:6789/0 conn(0x7f28f013f9a0 legacy=0x7f28f0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.351+0000 7f28f6e50640 1 -- 172.21.15.181:0/2557071161 shutdown_connections 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.351+0000 7f28f6e50640 1 -- 172.21.15.181:0/2557071161 >> 172.21.15.181:0/2557071161 conn(0x7f28f00abcd0 msgr2=0x7f28f00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.351+0000 7f28f6e50640 1 -- 172.21.15.181:0/2557071161 shutdown_connections 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.351+0000 7f28f6e50640 1 -- 172.21.15.181:0/2557071161 wait complete. 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.351+0000 7f28f6e50640 10 monclient: build_initial_monmap 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.351+0000 7f28f6e50640 10 monclient: monmap: 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:02.362 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:02.363 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:02.363 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:02.363 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:02.363 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:02.363 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:02.363 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:02.363 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:02.363 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 1 Processor -- start 2024-09-13T10:39:02.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 1 -- start start 2024-09-13T10:39:02.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 10 monclient: init 2024-09-13T10:39:02.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:02.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 10 monclient: _add_conns ranks=[7,2,0,5,3,6,1,4,8] 2024-09-13T10:39:02.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 10 monclient(hunting): picked mon.noname-i con 0x7f28f00a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:02.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 10 monclient(hunting): picked mon.noname-b con 0x7f28f00a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:02.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 10 monclient(hunting): picked mon.noname-a con 0x7f28f013f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:02.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f013f060 con 0x7f28f013f9a0 2024-09-13T10:39:02.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f01393f0 con 0x7f28f00a6ab0 2024-09-13T10:39:02.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f0139030 con 0x7f28f00a66d0 2024-09-13T10:39:02.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:02.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f6e50640 10 monclient(hunting): authenticate will time out at 1281.857706s 2024-09-13T10:39:02.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28effff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f28f00a6ab0 0x7f28f013b920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:56316/0 (socket says 172.21.15.181:56316) 2024-09-13T10:39:02.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28f53ed640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f28f013f9a0 0x7f28f01d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:52118/0 (socket says 172.21.15.181:52118) 2024-09-13T10:39:02.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.352+0000 7f28effff640 1 -- 172.21.15.181:0/2515506810 learned_addr learned my addr 172.21.15.181:0/2515506810 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:02.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.354+0000 7f28f53ed640 1 -- 172.21.15.181:0/2515506810 >> v1:172.21.15.181:6789/0 conn(0x7f28f013f9a0 legacy=0x7f28f01d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.354+0000 7f28effff640 1 -- 172.21.15.181:0/2515506810 >> v1:172.21.15.181:6790/0 conn(0x7f28f00a6ab0 legacy=0x7f28f013b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2587676476 0 0) 0x7f28f013f060 con 0x7f28f013f9a0 2024-09-13T10:39:02.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): my global_id is 115263 2024-09-13T10:39:02.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28d4003520 con 0x7f28f013f9a0 2024-09-13T10:39:02.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28f4bec640 1 -- 172.21.15.181:0/2515506810 >> v1:172.21.15.195:6792/0 conn(0x7f28f00a66d0 legacy=0x7f28f013b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:02.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200419723 0 0) 0x7f28f01393f0 con 0x7f28f00a6ab0 2024-09-13T10:39:02.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): my global_id is 134561 2024-09-13T10:39:02.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28f013f060 con 0x7f28f00a6ab0 2024-09-13T10:39:02.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676985289 0 0) 0x7f28f0139030 con 0x7f28f00a66d0 2024-09-13T10:39:02.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:02.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:02.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:02.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): my global_id is 57517 2024-09-13T10:39:02.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28f01393f0 con 0x7f28f00a66d0 2024-09-13T10:39:02.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 839445019 0 0) 0x7f28f013f060 con 0x7f28f00a6ab0 2024-09-13T10:39:02.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28f0139030 con 0x7f28f00a6ab0 2024-09-13T10:39:02.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28dc0047e0 con 0x7f28f00a6ab0 2024-09-13T10:39:02.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:02.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:02.372 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): dump: 2024-09-13T10:39:02.372 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.372 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.372 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.372 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.372 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:02.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1948504789 0 0) 0x7f28d4003520 con 0x7f28f013f9a0 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28f013f060 con 0x7f28f013f9a0 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28e80020a0 con 0x7f28f013f9a0 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient(hunting): dump: 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.374 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.375 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.375 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.375 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.375 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.375 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.375 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.375 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.375 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2942968293 0 0) 0x7f28f01393f0 con 0x7f28f00a66d0 2024-09-13T10:39:02.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28d4003520 con 0x7f28f00a66d0 2024-09-13T10:39:02.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2484494831 0 0) 0x7f28f0139030 con 0x7f28f00a6ab0 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 >> v1:172.21.15.195:6792/0 conn(0x7f28f00a66d0 legacy=0x7f28f013b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 >> v1:172.21.15.181:6789/0 conn(0x7f28f013f9a0 legacy=0x7f28f01d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 monclient: found mon.b 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f013e1f0 con 0x7f28f00a6ab0 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient: _finish_auth 0 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28f6e50640 5 monclient: authenticate success, global_id 134561 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28f6e50640 10 monclient: _renew_subs 2024-09-13T10:39:02.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28f6e50640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:02.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28f6e50640 1 -- 172.21.15.181:0/2515506810 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f28f013c030 con 0x7f28f00a6ab0 2024-09-13T10:39:02.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28f6e50640 10 monclient: _renew_subs 2024-09-13T10:39:02.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28f6e50640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:02.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28f6e50640 1 -- 172.21.15.181:0/2515506810 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f28f00a28a0 con 0x7f28f00a6ab0 2024-09-13T10:39:02.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28dc004c30 con 0x7f28f00a6ab0 2024-09-13T10:39:02.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:02.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28dc005120 con 0x7f28f00a6ab0 2024-09-13T10:39:02.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:02.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28eeffd640 4 set_mon_vals no callback set 2024-09-13T10:39:02.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.355+0000 7f28ed7fa640 10 monclient: dump: 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:02.378 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:02.379 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:02.379 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:02.379 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:02.379 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:02.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.356+0000 7f28f6e50640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:02.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.356+0000 7f28f6e50640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:02.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.356+0000 7f28f6e50640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:02.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.356+0000 7f28f6e50640 1 -- 172.21.15.181:0/2515506810 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d0005080 con 0x7f28f00a6ab0 2024-09-13T10:39:02.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.356+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f28dc0052c0 con 0x7f28f00a6ab0 2024-09-13T10:39:02.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.356+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(282..282 src has 1..282) ==== 3898+0+0 (unknown 3928562045 0 0) 0x7f28dc04e270 con 0x7f28f00a6ab0 2024-09-13T10:39:02.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.356+0000 7f28f4bec640 10 monclient: get_auth_request con 0x7f28d40403c0 auth_method 0 2024-09-13T10:39:02.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.360+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f28dc017760 con 0x7f28f00a6ab0 2024-09-13T10:39:02.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.361+0000 7f28ed7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:02.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.361+0000 7f28ed7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:02.568 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40381]: starting. 2024-09-13T10:39:02.568 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40381]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40379 2024-09-13T10:39:02.568 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40381]: shutting down. 2024-09-13T10:39:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.612+0000 7f28f6e50640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-13T10:39:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.612+0000 7f28f6e50640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-13T10:39:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.612+0000 7f28f6e50640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:02.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.612+0000 7f28f6e50640 1 -- 172.21.15.181:0/2515506810 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f28d0005c40 con 0x7f28f00a6ab0 2024-09-13T10:39:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.614+0000 7f28ed7fa640 1 -- 172.21.15.181:0/2515506810 <== mon.2 v1:172.21.15.181:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f28dc017060 con 0x7f28f00a6ab0 2024-09-13T10:39:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.614+0000 7f28ed7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-13T10:39:02.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.614+0000 7f28ed7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:02.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=11,kv=12,logm=52} crc {auth=3911899260,config=2586702516,health=4108416964,kv=3467323233,logm=1487040593}) 2024-09-13T10:39:02.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=24,config=2,health=12,kv=11,logm=51} crc {auth=2859027341,config=2586702516,health=1840767641,kv=286407082,logm=3660290552}) 2024-09-13T10:39:02.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.617 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=11,kv=12,logm=52} crc {auth=3911899260,config=2586702516,health=4108416964,kv=3467323233,logm=1487040593}) 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=23,config=2,health=11,kv=12,logm=52} crc {auth=435040002,config=2586702516,health=1708225859,kv=3467323233,logm=3241066680}) 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=11,kv=12,logm=52} crc {auth=3911899260,config=2586702516,health=4108416964,kv=3467323233,logm=1487040593}) 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=23,config=2,health=12,kv=12,logm=51} crc {auth=227622987,config=2586702516,health=1630673766,kv=3467323233,logm=725626679}) 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=11,kv=12,logm=52} crc {auth=3911899260,config=2586702516,health=4108416964,kv=3467323233,logm=1487040593}) 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=24,config=2,health=12,kv=11,logm=51} crc {auth=2859027341,config=2586702516,health=1630673766,kv=3279620548,logm=2116721194}) 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=11,kv=12,logm=52} crc {auth=3911899260,config=2586702516,health=4108416964,kv=3467323233,logm=1487040593}) 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=22,config=2,health=12,kv=12,logm=52} crc {auth=3349320121,config=2586702516,health=1630673766,kv=3467323233,logm=2567542257}) 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=11,kv=12,logm=52} crc {auth=3911899260,config=2586702516,health=4108416964,kv=3467323233,logm=1487040593}) 2024-09-13T10:39:02.618 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=20,config=2,health=11,kv=12,logm=55} crc {auth=2910691041,config=2586702516,health=991710783,kv=3467323233,logm=3195233711}) 2024-09-13T10:39:02.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=11,kv=12,logm=52} crc {auth=3911899260,config=2586702516,health=4108416964,kv=3467323233,logm=1487040593}) 2024-09-13T10:39:02.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=22,config=2,health=12,kv=11,logm=53} crc {auth=882657182,config=2586702516,health=1630673766,kv=3279620548,logm=1935126712}) 2024-09-13T10:39:02.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=11,kv=12,logm=52} crc {auth=3911899260,config=2586702516,health=4108416964,kv=3467323233,logm=1487040593}) 2024-09-13T10:39:02.619 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.614+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=23,config=2,health=11,kv=11,logm=53} crc {auth=398444971,config=2586702516,health=3925339507,kv=3226510214,logm=3431469784}) 2024-09-13T10:39:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.617+0000 7f28f6e50640 1 -- 172.21.15.181:0/2515506810 >> v1:172.21.15.195:6800/1839191919 conn(0x7f28d40403c0 legacy=0x7f28d4042880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.617+0000 7f28f6e50640 10 monclient: shutdown 2024-09-13T10:39:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.617+0000 7f28f6e50640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.617+0000 7f28f6e50640 1 -- 172.21.15.181:0/2515506810 >> v1:172.21.15.181:6790/0 conn(0x7f28f00a6ab0 legacy=0x7f28f013b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.617+0000 7f28f6e50640 1 -- 172.21.15.181:0/2515506810 shutdown_connections 2024-09-13T10:39:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.617+0000 7f28f6e50640 1 -- 172.21.15.181:0/2515506810 >> 172.21.15.181:0/2515506810 conn(0x7f28f00abcd0 msgr2=0x7f28f0145cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.617+0000 7f28f6e50640 1 -- 172.21.15.181:0/2515506810 shutdown_connections 2024-09-13T10:39:02.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:02.617+0000 7f28f6e50640 1 -- 172.21.15.181:0/2515506810 wait complete. 2024-09-13T10:39:02.630 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-13T10:39:02.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1940971599}) 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2368448597}) 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1940971599}) 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1511579938}) 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1940971599}) 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.627+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2046596485}) 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1940971599}) 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=495990651}) 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1940971599}) 2024-09-13T10:39:02.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3061905045}) 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1940971599}) 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3373581480}) 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1940971599}) 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4193373013}) 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1940971599}) 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.628+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3843201716}) 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1548529523}) 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=760237468}) 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1548529523}) 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3316453741}) 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1548529523}) 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3066782938}) 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1548529523}) 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3909747922}) 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1548529523}) 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1677736582}) 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1548529523}) 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2496604168}) 2024-09-13T10:39:02.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1548529523}) 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1608996034}) 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1548529523}) 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3638497090}) 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2972745967}) 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3841090895}) 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2972745967}) 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3955824130}) 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2972745967}) 2024-09-13T10:39:02.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3226164119}) 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2972745967}) 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=646082147}) 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2972745967}) 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3487698104}) 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2972745967}) 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3841057292}) 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2972745967}) 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2662871811}) 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2972745967}) 2024-09-13T10:39:02.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.631+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2808151593}) 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4186182899}) 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2607683932}) 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4186182899}) 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1540214251}) 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4186182899}) 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=297889434}) 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4186182899}) 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=255636708}) 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4186182899}) 2024-09-13T10:39:02.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1435977722}) 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4186182899}) 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=6226374}) 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4186182899}) 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2160228287}) 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4186182899}) 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=934945379}) 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1578129418}) 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2709288447}) 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1578129418}) 2024-09-13T10:39:02.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3208507987}) 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1578129418}) 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2311361167}) 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1578129418}) 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2501491898}) 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1578129418}) 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1035821019}) 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1578129418}) 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1979958136}) 2024-09-13T10:39:02.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1578129418}) 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1095579958}) 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1578129418}) 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=722763322}) 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2662172511}) 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2793657289}) 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2662172511}) 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3396969832}) 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2662172511}) 2024-09-13T10:39:02.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1644121729}) 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2662172511}) 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=115891688}) 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2662172511}) 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=627188148}) 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2662172511}) 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4176503573}) 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2662172511}) 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2258648028}) 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2662172511}) 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=446848894}) 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2385920916}) 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3260726404}) 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2385920916}) 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=909417691}) 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2385920916}) 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3783223485}) 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2385920916}) 2024-09-13T10:39:02.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1530200333}) 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2385920916}) 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2930024910}) 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2385920916}) 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2153578129}) 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2385920916}) 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=575267760}) 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2385920916}) 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=905863610}) 2024-09-13T10:39:02.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2362688210}) 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=443647539}) 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2362688210}) 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1217595943}) 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2362688210}) 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3586058322}) 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2362688210}) 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2241670662}) 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.669 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2362688210}) 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1275783571}) 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2362688210}) 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3899007482}) 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2362688210}) 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=915891806}) 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2362688210}) 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.637+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=355106668}) 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310148156}) 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799776401}) 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310148156}) 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1744931251}) 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310148156}) 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2906826442}) 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310148156}) 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3842341739}) 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310148156}) 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=672055299}) 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310148156}) 2024-09-13T10:39:02.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1831625607}) 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310148156}) 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3642733133}) 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=310148156}) 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.638+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1382656019}) 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=565895672}) 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1862220962}) 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=565895672}) 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3930701309}) 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=565895672}) 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3749617338}) 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=565895672}) 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3340715762}) 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=565895672}) 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1100101695}) 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=565895672}) 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4041967562}) 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=565895672}) 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4272476488}) 2024-09-13T10:39:02.673 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=565895672}) 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2120296067}) 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=109423957}) 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4112919159}) 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=109423957}) 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1284709505}) 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=109423957}) 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1797569786}) 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=109423957}) 2024-09-13T10:39:02.674 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=623636943}) 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=109423957}) 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2839061575}) 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=109423957}) 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1079044099}) 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=109423957}) 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1098526754}) 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=109423957}) 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.640+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2718095052}) 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.675 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1909331201}) 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2086585650}) 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1909331201}) 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3753634566}) 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1909331201}) 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1401348712}) 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1909331201}) 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3006557171}) 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1909331201}) 2024-09-13T10:39:02.676 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1915779175}) 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1909331201}) 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3291383463}) 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1909331201}) 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=202723282}) 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1909331201}) 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.641+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4221023503}) 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=31049071}) 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=293195266}) 2024-09-13T10:39:02.677 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=31049071}) 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=436471833}) 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=31049071}) 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2816420059}) 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=31049071}) 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=925640624}) 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=31049071}) 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1986742925}) 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.678 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=31049071}) 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4287401433}) 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=31049071}) 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1535404186}) 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=31049071}) 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.642+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3712060899}) 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4152513033}) 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=436036978}) 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4152513033}) 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3062930396}) 2024-09-13T10:39:02.679 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.643+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4152513033}) 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1163632283}) 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4152513033}) 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3133017008}) 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4152513033}) 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3537411410}) 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4152513033}) 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1462120503}) 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.680 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4152513033}) 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2633211804}) 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4152513033}) 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.644+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=949405255}) 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3010235114}) 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=706885030}) 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3010235114}) 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2062312911}) 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3010235114}) 2024-09-13T10:39:02.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=553505949}) 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3010235114}) 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1224179706}) 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3010235114}) 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4078740320}) 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3010235114}) 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3826201915}) 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3010235114}) 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3571307986}) 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3010235114}) 2024-09-13T10:39:02.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.645+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2092054787}) 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1978554939}) 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1534934622}) 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1978554939}) 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1593718121}) 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1978554939}) 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2153687064}) 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1978554939}) 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3872458586}) 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1978554939}) 2024-09-13T10:39:02.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2384061585}) 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1978554939}) 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4095436277}) 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1978554939}) 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3866003156}) 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1978554939}) 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1429118942}) 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=55733075}) 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3858679754}) 2024-09-13T10:39:02.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=55733075}) 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3871062315}) 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=55733075}) 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3657891835}) 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=55733075}) 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2678208968}) 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=55733075}) 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4215802885}) 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=55733075}) 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=492241569}) 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=55733075}) 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4165789007}) 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=55733075}) 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.647+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2341474071}) 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=295963271}) 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1603603057}) 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=295963271}) 2024-09-13T10:39:02.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3263780635}) 2024-09-13T10:39:02.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=295963271}) 2024-09-13T10:39:02.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4250574919}) 2024-09-13T10:39:02.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=295963271}) 2024-09-13T10:39:02.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3203663734}) 2024-09-13T10:39:02.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=295963271}) 2024-09-13T10:39:02.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1787764413}) 2024-09-13T10:39:02.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=295963271}) 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2241246339}) 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=295963271}) 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2675097271}) 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=295963271}) 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.648+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=549467815}) 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1814131798}) 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3864440431}) 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1814131798}) 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3427232670}) 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1814131798}) 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1980951731}) 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1814131798}) 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=173248993}) 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1814131798}) 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=593937637}) 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1814131798}) 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4064143165}) 2024-09-13T10:39:02.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1814131798}) 2024-09-13T10:39:02.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3104392469}) 2024-09-13T10:39:02.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1814131798}) 2024-09-13T10:39:02.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2148816643}) 2024-09-13T10:39:02.799 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.799 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3905768694}) 2024-09-13T10:39:02.799 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954261994}) 2024-09-13T10:39:02.799 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.799 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3905768694}) 2024-09-13T10:39:02.800 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=263904336}) 2024-09-13T10:39:02.800 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.800 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3905768694}) 2024-09-13T10:39:02.800 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=902033890}) 2024-09-13T10:39:02.800 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.800 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3905768694}) 2024-09-13T10:39:02.800 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2717611599}) 2024-09-13T10:39:02.800 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.800 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3905768694}) 2024-09-13T10:39:02.800 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=122081045}) 2024-09-13T10:39:02.800 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.800 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3905768694}) 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1960199261}) 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3905768694}) 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2514633640}) 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3905768694}) 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.770+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2135753372}) 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390735520}) 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3732236984}) 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390735520}) 2024-09-13T10:39:02.801 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1728330987}) 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390735520}) 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1086443917}) 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390735520}) 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4227356789}) 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390735520}) 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2526613740}) 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390735520}) 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=555904456}) 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.802 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390735520}) 2024-09-13T10:39:02.803 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3221517807}) 2024-09-13T10:39:02.803 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.803 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390735520}) 2024-09-13T10:39:02.803 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.772+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=908537660}) 2024-09-13T10:39:02.803 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.803 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=151515670}) 2024-09-13T10:39:02.803 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861012798}) 2024-09-13T10:39:02.803 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.803 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=151515670}) 2024-09-13T10:39:02.803 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1768449717}) 2024-09-13T10:39:02.803 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.803 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=151515670}) 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1722377646}) 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=151515670}) 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=697327680}) 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=151515670}) 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2173333368}) 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=151515670}) 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=865344897}) 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=151515670}) 2024-09-13T10:39:02.804 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2092837475}) 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=151515670}) 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.773+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3748057790}) 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=567508984}) 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2795066515}) 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=567508984}) 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1171004467}) 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=567508984}) 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3214619611}) 2024-09-13T10:39:02.805 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=567508984}) 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3313421215}) 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=567508984}) 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2115545075}) 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=567508984}) 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3566996339}) 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=567508984}) 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3104880424}) 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.806 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=567508984}) 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.774+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=421378954}) 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1596829226}) 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4059884376}) 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1596829226}) 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=293486046}) 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1596829226}) 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3091521341}) 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1596829226}) 2024-09-13T10:39:02.807 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=495392584}) 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1596829226}) 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4209894100}) 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1596829226}) 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3126369714}) 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1596829226}) 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3767635976}) 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1596829226}) 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.775+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2727061771}) 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.808 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=530085392}) 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=11238051}) 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=530085392}) 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=326333895}) 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=530085392}) 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2288935364}) 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=530085392}) 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1035490478}) 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=530085392}) 2024-09-13T10:39:02.809 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2248470418}) 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=530085392}) 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2783789649}) 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=530085392}) 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.776+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3784089134}) 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.777+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.777+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=530085392}) 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.777+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3737896490}) 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=910594542}) 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441033002}) 2024-09-13T10:39:02.810 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.811 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=910594542}) 2024-09-13T10:39:02.811 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1097511139}) 2024-09-13T10:39:02.811 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.811 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=910594542}) 2024-09-13T10:39:02.811 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2008143886}) 2024-09-13T10:39:02.811 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.811 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=910594542}) 2024-09-13T10:39:02.811 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3212093041}) 2024-09-13T10:39:02.811 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.811 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=910594542}) 2024-09-13T10:39:02.811 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2178262970}) 2024-09-13T10:39:02.811 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.812 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=910594542}) 2024-09-13T10:39:02.812 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=727529310}) 2024-09-13T10:39:02.812 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.812 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=910594542}) 2024-09-13T10:39:02.812 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2970964368}) 2024-09-13T10:39:02.812 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.812 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=910594542}) 2024-09-13T10:39:02.812 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.778+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2865342947}) 2024-09-13T10:39:02.812 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.812 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3868061483}) 2024-09-13T10:39:02.812 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=905729950}) 2024-09-13T10:39:02.812 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.813 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3868061483}) 2024-09-13T10:39:02.813 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=56881773}) 2024-09-13T10:39:02.813 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.813 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3868061483}) 2024-09-13T10:39:02.813 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2641281401}) 2024-09-13T10:39:02.813 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.813 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3868061483}) 2024-09-13T10:39:02.813 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1500622213}) 2024-09-13T10:39:02.813 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.813 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3868061483}) 2024-09-13T10:39:02.813 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=873225121}) 2024-09-13T10:39:02.813 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3868061483}) 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2443171627}) 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3868061483}) 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=574223109}) 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3868061483}) 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.779+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1112415643}) 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=394745305}) 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206586950}) 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=394745305}) 2024-09-13T10:39:02.814 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3820033541}) 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=394745305}) 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1200918233}) 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=394745305}) 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1933165950}) 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=394745305}) 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4281468344}) 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=394745305}) 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4022408789}) 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.815 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=394745305}) 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=205997307}) 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=394745305}) 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.780+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3690700811}) 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714795821}) 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2856646884}) 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714795821}) 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2320073627}) 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714795821}) 2024-09-13T10:39:02.816 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=289394222}) 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714795821}) 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3526669356}) 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714795821}) 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2809036218}) 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714795821}) 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2156035889}) 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714795821}) 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1655764375}) 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.817 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714795821}) 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.781+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=62512042}) 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3143980409}) 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1396527415}) 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3143980409}) 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=819775908}) 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3143980409}) 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=51020751}) 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3143980409}) 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4131391978}) 2024-09-13T10:39:02.818 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3143980409}) 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=981720757}) 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3143980409}) 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3002610918}) 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3143980409}) 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2864402766}) 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3143980409}) 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.783+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1340044912}) 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.819 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1170184754}) 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2197617585}) 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1170184754}) 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3890042357}) 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1170184754}) 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=563119279}) 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1170184754}) 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4037036958}) 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1170184754}) 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1243945941}) 2024-09-13T10:39:02.820 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1170184754}) 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1740042224}) 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1170184754}) 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2950285968}) 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1170184754}) 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.784+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=942078827}) 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=28751039}) 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4174165756}) 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.821 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=28751039}) 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3784588775}) 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=28751039}) 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4050851811}) 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=28751039}) 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3480759109}) 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=28751039}) 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1580752757}) 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=28751039}) 2024-09-13T10:39:02.822 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3426629855}) 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=28751039}) 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2100547521}) 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=28751039}) 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.786+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1592462109}) 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1885063601}) 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2077694252}) 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1885063601}) 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1806106694}) 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.823 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1885063601}) 2024-09-13T10:39:02.824 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2459792592}) 2024-09-13T10:39:02.824 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.824 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1885063601}) 2024-09-13T10:39:02.824 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1977350735}) 2024-09-13T10:39:02.824 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.824 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1885063601}) 2024-09-13T10:39:02.824 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1525670551}) 2024-09-13T10:39:02.824 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.824 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1885063601}) 2024-09-13T10:39:02.824 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2939438238}) 2024-09-13T10:39:02.824 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.824 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1885063601}) 2024-09-13T10:39:02.825 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2176807116}) 2024-09-13T10:39:02.825 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:02.825 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1885063601}) 2024-09-13T10:39:02.825 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:02.787+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4287319133}) 2024-09-13T10:39:03.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3425905924}) 2024-09-13T10:39:03.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=184100768}) 2024-09-13T10:39:03.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3425905924}) 2024-09-13T10:39:03.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2824974182}) 2024-09-13T10:39:03.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3425905924}) 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1621544627}) 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3425905924}) 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3219170976}) 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3425905924}) 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=253724319}) 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3425905924}) 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=440830198}) 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.087 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3425905924}) 2024-09-13T10:39:03.088 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2338118500}) 2024-09-13T10:39:03.088 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.088 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3425905924}) 2024-09-13T10:39:03.088 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.080+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1485765397}) 2024-09-13T10:39:03.088 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.088 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1308495667}) 2024-09-13T10:39:03.088 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3325344093}) 2024-09-13T10:39:03.088 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.088 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1308495667}) 2024-09-13T10:39:03.088 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=429263185}) 2024-09-13T10:39:03.088 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.088 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1308495667}) 2024-09-13T10:39:03.089 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2378261216}) 2024-09-13T10:39:03.089 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.089 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1308495667}) 2024-09-13T10:39:03.089 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3218800594}) 2024-09-13T10:39:03.089 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.089 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1308495667}) 2024-09-13T10:39:03.089 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2515517815}) 2024-09-13T10:39:03.089 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.089 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1308495667}) 2024-09-13T10:39:03.090 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4249919652}) 2024-09-13T10:39:03.090 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.090 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1308495667}) 2024-09-13T10:39:03.090 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1612326195}) 2024-09-13T10:39:03.090 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.090 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1308495667}) 2024-09-13T10:39:03.090 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.082+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=297442181}) 2024-09-13T10:39:03.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.561+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.561+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1451000359}) 2024-09-13T10:39:03.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.561+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3018115998}) 2024-09-13T10:39:03.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.561+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.561+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1451000359}) 2024-09-13T10:39:03.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.561+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=919115480}) 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.561+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.561+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1451000359}) 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2771803430}) 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1451000359}) 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4116051593}) 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1451000359}) 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=853440488}) 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1451000359}) 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4200657275}) 2024-09-13T10:39:03.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1451000359}) 2024-09-13T10:39:03.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1917588776}) 2024-09-13T10:39:03.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1451000359}) 2024-09-13T10:39:03.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.562+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1920927594}) 2024-09-13T10:39:03.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288760803}) 2024-09-13T10:39:03.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3944274844}) 2024-09-13T10:39:03.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288760803}) 2024-09-13T10:39:03.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=642634810}) 2024-09-13T10:39:03.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288760803}) 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3621363604}) 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288760803}) 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1289921487}) 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288760803}) 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=89748336}) 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288760803}) 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2652499160}) 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288760803}) 2024-09-13T10:39:03.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4191059689}) 2024-09-13T10:39:03.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2288760803}) 2024-09-13T10:39:03.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.566+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1396087039}) 2024-09-13T10:39:03.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=71552652}) 2024-09-13T10:39:03.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2167151656}) 2024-09-13T10:39:03.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=71552652}) 2024-09-13T10:39:03.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3081400206}) 2024-09-13T10:39:03.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=71552652}) 2024-09-13T10:39:03.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2650979000}) 2024-09-13T10:39:03.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=71552652}) 2024-09-13T10:39:03.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2096844057}) 2024-09-13T10:39:03.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=71552652}) 2024-09-13T10:39:03.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3345642909}) 2024-09-13T10:39:03.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=71552652}) 2024-09-13T10:39:03.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1082613148}) 2024-09-13T10:39:03.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=71552652}) 2024-09-13T10:39:03.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2935243493}) 2024-09-13T10:39:03.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=71552652}) 2024-09-13T10:39:03.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.594+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4293960927}) 2024-09-13T10:39:03.631 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:39:03.632 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:39:03.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=624655506}) 2024-09-13T10:39:03.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1893924456}) 2024-09-13T10:39:03.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=624655506}) 2024-09-13T10:39:03.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1283172326}) 2024-09-13T10:39:03.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=624655506}) 2024-09-13T10:39:03.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1856083652}) 2024-09-13T10:39:03.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=624655506}) 2024-09-13T10:39:03.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1840131624}) 2024-09-13T10:39:03.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=624655506}) 2024-09-13T10:39:03.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3870304813}) 2024-09-13T10:39:03.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=624655506}) 2024-09-13T10:39:03.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2271273180}) 2024-09-13T10:39:03.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=624655506}) 2024-09-13T10:39:03.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=703959853}) 2024-09-13T10:39:03.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.680+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=624655506}) 2024-09-13T10:39:03.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.681+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=84968860}) 2024-09-13T10:39:03.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.727+0000 7f2740631640 10 monclient: get_monmap_and_config 2024-09-13T10:39:03.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.727+0000 7f2740631640 10 monclient: build_initial_monmap 2024-09-13T10:39:03.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.727+0000 7f2740631640 10 monclient: monmap: 2024-09-13T10:39:03.729 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:03.728412+0000 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:03.728412+0000 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:03.730 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:03.731 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.728+0000 7f2740631640 1 Processor -- start 2024-09-13T10:39:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.728+0000 7f2740631640 1 -- start start 2024-09-13T10:39:03.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.728+0000 7f2740631640 10 monclient: init 2024-09-13T10:39:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.728+0000 7f2740631640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.728+0000 7f2740631640 10 monclient: _add_conns ranks=[1,8,3,7,4,5,6,2,0] 2024-09-13T10:39:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.729+0000 7f2740631640 10 monclient(hunting): picked mon.noname-f con 0x7f27380a6740 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.729+0000 7f2740631640 10 monclient(hunting): picked mon.noname-e con 0x7f27380a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.729+0000 7f2740631640 10 monclient(hunting): picked mon.noname-g con 0x7f273813f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.729+0000 7f2740631640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27380a2f40 con 0x7f27380a6740 2024-09-13T10:39:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.729+0000 7f2740631640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27380a4bc0 con 0x7f273813f750 2024-09-13T10:39:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.729+0000 7f2740631640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27380a5360 con 0x7f27380a8340 2024-09-13T10:39:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.729+0000 7f2740631640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.729+0000 7f2740631640 10 monclient(hunting): authenticate will time out at 1283.234066s 2024-09-13T10:39:03.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.729+0000 7f273dbcc640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f27380a8340 0x7f27380a7230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54980/0 (socket says 172.21.15.181:54980) 2024-09-13T10:39:03.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.729+0000 7f273dbcc640 1 -- 172.21.15.181:0/1653231791 learned_addr learned my addr 172.21.15.181:0/1653231791 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273dbcc640 1 -- 172.21.15.181:0/1653231791 >> v1:172.21.15.181:6793/0 conn(0x7f27380a8340 legacy=0x7f27380a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273e3cd640 1 -- 172.21.15.181:0/1653231791 >> v1:172.21.15.195:6789/0 conn(0x7f27380a6740 legacy=0x7f27380a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273ebce640 1 -- 172.21.15.181:0/1653231791 >> v1:172.21.15.195:6790/0 conn(0x7f273813f750 legacy=0x7f2738141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 699098701 0 0) 0x7f27380a5360 con 0x7f27380a8340 2024-09-13T10:39:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:03.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient(hunting): my global_id is 105623 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2724003520 con 0x7f27380a8340 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107974769 0 0) 0x7f27380a2f40 con 0x7f27380a6740 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient(hunting): my global_id is 134524 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27380a5360 con 0x7f27380a6740 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1865314758 0 0) 0x7f27380a4bc0 con 0x7f273813f750 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient(hunting): my global_id is 164172 2024-09-13T10:39:03.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27380a2f40 con 0x7f273813f750 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 774614267 0 0) 0x7f2724003520 con 0x7f27380a8340 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 >> v1:172.21.15.195:6790/0 conn(0x7f273813f750 legacy=0x7f2738141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 >> v1:172.21.15.195:6789/0 conn(0x7f27380a6740 legacy=0x7f27380a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient: _finish_hunting 0 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 monclient: found mon.noname-e 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2738146290 con 0x7f27380a8340 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient: _finish_auth 0 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient: _check_auth_tickets 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2728001ae0 con 0x7f27380a8340 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f2740631640 5 monclient: authenticate success, global_id 105623 2024-09-13T10:39:03.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f2740631640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient: dump: 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:03.743 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f2740631640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27280048a0 con 0x7f27380a8340 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 1 -- 172.21.15.181:0/1653231791 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2728004e10 con 0x7f27380a8340 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f2740631640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f2740631640 4 set_mon_vals no callback set 2024-09-13T10:39:03.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.731+0000 7f273d3cb640 10 monclient: dump: 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:03.745 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.732+0000 7f2740631640 10 monclient: shutdown 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.732+0000 7f2740631640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.732+0000 7f2740631640 1 -- 172.21.15.181:0/1653231791 >> v1:172.21.15.181:6793/0 conn(0x7f27380a8340 legacy=0x7f27380a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.732+0000 7f2740631640 1 -- 172.21.15.181:0/1653231791 shutdown_connections 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.732+0000 7f2740631640 1 -- 172.21.15.181:0/1653231791 >> 172.21.15.181:0/1653231791 conn(0x7f27380abd40 msgr2=0x7f27380ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.732+0000 7f2740631640 1 -- 172.21.15.181:0/1653231791 shutdown_connections 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.732+0000 7f2740631640 1 -- 172.21.15.181:0/1653231791 wait complete. 2024-09-13T10:39:03.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.732+0000 7f2740631640 10 monclient: build_initial_monmap 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 10 monclient: monmap: 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:03.747 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 1 Processor -- start 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 1 -- start start 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 10 monclient: init 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 10 monclient: _add_conns ranks=[4,5,1,6,2,7,0,8,3] 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 10 monclient(hunting): picked mon.noname-c con 0x7f27380a6740 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 10 monclient(hunting): picked mon.noname-h con 0x7f27380a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 10 monclient(hunting): picked mon.noname-f con 0x7f273813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27380ac290 con 0x7f273813f750 2024-09-13T10:39:03.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27381228c0 con 0x7f27380a6740 2024-09-13T10:39:03.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2738145460 con 0x7f27380a8340 2024-09-13T10:39:03.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:03.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f2740631640 10 monclient(hunting): authenticate will time out at 1283.238816s 2024-09-13T10:39:03.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f273e3cd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f27380a6740 0x7f273813af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:37590/0 (socket says 172.21.15.181:37590) 2024-09-13T10:39:03.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.733+0000 7f273e3cd640 1 -- 172.21.15.181:0/3270944720 learned_addr learned my addr 172.21.15.181:0/3270944720 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:03.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.735+0000 7f273e3cd640 1 -- 172.21.15.181:0/3270944720 >> v1:172.21.15.181:6791/0 conn(0x7f27380a6740 legacy=0x7f273813af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:03.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f273ebce640 1 -- 172.21.15.181:0/3270944720 >> v1:172.21.15.195:6789/0 conn(0x7f273813f750 legacy=0x7f27381d6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:03.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f273dbcc640 1 -- 172.21.15.181:0/3270944720 >> v1:172.21.15.195:6791/0 conn(0x7f27380a8340 legacy=0x7f27381d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:03.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3501584441 0 0) 0x7f27381228c0 con 0x7f27380a6740 2024-09-13T10:39:03.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:03.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:03.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): my global_id is 115312 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f271c003520 con 0x7f27380a6740 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123558379 0 0) 0x7f27380a2f40 con 0x7f273813f750 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): my global_id is 134533 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27381228c0 con 0x7f273813f750 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 630671283 0 0) 0x7f2738145460 con 0x7f27380a8340 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): my global_id is 105485 2024-09-13T10:39:03.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27380a2f40 con 0x7f27380a8340 2024-09-13T10:39:03.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1470960086 0 0) 0x7f271c003520 con 0x7f27380a6740 2024-09-13T10:39:03.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2738145460 con 0x7f27380a6740 2024-09-13T10:39:03.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2734003950 con 0x7f27380a6740 2024-09-13T10:39:03.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:03.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:03.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): dump: 2024-09-13T10:39:03.751 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:03.751 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:03.752 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4068915651 0 0) 0x7f27381228c0 con 0x7f273813f750 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f271c003520 con 0x7f273813f750 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2730001f60 con 0x7f273813f750 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): dump: 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:03.753 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3164013874 0 0) 0x7f27380a2f40 con 0x7f27380a8340 2024-09-13T10:39:03.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27381228c0 con 0x7f27380a8340 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2728004d90 con 0x7f27380a8340 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient(hunting): dump: 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:03.755 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:03.756 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:03.756 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:03.756 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:03.756 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:03.756 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:03.756 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:03.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2995623958 0 0) 0x7f2738145460 con 0x7f27380a6740 2024-09-13T10:39:03.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 >> v1:172.21.15.195:6791/0 conn(0x7f27380a8340 legacy=0x7f27381d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:03.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 >> v1:172.21.15.195:6789/0 conn(0x7f273813f750 legacy=0x7f27381d6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:03.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:03.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 monclient: found mon.c 2024-09-13T10:39:03.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2738142b60 con 0x7f27380a6740 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient: _finish_auth 0 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f2740631640 5 monclient: authenticate success, global_id 115312 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f2740631640 10 monclient: _renew_subs 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f2740631640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f2740631640 1 -- 172.21.15.181:0/3270944720 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f27380a1d10 con 0x7f27380a6740 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f2740631640 10 monclient: _renew_subs 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f2740631640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f2740631640 1 -- 172.21.15.181:0/3270944720 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f27380a0ad0 con 0x7f27380a6740 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2734001cf0 con 0x7f27380a6740 2024-09-13T10:39:03.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f27340041e0 con 0x7f27380a6740 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f273cbca640 4 set_mon_vals no callback set 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.736+0000 7f272effd640 10 monclient: dump: 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:03.758 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.737+0000 7f2740631640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.737+0000 7f2740631640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.737+0000 7f2740631640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.737+0000 7f2740631640 1 -- 172.21.15.181:0/3270944720 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2720005080 con 0x7f27380a6740 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.737+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2734011ca0 con 0x7f27380a6740 2024-09-13T10:39:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.737+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(284..284 src has 1..284) ==== 3898+0+0 (unknown 2549241883 0 0) 0x7f273404e560 con 0x7f27380a6740 2024-09-13T10:39:03.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.738+0000 7f273dbcc640 10 monclient: get_auth_request con 0x7f271c0403c0 auth_method 0 2024-09-13T10:39:03.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.742+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f27340179f0 con 0x7f27380a6740 2024-09-13T10:39:03.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.742+0000 7f272effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:03.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.742+0000 7f272effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:03.969 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.969 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1174547310}) 2024-09-13T10:39:03.969 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1363234612}) 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1174547310}) 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1889001116}) 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1174547310}) 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2249763456}) 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1174547310}) 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3602349539}) 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1174547310}) 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=187138764}) 2024-09-13T10:39:03.970 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.971 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1174547310}) 2024-09-13T10:39:03.971 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3100734211}) 2024-09-13T10:39:03.971 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.971 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1174547310}) 2024-09-13T10:39:03.971 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4015319748}) 2024-09-13T10:39:03.971 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:03.971 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1174547310}) 2024-09-13T10:39:03.971 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:03.966+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2621874614}) 2024-09-13T10:39:03.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.982+0000 7f2740631640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:39:03.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.982+0000 7f2740631640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:03.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.982+0000 7f2740631640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:03.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.982+0000 7f2740631640 1 -- 172.21.15.181:0/3270944720 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2720005370 con 0x7f27380a6740 2024-09-13T10:39:03.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.983+0000 7f272effd640 1 -- 172.21.15.181:0/3270944720 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 3281242804) 0x7f27340172f0 con 0x7f27380a6740 2024-09-13T10:39:03.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.983+0000 7f272effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:03.985 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.983+0000 7f272effd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:03.985 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":132,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":3,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:39:03.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.985+0000 7f2740631640 1 -- 172.21.15.181:0/3270944720 >> v1:172.21.15.195:6800/1839191919 conn(0x7f271c0403c0 legacy=0x7f271c042880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:03.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.985+0000 7f2740631640 10 monclient: shutdown 2024-09-13T10:39:03.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.985+0000 7f2740631640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:03.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.985+0000 7f2740631640 1 -- 172.21.15.181:0/3270944720 >> v1:172.21.15.181:6791/0 conn(0x7f27380a6740 legacy=0x7f273813af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:03.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.985+0000 7f2740631640 1 -- 172.21.15.181:0/3270944720 shutdown_connections 2024-09-13T10:39:03.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.986+0000 7f2740631640 1 -- 172.21.15.181:0/3270944720 >> 172.21.15.181:0/3270944720 conn(0x7f27380abd40 msgr2=0x7f2738141b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:03.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.986+0000 7f2740631640 1 -- 172.21.15.181:0/3270944720 shutdown_connections 2024-09-13T10:39:03.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:03.986+0000 7f2740631640 1 -- 172.21.15.181:0/3270944720 wait complete. 2024-09-13T10:39:03.997 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:39:03.998 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T10:39:03.998 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:39:03.998 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:39:04.084 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.084 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=753632101}) 2024-09-13T10:39:04.084 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2141750787}) 2024-09-13T10:39:04.084 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.084 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=753632101}) 2024-09-13T10:39:04.084 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=894709792}) 2024-09-13T10:39:04.085 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.085 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=753632101}) 2024-09-13T10:39:04.085 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=204169766}) 2024-09-13T10:39:04.085 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.085 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=753632101}) 2024-09-13T10:39:04.085 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2768519523}) 2024-09-13T10:39:04.085 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.085 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=753632101}) 2024-09-13T10:39:04.085 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4237447644}) 2024-09-13T10:39:04.085 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.085 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=753632101}) 2024-09-13T10:39:04.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1956266513}) 2024-09-13T10:39:04.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=753632101}) 2024-09-13T10:39:04.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1271954296}) 2024-09-13T10:39:04.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=753632101}) 2024-09-13T10:39:04.086 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.081+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3468735980}) 2024-09-13T10:39:04.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.095+0000 7f70cdfc3640 10 monclient: get_monmap_and_config 2024-09-13T10:39:04.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.095+0000 7f70cdfc3640 10 monclient: build_initial_monmap 2024-09-13T10:39:04.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.095+0000 7f70cdfc3640 10 monclient: monmap: 2024-09-13T10:39:04.097 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:04.097 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:04.096551+0000 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:04.096551+0000 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:04.098 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.096+0000 7f70cdfc3640 1 Processor -- start 2024-09-13T10:39:04.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.096+0000 7f70cdfc3640 1 -- start start 2024-09-13T10:39:04.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.096+0000 7f70cdfc3640 10 monclient: init 2024-09-13T10:39:04.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.097+0000 7f70cdfc3640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:04.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.097+0000 7f70cdfc3640 10 monclient: _add_conns ranks=[7,5,8,0,3,4,1,6,2] 2024-09-13T10:39:04.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.097+0000 7f70cdfc3640 10 monclient(hunting): picked mon.noname-i con 0x7f70c80a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:04.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.097+0000 7f70cdfc3640 10 monclient(hunting): picked mon.noname-h con 0x7f70c80a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:04.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.097+0000 7f70cdfc3640 10 monclient(hunting): picked mon.noname-e con 0x7f70c813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:04.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.097+0000 7f70cdfc3640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c80a4bc0 con 0x7f70c80a8340 2024-09-13T10:39:04.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.097+0000 7f70cdfc3640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c813a320 con 0x7f70c80a6640 2024-09-13T10:39:04.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.097+0000 7f70cdfc3640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c80a8100 con 0x7f70c813f750 2024-09-13T10:39:04.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.097+0000 7f70cdfc3640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:04.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.097+0000 7f70cdfc3640 10 monclient(hunting): authenticate will time out at 1283.602573s 2024-09-13T10:39:04.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.097+0000 7f70c7fff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f70c813f750 0x7f70c8141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54982/0 (socket says 172.21.15.181:54982) 2024-09-13T10:39:04.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.097+0000 7f70c7fff640 1 -- 172.21.15.181:0/619444523 learned_addr learned my addr 172.21.15.181:0/619444523 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:04.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.099+0000 7f70c7fff640 1 -- 172.21.15.181:0/619444523 >> v1:172.21.15.181:6793/0 conn(0x7f70c813f750 legacy=0x7f70c8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.099+0000 7f70bffff640 1 -- 172.21.15.181:0/619444523 >> v1:172.21.15.195:6791/0 conn(0x7f70c80a8340 legacy=0x7f70c8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.099+0000 7f70c77fe640 1 -- 172.21.15.181:0/619444523 >> v1:172.21.15.195:6792/0 conn(0x7f70c80a6640 legacy=0x7f70c8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 1 -- 172.21.15.181:0/619444523 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750016355 0 0) 0x7f70c80a8100 con 0x7f70c813f750 2024-09-13T10:39:04.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient(hunting): my global_id is 105632 2024-09-13T10:39:04.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 1 -- 172.21.15.181:0/619444523 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70b4003520 con 0x7f70c813f750 2024-09-13T10:39:04.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 1 -- 172.21.15.181:0/619444523 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773275560 0 0) 0x7f70c80a4bc0 con 0x7f70c80a8340 2024-09-13T10:39:04.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient(hunting): my global_id is 105494 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 1 -- 172.21.15.181:0/619444523 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70c80a8100 con 0x7f70c80a8340 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 1 -- 172.21.15.181:0/619444523 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 7687861 0 0) 0x7f70b4003520 con 0x7f70c813f750 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 1 -- 172.21.15.181:0/619444523 >> v1:172.21.15.195:6792/0 conn(0x7f70c80a6640 legacy=0x7f70c8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 1 -- 172.21.15.181:0/619444523 >> v1:172.21.15.195:6791/0 conn(0x7f70c80a8340 legacy=0x7f70c8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 1 monclient: found mon.noname-e 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 1 -- 172.21.15.181:0/619444523 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c80a48e0 con 0x7f70c813f750 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:04.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 1 -- 172.21.15.181:0/619444523 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f70c0001e60 con 0x7f70c813f750 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70cdfc3640 5 monclient: authenticate success, global_id 105632 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient: dump: 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.107 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70cdfc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 1 -- 172.21.15.181:0/619444523 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70c0004c20 con 0x7f70c813f750 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70cdfc3640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 1 -- 172.21.15.181:0/619444523 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f70c00051d0 con 0x7f70c813f750 2024-09-13T10:39:04.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70cdfc3640 4 set_mon_vals no callback set 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70c6ffd640 10 monclient: dump: 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.109 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70cdfc3640 10 monclient: shutdown 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70cdfc3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70cdfc3640 1 -- 172.21.15.181:0/619444523 >> v1:172.21.15.181:6793/0 conn(0x7f70c813f750 legacy=0x7f70c8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70cdfc3640 1 -- 172.21.15.181:0/619444523 shutdown_connections 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70cdfc3640 1 -- 172.21.15.181:0/619444523 >> 172.21.15.181:0/619444523 conn(0x7f70c8077170 msgr2=0x7f70c80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.100+0000 7f70cdfc3640 1 -- 172.21.15.181:0/619444523 shutdown_connections 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.101+0000 7f70cdfc3640 1 -- 172.21.15.181:0/619444523 wait complete. 2024-09-13T10:39:04.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.101+0000 7f70cdfc3640 10 monclient: build_initial_monmap 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.101+0000 7f70cdfc3640 10 monclient: monmap: 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:04.111 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.101+0000 7f70cdfc3640 1 Processor -- start 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.101+0000 7f70cdfc3640 1 -- start start 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.101+0000 7f70cdfc3640 10 monclient: init 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.102+0000 7f70cdfc3640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.102+0000 7f70cdfc3640 10 monclient: _add_conns ranks=[1,4,7,5,6,2,3,0,8] 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.102+0000 7f70cdfc3640 10 monclient(hunting): picked mon.noname-f con 0x7f70c80a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.102+0000 7f70cdfc3640 10 monclient(hunting): picked mon.noname-c con 0x7f70c813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.102+0000 7f70cdfc3640 10 monclient(hunting): picked mon.noname-i con 0x7f70c81d4730 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:04.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.102+0000 7f70cdfc3640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c8142ef0 con 0x7f70c80a8340 2024-09-13T10:39:04.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.102+0000 7f70cdfc3640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c80a1220 con 0x7f70c813f750 2024-09-13T10:39:04.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.102+0000 7f70cdfc3640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c80a1500 con 0x7f70c81d4730 2024-09-13T10:39:04.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.102+0000 7f70cdfc3640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:04.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.102+0000 7f70cdfc3640 10 monclient(hunting): authenticate will time out at 1283.607420s 2024-09-13T10:39:04.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.102+0000 7f70bffff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f70c813f750 0x7f70c8138c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:37604/0 (socket says 172.21.15.181:37604) 2024-09-13T10:39:04.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.102+0000 7f70bffff640 1 -- 172.21.15.181:0/1696657243 learned_addr learned my addr 172.21.15.181:0/1696657243 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:04.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70bffff640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.181:6791/0 conn(0x7f70c813f750 legacy=0x7f70c8138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c77fe640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.195:6789/0 conn(0x7f70c80a8340 legacy=0x7f70c81384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c7fff640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.195:6792/0 conn(0x7f70c81d4730 legacy=0x7f70c81d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70bffff640 1 --1- 172.21.15.181:0/1696657243 >> v1:172.21.15.181:6791/0 conn(0x7f70c813f750 0x7f70c8138c00 :-1 s=OPENED pgs=704 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f70c80a1220 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 228033216 0 0) 0x7f70b8001630 con 0x7f70c80a8340 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c4ff9640 10 monclient(hunting): my global_id is 134542 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70a8003550 con 0x7f70c80a8340 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100799961 0 0) 0x7f70c80a1500 con 0x7f70c81d4730 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.118 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c4ff9640 10 monclient(hunting): my global_id is 57553 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.104+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70b8001630 con 0x7f70c81d4730 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3296241437 0 0) 0x7f70a8003550 con 0x7f70c80a8340 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70c80a1500 con 0x7f70c80a8340 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f70b8003950 con 0x7f70c80a8340 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.119 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.120 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.120 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.120 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.120 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.120 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.120 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.120 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.120 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.120 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.120 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:04.120 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3512778117 0 0) 0x7f70b8001630 con 0x7f70c81d4730 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70a8003550 con 0x7f70c81d4730 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f70c00020b0 con 0x7f70c81d4730 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.121 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2387787194 0 0) 0x7f70c80a1500 con 0x7f70c80a8340 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.195:6792/0 conn(0x7f70c81d4730 legacy=0x7f70c81d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.181:6791/0 conn(0x7f70c813f750 legacy=0x7f70c8138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 monclient: found mon.f 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:39:04.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c8139310 con 0x7f70c80a8340 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient: _finish_auth 0 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70cdfc3640 5 monclient: authenticate success, global_id 134542 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2030263938 0 0) 0x7f70c80a1220 con 0x7f70c813f750 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70cdfc3640 10 monclient: _renew_subs 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70cdfc3640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70cdfc3640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f70c80a9e20 con 0x7f70c80a8340 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70cdfc3640 10 monclient: _renew_subs 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70cdfc3640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70cdfc3640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f70c809fd00 con 0x7f70c80a8340 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70b8003e20 con 0x7f70c80a8340 2024-09-13T10:39:04.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f70b8001d40 con 0x7f70c80a8340 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c67fc640 4 set_mon_vals no callback set 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.105+0000 7f70c4ff9640 10 monclient: dump: 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.124 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.125 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.125 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.125 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.125 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.125 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.125 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.125 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.106+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f70b8011ca0 con 0x7f70c80a8340 2024-09-13T10:39:04.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.106+0000 7f70cdfc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:04.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.106+0000 7f70cdfc3640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f70ac0065c0 con 0x7f70ac002860 2024-09-13T10:39:04.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.106+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(284..284 src has 1..284) ==== 3898+0+0 (unknown 2549241883 0 0) 0x7f70b804e3c0 con 0x7f70c80a8340 2024-09-13T10:39:04.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.106+0000 7f70c7fff640 10 monclient: get_auth_request con 0x7f70a8040190 auth_method 0 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70bffff640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.181:6789/0 conn(0x7f70ac002860 legacy=0x7f70ac004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440454978 0 0) 0x7f70ac0065c0 con 0x7f70ac002860 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70c4ff9640 10 monclient(hunting): my global_id is 115281 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70c80a1220 con 0x7f70ac002860 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1137651219 0 0) 0x7f70c80a1220 con 0x7f70ac002860 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70ac0065c0 con 0x7f70ac002860 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f70b0003610 con 0x7f70ac002860 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70c4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.108+0000 7f70c4ff9640 10 monclient: dump: 2024-09-13T10:39:04.126 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.127 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.128 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.109+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1381434121 0 0) 0x7f70ac0065c0 con 0x7f70ac002860 2024-09-13T10:39:04.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.109+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70ac00a160 con 0x7f70ac002860 2024-09-13T10:39:04.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.109+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f70b00057c0 con 0x7f70ac002860 2024-09-13T10:39:04.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.109+0000 7f70c4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:04.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.109+0000 7f70c4ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:04.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.109+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.181:6789/0 conn(0x7f70ac002860 legacy=0x7f70ac004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.109+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.181:6789/0 conn(0x7f70ac002860 legacy=0x7f70ac004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.115+0000 7f70cdfc3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:04.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.115+0000 7f70cdfc3640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f70ac009e70 con 0x7f70ac009130 2024-09-13T10:39:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.117+0000 7f70bffff640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.181:6789/0 conn(0x7f70ac009130 legacy=0x7f70ac0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.117+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520026566 0 0) 0x7f70ac009e70 con 0x7f70ac009130 2024-09-13T10:39:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.117+0000 7f70c4ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.117+0000 7f70c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.117+0000 7f70c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.117+0000 7f70c4ff9640 10 monclient(hunting): my global_id is 115290 2024-09-13T10:39:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.117+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70ac0065c0 con 0x7f70ac009130 2024-09-13T10:39:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.117+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3996921607 0 0) 0x7f70ac0065c0 con 0x7f70ac009130 2024-09-13T10:39:04.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70ac009e70 con 0x7f70ac009130 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f70b0003da0 con 0x7f70ac009130 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c4ff9640 10 monclient: dump: 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.131 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2951155134 0 0) 0x7f70ac009e70 con 0x7f70ac009130 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f70ac00c410 con 0x7f70ac009130 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7894 (unknown 0 0 78062142) 0x7f70b00040e0 con 0x7f70ac009130 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c4ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.181:6789/0 conn(0x7f70ac009130 legacy=0x7f70ac0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c4ff9640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.181:6789/0 conn(0x7f70ac009130 legacy=0x7f70ac0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.133 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:04.133 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:04.133 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:04.133 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:04.133 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:04.133 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 180096, 2024-09-13T10:39:04.133 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:04.133 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:04.133 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:04.134 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:04.135 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.136 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.136 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.136 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.136 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.136 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.136 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.136 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.136 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.136 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.136 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.136 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:04.137 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:04.138 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:04.138 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:04.138 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:04.138 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:04.138 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.138 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.138 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.138 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.138 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.138 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.138 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.138 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.141 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:04.141 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:04.141 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.141 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.141 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.141 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:04.141 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.141 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.141 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.141 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.142 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:04.143 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.144 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.145 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.146 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:04.147 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.148 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.149 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.150 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.151 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:04.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.153 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.153 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.153 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:04.153 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.153 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.153 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:39:04.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.153 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.153 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.153 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:04.154 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.154 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.154 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:04.154 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:04.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70cdfc3640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.195:6800/1839191919 conn(0x7f70a8040190 legacy=0x7f70a8042650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70cdfc3640 10 monclient: shutdown 2024-09-13T10:39:04.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70cdfc3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:04.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70cdfc3640 1 -- 172.21.15.181:0/1696657243 >> v1:172.21.15.195:6789/0 conn(0x7f70c80a8340 legacy=0x7f70c81384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c7fff640 1 -- 172.21.15.181:0/1696657243 reap_dead start 2024-09-13T10:39:04.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70c7fff640 1 -- 172.21.15.181:0/1696657243 reap_dead start 2024-09-13T10:39:04.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70cdfc3640 1 -- 172.21.15.181:0/1696657243 shutdown_connections 2024-09-13T10:39:04.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70cdfc3640 1 -- 172.21.15.181:0/1696657243 >> 172.21.15.181:0/1696657243 conn(0x7f70c80a6640 msgr2=0x7f70c81420c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:04.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70cdfc3640 1 -- 172.21.15.181:0/1696657243 shutdown_connections 2024-09-13T10:39:04.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.118+0000 7f70cdfc3640 1 -- 172.21.15.181:0/1696657243 wait complete. 2024-09-13T10:39:04.156 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:04.156 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:39:04.156 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:39:04.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.253+0000 7f9d5bcd4640 10 monclient: get_monmap_and_config 2024-09-13T10:39:04.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.253+0000 7f9d5bcd4640 10 monclient: build_initial_monmap 2024-09-13T10:39:04.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.253+0000 7f9d5bcd4640 10 monclient: monmap: 2024-09-13T10:39:04.255 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:04.255 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.255 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:04.254149+0000 2024-09-13T10:39:04.255 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:04.254149+0000 2024-09-13T10:39:04.255 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:04.255 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.255 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:04.256 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:04.256 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:04.256 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:04.256 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:04.256 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:04.256 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:04.256 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:04.256 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:04.256 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 1 Processor -- start 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 1 -- start start 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 10 monclient: init 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 10 monclient: _add_conns ranks=[4,8,0,3,6,7,5,2,1] 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 10 monclient(hunting): picked mon.noname-c con 0x7f9d54139040 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 10 monclient(hunting): picked mon.noname-e con 0x7f9d5409cd50 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 10 monclient(hunting): picked mon.noname-a con 0x7f9d5413fae0 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5409dbb0 con 0x7f9d5413fae0 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5409de90 con 0x7f9d54139040 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5409e170 con 0x7f9d5409cd50 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d5bcd4640 10 monclient(hunting): authenticate will time out at 1283.759930s 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.254+0000 7f9d59a70640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f9d54139040 0x7f9d540a58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:37610/0 (socket says 172.21.15.181:37610) 2024-09-13T10:39:04.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.255+0000 7f9d59a70640 1 -- 172.21.15.181:0/2973357601 learned_addr learned my addr 172.21.15.181:0/2973357601 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:04.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.255+0000 7f9d5926f640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f9d5409cd50 0x7f9d5413e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:54986/0 (socket says 172.21.15.181:54986) 2024-09-13T10:39:04.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d5926f640 1 -- 172.21.15.181:0/2973357601 >> v1:172.21.15.181:6793/0 conn(0x7f9d5409cd50 legacy=0x7f9d5413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d59a70640 1 -- 172.21.15.181:0/2973357601 >> v1:172.21.15.181:6791/0 conn(0x7f9d54139040 legacy=0x7f9d540a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d5a271640 1 -- 172.21.15.181:0/2973357601 >> v1:172.21.15.181:6789/0 conn(0x7f9d5413fae0 legacy=0x7f9d54141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2898048431 0 0) 0x7f9d5409e170 con 0x7f9d5409cd50 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient(hunting): my global_id is 105641 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d40003520 con 0x7f9d5409cd50 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946562656 0 0) 0x7f9d5409dbb0 con 0x7f9d5413fae0 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient(hunting): my global_id is 115299 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d5409e170 con 0x7f9d5413fae0 2024-09-13T10:39:04.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2209556345 0 0) 0x7f9d5409de90 con 0x7f9d54139040 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient(hunting): my global_id is 115330 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d5409dbb0 con 0x7f9d54139040 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1219060530 0 0) 0x7f9d40003520 con 0x7f9d5409cd50 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 >> v1:172.21.15.181:6791/0 conn(0x7f9d54139040 legacy=0x7f9d540a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 >> v1:172.21.15.181:6789/0 conn(0x7f9d5413fae0 legacy=0x7f9d54141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient: _finish_hunting 0 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 monclient: found mon.noname-e 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d540a5ff0 con 0x7f9d5409cd50 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient: _finish_auth 0 2024-09-13T10:39:04.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient: _check_auth_tickets 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9d44001ae0 con 0x7f9d5409cd50 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient: dump: 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.265 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.266 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d5bcd4640 5 monclient: authenticate success, global_id 105641 2024-09-13T10:39:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d5bcd4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d440047e0 con 0x7f9d5409cd50 2024-09-13T10:39:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:04.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 1 -- 172.21.15.181:0/2973357601 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9d44004d50 con 0x7f9d5409cd50 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d58a6e640 10 monclient: dump: 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.267 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d5bcd4640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.257+0000 7f9d5bcd4640 4 set_mon_vals no callback set 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.258+0000 7f9d5bcd4640 10 monclient: shutdown 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.258+0000 7f9d5bcd4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.258+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/2973357601 >> v1:172.21.15.181:6793/0 conn(0x7f9d5409cd50 legacy=0x7f9d5413e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.258+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/2973357601 shutdown_connections 2024-09-13T10:39:04.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.258+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/2973357601 >> 172.21.15.181:0/2973357601 conn(0x7f9d54077120 msgr2=0x7f9d540abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.258+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/2973357601 shutdown_connections 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.258+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/2973357601 wait complete. 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.258+0000 7f9d5bcd4640 10 monclient: build_initial_monmap 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.258+0000 7f9d5bcd4640 10 monclient: monmap: 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:04.269 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 1 Processor -- start 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 1 -- start start 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 10 monclient: init 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 10 monclient: _add_conns ranks=[6,4,5,7,8,3,2,0,1] 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 10 monclient(hunting): picked mon.noname-d con 0x7f9d5409cd50 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 10 monclient(hunting): picked mon.noname-c con 0x7f9d54139040 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:04.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 10 monclient(hunting): picked mon.noname-h con 0x7f9d5413fae0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:04.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5413f0c0 con 0x7f9d54139040 2024-09-13T10:39:04.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5413ad80 con 0x7f9d5413fae0 2024-09-13T10:39:04.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d541432f0 con 0x7f9d5409cd50 2024-09-13T10:39:04.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:04.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5bcd4640 10 monclient(hunting): authenticate will time out at 1283.764810s 2024-09-13T10:39:04.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5926f640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f9d54139040 0x7f9d541344e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:37614/0 (socket says 172.21.15.181:37614) 2024-09-13T10:39:04.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d59a70640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f9d5409cd50 0x7f9d54133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41770/0 (socket says 172.21.15.181:41770) 2024-09-13T10:39:04.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.259+0000 7f9d5926f640 1 -- 172.21.15.181:0/3850432838 learned_addr learned my addr 172.21.15.181:0/3850432838 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:04.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d5926f640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.181:6791/0 conn(0x7f9d54139040 legacy=0x7f9d541344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d59a70640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.181:6792/0 conn(0x7f9d5409cd50 legacy=0x7f9d54133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243679459 0 0) 0x7f9d5413f0c0 con 0x7f9d54139040 2024-09-13T10:39:04.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.277 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): my global_id is 115339 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d38003520 con 0x7f9d54139040 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197780558 0 0) 0x7f9d541432f0 con 0x7f9d5409cd50 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): my global_id is 134511 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d5413f0c0 con 0x7f9d5409cd50 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d5a271640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.195:6791/0 conn(0x7f9d5413fae0 legacy=0x7f9d541d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3064710229 0 0) 0x7f9d5413f0c0 con 0x7f9d5409cd50 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d541432f0 con 0x7f9d5409cd50 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 234635678 0 0) 0x7f9d38003520 con 0x7f9d54139040 2024-09-13T10:39:04.278 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d5413f0c0 con 0x7f9d54139040 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468398819 0 0) 0x7f9d5413ad80 con 0x7f9d5413fae0 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): my global_id is 105503 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d38003520 con 0x7f9d5413fae0 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9d50001320 con 0x7f9d5409cd50 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): dump: 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.279 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:04.280 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9d44004cd0 con 0x7f9d54139040 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient(hunting): dump: 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.281 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1559079508 0 0) 0x7f9d541432f0 con 0x7f9d5409cd50 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.195:6791/0 conn(0x7f9d5413fae0 legacy=0x7f9d541d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.181:6791/0 conn(0x7f9d54139040 legacy=0x7f9d541344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 monclient: found mon.d 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d54134bf0 con 0x7f9d5409cd50 2024-09-13T10:39:04.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d5bcd4640 5 monclient: authenticate success, global_id 134511 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d5bcd4640 10 monclient: _renew_subs 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d5bcd4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5413a7c0 con 0x7f9d5409cd50 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d5bcd4640 10 monclient: _renew_subs 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d5bcd4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d54133070 con 0x7f9d5409cd50 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d50001860 con 0x7f9d5409cd50 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9d50005110 con 0x7f9d5409cd50 2024-09-13T10:39:04.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4bfff640 4 set_mon_vals no callback set 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.262+0000 7f9d4a7fc640 10 monclient: dump: 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.284 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.263+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9d50011790 con 0x7f9d5409cd50 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.263+0000 7f9d5bcd4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.263+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d3c0065c0 con 0x7f9d3c002860 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.263+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(284..284 src has 1..284) ==== 3898+0+0 (unknown 2549241883 0 0) 0x7f9d5004e2b0 con 0x7f9d5409cd50 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.263+0000 7f9d5a271640 10 monclient: get_auth_request con 0x7f9d38040430 auth_method 0 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.265+0000 7f9d5926f640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.181:6790/0 conn(0x7f9d3c002860 legacy=0x7f9d3c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.265+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980203165 0 0) 0x7f9d3c0065c0 con 0x7f9d3c002860 2024-09-13T10:39:04.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 10 monclient(hunting): my global_id is 134570 2024-09-13T10:39:04.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d541432f0 con 0x7f9d3c002860 2024-09-13T10:39:04.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1340730609 0 0) 0x7f9d541432f0 con 0x7f9d3c002860 2024-09-13T10:39:04.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d3c0065c0 con 0x7f9d3c002860 2024-09-13T10:39:04.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9d440047e0 con 0x7f9d3c002860 2024-09-13T10:39:04.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:04.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 10 monclient: dump: 2024-09-13T10:39:04.286 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.286 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.287 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3646213514 0 0) 0x7f9d3c0065c0 con 0x7f9d3c002860 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d3c00a160 con 0x7f9d3c002860 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9d44005710 con 0x7f9d3c002860 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.181:6790/0 conn(0x7f9d3c002860 legacy=0x7f9d3c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.266+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.181:6790/0 conn(0x7f9d3c002860 legacy=0x7f9d3c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.272+0000 7f9d5bcd4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.272+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d3c009e70 con 0x7f9d3c009130 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d5926f640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.181:6790/0 conn(0x7f9d3c009130 legacy=0x7f9d3c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1125161343 0 0) 0x7f9d3c009e70 con 0x7f9d3c009130 2024-09-13T10:39:04.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 10 monclient(hunting): my global_id is 134579 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d3c0065c0 con 0x7f9d3c009130 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 380099668 0 0) 0x7f9d3c0065c0 con 0x7f9d3c009130 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d3c009e70 con 0x7f9d3c009130 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f9d44005f80 con 0x7f9d3c009130 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 10 monclient: dump: 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.289 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3827321007 0 0) 0x7f9d3c009e70 con 0x7f9d3c009130 2024-09-13T10:39:04.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9d3c00c410 con 0x7f9d3c009130 2024-09-13T10:39:04.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 454673818) 0x7f9d44007450 con 0x7f9d3c009130 2024-09-13T10:39:04.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:04.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:04.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.181:6790/0 conn(0x7f9d3c009130 legacy=0x7f9d3c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.275+0000 7f9d4a7fc640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.181:6790/0 conn(0x7f9d3c009130 legacy=0x7f9d3c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.291 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:04.291 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:04.291 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:04.291 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:04.291 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:04.291 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 76271, 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:39:04.292 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.293 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.294 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:04.295 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:04.296 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:04.296 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:04.296 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:04.296 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:04.296 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:04.296 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.296 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.296 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.296 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.296 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.296 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.297 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:04.299 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:04.300 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.300 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.300 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.300 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:04.300 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:04.300 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.300 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.300 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.300 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:04.301 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.302 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.303 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:04.304 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.305 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.305 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.305 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:04.305 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:04.305 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.305 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.305 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.305 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:04.305 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.306 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.307 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:04.310 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.311 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.311 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:04.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.311 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.311 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.311 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:04.311 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.311 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.311 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:04.311 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:04.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.276+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.195:6800/1839191919 conn(0x7f9d38040430 legacy=0x7f9d380428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.276+0000 7f9d5bcd4640 10 monclient: shutdown 2024-09-13T10:39:04.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.276+0000 7f9d5bcd4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:04.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.276+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/3850432838 >> v1:172.21.15.181:6792/0 conn(0x7f9d5409cd50 legacy=0x7f9d54133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.276+0000 7f9d5a271640 1 -- 172.21.15.181:0/3850432838 reap_dead start 2024-09-13T10:39:04.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.276+0000 7f9d5a271640 1 -- 172.21.15.181:0/3850432838 reap_dead start 2024-09-13T10:39:04.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.276+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/3850432838 shutdown_connections 2024-09-13T10:39:04.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.276+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/3850432838 >> 172.21.15.181:0/3850432838 conn(0x7f9d54077120 msgr2=0x7f9d540aab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:04.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.276+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/3850432838 shutdown_connections 2024-09-13T10:39:04.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.276+0000 7f9d5bcd4640 1 -- 172.21.15.181:0/3850432838 wait complete. 2024-09-13T10:39:04.313 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:04.314 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:39:04.314 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:39:04.316 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.275+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.316 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.275+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=970223734}) 2024-09-13T10:39:04.316 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.275+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2658631374}) 2024-09-13T10:39:04.316 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.275+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.316 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.275+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=970223734}) 2024-09-13T10:39:04.316 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.275+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3455454600}) 2024-09-13T10:39:04.316 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.275+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.275+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=970223734}) 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2765358354}) 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=970223734}) 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2227578104}) 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=970223734}) 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1671284047}) 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=970223734}) 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1621049965}) 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.317 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=970223734}) 2024-09-13T10:39:04.318 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=804283781}) 2024-09-13T10:39:04.318 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.318 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=970223734}) 2024-09-13T10:39:04.318 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.276+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=183865187}) 2024-09-13T10:39:04.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.414+0000 7f8d390fe640 10 monclient: get_monmap_and_config 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.414+0000 7f8d390fe640 10 monclient: build_initial_monmap 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.414+0000 7f8d390fe640 10 monclient: monmap: 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:04.415029+0000 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:04.415029+0000 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:04.416 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:04.417 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:04.417 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:04.417 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:04.417 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:04.417 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.414+0000 7f8d390fe640 1 Processor -- start 2024-09-13T10:39:04.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d390fe640 1 -- start start 2024-09-13T10:39:04.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d390fe640 10 monclient: init 2024-09-13T10:39:04.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d390fe640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:04.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d390fe640 10 monclient: _add_conns ranks=[0,1,7,6,2,3,8,4,5] 2024-09-13T10:39:04.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d390fe640 10 monclient(hunting): picked mon.noname-a con 0x7f8d340a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:04.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d390fe640 10 monclient(hunting): picked mon.noname-f con 0x7f8d340a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:04.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d390fe640 10 monclient(hunting): picked mon.noname-i con 0x7f8d3413f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:04.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d390fe640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d340a4bc0 con 0x7f8d340a6640 2024-09-13T10:39:04.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d390fe640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d3413a320 con 0x7f8d340a8340 2024-09-13T10:39:04.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d390fe640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d340a8100 con 0x7f8d3413f750 2024-09-13T10:39:04.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d390fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:04.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d390fe640 10 monclient(hunting): authenticate will time out at 1283.920575s 2024-09-13T10:39:04.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d32d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8d340a6640 0x7f8d34139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:33406/0 (socket says 172.21.15.181:33406) 2024-09-13T10:39:04.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.415+0000 7f8d32d9d640 1 -- 172.21.15.181:0/3991133645 learned_addr learned my addr 172.21.15.181:0/3991133645 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:04.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.417+0000 7f8d32d9d640 1 -- 172.21.15.181:0/3991133645 >> v1:172.21.15.181:6789/0 conn(0x7f8d340a6640 legacy=0x7f8d34139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.417+0000 7f8d31d9b640 1 -- 172.21.15.181:0/3991133645 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4245104134 0 0) 0x7f8d340a4bc0 con 0x7f8d340a6640 2024-09-13T10:39:04.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient(hunting): my global_id is 115308 2024-09-13T10:39:04.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 1 -- 172.21.15.181:0/3991133645 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d20003520 con 0x7f8d340a6640 2024-09-13T10:39:04.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d3359e640 1 -- 172.21.15.181:0/3991133645 >> v1:172.21.15.195:6792/0 conn(0x7f8d3413f750 legacy=0x7f8d34141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d3259c640 1 -- 172.21.15.181:0/3991133645 >> v1:172.21.15.195:6789/0 conn(0x7f8d340a8340 legacy=0x7f8d34139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 1 -- 172.21.15.181:0/3991133645 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 195375745 0 0) 0x7f8d20003520 con 0x7f8d340a6640 2024-09-13T10:39:04.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 1 -- 172.21.15.181:0/3991133645 >> v1:172.21.15.195:6792/0 conn(0x7f8d3413f750 legacy=0x7f8d34141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 1 -- 172.21.15.181:0/3991133645 >> v1:172.21.15.195:6789/0 conn(0x7f8d340a8340 legacy=0x7f8d34139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 1 monclient: found mon.noname-a 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 1 -- 172.21.15.181:0/3991133645 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d340a48e0 con 0x7f8d340a6640 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient: _finish_auth 0 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 1 -- 172.21.15.181:0/3991133645 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d24001ae0 con 0x7f8d340a6640 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient: dump: 2024-09-13T10:39:04.424 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.425 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d390fe640 5 monclient: authenticate success, global_id 115308 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d390fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 1 -- 172.21.15.181:0/3991133645 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d240048a0 con 0x7f8d340a6640 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 1 -- 172.21.15.181:0/3991133645 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d24004dd0 con 0x7f8d340a6640 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d390fe640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d390fe640 4 set_mon_vals no callback set 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d31d9b640 10 monclient: dump: 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.426 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.427 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d390fe640 10 monclient: shutdown 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d390fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d390fe640 1 -- 172.21.15.181:0/3991133645 >> v1:172.21.15.181:6789/0 conn(0x7f8d340a6640 legacy=0x7f8d34139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d390fe640 1 -- 172.21.15.181:0/3991133645 shutdown_connections 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d390fe640 1 -- 172.21.15.181:0/3991133645 >> 172.21.15.181:0/3991133645 conn(0x7f8d34077170 msgr2=0x7f8d340abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d390fe640 1 -- 172.21.15.181:0/3991133645 shutdown_connections 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.418+0000 7f8d390fe640 1 -- 172.21.15.181:0/3991133645 wait complete. 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.419+0000 7f8d390fe640 10 monclient: build_initial_monmap 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.419+0000 7f8d390fe640 10 monclient: monmap: 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:04.428 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 1 Processor -- start 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 1 -- start start 2024-09-13T10:39:04.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 10 monclient: init 2024-09-13T10:39:04.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:04.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 10 monclient: _add_conns ranks=[0,6,2,3,7,5,1,8,4] 2024-09-13T10:39:04.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 10 monclient(hunting): picked mon.noname-a con 0x7f8d340a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:04.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 10 monclient(hunting): picked mon.noname-d con 0x7f8d3413f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:04.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8d341420c0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:04.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d340a9c40 con 0x7f8d340a8340 2024-09-13T10:39:04.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d34142b60 con 0x7f8d341420c0 2024-09-13T10:39:04.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d3413bdb0 con 0x7f8d3413f750 2024-09-13T10:39:04.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:04.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d390fe640 10 monclient(hunting): authenticate will time out at 1283.925598s 2024-09-13T10:39:04.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d32d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8d340a8340 0x7f8d3412c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:33414/0 (socket says 172.21.15.181:33414) 2024-09-13T10:39:04.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.420+0000 7f8d32d9d640 1 -- 172.21.15.181:0/3144828982 learned_addr learned my addr 172.21.15.181:0/3144828982 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:04.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.422+0000 7f8d32d9d640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6789/0 conn(0x7f8d340a8340 legacy=0x7f8d3412c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.422+0000 7f8d3259c640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6792/0 conn(0x7f8d3413f750 legacy=0x7f8d341d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.422+0000 7f8d3359e640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6790/0 conn(0x7f8d341420c0 legacy=0x7f8d341d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.422+0000 7f8d32d9d640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6789/0 conn(0x7f8d340a8340 legacy=0x7f8d3412c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.422+0000 7f8d32d9d640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6789/0 conn(0x7f8d340a8340 legacy=0x7f8d3412c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.422+0000 7f8d32d9d640 1 --1- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6789/0 conn(0x7f8d340a8340 0x7f8d3412c700 :-1 s=OPENED pgs=693 cs=1 l=1).handle_message read tag failed 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.422+0000 7f8d32d9d640 1 --1- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6789/0 conn(0x7f8d340a8340 0x7f8d3412c700 :-1 s=OPENED pgs=693 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.422+0000 7f8d2b7fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.181:6789/0 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.422+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1482712393 0 0) 0x7f8d3413bdb0 con 0x7f8d3413f750 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): my global_id is 134520 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d14003550 con 0x7f8d3413f750 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199297360 0 0) 0x7f8d34142b60 con 0x7f8d341420c0 2024-09-13T10:39:04.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): my global_id is 134588 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d3413bdb0 con 0x7f8d341420c0 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3510505414 0 0) 0x7f8d14003550 con 0x7f8d3413f750 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d34142b60 con 0x7f8d3413f750 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3726044009 0 0) 0x7f8d3413bdb0 con 0x7f8d341420c0 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d14003550 con 0x7f8d341420c0 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d1c003610 con 0x7f8d3413f750 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.436 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.437 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d2c001f80 con 0x7f8d341420c0 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.438 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3418896426 0 0) 0x7f8d34142b60 con 0x7f8d3413f750 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6790/0 conn(0x7f8d341420c0 legacy=0x7f8d341d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6789/0 conn(0x7f8d340a8340 legacy=0x7f8d3412c700 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 monclient: found mon.d 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:04.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3413baa0 con 0x7f8d3413f750 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d390fe640 5 monclient: authenticate success, global_id 134520 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d390fe640 10 monclient: _renew_subs 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d390fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d390fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3413ae50 con 0x7f8d3413f750 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d390fe640 10 monclient: _renew_subs 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d390fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d390fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f8d3412cff0 con 0x7f8d3413f750 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d1c003b90 con 0x7f8d3413f750 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:04.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d1c004100 con 0x7f8d3413f750 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d3159a640 4 set_mon_vals no callback set 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.423+0000 7f8d2b7fe640 10 monclient: dump: 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.441 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.424+0000 7f8d390fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.424+0000 7f8d390fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8d180065c0 con 0x7f8d18002860 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.424+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f8d1c0042a0 con 0x7f8d3413f750 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.424+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(284..284 src has 1..284) ==== 3898+0+0 (unknown 2549241883 0 0) 0x7f8d1c04e2f0 con 0x7f8d3413f750 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.425+0000 7f8d3359e640 10 monclient: get_auth_request con 0x7f8d140400c0 auth_method 0 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.426+0000 7f8d32d9d640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6791/0 conn(0x7f8d18002860 legacy=0x7f8d18004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.426+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266326354 0 0) 0x7f8d180065c0 con 0x7f8d18002860 2024-09-13T10:39:04.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.426+0000 7f8d2b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.426+0000 7f8d2b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.426+0000 7f8d2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.426+0000 7f8d2b7fe640 10 monclient(hunting): my global_id is 115348 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.426+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d34142b60 con 0x7f8d18002860 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.426+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3751243671 0 0) 0x7f8d34142b60 con 0x7f8d18002860 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.427+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d180065c0 con 0x7f8d18002860 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.427+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d24001d30 con 0x7f8d18002860 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.427+0000 7f8d2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.427+0000 7f8d2b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.427+0000 7f8d2b7fe640 10 monclient: dump: 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.443 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.427+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 595884304 0 0) 0x7f8d180065c0 con 0x7f8d18002860 2024-09-13T10:39:04.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.427+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d1800a160 con 0x7f8d18002860 2024-09-13T10:39:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.427+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8d24004b90 con 0x7f8d18002860 2024-09-13T10:39:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.427+0000 7f8d2b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.427+0000 7f8d2b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.427+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6791/0 conn(0x7f8d18002860 legacy=0x7f8d18004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.427+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6791/0 conn(0x7f8d18002860 legacy=0x7f8d18004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.433+0000 7f8d390fe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:04.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.433+0000 7f8d390fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8d18009e50 con 0x7f8d18009110 2024-09-13T10:39:04.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.435+0000 7f8d32d9d640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6791/0 conn(0x7f8d18009110 legacy=0x7f8d180095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.435+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000172558 0 0) 0x7f8d18009e50 con 0x7f8d18009110 2024-09-13T10:39:04.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 10 monclient(hunting): my global_id is 115357 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d180065c0 con 0x7f8d18009110 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3819654795 0 0) 0x7f8d180065c0 con 0x7f8d18009110 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d18009e50 con 0x7f8d18009110 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8d24005450 con 0x7f8d18009110 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 10 monclient: dump: 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.447 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1074503382 0 0) 0x7f8d18009e50 con 0x7f8d18009110 2024-09-13T10:39:04.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8d1800c3f0 con 0x7f8d18009110 2024-09-13T10:39:04.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 2512652726) 0x7f8d240085c0 con 0x7f8d18009110 2024-09-13T10:39:04.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:04.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:04.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6791/0 conn(0x7f8d18009110 legacy=0x7f8d180095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d2b7fe640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6791/0 conn(0x7f8d18009110 legacy=0x7f8d180095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.449 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:04.449 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:04.449 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:04.449 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 180414, 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.450 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.451 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.452 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.453 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.453 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:04.453 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:04.453 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:04.453 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:04.453 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:04.453 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:04.453 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:04.453 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.454 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:04.455 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.456 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.458 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.459 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.461 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:04.461 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:04.461 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.461 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.461 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.461 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:04.461 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.461 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.461 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.461 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.462 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.463 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.463 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:04.463 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:04.463 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.463 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.463 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.463 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:04.464 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.465 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.468 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:04.469 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.469 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.469 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:04.469 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d390fe640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.195:6800/1839191919 conn(0x7f8d140400c0 legacy=0x7f8d14042580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d390fe640 10 monclient: shutdown 2024-09-13T10:39:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d390fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:04.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d390fe640 1 -- 172.21.15.181:0/3144828982 >> v1:172.21.15.181:6792/0 conn(0x7f8d3413f750 legacy=0x7f8d341d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.436+0000 7f8d3359e640 1 -- 172.21.15.181:0/3144828982 reap_dead start 2024-09-13T10:39:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.437+0000 7f8d3359e640 1 -- 172.21.15.181:0/3144828982 reap_dead start 2024-09-13T10:39:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.437+0000 7f8d390fe640 1 -- 172.21.15.181:0/3144828982 shutdown_connections 2024-09-13T10:39:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.437+0000 7f8d390fe640 1 -- 172.21.15.181:0/3144828982 >> 172.21.15.181:0/3144828982 conn(0x7f8d340a6640 msgr2=0x7f8d340a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.437+0000 7f8d390fe640 1 -- 172.21.15.181:0/3144828982 shutdown_connections 2024-09-13T10:39:04.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.437+0000 7f8d390fe640 1 -- 172.21.15.181:0/3144828982 wait complete. 2024-09-13T10:39:04.471 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:04.471 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:39:04.471 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:39:04.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.569+0000 7feae5240640 10 monclient: get_monmap_and_config 2024-09-13T10:39:04.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.569+0000 7feae5240640 10 monclient: build_initial_monmap 2024-09-13T10:39:04.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.569+0000 7feae5240640 10 monclient: monmap: 2024-09-13T10:39:04.571 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:04.571 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.571 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:04.569878+0000 2024-09-13T10:39:04.571 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:04.569878+0000 2024-09-13T10:39:04.571 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:04.571 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.571 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:04.571 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:04.571 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:04.572 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:04.572 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:04.572 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:04.572 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:04.572 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:04.572 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:04.572 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987187023}) 2024-09-13T10:39:04.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=924495128}) 2024-09-13T10:39:04.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987187023}) 2024-09-13T10:39:04.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=973291097}) 2024-09-13T10:39:04.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987187023}) 2024-09-13T10:39:04.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=92458388}) 2024-09-13T10:39:04.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987187023}) 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=749425385}) 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987187023}) 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=162758406}) 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987187023}) 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3704539947}) 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987187023}) 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=209097122}) 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987187023}) 2024-09-13T10:39:04.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.569+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3076351899}) 2024-09-13T10:39:04.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.570+0000 7feae5240640 1 Processor -- start 2024-09-13T10:39:04.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.570+0000 7feae5240640 1 -- start start 2024-09-13T10:39:04.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.570+0000 7feae5240640 10 monclient: init 2024-09-13T10:39:04.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.570+0000 7feae5240640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:04.577 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.571+0000 7feae5240640 10 monclient: _add_conns ranks=[2,6,5,3,7,4,0,1,8] 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.571+0000 7feae5240640 10 monclient(hunting): picked mon.noname-b con 0x7feae00a5550 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.571+0000 7feae5240640 10 monclient(hunting): picked mon.noname-d con 0x7feae006ebc0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.571+0000 7feae5240640 10 monclient(hunting): picked mon.noname-h con 0x7feae00a6040 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.571+0000 7feae5240640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae00706a0 con 0x7feae00a5550 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.571+0000 7feae5240640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae00a7020 con 0x7feae00a6040 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.571+0000 7feae5240640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae0072060 con 0x7feae006ebc0 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.571+0000 7feae5240640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.571+0000 7feae5240640 10 monclient(hunting): authenticate will time out at 1284.076098s 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.571+0000 7feade59c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7feae006ebc0 0x7feae013e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41796/0 (socket says 172.21.15.181:41796) 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.571+0000 7feade59c640 1 -- 172.21.15.181:0/4173732287 learned_addr learned my addr 172.21.15.181:0/4173732287 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.571+0000 7feaded9d640 1 --1- 172.21.15.181:0/4173732287 >> v1:172.21.15.181:6790/0 conn(0x7feae00a5550 0x7feae00a5930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55670/0 (socket says 172.21.15.181:55670) 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.573+0000 7feade59c640 1 -- 172.21.15.181:0/4173732287 >> v1:172.21.15.181:6792/0 conn(0x7feae006ebc0 legacy=0x7feae013e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.573+0000 7feaded9d640 1 -- 172.21.15.181:0/4173732287 >> v1:172.21.15.181:6790/0 conn(0x7feae00a5550 legacy=0x7feae00a5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.574+0000 7feadf59e640 1 -- 172.21.15.181:0/4173732287 >> v1:172.21.15.195:6791/0 conn(0x7feae00a6040 legacy=0x7feae0141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.577+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3092646624 0 0) 0x7feae00706a0 con 0x7feae00a5550 2024-09-13T10:39:04.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.577+0000 7feaddd9b640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.577+0000 7feaddd9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.577+0000 7feaddd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient(hunting): my global_id is 134597 2024-09-13T10:39:04.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feac8003520 con 0x7feae00a5550 2024-09-13T10:39:04.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438710707 0 0) 0x7feae00a7020 con 0x7feae00a6040 2024-09-13T10:39:04.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient(hunting): my global_id is 105512 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feae00706a0 con 0x7feae00a6040 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 129418933 0 0) 0x7feae0072060 con 0x7feae006ebc0 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient(hunting): my global_id is 134529 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feae00a7020 con 0x7feae006ebc0 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1499371361 0 0) 0x7feac8003520 con 0x7feae00a5550 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 >> v1:172.21.15.181:6792/0 conn(0x7feae006ebc0 legacy=0x7feae013e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 >> v1:172.21.15.195:6791/0 conn(0x7feae00a6040 legacy=0x7feae0141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient: _finish_hunting 0 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 monclient: found mon.noname-b 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae0072230 con 0x7feae00a5550 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient: _finish_auth 0 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient: _check_auth_tickets 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fead0001a00 con 0x7feae00a5550 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient: dump: 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.583 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.584 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feae5240640 5 monclient: authenticate success, global_id 134597 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feae5240640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fead0001cd0 con 0x7feae00a5550 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 1 -- 172.21.15.181:0/4173732287 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fead0004b20 con 0x7feae00a5550 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feae5240640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feae5240640 4 set_mon_vals no callback set 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.578+0000 7feaddd9b640 10 monclient: dump: 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.585 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.579+0000 7feae5240640 10 monclient: shutdown 2024-09-13T10:39:04.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.579+0000 7feae5240640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:04.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.579+0000 7feae5240640 1 -- 172.21.15.181:0/4173732287 >> v1:172.21.15.181:6790/0 conn(0x7feae00a5550 legacy=0x7feae00a5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.579+0000 7feae5240640 1 -- 172.21.15.181:0/4173732287 shutdown_connections 2024-09-13T10:39:04.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.579+0000 7feae5240640 1 -- 172.21.15.181:0/4173732287 >> 172.21.15.181:0/4173732287 conn(0x7feae00aa170 msgr2=0x7feae00a6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:04.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.579+0000 7feae5240640 1 -- 172.21.15.181:0/4173732287 shutdown_connections 2024-09-13T10:39:04.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.579+0000 7feae5240640 1 -- 172.21.15.181:0/4173732287 wait complete. 2024-09-13T10:39:04.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.580+0000 7feae5240640 10 monclient: build_initial_monmap 2024-09-13T10:39:04.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.580+0000 7feae5240640 10 monclient: monmap: 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:04.588 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:04.589 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:04.589 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3027998676}) 2024-09-13T10:39:04.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1756109978}) 2024-09-13T10:39:04.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3027998676}) 2024-09-13T10:39:04.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3315380596}) 2024-09-13T10:39:04.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3027998676}) 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=347574176}) 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3027998676}) 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=947869284}) 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3027998676}) 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1356135804}) 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3027998676}) 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2730407093}) 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3027998676}) 2024-09-13T10:39:04.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2275751875}) 2024-09-13T10:39:04.593 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.593 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3027998676}) 2024-09-13T10:39:04.593 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.578+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3267912092}) 2024-09-13T10:39:04.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.580+0000 7feae5240640 1 Processor -- start 2024-09-13T10:39:04.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.580+0000 7feae5240640 1 -- start start 2024-09-13T10:39:04.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.580+0000 7feae5240640 10 monclient: init 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.581+0000 7feae5240640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.581+0000 7feae5240640 10 monclient: _add_conns ranks=[0,1,5,6,8,2,3,4,7] 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.581+0000 7feae5240640 10 monclient(hunting): picked mon.noname-a con 0x7feae006ebc0 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.581+0000 7feae5240640 10 monclient(hunting): picked mon.noname-f con 0x7feae00a5550 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.581+0000 7feae5240640 10 monclient(hunting): picked mon.noname-h con 0x7feae00a6040 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.581+0000 7feae5240640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae01294b0 con 0x7feae006ebc0 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.581+0000 7feae5240640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae0129790 con 0x7feae00a5550 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.581+0000 7feae5240640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae00a3810 con 0x7feae00a6040 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.581+0000 7feae5240640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.581+0000 7feae5240640 10 monclient(hunting): authenticate will time out at 1284.086226s 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.581+0000 7feaded9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7feae006ebc0 0x7feae01ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:33430/0 (socket says 172.21.15.181:33430) 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.581+0000 7feaded9d640 1 -- 172.21.15.181:0/3690856967 learned_addr learned my addr 172.21.15.181:0/3690856967 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:04.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feaded9d640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.181:6789/0 conn(0x7feae006ebc0 legacy=0x7feae01ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feadf59e640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.195:6791/0 conn(0x7feae00a6040 legacy=0x7feae01d6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feade59c640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.195:6789/0 conn(0x7feae00a5550 legacy=0x7feae01d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2650312357 0 0) 0x7feae00a3810 con 0x7feae00a6040 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 10 monclient(hunting): my global_id is 105521 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feacc003520 con 0x7feae00a6040 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529632282 0 0) 0x7feae0129790 con 0x7feae00a5550 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 10 monclient(hunting): my global_id is 134560 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feae00a3810 con 0x7feae00a5550 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3066042585 0 0) 0x7feae01294b0 con 0x7feae006ebc0 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 10 monclient(hunting): my global_id is 115326 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.583+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feae0129790 con 0x7feae006ebc0 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3351484658 0 0) 0x7feacc003520 con 0x7feae00a6040 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feae01294b0 con 0x7feae00a6040 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fead8002030 con 0x7feae00a6040 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:39:04.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient(hunting): dump: 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.604 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2525698068 0 0) 0x7feae0129790 con 0x7feae006ebc0 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feacc003520 con 0x7feae006ebc0 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fead0004b20 con 0x7feae006ebc0 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient(hunting): dump: 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.605 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3028966631 0 0) 0x7feae00a3810 con 0x7feae00a5550 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feae0129790 con 0x7feae00a5550 2024-09-13T10:39:04.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fead4001d00 con 0x7feae00a5550 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient(hunting): dump: 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.607 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 755132603 0 0) 0x7feae01294b0 con 0x7feae00a6040 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.195:6789/0 conn(0x7feae00a5550 legacy=0x7feae01d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.181:6789/0 conn(0x7feae006ebc0 legacy=0x7feae01ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 monclient: found mon.h 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:04.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae00a32e0 con 0x7feae00a6040 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feae5240640 5 monclient: authenticate success, global_id 105521 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feae5240640 10 monclient: _renew_subs 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feae5240640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feae5240640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feae01291d0 con 0x7feae00a6040 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feae5240640 10 monclient: _renew_subs 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feae5240640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feae5240640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7feae0126dc0 con 0x7feae00a6040 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fead8003d50 con 0x7feae00a6040 2024-09-13T10:39:04.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fead8004340 con 0x7feae00a6040 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feadd59a640 4 set_mon_vals no callback set 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.584+0000 7feac77fe640 10 monclient: dump: 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.610 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.585+0000 7feae5240640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.585+0000 7feae5240640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feac00065c0 con 0x7feac0002860 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.585+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fead8004560 con 0x7feae00a6040 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.585+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(284..284 src has 1..284) ==== 3898+0+0 (unknown 2549241883 0 0) 0x7fead804e6b0 con 0x7feae00a6040 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.585+0000 7feade59c640 10 monclient: get_auth_request con 0x7feacc0403d0 auth_method 0 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feaded9d640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.181:6792/0 conn(0x7feac0002860 legacy=0x7feac0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3740666886 0 0) 0x7feac00065c0 con 0x7feac0002860 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 10 monclient(hunting): my global_id is 134538 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feae01294b0 con 0x7feac0002860 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1536558094 0 0) 0x7feae01294b0 con 0x7feac0002860 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feac00065c0 con 0x7feac0002860 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fead0001c50 con 0x7feac0002860 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 10 monclient: dump: 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.612 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.613 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.613 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.613 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.613 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.613 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.613 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2208179919 0 0) 0x7feac00065c0 con 0x7feac0002860 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.587+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feac000a160 con 0x7feac0002860 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.588+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fead00054e0 con 0x7feac0002860 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.588+0000 7feac77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.588+0000 7feac77fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:04.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.588+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.181:6792/0 conn(0x7feac0002860 legacy=0x7feac0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.588+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.181:6792/0 conn(0x7feac0002860 legacy=0x7feac0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.595+0000 7feae5240640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:04.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.595+0000 7feae5240640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feac0009e70 con 0x7feac0009130 2024-09-13T10:39:04.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.597+0000 7feaded9d640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.181:6792/0 conn(0x7feac0009130 legacy=0x7feac00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3724815071 0 0) 0x7feac0009e70 con 0x7feac0009130 2024-09-13T10:39:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 10 monclient(hunting): my global_id is 134547 2024-09-13T10:39:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feac00065c0 con 0x7feac0009130 2024-09-13T10:39:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3296844378 0 0) 0x7feac00065c0 con 0x7feac0009130 2024-09-13T10:39:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feac0009e70 con 0x7feac0009130 2024-09-13T10:39:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fead0005c40 con 0x7feac0009130 2024-09-13T10:39:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 10 monclient: dump: 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.619 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.620 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.620 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.620 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.620 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 613654671 0 0) 0x7feac0009e70 con 0x7feac0009130 2024-09-13T10:39:04.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.607+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feac000c3f0 con 0x7feac0009130 2024-09-13T10:39:04.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.610+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 1811740319) 0x7fead0006040 con 0x7feac0009130 2024-09-13T10:39:04.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.610+0000 7feac77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:04.620 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 76632, 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:04.621 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:04.622 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:04.622 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:04.624 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.624 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:39:04.624 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:04.624 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:04.624 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:04.624 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.624 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.624 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.624 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.624 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.624 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.625 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.625 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.625 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.625 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.625 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.625 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.625 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:04.625 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:04.625 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.626 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.626 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.626 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.626 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.626 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.626 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.626 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.626 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.626 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.626 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.626 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:04.627 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.628 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.629 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:04.630 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.631 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.632 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:04.633 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.634 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:04.636 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.637 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.638 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:04.639 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.640 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.641 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.642 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.642 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:39:04.642 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.642 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.642 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:04.642 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:04.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.610+0000 7feac77fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:04.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.610+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.181:6792/0 conn(0x7feac0009130 legacy=0x7feac00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.610+0000 7feac77fe640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.181:6792/0 conn(0x7feac0009130 legacy=0x7feac00095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.614+0000 7feac57fa640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.195:6800/1839191919 conn(0x7feacc0403d0 legacy=0x7feacc042890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.614+0000 7feadf59e640 1 -- 172.21.15.181:0/3690856967 reap_dead start 2024-09-13T10:39:04.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.614+0000 7feac57fa640 10 monclient: shutdown 2024-09-13T10:39:04.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.614+0000 7feac57fa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:04.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.614+0000 7feac57fa640 1 -- 172.21.15.181:0/3690856967 >> v1:172.21.15.195:6791/0 conn(0x7feae00a6040 legacy=0x7feae01d6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.615+0000 7feac57fa640 1 -- 172.21.15.181:0/3690856967 shutdown_connections 2024-09-13T10:39:04.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.615+0000 7feac57fa640 1 -- 172.21.15.181:0/3690856967 >> 172.21.15.181:0/3690856967 conn(0x7feae00aa170 msgr2=0x7feae0142b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:04.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.616+0000 7feac57fa640 1 -- 172.21.15.181:0/3690856967 shutdown_connections 2024-09-13T10:39:04.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.616+0000 7feac57fa640 1 -- 172.21.15.181:0/3690856967 wait complete. 2024-09-13T10:39:04.647 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:04.647 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:39:04.647 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:39:04.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2269725918}) 2024-09-13T10:39:04.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3204350447}) 2024-09-13T10:39:04.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2269725918}) 2024-09-13T10:39:04.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=678360753}) 2024-09-13T10:39:04.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2269725918}) 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4030622835}) 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2269725918}) 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=670069752}) 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2269725918}) 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3217741624}) 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2269725918}) 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1821366522}) 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2269725918}) 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2855812777}) 2024-09-13T10:39:04.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2269725918}) 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.592+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3394818520}) 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1088583252}) 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2087130773}) 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1088583252}) 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=33397126}) 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1088583252}) 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=972321127}) 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1088583252}) 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3819612135}) 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1088583252}) 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=197737633}) 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1088583252}) 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3343110869}) 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1088583252}) 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=636876144}) 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1088583252}) 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.597+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1105996411}) 2024-09-13T10:39:04.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714393929}) 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1215109130}) 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714393929}) 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3735854569}) 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714393929}) 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=696263359}) 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714393929}) 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=89979399}) 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714393929}) 2024-09-13T10:39:04.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3160770386}) 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714393929}) 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1728583504}) 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714393929}) 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3550568490}) 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1714393929}) 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.607+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2808478649}) 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=141854956}) 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2941744613}) 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=141854956}) 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2170239003}) 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=141854956}) 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1199183064}) 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=141854956}) 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1532396330}) 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=141854956}) 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2880226612}) 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=141854956}) 2024-09-13T10:39:04.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2426923758}) 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=141854956}) 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3935700468}) 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=141854956}) 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.612+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4249638204}) 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698422198}) 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2915779035}) 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698422198}) 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4031829191}) 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698422198}) 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3154429125}) 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698422198}) 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2630693689}) 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698422198}) 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1137358682}) 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698422198}) 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3691683835}) 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698422198}) 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3581928201}) 2024-09-13T10:39:04.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3698422198}) 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.632+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2115920255}) 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3433872908}) 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=450835314}) 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.633+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3433872908}) 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3008616068}) 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3433872908}) 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2786738181}) 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3433872908}) 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2270816095}) 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3433872908}) 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1706149834}) 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3433872908}) 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=179536873}) 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3433872908}) 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2923137817}) 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3433872908}) 2024-09-13T10:39:04.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2579702901}) 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3821089673}) 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=688926459}) 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3821089673}) 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3237928866}) 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3821089673}) 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1434813425}) 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3821089673}) 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2471339558}) 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.665 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3821089673}) 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=761129561}) 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3821089673}) 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1672712857}) 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3821089673}) 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1137288306}) 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3821089673}) 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.635+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4009754709}) 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3575900957}) 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2686093199}) 2024-09-13T10:39:04.666 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3575900957}) 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3002004055}) 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3575900957}) 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2345000513}) 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3575900957}) 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1857602820}) 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3575900957}) 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1777330296}) 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3575900957}) 2024-09-13T10:39:04.667 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3010419502}) 2024-09-13T10:39:04.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3575900957}) 2024-09-13T10:39:04.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=376552644}) 2024-09-13T10:39:04.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3575900957}) 2024-09-13T10:39:04.668 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.636+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=579622401}) 2024-09-13T10:39:04.709 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:04.709 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40416]: starting. 2024-09-13T10:39:04.709 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40416]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40379 2024-09-13T10:39:04.709 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40416]: created object 0... 2024-09-13T10:39:04.709 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40416]: created object 25... 2024-09-13T10:39:04.709 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40416]: created object 49... 2024-09-13T10:39:04.709 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40416]: finishing. 2024-09-13T10:39:04.709 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40416]: shutting down. 2024-09-13T10:39:04.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2450470100}) 2024-09-13T10:39:04.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=545272933}) 2024-09-13T10:39:04.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2450470100}) 2024-09-13T10:39:04.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=262886432}) 2024-09-13T10:39:04.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2450470100}) 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2074256287}) 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2450470100}) 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3409269522}) 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2450470100}) 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1282594839}) 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2450470100}) 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1573256606}) 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2450470100}) 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1249380450}) 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.734+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2450470100}) 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.735+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2851568112}) 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2049442351}) 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1392265217}) 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2049442351}) 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=681209586}) 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2049442351}) 2024-09-13T10:39:04.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2109999938}) 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2049442351}) 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2461093982}) 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2049442351}) 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1195901808}) 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2049442351}) 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=594353680}) 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2049442351}) 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=682342048}) 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2049442351}) 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.736+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2740762450}) 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1656477344}) 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728168182}) 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1656477344}) 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=462955257}) 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1656477344}) 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2933404180}) 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1656477344}) 2024-09-13T10:39:04.754 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2425705533}) 2024-09-13T10:39:04.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1656477344}) 2024-09-13T10:39:04.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=111293229}) 2024-09-13T10:39:04.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1656477344}) 2024-09-13T10:39:04.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1649233815}) 2024-09-13T10:39:04.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1656477344}) 2024-09-13T10:39:04.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=442368650}) 2024-09-13T10:39:04.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1656477344}) 2024-09-13T10:39:04.755 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1002385235}) 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=288991426}) 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4052771167}) 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=288991426}) 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=775719977}) 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=288991426}) 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2297173841}) 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=288991426}) 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2251126928}) 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.756 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=288991426}) 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4175487716}) 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=288991426}) 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1925642875}) 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=288991426}) 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2987618522}) 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=288991426}) 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.739+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2564725260}) 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2271496226}) 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1969743679}) 2024-09-13T10:39:04.757 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2271496226}) 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2142606956}) 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2271496226}) 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1871161813}) 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2271496226}) 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2692909816}) 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2271496226}) 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3111695528}) 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.758 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2271496226}) 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1591082547}) 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2271496226}) 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2252502384}) 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2271496226}) 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.740+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1943132848}) 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.741+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.741+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=935571958}) 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.741+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1683945306}) 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=935571958}) 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3471591882}) 2024-09-13T10:39:04.759 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=935571958}) 2024-09-13T10:39:04.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2151703229}) 2024-09-13T10:39:04.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=935571958}) 2024-09-13T10:39:04.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3782755286}) 2024-09-13T10:39:04.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=935571958}) 2024-09-13T10:39:04.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2249987270}) 2024-09-13T10:39:04.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=935571958}) 2024-09-13T10:39:04.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=559907417}) 2024-09-13T10:39:04.760 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=935571958}) 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1580297031}) 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=935571958}) 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.742+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4250322520}) 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3464896183}) 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3846331160}) 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3464896183}) 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1282577580}) 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3464896183}) 2024-09-13T10:39:04.761 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4250996926}) 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3464896183}) 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=346609410}) 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3464896183}) 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3007663624}) 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3464896183}) 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2213395663}) 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3464896183}) 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3708622130}) 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.762 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3464896183}) 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.743+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=958393178}) 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1920915416}) 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252777190}) 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1920915416}) 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2176063823}) 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1920915416}) 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2192861370}) 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1920915416}) 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1251467426}) 2024-09-13T10:39:04.763 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1920915416}) 2024-09-13T10:39:04.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1796378954}) 2024-09-13T10:39:04.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1920915416}) 2024-09-13T10:39:04.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3685460169}) 2024-09-13T10:39:04.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.744+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1920915416}) 2024-09-13T10:39:04.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.745+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3499272808}) 2024-09-13T10:39:04.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.745+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.745+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1920915416}) 2024-09-13T10:39:04.764 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.745+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2116607758}) 2024-09-13T10:39:04.765 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:04.765 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40418]: starting. 2024-09-13T10:39:04.765 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40418]: listing objects. 2024-09-13T10:39:04.765 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40418]: listed object 0... 2024-09-13T10:39:04.765 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40418]: listed object 25... 2024-09-13T10:39:04.765 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40418]: saw 50 objects 2024-09-13T10:39:04.765 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40418]: shutting down. 2024-09-13T10:39:04.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.755+0000 7f2fd03ca640 10 monclient: get_monmap_and_config 2024-09-13T10:39:04.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.755+0000 7f2fd03ca640 10 monclient: build_initial_monmap 2024-09-13T10:39:04.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.755+0000 7f2fd03ca640 10 monclient: monmap: 2024-09-13T10:39:04.786 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:04.786 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.786 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:04.756453+0000 2024-09-13T10:39:04.786 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:04.756453+0000 2024-09-13T10:39:04.786 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:04.786 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.786 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:04.786 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:04.787 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:04.787 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:04.787 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:04.787 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:04.787 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:04.787 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:04.787 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:04.787 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.756+0000 7f2fd03ca640 1 Processor -- start 2024-09-13T10:39:04.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.756+0000 7f2fd03ca640 1 -- start start 2024-09-13T10:39:04.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.756+0000 7f2fd03ca640 10 monclient: init 2024-09-13T10:39:04.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fd03ca640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:04.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fd03ca640 10 monclient: _add_conns ranks=[4,0,6,8,7,3,5,1,2] 2024-09-13T10:39:04.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fd03ca640 10 monclient(hunting): picked mon.noname-c con 0x7f2fc80a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:04.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fd03ca640 10 monclient(hunting): picked mon.noname-a con 0x7f2fc80a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:04.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fd03ca640 10 monclient(hunting): picked mon.noname-d con 0x7f2fc813f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:04.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fd03ca640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc80a5fe0 con 0x7f2fc80a6ab0 2024-09-13T10:39:04.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fd03ca640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc80a8080 con 0x7f2fc80a66d0 2024-09-13T10:39:04.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fd03ca640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc80a42c0 con 0x7f2fc813f9a0 2024-09-13T10:39:04.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fd03ca640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:04.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fd03ca640 10 monclient(hunting): authenticate will time out at 1284.262122s 2024-09-13T10:39:04.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fcd965640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2fc80a6ab0 0x7f2fc80a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:33438/0 (socket says 172.21.15.181:33438) 2024-09-13T10:39:04.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fce967640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f2fc813f9a0 0x7f2fc8141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41818/0 (socket says 172.21.15.181:41818) 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fce166640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f2fc80a66d0 0x7f2fc80a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:37640/0 (socket says 172.21.15.181:37640) 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.757+0000 7f2fcd965640 1 -- 172.21.15.181:0/3852596338 learned_addr learned my addr 172.21.15.181:0/3852596338 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fce967640 1 -- 172.21.15.181:0/3852596338 >> v1:172.21.15.181:6792/0 conn(0x7f2fc813f9a0 legacy=0x7f2fc8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd965640 1 -- 172.21.15.181:0/3852596338 >> v1:172.21.15.181:6789/0 conn(0x7f2fc80a6ab0 legacy=0x7f2fc80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fce166640 1 -- 172.21.15.181:0/3852596338 >> v1:172.21.15.181:6791/0 conn(0x7f2fc80a66d0 legacy=0x7f2fc80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 91369644 0 0) 0x7f2fc80a8080 con 0x7f2fc80a66d0 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient(hunting): my global_id is 115366 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fb4003520 con 0x7f2fc80a66d0 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3947902469 0 0) 0x7f2fc80a5fe0 con 0x7f2fc80a6ab0 2024-09-13T10:39:04.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient(hunting): my global_id is 115335 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc80a8080 con 0x7f2fc80a6ab0 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577237730 0 0) 0x7f2fc80a42c0 con 0x7f2fc813f9a0 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient(hunting): my global_id is 134556 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc80a5fe0 con 0x7f2fc813f9a0 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2747940971 0 0) 0x7f2fb4003520 con 0x7f2fc80a66d0 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 >> v1:172.21.15.181:6792/0 conn(0x7f2fc813f9a0 legacy=0x7f2fc8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 >> v1:172.21.15.181:6789/0 conn(0x7f2fc80a6ab0 legacy=0x7f2fc80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient: _finish_hunting 0 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 monclient: found mon.noname-c 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc81464e0 con 0x7f2fc80a66d0 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient: _finish_auth 0 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient: _check_auth_tickets 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2fc4001a10 con 0x7f2fc80a66d0 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient: dump: 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.791 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.792 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fd03ca640 5 monclient: authenticate success, global_id 115366 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fd03ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fc4001ce0 con 0x7f2fc80a66d0 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 1 -- 172.21.15.181:0/3852596338 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2fc4004b20 con 0x7f2fc80a66d0 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fd03ca640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fd03ca640 4 set_mon_vals no callback set 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.759+0000 7f2fcd164640 10 monclient: dump: 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.793 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.760+0000 7f2fd03ca640 10 monclient: shutdown 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.760+0000 7f2fd03ca640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:04.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.760+0000 7f2fd03ca640 1 -- 172.21.15.181:0/3852596338 >> v1:172.21.15.181:6791/0 conn(0x7f2fc80a66d0 legacy=0x7f2fc80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.760+0000 7f2fd03ca640 1 -- 172.21.15.181:0/3852596338 shutdown_connections 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.760+0000 7f2fd03ca640 1 -- 172.21.15.181:0/3852596338 >> 172.21.15.181:0/3852596338 conn(0x7f2fc80abcd0 msgr2=0x7f2fc80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.760+0000 7f2fd03ca640 1 -- 172.21.15.181:0/3852596338 shutdown_connections 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.760+0000 7f2fd03ca640 1 -- 172.21.15.181:0/3852596338 wait complete. 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 10 monclient: build_initial_monmap 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 10 monclient: monmap: 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:04.795 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 1 Processor -- start 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 1 -- start start 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 10 monclient: init 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:04.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 10 monclient: _add_conns ranks=[0,2,4,6,8,7,3,1,5] 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 10 monclient(hunting): picked mon.noname-a con 0x7f2fc80a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 10 monclient(hunting): picked mon.noname-b con 0x7f2fc80a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 10 monclient(hunting): picked mon.noname-c con 0x7f2fc813f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc813d070 con 0x7f2fc80a66d0 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc8070680 con 0x7f2fc80a6ab0 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc8139070 con 0x7f2fc813f9a0 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.761+0000 7f2fd03ca640 10 monclient(hunting): authenticate will time out at 1284.266966s 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.762+0000 7f2fce967640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f2fc813f9a0 0x7f2fc81d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:37648/0 (socket says 172.21.15.181:37648) 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.762+0000 7f2fce166640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2fc80a66d0 0x7f2fc8136a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:33454/0 (socket says 172.21.15.181:33454) 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.762+0000 7f2fce967640 1 -- 172.21.15.181:0/417967476 learned_addr learned my addr 172.21.15.181:0/417967476 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fce166640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.181:6789/0 conn(0x7f2fc80a66d0 legacy=0x7f2fc8136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fce967640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.181:6791/0 conn(0x7f2fc813f9a0 legacy=0x7f2fc81d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.797 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fcd965640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.181:6790/0 conn(0x7f2fc80a6ab0 legacy=0x7f2fc81d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908972323 0 0) 0x7f2fc813d070 con 0x7f2fc80a66d0 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): my global_id is 115344 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fac003520 con 0x7f2fc80a66d0 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3230927206 0 0) 0x7f2fc8139070 con 0x7f2fc813f9a0 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): my global_id is 115375 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc813d070 con 0x7f2fc813f9a0 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366452500 0 0) 0x7f2fb8001c70 con 0x7f2fc80a6ab0 2024-09-13T10:39:04.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): my global_id is 134606 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc8139070 con 0x7f2fc80a6ab0 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 393046015 0 0) 0x7f2fac003520 con 0x7f2fc80a66d0 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fb8001c70 con 0x7f2fc80a66d0 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2fc4004b20 con 0x7f2fc80a66d0 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): dump: 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.799 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 299157326 0 0) 0x7f2fc813d070 con 0x7f2fc813f9a0 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fac003520 con 0x7f2fc813f9a0 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2fc0002000 con 0x7f2fc813f9a0 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): dump: 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.801 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 535094725 0 0) 0x7f2fc8139070 con 0x7f2fc80a6ab0 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fc813d070 con 0x7f2fc80a6ab0 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2fb80047e0 con 0x7f2fc80a6ab0 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient(hunting): dump: 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.803 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 437173784 0 0) 0x7f2fb8001c70 con 0x7f2fc80a66d0 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.181:6791/0 conn(0x7f2fc813f9a0 legacy=0x7f2fc81d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.181:6790/0 conn(0x7f2fc80a6ab0 legacy=0x7f2fc81d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 monclient: found mon.a 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc813e870 con 0x7f2fc80a66d0 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient: _finish_auth 0 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:04.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fbeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fd03ca640 5 monclient: authenticate success, global_id 115344 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fd03ca640 10 monclient: _renew_subs 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fd03ca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fd03ca640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc813f3d0 con 0x7f2fc80a66d0 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fd03ca640 10 monclient: _renew_subs 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fd03ca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.764+0000 7f2fd03ca640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2fc8137130 con 0x7f2fc80a66d0 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.765+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fc4001ce0 con 0x7f2fc80a66d0 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.765+0000 7f2fbeffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.765+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2fc40014b0 con 0x7f2fc80a66d0 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.765+0000 7f2fbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.765+0000 7f2fcc963640 4 set_mon_vals no callback set 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.765+0000 7f2fbeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:04.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.765+0000 7f2fbeffd640 10 monclient: dump: 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.806 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.765+0000 7f2fd03ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.765+0000 7f2fd03ca640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2fb00065c0 con 0x7f2fb0002860 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.765+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2fc40119b0 con 0x7f2fc80a66d0 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.766+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(285..285 src has 1..285) ==== 3898+0+0 (unknown 2129848869 0 0) 0x7f2fc404e300 con 0x7f2fc80a66d0 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.766+0000 7f2fce967640 10 monclient: get_auth_request con 0x7f2fac040560 auth_method 0 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.767+0000 7f2fcd965640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.181:6793/0 conn(0x7f2fb0002860 legacy=0x7f2fb0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1586672687 0 0) 0x7f2fb00065c0 con 0x7f2fb0002860 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.807 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 10 monclient(hunting): my global_id is 105650 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fb8001c70 con 0x7f2fb0002860 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1241285195 0 0) 0x7f2fb8001c70 con 0x7f2fb0002860 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fb00065c0 con 0x7f2fb0002860 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2fb8004ef0 con 0x7f2fb0002860 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 10 monclient: dump: 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.808 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2645174700 0 0) 0x7f2fb00065c0 con 0x7f2fb0002860 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fb000a160 con 0x7f2fb0002860 2024-09-13T10:39:04.809 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2fb8006490 con 0x7f2fb0002860 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.181:6793/0 conn(0x7f2fb0002860 legacy=0x7f2fb0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.768+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.181:6793/0 conn(0x7f2fb0002860 legacy=0x7f2fb0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.774+0000 7f2fd03ca640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.774+0000 7f2fd03ca640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2fb0009e50 con 0x7f2fb0009110 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fcd965640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.181:6793/0 conn(0x7f2fb0009110 legacy=0x7f2fb00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3519323668 0 0) 0x7f2fb0009e50 con 0x7f2fb0009110 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 10 monclient(hunting): my global_id is 105659 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fb00065c0 con 0x7f2fb0009110 2024-09-13T10:39:04.810 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1347082546 0 0) 0x7f2fb00065c0 con 0x7f2fb0009110 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fb0009e50 con 0x7f2fb0009110 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2fb8005560 con 0x7f2fb0009110 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 10 monclient: dump: 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.811 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3210458791 0 0) 0x7f2fb0009e50 con 0x7f2fb0009110 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2fb000c3a0 con 0x7f2fb0009110 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7560 (unknown 0 0 2136830677) 0x7f2fb8005990 con 0x7f2fb0009110 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:04.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.181:6793/0 conn(0x7f2fb0009110 legacy=0x7f2fb00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.777+0000 7f2fbeffd640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.181:6793/0 conn(0x7f2fb0009110 legacy=0x7f2fb00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.813 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:04.813 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:04.813 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:04.813 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:04.813 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:04.813 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 228480, 2024-09-13T10:39:04.813 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:04.814 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:04.815 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:04.817 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.818 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.819 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:04.820 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.822 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.823 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.824 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.825 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:04.828 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:04.828 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.828 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.828 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.828 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:04.828 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.828 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.829 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:04.830 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:04.832 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:04.833 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.834 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.834 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:04.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.834 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.834 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.834 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:04.834 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.834 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.834 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:04.834 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:04.835 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.835 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2935276342}) 2024-09-13T10:39:04.835 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3656405439}) 2024-09-13T10:39:04.835 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2935276342}) 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2302073223}) 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2935276342}) 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1997171414}) 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2935276342}) 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1799377180}) 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2935276342}) 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3884794237}) 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2935276342}) 2024-09-13T10:39:04.836 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2009510706}) 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2935276342}) 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=105540890}) 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2935276342}) 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.746+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=502739414}) 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3223230642}) 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2782513822}) 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3223230642}) 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4145447304}) 2024-09-13T10:39:04.837 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3223230642}) 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1106382601}) 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3223230642}) 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2053533063}) 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3223230642}) 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2323534647}) 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3223230642}) 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4236957858}) 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3223230642}) 2024-09-13T10:39:04.838 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2972498820}) 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3223230642}) 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.747+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1266127591}) 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2580843775}) 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=896940944}) 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2580843775}) 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=769628795}) 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2580843775}) 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2513534080}) 2024-09-13T10:39:04.839 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2580843775}) 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3678038315}) 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2580843775}) 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3663277321}) 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2580843775}) 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=644736889}) 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2580843775}) 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=228256252}) 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.840 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2580843775}) 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.748+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1875017484}) 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3261211193}) 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3751736390}) 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3261211193}) 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1132535544}) 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3261211193}) 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=691651335}) 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3261211193}) 2024-09-13T10:39:04.841 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3565805974}) 2024-09-13T10:39:04.842 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.842 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3261211193}) 2024-09-13T10:39:04.842 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4144046198}) 2024-09-13T10:39:04.842 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.842 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3261211193}) 2024-09-13T10:39:04.842 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1263591138}) 2024-09-13T10:39:04.842 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.842 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3261211193}) 2024-09-13T10:39:04.842 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2708586386}) 2024-09-13T10:39:04.842 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.842 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3261211193}) 2024-09-13T10:39:04.842 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.750+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3487691392}) 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2735392770}) 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2572524750}) 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2735392770}) 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3633881758}) 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2735392770}) 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1500009358}) 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2735392770}) 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1089771479}) 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.843 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2735392770}) 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2151157392}) 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2735392770}) 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4153140504}) 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2735392770}) 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=408989497}) 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2735392770}) 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.751+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3514645244}) 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=185802321}) 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1283980724}) 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.844 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=185802321}) 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3034551763}) 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=185802321}) 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=970720363}) 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=185802321}) 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=800172460}) 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=185802321}) 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1423518840}) 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=185802321}) 2024-09-13T10:39:04.845 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2136375957}) 2024-09-13T10:39:04.846 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.846 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.752+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=185802321}) 2024-09-13T10:39:04.846 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.753+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2317710200}) 2024-09-13T10:39:04.846 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.753+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:04.846 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.753+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=185802321}) 2024-09-13T10:39:04.846 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:04.753+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4068615795}) 2024-09-13T10:39:04.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.778+0000 7f2fd03ca640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.195:6800/1839191919 conn(0x7f2fac040560 legacy=0x7f2fac042a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.778+0000 7f2fd03ca640 10 monclient: shutdown 2024-09-13T10:39:04.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.778+0000 7f2fd03ca640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:04.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.778+0000 7f2fd03ca640 1 -- 172.21.15.181:0/417967476 >> v1:172.21.15.181:6789/0 conn(0x7f2fc80a66d0 legacy=0x7f2fc8136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.778+0000 7f2fce967640 1 -- 172.21.15.181:0/417967476 reap_dead start 2024-09-13T10:39:04.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.778+0000 7f2fce967640 1 -- 172.21.15.181:0/417967476 reap_dead start 2024-09-13T10:39:04.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.778+0000 7f2fd03ca640 1 -- 172.21.15.181:0/417967476 shutdown_connections 2024-09-13T10:39:04.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.778+0000 7f2fd03ca640 1 -- 172.21.15.181:0/417967476 >> 172.21.15.181:0/417967476 conn(0x7f2fc80abcd0 msgr2=0x7f2fc80a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:04.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.778+0000 7f2fd03ca640 1 -- 172.21.15.181:0/417967476 shutdown_connections 2024-09-13T10:39:04.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.778+0000 7f2fd03ca640 1 -- 172.21.15.181:0/417967476 wait complete. 2024-09-13T10:39:04.848 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:04.848 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:39:04.848 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:39:04.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.946+0000 7f5ea0bcd640 10 monclient: get_monmap_and_config 2024-09-13T10:39:04.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.946+0000 7f5ea0bcd640 10 monclient: build_initial_monmap 2024-09-13T10:39:04.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.946+0000 7f5ea0bcd640 10 monclient: monmap: 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:04.946904+0000 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:04.946904+0000 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:04.948 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:04.949 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:04.949 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.946+0000 7f5ea0bcd640 1 Processor -- start 2024-09-13T10:39:04.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5ea0bcd640 1 -- start start 2024-09-13T10:39:04.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5ea0bcd640 10 monclient: init 2024-09-13T10:39:04.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5ea0bcd640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:04.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5ea0bcd640 10 monclient: _add_conns ranks=[6,4,2,0,7,5,1,8,3] 2024-09-13T10:39:04.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5ea0bcd640 10 monclient(hunting): picked mon.noname-d con 0x7f5e9c0a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:04.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5ea0bcd640 10 monclient(hunting): picked mon.noname-c con 0x7f5e9c0a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:04.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5ea0bcd640 10 monclient(hunting): picked mon.noname-b con 0x7f5e9c13f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:04.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5ea0bcd640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e9c0a5fe0 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5ea0bcd640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e9c0a8080 con 0x7f5e9c0a6ab0 2024-09-13T10:39:04.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5ea0bcd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e9c0a42c0 con 0x7f5e9c0a66d0 2024-09-13T10:39:04.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5ea0bcd640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:04.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5e9a59c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f5e9c0a66d0 0x7f5e9c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41828/0 (socket says 172.21.15.181:41828) 2024-09-13T10:39:04.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5ea0bcd640 10 monclient(hunting): authenticate will time out at 1284.452689s 2024-09-13T10:39:04.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.947+0000 7f5e9a59c640 1 -- 172.21.15.181:0/2717818642 learned_addr learned my addr 172.21.15.181:0/2717818642 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:04.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.949+0000 7f5e9a59c640 1 -- 172.21.15.181:0/2717818642 >> v1:172.21.15.181:6792/0 conn(0x7f5e9c0a66d0 legacy=0x7f5e9c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.949+0000 7f5e9ad9d640 1 -- 172.21.15.181:0/2717818642 >> v1:172.21.15.181:6790/0 conn(0x7f5e9c13f9a0 legacy=0x7f5e9c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.949+0000 7f5e93fff640 1 -- 172.21.15.181:0/2717818642 >> v1:172.21.15.181:6791/0 conn(0x7f5e9c0a6ab0 legacy=0x7f5e9c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668063638 0 0) 0x7f5e9c0a5fe0 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient(hunting): my global_id is 134615 2024-09-13T10:39:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e88003520 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375362185 0 0) 0x7f5e9c0a42c0 con 0x7f5e9c0a66d0 2024-09-13T10:39:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient(hunting): my global_id is 134565 2024-09-13T10:39:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e9c0a5fe0 con 0x7f5e9c0a66d0 2024-09-13T10:39:04.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 500910662 0 0) 0x7f5e9c0a8080 con 0x7f5e9c0a6ab0 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient(hunting): my global_id is 115384 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e9c0a42c0 con 0x7f5e9c0a6ab0 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1976394756 0 0) 0x7f5e9c0a5fe0 con 0x7f5e9c0a66d0 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 >> v1:172.21.15.181:6791/0 conn(0x7f5e9c0a6ab0 legacy=0x7f5e9c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e9ad9d640 1 --1- 172.21.15.181:0/2717818642 >> v1:172.21.15.181:6790/0 conn(0x7f5e9c13f9a0 0x7f5e9c141d90 :-1 s=OPENED pgs=461 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f5e94001dd0 mon_map magic: 0 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 >> v1:172.21.15.181:6790/0 conn(0x7f5e9c13f9a0 legacy=0x7f5e9c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 monclient: found mon.noname-d 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:04.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9c1464e0 con 0x7f5e9c0a66d0 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient: _finish_auth 0 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e8c0019d0 con 0x7f5e9c0a66d0 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient: dump: 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.958 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e94001dd0 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5ea0bcd640 5 monclient: authenticate success, global_id 134565 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5ea0bcd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:04.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5e8c001ca0 con 0x7f5e9c0a66d0 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 1 -- 172.21.15.181:0/2717818642 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e8c004be0 con 0x7f5e9c0a66d0 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5ea0bcd640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5ea0bcd640 4 set_mon_vals no callback set 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5e99d9b640 10 monclient: dump: 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.960 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5ea0bcd640 10 monclient: shutdown 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5ea0bcd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.950+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2717818642 >> v1:172.21.15.181:6792/0 conn(0x7f5e9c0a66d0 legacy=0x7f5e9c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.951+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2717818642 shutdown_connections 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.951+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2717818642 >> 172.21.15.181:0/2717818642 conn(0x7f5e9c0abcd0 msgr2=0x7f5e9c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.951+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2717818642 shutdown_connections 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.951+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2717818642 wait complete. 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.951+0000 7f5ea0bcd640 10 monclient: build_initial_monmap 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.951+0000 7f5ea0bcd640 10 monclient: monmap: 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 1 Processor -- start 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 1 -- start start 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 10 monclient: init 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 10 monclient: _add_conns ranks=[5,1,6,2,7,4,3,0,8] 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 10 monclient(hunting): picked mon.noname-h con 0x7f5e9c0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:04.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 10 monclient(hunting): picked mon.noname-f con 0x7f5e9c0a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 10 monclient(hunting): picked mon.noname-d con 0x7f5e9c13f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e9c13d1b0 con 0x7f5e9c0a6ab0 2024-09-13T10:39:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e9c137820 con 0x7f5e9c0a66d0 2024-09-13T10:39:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e9c13f510 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5ea0bcd640 10 monclient(hunting): authenticate will time out at 1284.457564s 2024-09-13T10:39:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5e9ad9d640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f5e9c13f9a0 0x7f5e9c1d6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41840/0 (socket says 172.21.15.181:41840) 2024-09-13T10:39:04.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.952+0000 7f5e9ad9d640 1 -- 172.21.15.181:0/2458583215 learned_addr learned my addr 172.21.15.181:0/2458583215 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.954+0000 7f5e9ad9d640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.181:6792/0 conn(0x7f5e9c13f9a0 legacy=0x7f5e9c1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.954+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 17163078 0 0) 0x7f5e9c13f510 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.954+0000 7f5e92ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.954+0000 7f5e92ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.954+0000 7f5e92ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.954+0000 7f5e92ffd640 10 monclient(hunting): my global_id is 134574 2024-09-13T10:39:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.954+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e7c003520 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.968 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.954+0000 7f5e9a59c640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.195:6791/0 conn(0x7f5e9c0a66d0 legacy=0x7f5e9c0a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e93fff640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.195:6789/0 conn(0x7f5e9c0a6ab0 legacy=0x7f5e9c1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 15857325 0 0) 0x7f5e7c003520 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e9c13f510 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e94002080 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 10 monclient(hunting): dump: 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.969 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3111333781 0 0) 0x7f5e9c13f510 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.195:6791/0 conn(0x7f5e9c0a66d0 legacy=0x7f5e9c0a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.970 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.195:6789/0 conn(0x7f5e9c0a6ab0 legacy=0x7f5e9c1d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 1 monclient: found mon.d 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9c13ec70 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 10 monclient: _finish_auth 0 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5ea0bcd640 5 monclient: authenticate success, global_id 134574 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5ea0bcd640 10 monclient: _renew_subs 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5ea0bcd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9c1cb880 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5ea0bcd640 10 monclient: _renew_subs 2024-09-13T10:39:04.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5ea0bcd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f5e9c13dd10 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5e94003df0 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e940042e0 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e9959a640 4 set_mon_vals no callback set 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.955+0000 7f5e92ffd640 10 monclient: dump: 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.972 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.956+0000 7f5ea0bcd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.956+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5e800065c0 con 0x7f5e80002860 2024-09-13T10:39:04.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.956+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5e94004480 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.956+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(285..285 src has 1..285) ==== 3898+0+0 (unknown 2129848869 0 0) 0x7f5e9404e6b0 con 0x7f5e9c13f9a0 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.956+0000 7f5e93fff640 10 monclient: get_auth_request con 0x7f5e7c03fae0 auth_method 0 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e9a59c640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.195:6789/0 conn(0x7f5e80002860 legacy=0x7f5e80004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394905595 0 0) 0x7f5e800065c0 con 0x7f5e80002860 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e92ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e92ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e92ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e92ffd640 10 monclient(hunting): my global_id is 134578 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e9c13f510 con 0x7f5e80002860 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1238538248 0 0) 0x7f5e9c13f510 con 0x7f5e80002860 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e800065c0 con 0x7f5e80002860 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e8c001360 con 0x7f5e80002860 2024-09-13T10:39:04.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e92ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.958+0000 7f5e92ffd640 10 monclient: dump: 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.975 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.959+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1401117418 0 0) 0x7f5e800065c0 con 0x7f5e80002860 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.959+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e8000a160 con 0x7f5e80002860 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.959+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5e8c001580 con 0x7f5e80002860 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.959+0000 7f5e92ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.959+0000 7f5e92ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.959+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.195:6789/0 conn(0x7f5e80002860 legacy=0x7f5e80004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.959+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.195:6789/0 conn(0x7f5e80002860 legacy=0x7f5e80004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.965+0000 7f5ea0bcd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:04.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.965+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5e80009e40 con 0x7f5e80009100 2024-09-13T10:39:04.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e9a59c640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.195:6789/0 conn(0x7f5e80009100 legacy=0x7f5e80009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:04.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216546411 0 0) 0x7f5e80009e40 con 0x7f5e80009100 2024-09-13T10:39:04.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:04.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:04.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:04.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 10 monclient(hunting): my global_id is 134587 2024-09-13T10:39:04.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e800065c0 con 0x7f5e80009100 2024-09-13T10:39:04.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3440622808 0 0) 0x7f5e800065c0 con 0x7f5e80009100 2024-09-13T10:39:04.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e80009e40 con 0x7f5e80009100 2024-09-13T10:39:04.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5e8c005340 con 0x7f5e80009100 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 10 monclient: dump: 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:04.979 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:04.980 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3410332412 0 0) 0x7f5e80009e40 con 0x7f5e80009100 2024-09-13T10:39:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.968+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5e8000c3f0 con 0x7f5e80009100 2024-09-13T10:39:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 232018233) 0x7f5e8c005470 con 0x7f5e80009100 2024-09-13T10:39:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5e92ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5e92ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.195:6789/0 conn(0x7f5e80009100 legacy=0x7f5e80009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:04.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5e92ffd640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.195:6789/0 conn(0x7f5e80009100 legacy=0x7f5e80009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 76997, 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:04.981 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.982 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.983 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:04.984 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:04.985 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.986 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:04.987 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:04.988 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.989 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:04.990 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:04.991 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:04.993 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.994 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:04.995 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:04.996 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.997 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:04.998 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:04.999 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:04.999 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:04.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:04.999 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:04.999 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:05.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5e7c03fae0 legacy=0x7f5e7c041fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5ea0bcd640 10 monclient: shutdown 2024-09-13T10:39:05.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5ea0bcd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:05.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2458583215 >> v1:172.21.15.181:6792/0 conn(0x7f5e9c13f9a0 legacy=0x7f5e9c1d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5e9ad9d640 1 -- 172.21.15.181:0/2458583215 reap_dead start 2024-09-13T10:39:05.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5e9ad9d640 1 -- 172.21.15.181:0/2458583215 reap_dead start 2024-09-13T10:39:05.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2458583215 shutdown_connections 2024-09-13T10:39:05.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2458583215 >> 172.21.15.181:0/2458583215 conn(0x7f5e9c0abcd0 msgr2=0x7f5e9c145ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:05.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2458583215 shutdown_connections 2024-09-13T10:39:05.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:04.969+0000 7f5ea0bcd640 1 -- 172.21.15.181:0/2458583215 wait complete. 2024-09-13T10:39:05.001 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:05.001 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:39:05.001 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:39:05.042 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.038+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.042 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.038+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3819854181}) 2024-09-13T10:39:05.042 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.038+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3520675011}) 2024-09-13T10:39:05.042 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.038+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.042 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.038+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3819854181}) 2024-09-13T10:39:05.042 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.038+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1921647485}) 2024-09-13T10:39:05.042 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.042 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3819854181}) 2024-09-13T10:39:05.042 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=522229765}) 2024-09-13T10:39:05.042 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.042 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3819854181}) 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=745852475}) 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3819854181}) 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4171038234}) 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3819854181}) 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2875296190}) 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3819854181}) 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2920390299}) 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3819854181}) 2024-09-13T10:39:05.043 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.039+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3990736962}) 2024-09-13T10:39:05.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.099+0000 7f1d0bb90640 10 monclient: get_monmap_and_config 2024-09-13T10:39:05.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.099+0000 7f1d0bb90640 10 monclient: build_initial_monmap 2024-09-13T10:39:05.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.099+0000 7f1d0bb90640 10 monclient: monmap: 2024-09-13T10:39:05.100 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:05.100 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:05.099653+0000 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:05.099653+0000 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:05.101 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:05.102 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.099+0000 7f1d0bb90640 1 Processor -- start 2024-09-13T10:39:05.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.099+0000 7f1d0bb90640 1 -- start start 2024-09-13T10:39:05.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.099+0000 7f1d0bb90640 10 monclient: init 2024-09-13T10:39:05.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.100+0000 7f1d0bb90640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:05.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.100+0000 7f1d0bb90640 10 monclient: _add_conns ranks=[5,7,2,4,1,8,3,6,0] 2024-09-13T10:39:05.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.100+0000 7f1d0bb90640 10 monclient(hunting): picked mon.noname-h con 0x7f1d040a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:05.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.100+0000 7f1d0bb90640 10 monclient(hunting): picked mon.noname-i con 0x7f1d040a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:05.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.100+0000 7f1d0bb90640 10 monclient(hunting): picked mon.noname-b con 0x7f1d0413f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:05.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.100+0000 7f1d0bb90640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d040a5fe0 con 0x7f1d0413f9a0 2024-09-13T10:39:05.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.100+0000 7f1d0bb90640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d040a8080 con 0x7f1d040a66d0 2024-09-13T10:39:05.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.100+0000 7f1d0bb90640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d040a42c0 con 0x7f1d040a6ab0 2024-09-13T10:39:05.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.100+0000 7f1d0bb90640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:05.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.100+0000 7f1d0bb90640 10 monclient(hunting): authenticate will time out at 1284.605427s 2024-09-13T10:39:05.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.100+0000 7f1d0a12d640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f1d0413f9a0 0x7f1d04141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55708/0 (socket says 172.21.15.181:55708) 2024-09-13T10:39:05.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.100+0000 7f1d0a12d640 1 -- 172.21.15.181:0/2918285158 learned_addr learned my addr 172.21.15.181:0/2918285158 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:05.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.102+0000 7f1d0a12d640 1 -- 172.21.15.181:0/2918285158 >> v1:172.21.15.181:6790/0 conn(0x7f1d0413f9a0 legacy=0x7f1d04141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.102+0000 7f1d0992c640 1 -- 172.21.15.181:0/2918285158 >> v1:172.21.15.195:6791/0 conn(0x7f1d040a66d0 legacy=0x7f1d040a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.102+0000 7f1d0912b640 1 -- 172.21.15.181:0/2918285158 >> v1:172.21.15.195:6792/0 conn(0x7f1d040a6ab0 legacy=0x7f1d040a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036470490 0 0) 0x7f1d040a5fe0 con 0x7f1d0413f9a0 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient(hunting): my global_id is 134624 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cf0003520 con 0x7f1d0413f9a0 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1885391216 0 0) 0x7f1d040a8080 con 0x7f1d040a66d0 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient(hunting): my global_id is 105539 2024-09-13T10:39:05.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d040a5fe0 con 0x7f1d040a66d0 2024-09-13T10:39:05.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 924989981 0 0) 0x7f1d040a42c0 con 0x7f1d040a6ab0 2024-09-13T10:39:05.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient(hunting): my global_id is 57571 2024-09-13T10:39:05.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d040a8080 con 0x7f1d040a6ab0 2024-09-13T10:39:05.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 573656957 0 0) 0x7f1cf0003520 con 0x7f1d0413f9a0 2024-09-13T10:39:05.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 >> v1:172.21.15.195:6792/0 conn(0x7f1d040a6ab0 legacy=0x7f1d040a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 >> v1:172.21.15.195:6791/0 conn(0x7f1d040a66d0 legacy=0x7f1d040a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient: _finish_hunting 0 2024-09-13T10:39:05.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 monclient: found mon.noname-b 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d041464e0 con 0x7f1d0413f9a0 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient: _finish_auth 0 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient: _check_auth_tickets 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0bb90640 5 monclient: authenticate success, global_id 134624 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0bb90640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1cfc001ad0 con 0x7f1d0413f9a0 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient: dump: 2024-09-13T10:39:05.110 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.111 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.112 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.112 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0bb90640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:05.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1cfc0048a0 con 0x7f1d0413f9a0 2024-09-13T10:39:05.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:05.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 1 -- 172.21.15.181:0/2918285158 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1cfc004dd0 con 0x7f1d0413f9a0 2024-09-13T10:39:05.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0bb90640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:05.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0bb90640 4 set_mon_vals no callback set 2024-09-13T10:39:05.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:05.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0892a640 10 monclient: dump: 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.113 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0bb90640 10 monclient: shutdown 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0bb90640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.103+0000 7f1d0bb90640 1 -- 172.21.15.181:0/2918285158 >> v1:172.21.15.181:6790/0 conn(0x7f1d0413f9a0 legacy=0x7f1d04141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.104+0000 7f1d0bb90640 1 -- 172.21.15.181:0/2918285158 shutdown_connections 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.104+0000 7f1d0bb90640 1 -- 172.21.15.181:0/2918285158 >> 172.21.15.181:0/2918285158 conn(0x7f1d040abcd0 msgr2=0x7f1d040ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.104+0000 7f1d0bb90640 1 -- 172.21.15.181:0/2918285158 shutdown_connections 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.104+0000 7f1d0bb90640 1 -- 172.21.15.181:0/2918285158 wait complete. 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.104+0000 7f1d0bb90640 10 monclient: build_initial_monmap 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.104+0000 7f1d0bb90640 10 monclient: monmap: 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:05.114 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.104+0000 7f1d0bb90640 1 Processor -- start 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0bb90640 1 -- start start 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0bb90640 10 monclient: init 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0bb90640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0bb90640 10 monclient: _add_conns ranks=[1,5,6,2,7,0,8,4,3] 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0bb90640 10 monclient(hunting): picked mon.noname-f con 0x7f1d040a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0bb90640 10 monclient(hunting): picked mon.noname-h con 0x7f1d040a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0bb90640 10 monclient(hunting): picked mon.noname-d con 0x7f1d0413f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0bb90640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d0413f170 con 0x7f1d040a66d0 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0bb90640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d0413f450 con 0x7f1d040a6ab0 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0bb90640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d04142db0 con 0x7f1d0413f9a0 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0bb90640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0bb90640 10 monclient(hunting): authenticate will time out at 1284.610506s 2024-09-13T10:39:05.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0a12d640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f1d0413f9a0 0x7f1d041d6f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41848/0 (socket says 172.21.15.181:41848) 2024-09-13T10:39:05.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.105+0000 7f1d0a12d640 1 -- 172.21.15.181:0/1575165550 learned_addr learned my addr 172.21.15.181:0/1575165550 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:05.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1d0a12d640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.181:6792/0 conn(0x7f1d0413f9a0 legacy=0x7f1d041d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1d0992c640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6789/0 conn(0x7f1d040a66d0 legacy=0x7f1d04136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1d0912b640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6791/0 conn(0x7f1d040a6ab0 legacy=0x7f1d041d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876331316 0 0) 0x7f1d04142db0 con 0x7f1d0413f9a0 2024-09-13T10:39:05.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 10 monclient(hunting): my global_id is 134583 2024-09-13T10:39:05.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ce8003520 con 0x7f1d0413f9a0 2024-09-13T10:39:05.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3196985241 0 0) 0x7f1d0413f170 con 0x7f1d040a66d0 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 10 monclient(hunting): my global_id is 134596 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d04142db0 con 0x7f1d040a66d0 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610464238 0 0) 0x7f1d0413f450 con 0x7f1d040a6ab0 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 10 monclient(hunting): my global_id is 105548 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.107+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d0413f170 con 0x7f1d040a6ab0 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 859869225 0 0) 0x7f1ce8003520 con 0x7f1d0413f9a0 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d0413f450 con 0x7f1d0413f9a0 2024-09-13T10:39:05.125 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1cfc001d20 con 0x7f1d0413f9a0 2024-09-13T10:39:05.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:05.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:05.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient(hunting): dump: 2024-09-13T10:39:05.126 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.126 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.126 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.126 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.126 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.126 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.127 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.127 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.127 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.127 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.127 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.127 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.127 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.127 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.128 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.128 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:05.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3158351161 0 0) 0x7f1d04142db0 con 0x7f1d040a66d0 2024-09-13T10:39:05.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ce8003520 con 0x7f1d040a66d0 2024-09-13T10:39:05.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1d00003990 con 0x7f1d040a66d0 2024-09-13T10:39:05.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:05.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:05.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient(hunting): dump: 2024-09-13T10:39:05.129 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.129 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.129 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.129 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.129 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.130 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.130 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.130 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.130 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.130 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.130 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.130 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.130 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.130 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.131 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.131 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 291282615 0 0) 0x7f1d0413f170 con 0x7f1d040a6ab0 2024-09-13T10:39:05.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d04142db0 con 0x7f1d040a6ab0 2024-09-13T10:39:05.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1cf4001d30 con 0x7f1d040a6ab0 2024-09-13T10:39:05.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:05.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:05.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient(hunting): dump: 2024-09-13T10:39:05.131 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.131 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.131 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 818053712 0 0) 0x7f1d0413f450 con 0x7f1d0413f9a0 2024-09-13T10:39:05.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6791/0 conn(0x7f1d040a6ab0 legacy=0x7f1d041d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6789/0 conn(0x7f1d040a66d0 legacy=0x7f1d04136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:05.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 monclient: found mon.d 2024-09-13T10:39:05.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:05.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:05.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d04139070 con 0x7f1d0413f9a0 2024-09-13T10:39:05.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:05.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:05.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:05.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1d0bb90640 5 monclient: authenticate success, global_id 134583 2024-09-13T10:39:05.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1d0bb90640 10 monclient: _renew_subs 2024-09-13T10:39:05.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1d0bb90640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:05.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1d0bb90640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1d04068af0 con 0x7f1d0413f9a0 2024-09-13T10:39:05.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1d0bb90640 10 monclient: _renew_subs 2024-09-13T10:39:05.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1d0bb90640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:05.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1d0bb90640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f1d040a2580 con 0x7f1d0413f9a0 2024-09-13T10:39:05.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1cfc0048a0 con 0x7f1d0413f9a0 2024-09-13T10:39:05.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:05.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1cfc005380 con 0x7f1d0413f9a0 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfbfff640 4 set_mon_vals no callback set 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.108+0000 7f1cfa7fc640 10 monclient: dump: 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.135 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.109+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1cfc011a00 con 0x7f1d0413f9a0 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.109+0000 7f1d0bb90640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.109+0000 7f1d0bb90640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1cec0065c0 con 0x7f1cec002860 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.109+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(285..285 src has 1..285) ==== 3898+0+0 (unknown 2129848869 0 0) 0x7f1cfc04e260 con 0x7f1d0413f9a0 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.109+0000 7f1d0912b640 10 monclient: get_auth_request con 0x7f1ce8040700 auth_method 0 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1d0992c640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1cec002860 legacy=0x7f1cec004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3483933926 0 0) 0x7f1cec0065c0 con 0x7f1cec002860 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1cfa7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1cfa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1cfa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1cfa7fc640 10 monclient(hunting): my global_id is 164181 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d0413f450 con 0x7f1cec002860 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2764860503 0 0) 0x7f1d0413f450 con 0x7f1cec002860 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1cec0065c0 con 0x7f1cec002860 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1d000041d0 con 0x7f1cec002860 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1cfa7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.111+0000 7f1cfa7fc640 10 monclient: dump: 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.137 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.138 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.138 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.138 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.138 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.138 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.138 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.138 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.138 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.138 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.138 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.138 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.138 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.139 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.139 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.112+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 839980091 0 0) 0x7f1cec0065c0 con 0x7f1cec002860 2024-09-13T10:39:05.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.112+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1cec00a160 con 0x7f1cec002860 2024-09-13T10:39:05.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.112+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1d00005b40 con 0x7f1cec002860 2024-09-13T10:39:05.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.112+0000 7f1cfa7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:05.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.112+0000 7f1cfa7fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:05.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.112+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1cec002860 legacy=0x7f1cec004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.112+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1cec002860 legacy=0x7f1cec004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:05.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.118+0000 7f1d0bb90640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:05.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.118+0000 7f1d0bb90640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1cec009e70 con 0x7f1cec009130 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.120+0000 7f1d0992c640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1cec009130 legacy=0x7f1cec0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190855009 0 0) 0x7f1cec009e70 con 0x7f1cec009130 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 10 monclient(hunting): my global_id is 164190 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cec0065c0 con 0x7f1cec009130 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2563396396 0 0) 0x7f1cec0065c0 con 0x7f1cec009130 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1cec009e70 con 0x7f1cec009130 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1d000047c0 con 0x7f1cec009130 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:05.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 10 monclient: dump: 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.141 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.142 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3659331549 0 0) 0x7f1cec009e70 con 0x7f1cec009130 2024-09-13T10:39:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1cec00c3f0 con 0x7f1cec009130 2024-09-13T10:39:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1d0992c640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1cec009130 legacy=0x7f1cec0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T10:39:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1d0992c640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1cec009130 legacy=0x7f1cec0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:39:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1d0992c640 1 --1- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1cec009130 0x7f1cec0095c0 :-1 s=OPENED pgs=761 cs=1 l=1).handle_message read tag failed 2024-09-13T10:39:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1d0992c640 1 --1- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1cec009130 0x7f1cec0095c0 :-1 s=OPENED pgs=761 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:39:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1cec009130 legacy=0x7f1cec0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1cec009130 legacy=0x7f1cec0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:05.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.121+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1cec009e70 con 0x7f1ce8049de0 2024-09-13T10:39:05.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.123+0000 7f1d0992c640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1ce8049de0 legacy=0x7f1ce804a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.123+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 732371205 0 0) 0x7f1cec009e70 con 0x7f1ce8049de0 2024-09-13T10:39:05.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.123+0000 7f1cfa7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.123+0000 7f1cfa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.123+0000 7f1cfa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.123+0000 7f1cfa7fc640 10 monclient(hunting): my global_id is 164199 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.123+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cec0065c0 con 0x7f1ce8049de0 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 628579784 0 0) 0x7f1cec0065c0 con 0x7f1ce8049de0 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1cec009e70 con 0x7f1ce8049de0 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1d00006790 con 0x7f1ce8049de0 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 10 monclient: dump: 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.145 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.146 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1889001963 0 0) 0x7f1cec009e70 con 0x7f1ce8049de0 2024-09-13T10:39:05.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1d00005b40 con 0x7f1ce8049de0 2024-09-13T10:39:05.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 622645891) 0x7f1d00008a10 con 0x7f1ce8049de0 2024-09-13T10:39:05.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:05.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:05.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1ce8049de0 legacy=0x7f1ce804a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1cfa7fc640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6790/0 conn(0x7f1ce8049de0 legacy=0x7f1ce804a1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:05.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1d0a12d640 1 -- 172.21.15.181:0/1575165550 reap_dead start 2024-09-13T10:39:05.147 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 24583, 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:05.169 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:05.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1d0bb90640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1ce8040700 legacy=0x7f1ce8042bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1d0bb90640 10 monclient: shutdown 2024-09-13T10:39:05.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1d0bb90640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:05.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1d0bb90640 1 -- 172.21.15.181:0/1575165550 >> v1:172.21.15.181:6792/0 conn(0x7f1d0413f9a0 legacy=0x7f1d041d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1d0bb90640 1 -- 172.21.15.181:0/1575165550 shutdown_connections 2024-09-13T10:39:05.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1d0bb90640 1 -- 172.21.15.181:0/1575165550 >> 172.21.15.181:0/1575165550 conn(0x7f1d040abcd0 msgr2=0x7f1d040a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:05.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1d0bb90640 1 -- 172.21.15.181:0/1575165550 shutdown_connections 2024-09-13T10:39:05.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.124+0000 7f1d0bb90640 1 -- 172.21.15.181:0/1575165550 wait complete. 2024-09-13T10:39:05.171 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:05.172 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:39:05.172 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:39:05.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.268+0000 7f307e9f5640 10 monclient: get_monmap_and_config 2024-09-13T10:39:05.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.268+0000 7f307e9f5640 10 monclient: build_initial_monmap 2024-09-13T10:39:05.270 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.268+0000 7f307e9f5640 10 monclient: monmap: 2024-09-13T10:39:05.270 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:05.270 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.270 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:05.269531+0000 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:05.269531+0000 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:05.271 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.269+0000 7f307e9f5640 1 Processor -- start 2024-09-13T10:39:05.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.269+0000 7f307e9f5640 1 -- start start 2024-09-13T10:39:05.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.269+0000 7f307e9f5640 10 monclient: init 2024-09-13T10:39:05.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.270+0000 7f307e9f5640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:05.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.270+0000 7f307e9f5640 10 monclient: _add_conns ranks=[7,6,8,3,2,1,0,4,5] 2024-09-13T10:39:05.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.270+0000 7f307e9f5640 10 monclient(hunting): picked mon.noname-i con 0x7f30780a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:05.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.270+0000 7f307e9f5640 10 monclient(hunting): picked mon.noname-d con 0x7f30780a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:05.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.270+0000 7f307e9f5640 10 monclient(hunting): picked mon.noname-e con 0x7f307813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:05.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.270+0000 7f307e9f5640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30780a4bc0 con 0x7f30780a8340 2024-09-13T10:39:05.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.270+0000 7f307e9f5640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307813a320 con 0x7f30780a6640 2024-09-13T10:39:05.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.270+0000 7f307e9f5640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30780a8100 con 0x7f307813f750 2024-09-13T10:39:05.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.270+0000 7f307e9f5640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:05.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.270+0000 7f307e9f5640 10 monclient(hunting): authenticate will time out at 1284.775286s 2024-09-13T10:39:05.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.270+0000 7f30777fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f30780a8340 0x7f3078139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41854/0 (socket says 172.21.15.181:41854) 2024-09-13T10:39:05.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.270+0000 7f30777fe640 1 -- 172.21.15.181:0/1196252582 learned_addr learned my addr 172.21.15.181:0/1196252582 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:05.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f307cf92640 1 -- 172.21.15.181:0/1196252582 >> v1:172.21.15.181:6793/0 conn(0x7f307813f750 legacy=0x7f3078141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f30777fe640 1 -- 172.21.15.181:0/1196252582 >> v1:172.21.15.181:6792/0 conn(0x7f30780a8340 legacy=0x7f3078139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3077fff640 1 -- 172.21.15.181:0/1196252582 >> v1:172.21.15.195:6792/0 conn(0x7f30780a6640 legacy=0x7f3078139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4221750323 0 0) 0x7f30780a8100 con 0x7f307813f750 2024-09-13T10:39:05.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient(hunting): my global_id is 105668 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3060003520 con 0x7f307813f750 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923789522 0 0) 0x7f30780a4bc0 con 0x7f30780a8340 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient(hunting): my global_id is 134592 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30780a8100 con 0x7f30780a8340 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 167305477 0 0) 0x7f307813a320 con 0x7f30780a6640 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient(hunting): my global_id is 57580 2024-09-13T10:39:05.284 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30780a4bc0 con 0x7f30780a6640 2024-09-13T10:39:05.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2586642554 0 0) 0x7f3060003520 con 0x7f307813f750 2024-09-13T10:39:05.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 >> v1:172.21.15.195:6792/0 conn(0x7f30780a6640 legacy=0x7f3078139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 >> v1:172.21.15.181:6792/0 conn(0x7f30780a8340 legacy=0x7f3078139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:05.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 1 monclient: found mon.noname-e 2024-09-13T10:39:05.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:05.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:05.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30780a48e0 con 0x7f307813f750 2024-09-13T10:39:05.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient: _finish_auth 0 2024-09-13T10:39:05.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:05.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:05.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3070001eb0 con 0x7f307813f750 2024-09-13T10:39:05.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f307e9f5640 5 monclient: authenticate success, global_id 105668 2024-09-13T10:39:05.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.272+0000 7f3076ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f3076ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:05.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f3076ffd640 10 monclient: dump: 2024-09-13T10:39:05.286 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.286 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.286 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.286 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.286 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.286 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.286 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.286 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.287 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.287 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.287 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.287 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.287 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.287 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.287 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.287 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f307e9f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:05.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3070003990 con 0x7f307813f750 2024-09-13T10:39:05.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f3076ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:05.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f3076ffd640 1 -- 172.21.15.181:0/1196252582 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3070003f00 con 0x7f307813f750 2024-09-13T10:39:05.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f307e9f5640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:05.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f307e9f5640 4 set_mon_vals no callback set 2024-09-13T10:39:05.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f3076ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f3076ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:05.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f3076ffd640 10 monclient: dump: 2024-09-13T10:39:05.288 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.288 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.288 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.289 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.289 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.289 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.289 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.289 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.289 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.289 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.289 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.289 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.290 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.290 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.290 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.290 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f307e9f5640 10 monclient: shutdown 2024-09-13T10:39:05.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f307e9f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:05.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f307e9f5640 1 -- 172.21.15.181:0/1196252582 >> v1:172.21.15.181:6793/0 conn(0x7f307813f750 legacy=0x7f3078141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f307e9f5640 1 -- 172.21.15.181:0/1196252582 shutdown_connections 2024-09-13T10:39:05.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f307e9f5640 1 -- 172.21.15.181:0/1196252582 >> 172.21.15.181:0/1196252582 conn(0x7f3078077170 msgr2=0x7f30780abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:05.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f307e9f5640 1 -- 172.21.15.181:0/1196252582 shutdown_connections 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.273+0000 7f307e9f5640 1 -- 172.21.15.181:0/1196252582 wait complete. 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.274+0000 7f307e9f5640 10 monclient: build_initial_monmap 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.274+0000 7f307e9f5640 10 monclient: monmap: 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:05.291 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.274+0000 7f307e9f5640 1 Processor -- start 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.274+0000 7f307e9f5640 1 -- start start 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.274+0000 7f307e9f5640 10 monclient: init 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.275+0000 7f307e9f5640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.275+0000 7f307e9f5640 10 monclient: _add_conns ranks=[0,6,3,7,8,5,1,4,2] 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.275+0000 7f307e9f5640 10 monclient(hunting): picked mon.noname-a con 0x7f30780a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:05.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.275+0000 7f307e9f5640 10 monclient(hunting): picked mon.noname-d con 0x7f307813f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.275+0000 7f307e9f5640 10 monclient(hunting): picked mon.noname-g con 0x7f307809f780 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.275+0000 7f307e9f5640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30780a2880 con 0x7f30780a8340 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.275+0000 7f307e9f5640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30780a09c0 con 0x7f307809f780 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.275+0000 7f307e9f5640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30780a0ca0 con 0x7f307813f750 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.275+0000 7f307e9f5640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.275+0000 7f307e9f5640 10 monclient(hunting): authenticate will time out at 1284.780204s 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.275+0000 7f30777fe640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f307813f750 0x7f307809d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:41856/0 (socket says 172.21.15.181:41856) 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.275+0000 7f30777fe640 1 -- 172.21.15.181:0/4017348760 learned_addr learned my addr 172.21.15.181:0/4017348760 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f30777fe640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.181:6792/0 conn(0x7f307813f750 legacy=0x7f307809d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3077fff640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.181:6789/0 conn(0x7f30780a8340 legacy=0x7f307809d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f307cf92640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.195:6790/0 conn(0x7f307809f780 legacy=0x7f30781d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806766360 0 0) 0x7f30780a0ca0 con 0x7f307813f750 2024-09-13T10:39:05.293 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): my global_id is 134601 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3064003550 con 0x7f307813f750 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3813966636 0 0) 0x7f3068001350 con 0x7f30780a8340 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): my global_id is 115353 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30780a0ca0 con 0x7f30780a8340 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1626581984 0 0) 0x7f30780a09c0 con 0x7f307809f780 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): my global_id is 164208 2024-09-13T10:39:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3068001350 con 0x7f307809f780 2024-09-13T10:39:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 887314372 0 0) 0x7f3064003550 con 0x7f307813f750 2024-09-13T10:39:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f30780a09c0 con 0x7f307813f750 2024-09-13T10:39:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1765732091 0 0) 0x7f30780a0ca0 con 0x7f30780a8340 2024-09-13T10:39:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3064003550 con 0x7f30780a8340 2024-09-13T10:39:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f306c001d20 con 0x7f307813f750 2024-09-13T10:39:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:05.295 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.296 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3068003610 con 0x7f30780a8340 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.297 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4204067434 0 0) 0x7f3068001350 con 0x7f307809f780 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f30780a0ca0 con 0x7f307809f780 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3070003e80 con 0x7f307809f780 2024-09-13T10:39:05.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.299 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.300 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.300 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.300 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.300 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.300 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.300 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.301 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.277+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3942114153 0 0) 0x7f30780a09c0 con 0x7f307813f750 2024-09-13T10:39:05.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.195:6790/0 conn(0x7f307809f780 legacy=0x7f30781d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.181:6789/0 conn(0x7f30780a8340 legacy=0x7f307809d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:39:05.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 1 monclient: found mon.d 2024-09-13T10:39:05.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:05.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:05.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30780a0110 con 0x7f307813f750 2024-09-13T10:39:05.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 10 monclient: _finish_auth 0 2024-09-13T10:39:05.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:39:05.301 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:05.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f307e9f5640 5 monclient: authenticate success, global_id 134601 2024-09-13T10:39:05.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f307e9f5640 10 monclient: _renew_subs 2024-09-13T10:39:05.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f307e9f5640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:05.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f307e9f5640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f307809ec20 con 0x7f307813f750 2024-09-13T10:39:05.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f307e9f5640 10 monclient: _renew_subs 2024-09-13T10:39:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f307e9f5640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f307e9f5640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f30780a0f80 con 0x7f307813f750 2024-09-13T10:39:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f306c001890 con 0x7f307813f750 2024-09-13T10:39:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f306c005110 con 0x7f307813f750 2024-09-13T10:39:05.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f30767fc640 4 set_mon_vals no callback set 2024-09-13T10:39:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f3074ff9640 10 monclient: dump: 2024-09-13T10:39:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.304 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f307e9f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.278+0000 7f307e9f5640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f30580065c0 con 0x7f3058002860 2024-09-13T10:39:05.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.279+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f306c011790 con 0x7f307813f750 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.279+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(285..285 src has 1..285) ==== 3898+0+0 (unknown 2129848869 0 0) 0x7f306c04e330 con 0x7f307813f750 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.279+0000 7f307cf92640 10 monclient: get_auth_request con 0x7f3064040430 auth_method 0 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3077fff640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.195:6791/0 conn(0x7f3058002860 legacy=0x7f3058004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2560682699 0 0) 0x7f30580065c0 con 0x7f3058002860 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 10 monclient(hunting): my global_id is 105557 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30780a09c0 con 0x7f3058002860 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 946993378 0 0) 0x7f30780a09c0 con 0x7f3058002860 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f30580065c0 con 0x7f3058002860 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f30680042d0 con 0x7f3058002860 2024-09-13T10:39:05.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 10 monclient: dump: 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.307 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.308 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2467044648 0 0) 0x7f30580065c0 con 0x7f3058002860 2024-09-13T10:39:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.281+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f305800a160 con 0x7f3058002860 2024-09-13T10:39:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.282+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f30680057c0 con 0x7f3058002860 2024-09-13T10:39:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.282+0000 7f3074ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.282+0000 7f3074ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.282+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.195:6791/0 conn(0x7f3058002860 legacy=0x7f3058004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.282+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.195:6791/0 conn(0x7f3058002860 legacy=0x7f3058004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.288+0000 7f307e9f5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.288+0000 7f307e9f5640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3058009e70 con 0x7f3058009130 2024-09-13T10:39:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3077fff640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.195:6791/0 conn(0x7f3058009130 legacy=0x7f30580095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3245716228 0 0) 0x7f3058009e70 con 0x7f3058009130 2024-09-13T10:39:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 10 monclient(hunting): my global_id is 105566 2024-09-13T10:39:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30580065c0 con 0x7f3058009130 2024-09-13T10:39:05.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3074285104 0 0) 0x7f30580065c0 con 0x7f3058009130 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3058009e70 con 0x7f3058009130 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3068005f20 con 0x7f3058009130 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 10 monclient: dump: 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.311 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2018777018 0 0) 0x7f3058009e70 con 0x7f3058009130 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.290+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f305800c410 con 0x7f3058009130 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 1696399853) 0x7f30680073f0 con 0x7f3058009130 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f3074ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f3074ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:05.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.195:6791/0 conn(0x7f3058009130 legacy=0x7f30580095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f3074ff9640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.195:6791/0 conn(0x7f3058009130 legacy=0x7f30580095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:05.313 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:05.313 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:05.313 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:05.313 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:05.313 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:05.313 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 228990, 2024-09-13T10:39:05.313 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:05.313 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:05.314 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:05.315 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:05.315 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:05.315 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:05.315 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:05.315 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:05.315 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:05.315 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:05.315 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:05.315 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:05.315 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:05.315 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:05.316 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:05.317 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:05.318 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.319 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.320 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.320 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:05.320 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.320 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.320 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.320 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:05.320 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:05.320 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.320 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.320 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.321 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:05.321 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:05.321 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.321 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.321 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.321 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:05.321 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.321 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.322 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:05.324 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.325 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.325 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.325 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:05.325 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:05.325 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.325 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.325 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.325 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:05.325 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.326 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:05.328 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:05.329 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.330 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.331 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.331 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:05.331 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.331 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.331 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.331 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:05.331 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:05.331 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.332 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:05.333 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.334 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.334 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:05.334 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:05.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f307e9f5640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3064040430 legacy=0x7f30640428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f307e9f5640 10 monclient: shutdown 2024-09-13T10:39:05.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f307e9f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:05.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f307e9f5640 1 -- 172.21.15.181:0/4017348760 >> v1:172.21.15.181:6792/0 conn(0x7f307813f750 legacy=0x7f307809d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f307cf92640 1 -- 172.21.15.181:0/4017348760 reap_dead start 2024-09-13T10:39:05.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f307cf92640 1 -- 172.21.15.181:0/4017348760 reap_dead start 2024-09-13T10:39:05.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f307e9f5640 1 -- 172.21.15.181:0/4017348760 shutdown_connections 2024-09-13T10:39:05.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f307e9f5640 1 -- 172.21.15.181:0/4017348760 >> 172.21.15.181:0/4017348760 conn(0x7f30780a6640 msgr2=0x7f30780ab2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:05.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f307e9f5640 1 -- 172.21.15.181:0/4017348760 shutdown_connections 2024-09-13T10:39:05.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.291+0000 7f307e9f5640 1 -- 172.21.15.181:0/4017348760 wait complete. 2024-09-13T10:39:05.336 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:05.337 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:39:05.337 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:39:05.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.434+0000 7f0e4a1aa640 10 monclient: get_monmap_and_config 2024-09-13T10:39:05.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.434+0000 7f0e4a1aa640 10 monclient: build_initial_monmap 2024-09-13T10:39:05.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.434+0000 7f0e4a1aa640 10 monclient: monmap: 2024-09-13T10:39:05.436 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:05.436 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.436 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:05.435300+0000 2024-09-13T10:39:05.436 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:05.435300+0000 2024-09-13T10:39:05.436 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:05.436 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.437 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:05.437 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:05.437 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:05.437 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:05.437 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:05.437 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:05.437 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:05.437 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:05.437 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:05.437 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.435+0000 7f0e4a1aa640 1 Processor -- start 2024-09-13T10:39:05.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.435+0000 7f0e4a1aa640 1 -- start start 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.435+0000 7f0e4a1aa640 10 monclient: init 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.435+0000 7f0e4a1aa640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.435+0000 7f0e4a1aa640 10 monclient: _add_conns ranks=[5,4,2,6,3,8,1,0,7] 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.435+0000 7f0e4a1aa640 10 monclient(hunting): picked mon.noname-h con 0x7f0e440a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.435+0000 7f0e4a1aa640 10 monclient(hunting): picked mon.noname-c con 0x7f0e440a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.436+0000 7f0e4a1aa640 10 monclient(hunting): picked mon.noname-b con 0x7f0e4413f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.436+0000 7f0e4a1aa640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e440a4bc0 con 0x7f0e4413f750 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.436+0000 7f0e4a1aa640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e4413a320 con 0x7f0e440a8340 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.436+0000 7f0e4a1aa640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e440a8100 con 0x7f0e440a6640 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.436+0000 7f0e4a1aa640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.436+0000 7f0e4a1aa640 10 monclient(hunting): authenticate will time out at 1284.941042s 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.436+0000 7f0e43fff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f0e4413f750 0x7f0e44141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:55712/0 (socket says 172.21.15.181:55712) 2024-09-13T10:39:05.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.436+0000 7f0e43fff640 1 -- 172.21.15.181:0/578835017 learned_addr learned my addr 172.21.15.181:0/578835017 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:05.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.436+0000 7f0e42ffd640 1 --1- 172.21.15.181:0/578835017 >> v1:172.21.15.181:6791/0 conn(0x7f0e440a8340 0x7f0e44139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:37668/0 (socket says 172.21.15.181:37668) 2024-09-13T10:39:05.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e43fff640 1 -- 172.21.15.181:0/578835017 >> v1:172.21.15.181:6790/0 conn(0x7f0e4413f750 legacy=0x7f0e44141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e42ffd640 1 -- 172.21.15.181:0/578835017 >> v1:172.21.15.181:6791/0 conn(0x7f0e440a8340 legacy=0x7f0e44139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e437fe640 1 -- 172.21.15.181:0/578835017 >> v1:172.21.15.195:6791/0 conn(0x7f0e440a6640 legacy=0x7f0e44139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 800610457 0 0) 0x7f0e440a4bc0 con 0x7f0e4413f750 2024-09-13T10:39:05.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient(hunting): my global_id is 134633 2024-09-13T10:39:05.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e2c003520 con 0x7f0e4413f750 2024-09-13T10:39:05.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299914882 0 0) 0x7f0e4413a320 con 0x7f0e440a8340 2024-09-13T10:39:05.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient(hunting): my global_id is 115393 2024-09-13T10:39:05.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e440a4bc0 con 0x7f0e440a8340 2024-09-13T10:39:05.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4141163067 0 0) 0x7f0e440a8100 con 0x7f0e440a6640 2024-09-13T10:39:05.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient(hunting): my global_id is 105575 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e4413a320 con 0x7f0e440a6640 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2862345818 0 0) 0x7f0e440a4bc0 con 0x7f0e440a8340 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 >> v1:172.21.15.195:6791/0 conn(0x7f0e440a6640 legacy=0x7f0e44139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 >> v1:172.21.15.181:6790/0 conn(0x7f0e4413f750 legacy=0x7f0e44141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 1 monclient: found mon.noname-c 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e440a48e0 con 0x7f0e440a8340 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.438+0000 7f0e427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:05.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0e38001ac0 con 0x7f0e440a8340 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e427fc640 10 monclient: dump: 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.451 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e4a1aa640 5 monclient: authenticate success, global_id 115393 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e4a1aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e380047e0 con 0x7f0e440a8340 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e427fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e427fc640 1 -- 172.21.15.181:0/578835017 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0e38004d50 con 0x7f0e440a8340 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e4a1aa640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e4a1aa640 4 set_mon_vals no callback set 2024-09-13T10:39:05.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e427fc640 10 monclient: dump: 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.453 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e4a1aa640 10 monclient: shutdown 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e4a1aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/578835017 >> v1:172.21.15.181:6791/0 conn(0x7f0e440a8340 legacy=0x7f0e44139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/578835017 shutdown_connections 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/578835017 >> 172.21.15.181:0/578835017 conn(0x7f0e44077170 msgr2=0x7f0e440abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/578835017 shutdown_connections 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.439+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/578835017 wait complete. 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.440+0000 7f0e4a1aa640 10 monclient: build_initial_monmap 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.440+0000 7f0e4a1aa640 10 monclient: monmap: 2024-09-13T10:39:05.454 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:05.455 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:05.456 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:05.456 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.440+0000 7f0e4a1aa640 1 Processor -- start 2024-09-13T10:39:05.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.440+0000 7f0e4a1aa640 1 -- start start 2024-09-13T10:39:05.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.440+0000 7f0e4a1aa640 10 monclient: init 2024-09-13T10:39:05.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.441+0000 7f0e4a1aa640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:05.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.441+0000 7f0e4a1aa640 10 monclient: _add_conns ranks=[7,1,4,6,8,2,3,0,5] 2024-09-13T10:39:05.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.441+0000 7f0e4a1aa640 10 monclient(hunting): picked mon.noname-i con 0x7f0e440a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:05.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.441+0000 7f0e4a1aa640 10 monclient(hunting): picked mon.noname-f con 0x7f0e4413f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:05.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.441+0000 7f0e4a1aa640 10 monclient(hunting): picked mon.noname-c con 0x7f0e44142140 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:05.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.441+0000 7f0e4a1aa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e4413c370 con 0x7f0e4413f750 2024-09-13T10:39:05.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.441+0000 7f0e4a1aa640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e4413c650 con 0x7f0e44142140 2024-09-13T10:39:05.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.441+0000 7f0e4a1aa640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e440a9f20 con 0x7f0e440a8340 2024-09-13T10:39:05.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.441+0000 7f0e4a1aa640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:05.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.441+0000 7f0e4a1aa640 10 monclient(hunting): authenticate will time out at 1284.946260s 2024-09-13T10:39:05.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.441+0000 7f0e43fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f0e44142140 0x7f0e441d6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:37674/0 (socket says 172.21.15.181:37674) 2024-09-13T10:39:05.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.441+0000 7f0e43fff640 1 -- 172.21.15.181:0/3784826585 learned_addr learned my addr 172.21.15.181:0/3784826585 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:05.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e43fff640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.181:6791/0 conn(0x7f0e44142140 legacy=0x7f0e441d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e437fe640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.195:6792/0 conn(0x7f0e440a8340 legacy=0x7f0e441ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796101511 0 0) 0x7f0e4413c650 con 0x7f0e44142140 2024-09-13T10:39:05.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): my global_id is 115402 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e30003550 con 0x7f0e44142140 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e42ffd640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.195:6789/0 conn(0x7f0e4413f750 legacy=0x7f0e441d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1926051319 0 0) 0x7f0e440a9f20 con 0x7f0e440a8340 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): my global_id is 57589 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e4413c650 con 0x7f0e440a8340 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757506121 0 0) 0x7f0e4413c370 con 0x7f0e4413f750 2024-09-13T10:39:05.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): my global_id is 134605 2024-09-13T10:39:05.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e440a9f20 con 0x7f0e4413f750 2024-09-13T10:39:05.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1600115762 0 0) 0x7f0e30003550 con 0x7f0e44142140 2024-09-13T10:39:05.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e4413c370 con 0x7f0e44142140 2024-09-13T10:39:05.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0e3c0020b0 con 0x7f0e44142140 2024-09-13T10:39:05.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:05.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:05.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): dump: 2024-09-13T10:39:05.459 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.460 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.460 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.460 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.460 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.460 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.460 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.460 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.460 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.460 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.460 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1698242082 0 0) 0x7f0e4413c370 con 0x7f0e44142140 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.195:6792/0 conn(0x7f0e440a8340 legacy=0x7f0e441ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.195:6789/0 conn(0x7f0e4413f750 legacy=0x7f0e441d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 monclient: found mon.c 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:05.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:05.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4413ae50 con 0x7f0e44142140 2024-09-13T10:39:05.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient: _finish_auth 0 2024-09-13T10:39:05.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:39:05.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e2bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:05.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e4a1aa640 5 monclient: authenticate success, global_id 115402 2024-09-13T10:39:05.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e4a1aa640 10 monclient: _renew_subs 2024-09-13T10:39:05.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e4a1aa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:05.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.443+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0e4413c090 con 0x7f0e44142140 2024-09-13T10:39:05.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e4a1aa640 10 monclient: _renew_subs 2024-09-13T10:39:05.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e4a1aa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:05.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f0e441cee60 con 0x7f0e44142140 2024-09-13T10:39:05.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e3c001e40 con 0x7f0e44142140 2024-09-13T10:39:05.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e2bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:05.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0e3c005490 con 0x7f0e44142140 2024-09-13T10:39:05.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e41ffb640 4 set_mon_vals no callback set 2024-09-13T10:39:05.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e2bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:05.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e2bfff640 10 monclient: dump: 2024-09-13T10:39:05.463 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.463 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.463 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.463 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e4a1aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:05.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0e240065c0 con 0x7f0e24002860 2024-09-13T10:39:05.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.444+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0e3c011b10 con 0x7f0e44142140 2024-09-13T10:39:05.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.445+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(285..285 src has 1..285) ==== 3898+0+0 (unknown 2129848869 0 0) 0x7f0e3c04e5e0 con 0x7f0e44142140 2024-09-13T10:39:05.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.445+0000 7f0e42ffd640 10 monclient: get_auth_request con 0x7f0e3003fed0 auth_method 0 2024-09-13T10:39:05.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2663238392}) 2024-09-13T10:39:05.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2447092397}) 2024-09-13T10:39:05.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2663238392}) 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=180432854}) 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2663238392}) 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=900299905}) 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2663238392}) 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=71472819}) 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2663238392}) 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=62704316}) 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2663238392}) 2024-09-13T10:39:05.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3681432583}) 2024-09-13T10:39:05.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2663238392}) 2024-09-13T10:39:05.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4164459906}) 2024-09-13T10:39:05.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2663238392}) 2024-09-13T10:39:05.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=286926695}) 2024-09-13T10:39:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e437fe640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.195:6792/0 conn(0x7f0e24002860 legacy=0x7f0e24004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098070168 0 0) 0x7f0e240065c0 con 0x7f0e24002860 2024-09-13T10:39:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 10 monclient(hunting): my global_id is 57598 2024-09-13T10:39:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e4413c370 con 0x7f0e24002860 2024-09-13T10:39:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2470048424 0 0) 0x7f0e4413c370 con 0x7f0e24002860 2024-09-13T10:39:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e240065c0 con 0x7f0e24002860 2024-09-13T10:39:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0e34001d30 con 0x7f0e24002860 2024-09-13T10:39:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 10 monclient: dump: 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.472 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3953904215 0 0) 0x7f0e240065c0 con 0x7f0e24002860 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.447+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e2400a160 con 0x7f0e24002860 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.448+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0e340057c0 con 0x7f0e24002860 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.448+0000 7f0e2bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.448+0000 7f0e2bfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.448+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.195:6792/0 conn(0x7f0e24002860 legacy=0x7f0e24004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.448+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.195:6792/0 conn(0x7f0e24002860 legacy=0x7f0e24004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.454+0000 7f0e4a1aa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.454+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0e24009e50 con 0x7f0e24009110 2024-09-13T10:39:05.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.456+0000 7f0e437fe640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.195:6792/0 conn(0x7f0e24009110 legacy=0x7f0e240095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3657471673 0 0) 0x7f0e24009e50 con 0x7f0e24009110 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 10 monclient(hunting): my global_id is 57607 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e240065c0 con 0x7f0e24009110 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2246218843 0 0) 0x7f0e240065c0 con 0x7f0e24009110 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e24009e50 con 0x7f0e24009110 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0e34004060 con 0x7f0e24009110 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 10 monclient: dump: 2024-09-13T10:39:05.474 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.475 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.476 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 288935317 0 0) 0x7f0e24009e50 con 0x7f0e24009110 2024-09-13T10:39:05.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.457+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0e2400c3a0 con 0x7f0e24009110 2024-09-13T10:39:05.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7729 (unknown 0 0 2999739455) 0x7f0e34004060 con 0x7f0e24009110 2024-09-13T10:39:05.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e2bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:05.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e2bfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:05.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.195:6792/0 conn(0x7f0e24009110 legacy=0x7f0e240095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e2bfff640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.195:6792/0 conn(0x7f0e24009110 legacy=0x7f0e240095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:05.476 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:05.476 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:05.477 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:05.477 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:39:05.477 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 132, 2024-09-13T10:39:05.477 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 559877, 2024-09-13T10:39:05.477 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:05.477 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:05.478 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:05.478 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:05.478 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:05.478 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:05.478 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:05.478 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:05.479 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:05.479 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:05.479 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.479 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 4, 2024-09-13T10:39:05.479 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:05.480 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:05.480 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:05.480 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:05.480 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:05.480 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:05.481 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:05.481 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:05.481 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:05.481 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:05.481 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:05.481 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:05.482 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:05.482 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:05.482 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.482 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:05.482 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:05.483 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:05.483 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:05.483 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:05.483 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:05.483 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:05.483 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:05.484 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:05.484 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:05.484 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:05.484 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:05.484 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:05.484 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.485 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:05.485 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:05.485 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:05.485 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:05.486 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:05.486 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:05.486 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:05.486 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:05.486 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:05.487 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:05.487 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:05.487 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:05.487 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:05.487 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:05.488 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:05.488 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:05.488 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:05.488 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:05.488 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:05.488 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:05.489 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:05.489 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:05.489 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:05.489 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:05.489 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:05.490 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:05.490 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:05.490 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:05.490 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.490 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:05.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.491 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:05.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.491 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:05.491 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:05.491 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.491 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.492 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.492 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:05.492 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.492 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.493 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.493 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:05.493 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:05.493 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.494 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.494 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.494 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:05.495 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:05.495 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.495 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.495 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.495 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:05.496 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.496 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.496 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.496 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:05.497 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:05.497 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.497 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.497 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.498 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:05.498 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:05.498 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.498 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.499 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.499 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:05.499 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.499 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.499 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.500 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:05.500 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:05.500 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.500 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.500 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.501 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:05.501 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:05.501 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.502 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.502 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.502 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:05.502 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.503 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.503 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.503 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:05.503 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:05.503 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.504 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.504 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.504 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:05.505 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:05.505 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.505 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.505 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.506 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:05.506 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.506 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.506 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.506 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:05.507 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:05.507 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.507 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.507 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.508 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:05.508 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:05.508 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.508 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.509 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.509 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:05.509 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.509 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.509 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.510 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:05.510 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:05.510 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.510 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.511 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.511 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:05.511 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:05.511 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.512 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.512 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.512 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:05.512 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.513 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.513 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.513 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:05.513 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:05.514 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.514 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.514 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.514 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:05.515 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:05.515 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.515 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.515 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:05.516 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.516 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.516 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.516 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:05.517 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:05.517 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.517 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.517 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.518 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:05.518 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:05.518 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:05.518 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:05.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.519 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:05.519 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:05.519 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:05.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.519 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.520 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:05.520 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:05.520 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:05.520 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:05.520 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:05.521 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.521 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.521 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:05.521 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:05.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.522 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:05.522 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:05.522 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:05.522 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.523 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.523 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:05.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.523 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:05.523 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:05.523 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:05.524 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.524 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:05.524 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:05.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:05.524 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:05.525 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:05.525 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:39:05.525 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:05.525 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:05.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:05.525 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:05.526 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:05.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0e3003fed0 legacy=0x7f0e30042390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e4a1aa640 10 monclient: shutdown 2024-09-13T10:39:05.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e4a1aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:05.529 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/3784826585 >> v1:172.21.15.181:6791/0 conn(0x7f0e44142140 legacy=0x7f0e441d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e43fff640 1 -- 172.21.15.181:0/3784826585 reap_dead start 2024-09-13T10:39:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e43fff640 1 -- 172.21.15.181:0/3784826585 reap_dead start 2024-09-13T10:39:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/3784826585 shutdown_connections 2024-09-13T10:39:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/3784826585 >> 172.21.15.181:0/3784826585 conn(0x7f0e440a6640 msgr2=0x7f0e440a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:05.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/3784826585 shutdown_connections 2024-09-13T10:39:05.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.458+0000 7f0e4a1aa640 1 -- 172.21.15.181:0/3784826585 wait complete. 2024-09-13T10:39:05.531 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:05.532 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['d', 'b', 'c', 'a'] 2024-09-13T10:39:05.532 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-13T10:39:05.532 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-09-13T10:39:05.532 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-09-13T10:39:05.533 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-09-13T10:39:05.533 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:39:05.546 INFO:tasks.ceph.mon.d:Stopped 2024-09-13T10:39:05.546 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-13T10:39:05.546 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-13T10:39:05.547 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T10:39:05.547 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:39:05.563 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.563 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3357230969}) 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1305798753}) 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3357230969}) 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4202853726}) 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3357230969}) 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1277759223}) 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3357230969}) 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2913646518}) 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3357230969}) 2024-09-13T10:39:05.564 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=384494026}) 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3357230969}) 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3314731708}) 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3357230969}) 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=393199631}) 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3357230969}) 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3881703732}) 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1812199607}) 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3525751404}) 2024-09-13T10:39:05.565 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1812199607}) 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2075764470}) 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1812199607}) 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2455622763}) 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1812199607}) 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4213886865}) 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1812199607}) 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3128488783}) 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.566 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1812199607}) 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=758326598}) 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1812199607}) 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=112283626}) 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1812199607}) 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2297832342}) 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1457979820}) 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578109492}) 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1457979820}) 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1731681115}) 2024-09-13T10:39:05.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1457979820}) 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3048007827}) 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1457979820}) 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=41937531}) 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1457979820}) 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2863125573}) 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1457979820}) 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2298315705}) 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1457979820}) 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2669521597}) 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1457979820}) 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4083101499}) 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3889424886}) 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=242247940}) 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3889424886}) 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1812150852}) 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3889424886}) 2024-09-13T10:39:05.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4109618334}) 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3889424886}) 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=626191179}) 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3889424886}) 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3520315227}) 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3889424886}) 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3497707347}) 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3889424886}) 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2051611215}) 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3889424886}) 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3701571270}) 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=346742202}) 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3809188205}) 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=346742202}) 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1588888234}) 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=346742202}) 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1277057151}) 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=346742202}) 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2890534614}) 2024-09-13T10:39:05.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=346742202}) 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=731016481}) 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=346742202}) 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4009694101}) 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=346742202}) 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3563664584}) 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=346742202}) 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=694200461}) 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2424452764}) 2024-09-13T10:39:05.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=118632785}) 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2424452764}) 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2422449819}) 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2424452764}) 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2728174644}) 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2424452764}) 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=390733595}) 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2424452764}) 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3887714895}) 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2424452764}) 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2193440494}) 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2424452764}) 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4175982865}) 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2424452764}) 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2922448126}) 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=978616399}) 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3016663137}) 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=978616399}) 2024-09-13T10:39:05.574 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2983731165}) 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=978616399}) 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4149270657}) 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=978616399}) 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3389441788}) 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=978616399}) 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3781628021}) 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=978616399}) 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=518719788}) 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.575 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=978616399}) 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1269039800}) 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=978616399}) 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4096727578}) 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2022776409}) 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1159578468}) 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2022776409}) 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=547118561}) 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2022776409}) 2024-09-13T10:39:05.576 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4133124085}) 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2022776409}) 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4041221050}) 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2022776409}) 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=399699219}) 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2022776409}) 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3415529382}) 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2022776409}) 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3026745721}) 2024-09-13T10:39:05.577 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2022776409}) 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4281305589}) 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4025493761}) 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=833010580}) 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4025493761}) 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2351331003}) 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4025493761}) 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4138805551}) 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.578 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4025493761}) 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1894744533}) 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4025493761}) 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=486543088}) 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4025493761}) 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=515955543}) 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4025493761}) 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1213503984}) 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4025493761}) 2024-09-13T10:39:05.579 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.502+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2906977597}) 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=812495534}) 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3735169865}) 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=812495534}) 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4143631052}) 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=812495534}) 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=491258617}) 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=812495534}) 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2759523919}) 2024-09-13T10:39:05.580 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=812495534}) 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=678609188}) 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=812495534}) 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1531951962}) 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=812495534}) 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3759132967}) 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=812495534}) 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.503+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4199188988}) 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2530825154}) 2024-09-13T10:39:05.581 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4192163082}) 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2530825154}) 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3167116531}) 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2530825154}) 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3687973188}) 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2530825154}) 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=510830652}) 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2530825154}) 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1188392033}) 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.582 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2530825154}) 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3053730624}) 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2530825154}) 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2508262139}) 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2530825154}) 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.504+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1808101894}) 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.505+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.505+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2722664982}) 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.505+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1495591828}) 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.505+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.505+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2722664982}) 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.505+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1966601933}) 2024-09-13T10:39:05.583 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.505+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.505+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2722664982}) 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.505+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3065378921}) 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.505+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.505+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2722664982}) 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3809274126}) 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2722664982}) 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2448321477}) 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2722664982}) 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3753112342}) 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.584 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2722664982}) 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1259503926}) 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2722664982}) 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=226097462}) 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4276337590}) 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=59421138}) 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4276337590}) 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=467154873}) 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4276337590}) 2024-09-13T10:39:05.585 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3531715136}) 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4276337590}) 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=337107649}) 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4276337590}) 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2416716447}) 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4276337590}) 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3298275408}) 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4276337590}) 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2070010064}) 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.586 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4276337590}) 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1484334545}) 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2152487495}) 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078677794}) 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2152487495}) 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4047268233}) 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2152487495}) 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=792366597}) 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2152487495}) 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4036752373}) 2024-09-13T10:39:05.587 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2152487495}) 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3826954084}) 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2152487495}) 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2888333721}) 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2152487495}) 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2850174015}) 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2152487495}) 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.508+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1691341565}) 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4000763347}) 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=409790330}) 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4000763347}) 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=751907530}) 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4000763347}) 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3439816542}) 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4000763347}) 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2605084651}) 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4000763347}) 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1178226766}) 2024-09-13T10:39:05.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4000763347}) 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3553883102}) 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4000763347}) 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=933124031}) 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4000763347}) 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3799909574}) 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=641921016}) 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1568452262}) 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=641921016}) 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4287593580}) 2024-09-13T10:39:05.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=641921016}) 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=465364280}) 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=641921016}) 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1676295254}) 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=641921016}) 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1219397875}) 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=641921016}) 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3065530670}) 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=641921016}) 2024-09-13T10:39:05.591 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3907770378}) 2024-09-13T10:39:05.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:05.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=641921016}) 2024-09-13T10:39:05.592 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:05.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1906165664}) 2024-09-13T10:39:05.598 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T10:39:05.598 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-13T10:39:05.598 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-13T10:39:05.598 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T10:39:05.598 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:39:05.650 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T10:39:05.651 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-13T10:39:05.651 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-13T10:39:05.651 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T10:39:05.651 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:39:05.702 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T10:39:05.702 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2024-09-13T10:39:05.702 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:39:05.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.836+0000 7f77d03cd640 10 monclient: get_monmap_and_config 2024-09-13T10:39:05.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.836+0000 7f77d03cd640 10 monclient: build_initial_monmap 2024-09-13T10:39:05.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.836+0000 7f77d03cd640 10 monclient: monmap: 2024-09-13T10:39:05.838 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:05.838 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.838 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:05.837195+0000 2024-09-13T10:39:05.838 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:05.837195+0000 2024-09-13T10:39:05.838 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:05.838 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.838 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:05.838 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:05.839 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:05.839 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:05.839 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:05.839 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:05.839 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:05.839 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:05.839 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:05.839 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 1 Processor -- start 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 1 -- start start 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 10 monclient: init 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 10 monclient: _add_conns ranks=[6,7,2,8,3,1,5,0,4] 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 10 monclient(hunting): picked mon.noname-d con 0x7f77c80a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 10 monclient(hunting): picked mon.noname-i con 0x7f77c80a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 10 monclient(hunting): picked mon.noname-b con 0x7f77c813f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c80a4bc0 con 0x7f77c813f750 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c813a320 con 0x7f77c80a6640 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c80a8100 con 0x7f77c80a8340 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77d03cd640 10 monclient(hunting): authenticate will time out at 1285.342827s 2024-09-13T10:39:05.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77ce169640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f77c80a6640 legacy=0x7f77c8139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:05.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.837+0000 7f77ce96a640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f77c813f750 legacy=0x7f77c8141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:05.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.838+0000 7f77cd968640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f77c80a8340 0x7f77c8139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:45402/0 (socket says 172.21.15.181:45402) 2024-09-13T10:39:05.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.838+0000 7f77cd968640 1 -- 172.21.15.181:0/3291107007 learned_addr learned my addr 172.21.15.181:0/3291107007 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:05.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd968640 1 -- 172.21.15.181:0/3291107007 >> v1:172.21.15.195:6792/0 conn(0x7f77c80a8340 legacy=0x7f77c8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 1 -- 172.21.15.181:0/3291107007 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090520925 0 0) 0x7f77c80a8100 con 0x7f77c80a8340 2024-09-13T10:39:05.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient(hunting): my global_id is 57616 2024-09-13T10:39:05.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 1 -- 172.21.15.181:0/3291107007 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b4003520 con 0x7f77c80a8340 2024-09-13T10:39:05.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 1 -- 172.21.15.181:0/3291107007 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3452119895 0 0) 0x7f77b4003520 con 0x7f77c80a8340 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 1 -- 172.21.15.181:0/3291107007 >> v1:172.21.15.181:6792/0 conn(0x7f77c80a6640 legacy=0x7f77c8139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 1 -- 172.21.15.181:0/3291107007 >> v1:172.21.15.181:6790/0 conn(0x7f77c813f750 legacy=0x7f77c8141b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient: _finish_hunting 0 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 1 monclient: found mon.noname-i 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 1 -- 172.21.15.181:0/3291107007 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c80a48e0 con 0x7f77c80a8340 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient: _finish_auth 0 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient: _check_auth_tickets 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 1 -- 172.21.15.181:0/3291107007 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f77b8001ae0 con 0x7f77c80a8340 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77d03cd640 5 monclient: authenticate success, global_id 57616 2024-09-13T10:39:05.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77d03cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:05.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:39:05.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient: dump: 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.848 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77d03cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 1 -- 172.21.15.181:0/3291107007 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77b80048a0 con 0x7f77c80a8340 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77d03cd640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77d03cd640 4 set_mon_vals no callback set 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 1 -- 172.21.15.181:0/3291107007 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f77b8004e50 con 0x7f77c80a8340 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.840+0000 7f77cd167640 10 monclient: dump: 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.849 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.850 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.841+0000 7f77d03cd640 10 monclient: shutdown 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.841+0000 7f77d03cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.841+0000 7f77d03cd640 1 -- 172.21.15.181:0/3291107007 >> v1:172.21.15.195:6792/0 conn(0x7f77c80a8340 legacy=0x7f77c8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.841+0000 7f77d03cd640 1 -- 172.21.15.181:0/3291107007 shutdown_connections 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.841+0000 7f77d03cd640 1 -- 172.21.15.181:0/3291107007 >> 172.21.15.181:0/3291107007 conn(0x7f77c8077170 msgr2=0x7f77c80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.841+0000 7f77d03cd640 1 -- 172.21.15.181:0/3291107007 shutdown_connections 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.841+0000 7f77d03cd640 1 -- 172.21.15.181:0/3291107007 wait complete. 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.841+0000 7f77d03cd640 10 monclient: build_initial_monmap 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.841+0000 7f77d03cd640 10 monclient: monmap: 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:05.851 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 1 Processor -- start 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 1 -- start start 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 10 monclient: init 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 10 monclient: _add_conns ranks=[8,5,7,0,1,6,4,2,3] 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 10 monclient(hunting): picked mon.noname-e con 0x7f77c80a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 10 monclient(hunting): picked mon.noname-h con 0x7f77c813f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 10 monclient(hunting): picked mon.noname-i con 0x7f77c81d43a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c80a1190 con 0x7f77c813f750 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c809e190 con 0x7f77c81d43a0 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c80a9c40 con 0x7f77c80a8340 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77d03cd640 10 monclient(hunting): authenticate will time out at 1285.347782s 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77ce169640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f77c80a8340 0x7f77c809d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:55022/0 (socket says 172.21.15.181:55022) 2024-09-13T10:39:05.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.842+0000 7f77ce169640 1 -- 172.21.15.181:0/1914172083 learned_addr learned my addr 172.21.15.181:0/1914172083 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:05.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.844+0000 7f77ce169640 1 -- 172.21.15.181:0/1914172083 >> v1:172.21.15.181:6793/0 conn(0x7f77c80a8340 legacy=0x7f77c809d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77cd968640 1 -- 172.21.15.181:0/1914172083 >> v1:172.21.15.195:6791/0 conn(0x7f77c813f750 legacy=0x7f77c809da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77ce96a640 1 -- 172.21.15.181:0/1914172083 >> v1:172.21.15.195:6792/0 conn(0x7f77c81d43a0 legacy=0x7f77c81d6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884043419 0 0) 0x7f77c809e190 con 0x7f77c81d43a0 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient(hunting): my global_id is 57625 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77ac003550 con 0x7f77c81d43a0 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2003743002 0 0) 0x7f77ac003550 con 0x7f77c81d43a0 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77c809e190 con 0x7f77c81d43a0 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f77c0004800 con 0x7f77c81d43a0 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:39:05.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient(hunting): dump: 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.858 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2666150902 0 0) 0x7f77c809e190 con 0x7f77c81d43a0 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 >> v1:172.21.15.181:6793/0 conn(0x7f77c80a8340 legacy=0x7f77c809d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 >> v1:172.21.15.195:6791/0 conn(0x7f77c813f750 legacy=0x7f77c809da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 1 monclient: found mon.i 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c80a0320 con 0x7f77c81d43a0 2024-09-13T10:39:05.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient: _finish_auth 0 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77d03cd640 5 monclient: authenticate success, global_id 57625 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77d03cd640 10 monclient: _renew_subs 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77d03cd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77d03cd640 1 -- 172.21.15.181:0/1914172083 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f77c809ee30 con 0x7f77c81d43a0 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77d03cd640 10 monclient: _renew_subs 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77d03cd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77d03cd640 1 -- 172.21.15.181:0/1914172083 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f77c80a29f0 con 0x7f77c81d43a0 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77c0004a20 con 0x7f77c81d43a0 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f77c0004f90 con 0x7f77c81d43a0 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:05.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77cc966640 4 set_mon_vals no callback set 2024-09-13T10:39:05.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:05.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.845+0000 7f77beffd640 10 monclient: dump: 2024-09-13T10:39:05.861 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:05.861 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:05.861 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.861 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:05.861 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:05.861 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:05.861 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:05.861 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:05.861 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:05.861 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.846+0000 7f77d03cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.846+0000 7f77d03cd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.846+0000 7f77d03cd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.846+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f77c0005230 con 0x7f77c81d43a0 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.846+0000 7f77d03cd640 1 -- 172.21.15.181:0/1914172083 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b0005080 con 0x7f77c81d43a0 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.846+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(285..285 src has 1..285) ==== 3898+0+0 (unknown 2129848869 0 0) 0x7f77c004e5e0 con 0x7f77c81d43a0 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.847+0000 7f77ce169640 10 monclient: get_auth_request con 0x7f77ac03fb60 auth_method 0 2024-09-13T10:39:05.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.851+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 <== mon.7 v1:172.21.15.195:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f77c0017a70 con 0x7f77c81d43a0 2024-09-13T10:39:05.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.851+0000 7f77beffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:05.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:05.851+0000 7f77beffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:06.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.090+0000 7f77d03cd640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:39:06.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.090+0000 7f77d03cd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:06.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.090+0000 7f77d03cd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:06.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.090+0000 7f77d03cd640 1 -- 172.21.15.181:0/1914172083 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f77b0005370 con 0x7f77c81d43a0 2024-09-13T10:39:06.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.091+0000 7f77beffd640 1 -- 172.21.15.181:0/1914172083 <== mon.7 v1:172.21.15.195:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 1928238804) 0x7f77c0017370 con 0x7f77c81d43a0 2024-09-13T10:39:06.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.091+0000 7f77beffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:06.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.091+0000 7f77beffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:06.093 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":132,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":5,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:39:06.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.093+0000 7f77d03cd640 1 -- 172.21.15.181:0/1914172083 >> v1:172.21.15.195:6800/1839191919 conn(0x7f77ac03fb60 legacy=0x7f77ac042020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:06.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.093+0000 7f77d03cd640 10 monclient: shutdown 2024-09-13T10:39:06.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.093+0000 7f77d03cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:06.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.093+0000 7f77d03cd640 1 -- 172.21.15.181:0/1914172083 >> v1:172.21.15.195:6792/0 conn(0x7f77c81d43a0 legacy=0x7f77c81d6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:06.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.093+0000 7f77d03cd640 1 -- 172.21.15.181:0/1914172083 shutdown_connections 2024-09-13T10:39:06.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.093+0000 7f77d03cd640 1 -- 172.21.15.181:0/1914172083 >> 172.21.15.181:0/1914172083 conn(0x7f77c80a6640 msgr2=0x7f77c8141b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:06.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.093+0000 7f77d03cd640 1 -- 172.21.15.181:0/1914172083 shutdown_connections 2024-09-13T10:39:06.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:06.093+0000 7f77d03cd640 1 -- 172.21.15.181:0/1914172083 wait complete. 2024-09-13T10:39:09.107 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:39:09.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.214+0000 7fb82230e640 10 monclient: get_monmap_and_config 2024-09-13T10:39:09.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.214+0000 7fb82230e640 10 monclient: build_initial_monmap 2024-09-13T10:39:09.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.214+0000 7fb82230e640 10 monclient: monmap: 2024-09-13T10:39:09.216 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:09.216 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:09.216 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:09.215148+0000 2024-09-13T10:39:09.217 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:09.215148+0000 2024-09-13T10:39:09.217 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:09.217 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:09.217 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:09.217 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:09.217 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:09.217 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:09.217 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:09.218 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:09.218 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:09.218 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:09.218 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:09.218 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:09.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 1 Processor -- start 2024-09-13T10:39:09.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 1 -- start start 2024-09-13T10:39:09.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 10 monclient: init 2024-09-13T10:39:09.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:09.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 10 monclient: _add_conns ranks=[2,7,1,4,5,0,6,8,3] 2024-09-13T10:39:09.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 10 monclient(hunting): picked mon.noname-b con 0x7fb81c139040 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:09.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 10 monclient(hunting): picked mon.noname-i con 0x7fb81c09cd50 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:09.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 10 monclient(hunting): picked mon.noname-f con 0x7fb81c13fae0 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:09.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c09dbb0 con 0x7fb81c13fae0 2024-09-13T10:39:09.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c09de90 con 0x7fb81c139040 2024-09-13T10:39:09.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c09e170 con 0x7fb81c09cd50 2024-09-13T10:39:09.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:09.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb82230e640 10 monclient(hunting): authenticate will time out at 1288.720924s 2024-09-13T10:39:09.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.215+0000 7fb81bfff640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fb81c139040 legacy=0x7fb81c0a58e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:09.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.216+0000 7fb8208ab640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fb81c13fae0 0x7fb81c141ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:43474/0 (socket says 172.21.15.181:43474) 2024-09-13T10:39:09.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.216+0000 7fb81b7fe640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7fb81c09cd50 0x7fb81c13e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:45416/0 (socket says 172.21.15.181:45416) 2024-09-13T10:39:09.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.216+0000 7fb8208ab640 1 -- 172.21.15.181:0/3165168112 learned_addr learned my addr 172.21.15.181:0/3165168112 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:09.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb8208ab640 1 -- 172.21.15.181:0/3165168112 >> v1:172.21.15.195:6789/0 conn(0x7fb81c13fae0 legacy=0x7fb81c141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:09.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81b7fe640 1 -- 172.21.15.181:0/3165168112 >> v1:172.21.15.195:6792/0 conn(0x7fb81c09cd50 legacy=0x7fb81c13e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:09.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 1 -- 172.21.15.181:0/3165168112 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 271598766 0 0) 0x7fb81c09e170 con 0x7fb81c09cd50 2024-09-13T10:39:09.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:09.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:09.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:09.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 10 monclient(hunting): my global_id is 57634 2024-09-13T10:39:09.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 1 -- 172.21.15.181:0/3165168112 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb804003520 con 0x7fb81c09cd50 2024-09-13T10:39:09.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 1 -- 172.21.15.181:0/3165168112 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3235616273 0 0) 0x7fb804003520 con 0x7fb81c09cd50 2024-09-13T10:39:09.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 1 -- 172.21.15.181:0/3165168112 >> v1:172.21.15.181:6790/0 conn(0x7fb81c139040 legacy=0x7fb81c0a58e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 1 -- 172.21.15.181:0/3165168112 >> v1:172.21.15.195:6789/0 conn(0x7fb81c13fae0 legacy=0x7fb81c141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 1 monclient: found mon.noname-i 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 1 -- 172.21.15.181:0/3165168112 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c0a5ff0 con 0x7fb81c09cd50 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 10 monclient: _finish_auth 0 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 1 -- 172.21.15.181:0/3165168112 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb810001ae0 con 0x7fb81c09cd50 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:39:09.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb81affd640 10 monclient: dump: 2024-09-13T10:39:09.230 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:09.230 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:09.230 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:09.230 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:09.230 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:09.230 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:09.230 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:09.230 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:09.230 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:09.230 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb82230e640 5 monclient: authenticate success, global_id 57634 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.218+0000 7fb82230e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb81affd640 1 -- 172.21.15.181:0/3165168112 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8100047e0 con 0x7fb81c09cd50 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb81affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb81affd640 1 -- 172.21.15.181:0/3165168112 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb810004d90 con 0x7fb81c09cd50 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb82230e640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb82230e640 4 set_mon_vals no callback set 2024-09-13T10:39:09.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb81affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb81affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb81affd640 10 monclient: dump: 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:09.232 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb82230e640 10 monclient: shutdown 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb82230e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb82230e640 1 -- 172.21.15.181:0/3165168112 >> v1:172.21.15.195:6792/0 conn(0x7fb81c09cd50 legacy=0x7fb81c13e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb82230e640 1 -- 172.21.15.181:0/3165168112 shutdown_connections 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb82230e640 1 -- 172.21.15.181:0/3165168112 >> 172.21.15.181:0/3165168112 conn(0x7fb81c077120 msgr2=0x7fb81c0abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb82230e640 1 -- 172.21.15.181:0/3165168112 shutdown_connections 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.219+0000 7fb82230e640 1 -- 172.21.15.181:0/3165168112 wait complete. 2024-09-13T10:39:09.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.220+0000 7fb82230e640 10 monclient: build_initial_monmap 2024-09-13T10:39:09.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.220+0000 7fb82230e640 10 monclient: monmap: 2024-09-13T10:39:09.234 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:09.234 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:09.234 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:09.234 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:09.234 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:09.234 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:09.234 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:09.234 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:09.234 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:09.234 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.220+0000 7fb82230e640 1 Processor -- start 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.220+0000 7fb82230e640 1 -- start start 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.220+0000 7fb82230e640 10 monclient: init 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb82230e640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb82230e640 10 monclient: _add_conns ranks=[2,0,4,1,6,8,3,5,7] 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb82230e640 10 monclient(hunting): picked mon.noname-b con 0x7fb81c09cd50 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb82230e640 10 monclient(hunting): picked mon.noname-a con 0x7fb81c139040 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:09.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb82230e640 10 monclient(hunting): picked mon.noname-c con 0x7fb81c13fae0 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:09.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb82230e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c13c1e0 con 0x7fb81c139040 2024-09-13T10:39:09.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb81bfff640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fb81c09cd50 legacy=0x7fb81c13a6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:09.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb82230e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c0aae70 con 0x7fb81c09cd50 2024-09-13T10:39:09.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb81b7fe640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fb81c139040 legacy=0x7fb81c13ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:39:09.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb82230e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c0a5a30 con 0x7fb81c13fae0 2024-09-13T10:39:09.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb82230e640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:09.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb8208ab640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7fb81c13fae0 legacy=0x7fb81c1d66b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:09.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.221+0000 7fb82230e640 10 monclient(hunting): authenticate will time out at 1288.726236s 2024-09-13T10:39:09.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.422+0000 7fb8208ab640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7fb81c13fae0 legacy=0x7fb81c1d66b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:09.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.422+0000 7fb81b7fe640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fb81c139040 legacy=0x7fb81c13ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:39:09.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.422+0000 7fb81bfff640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fb81c09cd50 legacy=0x7fb81c13a6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:09.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.823+0000 7fb8208ab640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7fb81c13fae0 legacy=0x7fb81c1d66b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:09.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.823+0000 7fb81bfff640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fb81c09cd50 legacy=0x7fb81c13a6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:09.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:09.823+0000 7fb81b7fe640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fb81c139040 legacy=0x7fb81c13ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:39:10.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:10.624+0000 7fb81b7fe640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fb81c139040 legacy=0x7fb81c13ae00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:39:10.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:10.624+0000 7fb8208ab640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7fb81c13fae0 legacy=0x7fb81c1d66b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:10.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:10.624+0000 7fb81bfff640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fb81c09cd50 legacy=0x7fb81c13a6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:12.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 10 monclient(hunting): tick 2024-09-13T10:39:12.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:39:12.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 1 monclient(hunting): continuing hunt 2024-09-13T10:39:12.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:39:12.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7fb81c13fae0 legacy=0x7fb81c1d66b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:12.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fb81c09cd50 legacy=0x7fb81c13a6f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:12.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fb81c139040 legacy=0x7fb81c13ae00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:12.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 10 monclient: _add_conns ranks=[5,7,8,3,1,6] 2024-09-13T10:39:12.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 10 monclient(hunting): picked mon.noname-h con 0x7fb7fc003780 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:12.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 10 monclient(hunting): picked mon.noname-i con 0x7fb7fc007410 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:12.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 10 monclient(hunting): picked mon.noname-e con 0x7fb7fc00b1a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:12.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c143330 con 0x7fb7fc003780 2024-09-13T10:39:12.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c13c1e0 con 0x7fb7fc007410 2024-09-13T10:39:12.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c0a5a30 con 0x7fb7fc00b1a0 2024-09-13T10:39:12.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8037fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:12.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8208ab640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fb7fc00b1a0 0x7fb7fc00d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:55034/0 (socket says 172.21.15.181:55034) 2024-09-13T10:39:12.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.221+0000 7fb8208ab640 1 -- 172.21.15.181:0/2247950950 learned_addr learned my addr 172.21.15.181:0/2247950950 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:12.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.224+0000 7fb8208ab640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6793/0 conn(0x7fb7fc00b1a0 legacy=0x7fb7fc00d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:12.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.224+0000 7fb81b7fe640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.195:6792/0 conn(0x7fb7fc007410 legacy=0x7fb7fc0098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:12.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:12.224+0000 7fb81bfff640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.195:6791/0 conn(0x7fb7fc003780 legacy=0x7fb7fc005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:15.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 10 monclient(hunting): tick 2024-09-13T10:39:15.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 1 monclient(hunting): continuing hunt 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6793/0 conn(0x7fb7fc00b1a0 legacy=0x7fb7fc00d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.195:6792/0 conn(0x7fb7fc007410 legacy=0x7fb7fc0098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.195:6791/0 conn(0x7fb7fc003780 legacy=0x7fb7fc005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 10 monclient: _add_conns ranks=[3,1,6] 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 10 monclient(hunting): picked mon.noname-g con 0x7fb7fc0101c0 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8208ab640 1 -- 172.21.15.181:0/2247950950 reap_dead start 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 10 monclient(hunting): picked mon.noname-f con 0x7fb7fc010f70 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 10 monclient(hunting): picked mon.noname-d con 0x7fb7fc011b90 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc011fa0 con 0x7fb7fc010f70 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.221+0000 7fb8037fe640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc00a140 con 0x7fb7fc0101c0 2024-09-13T10:39:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.222+0000 7fb8037fe640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc00a360 con 0x7fb7fc011b90 2024-09-13T10:39:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.222+0000 7fb8037fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.222+0000 7fb8208ab640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6792/0 conn(0x7fb7fc011b90 legacy=0x7fb7fc019340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.224+0000 7fb81bfff640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.195:6790/0 conn(0x7fb7fc0101c0 legacy=0x7fb7fc010600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.224+0000 7fb81b7fe640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.195:6789/0 conn(0x7fb7fc010f70 legacy=0x7fb7fc011380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:15.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.423+0000 7fb8208ab640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6792/0 conn(0x7fb7fc011b90 legacy=0x7fb7fc019340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:15.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:15.824+0000 7fb8208ab640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6792/0 conn(0x7fb7fc011b90 legacy=0x7fb7fc019340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:16.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:16.626+0000 7fb8208ab640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6792/0 conn(0x7fb7fc011b90 legacy=0x7fb7fc019340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:18.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 10 monclient(hunting): tick 2024-09-13T10:39:18.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:39:18.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 1 monclient(hunting): continuing hunt 2024-09-13T10:39:18.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:39:18.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6792/0 conn(0x7fb7fc011b90 legacy=0x7fb7fc019340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:18.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.195:6790/0 conn(0x7fb7fc0101c0 legacy=0x7fb7fc010600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:18.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.195:6789/0 conn(0x7fb7fc010f70 legacy=0x7fb7fc011380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:18.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 10 monclient: _add_conns ranks=[4,2,3,5,1,8,7,0,6] 2024-09-13T10:39:18.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 10 monclient(hunting): picked mon.noname-c con 0x7fb7fc00a8b0 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:18.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 10 monclient(hunting): picked mon.noname-b con 0x7fb7fc00ad30 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:18.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 10 monclient(hunting): picked mon.noname-g con 0x7fb7fc0101c0 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:18.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc00a580 con 0x7fb7fc00ad30 2024-09-13T10:39:18.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc00a360 con 0x7fb7fc0101c0 2024-09-13T10:39:18.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc00d7a0 con 0x7fb7fc00a8b0 2024-09-13T10:39:18.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb8037fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:18.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb81b7fe640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6790/0 conn(0x7fb7fc00ad30 legacy=0x7fb7fc005bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:18.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.222+0000 7fb81bfff640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6791/0 conn(0x7fb7fc00a8b0 legacy=0x7fb7fc0098d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:18.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.224+0000 7fb8208ab640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.195:6790/0 conn(0x7fb7fc0101c0 legacy=0x7fb7fc010600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:18.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.423+0000 7fb81bfff640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6791/0 conn(0x7fb7fc00a8b0 legacy=0x7fb7fc0098d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:18.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.423+0000 7fb81b7fe640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6790/0 conn(0x7fb7fc00ad30 legacy=0x7fb7fc005bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:18.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.824+0000 7fb81bfff640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6791/0 conn(0x7fb7fc00a8b0 legacy=0x7fb7fc0098d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:18.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:18.824+0000 7fb81b7fe640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6790/0 conn(0x7fb7fc00ad30 legacy=0x7fb7fc005bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.625+0000 7fb81b7fe640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6790/0 conn(0x7fb7fc00ad30 legacy=0x7fb7fc005bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:19.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.625+0000 7fb81bfff640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6791/0 conn(0x7fb7fc00a8b0 legacy=0x7fb7fc0098d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:19.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.646+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2245210624 0 0) 0x7fb7fc00a360 con 0x7fb7fc0101c0 2024-09-13T10:39:19.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.646+0000 7fb818ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:19.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.646+0000 7fb818ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:19.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.646+0000 7fb818ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:19.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.646+0000 7fb818ff9640 10 monclient(hunting): my global_id is 164217 2024-09-13T10:39:19.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.646+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb808003520 con 0x7fb7fc0101c0 2024-09-13T10:39:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.652+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 418082615 0 0) 0x7fb808003520 con 0x7fb7fc0101c0 2024-09-13T10:39:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.652+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7fc00a360 con 0x7fb7fc0101c0 2024-09-13T10:39:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.652+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb814002060 con 0x7fb7fc0101c0 2024-09-13T10:39:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.652+0000 7fb818ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.652+0000 7fb818ff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:39:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.652+0000 7fb818ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:19.656 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.652+0000 7fb818ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 424460366 0 0) 0x7fb7fc00a360 con 0x7fb7fc0101c0 2024-09-13T10:39:19.657 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6791/0 conn(0x7fb7fc00a8b0 legacy=0x7fb7fc0098d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.181:6790/0 conn(0x7fb7fc00ad30 legacy=0x7fb7fc005bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:39:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 1 monclient: found mon.g 2024-09-13T10:39:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:39:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc00da30 con 0x7fb7fc0101c0 2024-09-13T10:39:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 10 monclient: _finish_auth 0 2024-09-13T10:39:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:39:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb82230e640 5 monclient: authenticate success, global_id 164217 2024-09-13T10:39:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb82230e640 10 monclient: _renew_subs 2024-09-13T10:39:19.658 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb82230e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb82230e640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c13e260 con 0x7fb7fc0101c0 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb82230e640 10 monclient: _renew_subs 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb82230e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb82230e640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb81c13ea40 con 0x7fb7fc0101c0 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb814004e80 con 0x7fb7fc0101c0 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb814005370 con 0x7fb7fc0101c0 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb81a7fc640 4 set_mon_vals no callback set 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.653+0000 7fb818ff9640 10 monclient: dump: 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:19.659 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:19.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.654+0000 7fb82230e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.654+0000 7fb82230e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.654+0000 7fb82230e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:39:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.654+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb8140055d0 con 0x7fb7fc0101c0 2024-09-13T10:39:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.654+0000 7fb82230e640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.195:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f4005080 con 0x7fb7fc0101c0 2024-09-13T10:39:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.654+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(285..285 src has 1..285) ==== 3898+0+0 (unknown 2129848869 0 0) 0x7fb81404e4f0 con 0x7fb7fc0101c0 2024-09-13T10:39:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.654+0000 7fb81bfff640 10 monclient: get_auth_request con 0x7fb80803f830 auth_method 0 2024-09-13T10:39:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.659+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 <== mon.3 v1:172.21.15.195:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fb8140179f0 con 0x7fb7fc0101c0 2024-09-13T10:39:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.659+0000 7fb818ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:19.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.659+0000 7fb818ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.904+0000 7fb82230e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:39:19.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.904+0000 7fb82230e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:19.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.904+0000 7fb82230e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:39:19.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.904+0000 7fb82230e640 1 -- 172.21.15.181:0/2247950950 --> v1:172.21.15.195:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb7f4005370 con 0x7fb7fc0101c0 2024-09-13T10:39:19.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.905+0000 7fb818ff9640 1 -- 172.21.15.181:0/2247950950 <== mon.3 v1:172.21.15.195:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2721 (unknown 254746657 0 3004425886) 0x7fb8140172f0 con 0x7fb7fc0101c0 2024-09-13T10:39:19.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.905+0000 7fb818ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:19.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.905+0000 7fb818ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:19.906 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":136,"quorum":[1,3,5,7,8],"quorum_names":["f","g","h","i","e"],"quorum_leader_name":"i","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:39:19.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.907+0000 7fb82230e640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb80803f830 legacy=0x7fb808041cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:19.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.907+0000 7fb82230e640 10 monclient: shutdown 2024-09-13T10:39:19.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.907+0000 7fb82230e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:19.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.907+0000 7fb82230e640 1 -- 172.21.15.181:0/2247950950 >> v1:172.21.15.195:6790/0 conn(0x7fb7fc0101c0 legacy=0x7fb7fc010600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:19.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.907+0000 7fb8208ab640 1 -- 172.21.15.181:0/2247950950 reap_dead start 2024-09-13T10:39:19.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.907+0000 7fb8208ab640 1 -- 172.21.15.181:0/2247950950 reap_dead start 2024-09-13T10:39:19.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.907+0000 7fb82230e640 1 -- 172.21.15.181:0/2247950950 shutdown_connections 2024-09-13T10:39:19.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.907+0000 7fb82230e640 1 -- 172.21.15.181:0/2247950950 >> 172.21.15.181:0/2247950950 conn(0x7fb81c077120 msgr2=0x7fb81c13f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:19.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.907+0000 7fb82230e640 1 -- 172.21.15.181:0/2247950950 shutdown_connections 2024-09-13T10:39:19.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:19.907+0000 7fb82230e640 1 -- 172.21.15.181:0/2247950950 wait complete. 2024-09-13T10:39:19.919 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2024-09-13T10:39:19.920 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon e 2024-09-13T10:39:19.920 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:39:20.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.016+0000 7fd1a4d5d640 10 monclient: get_monmap_and_config 2024-09-13T10:39:20.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.016+0000 7fd1a4d5d640 10 monclient: build_initial_monmap 2024-09-13T10:39:20.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.016+0000 7fd1a4d5d640 10 monclient: monmap: 2024-09-13T10:39:20.018 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:20.018 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:20.018 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:20.017497+0000 2024-09-13T10:39:20.018 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:20.017497+0000 2024-09-13T10:39:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:20.019 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:20.019 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:20.020 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.017+0000 7fd1a4d5d640 1 Processor -- start 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.017+0000 7fd1a4d5d640 1 -- start start 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.017+0000 7fd1a4d5d640 10 monclient: init 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.018+0000 7fd1a4d5d640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.018+0000 7fd1a4d5d640 10 monclient: _add_conns ranks=[7,3,8,6,2,5,1,0,4] 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.018+0000 7fd1a4d5d640 10 monclient(hunting): picked mon.noname-i con 0x7fd1a00a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.018+0000 7fd1a4d5d640 10 monclient(hunting): picked mon.noname-g con 0x7fd1a00a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.018+0000 7fd1a4d5d640 10 monclient(hunting): picked mon.noname-e con 0x7fd1a013f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.018+0000 7fd1a4d5d640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a00a4bc0 con 0x7fd1a00a8340 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.018+0000 7fd1a4d5d640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a013a320 con 0x7fd1a00a6640 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.018+0000 7fd1a4d5d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a00a8100 con 0x7fd1a013f750 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.018+0000 7fd1a4d5d640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.018+0000 7fd1a4d5d640 10 monclient(hunting): authenticate will time out at 1299.523228s 2024-09-13T10:39:20.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.018+0000 7fd19ed9d640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fd1a013f750 0x7fd1a0141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:44734/0 (socket says 172.21.15.181:44734) 2024-09-13T10:39:20.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.018+0000 7fd19ed9d640 1 -- 172.21.15.181:0/274914652 learned_addr learned my addr 172.21.15.181:0/274914652 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:20.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19ed9d640 1 -- 172.21.15.181:0/274914652 >> v1:172.21.15.181:6793/0 conn(0x7fd1a013f750 legacy=0x7fd1a0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:20.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19dd9b640 1 -- 172.21.15.181:0/274914652 >> v1:172.21.15.195:6790/0 conn(0x7fd1a00a8340 legacy=0x7fd1a0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:20.025 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 727832158 0 0) 0x7fd1a00a8100 con 0x7fd1a013f750 2024-09-13T10:39:20.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:39:20.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19e59c640 1 -- 172.21.15.181:0/274914652 >> v1:172.21.15.195:6792/0 conn(0x7fd1a00a6640 legacy=0x7fd1a0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:20.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:20.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:20.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient(hunting): my global_id is 105677 2024-09-13T10:39:20.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd188003520 con 0x7fd1a013f750 2024-09-13T10:39:20.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198234653 0 0) 0x7fd1a013a320 con 0x7fd1a00a6640 2024-09-13T10:39:20.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:39:20.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:20.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:20.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient(hunting): my global_id is 57643 2024-09-13T10:39:20.026 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1a00a8100 con 0x7fd1a00a6640 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198447725 0 0) 0x7fd1a00a4bc0 con 0x7fd1a00a8340 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient(hunting): my global_id is 164226 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1a013a320 con 0x7fd1a00a8340 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 846821646 0 0) 0x7fd188003520 con 0x7fd1a013f750 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 >> v1:172.21.15.195:6792/0 conn(0x7fd1a00a6640 legacy=0x7fd1a0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 >> v1:172.21.15.195:6790/0 conn(0x7fd1a00a8340 legacy=0x7fd1a0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient: _finish_hunting 0 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 1 monclient: found mon.noname-e 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:20.027 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a00a48e0 con 0x7fd1a013f750 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient: _finish_auth 0 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient: _check_auth_tickets 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd1a4d5d640 5 monclient: authenticate success, global_id 105677 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd198001e60 con 0x7fd1a013f750 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd1a4d5d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.020+0000 7fd19d59a640 10 monclient: dump: 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.028 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:20.029 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd1a4d5d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd198004c20 con 0x7fd1a013f750 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd19d59a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd1a4d5d640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd19d59a640 1 -- 172.21.15.181:0/274914652 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd198005190 con 0x7fd1a013f750 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd19d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd1a4d5d640 4 set_mon_vals no callback set 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd19d59a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd19d59a640 10 monclient: dump: 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:20.030 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd1a4d5d640 10 monclient: shutdown 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd1a4d5d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/274914652 >> v1:172.21.15.181:6793/0 conn(0x7fd1a013f750 legacy=0x7fd1a0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/274914652 shutdown_connections 2024-09-13T10:39:20.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/274914652 >> 172.21.15.181:0/274914652 conn(0x7fd1a0077170 msgr2=0x7fd1a00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/274914652 shutdown_connections 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.021+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/274914652 wait complete. 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.022+0000 7fd1a4d5d640 10 monclient: build_initial_monmap 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.022+0000 7fd1a4d5d640 10 monclient: monmap: 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:20.032 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.022+0000 7fd1a4d5d640 1 Processor -- start 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.022+0000 7fd1a4d5d640 1 -- start start 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.022+0000 7fd1a4d5d640 10 monclient: init 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd1a4d5d640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd1a4d5d640 10 monclient: _add_conns ranks=[1,8,4,5,0,7,6,2,3] 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd1a4d5d640 10 monclient(hunting): picked mon.noname-f con 0x7fd1a00a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd1a4d5d640 10 monclient(hunting): picked mon.noname-e con 0x7fd1a013f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:20.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd1a4d5d640 10 monclient(hunting): picked mon.noname-c con 0x7fd1a01d4720 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:20.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd1a4d5d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a00a9cb0 con 0x7fd1a00a8340 2024-09-13T10:39:20.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd1a4d5d640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a0134af0 con 0x7fd1a01d4720 2024-09-13T10:39:20.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd1a4d5d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a0138fd0 con 0x7fd1a013f750 2024-09-13T10:39:20.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd19ed9d640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7fd1a01d4720 legacy=0x7fd1a01d6b10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:20.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd1a4d5d640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:20.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd1a4d5d640 10 monclient(hunting): authenticate will time out at 1299.528350s 2024-09-13T10:39:20.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd19dd9b640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fd1a013f750 0x7fd1a01388c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:44740/0 (socket says 172.21.15.181:44740) 2024-09-13T10:39:20.034 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.023+0000 7fd19dd9b640 1 -- 172.21.15.181:0/3531627523 learned_addr learned my addr 172.21.15.181:0/3531627523 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd19dd9b640 1 -- 172.21.15.181:0/3531627523 >> v1:172.21.15.181:6793/0 conn(0x7fd1a013f750 legacy=0x7fd1a01388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd19e59c640 1 -- 172.21.15.181:0/3531627523 >> v1:172.21.15.195:6789/0 conn(0x7fd1a00a8340 legacy=0x7fd1a01ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3779383834 0 0) 0x7fd1a0138fd0 con 0x7fd1a013f750 2024-09-13T10:39:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 10 monclient(hunting): my global_id is 105686 2024-09-13T10:39:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd180003520 con 0x7fd1a013f750 2024-09-13T10:39:20.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2780945292 0 0) 0x7fd180003520 con 0x7fd1a013f750 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1a0138fd0 con 0x7fd1a013f750 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd194003610 con 0x7fd1a013f750 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 10 monclient(hunting): dump: 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:20.040 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4060436487 0 0) 0x7fd1a00a9cb0 con 0x7fd1a00a8340 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:20.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 10 monclient(hunting): my global_id is 134614 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.025+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd180003520 con 0x7fd1a00a8340 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1638809611 0 0) 0x7fd1a0138fd0 con 0x7fd1a013f750 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 >> v1:172.21.15.181:6791/0 conn(0x7fd1a01d4720 legacy=0x7fd1a01d6b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 >> v1:172.21.15.195:6789/0 conn(0x7fd1a00a8340 legacy=0x7fd1a01ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 1 monclient: found mon.e 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a013da10 con 0x7fd1a013f750 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 10 monclient: _finish_auth 0 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:20.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd1a4d5d640 5 monclient: authenticate success, global_id 105686 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd1a4d5d640 10 monclient: _renew_subs 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd1a4d5d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a01d8230 con 0x7fd1a013f750 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd1a4d5d640 10 monclient: _renew_subs 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd1a4d5d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fd1a01d85e0 con 0x7fd1a013f750 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd194003bc0 con 0x7fd1a013f750 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd1940040f0 con 0x7fd1a013f750 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd19cd99640 4 set_mon_vals no callback set 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:20.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 10 monclient: dump: 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:20.044 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd1a4d5d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd1840065c0 con 0x7fd184002860 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.026+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fd194004290 con 0x7fd1a013f750 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.027+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(285..285 src has 1..285) ==== 3898+0+0 (unknown 2129848869 0 0) 0x7fd19404e4f0 con 0x7fd1a013f750 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.027+0000 7fd19ed9d640 10 monclient: get_auth_request con 0x7fd18003faa0 auth_method 0 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd19e59c640 1 -- 172.21.15.181:0/3531627523 >> v1:172.21.15.181:6793/0 conn(0x7fd184002860 legacy=0x7fd184004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1421576472 0 0) 0x7fd1840065c0 con 0x7fd184002860 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:20.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 10 monclient(hunting): my global_id is 105695 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1a0138fd0 con 0x7fd184002860 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1397174231 0 0) 0x7fd1a0138fd0 con 0x7fd184002860 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1840065c0 con 0x7fd184002860 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd190001d20 con 0x7fd184002860 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 10 monclient: dump: 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:20.046 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2449631872 0 0) 0x7fd1840065c0 con 0x7fd184002860 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd18400a160 con 0x7fd184002860 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd1900057c0 con 0x7fd184002860 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:20.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 >> v1:172.21.15.181:6793/0 conn(0x7fd184002860 legacy=0x7fd184004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.029+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 >> v1:172.21.15.181:6793/0 conn(0x7fd184002860 legacy=0x7fd184004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.035+0000 7fd1a4d5d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:20.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.035+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd184009e50 con 0x7fd184009110 2024-09-13T10:39:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd19e59c640 1 -- 172.21.15.181:0/3531627523 >> v1:172.21.15.181:6793/0 conn(0x7fd184009110 legacy=0x7fd1840095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2949444088 0 0) 0x7fd184009e50 con 0x7fd184009110 2024-09-13T10:39:20.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 10 monclient(hunting): my global_id is 105704 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1840065c0 con 0x7fd184009110 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 868574879 0 0) 0x7fd1840065c0 con 0x7fd184009110 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd184009e50 con 0x7fd184009110 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fd190003d80 con 0x7fd184009110 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 10 monclient: dump: 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:20.050 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:20.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 879432924 0 0) 0x7fd184009e50 con 0x7fd184009110 2024-09-13T10:39:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.038+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd18400c3f0 con 0x7fd184009110 2024-09-13T10:39:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7516 (unknown 0 0 4212688441) 0x7fd190004080 con 0x7fd184009110 2024-09-13T10:39:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd18effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd18effd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 >> v1:172.21.15.181:6793/0 conn(0x7fd184009110 legacy=0x7fd1840095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:20.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd18effd640 1 -- 172.21.15.181:0/3531627523 >> v1:172.21.15.181:6793/0 conn(0x7fd184009110 legacy=0x7fd1840095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:20.052 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:20.052 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:20.052 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:20.052 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 136, 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 243742, 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:20.053 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:20.054 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:20.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:20.056 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:20.057 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:20.058 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:20.059 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:20.060 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.061 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:20.062 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:20.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:20.064 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:20.065 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:20.065 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:20.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.065 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:20.065 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:20.065 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:20.065 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:20.065 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:20.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.065 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:20.065 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:20.065 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:20.066 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:20.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:20.068 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:20.069 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:20.070 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:39:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:20.071 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:20.071 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:20.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/3531627523 >> v1:172.21.15.195:6800/1839191919 conn(0x7fd18003faa0 legacy=0x7fd180041f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:20.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd1a4d5d640 10 monclient: shutdown 2024-09-13T10:39:20.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd1a4d5d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:20.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/3531627523 >> v1:172.21.15.181:6793/0 conn(0x7fd1a013f750 legacy=0x7fd1a01388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:20.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd19ed9d640 1 -- 172.21.15.181:0/3531627523 reap_dead start 2024-09-13T10:39:20.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd19ed9d640 1 -- 172.21.15.181:0/3531627523 reap_dead start 2024-09-13T10:39:20.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/3531627523 shutdown_connections 2024-09-13T10:39:20.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/3531627523 >> 172.21.15.181:0/3531627523 conn(0x7fd1a00a6640 msgr2=0x7fd1a01308c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:20.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/3531627523 shutdown_connections 2024-09-13T10:39:20.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.039+0000 7fd1a4d5d640 1 -- 172.21.15.181:0/3531627523 wait complete. 2024-09-13T10:39:20.073 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-13T10:39:20.074 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon f 2024-09-13T10:39:20.074 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:39:20.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.169+0000 7f7934e0f640 10 monclient: get_monmap_and_config 2024-09-13T10:39:20.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.169+0000 7f7934e0f640 10 monclient: build_initial_monmap 2024-09-13T10:39:20.171 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.170+0000 7f7934e0f640 10 monclient: monmap: 2024-09-13T10:39:20.171 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:20.171 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:20.171 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:20.170605+0000 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:20.170605+0000 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:20.172 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:20.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.170+0000 7f7934e0f640 1 Processor -- start 2024-09-13T10:39:20.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.170+0000 7f7934e0f640 1 -- start start 2024-09-13T10:39:20.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.170+0000 7f7934e0f640 10 monclient: init 2024-09-13T10:39:20.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.171+0000 7f7934e0f640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:20.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.171+0000 7f7934e0f640 10 monclient: _add_conns ranks=[5,3,8,6,0,1,2,4,7] 2024-09-13T10:39:20.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.171+0000 7f7934e0f640 10 monclient(hunting): picked mon.noname-h con 0x7f79300a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:20.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.171+0000 7f7934e0f640 10 monclient(hunting): picked mon.noname-g con 0x7f79300a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:20.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.171+0000 7f7934e0f640 10 monclient(hunting): picked mon.noname-e con 0x7f793013f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:20.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.171+0000 7f7934e0f640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79300a4bc0 con 0x7f79300a8340 2024-09-13T10:39:20.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.171+0000 7f7934e0f640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793013a320 con 0x7f79300a6640 2024-09-13T10:39:20.174 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.171+0000 7f7934e0f640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79300a8100 con 0x7f793013f750 2024-09-13T10:39:20.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.171+0000 7f7934e0f640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:20.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.171+0000 7f7934e0f640 10 monclient(hunting): authenticate will time out at 1299.676298s 2024-09-13T10:39:20.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.171+0000 7f792ed9d640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f793013f750 0x7f7930141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:44774/0 (socket says 172.21.15.181:44774) 2024-09-13T10:39:20.175 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.171+0000 7f792ed9d640 1 -- 172.21.15.181:0/3883572332 learned_addr learned my addr 172.21.15.181:0/3883572332 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:20.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792ed9d640 1 -- 172.21.15.181:0/3883572332 >> v1:172.21.15.181:6793/0 conn(0x7f793013f750 legacy=0x7f7930141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:20.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792e59c640 1 -- 172.21.15.181:0/3883572332 >> v1:172.21.15.195:6791/0 conn(0x7f79300a6640 legacy=0x7f7930139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:20.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792dd9b640 1 -- 172.21.15.181:0/3883572332 >> v1:172.21.15.195:6790/0 conn(0x7f79300a8340 legacy=0x7f7930139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 1 -- 172.21.15.181:0/3883572332 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1737340093 0 0) 0x7f79300a8100 con 0x7f793013f750 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 10 monclient(hunting): _negotiate 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 10 monclient(hunting): my global_id is 105713 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 1 -- 172.21.15.181:0/3883572332 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7918003520 con 0x7f793013f750 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 1 -- 172.21.15.181:0/3883572332 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1673565548 0 0) 0x7f7918003520 con 0x7f793013f750 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 1 -- 172.21.15.181:0/3883572332 >> v1:172.21.15.195:6791/0 conn(0x7f79300a6640 legacy=0x7f7930139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 1 -- 172.21.15.181:0/3883572332 >> v1:172.21.15.195:6790/0 conn(0x7f79300a8340 legacy=0x7f7930139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 10 monclient: _finish_hunting 0 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 1 monclient: found mon.noname-e 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:20.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 1 -- 172.21.15.181:0/3883572332 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79300a48e0 con 0x7f793013f750 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 10 monclient: _finish_auth 0 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 10 monclient: _check_auth_tickets 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.173+0000 7f792d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f792d59a640 1 -- 172.21.15.181:0/3883572332 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7928001ae0 con 0x7f793013f750 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f7934e0f640 5 monclient: authenticate success, global_id 105713 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f7934e0f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f792d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f792d59a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f792d59a640 10 monclient: dump: 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:20.180 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:20.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f7934e0f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f792d59a640 1 -- 172.21.15.181:0/3883572332 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f79280048a0 con 0x7f793013f750 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f792d59a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f792d59a640 1 -- 172.21.15.181:0/3883572332 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7928004e10 con 0x7f793013f750 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f7934e0f640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f7934e0f640 4 set_mon_vals no callback set 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f792d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f792d59a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f792d59a640 10 monclient: dump: 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:20.182 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f7934e0f640 10 monclient: shutdown 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f7934e0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f7934e0f640 1 -- 172.21.15.181:0/3883572332 >> v1:172.21.15.181:6793/0 conn(0x7f793013f750 legacy=0x7f7930141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:20.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f7934e0f640 1 -- 172.21.15.181:0/3883572332 shutdown_connections 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f7934e0f640 1 -- 172.21.15.181:0/3883572332 >> 172.21.15.181:0/3883572332 conn(0x7f7930077170 msgr2=0x7f79300abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f7934e0f640 1 -- 172.21.15.181:0/3883572332 shutdown_connections 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.174+0000 7f7934e0f640 1 -- 172.21.15.181:0/3883572332 wait complete. 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.175+0000 7f7934e0f640 10 monclient: build_initial_monmap 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.175+0000 7f7934e0f640 10 monclient: monmap: 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:20.184 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.175+0000 7f7934e0f640 1 Processor -- start 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.175+0000 7f7934e0f640 1 -- start start 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.175+0000 7f7934e0f640 10 monclient: init 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f7934e0f640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f7934e0f640 10 monclient: _add_conns ranks=[2,6,4,5,3,1,7,0,8] 2024-09-13T10:39:20.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f7934e0f640 10 monclient(hunting): picked mon.noname-b con 0x7f79300a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:20.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f7934e0f640 10 monclient(hunting): picked mon.noname-d con 0x7f793013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:20.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f7934e0f640 10 monclient(hunting): picked mon.noname-c con 0x7f793013cef0 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:20.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f7934e0f640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7930134cf0 con 0x7f79300a8340 2024-09-13T10:39:20.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f792e59c640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f79300a8340 legacy=0x7f79301ce5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:20.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f7934e0f640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793013e0d0 con 0x7f793013cef0 2024-09-13T10:39:20.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f7934e0f640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7930134450 con 0x7f793013f750 2024-09-13T10:39:20.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f792dd9b640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f793013f750 legacy=0x7f79301d3580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:20.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f7934e0f640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:20.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f7934e0f640 10 monclient(hunting): authenticate will time out at 1299.681246s 2024-09-13T10:39:20.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.176+0000 7f792ed9d640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f793013cef0 legacy=0x7f79301d6cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:20.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.377+0000 7f792ed9d640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f793013cef0 legacy=0x7f79301d6cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:20.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.377+0000 7f792e59c640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f79300a8340 legacy=0x7f79301ce5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:20.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.377+0000 7f792dd9b640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f793013f750 legacy=0x7f79301d3580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:20.639 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40417]: starting. 2024-09-13T10:39:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40417]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40379 2024-09-13T10:39:20.640 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40417]: shutting down. 2024-09-13T10:39:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:20.641 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:39:20.644 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:39:20.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.778+0000 7f792dd9b640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f793013f750 legacy=0x7f79301d3580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:20.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.778+0000 7f792e59c640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f79300a8340 legacy=0x7f79301ce5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:20.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:20.778+0000 7f792ed9d640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f793013cef0 legacy=0x7f79301d6cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:21.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:21.579+0000 7f792dd9b640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f793013f750 legacy=0x7f79301d3580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:21.580 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:21.579+0000 7f792e59c640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f79300a8340 legacy=0x7f79301ce5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:21.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:21.579+0000 7f791effd640 1 -- DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:39:21.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:21.579+0000 7f792ed9d640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f793013cef0 legacy=0x7f79301d6cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:22.188 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40488]: starting. 2024-09-13T10:39:22.188 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40488]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40487 2024-09-13T10:39:22.188 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40488]: created object 0... 2024-09-13T10:39:22.188 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40488]: created object 25... 2024-09-13T10:39:22.188 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40488]: created object 49... 2024-09-13T10:39:22.188 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40488]: finishing. 2024-09-13T10:39:22.188 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40488]: shutting down. 2024-09-13T10:39:23.082 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40489]: starting. 2024-09-13T10:39:23.082 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40489]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40487 2024-09-13T10:39:23.082 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40489]: shutting down. 2024-09-13T10:39:23.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 10 monclient(hunting): tick 2024-09-13T10:39:23.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:39:23.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 1 monclient(hunting): continuing hunt 2024-09-13T10:39:23.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:39:23.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f793013f750 legacy=0x7f79301d3580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:23.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f793013cef0 legacy=0x7f79301d6cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:23.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f79300a8340 legacy=0x7f79301ce5a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:23.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 10 monclient: _add_conns ranks=[5,8,3,0,1,7] 2024-09-13T10:39:23.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 10 monclient(hunting): picked mon.noname-h con 0x7f7914003780 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:23.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 10 monclient(hunting): picked mon.noname-e con 0x7f7914007370 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:23.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 10 monclient(hunting): picked mon.noname-g con 0x7f791400b100 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:23.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793013e430 con 0x7f791400b100 2024-09-13T10:39:23.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7930134cf0 con 0x7f7914003780 2024-09-13T10:39:23.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793013e0d0 con 0x7f7914007370 2024-09-13T10:39:23.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f791dffb640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:23.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f792dd9b640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f7914007370 0x7f7914009830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:44782/0 (socket says 172.21.15.181:44782) 2024-09-13T10:39:23.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.176+0000 7f792dd9b640 1 -- 172.21.15.181:0/1979465784 learned_addr learned my addr 172.21.15.181:0/1979465784 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:23.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.178+0000 7f792dd9b640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.181:6793/0 conn(0x7f7914007370 legacy=0x7f7914009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:23.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280699088 0 0) 0x7f793013e0d0 con 0x7f7914007370 2024-09-13T10:39:23.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:23.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:23.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:23.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): my global_id is 105722 2024-09-13T10:39:23.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7910003550 con 0x7f7914007370 2024-09-13T10:39:23.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f792ed9d640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.195:6790/0 conn(0x7f791400b100 legacy=0x7f791400d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:23.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f792e59c640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.195:6791/0 conn(0x7f7914003780 legacy=0x7f7914005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:23.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 988859647 0 0) 0x7f793013e430 con 0x7f791400b100 2024-09-13T10:39:23.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:23.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:23.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:23.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): my global_id is 164262 2024-09-13T10:39:23.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f793013e0d0 con 0x7f791400b100 2024-09-13T10:39:23.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3500622958 0 0) 0x7f7930134cf0 con 0x7f7914003780 2024-09-13T10:39:23.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:23.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:23.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:23.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): my global_id is 105602 2024-09-13T10:39:23.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f793013e430 con 0x7f7914003780 2024-09-13T10:39:23.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 942568758 0 0) 0x7f7910003550 con 0x7f7914007370 2024-09-13T10:39:23.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7930134cf0 con 0x7f7914007370 2024-09-13T10:39:23.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7924003950 con 0x7f7914007370 2024-09-13T10:39:23.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:23.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:23.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): dump: 2024-09-13T10:39:23.186 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:23.186 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:23.186 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:23.186 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:23.187 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:23.187 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:23.187 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:23.187 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:23.187 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:23.187 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:23.187 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:23.187 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:23.187 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:23.187 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:23.187 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:23.187 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:23.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:23.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1305194536 0 0) 0x7f793013e430 con 0x7f7914003780 2024-09-13T10:39:23.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7910003550 con 0x7f7914003780 2024-09-13T10:39:23.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7920003990 con 0x7f7914003780 2024-09-13T10:39:23.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:23.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:23.188 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): dump: 2024-09-13T10:39:23.188 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:23.188 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:23.188 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:23.188 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:23.189 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:23.189 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:23.189 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:23.189 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:23.189 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:23.189 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:23.189 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:23.189 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:23.189 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:23.189 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:23.189 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:23.189 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2548239734 0 0) 0x7f793013e0d0 con 0x7f791400b100 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f793013e430 con 0x7f791400b100 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7928001a60 con 0x7f791400b100 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient(hunting): dump: 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:23.190 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1151699826 0 0) 0x7f7930134cf0 con 0x7f7914007370 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.195:6791/0 conn(0x7f7914003780 legacy=0x7f7914005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.195:6790/0 conn(0x7f791400b100 legacy=0x7f791400d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:23.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:23.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 monclient: found mon.e 2024-09-13T10:39:23.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:23.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f792ed9d640 1 -- 172.21.15.181:0/1979465784 reap_dead start 2024-09-13T10:39:23.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:23.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7930134450 con 0x7f7914007370 2024-09-13T10:39:23.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient: _finish_auth 0 2024-09-13T10:39:23.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:23.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f791effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:23.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f7934e0f640 5 monclient: authenticate success, global_id 105722 2024-09-13T10:39:23.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f7934e0f640 10 monclient: _renew_subs 2024-09-13T10:39:23.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f7934e0f640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f7934e0f640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f793013de30 con 0x7f7914007370 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.179+0000 7f7934e0f640 10 monclient: _renew_subs 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.180+0000 7f7934e0f640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.180+0000 7f7934e0f640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f79301ce5a0 con 0x7f7914007370 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.180+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7924001c60 con 0x7f7914007370 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.180+0000 7f791effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.180+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7924004210 con 0x7f7914007370 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.180+0000 7f791effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.180+0000 7f791effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.180+0000 7f791effd640 10 monclient: dump: 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:23.193 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:23.194 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:23.194 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:23.194 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:23.194 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:23.194 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:23.194 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:23.194 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:23.194 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:23.194 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:23.194 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:23.194 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:23.194 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:23.195 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:23.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.180+0000 7f792cd99640 4 set_mon_vals no callback set 2024-09-13T10:39:23.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.181+0000 7f7934e0f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:23.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.181+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7924011ca0 con 0x7f7914007370 2024-09-13T10:39:23.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.181+0000 7f7934e0f640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f79080065c0 con 0x7f7908002860 2024-09-13T10:39:23.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.181+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(289..289 src has 1..289) ==== 3506+0+0 (unknown 2194421268 0 0) 0x7f792404e2d0 con 0x7f7914007370 2024-09-13T10:39:23.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.181+0000 7f792ed9d640 10 monclient: get_auth_request con 0x7f7910040450 auth_method 0 2024-09-13T10:39:23.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.183+0000 7f792e59c640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.195:6789/0 conn(0x7f7908002860 legacy=0x7f7908004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:23.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.183+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3492566821 0 0) 0x7f79080065c0 con 0x7f7908002860 2024-09-13T10:39:23.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.183+0000 7f791effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:23.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.183+0000 7f791effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:23.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.183+0000 7f791effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:23.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.183+0000 7f791effd640 10 monclient(hunting): my global_id is 134650 2024-09-13T10:39:23.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.183+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7930134cf0 con 0x7f7908002860 2024-09-13T10:39:23.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3022928335 0 0) 0x7f7930134cf0 con 0x7f7908002860 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f79080065c0 con 0x7f7908002860 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7920004190 con 0x7f7908002860 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 10 monclient: dump: 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:23.199 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:23.200 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:23.200 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:23.200 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:23.200 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:23.200 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:23.200 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:23.200 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:23.200 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:23.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 562278183 0 0) 0x7f79080065c0 con 0x7f7908002860 2024-09-13T10:39:23.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f790800a160 con 0x7f7908002860 2024-09-13T10:39:23.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7920005b40 con 0x7f7908002860 2024-09-13T10:39:23.200 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.195:6789/0 conn(0x7f7908002860 legacy=0x7f7908004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.184+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.195:6789/0 conn(0x7f7908002860 legacy=0x7f7908004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.191+0000 7f7934e0f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.191+0000 7f7934e0f640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7908009e70 con 0x7f7908009130 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f792e59c640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.195:6789/0 conn(0x7f7908009130 legacy=0x7f79080095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174757594 0 0) 0x7f7908009e70 con 0x7f7908009130 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 10 monclient(hunting): my global_id is 134659 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79080065c0 con 0x7f7908009130 2024-09-13T10:39:23.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 470695385 0 0) 0x7f79080065c0 con 0x7f7908009130 2024-09-13T10:39:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7908009e70 con 0x7f7908009130 2024-09-13T10:39:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7920005cf0 con 0x7f7908009130 2024-09-13T10:39:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 10 monclient: dump: 2024-09-13T10:39:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:23.202 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.194+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 609150258 0 0) 0x7f7908009e70 con 0x7f7908009130 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f790800c410 con 0x7f7908009130 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7682 (unknown 0 0 2200649969) 0x7f7920007160 con 0x7f7908009130 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f791effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:23.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f791effd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.195:6789/0 conn(0x7f7908009130 legacy=0x7f79080095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:23.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f791effd640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.195:6789/0 conn(0x7f7908009130 legacy=0x7f79080095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:23.204 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:23.204 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:23.204 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:23.204 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:23.204 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 136, 2024-09-13T10:39:23.204 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 95224, 2024-09-13T10:39:23.204 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:23.204 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:23.205 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:23.206 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:23.207 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:23.208 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:23.209 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.210 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:23.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.211 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:23.211 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:23.211 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:23.211 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:23.211 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:23.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.211 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:23.211 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:23.211 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:23.211 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:23.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.213 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:23.214 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:23.215 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:23.216 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:23.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:23.218 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:23.219 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:23.220 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:23.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:23.222 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:39:23.223 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:23.224 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:23.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:23.224 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:23.224 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:23.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f7934e0f640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7910040450 legacy=0x7f7910042910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:23.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f7934e0f640 10 monclient: shutdown 2024-09-13T10:39:23.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f7934e0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:23.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f7934e0f640 1 -- 172.21.15.181:0/1979465784 >> v1:172.21.15.181:6793/0 conn(0x7f7914007370 legacy=0x7f7914009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:23.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f7934e0f640 1 -- 172.21.15.181:0/1979465784 shutdown_connections 2024-09-13T10:39:23.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f7934e0f640 1 -- 172.21.15.181:0/1979465784 >> 172.21.15.181:0/1979465784 conn(0x7f79300a6640 msgr2=0x7f79300a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:23.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.195+0000 7f7934e0f640 1 -- 172.21.15.181:0/1979465784 shutdown_connections 2024-09-13T10:39:23.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.196+0000 7f7934e0f640 1 -- 172.21.15.181:0/1979465784 wait complete. 2024-09-13T10:39:23.226 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-13T10:39:23.226 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon g 2024-09-13T10:39:23.227 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:39:23.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.331+0000 7f6be72cd640 10 monclient: get_monmap_and_config 2024-09-13T10:39:23.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.331+0000 7f6be72cd640 10 monclient: build_initial_monmap 2024-09-13T10:39:23.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.331+0000 7f6be72cd640 10 monclient: monmap: 2024-09-13T10:39:23.333 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:23.333 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:23.333 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:23.332318+0000 2024-09-13T10:39:23.333 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:23.332318+0000 2024-09-13T10:39:23.333 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:23.334 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:23.334 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:23.334 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:23.334 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:23.334 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:23.334 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:23.334 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:23.334 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:23.334 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:23.334 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:23.334 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.332+0000 7f6be72cd640 1 Processor -- start 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.332+0000 7f6be72cd640 1 -- start start 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.332+0000 7f6be72cd640 10 monclient: init 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.332+0000 7f6be72cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.332+0000 7f6be72cd640 10 monclient: _add_conns ranks=[2,4,6,8,5,7,1,0,3] 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.332+0000 7f6be72cd640 10 monclient(hunting): picked mon.noname-b con 0x7f6be00a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.332+0000 7f6be72cd640 10 monclient(hunting): picked mon.noname-c con 0x7f6be00a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.332+0000 7f6be72cd640 10 monclient(hunting): picked mon.noname-d con 0x7f6be013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.332+0000 7f6be72cd640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be00a4bc0 con 0x7f6be00a6640 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.333+0000 7f6be72cd640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be013a320 con 0x7f6be00a8340 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.333+0000 7f6be72cd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be00a8100 con 0x7f6be013f750 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.333+0000 7f6be72cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:23.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.333+0000 7f6be72cd640 10 monclient(hunting): authenticate will time out at 1302.838035s 2024-09-13T10:39:23.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.333+0000 7f6be4868640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f6be00a8340 legacy=0x7f6be0139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:23.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.333+0000 7f6be5069640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f6be00a6640 legacy=0x7f6be0139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:23.337 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.333+0000 7f6be586a640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f6be013f750 legacy=0x7f6be0141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:23.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.534+0000 7f6be4868640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f6be00a8340 legacy=0x7f6be0139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:23.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.534+0000 7f6be5069640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f6be00a6640 legacy=0x7f6be0139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:23.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.534+0000 7f6be586a640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f6be013f750 legacy=0x7f6be0141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:23.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.936+0000 7f6be586a640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f6be013f750 legacy=0x7f6be0141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:23.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.936+0000 7f6be5069640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f6be00a6640 legacy=0x7f6be0139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:23.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:23.936+0000 7f6be4868640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f6be00a8340 legacy=0x7f6be0139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:24.737+0000 7f6be4868640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f6be00a8340 legacy=0x7f6be0139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:24.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:24.737+0000 7f6be5069640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f6be00a6640 legacy=0x7f6be0139500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:24.737+0000 7f6be586a640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f6be013f750 legacy=0x7f6be0141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:24.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:24.737+0000 7f6bd7fff640 1 -- DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:39:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 10 monclient(hunting): tick 2024-09-13T10:39:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:39:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 1 monclient(hunting): continuing hunt 2024-09-13T10:39:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:39:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f6be013f750 legacy=0x7f6be0141b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:39:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7f6be00a8340 legacy=0x7f6be0139c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:39:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7f6be00a6640 legacy=0x7f6be0139500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:39:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 10 monclient: _add_conns ranks=[5,3,8,7,0,1] 2024-09-13T10:39:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 10 monclient(hunting): picked mon.noname-h con 0x7f6bc4003780 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:26.335 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 10 monclient(hunting): picked mon.noname-g con 0x7f6bc4007410 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 10 monclient(hunting): picked mon.noname-e con 0x7f6bc400b1a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be00a48e0 con 0x7f6bc4007410 2024-09-13T10:39:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be00a4bc0 con 0x7f6bc4003780 2024-09-13T10:39:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be013a320 con 0x7f6bc400b1a0 2024-09-13T10:39:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6bd6ffd640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6be586a640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f6bc400b1a0 0x7f6bc400d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:48964/0 (socket says 172.21.15.181:48964) 2024-09-13T10:39:26.336 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.333+0000 7f6be586a640 1 -- 172.21.15.181:0/2742665442 learned_addr learned my addr 172.21.15.181:0/2742665442 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.335+0000 7f6be586a640 1 -- 172.21.15.181:0/2742665442 >> v1:172.21.15.181:6793/0 conn(0x7f6bc400b1a0 legacy=0x7f6bc400d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.335+0000 7f6be4868640 1 -- 172.21.15.181:0/2742665442 >> v1:172.21.15.195:6790/0 conn(0x7f6bc4007410 legacy=0x7f6bc40098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.335+0000 7f6be5069640 1 -- 172.21.15.181:0/2742665442 >> v1:172.21.15.195:6791/0 conn(0x7f6bc4003780 legacy=0x7f6bc4005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.335+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1976982938 0 0) 0x7f6be013a320 con 0x7f6bc400b1a0 2024-09-13T10:39:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.335+0000 7f6bd7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.335+0000 7f6bd7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.335+0000 7f6bd7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.335+0000 7f6bd7fff640 10 monclient(hunting): my global_id is 105749 2024-09-13T10:39:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bcc003520 con 0x7f6bc400b1a0 2024-09-13T10:39:26.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537152174 0 0) 0x7f6be00a48e0 con 0x7f6bc4007410 2024-09-13T10:39:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient(hunting): my global_id is 164280 2024-09-13T10:39:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6be013a320 con 0x7f6bc4007410 2024-09-13T10:39:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268866559 0 0) 0x7f6be00a4bc0 con 0x7f6bc4003780 2024-09-13T10:39:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient(hunting): my global_id is 105620 2024-09-13T10:39:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6be00a48e0 con 0x7f6bc4003780 2024-09-13T10:39:26.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 890922229 0 0) 0x7f6bcc003520 con 0x7f6bc400b1a0 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 >> v1:172.21.15.195:6791/0 conn(0x7f6bc4003780 legacy=0x7f6bc4005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 >> v1:172.21.15.195:6790/0 conn(0x7f6bc4007410 legacy=0x7f6bc40098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient: _finish_hunting 0 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 monclient: found mon.noname-e 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be00a8100 con 0x7f6bc400b1a0 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient: _finish_auth 0 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient: _check_auth_tickets 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6bd8004880 con 0x7f6bc400b1a0 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6be586a640 1 -- 172.21.15.181:0/2742665442 reap_dead start 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient: dump: 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.342 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6be72cd640 5 monclient: authenticate success, global_id 105749 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6be72cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6bd8004ad0 con 0x7f6bc400b1a0 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 1 -- 172.21.15.181:0/2742665442 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6bd8004c80 con 0x7f6bc400b1a0 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6be72cd640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6be72cd640 4 set_mon_vals no callback set 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:26.343 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.336+0000 7f6bd7fff640 10 monclient: dump: 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.344 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.345 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.337+0000 7f6be72cd640 10 monclient: shutdown 2024-09-13T10:39:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.337+0000 7f6be72cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.337+0000 7f6be72cd640 1 -- 172.21.15.181:0/2742665442 >> v1:172.21.15.181:6793/0 conn(0x7f6bc400b1a0 legacy=0x7f6bc400d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.337+0000 7f6be72cd640 1 -- 172.21.15.181:0/2742665442 shutdown_connections 2024-09-13T10:39:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.337+0000 7f6be72cd640 1 -- 172.21.15.181:0/2742665442 >> 172.21.15.181:0/2742665442 conn(0x7f6be0077170 msgr2=0x7f6be00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.337+0000 7f6be72cd640 1 -- 172.21.15.181:0/2742665442 shutdown_connections 2024-09-13T10:39:26.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.337+0000 7f6be72cd640 1 -- 172.21.15.181:0/2742665442 wait complete. 2024-09-13T10:39:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.338+0000 7f6be72cd640 10 monclient: build_initial_monmap 2024-09-13T10:39:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.338+0000 7f6be72cd640 10 monclient: monmap: 2024-09-13T10:39:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:26.351 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.338+0000 7f6be72cd640 1 Processor -- start 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.338+0000 7f6be72cd640 1 -- start start 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.338+0000 7f6be72cd640 10 monclient: init 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be72cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be72cd640 10 monclient: _add_conns ranks=[6,3,8,4,1,5,7,2,0] 2024-09-13T10:39:26.352 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be72cd640 10 monclient(hunting): picked mon.noname-d con 0x7f6be01366b0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be72cd640 10 monclient(hunting): picked mon.noname-g con 0x7f6be01d0ea0 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be72cd640 10 monclient(hunting): picked mon.noname-e con 0x7f6be01d49b0 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be72cd640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be01cea00 con 0x7f6be01d0ea0 2024-09-13T10:39:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be5069640 1 -- >> v1:172.21.15.181:6792/0 conn(0x7f6be01366b0 legacy=0x7f6be0136a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6792/0 2024-09-13T10:39:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be72cd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be00a0dc0 con 0x7f6be01366b0 2024-09-13T10:39:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be72cd640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6be00aa160 con 0x7f6be01d49b0 2024-09-13T10:39:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be72cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be72cd640 10 monclient(hunting): authenticate will time out at 1305.844436s 2024-09-13T10:39:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be586a640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f6be01d49b0 0x7f6be01d6da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:48980/0 (socket says 172.21.15.181:48980) 2024-09-13T10:39:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.339+0000 7f6be586a640 1 -- 172.21.15.181:0/2041817514 learned_addr learned my addr 172.21.15.181:0/2041817514 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.341+0000 7f6be586a640 1 -- 172.21.15.181:0/2041817514 >> v1:172.21.15.181:6793/0 conn(0x7f6be01d49b0 legacy=0x7f6be01d6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.353 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.341+0000 7f6be4868640 1 -- 172.21.15.181:0/2041817514 >> v1:172.21.15.195:6790/0 conn(0x7f6be01d0ea0 legacy=0x7f6be01d3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.341+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.343+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 400970394 0 0) 0x7f6be00a8100 con 0x7f6be01d49b0 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.343+0000 7f6bd5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.343+0000 7f6bd5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.343+0000 7f6bd5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.343+0000 7f6bd5ffb640 10 monclient(hunting): my global_id is 105758 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.343+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bc4011730 con 0x7f6be01d49b0 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810728303 0 0) 0x7f6be01cea00 con 0x7f6be01d0ea0 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient(hunting): my global_id is 164289 2024-09-13T10:39:26.354 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6be00a8100 con 0x7f6be01d0ea0 2024-09-13T10:39:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3081029776 0 0) 0x7f6be00a8100 con 0x7f6be01d0ea0 2024-09-13T10:39:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6be01cea00 con 0x7f6be01d0ea0 2024-09-13T10:39:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6bd0004670 con 0x7f6be01d0ea0 2024-09-13T10:39:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-13T10:39:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient(hunting): dump: 2024-09-13T10:39:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.355 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2322338991 0 0) 0x7f6bc4011730 con 0x7f6be01d49b0 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6be00a8100 con 0x7f6be01d49b0 2024-09-13T10:39:26.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6bd8004fc0 con 0x7f6be01d49b0 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient(hunting): dump: 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.357 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.358 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2713287657 0 0) 0x7f6be01cea00 con 0x7f6be01d0ea0 2024-09-13T10:39:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 >> v1:172.21.15.181:6793/0 conn(0x7f6be01d49b0 legacy=0x7f6be01d6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 >> v1:172.21.15.181:6792/0 conn(0x7f6be01366b0 legacy=0x7f6be0136a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:39:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 monclient: found mon.g 2024-09-13T10:39:26.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be00a2480 con 0x7f6be01d0ea0 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient: _finish_auth 0 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6be72cd640 5 monclient: authenticate success, global_id 164289 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6be72cd640 10 monclient: _renew_subs 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6be72cd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6be72cd640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6be00a2760 con 0x7f6be01d0ea0 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6bd0004ac0 con 0x7f6be01d0ea0 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6bd0004fb0 con 0x7f6be01d0ea0 2024-09-13T10:39:26.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd5ffb640 10 monclient: dump: 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.360 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.344+0000 7f6bd77fe640 4 set_mon_vals no callback set 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.345+0000 7f6be72cd640 10 monclient: _renew_subs 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.345+0000 7f6be72cd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.195:6790/0 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.345+0000 7f6be72cd640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6be013e7d0 con 0x7f6be01d0ea0 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.345+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6bd0005250 con 0x7f6be01d0ea0 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.346+0000 7f6be72cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.346+0000 7f6be72cd640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6be00a29a0 con 0x7f6be0077170 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.346+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 8 ==== osd_map(289..289 src has 1..289) ==== 3506+0+0 (unknown 2194421268 0 0) 0x7f6bd004e0b0 con 0x7f6be01d0ea0 2024-09-13T10:39:26.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.346+0000 7f6be5069640 10 monclient: get_auth_request con 0x7f6bc4041120 auth_method 0 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.348+0000 7f6be586a640 1 -- 172.21.15.181:0/2041817514 >> v1:172.21.15.195:6790/0 conn(0x7f6be0077170 legacy=0x7f6be01376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.348+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707984049 0 0) 0x7f6be00a29a0 con 0x7f6be0077170 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.348+0000 7f6bd5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.348+0000 7f6bd5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.348+0000 7f6bd5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.348+0000 7f6bd5ffb640 10 monclient(hunting): my global_id is 164298 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.348+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6be01cea00 con 0x7f6be0077170 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3623291736 0 0) 0x7f6be01cea00 con 0x7f6be0077170 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6be00a29a0 con 0x7f6be0077170 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6bd8004ad0 con 0x7f6be0077170 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 10 monclient: dump: 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.362 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.363 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.364 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 605004183 0 0) 0x7f6be00a29a0 con 0x7f6be0077170 2024-09-13T10:39:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6be0139500 con 0x7f6be0077170 2024-09-13T10:39:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6bd8005660 con 0x7f6be0077170 2024-09-13T10:39:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 >> v1:172.21.15.195:6790/0 conn(0x7f6be0077170 legacy=0x7f6be01376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.349+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 >> v1:172.21.15.195:6790/0 conn(0x7f6be0077170 legacy=0x7f6be01376f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:26.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.356+0000 7f6be72cd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.356+0000 7f6be72cd640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6be01cddc0 con 0x7f6be0069b40 2024-09-13T10:39:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.358+0000 7f6be586a640 1 -- 172.21.15.181:0/2041817514 >> v1:172.21.15.195:6790/0 conn(0x7f6be0069b40 legacy=0x7f6be0137e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722638237 0 0) 0x7f6be01cddc0 con 0x7f6be0069b40 2024-09-13T10:39:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 10 monclient(hunting): my global_id is 164307 2024-09-13T10:39:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6be00a29a0 con 0x7f6be0069b40 2024-09-13T10:39:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1615973335 0 0) 0x7f6be00a29a0 con 0x7f6be0069b40 2024-09-13T10:39:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6be01cddc0 con 0x7f6be0069b40 2024-09-13T10:39:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6bd8005d80 con 0x7f6be0069b40 2024-09-13T10:39:26.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 10 monclient: dump: 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.367 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.368 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 722431921 0 0) 0x7f6be01cddc0 con 0x7f6be0069b40 2024-09-13T10:39:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.359+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6be0138510 con 0x7f6be0069b40 2024-09-13T10:39:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7515 (unknown 0 0 3131072425) 0x7f6bd80080c0 con 0x7f6be0069b40 2024-09-13T10:39:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6bd5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6bd5ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 >> v1:172.21.15.195:6790/0 conn(0x7f6be0069b40 legacy=0x7f6be0137e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6bd5ffb640 1 -- 172.21.15.181:0/2041817514 >> v1:172.21.15.195:6790/0 conn(0x7f6be0069b40 legacy=0x7f6be0137e00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:26.369 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:26.369 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:26.369 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:26.369 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:26.369 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 136, 2024-09-13T10:39:26.369 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 45818, 2024-09-13T10:39:26.369 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:26.369 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:26.369 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:26.369 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:26.369 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:26.370 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:26.370 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.370 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 6, 2024-09-13T10:39:26.370 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:26.370 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:26.370 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:26.370 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:26.370 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:26.370 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:26.370 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:26.371 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:26.372 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:26.372 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:26.372 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:26.372 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:26.372 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:26.372 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:26.372 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:26.372 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:26.373 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:26.374 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:26.375 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.376 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.378 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.379 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:26.380 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.381 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.381 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.381 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:26.381 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.381 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.381 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.381 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:26.381 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:26.381 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.382 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.382 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.382 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:26.382 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:26.382 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.382 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.382 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.382 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:26.383 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.384 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.385 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.387 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:26.388 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6be72cd640 1 -- 172.21.15.181:0/2041817514 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6bc4041120 legacy=0x7f6bc40435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6be72cd640 10 monclient: shutdown 2024-09-13T10:39:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6be72cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6be72cd640 1 -- 172.21.15.181:0/2041817514 >> v1:172.21.15.195:6790/0 conn(0x7f6be01d0ea0 legacy=0x7f6be01d3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6be586a640 1 -- 172.21.15.181:0/2041817514 reap_dead start 2024-09-13T10:39:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6be586a640 1 -- 172.21.15.181:0/2041817514 reap_dead start 2024-09-13T10:39:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6be72cd640 1 -- 172.21.15.181:0/2041817514 shutdown_connections 2024-09-13T10:39:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6be72cd640 1 -- 172.21.15.181:0/2041817514 >> 172.21.15.181:0/2041817514 conn(0x7f6bc400b1a0 msgr2=0x7f6be00aa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:26.390 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6be72cd640 1 -- 172.21.15.181:0/2041817514 shutdown_connections 2024-09-13T10:39:26.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.360+0000 7f6be72cd640 1 -- 172.21.15.181:0/2041817514 wait complete. 2024-09-13T10:39:26.391 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-13T10:39:26.391 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon h 2024-09-13T10:39:26.391 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:39:26.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.495+0000 7fc46abaa640 10 monclient: get_monmap_and_config 2024-09-13T10:39:26.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.495+0000 7fc46abaa640 10 monclient: build_initial_monmap 2024-09-13T10:39:26.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.496+0000 7fc46abaa640 10 monclient: monmap: 2024-09-13T10:39:26.497 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:26.497 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.497 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:26.496589+0000 2024-09-13T10:39:26.497 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:26.496589+0000 2024-09-13T10:39:26.497 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:26.498 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.498 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:26.498 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:26.498 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:26.498 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:26.498 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:26.498 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:26.498 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:26.498 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:26.498 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:26.498 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.499 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.496+0000 7fc46abaa640 1 Processor -- start 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.496+0000 7fc46abaa640 1 -- start start 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.496+0000 7fc46abaa640 10 monclient: init 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc46abaa640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc46abaa640 10 monclient: _add_conns ranks=[7,2,4,8,5,0,1,3,6] 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc46abaa640 10 monclient(hunting): picked mon.noname-i con 0x7fc4640a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc46abaa640 10 monclient(hunting): picked mon.noname-b con 0x7fc4640a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc46abaa640 10 monclient(hunting): picked mon.noname-c con 0x7fc46413f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc46abaa640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4640a4bc0 con 0x7fc4640a8340 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc46abaa640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46413a320 con 0x7fc46413f750 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc46abaa640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4640a8100 con 0x7fc4640a6640 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc46abaa640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc46abaa640 10 monclient(hunting): authenticate will time out at 1306.002348s 2024-09-13T10:39:26.500 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc469147640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7fc46413f750 legacy=0x7fc464141b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:26.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc463fff640 1 -- >> v1:172.21.15.181:6790/0 conn(0x7fc4640a8340 legacy=0x7fc464139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:26.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc468946640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7fc4640a6640 0x7fc464139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:40130/0 (socket says 172.21.15.181:40130) 2024-09-13T10:39:26.501 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.497+0000 7fc468946640 1 -- 172.21.15.181:0/3925715087 learned_addr learned my addr 172.21.15.181:0/3925715087 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.499+0000 7fc468946640 1 -- 172.21.15.181:0/3925715087 >> v1:172.21.15.195:6792/0 conn(0x7fc4640a6640 legacy=0x7fc464139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 1 -- 172.21.15.181:0/3925715087 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1650146832 0 0) 0x7fc4640a8100 con 0x7fc4640a6640 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient(hunting): my global_id is 57670 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 1 -- 172.21.15.181:0/3925715087 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc44c003520 con 0x7fc4640a6640 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 1 -- 172.21.15.181:0/3925715087 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 878324550 0 0) 0x7fc44c003520 con 0x7fc4640a6640 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 1 -- 172.21.15.181:0/3925715087 >> v1:172.21.15.181:6791/0 conn(0x7fc46413f750 legacy=0x7fc464141b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 1 -- 172.21.15.181:0/3925715087 >> v1:172.21.15.181:6790/0 conn(0x7fc4640a8340 legacy=0x7fc464139c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 1 monclient: found mon.noname-i 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:26.503 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 1 -- 172.21.15.181:0/3925715087 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4640a48e0 con 0x7fc4640a6640 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 1 -- 172.21.15.181:0/3925715087 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc454001ae0 con 0x7fc4640a6640 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient: dump: 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.504 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.505 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.505 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.505 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.505 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.505 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.505 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.508 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.508 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.508 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc46abaa640 5 monclient: authenticate success, global_id 57670 2024-09-13T10:39:26.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc46abaa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:26.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 1 -- 172.21.15.181:0/3925715087 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4540048a0 con 0x7fc4640a6640 2024-09-13T10:39:26.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:26.508 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 1 -- 172.21.15.181:0/3925715087 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc454004e10 con 0x7fc4640a6640 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc4637fe640 10 monclient: dump: 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.509 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc46abaa640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.500+0000 7fc46abaa640 4 set_mon_vals no callback set 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.501+0000 7fc46abaa640 10 monclient: shutdown 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.501+0000 7fc46abaa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.501+0000 7fc46abaa640 1 -- 172.21.15.181:0/3925715087 >> v1:172.21.15.195:6792/0 conn(0x7fc4640a6640 legacy=0x7fc464139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.501+0000 7fc46abaa640 1 -- 172.21.15.181:0/3925715087 shutdown_connections 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.501+0000 7fc46abaa640 1 -- 172.21.15.181:0/3925715087 >> 172.21.15.181:0/3925715087 conn(0x7fc464077170 msgr2=0x7fc4640abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:26.510 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.501+0000 7fc46abaa640 1 -- 172.21.15.181:0/3925715087 shutdown_connections 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.501+0000 7fc46abaa640 1 -- 172.21.15.181:0/3925715087 wait complete. 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.501+0000 7fc46abaa640 10 monclient: build_initial_monmap 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.501+0000 7fc46abaa640 10 monclient: monmap: 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:26.511 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:26.512 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:26.512 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:26.512 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:26.512 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 1 Processor -- start 2024-09-13T10:39:26.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 1 -- start start 2024-09-13T10:39:26.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 10 monclient: init 2024-09-13T10:39:26.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:26.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 10 monclient: _add_conns ranks=[7,5,4,3,2,8,1,0,6] 2024-09-13T10:39:26.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 10 monclient(hunting): picked mon.noname-i con 0x7fc4640a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:26.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 10 monclient(hunting): picked mon.noname-h con 0x7fc46413f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:26.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 10 monclient(hunting): picked mon.noname-c con 0x7fc4641d43a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:26.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4640a1150 con 0x7fc4641d43a0 2024-09-13T10:39:26.517 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4640a9bd0 con 0x7fc46413f750 2024-09-13T10:39:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc464142d80 con 0x7fc4640a8340 2024-09-13T10:39:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc46abaa640 10 monclient(hunting): authenticate will time out at 1306.007926s 2024-09-13T10:39:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.502+0000 7fc469147640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7fc4641d43a0 legacy=0x7fc4641d6790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.503+0000 7fc468946640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7fc4640a8340 0x7fc46409d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:40146/0 (socket says 172.21.15.181:40146) 2024-09-13T10:39:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.503+0000 7fc468946640 1 -- 172.21.15.181:0/2343493141 learned_addr learned my addr 172.21.15.181:0/2343493141 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.503+0000 7fc463fff640 1 --1- 172.21.15.181:0/2343493141 >> v1:172.21.15.195:6791/0 conn(0x7fc46413f750 0x7fc46409dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:59236/0 (socket says 172.21.15.181:59236) 2024-09-13T10:39:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc468946640 1 -- 172.21.15.181:0/2343493141 >> v1:172.21.15.195:6792/0 conn(0x7fc4640a8340 legacy=0x7fc46409d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc463fff640 1 -- 172.21.15.181:0/2343493141 >> v1:172.21.15.195:6791/0 conn(0x7fc46413f750 legacy=0x7fc46409dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555486378 0 0) 0x7fc464142d80 con 0x7fc4640a8340 2024-09-13T10:39:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 10 monclient(hunting): my global_id is 57679 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc450003520 con 0x7fc4640a8340 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414168655 0 0) 0x7fc4640a9bd0 con 0x7fc46413f750 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 10 monclient(hunting): my global_id is 105629 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc464142d80 con 0x7fc46413f750 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2831590 0 0) 0x7fc450003520 con 0x7fc4640a8340 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4640a9bd0 con 0x7fc4640a8340 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc454004d90 con 0x7fc4640a8340 2024-09-13T10:39:26.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 10 monclient(hunting): dump: 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.520 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.505+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3783319826 0 0) 0x7fc464142d80 con 0x7fc46413f750 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc450003520 con 0x7fc46413f750 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc4580045e0 con 0x7fc46413f750 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 10 monclient(hunting): dump: 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.521 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.522 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3368256979 0 0) 0x7fc4640a9bd0 con 0x7fc4640a8340 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 >> v1:172.21.15.195:6791/0 conn(0x7fc46413f750 legacy=0x7fc46409dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 >> v1:172.21.15.181:6791/0 conn(0x7fc4641d43a0 legacy=0x7fc4641d6790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 10 monclient: _finish_hunting 0 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 1 monclient: found mon.i 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4640a02e0 con 0x7fc4640a8340 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 10 monclient: _finish_auth 0 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 10 monclient: _check_auth_tickets 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc46abaa640 5 monclient: authenticate success, global_id 57679 2024-09-13T10:39:26.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc46abaa640 10 monclient: _renew_subs 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc46abaa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc46abaa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc46409edf0 con 0x7fc4640a8340 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc46abaa640 10 monclient: _renew_subs 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc46abaa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc46abaa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc4640a0e70 con 0x7fc4640a8340 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4540048a0 con 0x7fc4640a8340 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc4540015e0 con 0x7fc4640a8340 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc462ffd640 4 set_mon_vals no callback set 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc4617fa640 10 monclient: dump: 2024-09-13T10:39:26.524 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.525 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc46abaa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.506+0000 7fc46abaa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc4440065c0 con 0x7fc444002860 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.507+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fc454011c20 con 0x7fc4640a8340 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.507+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(289..289 src has 1..289) ==== 3506+0+0 (unknown 2194421268 0 0) 0x7fc45404e2c0 con 0x7fc4640a8340 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.507+0000 7fc469147640 10 monclient: get_auth_request con 0x7fc450040060 auth_method 0 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc463fff640 1 -- 172.21.15.181:0/2343493141 >> v1:172.21.15.195:6791/0 conn(0x7fc444002860 legacy=0x7fc444004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966251179 0 0) 0x7fc4440065c0 con 0x7fc444002860 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 10 monclient(hunting): my global_id is 105638 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4640a9bd0 con 0x7fc444002860 2024-09-13T10:39:26.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1702975975 0 0) 0x7fc4640a9bd0 con 0x7fc444002860 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4440065c0 con 0x7fc444002860 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc458004e00 con 0x7fc444002860 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 10 monclient: dump: 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.527 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4076460443 0 0) 0x7fc4440065c0 con 0x7fc444002860 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.509+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc44400a160 con 0x7fc444002860 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.510+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc458007120 con 0x7fc444002860 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.510+0000 7fc4617fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.510+0000 7fc4617fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.510+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 >> v1:172.21.15.195:6791/0 conn(0x7fc444002860 legacy=0x7fc444004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.528 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.510+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 >> v1:172.21.15.195:6791/0 conn(0x7fc444002860 legacy=0x7fc444004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:26.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.516+0000 7fc46abaa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:26.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.516+0000 7fc46abaa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc444009e50 con 0x7fc444009110 2024-09-13T10:39:26.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.518+0000 7fc463fff640 1 -- 172.21.15.181:0/2343493141 >> v1:172.21.15.195:6791/0 conn(0x7fc444009110 legacy=0x7fc4440095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.518+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378525070 0 0) 0x7fc444009e50 con 0x7fc444009110 2024-09-13T10:39:26.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.518+0000 7fc4617fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.518+0000 7fc4617fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.530 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.518+0000 7fc4617fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.518+0000 7fc4617fa640 10 monclient(hunting): my global_id is 105647 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.518+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4440065c0 con 0x7fc444009110 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4228905292 0 0) 0x7fc4440065c0 con 0x7fc444009110 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc444009e50 con 0x7fc444009110 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fc458006800 con 0x7fc444009110 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 10 monclient: dump: 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.531 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3771397021 0 0) 0x7fc444009e50 con 0x7fc444009110 2024-09-13T10:39:26.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc44400c3f0 con 0x7fc444009110 2024-09-13T10:39:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7683 (unknown 0 0 1286665290) 0x7fc45800a110 con 0x7fc444009110 2024-09-13T10:39:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 >> v1:172.21.15.195:6791/0 conn(0x7fc444009110 legacy=0x7fc4440095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.519+0000 7fc4617fa640 1 -- 172.21.15.181:0/2343493141 >> v1:172.21.15.195:6791/0 conn(0x7fc444009110 legacy=0x7fc4440095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:26.533 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:26.533 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:26.533 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:26.533 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:26.533 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 136, 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 250218, 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 6, 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:26.534 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:26.535 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:26.536 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:26.537 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.538 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.539 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.541 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:26.542 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.543 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.544 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:26.545 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.546 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:26.547 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.548 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.549 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:26.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.551 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:26.552 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.520+0000 7fc46abaa640 1 -- 172.21.15.181:0/2343493141 >> v1:172.21.15.195:6800/1839191919 conn(0x7fc450040060 legacy=0x7fc450042520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.520+0000 7fc46abaa640 10 monclient: shutdown 2024-09-13T10:39:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.520+0000 7fc46abaa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.520+0000 7fc46abaa640 1 -- 172.21.15.181:0/2343493141 >> v1:172.21.15.195:6792/0 conn(0x7fc4640a8340 legacy=0x7fc46409d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.520+0000 7fc469147640 1 -- 172.21.15.181:0/2343493141 reap_dead start 2024-09-13T10:39:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.520+0000 7fc469147640 1 -- 172.21.15.181:0/2343493141 reap_dead start 2024-09-13T10:39:26.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.520+0000 7fc46abaa640 1 -- 172.21.15.181:0/2343493141 shutdown_connections 2024-09-13T10:39:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.520+0000 7fc46abaa640 1 -- 172.21.15.181:0/2343493141 >> 172.21.15.181:0/2343493141 conn(0x7fc4640a6640 msgr2=0x7fc464141dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.520+0000 7fc46abaa640 1 -- 172.21.15.181:0/2343493141 shutdown_connections 2024-09-13T10:39:26.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.520+0000 7fc46abaa640 1 -- 172.21.15.181:0/2343493141 wait complete. 2024-09-13T10:39:26.554 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-13T10:39:26.554 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon i 2024-09-13T10:39:26.554 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:39:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.651+0000 7fdbf2165640 10 monclient: get_monmap_and_config 2024-09-13T10:39:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.651+0000 7fdbf2165640 10 monclient: build_initial_monmap 2024-09-13T10:39:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.651+0000 7fdbf2165640 10 monclient: monmap: 2024-09-13T10:39:26.652 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:26.651726+0000 2024-09-13T10:39:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:26.651726+0000 2024-09-13T10:39:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:26.653 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:26.654 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:26.654 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:26.654 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.651+0000 7fdbf2165640 1 Processor -- start 2024-09-13T10:39:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.651+0000 7fdbf2165640 1 -- start start 2024-09-13T10:39:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.651+0000 7fdbf2165640 10 monclient: init 2024-09-13T10:39:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.652+0000 7fdbf2165640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.652+0000 7fdbf2165640 10 monclient: _add_conns ranks=[3,1,7,2,5,0,8,4,6] 2024-09-13T10:39:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.652+0000 7fdbf2165640 10 monclient(hunting): picked mon.noname-g con 0x7fdbec0a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:26.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.652+0000 7fdbf2165640 10 monclient(hunting): picked mon.noname-f con 0x7fdbec0a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.652+0000 7fdbf2165640 10 monclient(hunting): picked mon.noname-i con 0x7fdbec13f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.652+0000 7fdbf2165640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbec0a5fe0 con 0x7fdbec0a6ab0 2024-09-13T10:39:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.652+0000 7fdbf2165640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbec0a8080 con 0x7fdbec0a66d0 2024-09-13T10:39:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.652+0000 7fdbf2165640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbec0a42c0 con 0x7fdbec13f9a0 2024-09-13T10:39:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.652+0000 7fdbf2165640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.652+0000 7fdbf2165640 10 monclient(hunting): authenticate will time out at 1306.157420s 2024-09-13T10:39:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.652+0000 7fdbeb7fe640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7fdbec0a66d0 0x7fdbec0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:50716/0 (socket says 172.21.15.181:50716) 2024-09-13T10:39:26.656 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.652+0000 7fdbeb7fe640 1 -- 172.21.15.181:0/142820723 learned_addr learned my addr 172.21.15.181:0/142820723 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.654+0000 7fdbeb7fe640 1 -- 172.21.15.181:0/142820723 >> v1:172.21.15.195:6790/0 conn(0x7fdbec0a66d0 legacy=0x7fdbec0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.654+0000 7fdbeaffd640 1 -- 172.21.15.181:0/142820723 >> v1:172.21.15.195:6789/0 conn(0x7fdbec0a6ab0 legacy=0x7fdbec0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbebfff640 1 -- 172.21.15.181:0/142820723 >> v1:172.21.15.195:6792/0 conn(0x7fdbec13f9a0 legacy=0x7fdbec141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642989743 0 0) 0x7fdbec0a8080 con 0x7fdbec0a66d0 2024-09-13T10:39:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): my global_id is 164316 2024-09-13T10:39:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbd4003520 con 0x7fdbec0a66d0 2024-09-13T10:39:26.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1710843368 0 0) 0x7fdbec0a5fe0 con 0x7fdbec0a6ab0 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): my global_id is 134686 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbec0a8080 con 0x7fdbec0a6ab0 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2369303474 0 0) 0x7fdbec0a42c0 con 0x7fdbec13f9a0 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): my global_id is 57688 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbec0a5fe0 con 0x7fdbec13f9a0 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbeb7fe640 1 -- 172.21.15.181:0/142820723 >> v1:172.21.15.195:6790/0 conn(0x7fdbec0a66d0 legacy=0x7fdbec0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T10:39:26.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbeb7fe640 1 -- 172.21.15.181:0/142820723 >> v1:172.21.15.195:6790/0 conn(0x7fdbec0a66d0 legacy=0x7fdbec0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbeb7fe640 1 --1- 172.21.15.181:0/142820723 >> v1:172.21.15.195:6790/0 conn(0x7fdbec0a66d0 0x7fdbec0a53b0 :-1 s=OPENED pgs=813 cs=1 l=1).handle_message read tag failed 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbeb7fe640 1 --1- 172.21.15.181:0/142820723 >> v1:172.21.15.195:6790/0 conn(0x7fdbec0a66d0 0x7fdbec0a53b0 :-1 s=OPENED pgs=813 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.195:6790/0 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1587795813 0 0) 0x7fdbec0a8080 con 0x7fdbec0a6ab0 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 >> v1:172.21.15.195:6792/0 conn(0x7fdbec13f9a0 legacy=0x7fdbec141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 >> v1:172.21.15.195:6790/0 conn(0x7fdbec0a66d0 legacy=0x7fdbec0a53b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 monclient: found mon.noname-f 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbec1464e0 con 0x7fdbec0a6ab0 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:26.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbf2165640 5 monclient: authenticate success, global_id 134686 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbe00019d0 con 0x7fdbec0a6ab0 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbf2165640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient: dump: 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.663 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbf2165640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdbe0001ca0 con 0x7fdbec0a6ab0 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbf2165640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 1 -- 172.21.15.181:0/142820723 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbe0003950 con 0x7fdbec0a6ab0 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbf2165640 4 set_mon_vals no callback set 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.655+0000 7fdbea7fc640 10 monclient: dump: 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.665 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.656+0000 7fdbf2165640 10 monclient: shutdown 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.656+0000 7fdbf2165640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.656+0000 7fdbf2165640 1 -- 172.21.15.181:0/142820723 >> v1:172.21.15.195:6789/0 conn(0x7fdbec0a6ab0 legacy=0x7fdbec0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.656+0000 7fdbf2165640 1 -- 172.21.15.181:0/142820723 shutdown_connections 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.656+0000 7fdbf2165640 1 -- 172.21.15.181:0/142820723 >> 172.21.15.181:0/142820723 conn(0x7fdbec0abcd0 msgr2=0x7fdbec0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.656+0000 7fdbf2165640 1 -- 172.21.15.181:0/142820723 shutdown_connections 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.656+0000 7fdbf2165640 1 -- 172.21.15.181:0/142820723 wait complete. 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.656+0000 7fdbf2165640 10 monclient: build_initial_monmap 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.656+0000 7fdbf2165640 10 monclient: monmap: 2024-09-13T10:39:26.666 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:26.667 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 1 Processor -- start 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 1 -- start start 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 10 monclient: init 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 10 monclient: _add_conns ranks=[8,4,1,5,0,7,6,3,2] 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 10 monclient(hunting): picked mon.noname-e con 0x7fdbec0a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 10 monclient(hunting): picked mon.noname-c con 0x7fdbec0a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 10 monclient(hunting): picked mon.noname-f con 0x7fdbec13f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbec13edd0 con 0x7fdbec13f9a0 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbec1cf210 con 0x7fdbec0a6ab0 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbec13f0b0 con 0x7fdbec0a66d0 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:26.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbf2165640 10 monclient(hunting): authenticate will time out at 1306.162719s 2024-09-13T10:39:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbeaffd640 1 -- >> v1:172.21.15.181:6791/0 conn(0x7fdbec0a6ab0 legacy=0x7fdbec1ceb00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6791/0 2024-09-13T10:39:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbeb7fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fdbec0a66d0 0x7fdbec1ce3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:48988/0 (socket says 172.21.15.181:48988) 2024-09-13T10:39:26.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.657+0000 7fdbeb7fe640 1 -- 172.21.15.181:0/1375497603 learned_addr learned my addr 172.21.15.181:0/1375497603 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:26.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.659+0000 7fdbeb7fe640 1 -- 172.21.15.181:0/1375497603 >> v1:172.21.15.181:6793/0 conn(0x7fdbec0a66d0 legacy=0x7fdbec1ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1627846158 0 0) 0x7fdbec13f0b0 con 0x7fdbec0a66d0 2024-09-13T10:39:26.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient(hunting): my global_id is 105767 2024-09-13T10:39:26.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbd8003520 con 0x7fdbec0a66d0 2024-09-13T10:39:26.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbebfff640 1 -- 172.21.15.181:0/1375497603 >> v1:172.21.15.195:6789/0 conn(0x7fdbec13f9a0 legacy=0x7fdbec1d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3908796869 0 0) 0x7fdbd8003520 con 0x7fdbec0a66d0 2024-09-13T10:39:26.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbec13f0b0 con 0x7fdbec0a66d0 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbdc004b20 con 0x7fdbec0a66d0 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient(hunting): dump: 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.674 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1741847847 0 0) 0x7fdbec13f0b0 con 0x7fdbec0a66d0 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 >> v1:172.21.15.181:6791/0 conn(0x7fdbec0a6ab0 legacy=0x7fdbec1ceb00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 >> v1:172.21.15.195:6789/0 conn(0x7fdbec13f9a0 legacy=0x7fdbec1d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient: _finish_hunting 0 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 1 monclient: found mon.e 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:26.675 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbec1393f0 con 0x7fdbec0a66d0 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient: _finish_auth 0 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient: _check_auth_tickets 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbf2165640 5 monclient: authenticate success, global_id 105767 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbf2165640 10 monclient: _renew_subs 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbf2165640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbf2165640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdbec139030 con 0x7fdbec0a66d0 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbf2165640 10 monclient: _renew_subs 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbf2165640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbf2165640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fdbec13eaf0 con 0x7fdbec0a66d0 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdbdc005030 con 0x7fdbec0a66d0 2024-09-13T10:39:26.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbdc005520 con 0x7fdbec0a66d0 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbe9ffb640 4 set_mon_vals no callback set 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.660+0000 7fdbd3fff640 10 monclient: dump: 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.677 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.661+0000 7fdbf2165640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.661+0000 7fdbf2165640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdbcc0065c0 con 0x7fdbcc002860 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.661+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fdbdc011db0 con 0x7fdbec0a66d0 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.661+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(289..289 src has 1..289) ==== 3506+0+0 (unknown 2194421268 0 0) 0x7fdbdc04e4f0 con 0x7fdbec0a66d0 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.661+0000 7fdbebfff640 10 monclient: get_auth_request con 0x7fdbd803f9d0 auth_method 0 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.663+0000 7fdbeaffd640 1 -- 172.21.15.181:0/1375497603 >> v1:172.21.15.195:6792/0 conn(0x7fdbcc002860 legacy=0x7fdbcc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.663+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472429846 0 0) 0x7fdbcc0065c0 con 0x7fdbcc002860 2024-09-13T10:39:26.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.663+0000 7fdbd3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.663+0000 7fdbd3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.663+0000 7fdbd3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.663+0000 7fdbd3fff640 10 monclient(hunting): my global_id is 57697 2024-09-13T10:39:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.663+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbec13f0b0 con 0x7fdbcc002860 2024-09-13T10:39:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3864475233 0 0) 0x7fdbec13f0b0 con 0x7fdbcc002860 2024-09-13T10:39:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbcc0065c0 con 0x7fdbcc002860 2024-09-13T10:39:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbe0003950 con 0x7fdbcc002860 2024-09-13T10:39:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 10 monclient: dump: 2024-09-13T10:39:26.679 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.680 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.681 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2193261492 0 0) 0x7fdbcc0065c0 con 0x7fdbcc002860 2024-09-13T10:39:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbcc00a160 con 0x7fdbcc002860 2024-09-13T10:39:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fdbe0001600 con 0x7fdbcc002860 2024-09-13T10:39:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 >> v1:172.21.15.195:6792/0 conn(0x7fdbcc002860 legacy=0x7fdbcc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.664+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 >> v1:172.21.15.195:6792/0 conn(0x7fdbcc002860 legacy=0x7fdbcc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.670+0000 7fdbf2165640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:26.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.670+0000 7fdbf2165640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdbcc009e50 con 0x7fdbcc009110 2024-09-13T10:39:26.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbeaffd640 1 -- 172.21.15.181:0/1375497603 >> v1:172.21.15.195:6792/0 conn(0x7fdbcc009110 legacy=0x7fdbcc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:26.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564864636 0 0) 0x7fdbcc009e50 con 0x7fdbcc009110 2024-09-13T10:39:26.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:26.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:26.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:26.683 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 10 monclient(hunting): my global_id is 57706 2024-09-13T10:39:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbcc0065c0 con 0x7fdbcc009110 2024-09-13T10:39:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 334819253 0 0) 0x7fdbcc0065c0 con 0x7fdbcc009110 2024-09-13T10:39:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbcc009e50 con 0x7fdbcc009110 2024-09-13T10:39:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdbe0003f50 con 0x7fdbcc009110 2024-09-13T10:39:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 10 monclient: dump: 2024-09-13T10:39:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:26.684 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2240121832 0 0) 0x7fdbcc009e50 con 0x7fdbcc009110 2024-09-13T10:39:26.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.673+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdbcc00c3f0 con 0x7fdbcc009110 2024-09-13T10:39:26.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7852 (unknown 0 0 1073410069) 0x7fdbe0004170 con 0x7fdbcc009110 2024-09-13T10:39:26.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbd3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:26.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbd3fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:26.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 >> v1:172.21.15.195:6792/0 conn(0x7fdbcc009110 legacy=0x7fdbcc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbd3fff640 1 -- 172.21.15.181:0/1375497603 >> v1:172.21.15.195:6792/0 conn(0x7fdbcc009110 legacy=0x7fdbcc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:26.686 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 136, 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 581094, 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 7, 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:26.687 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.688 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:26.689 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:26.690 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:26.691 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:26.692 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.693 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.695 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.696 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.696 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:26.696 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:26.696 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.696 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.696 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.696 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:26.696 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.696 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:26.698 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.699 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.701 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.702 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:26.703 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:39:26.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.706 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:26.706 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:39:26.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:26.706 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:26.706 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:26.706 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:26.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:26.706 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:26.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:26.706 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:26.706 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:26.707 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbf2165640 1 -- 172.21.15.181:0/1375497603 >> v1:172.21.15.195:6800/1839191919 conn(0x7fdbd803f9d0 legacy=0x7fdbd8041e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbf2165640 10 monclient: shutdown 2024-09-13T10:39:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbf2165640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbf2165640 1 -- 172.21.15.181:0/1375497603 >> v1:172.21.15.181:6793/0 conn(0x7fdbec0a66d0 legacy=0x7fdbec1ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbebfff640 1 -- 172.21.15.181:0/1375497603 reap_dead start 2024-09-13T10:39:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbebfff640 1 -- 172.21.15.181:0/1375497603 reap_dead start 2024-09-13T10:39:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbf2165640 1 -- 172.21.15.181:0/1375497603 shutdown_connections 2024-09-13T10:39:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.674+0000 7fdbf2165640 1 -- 172.21.15.181:0/1375497603 >> 172.21.15.181:0/1375497603 conn(0x7fdbec0abcd0 msgr2=0x7fdbec0a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.675+0000 7fdbf2165640 1 -- 172.21.15.181:0/1375497603 shutdown_connections 2024-09-13T10:39:26.708 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:26.675+0000 7fdbf2165640 1 -- 172.21.15.181:0/1375497603 wait complete. 2024-09-13T10:39:26.709 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-13T10:39:26.709 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T10:39:29.101 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:29.102 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40524]: starting. 2024-09-13T10:39:29.102 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40524]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40487 2024-09-13T10:39:29.102 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40524]: created object 0... 2024-09-13T10:39:29.102 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40524]: created object 25... 2024-09-13T10:39:29.102 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40524]: created object 49... 2024-09-13T10:39:29.102 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40524]: finishing. 2024-09-13T10:39:29.102 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40524]: shutting down. 2024-09-13T10:39:29.138 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:29.138 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40526]: starting. 2024-09-13T10:39:29.138 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40526]: listing objects. 2024-09-13T10:39:29.138 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40526]: listed object 0... 2024-09-13T10:39:29.139 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40526]: listed object 25... 2024-09-13T10:39:29.139 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40526]: saw 50 objects 2024-09-13T10:39:29.139 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40526]: shutting down. 2024-09-13T10:39:29.989 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:29.990 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40525]: starting. 2024-09-13T10:39:29.990 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40525]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40487 2024-09-13T10:39:29.990 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40525]: shutting down. 2024-09-13T10:39:29.992 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:29.992 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:29.992 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:39:29.994 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:39:32.099 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40595]: starting. 2024-09-13T10:39:32.099 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40595]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40594 2024-09-13T10:39:32.099 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40595]: created object 0... 2024-09-13T10:39:32.099 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40595]: created object 25... 2024-09-13T10:39:32.099 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40595]: created object 49... 2024-09-13T10:39:32.099 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40595]: finishing. 2024-09-13T10:39:32.099 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40595]: shutting down. 2024-09-13T10:39:32.998 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40596]: starting. 2024-09-13T10:39:32.999 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40596]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40594 2024-09-13T10:39:32.999 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40596]: shutting down. 2024-09-13T10:39:35.473 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:35.473 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40631]: starting. 2024-09-13T10:39:35.473 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40631]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40594 2024-09-13T10:39:35.473 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40631]: created object 0... 2024-09-13T10:39:35.473 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40631]: created object 25... 2024-09-13T10:39:35.473 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40631]: created object 49... 2024-09-13T10:39:35.473 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40631]: finishing. 2024-09-13T10:39:35.474 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40631]: shutting down. 2024-09-13T10:39:35.510 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:35.510 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40633]: starting. 2024-09-13T10:39:35.510 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40633]: listing objects. 2024-09-13T10:39:35.510 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40633]: listed object 0... 2024-09-13T10:39:35.511 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40633]: listed object 25... 2024-09-13T10:39:35.511 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40633]: saw 50 objects 2024-09-13T10:39:35.511 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40633]: shutting down. 2024-09-13T10:39:36.371 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:36.372 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40632]: starting. 2024-09-13T10:39:36.372 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40632]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40594 2024-09-13T10:39:36.372 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40632]: shutting down. 2024-09-13T10:39:36.374 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:36.374 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:36.374 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:39:36.377 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:39:38.542 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40702]: starting. 2024-09-13T10:39:38.542 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40702]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40701 2024-09-13T10:39:38.542 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40702]: created object 0... 2024-09-13T10:39:38.542 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40702]: created object 25... 2024-09-13T10:39:38.542 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40702]: created object 49... 2024-09-13T10:39:38.542 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40702]: finishing. 2024-09-13T10:39:38.543 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40702]: shutting down. 2024-09-13T10:39:39.444 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40703]: starting. 2024-09-13T10:39:39.444 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40703]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40701 2024-09-13T10:39:39.444 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40703]: shutting down. 2024-09-13T10:39:41.185 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:41.185 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40738]: starting. 2024-09-13T10:39:41.185 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40738]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40701 2024-09-13T10:39:41.186 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40738]: created object 0... 2024-09-13T10:39:41.186 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40738]: created object 25... 2024-09-13T10:39:41.186 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40738]: created object 49... 2024-09-13T10:39:41.186 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40738]: finishing. 2024-09-13T10:39:41.186 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40738]: shutting down. 2024-09-13T10:39:42.512 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:42.512 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40740]: starting. 2024-09-13T10:39:42.512 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40740]: listing objects. 2024-09-13T10:39:42.512 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40740]: listed object 0... 2024-09-13T10:39:42.513 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40740]: listed object 25... 2024-09-13T10:39:42.513 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40740]: saw 50 objects 2024-09-13T10:39:42.513 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40740]: shutting down. 2024-09-13T10:39:43.460 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:43.460 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40739]: starting. 2024-09-13T10:39:43.460 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40739]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40701 2024-09-13T10:39:43.460 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40739]: shutting down. 2024-09-13T10:39:43.461 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:43.461 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:43.461 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:39:43.463 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:39:46.182 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40809]: starting. 2024-09-13T10:39:46.183 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40809]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40808 2024-09-13T10:39:46.183 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40809]: created object 0... 2024-09-13T10:39:46.183 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40809]: created object 25... 2024-09-13T10:39:46.183 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40809]: created object 49... 2024-09-13T10:39:46.183 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40809]: finishing. 2024-09-13T10:39:46.183 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40809]: shutting down. 2024-09-13T10:39:46.709 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-09-13T10:39:46.709 INFO:tasks.ceph.mon.d:Restarting daemon 2024-09-13T10:39:46.710 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-09-13T10:39:46.713 INFO:tasks.ceph.mon.d:Started 2024-09-13T10:39:46.713 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-13T10:39:46.713 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T10:39:46.713 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T10:39:46.715 INFO:tasks.ceph.mon.b:Started 2024-09-13T10:39:46.715 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-13T10:39:46.716 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T10:39:46.716 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T10:39:46.718 INFO:tasks.ceph.mon.c:Started 2024-09-13T10:39:46.718 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-13T10:39:46.718 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T10:39:46.718 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T10:39:46.721 INFO:tasks.ceph.mon.a:Started 2024-09-13T10:39:46.721 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:39:46.721 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:39:46.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.840+0000 7fbf19268640 10 monclient: get_monmap_and_config 2024-09-13T10:39:46.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.840+0000 7fbf19268640 10 monclient: build_initial_monmap 2024-09-13T10:39:46.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.840+0000 7fbf19268640 10 monclient: monmap: 2024-09-13T10:39:46.842 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:46.842 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:46.842 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:46.840825+0000 2024-09-13T10:39:46.842 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:46.840825+0000 2024-09-13T10:39:46.842 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:46.842 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:46.842 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:46.842 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:46.842 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:46.842 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:46.843 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:46.843 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:46.843 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:46.843 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:46.843 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:46.843 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:46.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.840+0000 7fbf19268640 1 Processor -- start 2024-09-13T10:39:46.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf19268640 1 -- start start 2024-09-13T10:39:46.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf19268640 10 monclient: init 2024-09-13T10:39:46.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf19268640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:46.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf19268640 10 monclient: _add_conns ranks=[7,6,2,0,3,4,1,8,5] 2024-09-13T10:39:46.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf19268640 10 monclient(hunting): picked mon.noname-i con 0x7fbf140a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf19268640 10 monclient(hunting): picked mon.noname-d con 0x7fbf140a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf19268640 10 monclient(hunting): picked mon.noname-b con 0x7fbf1413f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf0bfff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fbf140a6ab0 0x7fbf140a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:43712/0 (socket says 172.21.15.181:43712) 2024-09-13T10:39:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf0bfff640 1 -- 172.21.15.181:0/664570515 learned_addr learned my addr 172.21.15.181:0/664570515 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf19268640 1 -- 172.21.15.181:0/664570515 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf140a5fe0 con 0x7fbf1413f9a0 2024-09-13T10:39:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf137fe640 1 -- 172.21.15.181:0/664570515 >> v1:172.21.15.181:6790/0 conn(0x7fbf1413f9a0 legacy=0x7fbf14141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6790/0 2024-09-13T10:39:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf19268640 1 -- 172.21.15.181:0/664570515 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf140a8080 con 0x7fbf140a6ab0 2024-09-13T10:39:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf19268640 1 -- 172.21.15.181:0/664570515 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf140a42c0 con 0x7fbf140a66d0 2024-09-13T10:39:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf19268640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.841+0000 7fbf19268640 10 monclient(hunting): authenticate will time out at 1326.346974s 2024-09-13T10:39:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf0bfff640 1 -- 172.21.15.181:0/664570515 >> v1:172.21.15.181:6792/0 conn(0x7fbf140a6ab0 legacy=0x7fbf140a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf12ffd640 1 -- 172.21.15.181:0/664570515 >> v1:172.21.15.195:6792/0 conn(0x7fbf140a66d0 legacy=0x7fbf140a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 1 -- 172.21.15.181:0/664570515 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1660386610 0 0) 0x7fbf140a42c0 con 0x7fbf140a66d0 2024-09-13T10:39:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient(hunting): my global_id is 57778 2024-09-13T10:39:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 1 -- 172.21.15.181:0/664570515 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf00003520 con 0x7fbf140a66d0 2024-09-13T10:39:46.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 1 -- 172.21.15.181:0/664570515 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1435772660 0 0) 0x7fbf00003520 con 0x7fbf140a66d0 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 1 -- 172.21.15.181:0/664570515 >> v1:172.21.15.181:6792/0 conn(0x7fbf140a6ab0 legacy=0x7fbf140a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 1 -- 172.21.15.181:0/664570515 >> v1:172.21.15.181:6790/0 conn(0x7fbf1413f9a0 legacy=0x7fbf14141d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 1 monclient: found mon.noname-i 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 1 -- 172.21.15.181:0/664570515 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf141464e0 con 0x7fbf140a66d0 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf19268640 5 monclient: authenticate success, global_id 57778 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf19268640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:46.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 1 -- 172.21.15.181:0/664570515 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf04001ae0 con 0x7fbf140a66d0 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient: dump: 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:46.849 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:46.850 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf19268640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 1 -- 172.21.15.181:0/664570515 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbf04003610 con 0x7fbf140a66d0 2024-09-13T10:39:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf19268640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf19268640 4 set_mon_vals no callback set 2024-09-13T10:39:46.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 1 -- 172.21.15.181:0/664570515 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbf04003b00 con 0x7fbf140a66d0 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.844+0000 7fbf127fc640 10 monclient: dump: 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:46.851 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.845+0000 7fbf19268640 10 monclient: shutdown 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.845+0000 7fbf19268640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.845+0000 7fbf19268640 1 -- 172.21.15.181:0/664570515 >> v1:172.21.15.195:6792/0 conn(0x7fbf140a66d0 legacy=0x7fbf140a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.845+0000 7fbf19268640 1 -- 172.21.15.181:0/664570515 shutdown_connections 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.845+0000 7fbf19268640 1 -- 172.21.15.181:0/664570515 >> 172.21.15.181:0/664570515 conn(0x7fbf140abcd0 msgr2=0x7fbf140ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.845+0000 7fbf19268640 1 -- 172.21.15.181:0/664570515 shutdown_connections 2024-09-13T10:39:46.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.846+0000 7fbf19268640 1 -- 172.21.15.181:0/664570515 wait complete. 2024-09-13T10:39:46.856 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.846+0000 7fbf19268640 10 monclient: build_initial_monmap 2024-09-13T10:39:46.857 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.846+0000 7fbf19268640 10 monclient: monmap: 2024-09-13T10:39:46.857 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:46.857 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:46.857 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:46.857 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:46.857 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:46.857 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:46.857 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:46.857 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:46.857 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.847+0000 7fbf19268640 1 Processor -- start 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.847+0000 7fbf19268640 1 -- start start 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.847+0000 7fbf19268640 10 monclient: init 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.847+0000 7fbf19268640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.847+0000 7fbf19268640 10 monclient: _add_conns ranks=[1,5,0,4,8,2,7,6,3] 2024-09-13T10:39:46.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.847+0000 7fbf19268640 10 monclient(hunting): picked mon.noname-f con 0x7fbf140a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.848+0000 7fbf19268640 10 monclient(hunting): picked mon.noname-h con 0x7fbf140a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.848+0000 7fbf19268640 10 monclient(hunting): picked mon.noname-a con 0x7fbf1413f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.848+0000 7fbf19268640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf1413d3c0 con 0x7fbf1413f9a0 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.848+0000 7fbf137fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fbf1413f9a0 0x7fbf141d6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:53496/0 (socket says 172.21.15.181:53496) 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.848+0000 7fbf137fe640 1 -- 172.21.15.181:0/3819501058 learned_addr learned my addr 172.21.15.181:0/3819501058 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.848+0000 7fbf19268640 1 -- 172.21.15.181:0/3819501058 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf14142db0 con 0x7fbf140a66d0 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.848+0000 7fbf19268640 1 -- 172.21.15.181:0/3819501058 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf1413ee80 con 0x7fbf140a6ab0 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.848+0000 7fbf19268640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.848+0000 7fbf19268640 10 monclient(hunting): authenticate will time out at 1326.353271s 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.850+0000 7fbf137fe640 1 -- 172.21.15.181:0/3819501058 >> v1:172.21.15.181:6789/0 conn(0x7fbf1413f9a0 legacy=0x7fbf141d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.850+0000 7fbf0bfff640 1 -- 172.21.15.181:0/3819501058 >> v1:172.21.15.195:6791/0 conn(0x7fbf140a6ab0 legacy=0x7fbf141d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.850+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2691430121 0 0) 0x7fbf1413ee80 con 0x7fbf140a6ab0 2024-09-13T10:39:46.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.850+0000 7fbf0b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.850+0000 7fbf0b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.850+0000 7fbf0b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.850+0000 7fbf0b7fe640 10 monclient(hunting): my global_id is 105746 2024-09-13T10:39:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.850+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbef4003520 con 0x7fbf140a6ab0 2024-09-13T10:39:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4211088983 0 0) 0x7fbef4003520 con 0x7fbf140a6ab0 2024-09-13T10:39:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf1413ee80 con 0x7fbf140a6ab0 2024-09-13T10:39:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbefc001c80 con 0x7fbf140a6ab0 2024-09-13T10:39:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:39:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:46.860 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:46.861 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3104213337 0 0) 0x7fbf1413ee80 con 0x7fbf140a6ab0 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 >> v1:172.21.15.195:6789/0 conn(0x7fbf140a66d0 legacy=0x7fbf140a20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 >> v1:172.21.15.181:6789/0 conn(0x7fbf1413f9a0 legacy=0x7fbf141d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 1 monclient: found mon.h 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1413f720 con 0x7fbf140a6ab0 2024-09-13T10:39:46.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf19268640 5 monclient: authenticate success, global_id 105746 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf19268640 10 monclient: _renew_subs 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf19268640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf19268640 1 -- 172.21.15.181:0/3819501058 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1413df20 con 0x7fbf140a6ab0 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf19268640 10 monclient: _renew_subs 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf19268640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.851+0000 7fbf19268640 1 -- 172.21.15.181:0/3819501058 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fbf141cb880 con 0x7fbf140a6ab0 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.852+0000 7fbf0bfff640 1 --1- 172.21.15.181:0/3819501058 >> v1:172.21.15.195:6791/0 conn(0x7fbf140a6ab0 0x7fbf141d36a0 :-1 s=OPENED pgs=773 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fbefc004ff0 mon_map magic: 0 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.852+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbefc004b00 con 0x7fbf140a6ab0 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.852+0000 7fbf0b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:46.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.852+0000 7fbf11ffb640 4 set_mon_vals no callback set 2024-09-13T10:39:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.852+0000 7fbf19268640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.853+0000 7fbf19268640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.853+0000 7fbf19268640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:39:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.853+0000 7fbf19268640 1 -- 172.21.15.181:0/3819501058 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef8005080 con 0x7fbf140a6ab0 2024-09-13T10:39:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.853+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fbefc004ff0 con 0x7fbf140a6ab0 2024-09-13T10:39:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.853+0000 7fbf0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.853+0000 7fbf0b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.853+0000 7fbf0b7fe640 10 monclient: dump: 2024-09-13T10:39:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:46.864 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:46.865 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:46.866 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.853+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fbefc0052c0 con 0x7fbf140a6ab0 2024-09-13T10:39:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.853+0000 7fbf12ffd640 10 monclient: get_auth_request con 0x7fbef403fa20 auth_method 0 2024-09-13T10:39:46.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:46.859+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(307..307 src has 1..307) ==== 3898+0+0 (unknown 289818633 0 0) 0x7fbefc04e480 con 0x7fbf140a6ab0 2024-09-13T10:39:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:47.680+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 <== mon.5 v1:172.21.15.195:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fbefc017910 con 0x7fbf140a6ab0 2024-09-13T10:39:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:47.680+0000 7fbf0b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:47.681 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:47.680+0000 7fbf0b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:47.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:47.925+0000 7fbf19268640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:39:47.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:47.925+0000 7fbf19268640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:47.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:47.925+0000 7fbf19268640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:39:47.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:47.925+0000 7fbf19268640 1 -- 172.21.15.181:0/3819501058 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbef8005370 con 0x7fbf140a6ab0 2024-09-13T10:39:49.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:49.848+0000 7fbf0a7fc640 10 monclient: tick 2024-09-13T10:39:49.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:49.848+0000 7fbf0a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:49.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:49.848+0000 7fbf0a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:49.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:49.848+0000 7fbf0a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:50.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:50.848+0000 7fbf0a7fc640 10 monclient: tick 2024-09-13T10:39:50.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:50.848+0000 7fbf0a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:50.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:50.848+0000 7fbf0a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:51.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.848+0000 7fbf0a7fc640 10 monclient: tick 2024-09-13T10:39:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.848+0000 7fbf0a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:51.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.848+0000 7fbf0a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:51.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.881+0000 7fbf0b7fe640 1 -- 172.21.15.181:0/3819501058 <== mon.5 v1:172.21.15.195:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2739 (unknown 254746657 0 839067410) 0x7fbefc017210 con 0x7fbf140a6ab0 2024-09-13T10:39:51.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.881+0000 7fbf0b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:51.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.881+0000 7fbf0b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:51.883 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":138,"quorum":[0,1,2,3,4,5,7,8],"quorum_names":["a","f","b","g","c","h","i","e"],"quorum_leader_name":"i","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:39:51.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.885+0000 7fbf19268640 1 -- 172.21.15.181:0/3819501058 >> v1:172.21.15.195:6800/1839191919 conn(0x7fbef403fa20 legacy=0x7fbef4041ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:51.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.885+0000 7fbf19268640 10 monclient: shutdown 2024-09-13T10:39:51.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.885+0000 7fbf19268640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:51.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.885+0000 7fbf19268640 1 -- 172.21.15.181:0/3819501058 >> v1:172.21.15.195:6791/0 conn(0x7fbf140a6ab0 legacy=0x7fbf141d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:51.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.885+0000 7fbf19268640 1 -- 172.21.15.181:0/3819501058 shutdown_connections 2024-09-13T10:39:51.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.885+0000 7fbf19268640 1 -- 172.21.15.181:0/3819501058 >> 172.21.15.181:0/3819501058 conn(0x7fbf140abcd0 msgr2=0x7fbf140a8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:51.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.885+0000 7fbf19268640 1 -- 172.21.15.181:0/3819501058 shutdown_connections 2024-09-13T10:39:51.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:51.885+0000 7fbf19268640 1 -- 172.21.15.181:0/3819501058 wait complete. 2024-09-13T10:39:52.411 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40810]: starting. 2024-09-13T10:39:52.411 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40810]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40808 2024-09-13T10:39:52.411 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40810]: shutting down. 2024-09-13T10:39:54.901 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:39:55.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.017+0000 7f4a36fa4640 10 monclient: get_monmap_and_config 2024-09-13T10:39:55.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.017+0000 7f4a36fa4640 10 monclient: build_initial_monmap 2024-09-13T10:39:55.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.017+0000 7f4a36fa4640 10 monclient: monmap: 2024-09-13T10:39:55.019 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:55.019 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.019 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:55.017867+0000 2024-09-13T10:39:55.019 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:55.017867+0000 2024-09-13T10:39:55.019 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:55.019 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.019 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:55.019 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:55.019 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:55.019 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:55.019 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:55.020 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:55.020 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:55.020 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:55.020 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:55.020 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 1 Processor -- start 2024-09-13T10:39:55.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 1 -- start start 2024-09-13T10:39:55.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 10 monclient: init 2024-09-13T10:39:55.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:55.021 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 10 monclient: _add_conns ranks=[8,1,5,6,0,4,2,7,3] 2024-09-13T10:39:55.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 10 monclient(hunting): picked mon.noname-e con 0x7f4a300a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:55.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 10 monclient(hunting): picked mon.noname-f con 0x7f4a300a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:55.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 10 monclient(hunting): picked mon.noname-h con 0x7f4a3013f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:55.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a300a5fe0 con 0x7f4a300a6ab0 2024-09-13T10:39:55.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a300a8080 con 0x7f4a3013f9a0 2024-09-13T10:39:55.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a300a42c0 con 0x7f4a300a66d0 2024-09-13T10:39:55.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:55.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a36fa4640 10 monclient(hunting): authenticate will time out at 1334.523729s 2024-09-13T10:39:55.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a34d40640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f4a300a66d0 0x7f4a300a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:42500/0 (socket says 172.21.15.181:42500) 2024-09-13T10:39:55.022 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.018+0000 7f4a34d40640 1 -- 172.21.15.181:0/1110915804 learned_addr learned my addr 172.21.15.181:0/1110915804 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:55.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.020+0000 7f4a34d40640 1 -- 172.21.15.181:0/1110915804 >> v1:172.21.15.181:6793/0 conn(0x7f4a300a66d0 legacy=0x7f4a300a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2ffff640 1 -- 172.21.15.181:0/1110915804 >> v1:172.21.15.195:6789/0 conn(0x7f4a300a6ab0 legacy=0x7f4a300a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a35541640 1 -- 172.21.15.181:0/1110915804 >> v1:172.21.15.195:6791/0 conn(0x7f4a3013f9a0 legacy=0x7f4a30141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843925571 0 0) 0x7f4a300a42c0 con 0x7f4a300a66d0 2024-09-13T10:39:55.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient(hunting): my global_id is 105866 2024-09-13T10:39:55.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a20003520 con 0x7f4a300a66d0 2024-09-13T10:39:55.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379252548 0 0) 0x7f4a300a5fe0 con 0x7f4a300a6ab0 2024-09-13T10:39:55.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.031 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient(hunting): my global_id is 134794 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a300a42c0 con 0x7f4a300a6ab0 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491267322 0 0) 0x7f4a300a8080 con 0x7f4a3013f9a0 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient(hunting): my global_id is 105764 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a300a5fe0 con 0x7f4a3013f9a0 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3522488472 0 0) 0x7f4a20003520 con 0x7f4a300a66d0 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 >> v1:172.21.15.195:6791/0 conn(0x7f4a3013f9a0 legacy=0x7f4a30141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 >> v1:172.21.15.195:6789/0 conn(0x7f4a300a6ab0 legacy=0x7f4a300a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.032 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 monclient: found mon.noname-e 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a301464e0 con 0x7f4a300a66d0 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a24001ad0 con 0x7f4a300a66d0 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a36fa4640 5 monclient: authenticate success, global_id 105866 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a36fa4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:55.033 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient: dump: 2024-09-13T10:39:55.034 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.034 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.034 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.034 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.034 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.034 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.034 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.034 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.034 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.034 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.034 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.034 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a36fa4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a240048a0 con 0x7f4a300a66d0 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 1 -- 172.21.15.181:0/1110915804 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a24004e10 con 0x7f4a300a66d0 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a36fa4640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a36fa4640 4 set_mon_vals no callback set 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:55.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.021+0000 7f4a2f7fe640 10 monclient: dump: 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.036 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.022+0000 7f4a36fa4640 10 monclient: shutdown 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.022+0000 7f4a36fa4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.022+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1110915804 >> v1:172.21.15.181:6793/0 conn(0x7f4a300a66d0 legacy=0x7f4a300a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.022+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1110915804 shutdown_connections 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.022+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1110915804 >> 172.21.15.181:0/1110915804 conn(0x7f4a300abcd0 msgr2=0x7f4a300ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.022+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1110915804 shutdown_connections 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.022+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1110915804 wait complete. 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.022+0000 7f4a36fa4640 10 monclient: build_initial_monmap 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.022+0000 7f4a36fa4640 10 monclient: monmap: 2024-09-13T10:39:55.037 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:55.038 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:55.038 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:55.038 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:55.038 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:55.038 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:55.038 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:55.038 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:55.038 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:55.038 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:55.038 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:55.038 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:55.038 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:55.039 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:55.039 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:55.039 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 1 Processor -- start 2024-09-13T10:39:55.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 1 -- start start 2024-09-13T10:39:55.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 10 monclient: init 2024-09-13T10:39:55.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:55.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 10 monclient: _add_conns ranks=[6,3,2,4,0,1,8,7,5] 2024-09-13T10:39:55.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 10 monclient(hunting): picked mon.noname-d con 0x7f4a300a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:55.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 10 monclient(hunting): picked mon.noname-g con 0x7f4a300a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:55.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 10 monclient(hunting): picked mon.noname-b con 0x7f4a3013f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:55.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3013d1e0 con 0x7f4a3013f9a0 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a30068a90 con 0x7f4a300a6ab0 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a301cb9e0 con 0x7f4a300a66d0 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a36fa4640 10 monclient(hunting): authenticate will time out at 1334.528767s 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a34d40640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f4a300a66d0 0x7f4a300a1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:36562/0 (socket says 172.21.15.181:36562) 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.023+0000 7f4a34d40640 1 -- 172.21.15.181:0/1780402193 learned_addr learned my addr 172.21.15.181:0/1780402193 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.025+0000 7f4a34d40640 1 -- 172.21.15.181:0/1780402193 >> v1:172.21.15.181:6792/0 conn(0x7f4a300a66d0 legacy=0x7f4a300a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.025+0000 7f4a35541640 1 -- 172.21.15.181:0/1780402193 >> v1:172.21.15.181:6790/0 conn(0x7f4a3013f9a0 legacy=0x7f4a301d6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2ffff640 1 -- 172.21.15.181:0/1780402193 >> v1:172.21.15.195:6790/0 conn(0x7f4a300a6ab0 legacy=0x7f4a301d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1160477005 0 0) 0x7f4a301cb9e0 con 0x7f4a300a66d0 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): my global_id is 174111 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a14003520 con 0x7f4a300a66d0 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706389612 0 0) 0x7f4a3013d1e0 con 0x7f4a3013f9a0 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): my global_id is 174107 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a301cb9e0 con 0x7f4a3013f9a0 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560245836 0 0) 0x7f4a30068a90 con 0x7f4a300a6ab0 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): my global_id is 164388 2024-09-13T10:39:55.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a3013d1e0 con 0x7f4a300a6ab0 2024-09-13T10:39:55.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2538089354 0 0) 0x7f4a14003520 con 0x7f4a300a66d0 2024-09-13T10:39:55.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a30068a90 con 0x7f4a300a66d0 2024-09-13T10:39:55.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a24004d90 con 0x7f4a300a66d0 2024-09-13T10:39:55.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:55.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): dump: 2024-09-13T10:39:55.042 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.042 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.042 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.042 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.042 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 428557931 0 0) 0x7f4a301cb9e0 con 0x7f4a3013f9a0 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a14003520 con 0x7f4a3013f9a0 2024-09-13T10:39:55.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a28002070 con 0x7f4a3013f9a0 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): dump: 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.044 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3696973853 0 0) 0x7f4a3013d1e0 con 0x7f4a300a6ab0 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a301cb9e0 con 0x7f4a300a6ab0 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a1c003610 con 0x7f4a300a6ab0 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient(hunting): dump: 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.045 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.046 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1531580794 0 0) 0x7f4a30068a90 con 0x7f4a300a66d0 2024-09-13T10:39:55.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 >> v1:172.21.15.195:6790/0 conn(0x7f4a300a6ab0 legacy=0x7f4a301d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 >> v1:172.21.15.181:6790/0 conn(0x7f4a3013f9a0 legacy=0x7f4a301d6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient: _finish_hunting 0 2024-09-13T10:39:55.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 monclient: found mon.d 2024-09-13T10:39:55.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:55.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:55.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3013f540 con 0x7f4a300a66d0 2024-09-13T10:39:55.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient: _finish_auth 0 2024-09-13T10:39:55.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient: _check_auth_tickets 2024-09-13T10:39:55.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:55.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a36fa4640 5 monclient: authenticate success, global_id 174111 2024-09-13T10:39:55.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a36fa4640 10 monclient: _renew_subs 2024-09-13T10:39:55.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a36fa4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:55.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1780402193 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3013dd40 con 0x7f4a300a66d0 2024-09-13T10:39:55.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a36fa4640 10 monclient: _renew_subs 2024-09-13T10:39:55.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a36fa4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:55.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1780402193 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f4a300a2680 con 0x7f4a300a66d0 2024-09-13T10:39:55.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a24001d20 con 0x7f4a300a66d0 2024-09-13T10:39:55.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:55.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4a24005740 con 0x7f4a300a66d0 2024-09-13T10:39:55.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2effd640 4 set_mon_vals no callback set 2024-09-13T10:39:55.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:55.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.026+0000 7f4a2d7fa640 10 monclient: dump: 2024-09-13T10:39:55.049 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.049 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.049 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.049 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.049 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.049 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.049 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.049 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.027+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4a24011dc0 con 0x7f4a300a66d0 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.027+0000 7f4a36fa4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.027+0000 7f4a36fa4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.027+0000 7f4a36fa4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.027+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1780402193 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a10005080 con 0x7f4a300a66d0 2024-09-13T10:39:55.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.027+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(310..310 src has 1..310) ==== 3898+0+0 (unknown 1383115228 0 0) 0x7f4a2404e3c0 con 0x7f4a300a66d0 2024-09-13T10:39:55.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.028+0000 7f4a2ffff640 10 monclient: get_auth_request con 0x7f4a140404c0 auth_method 0 2024-09-13T10:39:55.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.032+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f4a24017910 con 0x7f4a300a66d0 2024-09-13T10:39:55.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.032+0000 7f4a2d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:55.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.032+0000 7f4a2d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:55.082 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:55.082 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40845]: starting. 2024-09-13T10:39:55.083 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40845]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40808 2024-09-13T10:39:55.083 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40845]: created object 0... 2024-09-13T10:39:55.083 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40845]: created object 25... 2024-09-13T10:39:55.083 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40845]: created object 49... 2024-09-13T10:39:55.083 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40845]: finishing. 2024-09-13T10:39:55.083 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40845]: shutting down. 2024-09-13T10:39:55.119 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:55.119 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40847]: starting. 2024-09-13T10:39:55.119 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40847]: listing objects. 2024-09-13T10:39:55.119 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40847]: listed object 0... 2024-09-13T10:39:55.120 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40847]: listed object 25... 2024-09-13T10:39:55.120 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40847]: saw 50 objects 2024-09-13T10:39:55.120 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40847]: shutting down. 2024-09-13T10:39:55.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.280+0000 7f4a36fa4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:39:55.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.281+0000 7f4a36fa4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:55.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.281+0000 7f4a36fa4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:55.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.281+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1780402193 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4a10005370 con 0x7f4a300a66d0 2024-09-13T10:39:55.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.281+0000 7f4a2d7fa640 1 -- 172.21.15.181:0/1780402193 <== mon.6 v1:172.21.15.181:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 1012979040) 0x7f4a24017210 con 0x7f4a300a66d0 2024-09-13T10:39:55.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.281+0000 7f4a2d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:55.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.281+0000 7f4a2d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:55.283 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":140,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:39:55.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.283+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1780402193 >> v1:172.21.15.195:6800/1839191919 conn(0x7f4a140404c0 legacy=0x7f4a14042980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.283+0000 7f4a36fa4640 10 monclient: shutdown 2024-09-13T10:39:55.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.283+0000 7f4a36fa4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:55.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.283+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1780402193 >> v1:172.21.15.181:6792/0 conn(0x7f4a300a66d0 legacy=0x7f4a300a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.283+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1780402193 shutdown_connections 2024-09-13T10:39:55.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.283+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1780402193 >> 172.21.15.181:0/1780402193 conn(0x7f4a300abcd0 msgr2=0x7f4a300a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:55.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.283+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1780402193 shutdown_connections 2024-09-13T10:39:55.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.283+0000 7f4a36fa4640 1 -- 172.21.15.181:0/1780402193 wait complete. 2024-09-13T10:39:55.295 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:39:55.295 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:39:55.296 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:39:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.392+0000 7f29aa6b8640 10 monclient: get_monmap_and_config 2024-09-13T10:39:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.392+0000 7f29aa6b8640 10 monclient: build_initial_monmap 2024-09-13T10:39:55.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.393+0000 7f29aa6b8640 10 monclient: monmap: 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:55.393586+0000 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:55.393586+0000 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:55.395 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:55.396 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:55.396 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.393+0000 7f29aa6b8640 1 Processor -- start 2024-09-13T10:39:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.393+0000 7f29aa6b8640 1 -- start start 2024-09-13T10:39:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.393+0000 7f29aa6b8640 10 monclient: init 2024-09-13T10:39:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f29aa6b8640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:55.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f29aa6b8640 10 monclient: _add_conns ranks=[7,6,0,5,8,3,1,2,4] 2024-09-13T10:39:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f29aa6b8640 10 monclient(hunting): picked mon.noname-i con 0x7f29a40a6640 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f29aa6b8640 10 monclient(hunting): picked mon.noname-d con 0x7f29a40a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f29aa6b8640 10 monclient(hunting): picked mon.noname-a con 0x7f29a413f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f29aa6b8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a40a4bc0 con 0x7f29a413f750 2024-09-13T10:39:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f29aa6b8640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a413a320 con 0x7f29a40a8340 2024-09-13T10:39:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f29aa6b8640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a40a8100 con 0x7f29a40a6640 2024-09-13T10:39:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f29aa6b8640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f29aa6b8640 10 monclient(hunting): authenticate will time out at 1334.899485s 2024-09-13T10:39:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f29a8c55640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f29a413f750 0x7f29a4141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:40922/0 (socket says 172.21.15.181:40922) 2024-09-13T10:39:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f299bfff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f29a40a8340 0x7f29a4139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:36572/0 (socket says 172.21.15.181:36572) 2024-09-13T10:39:55.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.394+0000 7f29a8c55640 1 -- 172.21.15.181:0/1264380907 learned_addr learned my addr 172.21.15.181:0/1264380907 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f299bfff640 1 -- 172.21.15.181:0/1264380907 >> v1:172.21.15.181:6792/0 conn(0x7f29a40a8340 legacy=0x7f29a4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a8c55640 1 -- 172.21.15.181:0/1264380907 >> v1:172.21.15.181:6789/0 conn(0x7f29a413f750 legacy=0x7f29a4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a3fff640 1 -- 172.21.15.181:0/1264380907 >> v1:172.21.15.195:6792/0 conn(0x7f29a40a6640 legacy=0x7f29a4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033639272 0 0) 0x7f29a413a320 con 0x7f29a40a8340 2024-09-13T10:39:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a37fe640 10 monclient(hunting): my global_id is 174120 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2990003520 con 0x7f29a40a8340 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173029052 0 0) 0x7f29a40a4bc0 con 0x7f29a413f750 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a37fe640 10 monclient(hunting): my global_id is 174114 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.396+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29a413a320 con 0x7f29a413f750 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 817618665 0 0) 0x7f29a40a8100 con 0x7f29a40a6640 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient(hunting): my global_id is 57796 2024-09-13T10:39:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29a40a4bc0 con 0x7f29a40a6640 2024-09-13T10:39:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1385024952 0 0) 0x7f2990003520 con 0x7f29a40a8340 2024-09-13T10:39:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 >> v1:172.21.15.195:6792/0 conn(0x7f29a40a6640 legacy=0x7f29a4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 >> v1:172.21.15.181:6789/0 conn(0x7f29a413f750 legacy=0x7f29a4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 1 monclient: found mon.noname-d 2024-09-13T10:39:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:39:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a40a48e0 con 0x7f29a40a8340 2024-09-13T10:39:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:55.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29aa6b8640 5 monclient: authenticate success, global_id 174120 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f298c001ae0 con 0x7f29a40a8340 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29aa6b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient: dump: 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.405 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29aa6b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f298c0047e0 con 0x7f29a40a8340 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29aa6b8640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:55.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 1 -- 172.21.15.181:0/1264380907 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f298c004d50 con 0x7f29a40a8340 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29aa6b8640 4 set_mon_vals no callback set 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29a37fe640 10 monclient: dump: 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.407 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29aa6b8640 10 monclient: shutdown 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29aa6b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29aa6b8640 1 -- 172.21.15.181:0/1264380907 >> v1:172.21.15.181:6792/0 conn(0x7f29a40a8340 legacy=0x7f29a4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29aa6b8640 1 -- 172.21.15.181:0/1264380907 shutdown_connections 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29aa6b8640 1 -- 172.21.15.181:0/1264380907 >> 172.21.15.181:0/1264380907 conn(0x7f29a4077170 msgr2=0x7f29a40abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29aa6b8640 1 -- 172.21.15.181:0/1264380907 shutdown_connections 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.397+0000 7f29aa6b8640 1 -- 172.21.15.181:0/1264380907 wait complete. 2024-09-13T10:39:55.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.398+0000 7f29aa6b8640 10 monclient: build_initial_monmap 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.398+0000 7f29aa6b8640 10 monclient: monmap: 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:55.409 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.398+0000 7f29aa6b8640 1 Processor -- start 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.398+0000 7f29aa6b8640 1 -- start start 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.398+0000 7f29aa6b8640 10 monclient: init 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.399+0000 7f29aa6b8640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.399+0000 7f29aa6b8640 10 monclient: _add_conns ranks=[1,5,0,3,6,8,4,2,7] 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.399+0000 7f29aa6b8640 10 monclient(hunting): picked mon.noname-f con 0x7f29a40a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.399+0000 7f29aa6b8640 10 monclient(hunting): picked mon.noname-h con 0x7f29a413f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.399+0000 7f29aa6b8640 10 monclient(hunting): picked mon.noname-a con 0x7f29a4135670 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.399+0000 7f29aa6b8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a40a9c40 con 0x7f29a4135670 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.399+0000 7f29aa6b8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a413d8d0 con 0x7f29a40a8340 2024-09-13T10:39:55.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.399+0000 7f29aa6b8640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a41348d0 con 0x7f29a413f750 2024-09-13T10:39:55.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.399+0000 7f29aa6b8640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:55.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.399+0000 7f29aa6b8640 10 monclient(hunting): authenticate will time out at 1334.904309s 2024-09-13T10:39:55.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.399+0000 7f29a8c55640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f29a4135670 0x7f29a41d6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:40934/0 (socket says 172.21.15.181:40934) 2024-09-13T10:39:55.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.399+0000 7f29a8c55640 1 -- 172.21.15.181:0/2361743900 learned_addr learned my addr 172.21.15.181:0/2361743900 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:55.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a8c55640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.181:6789/0 conn(0x7f29a4135670 legacy=0x7f29a41d6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f299bfff640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.195:6791/0 conn(0x7f29a413f750 legacy=0x7f29a41d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a3fff640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.195:6789/0 conn(0x7f29a40a8340 legacy=0x7f29a412f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2951183134 0 0) 0x7f29a40a9c40 con 0x7f29a4135670 2024-09-13T10:39:55.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): my global_id is 174123 2024-09-13T10:39:55.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2984003520 con 0x7f29a4135670 2024-09-13T10:39:55.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1485285061 0 0) 0x7f29a41348d0 con 0x7f29a413f750 2024-09-13T10:39:55.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): my global_id is 105773 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29a40a9c40 con 0x7f29a413f750 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1184461764 0 0) 0x7f29a413d8d0 con 0x7f29a40a8340 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): my global_id is 134803 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29a41348d0 con 0x7f29a40a8340 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3762326898 0 0) 0x7f2984003520 con 0x7f29a4135670 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29a413d8d0 con 0x7f29a4135670 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f299c0020b0 con 0x7f29a4135670 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:39:55.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): dump: 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.420 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4243355472 0 0) 0x7f29a40a9c40 con 0x7f29a413f750 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.401+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2984003520 con 0x7f29a413f750 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f298c004cd0 con 0x7f29a413f750 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 10 monclient(hunting): dump: 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.421 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1400335879 0 0) 0x7f29a41348d0 con 0x7f29a40a8340 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29a40a9c40 con 0x7f29a40a8340 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1581430083 0 0) 0x7f29a413d8d0 con 0x7f29a4135670 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.195:6791/0 conn(0x7f29a413f750 legacy=0x7f29a41d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.195:6789/0 conn(0x7f29a40a8340 legacy=0x7f29a412f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 10 monclient: _finish_hunting 0 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 1 monclient: found mon.a 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a413ceb0 con 0x7f29a4135670 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 10 monclient: _finish_auth 0 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 10 monclient: _check_auth_tickets 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29aa6b8640 5 monclient: authenticate success, global_id 174123 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29aa6b8640 10 monclient: _renew_subs 2024-09-13T10:39:55.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29aa6b8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:55.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29aa6b8640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f29a413d140 con 0x7f29a4135670 2024-09-13T10:39:55.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29aa6b8640 10 monclient: _renew_subs 2024-09-13T10:39:55.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29aa6b8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:55.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29aa6b8640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f29a4130020 con 0x7f29a4135670 2024-09-13T10:39:55.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f299c004e80 con 0x7f29a4135670 2024-09-13T10:39:55.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:55.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f299c005370 con 0x7f29a4135670 2024-09-13T10:39:55.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a2ffd640 4 set_mon_vals no callback set 2024-09-13T10:39:55.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:55.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 10 monclient: dump: 2024-09-13T10:39:55.424 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.425 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.426 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.426 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29aa6b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:55.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29aa6b8640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f29880065c0 con 0x7f2988002860 2024-09-13T10:39:55.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.402+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f299c005510 con 0x7f29a4135670 2024-09-13T10:39:55.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.403+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(310..310 src has 1..310) ==== 3898+0+0 (unknown 1383115228 0 0) 0x7f299c04e550 con 0x7f29a4135670 2024-09-13T10:39:55.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.403+0000 7f299bfff640 10 monclient: get_auth_request con 0x7f29840405d0 auth_method 0 2024-09-13T10:39:55.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a3fff640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.181:6789/0 conn(0x7f2988002860 legacy=0x7f2988004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3230435220 0 0) 0x7f29880065c0 con 0x7f2988002860 2024-09-13T10:39:55.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 10 monclient(hunting): my global_id is 174132 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29a413d8d0 con 0x7f2988002860 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1432709431 0 0) 0x7f29a413d8d0 con 0x7f2988002860 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29880065c0 con 0x7f2988002860 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2994003e50 con 0x7f2988002860 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 10 monclient: dump: 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.427 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2841654887 0 0) 0x7f29880065c0 con 0x7f2988002860 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f298800a160 con 0x7f2988002860 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2994004070 con 0x7f2988002860 2024-09-13T10:39:55.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.181:6789/0 conn(0x7f2988002860 legacy=0x7f2988004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.405+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.181:6789/0 conn(0x7f2988002860 legacy=0x7f2988004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.411+0000 7f29aa6b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.411+0000 7f29aa6b8640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2988009e70 con 0x7f2988009130 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a3fff640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.181:6789/0 conn(0x7f2988009130 legacy=0x7f29880095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457115362 0 0) 0x7f2988009e70 con 0x7f2988009130 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 10 monclient(hunting): my global_id is 174141 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29880065c0 con 0x7f2988009130 2024-09-13T10:39:55.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2184386114 0 0) 0x7f29880065c0 con 0x7f2988009130 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2988009e70 con 0x7f2988009130 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2994005b00 con 0x7f2988009130 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 10 monclient: dump: 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.430 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2698924788 0 0) 0x7f2988009e70 con 0x7f2988009130 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f298800c3f0 con 0x7f2988009130 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 1021204348) 0x7f2994007d90 con 0x7f2988009130 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.181:6789/0 conn(0x7f2988009130 legacy=0x7f29880095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.414+0000 7f29a17fa640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.181:6789/0 conn(0x7f2988009130 legacy=0x7f29880095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:55.432 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:55.432 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:55.432 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:55.432 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:55.432 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:55.432 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 8579, 2024-09-13T10:39:55.432 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:55.432 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:55.433 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:55.434 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.435 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:55.436 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:55.437 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:55.438 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.438 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:55.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.438 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:55.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.438 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:55.438 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:55.438 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.438 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.438 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:55.439 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.439 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.439 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.439 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:55.439 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:55.439 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.439 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.439 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.440 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:55.440 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:55.440 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.440 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:55.440 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.440 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.440 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.440 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.441 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.442 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.443 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:55.444 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:55.444 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.444 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.444 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.444 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:55.444 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.444 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.444 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.444 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:55.444 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:55.445 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:55.446 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:55.448 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:55.450 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:55.451 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.451 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.451 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:55.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.451 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:55.451 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:55.451 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:55.451 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.451 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.451 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:55.451 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:55.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.415+0000 7f29aa6b8640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.195:6800/1839191919 conn(0x7f29840405d0 legacy=0x7f2984042a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.415+0000 7f29aa6b8640 10 monclient: shutdown 2024-09-13T10:39:55.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.415+0000 7f29aa6b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:55.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.415+0000 7f29aa6b8640 1 -- 172.21.15.181:0/2361743900 >> v1:172.21.15.181:6789/0 conn(0x7f29a4135670 legacy=0x7f29a41d6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.415+0000 7f29a8c55640 1 -- 172.21.15.181:0/2361743900 reap_dead start 2024-09-13T10:39:55.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.415+0000 7f29a8c55640 1 -- 172.21.15.181:0/2361743900 reap_dead start 2024-09-13T10:39:55.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.415+0000 7f29aa6b8640 1 -- 172.21.15.181:0/2361743900 shutdown_connections 2024-09-13T10:39:55.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.415+0000 7f29aa6b8640 1 -- 172.21.15.181:0/2361743900 >> 172.21.15.181:0/2361743900 conn(0x7f29a40a6640 msgr2=0x7f29a40a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:55.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.415+0000 7f29aa6b8640 1 -- 172.21.15.181:0/2361743900 shutdown_connections 2024-09-13T10:39:55.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.415+0000 7f29aa6b8640 1 -- 172.21.15.181:0/2361743900 wait complete. 2024-09-13T10:39:55.454 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:55.454 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:39:55.454 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:39:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.551+0000 7f630507f640 10 monclient: get_monmap_and_config 2024-09-13T10:39:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.551+0000 7f630507f640 10 monclient: build_initial_monmap 2024-09-13T10:39:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.551+0000 7f630507f640 10 monclient: monmap: 2024-09-13T10:39:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.553 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:55.552132+0000 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:55.552132+0000 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:55.554 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 1 Processor -- start 2024-09-13T10:39:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 1 -- start start 2024-09-13T10:39:55.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 10 monclient: init 2024-09-13T10:39:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:55.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 10 monclient: _add_conns ranks=[3,6,4,5,2,7,8,0,1] 2024-09-13T10:39:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 10 monclient(hunting): picked mon.noname-g con 0x7f63000a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 10 monclient(hunting): picked mon.noname-d con 0x7f63000a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 10 monclient(hunting): picked mon.noname-c con 0x7f630013f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63000a4bc0 con 0x7f63000a6640 2024-09-13T10:39:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f630013a320 con 0x7f630013f750 2024-09-13T10:39:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63000a8100 con 0x7f63000a8340 2024-09-13T10:39:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f630507f640 10 monclient(hunting): authenticate will time out at 1335.057644s 2024-09-13T10:39:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f62fe59c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f63000a8340 0x7f6300139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:36582/0 (socket says 172.21.15.181:36582) 2024-09-13T10:39:55.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.552+0000 7f62fe59c640 1 -- 172.21.15.181:0/1167146443 learned_addr learned my addr 172.21.15.181:0/1167146443 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.554+0000 7f62ff59e640 1 -- 172.21.15.181:0/1167146443 >> v1:172.21.15.181:6791/0 conn(0x7f630013f750 legacy=0x7f6300141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.554+0000 7f62fe59c640 1 -- 172.21.15.181:0/1167146443 >> v1:172.21.15.181:6792/0 conn(0x7f63000a8340 legacy=0x7f6300139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104947194 0 0) 0x7f63000a8100 con 0x7f63000a8340 2024-09-13T10:39:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fed9d640 1 -- 172.21.15.181:0/1167146443 >> v1:172.21.15.195:6790/0 conn(0x7f63000a6640 legacy=0x7f6300139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient(hunting): my global_id is 174129 2024-09-13T10:39:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e8003520 con 0x7f63000a8340 2024-09-13T10:39:55.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479026792 0 0) 0x7f630013a320 con 0x7f630013f750 2024-09-13T10:39:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient(hunting): my global_id is 174109 2024-09-13T10:39:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63000a8100 con 0x7f630013f750 2024-09-13T10:39:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 305062862 0 0) 0x7f63000a4bc0 con 0x7f63000a6640 2024-09-13T10:39:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient(hunting): my global_id is 164397 2024-09-13T10:39:55.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f630013a320 con 0x7f63000a6640 2024-09-13T10:39:55.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 406800232 0 0) 0x7f63000a8100 con 0x7f630013f750 2024-09-13T10:39:55.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 >> v1:172.21.15.181:6792/0 conn(0x7f63000a8340 legacy=0x7f6300139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 >> v1:172.21.15.195:6790/0 conn(0x7f63000a6640 legacy=0x7f6300139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient: _finish_hunting 0 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 monclient: found mon.noname-c 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63000a48e0 con 0x7f630013f750 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient: _finish_auth 0 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient: _check_auth_tickets 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62f8001e90 con 0x7f630013f750 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient: dump: 2024-09-13T10:39:55.565 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.566 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f630507f640 5 monclient: authenticate success, global_id 174109 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f630507f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62f8003990 con 0x7f630013f750 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 1 -- 172.21.15.181:0/1167146443 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62f8003f00 con 0x7f630013f750 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f630507f640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f630507f640 4 set_mon_vals no callback set 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f62fdd9b640 10 monclient: dump: 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.567 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.568 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f630507f640 10 monclient: shutdown 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f630507f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.555+0000 7f630507f640 1 -- 172.21.15.181:0/1167146443 >> v1:172.21.15.181:6791/0 conn(0x7f630013f750 legacy=0x7f6300141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.556+0000 7f630507f640 1 -- 172.21.15.181:0/1167146443 shutdown_connections 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.556+0000 7f630507f640 1 -- 172.21.15.181:0/1167146443 >> 172.21.15.181:0/1167146443 conn(0x7f6300077170 msgr2=0x7f63000abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.556+0000 7f630507f640 1 -- 172.21.15.181:0/1167146443 shutdown_connections 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.556+0000 7f630507f640 1 -- 172.21.15.181:0/1167146443 wait complete. 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.556+0000 7f630507f640 10 monclient: build_initial_monmap 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.556+0000 7f630507f640 10 monclient: monmap: 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:55.569 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 1 Processor -- start 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 1 -- start start 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 10 monclient: init 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 10 monclient: _add_conns ranks=[0,8,3,1,6,5,2,4,7] 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 10 monclient(hunting): picked mon.noname-a con 0x7f63000a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 10 monclient(hunting): picked mon.noname-e con 0x7f630013f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 10 monclient(hunting): picked mon.noname-g con 0x7f6300142020 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63001cf0f0 con 0x7f63000a8340 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63000a9f00 con 0x7f6300142020 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6300142940 con 0x7f630013f750 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f630507f640 10 monclient(hunting): authenticate will time out at 1335.062822s 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f62fed9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f63000a8340 0x7f63001ce2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:40952/0 (socket says 172.21.15.181:40952) 2024-09-13T10:39:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f62fed9d640 1 -- 172.21.15.181:0/1193461391 learned_addr learned my addr 172.21.15.181:0/1193461391 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:55.572 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.557+0000 7f62fe59c640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f630013f750 0x7f63001ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:42512/0 (socket says 172.21.15.181:42512) 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.559+0000 7f62fe59c640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.181:6793/0 conn(0x7f630013f750 legacy=0x7f63001ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62fed9d640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.181:6789/0 conn(0x7f63000a8340 legacy=0x7f63001ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1244590279 0 0) 0x7f6300142940 con 0x7f630013f750 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): my global_id is 105875 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62ec003550 con 0x7f630013f750 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893351788 0 0) 0x7f63001cf0f0 con 0x7f63000a8340 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.578 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): my global_id is 174150 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6300142940 con 0x7f63000a8340 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62ff59e640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.195:6790/0 conn(0x7f6300142020 legacy=0x7f63001d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 918937923 0 0) 0x7f63000a9f00 con 0x7f6300142020 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): my global_id is 164406 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63001cf0f0 con 0x7f6300142020 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2542968932 0 0) 0x7f6300142940 con 0x7f63000a8340 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63000a9f00 con 0x7f63000a8340 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62f0003610 con 0x7f63000a8340 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:39:55.579 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): dump: 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.580 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2449821956 0 0) 0x7f62ec003550 con 0x7f630013f750 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6300142940 con 0x7f630013f750 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62f40047e0 con 0x7f630013f750 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): dump: 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.581 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1997077671 0 0) 0x7f63001cf0f0 con 0x7f6300142020 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62ec003550 con 0x7f6300142020 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62f8003e80 con 0x7f6300142020 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient(hunting): dump: 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.583 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1980467461 0 0) 0x7f63000a9f00 con 0x7f63000a8340 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.181:6793/0 conn(0x7f630013f750 legacy=0x7f63001ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.195:6790/0 conn(0x7f6300142020 legacy=0x7f63001d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 monclient: found mon.a 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630013ba40 con 0x7f63000a8340 2024-09-13T10:39:55.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f630507f640 5 monclient: authenticate success, global_id 174150 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f630507f640 10 monclient: _renew_subs 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f630507f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f630507f640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f630013c5b0 con 0x7f63000a8340 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f630507f640 10 monclient: _renew_subs 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f630507f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f630507f640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f63001d7c50 con 0x7f63000a8340 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62f0003b60 con 0x7f63000a8340 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62f00040d0 con 0x7f63000a8340 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62fd59a640 4 set_mon_vals no callback set 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.560+0000 7f62e77fe640 10 monclient: dump: 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.586 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.561+0000 7f630507f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.561+0000 7f630507f640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f62e00065c0 con 0x7f62e0002860 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.561+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f62f0004320 con 0x7f63000a8340 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.561+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(310..310 src has 1..310) ==== 3898+0+0 (unknown 1383115228 0 0) 0x7f62f004e310 con 0x7f63000a8340 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.562+0000 7f62ff59e640 10 monclient: get_auth_request con 0x7f62ec0404c0 auth_method 0 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.563+0000 7f62fe59c640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.181:6790/0 conn(0x7f62e0002860 legacy=0x7f62e0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.563+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712424223 0 0) 0x7f62e00065c0 con 0x7f62e0002860 2024-09-13T10:39:55.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.563+0000 7f62e77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.563+0000 7f62e77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.563+0000 7f62e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.563+0000 7f62e77fe640 10 monclient(hunting): my global_id is 174116 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.563+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63000a9f00 con 0x7f62e0002860 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4273041577 0 0) 0x7f63000a9f00 con 0x7f62e0002860 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62e00065c0 con 0x7f62e0002860 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62f4004eb0 con 0x7f62e0002860 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 10 monclient: dump: 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.588 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.589 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3487782212 0 0) 0x7f62e00065c0 con 0x7f62e0002860 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62e000a160 con 0x7f62e0002860 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f62f4007190 con 0x7f62e0002860 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.181:6790/0 conn(0x7f62e0002860 legacy=0x7f62e0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.564+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.181:6790/0 conn(0x7f62e0002860 legacy=0x7f62e0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.570+0000 7f630507f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.570+0000 7f630507f640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f62e0009e50 con 0x7f62e0009110 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.572+0000 7f62fe59c640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.181:6790/0 conn(0x7f62e0009110 legacy=0x7f62e00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.572+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528775278 0 0) 0x7f62e0009e50 con 0x7f62e0009110 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.572+0000 7f62e77fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.572+0000 7f62e77fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.572+0000 7f62e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.572+0000 7f62e77fe640 10 monclient(hunting): my global_id is 174125 2024-09-13T10:39:55.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.572+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e00065c0 con 0x7f62e0009110 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4150764517 0 0) 0x7f62e00065c0 con 0x7f62e0009110 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62e0009e50 con 0x7f62e0009110 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62f4005840 con 0x7f62e0009110 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 10 monclient: dump: 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.591 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1124284246 0 0) 0x7f62e0009e50 con 0x7f62e0009110 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f62e000c3f0 con 0x7f62e0009110 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 1252934741) 0x7f62f4006ba0 con 0x7f62e0009110 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:55.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.181:6790/0 conn(0x7f62e0009110 legacy=0x7f62e00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62e77fe640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.181:6790/0 conn(0x7f62e0009110 legacy=0x7f62e00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:55.593 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:55.593 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:55.593 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:55.593 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:55.593 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:55.593 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 8729, 2024-09-13T10:39:55.593 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:55.593 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:55.593 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:55.594 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:55.594 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:55.594 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:55.594 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:55.594 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:55.594 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:55.594 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:55.594 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.594 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:39:55.594 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:55.594 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:55.594 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:55.595 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:55.597 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:55.598 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.599 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:55.600 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.601 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.602 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.603 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.604 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.605 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.606 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:55.607 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.608 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:55.610 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.611 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:55.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.612 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:55.612 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:55.612 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:55.612 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.612 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.612 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:55.612 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:55.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f630507f640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.195:6800/1839191919 conn(0x7f62ec0404c0 legacy=0x7f62ec042980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f630507f640 10 monclient: shutdown 2024-09-13T10:39:55.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f630507f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:55.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f630507f640 1 -- 172.21.15.181:0/1193461391 >> v1:172.21.15.181:6789/0 conn(0x7f63000a8340 legacy=0x7f63001ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62ff59e640 1 -- 172.21.15.181:0/1193461391 reap_dead start 2024-09-13T10:39:55.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f62ff59e640 1 -- 172.21.15.181:0/1193461391 reap_dead start 2024-09-13T10:39:55.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f630507f640 1 -- 172.21.15.181:0/1193461391 shutdown_connections 2024-09-13T10:39:55.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f630507f640 1 -- 172.21.15.181:0/1193461391 >> 172.21.15.181:0/1193461391 conn(0x7f63000a6640 msgr2=0x7f63000a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:55.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f630507f640 1 -- 172.21.15.181:0/1193461391 shutdown_connections 2024-09-13T10:39:55.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.573+0000 7f630507f640 1 -- 172.21.15.181:0/1193461391 wait complete. 2024-09-13T10:39:55.614 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:55.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:39:55.615 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:39:55.713 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.711+0000 7fe1e92e4640 10 monclient: get_monmap_and_config 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.711+0000 7fe1e92e4640 10 monclient: build_initial_monmap 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.711+0000 7fe1e92e4640 10 monclient: monmap: 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:55.712527+0000 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:55.712527+0000 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:55.714 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:55.715 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.712+0000 7fe1e92e4640 1 Processor -- start 2024-09-13T10:39:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.712+0000 7fe1e92e4640 1 -- start start 2024-09-13T10:39:55.715 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.712+0000 7fe1e92e4640 10 monclient: init 2024-09-13T10:39:55.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e92e4640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:55.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e92e4640 10 monclient: _add_conns ranks=[4,6,7,0,5,1,3,8,2] 2024-09-13T10:39:55.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e92e4640 10 monclient(hunting): picked mon.noname-c con 0x7fe1e40a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:55.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e92e4640 10 monclient(hunting): picked mon.noname-d con 0x7fe1e40a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:55.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e92e4640 10 monclient(hunting): picked mon.noname-i con 0x7fe1e413f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:55.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e92e4640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e40a4bc0 con 0x7fe1e40a6640 2024-09-13T10:39:55.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e92e4640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e413a320 con 0x7fe1e40a8340 2024-09-13T10:39:55.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e92e4640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e40a8100 con 0x7fe1e413f750 2024-09-13T10:39:55.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e92e4640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e92e4640 10 monclient(hunting): authenticate will time out at 1335.218193s 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e27fc640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fe1e40a8340 0x7fe1e4139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:36586/0 (socket says 172.21.15.181:36586) 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e27fc640 1 -- 172.21.15.181:0/3485386317 learned_addr learned my addr 172.21.15.181:0/3485386317 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.713+0000 7fe1e2ffd640 1 --1- 172.21.15.181:0/3485386317 >> v1:172.21.15.181:6791/0 conn(0x7fe1e40a6640 0x7fe1e4139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51450/0 (socket says 172.21.15.181:51450) 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e2ffd640 1 -- 172.21.15.181:0/3485386317 >> v1:172.21.15.181:6791/0 conn(0x7fe1e40a6640 legacy=0x7fe1e4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e27fc640 1 -- 172.21.15.181:0/3485386317 >> v1:172.21.15.181:6792/0 conn(0x7fe1e40a8340 legacy=0x7fe1e4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 1 -- 172.21.15.181:0/3485386317 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433056472 0 0) 0x7fe1e40a4bc0 con 0x7fe1e40a6640 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient(hunting): my global_id is 174118 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 1 -- 172.21.15.181:0/3485386317 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1cc003520 con 0x7fe1e40a6640 2024-09-13T10:39:55.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 1 -- 172.21.15.181:0/3485386317 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452491616 0 0) 0x7fe1e413a320 con 0x7fe1e40a8340 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient(hunting): my global_id is 174138 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 1 -- 172.21.15.181:0/3485386317 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1e40a4bc0 con 0x7fe1e40a8340 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e37fe640 1 -- 172.21.15.181:0/3485386317 >> v1:172.21.15.195:6792/0 conn(0x7fe1e413f750 legacy=0x7fe1e4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 1 -- 172.21.15.181:0/3485386317 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4010150397 0 0) 0x7fe1cc003520 con 0x7fe1e40a6640 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 1 -- 172.21.15.181:0/3485386317 >> v1:172.21.15.195:6792/0 conn(0x7fe1e413f750 legacy=0x7fe1e4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 1 -- 172.21.15.181:0/3485386317 >> v1:172.21.15.181:6792/0 conn(0x7fe1e40a8340 legacy=0x7fe1e4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 1 monclient: found mon.noname-c 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:55.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 1 -- 172.21.15.181:0/3485386317 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e40a48e0 con 0x7fe1e40a6640 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient: _finish_auth 0 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 1 -- 172.21.15.181:0/3485386317 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe1d4001ae0 con 0x7fe1e40a6640 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient: dump: 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.723 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e92e4640 5 monclient: authenticate success, global_id 174118 2024-09-13T10:39:55.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e92e4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 1 -- 172.21.15.181:0/3485386317 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1d40047e0 con 0x7fe1e40a6640 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 1 -- 172.21.15.181:0/3485386317 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe1d4004d50 con 0x7fe1e40a6640 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e92e4640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e92e4640 4 set_mon_vals no callback set 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.715+0000 7fe1e1ffb640 10 monclient: dump: 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.725 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.716+0000 7fe1e92e4640 10 monclient: shutdown 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.716+0000 7fe1e92e4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.716+0000 7fe1e92e4640 1 -- 172.21.15.181:0/3485386317 >> v1:172.21.15.181:6791/0 conn(0x7fe1e40a6640 legacy=0x7fe1e4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.716+0000 7fe1e92e4640 1 -- 172.21.15.181:0/3485386317 shutdown_connections 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.716+0000 7fe1e92e4640 1 -- 172.21.15.181:0/3485386317 >> 172.21.15.181:0/3485386317 conn(0x7fe1e4077170 msgr2=0x7fe1e40abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.716+0000 7fe1e92e4640 1 -- 172.21.15.181:0/3485386317 shutdown_connections 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.716+0000 7fe1e92e4640 1 -- 172.21.15.181:0/3485386317 wait complete. 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.717+0000 7fe1e92e4640 10 monclient: build_initial_monmap 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.717+0000 7fe1e92e4640 10 monclient: monmap: 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:55.727 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.717+0000 7fe1e92e4640 1 Processor -- start 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.717+0000 7fe1e92e4640 1 -- start start 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.717+0000 7fe1e92e4640 10 monclient: init 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.717+0000 7fe1e92e4640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.717+0000 7fe1e92e4640 10 monclient: _add_conns ranks=[3,6,8,4,1,2,7,5,0] 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.717+0000 7fe1e92e4640 10 monclient(hunting): picked mon.noname-g con 0x7fe1e40a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:55.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.717+0000 7fe1e92e4640 10 monclient(hunting): picked mon.noname-d con 0x7fe1e413f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:55.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.717+0000 7fe1e92e4640 10 monclient(hunting): picked mon.noname-e con 0x7fe1e41d4670 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:55.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.718+0000 7fe1e92e4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e4135020 con 0x7fe1e40a8340 2024-09-13T10:39:55.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.718+0000 7fe1e92e4640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e4135300 con 0x7fe1e413f750 2024-09-13T10:39:55.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.718+0000 7fe1e92e4640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e413dac0 con 0x7fe1e41d4670 2024-09-13T10:39:55.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.718+0000 7fe1e92e4640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:55.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.718+0000 7fe1e92e4640 10 monclient(hunting): authenticate will time out at 1335.223032s 2024-09-13T10:39:55.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.718+0000 7fe1e27fc640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fe1e413f750 0x7fe1e4138830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:36588/0 (socket says 172.21.15.181:36588) 2024-09-13T10:39:55.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.718+0000 7fe1e27fc640 1 -- 172.21.15.181:0/2350619962 learned_addr learned my addr 172.21.15.181:0/2350619962 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:55.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1e27fc640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.181:6792/0 conn(0x7fe1e413f750 legacy=0x7fe1e4138830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1e37fe640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.181:6793/0 conn(0x7fe1e41d4670 legacy=0x7fe1e41d6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222733033 0 0) 0x7fe1e4135300 con 0x7fe1e413f750 2024-09-13T10:39:55.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): my global_id is 174147 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d0003550 con 0x7fe1e413f750 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820812765 0 0) 0x7fe1e413dac0 con 0x7fe1e41d4670 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): my global_id is 105884 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1e4135300 con 0x7fe1e41d4670 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1e2ffd640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.195:6790/0 conn(0x7fe1e40a8340 legacy=0x7fe1e41ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2780793328 0 0) 0x7fe1d0003550 con 0x7fe1e413f750 2024-09-13T10:39:55.734 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1e413dac0 con 0x7fe1e413f750 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe1d80047e0 con 0x7fe1e413f750 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.735 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1242021345 0 0) 0x7fe1e4135300 con 0x7fe1e41d4670 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1d0003550 con 0x7fe1e41d4670 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe1dc002000 con 0x7fe1e41d4670 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:55.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.737 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 446730793 0 0) 0x7fe1e413dac0 con 0x7fe1e413f750 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.181:6793/0 conn(0x7fe1e41d4670 legacy=0x7fe1e41d6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.195:6790/0 conn(0x7fe1e40a8340 legacy=0x7fe1e41ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 monclient: found mon.d 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e413dfe0 con 0x7fe1e413f750 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:55.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1e92e4640 5 monclient: authenticate success, global_id 174147 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1e92e4640 10 monclient: _renew_subs 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1e92e4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1e92e4640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e413e560 con 0x7fe1e413f750 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1e92e4640 10 monclient: _renew_subs 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1e92e4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1e92e4640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fe1e41d8180 con 0x7fe1e413f750 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1d8004c30 con 0x7fe1e413f750 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe1d8005120 con 0x7fe1e413f750 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1e17fa640 4 set_mon_vals no callback set 2024-09-13T10:39:55.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:55.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.720+0000 7fe1cb7fe640 10 monclient: dump: 2024-09-13T10:39:55.740 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.740 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.740 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.740 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.740 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.740 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.740 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.740 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.740 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.740 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.740 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.721+0000 7fe1e92e4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.721+0000 7fe1e92e4640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe1c40065c0 con 0x7fe1c4002860 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.721+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe1d80118d0 con 0x7fe1e413f750 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.722+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(310..310 src has 1..310) ==== 3898+0+0 (unknown 1383115228 0 0) 0x7fe1d804e3f0 con 0x7fe1e413f750 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.722+0000 7fe1e37fe640 10 monclient: get_auth_request con 0x7fe1d0040130 auth_method 0 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.723+0000 7fe1e2ffd640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.181:6791/0 conn(0x7fe1c4002860 legacy=0x7fe1c4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.723+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244585904 0 0) 0x7fe1c40065c0 con 0x7fe1c4002860 2024-09-13T10:39:55.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.723+0000 7fe1cb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.723+0000 7fe1cb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.723+0000 7fe1cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.723+0000 7fe1cb7fe640 10 monclient(hunting): my global_id is 174127 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1e413dac0 con 0x7fe1c4002860 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1790975914 0 0) 0x7fe1e413dac0 con 0x7fe1c4002860 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1c40065c0 con 0x7fe1c4002860 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe1d4004b20 con 0x7fe1c4002860 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 10 monclient: dump: 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.742 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1178535617 0 0) 0x7fe1c40065c0 con 0x7fe1c4002860 2024-09-13T10:39:55.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1c400a160 con 0x7fe1c4002860 2024-09-13T10:39:55.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe1d4004d40 con 0x7fe1c4002860 2024-09-13T10:39:55.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:55.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:55.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.181:6791/0 conn(0x7fe1c4002860 legacy=0x7fe1c4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.724+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.181:6791/0 conn(0x7fe1c4002860 legacy=0x7fe1c4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:55.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.730+0000 7fe1e92e4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:55.744 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.730+0000 7fe1e92e4640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe1c4009e50 con 0x7fe1c4009110 2024-09-13T10:39:55.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.732+0000 7fe1e2ffd640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.181:6791/0 conn(0x7fe1c4009110 legacy=0x7fe1c40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3238369284 0 0) 0x7fe1c4009e50 con 0x7fe1c4009110 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 10 monclient(hunting): my global_id is 174136 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1c40065c0 con 0x7fe1c4009110 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1363243137 0 0) 0x7fe1c40065c0 con 0x7fe1c4009110 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1c4009e50 con 0x7fe1c4009110 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe1d4004b20 con 0x7fe1c4009110 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 10 monclient: dump: 2024-09-13T10:39:55.746 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.747 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.748 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2934151312 0 0) 0x7fe1c4009e50 con 0x7fe1c4009110 2024-09-13T10:39:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe1c400c3f0 con 0x7fe1c4009110 2024-09-13T10:39:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 1109557527) 0x7fe1d4007d90 con 0x7fe1c4009110 2024-09-13T10:39:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.181:6791/0 conn(0x7fe1c4009110 legacy=0x7fe1c40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.733+0000 7fe1cb7fe640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.181:6791/0 conn(0x7fe1c4009110 legacy=0x7fe1c40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:55.748 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:55.748 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 8915, 2024-09-13T10:39:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:55.749 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:39:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:55.750 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:55.751 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:55.752 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:55.753 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:55.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.755 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.757 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:55.758 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.759 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.760 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.760 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:55.760 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:55.760 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.760 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.760 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:55.760 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.760 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.761 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.761 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:55.761 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:55.761 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.761 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.761 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.761 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:55.761 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:55.761 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.762 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.762 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.762 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:55.762 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.762 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.762 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.763 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.764 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:55.765 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:55.765 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.765 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.765 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.765 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:55.765 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.765 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.765 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.765 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:55.765 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:55.766 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.766 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.766 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.766 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:55.766 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:55.766 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.766 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.766 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.766 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:55.767 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:55.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.769 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.769 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:55.769 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:55.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.734+0000 7fe1e92e4640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.195:6800/1839191919 conn(0x7fe1d0040130 legacy=0x7fe1d00425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.734+0000 7fe1e92e4640 10 monclient: shutdown 2024-09-13T10:39:55.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.734+0000 7fe1e92e4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:55.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.734+0000 7fe1e92e4640 1 -- 172.21.15.181:0/2350619962 >> v1:172.21.15.181:6792/0 conn(0x7fe1e413f750 legacy=0x7fe1e4138830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.734+0000 7fe1e37fe640 1 -- 172.21.15.181:0/2350619962 reap_dead start 2024-09-13T10:39:55.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.734+0000 7fe1e37fe640 1 -- 172.21.15.181:0/2350619962 reap_dead start 2024-09-13T10:39:55.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.734+0000 7fe1e92e4640 1 -- 172.21.15.181:0/2350619962 shutdown_connections 2024-09-13T10:39:55.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.734+0000 7fe1e92e4640 1 -- 172.21.15.181:0/2350619962 >> 172.21.15.181:0/2350619962 conn(0x7fe1e40a6640 msgr2=0x7fe1e40a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:55.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.734+0000 7fe1e92e4640 1 -- 172.21.15.181:0/2350619962 shutdown_connections 2024-09-13T10:39:55.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.734+0000 7fe1e92e4640 1 -- 172.21.15.181:0/2350619962 wait complete. 2024-09-13T10:39:55.774 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:55.774 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:39:55.774 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:39:55.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.871+0000 7f1a3f332640 10 monclient: get_monmap_and_config 2024-09-13T10:39:55.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.871+0000 7f1a3f332640 10 monclient: build_initial_monmap 2024-09-13T10:39:55.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.871+0000 7f1a3f332640 10 monclient: monmap: 2024-09-13T10:39:55.873 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:55.872249+0000 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:55.872249+0000 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:55.874 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:55.875 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 1 Processor -- start 2024-09-13T10:39:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 1 -- start start 2024-09-13T10:39:55.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 10 monclient: init 2024-09-13T10:39:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 10 monclient: _add_conns ranks=[2,7,3,4,6,1,0,8,5] 2024-09-13T10:39:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 10 monclient(hunting): picked mon.noname-b con 0x7f1a381399b0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 10 monclient(hunting): picked mon.noname-i con 0x7f1a3809d2a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 10 monclient(hunting): picked mon.noname-g con 0x7f1a38139d90 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a380a8070 con 0x7f1a381399b0 2024-09-13T10:39:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a3809cb80 con 0x7f1a38139d90 2024-09-13T10:39:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a3809e4c0 con 0x7f1a3809d2a0 2024-09-13T10:39:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3f332640 10 monclient(hunting): authenticate will time out at 1335.377905s 2024-09-13T10:39:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.872+0000 7f1a3d0ce640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f1a381399b0 0x7f1a380a64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:46510/0 (socket says 172.21.15.181:46510) 2024-09-13T10:39:55.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.873+0000 7f1a3d0ce640 1 -- 172.21.15.181:0/1277109171 learned_addr learned my addr 172.21.15.181:0/1277109171 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a3d0ce640 1 -- 172.21.15.181:0/1277109171 >> v1:172.21.15.181:6790/0 conn(0x7f1a381399b0 legacy=0x7f1a380a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a3d8cf640 1 -- 172.21.15.181:0/1277109171 >> v1:172.21.15.195:6790/0 conn(0x7f1a38139d90 legacy=0x7f1a380a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a3c8cd640 1 -- 172.21.15.181:0/1277109171 >> v1:172.21.15.195:6792/0 conn(0x7f1a3809d2a0 legacy=0x7f1a380a6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216660089 0 0) 0x7f1a380a8070 con 0x7f1a381399b0 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient(hunting): my global_id is 174134 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a24003520 con 0x7f1a381399b0 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1024271728 0 0) 0x7f1a3809cb80 con 0x7f1a38139d90 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient(hunting): my global_id is 164424 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a380a8070 con 0x7f1a38139d90 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1186113311 0 0) 0x7f1a3809e4c0 con 0x7f1a3809d2a0 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient(hunting): my global_id is 57814 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a3809cb80 con 0x7f1a3809d2a0 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 837908266 0 0) 0x7f1a24003520 con 0x7f1a381399b0 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 >> v1:172.21.15.195:6792/0 conn(0x7f1a3809d2a0 legacy=0x7f1a380a6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 >> v1:172.21.15.195:6790/0 conn(0x7f1a38139d90 legacy=0x7f1a380a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:39:55.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 monclient: found mon.noname-b 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a380a82b0 con 0x7f1a381399b0 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient: _finish_auth 0 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a34001ad0 con 0x7f1a381399b0 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a3f332640 5 monclient: authenticate success, global_id 174134 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a3f332640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient: dump: 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.883 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.884 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a3f332640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a340048a0 con 0x7f1a381399b0 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 1 -- 172.21.15.181:0/1277109171 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a34004e10 con 0x7f1a381399b0 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a3f332640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a3f332640 4 set_mon_vals no callback set 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.875+0000 7f1a2ffff640 10 monclient: dump: 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.885 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.876+0000 7f1a3f332640 10 monclient: shutdown 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.876+0000 7f1a3f332640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:55.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.876+0000 7f1a3f332640 1 -- 172.21.15.181:0/1277109171 >> v1:172.21.15.181:6790/0 conn(0x7f1a381399b0 legacy=0x7f1a380a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.876+0000 7f1a3f332640 1 -- 172.21.15.181:0/1277109171 shutdown_connections 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.876+0000 7f1a3f332640 1 -- 172.21.15.181:0/1277109171 >> 172.21.15.181:0/1277109171 conn(0x7f1a380abdb0 msgr2=0x7f1a380ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.876+0000 7f1a3f332640 1 -- 172.21.15.181:0/1277109171 shutdown_connections 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.876+0000 7f1a3f332640 1 -- 172.21.15.181:0/1277109171 wait complete. 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.876+0000 7f1a3f332640 10 monclient: build_initial_monmap 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.876+0000 7f1a3f332640 10 monclient: monmap: 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:55.887 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 1 Processor -- start 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 1 -- start start 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 10 monclient: init 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 10 monclient: _add_conns ranks=[8,0,4,2,5,7,6,1,3] 2024-09-13T10:39:55.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 10 monclient(hunting): picked mon.noname-e con 0x7f1a3809d2a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:55.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 10 monclient(hunting): picked mon.noname-a con 0x7f1a381399b0 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:55.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 10 monclient(hunting): picked mon.noname-c con 0x7f1a38139d90 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:55.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a38134940 con 0x7f1a381399b0 2024-09-13T10:39:55.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a38135500 con 0x7f1a38139d90 2024-09-13T10:39:55.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a38137860 con 0x7f1a3809d2a0 2024-09-13T10:39:55.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:55.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3f332640 10 monclient(hunting): authenticate will time out at 1335.382673s 2024-09-13T10:39:55.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3d0ce640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f1a3809d2a0 0x7f1a38133b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:42522/0 (socket says 172.21.15.181:42522) 2024-09-13T10:39:55.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.877+0000 7f1a3d0ce640 1 -- 172.21.15.181:0/2406204204 learned_addr learned my addr 172.21.15.181:0/2406204204 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:55.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.879+0000 7f1a3d0ce640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.181:6793/0 conn(0x7f1a3809d2a0 legacy=0x7f1a38133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.879+0000 7f1a3d8cf640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.181:6791/0 conn(0x7f1a38139d90 legacy=0x7f1a381d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.879+0000 7f1a3c8cd640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.181:6789/0 conn(0x7f1a381399b0 legacy=0x7f1a38134230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4130088985 0 0) 0x7f1a38137860 con 0x7f1a3809d2a0 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): my global_id is 105893 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a1c003520 con 0x7f1a3809d2a0 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2551295845 0 0) 0x7f1a38135500 con 0x7f1a38139d90 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): my global_id is 174145 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a38137860 con 0x7f1a38139d90 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3535616318 0 0) 0x7f1a38134940 con 0x7f1a381399b0 2024-09-13T10:39:55.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): my global_id is 174159 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a38135500 con 0x7f1a381399b0 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1967829950 0 0) 0x7f1a38137860 con 0x7f1a38139d90 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a38134940 con 0x7f1a38139d90 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a300020b0 con 0x7f1a38139d90 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): dump: 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.895 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2564361705 0 0) 0x7f1a1c003520 con 0x7f1a3809d2a0 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a38137860 con 0x7f1a3809d2a0 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1761282908 0 0) 0x7f1a38135500 con 0x7f1a381399b0 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a1c003520 con 0x7f1a381399b0 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a34004d90 con 0x7f1a3809d2a0 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): dump: 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.897 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a28003610 con 0x7f1a381399b0 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:55.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient(hunting): dump: 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.899 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.900 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.900 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3562476156 0 0) 0x7f1a38134940 con 0x7f1a38139d90 2024-09-13T10:39:55.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.181:6793/0 conn(0x7f1a3809d2a0 legacy=0x7f1a38133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.181:6789/0 conn(0x7f1a381399b0 legacy=0x7f1a38134230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient: _finish_hunting 0 2024-09-13T10:39:55.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 monclient: found mon.c 2024-09-13T10:39:55.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:55.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:55.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a38136fc0 con 0x7f1a38139d90 2024-09-13T10:39:55.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient: _finish_auth 0 2024-09-13T10:39:55.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient: _check_auth_tickets 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a3f332640 5 monclient: authenticate success, global_id 174145 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a3f332640 10 monclient: _renew_subs 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a3f332640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a3f332640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1a38138f50 con 0x7f1a38139d90 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a30003c40 con 0x7f1a38139d90 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a300041b0 con 0x7f1a38139d90 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2dffb640 10 monclient: dump: 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.901 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.902 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a3f332640 10 monclient: _renew_subs 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a3f332640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a3f332640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f1a38138200 con 0x7f1a38139d90 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.880+0000 7f1a2f7fe640 4 set_mon_vals no callback set 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.881+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1a30004450 con 0x7f1a38139d90 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.881+0000 7f1a3f332640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.881+0000 7f1a3f332640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1a380008d0 con 0x7f1a380a0150 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.881+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(310..310 src has 1..310) ==== 3898+0+0 (unknown 1383115228 0 0) 0x7f1a3004e470 con 0x7f1a38139d90 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.881+0000 7f1a3c8cd640 10 monclient: get_auth_request con 0x7f1a1c040810 auth_method 0 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.883+0000 7f1a3d0ce640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.181:6792/0 conn(0x7f1a380a0150 legacy=0x7f1a380a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.883+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834446452 0 0) 0x7f1a380008d0 con 0x7f1a380a0150 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.883+0000 7f1a2dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.883+0000 7f1a2dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.883+0000 7f1a2dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.883+0000 7f1a2dffb640 10 monclient(hunting): my global_id is 174156 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.883+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a38134940 con 0x7f1a380a0150 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 965201293 0 0) 0x7f1a38134940 con 0x7f1a380a0150 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a380008d0 con 0x7f1a380a0150 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a340048a0 con 0x7f1a380a0150 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 10 monclient: dump: 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.904 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4127016752 0 0) 0x7f1a380008d0 con 0x7f1a380a0150 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a380a91e0 con 0x7f1a380a0150 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1a34005490 con 0x7f1a380a0150 2024-09-13T10:39:55.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:55.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:55.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.181:6792/0 conn(0x7f1a380a0150 legacy=0x7f1a380a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.884+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.181:6792/0 conn(0x7f1a380a0150 legacy=0x7f1a380a0530 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:55.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.890+0000 7f1a3f332640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:55.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.890+0000 7f1a3f332640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1a38135010 con 0x7f1a380a0c40 2024-09-13T10:39:55.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.892+0000 7f1a3d0ce640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.181:6792/0 conn(0x7f1a380a0c40 legacy=0x7f1a381dbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:55.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3191744433 0 0) 0x7f1a38135010 con 0x7f1a380a0c40 2024-09-13T10:39:55.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 10 monclient(hunting): my global_id is 174165 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a380008d0 con 0x7f1a380a0c40 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 366696409 0 0) 0x7f1a380008d0 con 0x7f1a380a0c40 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a38135010 con 0x7f1a380a0c40 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1a34005c70 con 0x7f1a380a0c40 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 10 monclient: dump: 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:55.908 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:55.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1363949317 0 0) 0x7f1a38135010 con 0x7f1a380a0c40 2024-09-13T10:39:55.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1a380a1020 con 0x7f1a380a0c40 2024-09-13T10:39:55.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 492364114) 0x7f1a34007140 con 0x7f1a380a0c40 2024-09-13T10:39:55.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:55.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:55.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.181:6792/0 conn(0x7f1a380a0c40 legacy=0x7f1a381dbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.893+0000 7f1a2dffb640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.181:6792/0 conn(0x7f1a380a0c40 legacy=0x7f1a381dbea0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:55.910 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:55.910 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:55.910 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 9074, 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:55.911 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:55.912 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:55.913 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:55.914 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:55.915 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:55.916 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.917 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.918 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.919 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:55.920 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.922 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:55.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:55.923 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.923 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.923 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.923 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:55.923 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:55.923 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.923 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.923 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.924 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.925 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.926 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:55.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.928 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:55.929 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:55.930 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:55.930 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:55.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:55.930 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:55.930 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:55.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.894+0000 7f1a3f332640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1a1c040810 legacy=0x7f1a1c042cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.894+0000 7f1a3f332640 10 monclient: shutdown 2024-09-13T10:39:55.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.894+0000 7f1a3f332640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:55.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.894+0000 7f1a3f332640 1 -- 172.21.15.181:0/2406204204 >> v1:172.21.15.181:6791/0 conn(0x7f1a38139d90 legacy=0x7f1a381d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:55.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.894+0000 7f1a3d8cf640 1 -- 172.21.15.181:0/2406204204 reap_dead start 2024-09-13T10:39:55.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.894+0000 7f1a3d8cf640 1 -- 172.21.15.181:0/2406204204 reap_dead start 2024-09-13T10:39:55.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.894+0000 7f1a3f332640 1 -- 172.21.15.181:0/2406204204 shutdown_connections 2024-09-13T10:39:55.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.894+0000 7f1a3f332640 1 -- 172.21.15.181:0/2406204204 >> 172.21.15.181:0/2406204204 conn(0x7f1a380abdb0 msgr2=0x7f1a381327e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:55.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.894+0000 7f1a3f332640 1 -- 172.21.15.181:0/2406204204 shutdown_connections 2024-09-13T10:39:55.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:55.894+0000 7f1a3f332640 1 -- 172.21.15.181:0/2406204204 wait complete. 2024-09-13T10:39:55.932 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:55.932 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:39:55.932 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:39:56.000 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:56.001 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40846]: starting. 2024-09-13T10:39:56.001 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40846]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40808 2024-09-13T10:39:56.001 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40846]: shutting down. 2024-09-13T10:39:56.002 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:56.002 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:39:56.002 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:39:56.005 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:39:56.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.033+0000 7f92f2910640 10 monclient: get_monmap_and_config 2024-09-13T10:39:56.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.033+0000 7f92f2910640 10 monclient: build_initial_monmap 2024-09-13T10:39:56.035 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.033+0000 7f92f2910640 10 monclient: monmap: 2024-09-13T10:39:56.035 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:56.035 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.035 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:56.034387+0000 2024-09-13T10:39:56.035 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:56.034387+0000 2024-09-13T10:39:56.035 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:56.035 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.035 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:56.035 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:56.036 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:56.036 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:56.036 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:56.036 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:56.036 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:56.036 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:56.036 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:56.036 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.034+0000 7f92f2910640 1 Processor -- start 2024-09-13T10:39:56.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.034+0000 7f92f2910640 1 -- start start 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.034+0000 7f92f2910640 10 monclient: init 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.034+0000 7f92f2910640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.034+0000 7f92f2910640 10 monclient: _add_conns ranks=[6,2,8,4,1,0,7,3,5] 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.035+0000 7f92f2910640 10 monclient(hunting): picked mon.noname-d con 0x7f92ec0a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.035+0000 7f92f2910640 10 monclient(hunting): picked mon.noname-b con 0x7f92ec0a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.035+0000 7f92f2910640 10 monclient(hunting): picked mon.noname-e con 0x7f92ec13f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.035+0000 7f92f2910640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92ec0a4bc0 con 0x7f92ec0a8340 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.035+0000 7f92f2910640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92ec13a320 con 0x7f92ec0a6640 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.035+0000 7f92f2910640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92ec0a8100 con 0x7f92ec13f750 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.035+0000 7f92f2910640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.035+0000 7f92f2910640 10 monclient(hunting): authenticate will time out at 1335.540067s 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.035+0000 7f92ebfff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f92ec0a6640 0x7f92ec139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:36608/0 (socket says 172.21.15.181:36608) 2024-09-13T10:39:56.038 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.035+0000 7f92eb7fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f92ec0a8340 0x7f92ec139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:46522/0 (socket says 172.21.15.181:46522) 2024-09-13T10:39:56.039 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.035+0000 7f92ebfff640 1 -- 172.21.15.181:0/4279532777 learned_addr learned my addr 172.21.15.181:0/4279532777 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:56.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92f0ead640 1 -- 172.21.15.181:0/4279532777 >> v1:172.21.15.181:6793/0 conn(0x7f92ec13f750 legacy=0x7f92ec141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eb7fe640 1 -- 172.21.15.181:0/4279532777 >> v1:172.21.15.181:6790/0 conn(0x7f92ec0a8340 legacy=0x7f92ec139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2968078100 0 0) 0x7f92ec0a8100 con 0x7f92ec13f750 2024-09-13T10:39:56.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 10 monclient(hunting): my global_id is 105902 2024-09-13T10:39:56.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92ebfff640 1 -- 172.21.15.181:0/4279532777 >> v1:172.21.15.181:6792/0 conn(0x7f92ec0a6640 legacy=0x7f92ec139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92d4003520 con 0x7f92ec13f750 2024-09-13T10:39:56.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911618837 0 0) 0x7f92ec0a4bc0 con 0x7f92ec0a8340 2024-09-13T10:39:56.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 10 monclient(hunting): my global_id is 174143 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92ec0a8100 con 0x7f92ec0a8340 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.037+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687123407 0 0) 0x7f92ec13a320 con 0x7f92ec0a6640 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient(hunting): my global_id is 174174 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92ec0a4bc0 con 0x7f92ec0a6640 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4012116412 0 0) 0x7f92d4003520 con 0x7f92ec13f750 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 >> v1:172.21.15.181:6792/0 conn(0x7f92ec0a6640 legacy=0x7f92ec139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 >> v1:172.21.15.181:6790/0 conn(0x7f92ec0a8340 legacy=0x7f92ec139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 1 monclient: found mon.noname-e 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ec0a48e0 con 0x7f92ec13f750 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f92e4001eb0 con 0x7f92ec13f750 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient: dump: 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.043 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92f2910640 5 monclient: authenticate success, global_id 105902 2024-09-13T10:39:56.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92f2910640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f92e4003990 con 0x7f92ec13f750 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 1 -- 172.21.15.181:0/4279532777 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f92e4003f00 con 0x7f92ec13f750 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92eaffd640 10 monclient: dump: 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.045 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92f2910640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.038+0000 7f92f2910640 4 set_mon_vals no callback set 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.039+0000 7f92f2910640 10 monclient: shutdown 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.039+0000 7f92f2910640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.039+0000 7f92f2910640 1 -- 172.21.15.181:0/4279532777 >> v1:172.21.15.181:6793/0 conn(0x7f92ec13f750 legacy=0x7f92ec141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.039+0000 7f92f2910640 1 -- 172.21.15.181:0/4279532777 shutdown_connections 2024-09-13T10:39:56.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.039+0000 7f92f2910640 1 -- 172.21.15.181:0/4279532777 >> 172.21.15.181:0/4279532777 conn(0x7f92ec077170 msgr2=0x7f92ec0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:56.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.039+0000 7f92f2910640 1 -- 172.21.15.181:0/4279532777 shutdown_connections 2024-09-13T10:39:56.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.039+0000 7f92f2910640 1 -- 172.21.15.181:0/4279532777 wait complete. 2024-09-13T10:39:56.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.040+0000 7f92f2910640 10 monclient: build_initial_monmap 2024-09-13T10:39:56.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.040+0000 7f92f2910640 10 monclient: monmap: 2024-09-13T10:39:56.052 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:56.052 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:56.052 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:56.052 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:56.052 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:56.052 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:56.052 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:56.052 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:56.052 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:56.052 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:56.052 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.040+0000 7f92f2910640 1 Processor -- start 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.040+0000 7f92f2910640 1 -- start start 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.040+0000 7f92f2910640 10 monclient: init 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.041+0000 7f92f2910640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.041+0000 7f92f2910640 10 monclient: _add_conns ranks=[3,5,4,2,8,6,7,1,0] 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.041+0000 7f92f2910640 10 monclient(hunting): picked mon.noname-g con 0x7f92ec0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.041+0000 7f92f2910640 10 monclient(hunting): picked mon.noname-h con 0x7f92ec13f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.041+0000 7f92f2910640 10 monclient(hunting): picked mon.noname-c con 0x7f92ec1d4520 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:56.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.041+0000 7f92f2910640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92ec0a0fa0 con 0x7f92ec0a8340 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.041+0000 7f92f2910640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92ec09e280 con 0x7f92ec1d4520 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.041+0000 7f92f2910640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92ec0a1730 con 0x7f92ec13f750 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.041+0000 7f92f2910640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.041+0000 7f92f2910640 10 monclient(hunting): authenticate will time out at 1335.546195s 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.041+0000 7f92f0ead640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f92ec1d4520 0x7f92ec1d6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51494/0 (socket says 172.21.15.181:51494) 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.041+0000 7f92f0ead640 1 -- 172.21.15.181:0/1068656022 learned_addr learned my addr 172.21.15.181:0/1068656022 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92f0ead640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.181:6791/0 conn(0x7f92ec1d4520 legacy=0x7f92ec1d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92eb7fe640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.195:6791/0 conn(0x7f92ec13f750 legacy=0x7f92ec09db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92ebfff640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.195:6790/0 conn(0x7f92ec0a8340 legacy=0x7f92ec09d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603637795 0 0) 0x7f92ec09e280 con 0x7f92ec1d4520 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): my global_id is 174154 2024-09-13T10:39:56.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92d8003550 con 0x7f92ec1d4520 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088390569 0 0) 0x7f92ec0a1730 con 0x7f92ec13f750 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): my global_id is 105782 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92ec09e280 con 0x7f92ec13f750 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3332545 0 0) 0x7f92ec0a0fa0 con 0x7f92ec0a8340 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): my global_id is 164433 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92ec0a1730 con 0x7f92ec0a8340 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 448809433 0 0) 0x7f92d8003550 con 0x7f92ec1d4520 2024-09-13T10:39:56.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92ec0a0fa0 con 0x7f92ec1d4520 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f92e4003e80 con 0x7f92ec1d4520 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.056 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.043+0000 7f92e8ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1906411368 0 0) 0x7f92ec09e280 con 0x7f92ec13f750 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92d8003550 con 0x7f92ec13f750 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3126950103 0 0) 0x7f92ec0a0fa0 con 0x7f92ec1d4520 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.195:6791/0 conn(0x7f92ec13f750 legacy=0x7f92ec09db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.195:6790/0 conn(0x7f92ec0a8340 legacy=0x7f92ec09d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 1 monclient: found mon.c 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ec0a1280 con 0x7f92ec1d4520 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92f2910640 5 monclient: authenticate success, global_id 174154 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92f2910640 10 monclient: _renew_subs 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92f2910640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92f2910640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f92ec0aa170 con 0x7f92ec1d4520 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92f2910640 10 monclient: _renew_subs 2024-09-13T10:39:56.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92f2910640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:56.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92f2910640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f92ec0a0cc0 con 0x7f92ec1d4520 2024-09-13T10:39:56.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f92e4001ed0 con 0x7f92ec1d4520 2024-09-13T10:39:56.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:56.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f92e40046c0 con 0x7f92ec1d4520 2024-09-13T10:39:56.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:56.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92ea7fc640 4 set_mon_vals no callback set 2024-09-13T10:39:56.059 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 10 monclient: dump: 2024-09-13T10:39:56.059 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.059 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.059 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.059 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.044+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f92e4012020 con 0x7f92ec1d4520 2024-09-13T10:39:56.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.045+0000 7f92f2910640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.045+0000 7f92f2910640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f92cc0065c0 con 0x7f92cc002860 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.045+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(311..311 src has 1..311) ==== 3506+0+0 (unknown 4201997143 0 0) 0x7f92e404e430 con 0x7f92ec1d4520 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.045+0000 7f92ebfff640 10 monclient: get_auth_request con 0x7f92d803ff60 auth_method 0 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92eb7fe640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.181:6793/0 conn(0x7f92cc002860 legacy=0x7f92cc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 557666775 0 0) 0x7f92cc0065c0 con 0x7f92cc002860 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 10 monclient(hunting): my global_id is 105911 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92ec0a0fa0 con 0x7f92cc002860 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 921950891 0 0) 0x7f92ec0a0fa0 con 0x7f92cc002860 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92cc0065c0 con 0x7f92cc002860 2024-09-13T10:39:56.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f92e0004eb0 con 0x7f92cc002860 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 10 monclient: dump: 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.062 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1340035191 0 0) 0x7f92cc0065c0 con 0x7f92cc002860 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.047+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92cc00a160 con 0x7f92cc002860 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.048+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f92e0006390 con 0x7f92cc002860 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.048+0000 7f92e8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.048+0000 7f92e8ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.048+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.181:6793/0 conn(0x7f92cc002860 legacy=0x7f92cc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.048+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.181:6793/0 conn(0x7f92cc002860 legacy=0x7f92cc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:56.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.054+0000 7f92f2910640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:56.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.054+0000 7f92f2910640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f92cc009e50 con 0x7f92cc009110 2024-09-13T10:39:56.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92eb7fe640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.181:6793/0 conn(0x7f92cc009110 legacy=0x7f92cc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 42402759 0 0) 0x7f92cc009e50 con 0x7f92cc009110 2024-09-13T10:39:56.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92e8ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92e8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92e8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92e8ff9640 10 monclient(hunting): my global_id is 105938 2024-09-13T10:39:56.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92cc0065c0 con 0x7f92cc009110 2024-09-13T10:39:56.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1511693023 0 0) 0x7f92cc0065c0 con 0x7f92cc009110 2024-09-13T10:39:56.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92cc009e50 con 0x7f92cc009110 2024-09-13T10:39:56.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f92e0005420 con 0x7f92cc009110 2024-09-13T10:39:56.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92e8ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:56.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.058+0000 7f92e8ff9640 10 monclient: dump: 2024-09-13T10:39:56.066 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.067 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.068 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.068 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 521175171 0 0) 0x7f92cc009e50 con 0x7f92cc009110 2024-09-13T10:39:56.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f92cc00c3f0 con 0x7f92cc009110 2024-09-13T10:39:56.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 2552755844) 0x7f92e0005810 con 0x7f92cc009110 2024-09-13T10:39:56.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92e8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:56.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92e8ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:56.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.181:6793/0 conn(0x7f92cc009110 legacy=0x7f92cc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92e8ff9640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.181:6793/0 conn(0x7f92cc009110 legacy=0x7f92cc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:56.068 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:56.069 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:56.069 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:56.069 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:56.069 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:56.069 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 279762, 2024-09-13T10:39:56.069 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:56.069 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:56.069 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:56.069 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:56.069 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:56.069 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:56.069 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.070 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.071 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:56.072 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.073 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.074 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.075 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:56.076 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.077 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:56.079 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.080 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:56.081 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:56.082 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.086 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.087 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.088 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:56.088 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.088 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.088 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:56.088 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:56.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92f2910640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.195:6800/1839191919 conn(0x7f92d803ff60 legacy=0x7f92d8042400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92f2910640 10 monclient: shutdown 2024-09-13T10:39:56.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92f2910640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:56.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92f2910640 1 -- 172.21.15.181:0/1068656022 >> v1:172.21.15.181:6791/0 conn(0x7f92ec1d4520 legacy=0x7f92ec1d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92f0ead640 1 -- 172.21.15.181:0/1068656022 reap_dead start 2024-09-13T10:39:56.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92f0ead640 1 -- 172.21.15.181:0/1068656022 reap_dead start 2024-09-13T10:39:56.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92f2910640 1 -- 172.21.15.181:0/1068656022 shutdown_connections 2024-09-13T10:39:56.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92f2910640 1 -- 172.21.15.181:0/1068656022 >> 172.21.15.181:0/1068656022 conn(0x7f92ec0a6640 msgr2=0x7f92ec141cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:56.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92f2910640 1 -- 172.21.15.181:0/1068656022 shutdown_connections 2024-09-13T10:39:56.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.059+0000 7f92f2910640 1 -- 172.21.15.181:0/1068656022 wait complete. 2024-09-13T10:39:56.090 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:56.090 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:39:56.090 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:39:56.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.192+0000 7f601d3bb640 10 monclient: get_monmap_and_config 2024-09-13T10:39:56.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.192+0000 7f601d3bb640 10 monclient: build_initial_monmap 2024-09-13T10:39:56.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.192+0000 7f601d3bb640 10 monclient: monmap: 2024-09-13T10:39:56.194 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:56.194 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.194 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:56.193559+0000 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:56.193559+0000 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:56.195 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.193+0000 7f601d3bb640 1 Processor -- start 2024-09-13T10:39:56.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.193+0000 7f601d3bb640 1 -- start start 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.193+0000 7f601d3bb640 10 monclient: init 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.193+0000 7f601d3bb640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.193+0000 7f601d3bb640 10 monclient: _add_conns ranks=[1,0,3,6,7,4,2,8,5] 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.194+0000 7f601d3bb640 10 monclient(hunting): picked mon.noname-f con 0x7f60180a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.194+0000 7f601d3bb640 10 monclient(hunting): picked mon.noname-a con 0x7f60180a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.194+0000 7f601d3bb640 10 monclient(hunting): picked mon.noname-g con 0x7f601813f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.194+0000 7f601d3bb640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60180a4bc0 con 0x7f60180a8340 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.194+0000 7f601d3bb640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f601813a320 con 0x7f60180a6640 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.194+0000 7f601d3bb640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60180a8100 con 0x7f601813f750 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.194+0000 7f601d3bb640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.194+0000 7f601d3bb640 10 monclient(hunting): authenticate will time out at 1335.699074s 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.194+0000 7f60167fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f60180a8340 0x7f6018139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:40966/0 (socket says 172.21.15.181:40966) 2024-09-13T10:39:56.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.194+0000 7f60167fc640 1 -- 172.21.15.181:0/4101003651 learned_addr learned my addr 172.21.15.181:0/4101003651 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:56.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f60167fc640 1 -- 172.21.15.181:0/4101003651 >> v1:172.21.15.181:6789/0 conn(0x7f60180a8340 legacy=0x7f6018139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6016ffd640 1 -- 172.21.15.181:0/4101003651 >> v1:172.21.15.195:6789/0 conn(0x7f60180a6640 legacy=0x7f6018139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f60177fe640 1 -- 172.21.15.181:0/4101003651 >> v1:172.21.15.195:6790/0 conn(0x7f601813f750 legacy=0x7f6018141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723634697 0 0) 0x7f60180a4bc0 con 0x7f60180a8340 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient(hunting): my global_id is 174186 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6004003520 con 0x7f60180a8340 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130870670 0 0) 0x7f601813a320 con 0x7f60180a6640 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient(hunting): my global_id is 134830 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60180a4bc0 con 0x7f60180a6640 2024-09-13T10:39:56.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3525622202 0 0) 0x7f60180a8100 con 0x7f601813f750 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient(hunting): my global_id is 164451 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f601813a320 con 0x7f601813f750 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 32418445 0 0) 0x7f6004003520 con 0x7f60180a8340 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 >> v1:172.21.15.195:6790/0 conn(0x7f601813f750 legacy=0x7f6018141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 >> v1:172.21.15.195:6789/0 conn(0x7f60180a6640 legacy=0x7f6018139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 monclient: found mon.noname-a 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60180a48e0 con 0x7f60180a8340 2024-09-13T10:39:56.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f601d3bb640 5 monclient: authenticate success, global_id 174186 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6000001ae0 con 0x7f60180a8340 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f601d3bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient: dump: 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.204 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f601d3bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f60000048a0 con 0x7f60180a8340 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f601d3bb640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:56.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 1 -- 172.21.15.181:0/4101003651 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6000004e10 con 0x7f60180a8340 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f601d3bb640 4 set_mon_vals no callback set 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.196+0000 7f6015ffb640 10 monclient: dump: 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.206 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.197+0000 7f601d3bb640 10 monclient: shutdown 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.197+0000 7f601d3bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.197+0000 7f601d3bb640 1 -- 172.21.15.181:0/4101003651 >> v1:172.21.15.181:6789/0 conn(0x7f60180a8340 legacy=0x7f6018139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.197+0000 7f601d3bb640 1 -- 172.21.15.181:0/4101003651 shutdown_connections 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.197+0000 7f601d3bb640 1 -- 172.21.15.181:0/4101003651 >> 172.21.15.181:0/4101003651 conn(0x7f6018077170 msgr2=0x7f60180abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.197+0000 7f601d3bb640 1 -- 172.21.15.181:0/4101003651 shutdown_connections 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.197+0000 7f601d3bb640 1 -- 172.21.15.181:0/4101003651 wait complete. 2024-09-13T10:39:56.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.198+0000 7f601d3bb640 10 monclient: build_initial_monmap 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.198+0000 7f601d3bb640 10 monclient: monmap: 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:56.208 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.198+0000 7f601d3bb640 1 Processor -- start 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.198+0000 7f601d3bb640 1 -- start start 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.198+0000 7f601d3bb640 10 monclient: init 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.198+0000 7f601d3bb640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.198+0000 7f601d3bb640 10 monclient: _add_conns ranks=[5,7,3,6,0,4,8,1,2] 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.198+0000 7f601d3bb640 10 monclient(hunting): picked mon.noname-h con 0x7f60180a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.198+0000 7f601d3bb640 10 monclient(hunting): picked mon.noname-i con 0x7f601813f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.198+0000 7f601d3bb640 10 monclient(hunting): picked mon.noname-g con 0x7f601813d170 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.198+0000 7f601d3bb640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f601813a680 con 0x7f601813d170 2024-09-13T10:39:56.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.199+0000 7f601d3bb640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60180a9c40 con 0x7f60180a8340 2024-09-13T10:39:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.199+0000 7f601d3bb640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f601813d600 con 0x7f601813f750 2024-09-13T10:39:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.199+0000 7f601d3bb640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.199+0000 7f601d3bb640 10 monclient(hunting): authenticate will time out at 1335.704036s 2024-09-13T10:39:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.199+0000 7f60167fc640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f601813f750 0x7f60181d3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:57342/0 (socket says 172.21.15.181:57342) 2024-09-13T10:39:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.199+0000 7f6016ffd640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f60180a8340 0x7f601813df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:51316/0 (socket says 172.21.15.181:51316) 2024-09-13T10:39:56.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.199+0000 7f60167fc640 1 -- 172.21.15.181:0/4277830436 learned_addr learned my addr 172.21.15.181:0/4277830436 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:56.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f6016ffd640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6791/0 conn(0x7f60180a8340 legacy=0x7f601813df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f60177fe640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6790/0 conn(0x7f601813d170 legacy=0x7f60181d6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f60167fc640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6792/0 conn(0x7f601813f750 legacy=0x7f60181d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353914918 0 0) 0x7f60180a9c40 con 0x7f60180a8340 2024-09-13T10:39:56.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): my global_id is 105791 2024-09-13T10:39:56.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ff8003550 con 0x7f60180a8340 2024-09-13T10:39:56.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3922156079 0 0) 0x7f601813a680 con 0x7f601813d170 2024-09-13T10:39:56.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): my global_id is 164460 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60180a9c40 con 0x7f601813d170 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199918647 0 0) 0x7f601813d600 con 0x7f601813f750 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): my global_id is 57832 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f601813a680 con 0x7f601813f750 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3563432203 0 0) 0x7f5ff8003550 con 0x7f60180a8340 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f601813d600 con 0x7f60180a8340 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6010003990 con 0x7f60180a8340 2024-09-13T10:39:56.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.218 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3761441011 0 0) 0x7f60180a9c40 con 0x7f601813d170 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ff8003550 con 0x7f601813d170 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2791442125 0 0) 0x7f601813a680 con 0x7f601813f750 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f60180a9c40 con 0x7f601813f750 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6008001cf0 con 0x7f601813d170 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:56.219 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.220 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6000004d90 con 0x7f601813f750 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.221 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2782155874 0 0) 0x7f601813d600 con 0x7f60180a8340 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6792/0 conn(0x7f601813f750 legacy=0x7f60181d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6790/0 conn(0x7f601813d170 legacy=0x7f60181d6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 monclient: found mon.h 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601813c140 con 0x7f60180a8340 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f600f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f601d3bb640 5 monclient: authenticate success, global_id 105791 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f601d3bb640 10 monclient: _renew_subs 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f601d3bb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f601d3bb640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f601813c420 con 0x7f60180a8340 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f601d3bb640 10 monclient: _renew_subs 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f601d3bb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.201+0000 7f601d3bb640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f601813b1e0 con 0x7f60180a8340 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f6016ffd640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6791/0 conn(0x7f60180a8340 legacy=0x7f601813df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f6016ffd640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6791/0 conn(0x7f60180a8340 legacy=0x7f601813df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:39:56.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f6016ffd640 1 --1- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6791/0 conn(0x7f60180a8340 0x7f601813df40 :-1 s=OPENED pgs=786 cs=1 l=1).handle_message read tag failed 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f6016ffd640 1 --1- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6791/0 conn(0x7f60180a8340 0x7f601813df40 :-1 s=OPENED pgs=786 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f600f7fe640 10 monclient: ms_handle_reset current mon v1:172.21.15.195:6791/0 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f600f7fe640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6791/0 conn(0x7f60180a8340 legacy=0x7f601813df40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f600f7fe640 10 monclient: _add_conns ranks=[6,1,8,7,3,5,0,4,2] 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f600f7fe640 10 monclient(hunting): picked mon.d con 0x7f5ff8006480 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f600f7fe640 10 monclient(hunting): picked mon.f con 0x7f5ff800a040 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f600f7fe640 10 monclient(hunting): picked mon.e con 0x7f5ff800df90 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f601813d600 con 0x7f5ff800a040 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f601813a680 con 0x7f5ff8006480 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5ff8014120 con 0x7f5ff800df90 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f600f7fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f601d3bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.202+0000 7f601d3bb640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f601813c660 con 0x7f6018077170 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f6016ffd640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.181:6792/0 conn(0x7f5ff8006480 legacy=0x7f5ff8008870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f60177fe640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.181:6793/0 conn(0x7f5ff800df90 legacy=0x7f5ff8010450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f60167fc640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6789/0 conn(0x7f5ff800a040 legacy=0x7f5ff800c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368253219 0 0) 0x7f5ff8014120 con 0x7f5ff800df90 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.181:6793/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f5ff80142f0 con 0x7f5ff800df90 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491861684 0 0) 0x7f601813a680 con 0x7f5ff8006480 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-13T10:39:56.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.181:6792/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f5ff8014120 con 0x7f5ff8006480 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3097988345 0 0) 0x7f601813d600 con 0x7f5ff800a040 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f601813a680 con 0x7f5ff800a040 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 848481257 0 0) 0x7f5ff80142f0 con 0x7f5ff800df90 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.181:6792/0 conn(0x7f5ff8006480 legacy=0x7f5ff8008870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6789/0 conn(0x7f5ff800a040 legacy=0x7f5ff800c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 monclient: found mon.e 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f60177fe640 1 -- 172.21.15.181:0/4277830436 reap_dead start 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:56.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f5ff8015540 con 0x7f5ff800df90 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6008003bb0 con 0x7f5ff800df90 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient: dump: 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.227 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6008003d50 con 0x7f5ff800df90 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f600f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.204+0000 7f60157fa640 4 set_mon_vals no callback set 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f6016ffd640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6789/0 conn(0x7f6018077170 legacy=0x7f6018130a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105741735 0 0) 0x7f601813c660 con 0x7f6018077170 2024-09-13T10:39:56.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f600f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f600f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f600f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f600f7fe640 10 monclient(hunting): my global_id is 134839 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ff80142f0 con 0x7f6018077170 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6008003f00 con 0x7f5ff800df90 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.8 v1:172.21.15.181:6793/0 6 ==== osd_map(311..311 src has 1..311) ==== 3506+0+0 (unknown 4201997143 0 0) 0x7f600804dd90 con 0x7f5ff800df90 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 705958537 0 0) 0x7f5ff80142f0 con 0x7f6018077170 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f601813c660 con 0x7f6018077170 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f60167fc640 10 monclient: get_auth_request con 0x7f5ff80457f0 auth_method 0 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.205+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6010005e80 con 0x7f6018077170 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.206+0000 7f600f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.206+0000 7f600f7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.206+0000 7f600f7fe640 10 monclient: dump: 2024-09-13T10:39:56.229 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.230 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.231 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.206+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 79267774 0 0) 0x7f601813c660 con 0x7f6018077170 2024-09-13T10:39:56.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.206+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6018143260 con 0x7f6018077170 2024-09-13T10:39:56.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.206+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6010006040 con 0x7f6018077170 2024-09-13T10:39:56.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.206+0000 7f600f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.206+0000 7f600f7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:56.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.206+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6789/0 conn(0x7f6018077170 legacy=0x7f6018130a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.206+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6789/0 conn(0x7f6018077170 legacy=0x7f6018130a30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:56.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.212+0000 7f601d3bb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:56.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.212+0000 7f601d3bb640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f601813cae0 con 0x7f6018069b40 2024-09-13T10:39:56.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.214+0000 7f6016ffd640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6789/0 conn(0x7f6018069b40 legacy=0x7f601813df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802291960 0 0) 0x7f601813b1e0 con 0x7f6018069b40 2024-09-13T10:39:56.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 10 monclient(hunting): my global_id is 134848 2024-09-13T10:39:56.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f601813c660 con 0x7f6018069b40 2024-09-13T10:39:56.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3712173258 0 0) 0x7f601813c660 con 0x7f6018069b40 2024-09-13T10:39:56.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f601813b1e0 con 0x7f6018069b40 2024-09-13T10:39:56.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f60100068b0 con 0x7f6018069b40 2024-09-13T10:39:56.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:56.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 10 monclient: dump: 2024-09-13T10:39:56.233 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.233 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.234 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3169127734 0 0) 0x7f601813b1e0 con 0x7f6018069b40 2024-09-13T10:39:56.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f601813c830 con 0x7f6018069b40 2024-09-13T10:39:56.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 169743586) 0x7f6010008c90 con 0x7f6018069b40 2024-09-13T10:39:56.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:56.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:56.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6789/0 conn(0x7f6018069b40 legacy=0x7f601813df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.215+0000 7f600f7fe640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6789/0 conn(0x7f6018069b40 legacy=0x7f601813df40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:56.235 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:56.235 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:56.235 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:56.235 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 128244, 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:56.236 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.237 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.238 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:56.239 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.240 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:56.243 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:56.244 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:56.245 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.247 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.248 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:56.249 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.250 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.251 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.252 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.253 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.254 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.255 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:56.255 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.255 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.255 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:56.255 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:56.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.216+0000 7f601d3bb640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5ff80457f0 legacy=0x7f5ff8047cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.216+0000 7f601d3bb640 10 monclient: shutdown 2024-09-13T10:39:56.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.216+0000 7f601d3bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:56.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.216+0000 7f601d3bb640 1 -- 172.21.15.181:0/4277830436 >> v1:172.21.15.181:6793/0 conn(0x7f5ff800df90 legacy=0x7f5ff8010450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.216+0000 7f601d3bb640 1 -- 172.21.15.181:0/4277830436 shutdown_connections 2024-09-13T10:39:56.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.216+0000 7f601d3bb640 1 -- 172.21.15.181:0/4277830436 >> 172.21.15.181:0/4277830436 conn(0x7f60180a6640 msgr2=0x7f60180a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:56.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.216+0000 7f601d3bb640 1 -- 172.21.15.181:0/4277830436 shutdown_connections 2024-09-13T10:39:56.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.216+0000 7f601d3bb640 1 -- 172.21.15.181:0/4277830436 wait complete. 2024-09-13T10:39:56.257 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:56.257 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:39:56.257 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:39:56.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.354+0000 7f0c6ea16640 10 monclient: get_monmap_and_config 2024-09-13T10:39:56.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.354+0000 7f0c6ea16640 10 monclient: build_initial_monmap 2024-09-13T10:39:56.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.354+0000 7f0c6ea16640 10 monclient: monmap: 2024-09-13T10:39:56.356 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:56.356 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.356 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:56.355171+0000 2024-09-13T10:39:56.356 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:56.355171+0000 2024-09-13T10:39:56.356 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:56.356 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.356 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:56.357 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:56.357 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:56.357 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:56.357 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:56.357 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:56.357 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:56.357 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:56.357 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:56.357 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.355+0000 7f0c6ea16640 1 Processor -- start 2024-09-13T10:39:56.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.355+0000 7f0c6ea16640 1 -- start start 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.355+0000 7f0c6ea16640 10 monclient: init 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.355+0000 7f0c6ea16640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.355+0000 7f0c6ea16640 10 monclient: _add_conns ranks=[2,5,1,0,7,6,3,4,8] 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.355+0000 7f0c6ea16640 10 monclient(hunting): picked mon.noname-b con 0x7f0c680a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.355+0000 7f0c6ea16640 10 monclient(hunting): picked mon.noname-h con 0x7f0c680a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.355+0000 7f0c6ea16640 10 monclient(hunting): picked mon.noname-f con 0x7f0c6813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.355+0000 7f0c6ea16640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c680a4bc0 con 0x7f0c6813f750 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.356+0000 7f0c6ea16640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6813a320 con 0x7f0c680a6640 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.356+0000 7f0c6ea16640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c680a8100 con 0x7f0c680a8340 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.356+0000 7f0c6ea16640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.356+0000 7f0c6ea16640 10 monclient(hunting): authenticate will time out at 1335.861036s 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.356+0000 7f0c67fff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f0c680a6640 0x7f0c68139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:46528/0 (socket says 172.21.15.181:46528) 2024-09-13T10:39:56.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.356+0000 7f0c67fff640 1 -- 172.21.15.181:0/4143313343 learned_addr learned my addr 172.21.15.181:0/4143313343 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:56.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c67fff640 1 -- 172.21.15.181:0/4143313343 >> v1:172.21.15.181:6790/0 conn(0x7f0c680a6640 legacy=0x7f0c68139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 1 -- 172.21.15.181:0/4143313343 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228394163 0 0) 0x7f0c6813a320 con 0x7f0c680a6640 2024-09-13T10:39:56.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient(hunting): my global_id is 174161 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 1 -- 172.21.15.181:0/4143313343 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c54003520 con 0x7f0c680a6640 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c5ffff640 1 -- 172.21.15.181:0/4143313343 >> v1:172.21.15.195:6791/0 conn(0x7f0c680a8340 legacy=0x7f0c68139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c6cfb3640 1 -- 172.21.15.181:0/4143313343 >> v1:172.21.15.195:6789/0 conn(0x7f0c6813f750 legacy=0x7f0c68141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c6cfb3640 1 -- 172.21.15.181:0/4143313343 >> v1:172.21.15.195:6789/0 conn(0x7f0c6813f750 legacy=0x7f0c68141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c6cfb3640 1 --1- 172.21.15.181:0/4143313343 >> v1:172.21.15.195:6789/0 conn(0x7f0c6813f750 0x7f0c68141b40 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 1 -- 172.21.15.181:0/4143313343 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3934055841 0 0) 0x7f0c54003520 con 0x7f0c680a6640 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 1 -- 172.21.15.181:0/4143313343 >> v1:172.21.15.195:6791/0 conn(0x7f0c680a8340 legacy=0x7f0c68139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 1 -- 172.21.15.181:0/4143313343 >> v1:172.21.15.195:6789/0 conn(0x7f0c6813f750 legacy=0x7f0c68141b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 1 monclient: found mon.noname-b 2024-09-13T10:39:56.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 1 -- 172.21.15.181:0/4143313343 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c680a48e0 con 0x7f0c680a6640 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c6ea16640 5 monclient: authenticate success, global_id 174161 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 1 -- 172.21.15.181:0/4143313343 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c58001ba0 con 0x7f0c680a6640 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c6ea16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient: dump: 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.365 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.366 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c6ea16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 1 -- 172.21.15.181:0/4143313343 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c580048a0 con 0x7f0c680a6640 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c6ea16640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 1 -- 172.21.15.181:0/4143313343 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c58004e10 con 0x7f0c680a6640 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c6ea16640 4 set_mon_vals no callback set 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.358+0000 7f0c677fe640 10 monclient: dump: 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.367 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.359+0000 7f0c6ea16640 10 monclient: shutdown 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.359+0000 7f0c6ea16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:56.368 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.359+0000 7f0c6ea16640 1 -- 172.21.15.181:0/4143313343 >> v1:172.21.15.181:6790/0 conn(0x7f0c680a6640 legacy=0x7f0c68139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.359+0000 7f0c6ea16640 1 -- 172.21.15.181:0/4143313343 shutdown_connections 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.359+0000 7f0c6ea16640 1 -- 172.21.15.181:0/4143313343 >> 172.21.15.181:0/4143313343 conn(0x7f0c68077170 msgr2=0x7f0c680abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.359+0000 7f0c6ea16640 1 -- 172.21.15.181:0/4143313343 shutdown_connections 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.359+0000 7f0c6ea16640 1 -- 172.21.15.181:0/4143313343 wait complete. 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.359+0000 7f0c6ea16640 10 monclient: build_initial_monmap 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.359+0000 7f0c6ea16640 10 monclient: monmap: 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:56.369 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 1 Processor -- start 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 1 -- start start 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 10 monclient: init 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 10 monclient: _add_conns ranks=[1,4,2,7,8,5,6,3,0] 2024-09-13T10:39:56.370 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 10 monclient(hunting): picked mon.noname-f con 0x7f0c680a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:56.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 10 monclient(hunting): picked mon.noname-c con 0x7f0c6813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:56.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 10 monclient(hunting): picked mon.noname-b con 0x7f0c6813d870 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:56.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6813e390 con 0x7f0c680a8340 2024-09-13T10:39:56.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c680a9c40 con 0x7f0c6813d870 2024-09-13T10:39:56.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c68134920 con 0x7f0c6813f750 2024-09-13T10:39:56.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6ea16640 10 monclient(hunting): authenticate will time out at 1335.865679s 2024-09-13T10:39:56.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6cfb3640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f0c6813d870 0x7f0c681d6e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:46538/0 (socket says 172.21.15.181:46538) 2024-09-13T10:39:56.371 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.360+0000 7f0c6cfb3640 1 -- 172.21.15.181:0/755958426 learned_addr learned my addr 172.21.15.181:0/755958426 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.362+0000 7f0c6cfb3640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.181:6790/0 conn(0x7f0c6813d870 legacy=0x7f0c681d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.362+0000 7f0c5ffff640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.181:6791/0 conn(0x7f0c6813f750 legacy=0x7f0c681d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.362+0000 7f0c67fff640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.195:6789/0 conn(0x7f0c680a8340 legacy=0x7f0c6812f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2847223911 0 0) 0x7f0c680a9c40 con 0x7f0c6813d870 2024-09-13T10:39:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): my global_id is 174170 2024-09-13T10:39:56.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c48003520 con 0x7f0c6813d870 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860562211 0 0) 0x7f0c68134920 con 0x7f0c6813f750 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): my global_id is 174172 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c680a9c40 con 0x7f0c6813f750 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1695389732 0 0) 0x7f0c48003520 con 0x7f0c6813d870 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c68134920 con 0x7f0c6813d870 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c60004720 con 0x7f0c6813d870 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): dump: 2024-09-13T10:39:56.376 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.377 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4158415133 0 0) 0x7f0c680a9c40 con 0x7f0c6813f750 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c48003520 con 0x7f0c6813f750 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c50003610 con 0x7f0c6813f750 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient(hunting): dump: 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.378 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1350168159 0 0) 0x7f0c68134920 con 0x7f0c6813d870 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.181:6791/0 conn(0x7f0c6813f750 legacy=0x7f0c681d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.195:6789/0 conn(0x7f0c680a8340 legacy=0x7f0c6812f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.379 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 monclient: found mon.b 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c68134c00 con 0x7f0c6813d870 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c6ea16640 5 monclient: authenticate success, global_id 174170 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c6ea16640 10 monclient: _renew_subs 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c6ea16640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c6ea16640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6813e5b0 con 0x7f0c6813d870 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c6ea16640 10 monclient: _renew_subs 2024-09-13T10:39:56.380 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c6ea16640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c6ea16640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0c6813d0c0 con 0x7f0c6813d870 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c60001600 con 0x7f0c6813d870 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c60001b70 con 0x7f0c6813d870 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c66ffd640 4 set_mon_vals no callback set 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.363+0000 7f0c657fa640 10 monclient: dump: 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.381 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.364+0000 7f0c6ea16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.364+0000 7f0c6ea16640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0c4c0065c0 con 0x7f0c4c002860 2024-09-13T10:39:56.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.364+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0c60001d10 con 0x7f0c6813d870 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.364+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(311..311 src has 1..311) ==== 3506+0+0 (unknown 4201997143 0 0) 0x7f0c6004e480 con 0x7f0c6813d870 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.364+0000 7f0c5ffff640 10 monclient: get_auth_request con 0x7f0c48040190 auth_method 0 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.366+0000 7f0c67fff640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.195:6790/0 conn(0x7f0c4c002860 legacy=0x7f0c4c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.366+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063818740 0 0) 0x7f0c4c0065c0 con 0x7f0c4c002860 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.366+0000 7f0c657fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.366+0000 7f0c657fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.366+0000 7f0c657fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.366+0000 7f0c657fa640 10 monclient(hunting): my global_id is 164469 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.366+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c68134920 con 0x7f0c4c002860 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2402259146 0 0) 0x7f0c68134920 con 0x7f0c4c002860 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c4c0065c0 con 0x7f0c4c002860 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c580015e0 con 0x7f0c4c002860 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.383 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 10 monclient: dump: 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.384 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1261332026 0 0) 0x7f0c4c0065c0 con 0x7f0c4c002860 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c4c00a160 con 0x7f0c4c002860 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0c580047e0 con 0x7f0c4c002860 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.195:6790/0 conn(0x7f0c4c002860 legacy=0x7f0c4c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.367+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.195:6790/0 conn(0x7f0c4c002860 legacy=0x7f0c4c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.373+0000 7f0c6ea16640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:56.385 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.373+0000 7f0c6ea16640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0c4c009e50 con 0x7f0c4c009110 2024-09-13T10:39:56.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c67fff640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.195:6790/0 conn(0x7f0c4c009110 legacy=0x7f0c4c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822382349 0 0) 0x7f0c4c009e50 con 0x7f0c4c009110 2024-09-13T10:39:56.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 10 monclient(hunting): my global_id is 164478 2024-09-13T10:39:56.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c4c0065c0 con 0x7f0c4c009110 2024-09-13T10:39:56.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2712421909 0 0) 0x7f0c4c0065c0 con 0x7f0c4c009110 2024-09-13T10:39:56.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c4c009e50 con 0x7f0c4c009110 2024-09-13T10:39:56.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0c580053a0 con 0x7f0c4c009110 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 10 monclient: dump: 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.388 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1372719301 0 0) 0x7f0c4c009e50 con 0x7f0c4c009110 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0c4c00c3f0 con 0x7f0c4c009110 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 2989840128) 0x7f0c58008160 con 0x7f0c4c009110 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.195:6790/0 conn(0x7f0c4c009110 legacy=0x7f0c4c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.389 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.376+0000 7f0c657fa640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.195:6790/0 conn(0x7f0c4c009110 legacy=0x7f0c4c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:56.390 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:56.390 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:56.390 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:56.390 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:56.390 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:56.390 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 75835, 2024-09-13T10:39:56.390 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:56.390 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:56.390 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:56.391 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:56.392 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.393 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:56.394 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.395 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.396 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.398 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.399 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.401 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:56.402 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:56.404 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.405 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:56.408 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.409 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.409 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:56.409 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:56.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.377+0000 7f0c6ea16640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0c48040190 legacy=0x7f0c48042650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.377+0000 7f0c6ea16640 10 monclient: shutdown 2024-09-13T10:39:56.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.377+0000 7f0c6ea16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:56.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.377+0000 7f0c6ea16640 1 -- 172.21.15.181:0/755958426 >> v1:172.21.15.181:6790/0 conn(0x7f0c6813d870 legacy=0x7f0c681d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.377+0000 7f0c6cfb3640 1 -- 172.21.15.181:0/755958426 reap_dead start 2024-09-13T10:39:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.377+0000 7f0c6cfb3640 1 -- 172.21.15.181:0/755958426 reap_dead start 2024-09-13T10:39:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.377+0000 7f0c6ea16640 1 -- 172.21.15.181:0/755958426 shutdown_connections 2024-09-13T10:39:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.377+0000 7f0c6ea16640 1 -- 172.21.15.181:0/755958426 >> 172.21.15.181:0/755958426 conn(0x7f0c680a6640 msgr2=0x7f0c680a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.377+0000 7f0c6ea16640 1 -- 172.21.15.181:0/755958426 shutdown_connections 2024-09-13T10:39:56.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.377+0000 7f0c6ea16640 1 -- 172.21.15.181:0/755958426 wait complete. 2024-09-13T10:39:56.411 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:56.411 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:39:56.411 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:39:56.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.509+0000 7f41f9594640 10 monclient: get_monmap_and_config 2024-09-13T10:39:56.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.509+0000 7f41f9594640 10 monclient: build_initial_monmap 2024-09-13T10:39:56.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.509+0000 7f41f9594640 10 monclient: monmap: 2024-09-13T10:39:56.511 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:56.511 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.511 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:56.510054+0000 2024-09-13T10:39:56.511 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:56.510054+0000 2024-09-13T10:39:56.511 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:56.511 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.511 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:56.511 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:56.512 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:56.512 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:56.512 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:56.512 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:56.512 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:56.512 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:56.512 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:56.512 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 1 Processor -- start 2024-09-13T10:39:56.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 1 -- start start 2024-09-13T10:39:56.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 10 monclient: init 2024-09-13T10:39:56.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 10 monclient: _add_conns ranks=[3,6,5,8,2,4,1,0,7] 2024-09-13T10:39:56.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 10 monclient(hunting): picked mon.noname-g con 0x7f41f40a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:56.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 10 monclient(hunting): picked mon.noname-d con 0x7f41f40a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:56.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 10 monclient(hunting): picked mon.noname-h con 0x7f41f413f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:56.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f40a5fe0 con 0x7f41f40a66d0 2024-09-13T10:39:56.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f40a8080 con 0x7f41f413f9a0 2024-09-13T10:39:56.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f40a42c0 con 0x7f41f40a6ab0 2024-09-13T10:39:56.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f9594640 10 monclient(hunting): authenticate will time out at 1336.015562s 2024-09-13T10:39:56.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f27fc640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f41f40a6ab0 0x7f41f40a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:36620/0 (socket says 172.21.15.181:36620) 2024-09-13T10:39:56.514 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.510+0000 7f41f27fc640 1 -- 172.21.15.181:0/559771943 learned_addr learned my addr 172.21.15.181:0/559771943 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:56.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.512+0000 7f41f27fc640 1 -- 172.21.15.181:0/559771943 >> v1:172.21.15.181:6792/0 conn(0x7f41f40a6ab0 legacy=0x7f41f40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f37fe640 1 -- 172.21.15.181:0/559771943 >> v1:172.21.15.195:6791/0 conn(0x7f41f413f9a0 legacy=0x7f41f4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f2ffd640 1 -- 172.21.15.181:0/559771943 >> v1:172.21.15.195:6790/0 conn(0x7f41f40a66d0 legacy=0x7f41f40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093484845 0 0) 0x7f41f40a42c0 con 0x7f41f40a6ab0 2024-09-13T10:39:56.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.518 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient(hunting): my global_id is 174183 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41dc003520 con 0x7f41f40a6ab0 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3485905128 0 0) 0x7f41f40a8080 con 0x7f41f413f9a0 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient(hunting): my global_id is 105809 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f40a42c0 con 0x7f41f413f9a0 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2095820380 0 0) 0x7f41f40a5fe0 con 0x7f41f40a66d0 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.519 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient(hunting): my global_id is 164487 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f40a8080 con 0x7f41f40a66d0 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3198662913 0 0) 0x7f41dc003520 con 0x7f41f40a6ab0 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 >> v1:172.21.15.195:6791/0 conn(0x7f41f413f9a0 legacy=0x7f41f4141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 >> v1:172.21.15.195:6790/0 conn(0x7f41f40a66d0 legacy=0x7f41f40a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 monclient: found mon.noname-d 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f41464e0 con 0x7f41f40a6ab0 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.520 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f9594640 5 monclient: authenticate success, global_id 174183 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41e4001ad0 con 0x7f41f40a6ab0 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f9594640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient: dump: 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.521 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f9594640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41e4001d20 con 0x7f41f40a6ab0 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f9594640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f9594640 4 set_mon_vals no callback set 2024-09-13T10:39:56.522 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 1 -- 172.21.15.181:0/559771943 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41e4004be0 con 0x7f41f40a6ab0 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.513+0000 7f41f1ffb640 10 monclient: dump: 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.523 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.514+0000 7f41f9594640 10 monclient: shutdown 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.514+0000 7f41f9594640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.514+0000 7f41f9594640 1 -- 172.21.15.181:0/559771943 >> v1:172.21.15.181:6792/0 conn(0x7f41f40a6ab0 legacy=0x7f41f40a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.514+0000 7f41f9594640 1 -- 172.21.15.181:0/559771943 shutdown_connections 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.514+0000 7f41f9594640 1 -- 172.21.15.181:0/559771943 >> 172.21.15.181:0/559771943 conn(0x7f41f40abcd0 msgr2=0x7f41f40ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.514+0000 7f41f9594640 1 -- 172.21.15.181:0/559771943 shutdown_connections 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.514+0000 7f41f9594640 1 -- 172.21.15.181:0/559771943 wait complete. 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.514+0000 7f41f9594640 10 monclient: build_initial_monmap 2024-09-13T10:39:56.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.514+0000 7f41f9594640 10 monclient: monmap: 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:56.525 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 1 Processor -- start 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 1 -- start start 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 10 monclient: init 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 10 monclient: _add_conns ranks=[1,7,8,0,3,5,2,4,6] 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 10 monclient(hunting): picked mon.noname-f con 0x7f41f40a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 10 monclient(hunting): picked mon.noname-i con 0x7f41f40a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 10 monclient(hunting): picked mon.noname-e con 0x7f41f413f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f413d1e0 con 0x7f41f40a66d0 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f4068a90 con 0x7f41f40a6ab0 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f41cb9e0 con 0x7f41f413f9a0 2024-09-13T10:39:56.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f9594640 10 monclient(hunting): authenticate will time out at 1336.020760s 2024-09-13T10:39:56.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f37fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f41f413f9a0 0x7f41f41d6e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:42580/0 (socket says 172.21.15.181:42580) 2024-09-13T10:39:56.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.515+0000 7f41f37fe640 1 -- 172.21.15.181:0/3415893697 learned_addr learned my addr 172.21.15.181:0/3415893697 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:56.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.517+0000 7f41f37fe640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.181:6793/0 conn(0x7f41f413f9a0 legacy=0x7f41f41d6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41f2ffd640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.195:6789/0 conn(0x7f41f40a66d0 legacy=0x7f41f40a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41f27fc640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.195:6792/0 conn(0x7f41f40a6ab0 legacy=0x7f41f41d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108173360 0 0) 0x7f41f41cb9e0 con 0x7f41f413f9a0 2024-09-13T10:39:56.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.531 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): my global_id is 105947 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e0003520 con 0x7f41f413f9a0 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276533518 0 0) 0x7f41f413d1e0 con 0x7f41f40a66d0 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): my global_id is 134857 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f41cb9e0 con 0x7f41f40a66d0 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3921403900 0 0) 0x7f41f4068a90 con 0x7f41f40a6ab0 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): my global_id is 57841 2024-09-13T10:39:56.532 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f413d1e0 con 0x7f41f40a6ab0 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3179864599 0 0) 0x7f41e0003520 con 0x7f41f413f9a0 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41f4068a90 con 0x7f41f413f9a0 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41ec003990 con 0x7f41f413f9a0 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.533 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1631037093 0 0) 0x7f41f4068a90 con 0x7f41f413f9a0 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.195:6792/0 conn(0x7f41f40a6ab0 legacy=0x7f41f41d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.534 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.195:6789/0 conn(0x7f41f40a66d0 legacy=0x7f41f40a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 monclient: found mon.e 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f413f540 con 0x7f41f413f9a0 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41f9594640 5 monclient: authenticate success, global_id 105947 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41f9594640 10 monclient: _renew_subs 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41f9594640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41f9594640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f41f413dd40 con 0x7f41f413f9a0 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41f9594640 10 monclient: _renew_subs 2024-09-13T10:39:56.535 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41f9594640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41f9594640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f41f40a2680 con 0x7f41f413f9a0 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41ec003e90 con 0x7f41f413f9a0 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41ec0043c0 con 0x7f41f413f9a0 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41f17fa640 4 set_mon_vals no callback set 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.518+0000 7f41db7fe640 10 monclient: dump: 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.536 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.519+0000 7f41f9594640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.519+0000 7f41f9594640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f41d40065c0 con 0x7f41d4002860 2024-09-13T10:39:56.537 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.519+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f41ec004560 con 0x7f41f413f9a0 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.519+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(311..311 src has 1..311) ==== 3506+0+0 (unknown 4201997143 0 0) 0x7f41ec04e510 con 0x7f41f413f9a0 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.519+0000 7f41f27fc640 10 monclient: get_auth_request con 0x7f41e003fd70 auth_method 0 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.521+0000 7f41f2ffd640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.195:6791/0 conn(0x7f41d4002860 legacy=0x7f41d4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.521+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 770533897 0 0) 0x7f41d40065c0 con 0x7f41d4002860 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.521+0000 7f41db7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.521+0000 7f41db7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.521+0000 7f41db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.521+0000 7f41db7fe640 10 monclient(hunting): my global_id is 105818 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.521+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f4068a90 con 0x7f41d4002860 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1689256182 0 0) 0x7f41f4068a90 con 0x7f41d4002860 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41d40065c0 con 0x7f41d4002860 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41e8001c80 con 0x7f41d4002860 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.538 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 10 monclient: dump: 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.539 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.540 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.540 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.540 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1988658356 0 0) 0x7f41d40065c0 con 0x7f41d4002860 2024-09-13T10:39:56.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41d400a160 con 0x7f41d4002860 2024-09-13T10:39:56.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f41e80057c0 con 0x7f41d4002860 2024-09-13T10:39:56.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:56.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.195:6791/0 conn(0x7f41d4002860 legacy=0x7f41d4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.522+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.195:6791/0 conn(0x7f41d4002860 legacy=0x7f41d4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:56.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.528+0000 7f41f9594640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:56.540 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.528+0000 7f41f9594640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f41d4009e70 con 0x7f41d4009130 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41f2ffd640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.195:6791/0 conn(0x7f41d4009130 legacy=0x7f41d40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2245311938 0 0) 0x7f41d4009e70 con 0x7f41d4009130 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 10 monclient(hunting): my global_id is 105827 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d40065c0 con 0x7f41d4009130 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3067854909 0 0) 0x7f41d40065c0 con 0x7f41d4009130 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41d4009e70 con 0x7f41d4009130 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f41e8003d50 con 0x7f41d4009130 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:56.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 10 monclient: dump: 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.543 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.544 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.544 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.544 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 444084161 0 0) 0x7f41d4009e70 con 0x7f41d4009130 2024-09-13T10:39:56.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.531+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f41d400c3f0 con 0x7f41d4009130 2024-09-13T10:39:56.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 4059104036) 0x7f41e8004090 con 0x7f41d4009130 2024-09-13T10:39:56.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41db7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:56.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41db7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:56.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.195:6791/0 conn(0x7f41d4009130 legacy=0x7f41d40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.544 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41db7fe640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.195:6791/0 conn(0x7f41d4009130 legacy=0x7f41d40095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 280231, 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:56.545 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:56.546 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:56.546 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:56.546 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:56.546 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.546 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:39:56.546 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:56.546 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:56.546 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:56.546 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.546 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.546 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.546 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.547 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:56.548 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:56.549 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.550 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:56.551 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.552 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.553 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:56.555 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.556 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.557 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.558 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:56.559 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.560 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.562 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:56.563 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.564 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.564 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:56.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.564 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.564 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.564 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:56.564 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.564 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.564 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:56.564 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:56.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41f9594640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.195:6800/1839191919 conn(0x7f41e003fd70 legacy=0x7f41e0042230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41f9594640 10 monclient: shutdown 2024-09-13T10:39:56.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41f9594640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:56.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41f9594640 1 -- 172.21.15.181:0/3415893697 >> v1:172.21.15.181:6793/0 conn(0x7f41f413f9a0 legacy=0x7f41f41d6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41f37fe640 1 -- 172.21.15.181:0/3415893697 reap_dead start 2024-09-13T10:39:56.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41f37fe640 1 -- 172.21.15.181:0/3415893697 reap_dead start 2024-09-13T10:39:56.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41f9594640 1 -- 172.21.15.181:0/3415893697 shutdown_connections 2024-09-13T10:39:56.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41f9594640 1 -- 172.21.15.181:0/3415893697 >> 172.21.15.181:0/3415893697 conn(0x7f41f40abcd0 msgr2=0x7f41f40a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:56.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41f9594640 1 -- 172.21.15.181:0/3415893697 shutdown_connections 2024-09-13T10:39:56.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.532+0000 7f41f9594640 1 -- 172.21.15.181:0/3415893697 wait complete. 2024-09-13T10:39:56.566 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:56.566 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:39:56.567 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:39:56.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.662+0000 7fb8a9b89640 10 monclient: get_monmap_and_config 2024-09-13T10:39:56.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.663+0000 7fb8a9b89640 10 monclient: build_initial_monmap 2024-09-13T10:39:56.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.663+0000 7fb8a9b89640 10 monclient: monmap: 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:56.663627+0000 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:56.663627+0000 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:56.665 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:56.666 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:56.666 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:56.666 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.663+0000 7fb8a9b89640 1 Processor -- start 2024-09-13T10:39:56.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.663+0000 7fb8a9b89640 1 -- start start 2024-09-13T10:39:56.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.663+0000 7fb8a9b89640 10 monclient: init 2024-09-13T10:39:56.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.664+0000 7fb8a9b89640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.664+0000 7fb8a9b89640 10 monclient: _add_conns ranks=[1,3,4,6,0,8,2,5,7] 2024-09-13T10:39:56.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.664+0000 7fb8a9b89640 10 monclient(hunting): picked mon.noname-f con 0x7fb8a40a54e0 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:56.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.664+0000 7fb8a9b89640 10 monclient(hunting): picked mon.noname-g con 0x7fb8a40a5fd0 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:56.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.664+0000 7fb8a9b89640 10 monclient(hunting): picked mon.noname-c con 0x7fb8a40722e0 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:56.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.664+0000 7fb8a9b89640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a4070310 con 0x7fb8a40a54e0 2024-09-13T10:39:56.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.664+0000 7fb8a9b89640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a40a7080 con 0x7fb8a40a5fd0 2024-09-13T10:39:56.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.664+0000 7fb8a9b89640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a406ef30 con 0x7fb8a40722e0 2024-09-13T10:39:56.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.664+0000 7fb8a9b89640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.664+0000 7fb8a9b89640 10 monclient(hunting): authenticate will time out at 1336.169345s 2024-09-13T10:39:56.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.664+0000 7fb8a3fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fb8a40722e0 0x7fb8a4141ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51506/0 (socket says 172.21.15.181:51506) 2024-09-13T10:39:56.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.664+0000 7fb8a3fff640 1 -- 172.21.15.181:0/787988279 learned_addr learned my addr 172.21.15.181:0/787988279 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:56.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a3fff640 1 -- 172.21.15.181:0/787988279 >> v1:172.21.15.181:6791/0 conn(0x7fb8a40722e0 legacy=0x7fb8a4141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a2ffd640 1 -- 172.21.15.181:0/787988279 >> v1:172.21.15.195:6790/0 conn(0x7fb8a40a5fd0 legacy=0x7fb8a413e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a37fe640 1 -- 172.21.15.181:0/787988279 >> v1:172.21.15.195:6789/0 conn(0x7fb8a40a54e0 legacy=0x7fb8a40a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065723261 0 0) 0x7fb8a406ef30 con 0x7fb8a40722e0 2024-09-13T10:39:56.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 10 monclient(hunting): my global_id is 174181 2024-09-13T10:39:56.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb88c003520 con 0x7fb8a40722e0 2024-09-13T10:39:56.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3991143523 0 0) 0x7fb8a40a7080 con 0x7fb8a40a5fd0 2024-09-13T10:39:56.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 10 monclient(hunting): my global_id is 164496 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a406ef30 con 0x7fb8a40a5fd0 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2820186214 0 0) 0x7fb8a4070310 con 0x7fb8a40a54e0 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 10 monclient(hunting): my global_id is 134866 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.666+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a40a7080 con 0x7fb8a40a54e0 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2520431920 0 0) 0x7fb88c003520 con 0x7fb8a40722e0 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 >> v1:172.21.15.195:6790/0 conn(0x7fb8a40a5fd0 legacy=0x7fb8a413e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 >> v1:172.21.15.195:6789/0 conn(0x7fb8a40a54e0 legacy=0x7fb8a40a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.673 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 1 monclient: found mon.noname-c 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a406f730 con 0x7fb8a40722e0 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb89c001e60 con 0x7fb8a40722e0 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a9b89640 5 monclient: authenticate success, global_id 174181 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a9b89640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 10 monclient: dump: 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.674 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.675 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a9b89640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb89c004c20 con 0x7fb8a40722e0 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 1 -- 172.21.15.181:0/787988279 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb89c005190 con 0x7fb8a40722e0 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a9b89640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a9b89640 4 set_mon_vals no callback set 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a27fc640 10 monclient: dump: 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.676 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.677 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a9b89640 10 monclient: shutdown 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a9b89640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a9b89640 1 -- 172.21.15.181:0/787988279 >> v1:172.21.15.181:6791/0 conn(0x7fb8a40722e0 legacy=0x7fb8a4141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a9b89640 1 -- 172.21.15.181:0/787988279 shutdown_connections 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a9b89640 1 -- 172.21.15.181:0/787988279 >> 172.21.15.181:0/787988279 conn(0x7fb8a40aa1c0 msgr2=0x7fb8a40a65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a9b89640 1 -- 172.21.15.181:0/787988279 shutdown_connections 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.667+0000 7fb8a9b89640 1 -- 172.21.15.181:0/787988279 wait complete. 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.668+0000 7fb8a9b89640 10 monclient: build_initial_monmap 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.668+0000 7fb8a9b89640 10 monclient: monmap: 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:56.678 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.668+0000 7fb8a9b89640 1 Processor -- start 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.668+0000 7fb8a9b89640 1 -- start start 2024-09-13T10:39:56.679 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.668+0000 7fb8a9b89640 10 monclient: init 2024-09-13T10:39:56.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.669+0000 7fb8a9b89640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.669+0000 7fb8a9b89640 10 monclient: _add_conns ranks=[3,8,5,0,7,4,1,2,6] 2024-09-13T10:39:56.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.669+0000 7fb8a9b89640 10 monclient(hunting): picked mon.noname-g con 0x7fb8a40722e0 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:56.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.669+0000 7fb8a9b89640 10 monclient(hunting): picked mon.noname-e con 0x7fb8a40a54e0 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:56.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.669+0000 7fb8a9b89640 10 monclient(hunting): picked mon.noname-h con 0x7fb8a40a5fd0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:56.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.669+0000 7fb8a9b89640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a413b170 con 0x7fb8a40722e0 2024-09-13T10:39:56.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.669+0000 7fb8a9b89640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a40a8330 con 0x7fb8a40a5fd0 2024-09-13T10:39:56.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.669+0000 7fb8a9b89640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a41ce240 con 0x7fb8a40a54e0 2024-09-13T10:39:56.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.669+0000 7fb8a9b89640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.669+0000 7fb8a9b89640 10 monclient(hunting): authenticate will time out at 1336.174232s 2024-09-13T10:39:56.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.669+0000 7fb8a2ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fb8a40a54e0 0x7fb8a41d2f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:42582/0 (socket says 172.21.15.181:42582) 2024-09-13T10:39:56.680 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.669+0000 7fb8a2ffd640 1 -- 172.21.15.181:0/1945776531 learned_addr learned my addr 172.21.15.181:0/1945776531 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:56.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb8a2ffd640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.181:6793/0 conn(0x7fb8a40a54e0 legacy=0x7fb8a41d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb8a37fe640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.195:6790/0 conn(0x7fb8a40722e0 legacy=0x7fb8a4141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb8a3fff640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.195:6791/0 conn(0x7fb8a40a5fd0 legacy=0x7fb8a41d6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132461546 0 0) 0x7fb8a41ce240 con 0x7fb8a40a54e0 2024-09-13T10:39:56.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): my global_id is 105956 2024-09-13T10:39:56.685 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb890003550 con 0x7fb8a40a54e0 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3146817576 0 0) 0x7fb8a413b170 con 0x7fb8a40722e0 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): my global_id is 164505 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a41ce240 con 0x7fb8a40722e0 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288988354 0 0) 0x7fb8a40a8330 con 0x7fb8a40a5fd0 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): my global_id is 105836 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a413b170 con 0x7fb8a40a5fd0 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 736768749 0 0) 0x7fb890003550 con 0x7fb8a40a54e0 2024-09-13T10:39:56.686 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8a40a8330 con 0x7fb8a40a54e0 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb898003610 con 0x7fb8a40a54e0 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): dump: 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.687 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.688 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.688 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.688 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.688 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.688 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.688 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:56.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2593877132 0 0) 0x7fb8a41ce240 con 0x7fb8a40722e0 2024-09-13T10:39:56.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb890003550 con 0x7fb8a40722e0 2024-09-13T10:39:56.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb894001c80 con 0x7fb8a40722e0 2024-09-13T10:39:56.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.688 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): dump: 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.689 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2005131995 0 0) 0x7fb8a413b170 con 0x7fb8a40a5fd0 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8a41ce240 con 0x7fb8a40a5fd0 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb89c005110 con 0x7fb8a40a5fd0 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 10 monclient(hunting): dump: 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.690 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.671+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 361754926 0 0) 0x7fb8a40a8330 con 0x7fb8a40a54e0 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.195:6791/0 conn(0x7fb8a40a5fd0 legacy=0x7fb8a41d6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.691 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.195:6790/0 conn(0x7fb8a40722e0 legacy=0x7fb8a4141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 1 monclient: found mon.e 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a413d4d0 con 0x7fb8a40a54e0 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb8a9b89640 5 monclient: authenticate success, global_id 105956 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb8a9b89640 10 monclient: _renew_subs 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb8a9b89640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb8a9b89640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a413bcd0 con 0x7fb8a40a54e0 2024-09-13T10:39:56.692 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb8a9b89640 10 monclient: _renew_subs 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb8a9b89640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb8a9b89640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fb8a41cdb90 con 0x7fb8a40a54e0 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb898003b90 con 0x7fb8a40a54e0 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb898004080 con 0x7fb8a40a54e0 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb8a1ffb640 4 set_mon_vals no callback set 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 10 monclient: dump: 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.693 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb8a9b89640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.694 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb8a9b89640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb8840065c0 con 0x7fb884002860 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.672+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fb898004220 con 0x7fb8a40a54e0 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.673+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(311..311 src has 1..311) ==== 3506+0+0 (unknown 4201997143 0 0) 0x7fb89804e2e0 con 0x7fb8a40a54e0 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.673+0000 7fb8a3fff640 10 monclient: get_auth_request con 0x7fb890040530 auth_method 0 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb8a37fe640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.195:6792/0 conn(0x7fb884002860 legacy=0x7fb884004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386263511 0 0) 0x7fb8840065c0 con 0x7fb884002860 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 10 monclient(hunting): my global_id is 57850 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a40a8330 con 0x7fb884002860 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 881261900 0 0) 0x7fb8a40a8330 con 0x7fb884002860 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8840065c0 con 0x7fb884002860 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb894003c00 con 0x7fb884002860 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.695 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 10 monclient: dump: 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.696 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.697 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.697 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.697 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2302112904 0 0) 0x7fb8840065c0 con 0x7fb884002860 2024-09-13T10:39:56.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.675+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb88400a160 con 0x7fb884002860 2024-09-13T10:39:56.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.676+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb894003fb0 con 0x7fb884002860 2024-09-13T10:39:56.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.676+0000 7fb88bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.676+0000 7fb88bfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:56.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.676+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.195:6792/0 conn(0x7fb884002860 legacy=0x7fb884004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.676+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.195:6792/0 conn(0x7fb884002860 legacy=0x7fb884004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:56.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.682+0000 7fb8a9b89640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:56.697 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.682+0000 7fb8a9b89640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb884009e50 con 0x7fb884009110 2024-09-13T10:39:56.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.684+0000 7fb8a37fe640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.195:6792/0 conn(0x7fb884009110 legacy=0x7fb8840095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.684+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 719570963 0 0) 0x7fb884009e50 con 0x7fb884009110 2024-09-13T10:39:56.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.684+0000 7fb88bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.684+0000 7fb88bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.684+0000 7fb88bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.684+0000 7fb88bfff640 10 monclient(hunting): my global_id is 57859 2024-09-13T10:39:56.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.684+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8840065c0 con 0x7fb884009110 2024-09-13T10:39:56.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2143831013 0 0) 0x7fb8840065c0 con 0x7fb884009110 2024-09-13T10:39:56.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb884009e50 con 0x7fb884009110 2024-09-13T10:39:56.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fb8940043e0 con 0x7fb884009110 2024-09-13T10:39:56.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.699 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 10 monclient: dump: 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.700 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.701 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.701 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3209324547 0 0) 0x7fb884009e50 con 0x7fb884009110 2024-09-13T10:39:56.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb88400c3f0 con 0x7fb884009110 2024-09-13T10:39:56.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7896 (unknown 0 0 4014318819) 0x7fb894007ee0 con 0x7fb884009110 2024-09-13T10:39:56.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:56.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:56.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.195:6792/0 conn(0x7fb884009110 legacy=0x7fb8840095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.701 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.685+0000 7fb88bfff640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.195:6792/0 conn(0x7fb884009110 legacy=0x7fb8840095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:56.701 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 611105, 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:56.702 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 3, 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.703 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.704 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:56.705 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:56.706 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.707 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.708 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.709 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:56.710 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:56.712 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.713 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.715 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:56.716 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.717 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.717 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.717 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:56.717 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:56.717 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.717 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.717 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:56.717 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:56.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.719 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:56.720 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:56.721 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:56.722 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:56.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:56.722 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:56.722 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:56.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.686+0000 7fb8a9b89640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.195:6800/1839191919 conn(0x7fb890040530 legacy=0x7fb8900429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.686+0000 7fb8a9b89640 10 monclient: shutdown 2024-09-13T10:39:56.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.686+0000 7fb8a9b89640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:56.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.686+0000 7fb8a9b89640 1 -- 172.21.15.181:0/1945776531 >> v1:172.21.15.181:6793/0 conn(0x7fb8a40a54e0 legacy=0x7fb8a41d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.686+0000 7fb8a3fff640 1 -- 172.21.15.181:0/1945776531 reap_dead start 2024-09-13T10:39:56.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.686+0000 7fb8a3fff640 1 -- 172.21.15.181:0/1945776531 reap_dead start 2024-09-13T10:39:56.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.686+0000 7fb8a9b89640 1 -- 172.21.15.181:0/1945776531 shutdown_connections 2024-09-13T10:39:56.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.686+0000 7fb8a9b89640 1 -- 172.21.15.181:0/1945776531 >> 172.21.15.181:0/1945776531 conn(0x7fb8a40aa1c0 msgr2=0x7fb8a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:56.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.686+0000 7fb8a9b89640 1 -- 172.21.15.181:0/1945776531 shutdown_connections 2024-09-13T10:39:56.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.686+0000 7fb8a9b89640 1 -- 172.21.15.181:0/1945776531 wait complete. 2024-09-13T10:39:56.724 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:56.724 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T10:39:56.724 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T10:39:56.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.819+0000 7f58a9811640 10 monclient: get_monmap_and_config 2024-09-13T10:39:56.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.819+0000 7f58a9811640 10 monclient: build_initial_monmap 2024-09-13T10:39:56.821 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.819+0000 7f58a9811640 10 monclient: monmap: 2024-09-13T10:39:56.821 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:56.821 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.821 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:56.820489+0000 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:56.820489+0000 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:56.822 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.820+0000 7f58a9811640 1 Processor -- start 2024-09-13T10:39:56.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.820+0000 7f58a9811640 1 -- start start 2024-09-13T10:39:56.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.820+0000 7f58a9811640 10 monclient: init 2024-09-13T10:39:56.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.820+0000 7f58a9811640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.820+0000 7f58a9811640 10 monclient: _add_conns ranks=[2,7,3,8,0,1,5,6,4] 2024-09-13T10:39:56.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.820+0000 7f58a9811640 10 monclient(hunting): picked mon.noname-b con 0x7f58a40a6640 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:56.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.820+0000 7f58a9811640 10 monclient(hunting): picked mon.noname-i con 0x7f58a40a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:56.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.821+0000 7f58a9811640 10 monclient(hunting): picked mon.noname-g con 0x7f58a413f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:56.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.821+0000 7f58a9811640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a40a4bc0 con 0x7f58a40a6640 2024-09-13T10:39:56.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.821+0000 7f58a9811640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a413a320 con 0x7f58a413f750 2024-09-13T10:39:56.824 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.821+0000 7f58a9811640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a40a8100 con 0x7f58a40a8340 2024-09-13T10:39:56.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.821+0000 7f58a9811640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.821+0000 7f58a9811640 10 monclient(hunting): authenticate will time out at 1336.326050s 2024-09-13T10:39:56.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.821+0000 7f58a2ffd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f58a40a6640 0x7f58a4139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:46550/0 (socket says 172.21.15.181:46550) 2024-09-13T10:39:56.825 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.821+0000 7f58a2ffd640 1 -- 172.21.15.181:0/3533248565 learned_addr learned my addr 172.21.15.181:0/3533248565 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:56.828 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a2ffd640 1 -- 172.21.15.181:0/3533248565 >> v1:172.21.15.181:6790/0 conn(0x7f58a40a6640 legacy=0x7f58a4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a37fe640 1 -- 172.21.15.181:0/3533248565 >> v1:172.21.15.195:6790/0 conn(0x7f58a413f750 legacy=0x7f58a4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f589a7fc640 1 -- 172.21.15.181:0/3533248565 >> v1:172.21.15.195:6792/0 conn(0x7f58a40a8340 legacy=0x7f58a4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1155496020 0 0) 0x7f58a40a4bc0 con 0x7f58a40a6640 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient(hunting): my global_id is 174179 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5890003520 con 0x7f58a40a6640 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3538914887 0 0) 0x7f58a413a320 con 0x7f58a413f750 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.829 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient(hunting): my global_id is 164514 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58a40a4bc0 con 0x7f58a413f750 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1101579407 0 0) 0x7f58a40a8100 con 0x7f58a40a8340 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient(hunting): my global_id is 57868 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58a413a320 con 0x7f58a40a8340 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 510510446 0 0) 0x7f5890003520 con 0x7f58a40a6640 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 >> v1:172.21.15.195:6792/0 conn(0x7f58a40a8340 legacy=0x7f58a4139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 >> v1:172.21.15.195:6790/0 conn(0x7f58a413f750 legacy=0x7f58a4141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 monclient: found mon.noname-b 2024-09-13T10:39:56.830 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a40a48e0 con 0x7f58a40a6640 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5894001ae0 con 0x7f58a40a6640 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a9811640 5 monclient: authenticate success, global_id 174179 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a9811640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient: dump: 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.831 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.832 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a9811640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58940048a0 con 0x7f58a40a6640 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 1 -- 172.21.15.181:0/3533248565 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5894004e10 con 0x7f58a40a6640 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a9811640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a9811640 4 set_mon_vals no callback set 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.823+0000 7f58a27fc640 10 monclient: dump: 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.833 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.824+0000 7f58a9811640 10 monclient: shutdown 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.824+0000 7f58a9811640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.824+0000 7f58a9811640 1 -- 172.21.15.181:0/3533248565 >> v1:172.21.15.181:6790/0 conn(0x7f58a40a6640 legacy=0x7f58a4139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.834 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.824+0000 7f58a9811640 1 -- 172.21.15.181:0/3533248565 shutdown_connections 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.824+0000 7f58a9811640 1 -- 172.21.15.181:0/3533248565 >> 172.21.15.181:0/3533248565 conn(0x7f58a4077170 msgr2=0x7f58a40abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.824+0000 7f58a9811640 1 -- 172.21.15.181:0/3533248565 shutdown_connections 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.824+0000 7f58a9811640 1 -- 172.21.15.181:0/3533248565 wait complete. 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.824+0000 7f58a9811640 10 monclient: build_initial_monmap 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.824+0000 7f58a9811640 10 monclient: monmap: 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:56.835 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 1 Processor -- start 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 1 -- start start 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 10 monclient: init 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 10 monclient: _add_conns ranks=[1,6,5,7,3,4,2,8,0] 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 10 monclient(hunting): picked mon.noname-f con 0x7f58a40a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:56.836 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 10 monclient(hunting): picked mon.noname-d con 0x7f58a413f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 10 monclient(hunting): picked mon.noname-h con 0x7f58a413e100 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a4134f20 con 0x7f58a40a8340 2024-09-13T10:39:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a413d5a0 con 0x7f58a413e100 2024-09-13T10:39:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a4134680 con 0x7f58a413f750 2024-09-13T10:39:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f58a9811640 10 monclient(hunting): authenticate will time out at 1336.330901s 2024-09-13T10:39:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f589a7fc640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f58a413f750 0x7f58a41d3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:36622/0 (socket says 172.21.15.181:36622) 2024-09-13T10:39:56.837 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.825+0000 7f589a7fc640 1 -- 172.21.15.181:0/2234038531 learned_addr learned my addr 172.21.15.181:0/2234038531 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:56.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f589a7fc640 1 -- 172.21.15.181:0/2234038531 >> v1:172.21.15.181:6792/0 conn(0x7f58a413f750 legacy=0x7f58a41d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a37fe640 1 -- 172.21.15.181:0/2234038531 >> v1:172.21.15.195:6791/0 conn(0x7f58a413e100 legacy=0x7f58a41d6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a2ffd640 1 -- 172.21.15.181:0/2234038531 >> v1:172.21.15.195:6789/0 conn(0x7f58a40a8340 legacy=0x7f58a41ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:56.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372779531 0 0) 0x7f58a4134680 con 0x7f58a413f750 2024-09-13T10:39:56.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): my global_id is 174192 2024-09-13T10:39:56.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5884003550 con 0x7f58a413f750 2024-09-13T10:39:56.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504643167 0 0) 0x7f58a413d5a0 con 0x7f58a413e100 2024-09-13T10:39:56.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): my global_id is 105845 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58a4134680 con 0x7f58a413e100 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087287972 0 0) 0x7f58a4134f20 con 0x7f58a40a8340 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): my global_id is 134875 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58a413d5a0 con 0x7f58a40a8340 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2324478397 0 0) 0x7f5884003550 con 0x7f58a413f750 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58a4134f20 con 0x7f58a413f750 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f588c003610 con 0x7f58a413f750 2024-09-13T10:39:56.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.843 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3281216315 0 0) 0x7f58a413d5a0 con 0x7f58a40a8340 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5884003550 con 0x7f58a40a8340 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5894004d90 con 0x7f58a40a8340 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.844 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1973311339 0 0) 0x7f58a4134680 con 0x7f58a413e100 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58a413d5a0 con 0x7f58a413e100 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f589c002070 con 0x7f58a413e100 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.846 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4202451741 0 0) 0x7f58a4134f20 con 0x7f58a413f750 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 >> v1:172.21.15.195:6791/0 conn(0x7f58a413e100 legacy=0x7f58a41d6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 >> v1:172.21.15.195:6789/0 conn(0x7f58a40a8340 legacy=0x7f58a41ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 monclient: found mon.d 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:56.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a4134960 con 0x7f58a413f750 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient: _finish_auth 0 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a9811640 5 monclient: authenticate success, global_id 174192 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a9811640 10 monclient: _renew_subs 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a9811640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a9811640 1 -- 172.21.15.181:0/2234038531 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f58a413e6b0 con 0x7f58a413f750 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a9811640 10 monclient: _renew_subs 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a9811640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a9811640 1 -- 172.21.15.181:0/2234038531 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f58a413ccd0 con 0x7f58a413f750 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f588c003bd0 con 0x7f58a413f750 2024-09-13T10:39:56.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f588c004140 con 0x7f58a413f750 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a1ffb640 4 set_mon_vals no callback set 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.828+0000 7f58a0ff9640 10 monclient: dump: 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:56.849 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.829+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f588c0042e0 con 0x7f58a413f750 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.829+0000 7f58a9811640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.830+0000 7f58a9811640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.830+0000 7f58a9811640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.830+0000 7f58a9811640 1 -- 172.21.15.181:0/2234038531 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5888005080 con 0x7f58a413f750 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.830+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(311..311 src has 1..311) ==== 3506+0+0 (unknown 4201997143 0 0) 0x7f588c04e310 con 0x7f58a413f750 2024-09-13T10:39:56.850 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.830+0000 7f58a2ffd640 10 monclient: get_auth_request con 0x7f5884040550 auth_method 0 2024-09-13T10:39:56.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.834+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f588c017940 con 0x7f58a413f750 2024-09-13T10:39:56.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.834+0000 7f58a0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:56.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:56.834+0000 7f58a0ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:57.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.088+0000 7f58a9811640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-13T10:39:57.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.088+0000 7f58a9811640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-13T10:39:57.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.088+0000 7f58a9811640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:39:57.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.088+0000 7f58a9811640 1 -- 172.21.15.181:0/2234038531 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f5888005c40 con 0x7f58a413f750 2024-09-13T10:39:57.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.091+0000 7f58a0ff9640 1 -- 172.21.15.181:0/2234038531 <== mon.6 v1:172.21.15.181:6792/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f588c017240 con 0x7f58a413f750 2024-09-13T10:39:57.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.091+0000 7f58a0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-13T10:39:57.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.091+0000 7f58a0ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:57.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.093+0000 7f58a9811640 1 -- 172.21.15.181:0/2234038531 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5884040550 legacy=0x7f5884042a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:57.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.093+0000 7f58a9811640 10 monclient: shutdown 2024-09-13T10:39:57.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.093+0000 7f58a9811640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:57.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.093+0000 7f58a9811640 1 -- 172.21.15.181:0/2234038531 >> v1:172.21.15.181:6792/0 conn(0x7f58a413f750 legacy=0x7f58a41d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:57.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.093+0000 7f58a9811640 1 -- 172.21.15.181:0/2234038531 shutdown_connections 2024-09-13T10:39:57.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.093+0000 7f58a9811640 1 -- 172.21.15.181:0/2234038531 >> 172.21.15.181:0/2234038531 conn(0x7f58a40a6640 msgr2=0x7f58a40a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:57.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.093+0000 7f58a9811640 1 -- 172.21.15.181:0/2234038531 shutdown_connections 2024-09-13T10:39:57.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:57.093+0000 7f58a9811640 1 -- 172.21.15.181:0/2234038531 wait complete. 2024-09-13T10:39:57.101 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.101 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=10,kv=11,logm=54} crc {auth=256384636,config=2586702516,health=1731454122,kv=3759619045,logm=3383815629}) 2024-09-13T10:39:57.101 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=25,config=2,health=12,kv=12,logm=49} crc {auth=1035292420,config=2586702516,health=2205972660,kv=4218324827,logm=2284868087}) 2024-09-13T10:39:57.101 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.101 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=10,kv=11,logm=54} crc {auth=256384636,config=2586702516,health=1731454122,kv=3759619045,logm=3383815629}) 2024-09-13T10:39:57.101 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=24,config=2,health=12,kv=11,logm=51} crc {auth=1125534007,config=2586702516,health=144923972,kv=760235678,logm=8867718}) 2024-09-13T10:39:57.101 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=10,kv=11,logm=54} crc {auth=256384636,config=2586702516,health=1731454122,kv=3759619045,logm=3383815629}) 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=24,config=2,health=12,kv=12,logm=50} crc {auth=2805173811,config=2586702516,health=144923972,kv=3467323233,logm=696196656}) 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=10,kv=11,logm=54} crc {auth=256384636,config=2586702516,health=1731454122,kv=3759619045,logm=3383815629}) 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=22,config=2,health=12,kv=11,logm=53} crc {auth=1985416966,config=2586702516,health=1745101641,kv=3759619045,logm=2751291761}) 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=10,kv=11,logm=54} crc {auth=256384636,config=2586702516,health=1731454122,kv=3759619045,logm=3383815629}) 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=24,config=2,health=12,kv=12,logm=50} crc {auth=396044550,config=2586702516,health=144923972,kv=3467323234,logm=398048306}) 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=10,kv=11,logm=54} crc {auth=256384636,config=2586702516,health=1731454122,kv=3759619045,logm=3383815629}) 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=24,config=2,health=12,kv=12,logm=50} crc {auth=2479503513,config=2586702516,health=144923972,kv=3467323233,logm=3082622972}) 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.102 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=10,kv=11,logm=54} crc {auth=256384636,config=2586702516,health=1731454122,kv=3759619045,logm=3383815629}) 2024-09-13T10:39:57.103 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=24,config=2,health=12,kv=12,logm=50} crc {auth=1875018395,config=2586702516,health=144923972,kv=3467323233,logm=4239592171}) 2024-09-13T10:39:57.103 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.103 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=23,config=2,health=10,kv=11,logm=54} crc {auth=256384636,config=2586702516,health=1731454122,kv=3759619045,logm=3383815629}) 2024-09-13T10:39:57.103 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.099+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=25,config=2,health=12,kv=12,logm=49} crc {auth=1035292420,config=2586702516,health=144923972,kv=3467323233,logm=3784070494}) 2024-09-13T10:39:57.106 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-13T10:39:57.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1639137668}) 2024-09-13T10:39:57.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2054121242}) 2024-09-13T10:39:57.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1639137668}) 2024-09-13T10:39:57.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2932267136}) 2024-09-13T10:39:57.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1639137668}) 2024-09-13T10:39:57.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3692029628}) 2024-09-13T10:39:57.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1639137668}) 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3822615819}) 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1639137668}) 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3794440941}) 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1639137668}) 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1904116772}) 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1639137668}) 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3076224410}) 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1639137668}) 2024-09-13T10:39:57.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.471+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1401539794}) 2024-09-13T10:39:57.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2285941873}) 2024-09-13T10:39:57.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2895323134}) 2024-09-13T10:39:57.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2285941873}) 2024-09-13T10:39:57.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2946931169}) 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2285941873}) 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=642989900}) 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2285941873}) 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1143000324}) 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2285941873}) 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1792496852}) 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2285941873}) 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=796796046}) 2024-09-13T10:39:57.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2285941873}) 2024-09-13T10:39:57.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3556587883}) 2024-09-13T10:39:57.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2285941873}) 2024-09-13T10:39:57.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.477+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3129926699}) 2024-09-13T10:39:57.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2016997318}) 2024-09-13T10:39:57.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=333371452}) 2024-09-13T10:39:57.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2016997318}) 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2590536577}) 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2016997318}) 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=178545274}) 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2016997318}) 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=936049914}) 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2016997318}) 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2523600680}) 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2016997318}) 2024-09-13T10:39:57.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2914219478}) 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2016997318}) 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1750799333}) 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2016997318}) 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.506+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=362287969}) 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1671011796}) 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3668088730}) 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1671011796}) 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1111017797}) 2024-09-13T10:39:57.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1671011796}) 2024-09-13T10:39:57.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2284741532}) 2024-09-13T10:39:57.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1671011796}) 2024-09-13T10:39:57.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3048021554}) 2024-09-13T10:39:57.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1671011796}) 2024-09-13T10:39:57.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2906705425}) 2024-09-13T10:39:57.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1671011796}) 2024-09-13T10:39:57.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=473992502}) 2024-09-13T10:39:57.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1671011796}) 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4157347920}) 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1671011796}) 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.507+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2764102374}) 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1123997402}) 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3539728776}) 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1123997402}) 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=689450185}) 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1123997402}) 2024-09-13T10:39:57.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1349677615}) 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1123997402}) 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3912010786}) 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1123997402}) 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3311054814}) 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1123997402}) 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3238706040}) 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1123997402}) 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1010135033}) 2024-09-13T10:39:57.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1123997402}) 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3811728146}) 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4293528662}) 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3498925205}) 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4293528662}) 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2885349602}) 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4293528662}) 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2990592084}) 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4293528662}) 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2854582228}) 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4293528662}) 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2805731920}) 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4293528662}) 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=240756186}) 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4293528662}) 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=577914167}) 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4293528662}) 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=644497423}) 2024-09-13T10:39:57.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=462145154}) 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=917398559}) 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=462145154}) 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1418785340}) 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=462145154}) 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=746371437}) 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=462145154}) 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1768032750}) 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=462145154}) 2024-09-13T10:39:57.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=268328430}) 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=462145154}) 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2350460364}) 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=462145154}) 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2784355936}) 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=462145154}) 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3984461602}) 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1191250875}) 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1749750681}) 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1191250875}) 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1980481398}) 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1191250875}) 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2740506670}) 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1191250875}) 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1650082296}) 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1191250875}) 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=495236797}) 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1191250875}) 2024-09-13T10:39:57.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2778072587}) 2024-09-13T10:39:57.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1191250875}) 2024-09-13T10:39:57.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3726580212}) 2024-09-13T10:39:57.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1191250875}) 2024-09-13T10:39:57.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.513+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2929914992}) 2024-09-13T10:39:57.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4120952057}) 2024-09-13T10:39:57.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=502884408}) 2024-09-13T10:39:57.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4120952057}) 2024-09-13T10:39:57.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3146787753}) 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4120952057}) 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3966860173}) 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4120952057}) 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2898742081}) 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4120952057}) 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2904278731}) 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4120952057}) 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1373106888}) 2024-09-13T10:39:57.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4120952057}) 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=458779217}) 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.515+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4120952057}) 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.515+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2270838845}) 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3341467771}) 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4024622590}) 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3341467771}) 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3016428496}) 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3341467771}) 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1354285518}) 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3341467771}) 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3215767015}) 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3341467771}) 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1148551500}) 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3341467771}) 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1328057315}) 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3341467771}) 2024-09-13T10:39:57.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3148964968}) 2024-09-13T10:39:57.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3341467771}) 2024-09-13T10:39:57.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.516+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=842831966}) 2024-09-13T10:39:57.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1522448848}) 2024-09-13T10:39:57.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1899345032}) 2024-09-13T10:39:57.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1522448848}) 2024-09-13T10:39:57.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=344524946}) 2024-09-13T10:39:57.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1522448848}) 2024-09-13T10:39:57.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3316319881}) 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1522448848}) 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1153399034}) 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1522448848}) 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1787946849}) 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1522448848}) 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1168266442}) 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1522448848}) 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3284414301}) 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1522448848}) 2024-09-13T10:39:57.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.517+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2476455690}) 2024-09-13T10:39:57.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=275825588}) 2024-09-13T10:39:57.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1594782623}) 2024-09-13T10:39:57.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=275825588}) 2024-09-13T10:39:57.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1465411468}) 2024-09-13T10:39:57.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=275825588}) 2024-09-13T10:39:57.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4188936295}) 2024-09-13T10:39:57.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=275825588}) 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3389244269}) 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=275825588}) 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2247845665}) 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=275825588}) 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.518+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=798081513}) 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.519+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.519+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=275825588}) 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.519+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2402074509}) 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.519+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.519+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=275825588}) 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.519+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1914186313}) 2024-09-13T10:39:57.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3151783193}) 2024-09-13T10:39:57.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3055470326}) 2024-09-13T10:39:57.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3151783193}) 2024-09-13T10:39:57.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1860095208}) 2024-09-13T10:39:57.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3151783193}) 2024-09-13T10:39:57.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4195534226}) 2024-09-13T10:39:57.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3151783193}) 2024-09-13T10:39:57.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=665652243}) 2024-09-13T10:39:57.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3151783193}) 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=392438891}) 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3151783193}) 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=689470129}) 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3151783193}) 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3815183237}) 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3151783193}) 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.520+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1221898714}) 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=697565938}) 2024-09-13T10:39:57.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1489814667}) 2024-09-13T10:39:57.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=697565938}) 2024-09-13T10:39:57.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=182287725}) 2024-09-13T10:39:57.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=697565938}) 2024-09-13T10:39:57.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2245014880}) 2024-09-13T10:39:57.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=697565938}) 2024-09-13T10:39:57.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4252071730}) 2024-09-13T10:39:57.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=697565938}) 2024-09-13T10:39:57.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2531748773}) 2024-09-13T10:39:57.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=697565938}) 2024-09-13T10:39:57.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2983155168}) 2024-09-13T10:39:57.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=697565938}) 2024-09-13T10:39:57.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=893864928}) 2024-09-13T10:39:57.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=697565938}) 2024-09-13T10:39:57.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.521+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2102984115}) 2024-09-13T10:39:57.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481539162}) 2024-09-13T10:39:57.588 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3500334768}) 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481539162}) 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=544508578}) 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481539162}) 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1135155337}) 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481539162}) 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4114533354}) 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481539162}) 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1462714624}) 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.589 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481539162}) 2024-09-13T10:39:57.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1164131295}) 2024-09-13T10:39:57.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481539162}) 2024-09-13T10:39:57.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=113005054}) 2024-09-13T10:39:57.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481539162}) 2024-09-13T10:39:57.590 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.586+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1775549170}) 2024-09-13T10:39:57.596 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.596 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1664754115}) 2024-09-13T10:39:57.596 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3941670634}) 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1664754115}) 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1432503247}) 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1664754115}) 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4195979239}) 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1664754115}) 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3600269732}) 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1664754115}) 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1032989238}) 2024-09-13T10:39:57.597 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1664754115}) 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1852466061}) 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1664754115}) 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3908924894}) 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1664754115}) 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.587+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3457319130}) 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3195897401}) 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2820480015}) 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3195897401}) 2024-09-13T10:39:57.598 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1463456231}) 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3195897401}) 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3801248983}) 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3195897401}) 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2617290686}) 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3195897401}) 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2066797369}) 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3195897401}) 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2212849583}) 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.599 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3195897401}) 2024-09-13T10:39:57.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2427539738}) 2024-09-13T10:39:57.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3195897401}) 2024-09-13T10:39:57.600 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.589+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3225183566}) 2024-09-13T10:39:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481108355}) 2024-09-13T10:39:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1404667279}) 2024-09-13T10:39:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481108355}) 2024-09-13T10:39:57.729 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2552670440}) 2024-09-13T10:39:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481108355}) 2024-09-13T10:39:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2250259955}) 2024-09-13T10:39:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481108355}) 2024-09-13T10:39:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3379434236}) 2024-09-13T10:39:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481108355}) 2024-09-13T10:39:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3427902838}) 2024-09-13T10:39:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481108355}) 2024-09-13T10:39:57.730 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=686961095}) 2024-09-13T10:39:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481108355}) 2024-09-13T10:39:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=753409067}) 2024-09-13T10:39:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481108355}) 2024-09-13T10:39:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.706+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1591794990}) 2024-09-13T10:39:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2388575203}) 2024-09-13T10:39:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3697409201}) 2024-09-13T10:39:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2388575203}) 2024-09-13T10:39:57.731 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3620922758}) 2024-09-13T10:39:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2388575203}) 2024-09-13T10:39:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3994770613}) 2024-09-13T10:39:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2388575203}) 2024-09-13T10:39:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1264156916}) 2024-09-13T10:39:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2388575203}) 2024-09-13T10:39:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1510159874}) 2024-09-13T10:39:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.732 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2388575203}) 2024-09-13T10:39:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1209895115}) 2024-09-13T10:39:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2388575203}) 2024-09-13T10:39:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3942243319}) 2024-09-13T10:39:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2388575203}) 2024-09-13T10:39:57.733 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.708+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1890049109}) 2024-09-13T10:39:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632840189}) 2024-09-13T10:39:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=304517806}) 2024-09-13T10:39:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632840189}) 2024-09-13T10:39:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1315612307}) 2024-09-13T10:39:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632840189}) 2024-09-13T10:39:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2640338523}) 2024-09-13T10:39:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.734 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632840189}) 2024-09-13T10:39:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=31155101}) 2024-09-13T10:39:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632840189}) 2024-09-13T10:39:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2012592150}) 2024-09-13T10:39:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632840189}) 2024-09-13T10:39:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2244730119}) 2024-09-13T10:39:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632840189}) 2024-09-13T10:39:57.735 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1053995887}) 2024-09-13T10:39:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632840189}) 2024-09-13T10:39:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.709+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1314298286}) 2024-09-13T10:39:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.710+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.710+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2762409069}) 2024-09-13T10:39:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.710+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=537177414}) 2024-09-13T10:39:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.710+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.710+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2762409069}) 2024-09-13T10:39:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.710+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=157584180}) 2024-09-13T10:39:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.710+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.736 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2762409069}) 2024-09-13T10:39:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=582989120}) 2024-09-13T10:39:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2762409069}) 2024-09-13T10:39:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=23191177}) 2024-09-13T10:39:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2762409069}) 2024-09-13T10:39:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2720277261}) 2024-09-13T10:39:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2762409069}) 2024-09-13T10:39:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2695665163}) 2024-09-13T10:39:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.737 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2762409069}) 2024-09-13T10:39:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=435232272}) 2024-09-13T10:39:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2762409069}) 2024-09-13T10:39:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.711+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1531051317}) 2024-09-13T10:39:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3745214238}) 2024-09-13T10:39:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3260745766}) 2024-09-13T10:39:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3745214238}) 2024-09-13T10:39:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1464459228}) 2024-09-13T10:39:57.738 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3745214238}) 2024-09-13T10:39:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=818320602}) 2024-09-13T10:39:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3745214238}) 2024-09-13T10:39:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1520595312}) 2024-09-13T10:39:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3745214238}) 2024-09-13T10:39:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1177614265}) 2024-09-13T10:39:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3745214238}) 2024-09-13T10:39:57.739 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1186341992}) 2024-09-13T10:39:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3745214238}) 2024-09-13T10:39:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3955763300}) 2024-09-13T10:39:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3745214238}) 2024-09-13T10:39:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.712+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3818279855}) 2024-09-13T10:39:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.713+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.713+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2414088802}) 2024-09-13T10:39:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.713+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1025454946}) 2024-09-13T10:39:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.713+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.713+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2414088802}) 2024-09-13T10:39:57.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3357856838}) 2024-09-13T10:39:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2414088802}) 2024-09-13T10:39:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4207197492}) 2024-09-13T10:39:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2414088802}) 2024-09-13T10:39:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1715246185}) 2024-09-13T10:39:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2414088802}) 2024-09-13T10:39:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2452242747}) 2024-09-13T10:39:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2414088802}) 2024-09-13T10:39:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3536441905}) 2024-09-13T10:39:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2414088802}) 2024-09-13T10:39:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=762483622}) 2024-09-13T10:39:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2414088802}) 2024-09-13T10:39:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.714+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=646572042}) 2024-09-13T10:39:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539236558}) 2024-09-13T10:39:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3710755409}) 2024-09-13T10:39:57.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539236558}) 2024-09-13T10:39:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3535745552}) 2024-09-13T10:39:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539236558}) 2024-09-13T10:39:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3404178125}) 2024-09-13T10:39:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539236558}) 2024-09-13T10:39:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3768594980}) 2024-09-13T10:39:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539236558}) 2024-09-13T10:39:57.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1717470004}) 2024-09-13T10:39:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539236558}) 2024-09-13T10:39:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3020749519}) 2024-09-13T10:39:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539236558}) 2024-09-13T10:39:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3925319654}) 2024-09-13T10:39:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3539236558}) 2024-09-13T10:39:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.715+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2750923033}) 2024-09-13T10:39:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.716+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.716+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1098315013}) 2024-09-13T10:39:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.716+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3891461386}) 2024-09-13T10:39:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1098315013}) 2024-09-13T10:39:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4021950824}) 2024-09-13T10:39:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1098315013}) 2024-09-13T10:39:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2116873690}) 2024-09-13T10:39:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1098315013}) 2024-09-13T10:39:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=59255371}) 2024-09-13T10:39:57.745 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1098315013}) 2024-09-13T10:39:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2674640066}) 2024-09-13T10:39:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1098315013}) 2024-09-13T10:39:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4154488191}) 2024-09-13T10:39:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1098315013}) 2024-09-13T10:39:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=973996323}) 2024-09-13T10:39:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1098315013}) 2024-09-13T10:39:57.746 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.717+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1474939432}) 2024-09-13T10:39:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3458457060}) 2024-09-13T10:39:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1217983178}) 2024-09-13T10:39:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3458457060}) 2024-09-13T10:39:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2404861807}) 2024-09-13T10:39:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3458457060}) 2024-09-13T10:39:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2213793146}) 2024-09-13T10:39:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.747 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3458457060}) 2024-09-13T10:39:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=249654714}) 2024-09-13T10:39:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3458457060}) 2024-09-13T10:39:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2226877487}) 2024-09-13T10:39:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3458457060}) 2024-09-13T10:39:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2063534241}) 2024-09-13T10:39:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3458457060}) 2024-09-13T10:39:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3480538958}) 2024-09-13T10:39:57.748 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3458457060}) 2024-09-13T10:39:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.718+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2472611878}) 2024-09-13T10:39:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2025459264}) 2024-09-13T10:39:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2704654085}) 2024-09-13T10:39:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2025459264}) 2024-09-13T10:39:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1218771786}) 2024-09-13T10:39:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2025459264}) 2024-09-13T10:39:57.749 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=983440852}) 2024-09-13T10:39:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2025459264}) 2024-09-13T10:39:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3152468094}) 2024-09-13T10:39:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2025459264}) 2024-09-13T10:39:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2863829591}) 2024-09-13T10:39:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2025459264}) 2024-09-13T10:39:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3242076089}) 2024-09-13T10:39:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2025459264}) 2024-09-13T10:39:57.750 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1298129133}) 2024-09-13T10:39:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2025459264}) 2024-09-13T10:39:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.719+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1350128780}) 2024-09-13T10:39:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097991357}) 2024-09-13T10:39:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=712466705}) 2024-09-13T10:39:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097991357}) 2024-09-13T10:39:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1259947940}) 2024-09-13T10:39:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.751 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097991357}) 2024-09-13T10:39:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2375218975}) 2024-09-13T10:39:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097991357}) 2024-09-13T10:39:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3790163495}) 2024-09-13T10:39:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097991357}) 2024-09-13T10:39:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1065329146}) 2024-09-13T10:39:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097991357}) 2024-09-13T10:39:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1840386150}) 2024-09-13T10:39:57.752 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097991357}) 2024-09-13T10:39:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1279724276}) 2024-09-13T10:39:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097991357}) 2024-09-13T10:39:57.753 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.721+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1905775383}) 2024-09-13T10:39:57.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.861+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.866 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.861+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3193981949}) 2024-09-13T10:39:57.866 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.861+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3575508461}) 2024-09-13T10:39:57.866 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.861+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.866 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.861+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3193981949}) 2024-09-13T10:39:57.866 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.861+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=47128165}) 2024-09-13T10:39:57.867 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.861+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.867 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.861+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3193981949}) 2024-09-13T10:39:57.867 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.861+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=84956270}) 2024-09-13T10:39:57.867 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.861+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.867 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.861+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3193981949}) 2024-09-13T10:39:57.867 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3794812247}) 2024-09-13T10:39:57.868 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.868 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3193981949}) 2024-09-13T10:39:57.868 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3986969786}) 2024-09-13T10:39:57.868 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.868 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3193981949}) 2024-09-13T10:39:57.868 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4230568740}) 2024-09-13T10:39:57.869 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.869 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3193981949}) 2024-09-13T10:39:57.869 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2375813867}) 2024-09-13T10:39:57.869 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.869 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3193981949}) 2024-09-13T10:39:57.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=68069328}) 2024-09-13T10:39:57.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2307255517}) 2024-09-13T10:39:57.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1699200346}) 2024-09-13T10:39:57.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.898 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2307255517}) 2024-09-13T10:39:57.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=904449448}) 2024-09-13T10:39:57.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2307255517}) 2024-09-13T10:39:57.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=142660030}) 2024-09-13T10:39:57.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2307255517}) 2024-09-13T10:39:57.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=613937348}) 2024-09-13T10:39:57.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2307255517}) 2024-09-13T10:39:57.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.894+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4009951912}) 2024-09-13T10:39:57.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.895+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.899 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.895+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2307255517}) 2024-09-13T10:39:57.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.895+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2649098567}) 2024-09-13T10:39:57.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.895+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.895+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2307255517}) 2024-09-13T10:39:57.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.895+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2595010382}) 2024-09-13T10:39:57.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.895+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:57.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.895+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2307255517}) 2024-09-13T10:39:57.900 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:57.895+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3926937306}) 2024-09-13T10:39:58.003 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.003 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3974143599}) 2024-09-13T10:39:58.003 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2148647574}) 2024-09-13T10:39:58.003 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.003 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3974143599}) 2024-09-13T10:39:58.003 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2643228305}) 2024-09-13T10:39:58.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3974143599}) 2024-09-13T10:39:58.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3019400319}) 2024-09-13T10:39:58.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3974143599}) 2024-09-13T10:39:58.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1208197023}) 2024-09-13T10:39:58.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3974143599}) 2024-09-13T10:39:58.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1506207643}) 2024-09-13T10:39:58.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3974143599}) 2024-09-13T10:39:58.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=928390784}) 2024-09-13T10:39:58.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3974143599}) 2024-09-13T10:39:58.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3206719243}) 2024-09-13T10:39:58.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3974143599}) 2024-09-13T10:39:58.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.000+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1047472151}) 2024-09-13T10:39:58.011 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.008+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.008+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1543961939}) 2024-09-13T10:39:58.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.008+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1320554705}) 2024-09-13T10:39:58.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.008+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.008+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1543961939}) 2024-09-13T10:39:58.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.008+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3899958779}) 2024-09-13T10:39:58.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.008+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.008+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1543961939}) 2024-09-13T10:39:58.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.008+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2133381834}) 2024-09-13T10:39:58.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.008+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.008+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1543961939}) 2024-09-13T10:39:58.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.008+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1403866079}) 2024-09-13T10:39:58.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.009+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.009+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1543961939}) 2024-09-13T10:39:58.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.009+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3691505788}) 2024-09-13T10:39:58.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.009+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.009+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1543961939}) 2024-09-13T10:39:58.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.009+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=199420738}) 2024-09-13T10:39:58.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.009+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.009+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1543961939}) 2024-09-13T10:39:58.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.009+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2896064758}) 2024-09-13T10:39:58.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.009+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.009+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1543961939}) 2024-09-13T10:39:58.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.009+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4165095718}) 2024-09-13T10:39:58.046 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.041+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.046 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.041+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=453818866}) 2024-09-13T10:39:58.046 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.041+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=9694736}) 2024-09-13T10:39:58.046 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.041+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.047 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.041+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=453818866}) 2024-09-13T10:39:58.047 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.041+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=429217492}) 2024-09-13T10:39:58.047 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.041+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.047 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.041+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=453818866}) 2024-09-13T10:39:58.047 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2421919265}) 2024-09-13T10:39:58.047 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.048 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=453818866}) 2024-09-13T10:39:58.048 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3044993707}) 2024-09-13T10:39:58.048 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.048 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=453818866}) 2024-09-13T10:39:58.048 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=984198037}) 2024-09-13T10:39:58.048 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.048 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=453818866}) 2024-09-13T10:39:58.048 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2410083293}) 2024-09-13T10:39:58.048 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.048 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=453818866}) 2024-09-13T10:39:58.049 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2772975151}) 2024-09-13T10:39:58.049 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.049 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=453818866}) 2024-09-13T10:39:58.049 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.042+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1850120478}) 2024-09-13T10:39:58.107 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:39:58.108 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:39:58.129 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40918]: starting. 2024-09-13T10:39:58.129 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40918]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40917 2024-09-13T10:39:58.130 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40918]: created object 0... 2024-09-13T10:39:58.130 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40918]: created object 25... 2024-09-13T10:39:58.130 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40918]: created object 49... 2024-09-13T10:39:58.130 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40918]: finishing. 2024-09-13T10:39:58.130 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[40918]: shutting down. 2024-09-13T10:39:58.169 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.169 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=903268599}) 2024-09-13T10:39:58.169 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1239101499}) 2024-09-13T10:39:58.169 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.169 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=903268599}) 2024-09-13T10:39:58.169 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2984813137}) 2024-09-13T10:39:58.169 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.169 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=903268599}) 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=987173915}) 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=903268599}) 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3589565318}) 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=903268599}) 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3754945733}) 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=903268599}) 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3957092069}) 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=903268599}) 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2718235894}) 2024-09-13T10:39:58.170 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.171 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=903268599}) 2024-09-13T10:39:58.171 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.166+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1046812478}) 2024-09-13T10:39:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.205+0000 7fe24d356640 10 monclient: get_monmap_and_config 2024-09-13T10:39:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.205+0000 7fe24d356640 10 monclient: build_initial_monmap 2024-09-13T10:39:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.205+0000 7fe24d356640 10 monclient: monmap: 2024-09-13T10:39:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:58.206429+0000 2024-09-13T10:39:58.207 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:58.206429+0000 2024-09-13T10:39:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:58.208 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:58.208 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.206+0000 7fe24d356640 1 Processor -- start 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.206+0000 7fe24d356640 1 -- start start 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.206+0000 7fe24d356640 10 monclient: init 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.206+0000 7fe24d356640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.206+0000 7fe24d356640 10 monclient: _add_conns ranks=[1,5,4,8,3,7,6,2,0] 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.207+0000 7fe24d356640 10 monclient(hunting): picked mon.noname-f con 0x7fe2480a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.207+0000 7fe24d356640 10 monclient(hunting): picked mon.noname-h con 0x7fe2480a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.207+0000 7fe24d356640 10 monclient(hunting): picked mon.noname-c con 0x7fe24813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.207+0000 7fe24d356640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2480a4bc0 con 0x7fe2480a6640 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.207+0000 7fe24d356640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24813a320 con 0x7fe24813f750 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.207+0000 7fe24d356640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2480a8100 con 0x7fe2480a8340 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.207+0000 7fe24d356640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.207+0000 7fe24d356640 10 monclient(hunting): authenticate will time out at 1337.712102s 2024-09-13T10:39:58.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.207+0000 7fe2477fe640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fe24813f750 0x7fe248141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51520/0 (socket says 172.21.15.181:51520) 2024-09-13T10:39:58.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.207+0000 7fe2477fe640 1 -- 172.21.15.181:0/2298868855 learned_addr learned my addr 172.21.15.181:0/2298868855 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe2477fe640 1 -- 172.21.15.181:0/2298868855 >> v1:172.21.15.181:6791/0 conn(0x7fe24813f750 legacy=0x7fe248141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe246ffd640 1 -- 172.21.15.181:0/2298868855 >> v1:172.21.15.195:6789/0 conn(0x7fe2480a6640 legacy=0x7fe248139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3817975317 0 0) 0x7fe24813a320 con 0x7fe24813f750 2024-09-13T10:39:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient(hunting): my global_id is 174190 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe2467fc640 1 -- 172.21.15.181:0/2298868855 >> v1:172.21.15.195:6791/0 conn(0x7fe2480a8340 legacy=0x7fe248139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe234003520 con 0x7fe24813f750 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3347802759 0 0) 0x7fe2480a4bc0 con 0x7fe2480a6640 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient(hunting): my global_id is 134884 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe24813a320 con 0x7fe2480a6640 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 603502042 0 0) 0x7fe2480a8100 con 0x7fe2480a8340 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient(hunting): my global_id is 105854 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2480a4bc0 con 0x7fe2480a8340 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 65920564 0 0) 0x7fe234003520 con 0x7fe24813f750 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 >> v1:172.21.15.195:6791/0 conn(0x7fe2480a8340 legacy=0x7fe248139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 >> v1:172.21.15.195:6789/0 conn(0x7fe2480a6640 legacy=0x7fe248139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 monclient: found mon.noname-c 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2480a48e0 con 0x7fe24813f750 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient: _finish_auth 0 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:58.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe240001e60 con 0x7fe24813f750 2024-09-13T10:39:58.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe24d356640 5 monclient: authenticate success, global_id 174190 2024-09-13T10:39:58.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe24d356640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:58.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:58.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient: dump: 2024-09-13T10:39:58.220 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.220 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.220 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.220 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.220 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.220 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.220 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.220 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.220 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.220 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe24d356640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe240004c20 con 0x7fe24813f750 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 1 -- 172.21.15.181:0/2298868855 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe240005190 con 0x7fe24813f750 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe24d356640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe24d356640 4 set_mon_vals no callback set 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.209+0000 7fe245ffb640 10 monclient: dump: 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.222 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.210+0000 7fe24d356640 10 monclient: shutdown 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.210+0000 7fe24d356640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.210+0000 7fe24d356640 1 -- 172.21.15.181:0/2298868855 >> v1:172.21.15.181:6791/0 conn(0x7fe24813f750 legacy=0x7fe248141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.210+0000 7fe24d356640 1 -- 172.21.15.181:0/2298868855 shutdown_connections 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.210+0000 7fe24d356640 1 -- 172.21.15.181:0/2298868855 >> 172.21.15.181:0/2298868855 conn(0x7fe248077170 msgr2=0x7fe2480abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.210+0000 7fe24d356640 1 -- 172.21.15.181:0/2298868855 shutdown_connections 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.210+0000 7fe24d356640 1 -- 172.21.15.181:0/2298868855 wait complete. 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.211+0000 7fe24d356640 10 monclient: build_initial_monmap 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.211+0000 7fe24d356640 10 monclient: monmap: 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:58.223 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:58.224 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.211+0000 7fe24d356640 1 Processor -- start 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.211+0000 7fe24d356640 1 -- start start 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.211+0000 7fe24d356640 10 monclient: init 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.211+0000 7fe24d356640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.211+0000 7fe24d356640 10 monclient: _add_conns ranks=[7,2,8,5,4,3,1,6,0] 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.211+0000 7fe24d356640 10 monclient(hunting): picked mon.noname-i con 0x7fe2480a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.211+0000 7fe24d356640 10 monclient(hunting): picked mon.noname-b con 0x7fe24813f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.212+0000 7fe24d356640 10 monclient(hunting): picked mon.noname-e con 0x7fe248142460 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.212+0000 7fe24d356640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24813bdc0 con 0x7fe24813f750 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.212+0000 7fe24d356640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24813c0a0 con 0x7fe2480a8340 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.212+0000 7fe24d356640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24813c380 con 0x7fe248142460 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.212+0000 7fe24d356640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:58.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.212+0000 7fe24d356640 10 monclient(hunting): authenticate will time out at 1337.717064s 2024-09-13T10:39:58.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.212+0000 7fe2467fc640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fe24813f750 0x7fe2481ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:46554/0 (socket says 172.21.15.181:46554) 2024-09-13T10:39:58.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.212+0000 7fe2477fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fe248142460 0x7fe2481d6530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:42596/0 (socket says 172.21.15.181:42596) 2024-09-13T10:39:58.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.212+0000 7fe2467fc640 1 -- 172.21.15.181:0/714618540 learned_addr learned my addr 172.21.15.181:0/714618540 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:58.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe2467fc640 1 -- 172.21.15.181:0/714618540 >> v1:172.21.15.181:6790/0 conn(0x7fe24813f750 legacy=0x7fe2481ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe2477fe640 1 -- 172.21.15.181:0/714618540 >> v1:172.21.15.181:6793/0 conn(0x7fe248142460 legacy=0x7fe2481d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe246ffd640 1 -- 172.21.15.181:0/714618540 >> v1:172.21.15.195:6792/0 conn(0x7fe2480a8340 legacy=0x7fe24813cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2684352032 0 0) 0x7fe24813bdc0 con 0x7fe24813f750 2024-09-13T10:39:58.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): my global_id is 174188 2024-09-13T10:39:58.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe228003550 con 0x7fe24813f750 2024-09-13T10:39:58.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656063462 0 0) 0x7fe24813c380 con 0x7fe248142460 2024-09-13T10:39:58.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): my global_id is 105965 2024-09-13T10:39:58.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe24813bdc0 con 0x7fe248142460 2024-09-13T10:39:58.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457469776 0 0) 0x7fe24813c0a0 con 0x7fe2480a8340 2024-09-13T10:39:58.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): my global_id is 57877 2024-09-13T10:39:58.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe24813c380 con 0x7fe2480a8340 2024-09-13T10:39:58.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3306857339 0 0) 0x7fe24813bdc0 con 0x7fe248142460 2024-09-13T10:39:58.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe24813c0a0 con 0x7fe248142460 2024-09-13T10:39:58.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2921105294 0 0) 0x7fe24813c380 con 0x7fe2480a8340 2024-09-13T10:39:58.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe24813bdc0 con 0x7fe2480a8340 2024-09-13T10:39:58.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3548104509 0 0) 0x7fe228003550 con 0x7fe24813f750 2024-09-13T10:39:58.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe24813c380 con 0x7fe24813f750 2024-09-13T10:39:58.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe2400020b0 con 0x7fe248142460 2024-09-13T10:39:58.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:58.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:58.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:58.233 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.233 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.233 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.233 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.233 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.234 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.234 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.234 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.234 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.234 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.234 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.234 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.235 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.235 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.235 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.235 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:58.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe238003610 con 0x7fe2480a8340 2024-09-13T10:39:58.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:58.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:58.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:58.236 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.236 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.236 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.237 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.237 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.237 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.237 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.237 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.237 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.237 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.237 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.237 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.237 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.237 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.238 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.238 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe230003610 con 0x7fe24813f750 2024-09-13T10:39:58.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:58.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:58.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:58.238 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.238 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.238 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.238 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.239 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.239 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.239 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.239 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.239 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.239 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.239 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.240 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.240 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.240 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.240 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.240 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2819291774 0 0) 0x7fe24813bdc0 con 0x7fe2480a8340 2024-09-13T10:39:58.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 >> v1:172.21.15.181:6793/0 conn(0x7fe248142460 legacy=0x7fe2481d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 >> v1:172.21.15.181:6790/0 conn(0x7fe24813f750 legacy=0x7fe2481ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:58.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 monclient: found mon.i 2024-09-13T10:39:58.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:58.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:58.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2481cecb0 con 0x7fe2480a8340 2024-09-13T10:39:58.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:58.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:58.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe23f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:58.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe24d356640 5 monclient: authenticate success, global_id 57877 2024-09-13T10:39:58.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe24d356640 10 monclient: _renew_subs 2024-09-13T10:39:58.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe24d356640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:58.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe24d356640 1 -- 172.21.15.181:0/714618540 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe2481cef40 con 0x7fe2480a8340 2024-09-13T10:39:58.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe24d356640 10 monclient: _renew_subs 2024-09-13T10:39:58.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe24d356640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:58.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.214+0000 7fe24d356640 1 -- 172.21.15.181:0/714618540 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fe2481d7e30 con 0x7fe2480a8340 2024-09-13T10:39:58.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.215+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe238003b20 con 0x7fe2480a8340 2024-09-13T10:39:58.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.215+0000 7fe23f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:58.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.215+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe238004050 con 0x7fe2480a8340 2024-09-13T10:39:58.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.215+0000 7fe23f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.215+0000 7fe2457fa640 4 set_mon_vals no callback set 2024-09-13T10:39:58.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.215+0000 7fe23f7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:58.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.215+0000 7fe23f7fe640 10 monclient: dump: 2024-09-13T10:39:58.244 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.244 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.244 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.244 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.244 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.244 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.244 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.244 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.244 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.244 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.244 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.215+0000 7fe24d356640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.215+0000 7fe24d356640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.215+0000 7fe24d356640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.215+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe2380042f0 con 0x7fe2480a8340 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.215+0000 7fe24d356640 1 -- 172.21.15.181:0/714618540 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe22c005080 con 0x7fe2480a8340 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.216+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(313..313 src has 1..313) ==== 3898+0+0 (unknown 2536213411 0 0) 0x7fe23804e240 con 0x7fe2480a8340 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.216+0000 7fe2467fc640 10 monclient: get_auth_request con 0x7fe228040650 auth_method 0 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.220+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.7 v1:172.21.15.195:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fe238017740 con 0x7fe2480a8340 2024-09-13T10:39:58.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.220+0000 7fe23f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:58.246 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.220+0000 7fe23f7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:58.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.460+0000 7fe24d356640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:39:58.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.461+0000 7fe24d356640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:58.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.461+0000 7fe24d356640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:58.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.461+0000 7fe24d356640 1 -- 172.21.15.181:0/714618540 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe22c005370 con 0x7fe2480a8340 2024-09-13T10:39:58.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.461+0000 7fe23f7fe640 1 -- 172.21.15.181:0/714618540 <== mon.7 v1:172.21.15.195:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 1177304767) 0x7fe238017040 con 0x7fe2480a8340 2024-09-13T10:39:58.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.461+0000 7fe23f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:39:58.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.461+0000 7fe23f7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:58.463 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":140,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":5,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:39:58.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.463+0000 7fe24d356640 1 -- 172.21.15.181:0/714618540 >> v1:172.21.15.195:6800/1839191919 conn(0x7fe228040650 legacy=0x7fe228042b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.463+0000 7fe24d356640 10 monclient: shutdown 2024-09-13T10:39:58.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.463+0000 7fe24d356640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:58.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.463+0000 7fe24d356640 1 -- 172.21.15.181:0/714618540 >> v1:172.21.15.195:6792/0 conn(0x7fe2480a8340 legacy=0x7fe24813cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.464+0000 7fe24d356640 1 -- 172.21.15.181:0/714618540 shutdown_connections 2024-09-13T10:39:58.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.464+0000 7fe24d356640 1 -- 172.21.15.181:0/714618540 >> 172.21.15.181:0/714618540 conn(0x7fe2480a6640 msgr2=0x7fe2480a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:58.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.464+0000 7fe24d356640 1 -- 172.21.15.181:0/714618540 shutdown_connections 2024-09-13T10:39:58.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.464+0000 7fe24d356640 1 -- 172.21.15.181:0/714618540 wait complete. 2024-09-13T10:39:58.475 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:39:58.476 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T10:39:58.476 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:39:58.476 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:39:58.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.572+0000 7f2cbded4640 10 monclient: get_monmap_and_config 2024-09-13T10:39:58.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.572+0000 7f2cbded4640 10 monclient: build_initial_monmap 2024-09-13T10:39:58.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.572+0000 7f2cbded4640 10 monclient: monmap: 2024-09-13T10:39:58.574 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:58.574 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.574 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:58.573268+0000 2024-09-13T10:39:58.574 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:58.573268+0000 2024-09-13T10:39:58.574 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:58.575 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.575 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:58.575 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:58.575 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:58.575 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:58.575 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:58.575 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:58.575 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:58.575 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:58.575 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:58.576 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.573+0000 7f2cbded4640 1 Processor -- start 2024-09-13T10:39:58.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.573+0000 7f2cbded4640 1 -- start start 2024-09-13T10:39:58.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.573+0000 7f2cbded4640 10 monclient: init 2024-09-13T10:39:58.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.573+0000 7f2cbded4640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:58.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.573+0000 7f2cbded4640 10 monclient: _add_conns ranks=[2,7,6,5,3,4,0,8,1] 2024-09-13T10:39:58.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.573+0000 7f2cbded4640 10 monclient(hunting): picked mon.noname-b con 0x7f2cb8139040 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:58.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.573+0000 7f2cbded4640 10 monclient(hunting): picked mon.noname-i con 0x7f2cb809cd50 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:58.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.574+0000 7f2cbded4640 10 monclient(hunting): picked mon.noname-d con 0x7f2cb813fae0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:58.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.574+0000 7f2cbded4640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb809dbb0 con 0x7f2cb8139040 2024-09-13T10:39:58.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.574+0000 7f2cbded4640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb809de90 con 0x7f2cb813fae0 2024-09-13T10:39:58.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.574+0000 7f2cbded4640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb809e170 con 0x7f2cb809cd50 2024-09-13T10:39:58.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.574+0000 7f2cbded4640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:58.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.574+0000 7f2cbded4640 10 monclient(hunting): authenticate will time out at 1338.079066s 2024-09-13T10:39:58.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.574+0000 7f2cb77fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f2cb8139040 0x7f2cb80a58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:46560/0 (socket says 172.21.15.181:46560) 2024-09-13T10:39:58.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.574+0000 7f2cb77fe640 1 -- 172.21.15.181:0/4191593437 learned_addr learned my addr 172.21.15.181:0/4191593437 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:58.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb77fe640 1 -- 172.21.15.181:0/4191593437 >> v1:172.21.15.181:6790/0 conn(0x7f2cb8139040 legacy=0x7f2cb80a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb7fff640 1 -- 172.21.15.181:0/4191593437 >> v1:172.21.15.181:6792/0 conn(0x7f2cb813fae0 legacy=0x7f2cb8141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb6ffd640 1 -- 172.21.15.181:0/4191593437 >> v1:172.21.15.195:6792/0 conn(0x7f2cb809cd50 legacy=0x7f2cb813e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687886620 0 0) 0x7f2cb809dbb0 con 0x7f2cb8139040 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient(hunting): my global_id is 174197 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ca0003520 con 0x7f2cb8139040 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833351410 0 0) 0x7f2cb809de90 con 0x7f2cb813fae0 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient(hunting): my global_id is 174201 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb809dbb0 con 0x7f2cb813fae0 2024-09-13T10:39:58.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3836726931 0 0) 0x7f2cb809e170 con 0x7f2cb809cd50 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient(hunting): my global_id is 57886 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb809de90 con 0x7f2cb809cd50 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4122743056 0 0) 0x7f2ca0003520 con 0x7f2cb8139040 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 >> v1:172.21.15.195:6792/0 conn(0x7f2cb809cd50 legacy=0x7f2cb813e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 >> v1:172.21.15.181:6792/0 conn(0x7f2cb813fae0 legacy=0x7f2cb8141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 monclient: found mon.noname-b 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:39:58.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb80a5ff0 con 0x7f2cb8139040 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ca8001ae0 con 0x7f2cb8139040 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cbded4640 5 monclient: authenticate success, global_id 174197 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cbded4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient: dump: 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.597 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cbded4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ca80048a0 con 0x7f2cb8139040 2024-09-13T10:39:58.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cb67fc640 1 -- 172.21.15.181:0/4191593437 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ca8004d90 con 0x7f2cb8139040 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.576+0000 7f2cbded4640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.577+0000 7f2cbded4640 4 set_mon_vals no callback set 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.577+0000 7f2cb67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.577+0000 7f2cb67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.577+0000 7f2cb67fc640 10 monclient: dump: 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.599 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.577+0000 7f2cbded4640 10 monclient: shutdown 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.577+0000 7f2cbded4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.577+0000 7f2cbded4640 1 -- 172.21.15.181:0/4191593437 >> v1:172.21.15.181:6790/0 conn(0x7f2cb8139040 legacy=0x7f2cb80a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.577+0000 7f2cbded4640 1 -- 172.21.15.181:0/4191593437 shutdown_connections 2024-09-13T10:39:58.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.577+0000 7f2cbded4640 1 -- 172.21.15.181:0/4191593437 >> 172.21.15.181:0/4191593437 conn(0x7f2cb8077120 msgr2=0x7f2cb80abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.577+0000 7f2cbded4640 1 -- 172.21.15.181:0/4191593437 shutdown_connections 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.577+0000 7f2cbded4640 1 -- 172.21.15.181:0/4191593437 wait complete. 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.578+0000 7f2cbded4640 10 monclient: build_initial_monmap 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.578+0000 7f2cbded4640 10 monclient: monmap: 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:58.601 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.578+0000 7f2cbded4640 1 Processor -- start 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.578+0000 7f2cbded4640 1 -- start start 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.578+0000 7f2cbded4640 10 monclient: init 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.579+0000 7f2cbded4640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.579+0000 7f2cbded4640 10 monclient: _add_conns ranks=[6,2,5,8,7,3,0,4,1] 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.579+0000 7f2cbded4640 10 monclient(hunting): picked mon.noname-d con 0x7f2cb809cd50 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.579+0000 7f2cbded4640 10 monclient(hunting): picked mon.noname-b con 0x7f2cb8139040 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:58.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.579+0000 7f2cbded4640 10 monclient(hunting): picked mon.noname-h con 0x7f2cb813fae0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.579+0000 7f2cbded4640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb813b040 con 0x7f2cb8139040 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.579+0000 7f2cbded4640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb8135700 con 0x7f2cb813fae0 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.579+0000 7f2cbded4640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb813a7a0 con 0x7f2cb809cd50 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.579+0000 7f2cbded4640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.579+0000 7f2cbded4640 10 monclient(hunting): authenticate will time out at 1338.084171s 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.579+0000 7f2cb6ffd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f2cb8139040 0x7f2cb8134780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:46570/0 (socket says 172.21.15.181:46570) 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.579+0000 7f2cb6ffd640 1 -- 172.21.15.181:0/827396576 learned_addr learned my addr 172.21.15.181:0/827396576 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2cb6ffd640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.181:6790/0 conn(0x7f2cb8139040 legacy=0x7f2cb8134780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2cb77fe640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.181:6792/0 conn(0x7f2cb809cd50 legacy=0x7f2cb8134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2cb7fff640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.195:6791/0 conn(0x7f2cb813fae0 legacy=0x7f2cb81d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11423359 0 0) 0x7f2cb813b040 con 0x7f2cb8139040 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): my global_id is 174206 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ca4003520 con 0x7f2cb8139040 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252592683 0 0) 0x7f2cb813a7a0 con 0x7f2cb809cd50 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): my global_id is 174210 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb813b040 con 0x7f2cb809cd50 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065545822 0 0) 0x7f2cb8135700 con 0x7f2cb813fae0 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): my global_id is 105863 2024-09-13T10:39:58.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb813a7a0 con 0x7f2cb813fae0 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1686986252 0 0) 0x7f2ca4003520 con 0x7f2cb8139040 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cb8135700 con 0x7f2cb8139040 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2cac003610 con 0x7f2cb8139040 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): dump: 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.605 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3516959773 0 0) 0x7f2cb813b040 con 0x7f2cb809cd50 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ca4003520 con 0x7f2cb809cd50 2024-09-13T10:39:58.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1544044134 0 0) 0x7f2cb813a7a0 con 0x7f2cb813fae0 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cb813b040 con 0x7f2cb813fae0 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ca8004d90 con 0x7f2cb809cd50 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): dump: 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.607 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2cb00020b0 con 0x7f2cb813fae0 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient(hunting): dump: 2024-09-13T10:39:58.608 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.609 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1056841875 0 0) 0x7f2cb8135700 con 0x7f2cb8139040 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.181:6792/0 conn(0x7f2cb809cd50 legacy=0x7f2cb8134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.195:6791/0 conn(0x7f2cb813fae0 legacy=0x7f2cb81d66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 monclient: found mon.b 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb813aa80 con 0x7f2cb8139040 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient: _finish_auth 0 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2c9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.581+0000 7f2cbded4640 5 monclient: authenticate success, global_id 174206 2024-09-13T10:39:58.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2cbded4640 10 monclient: _renew_subs 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2cbded4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2cbded4640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb8133230 con 0x7f2cb8139040 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2cbded4640 10 monclient: _renew_subs 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2cbded4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2cbded4640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2cb8134e90 con 0x7f2cb8139040 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cac003bd0 con 0x7f2cb8139040 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2c9ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2cac004140 con 0x7f2cb8139040 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2c9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2c9ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2cb5ffb640 4 set_mon_vals no callback set 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2c9ffff640 10 monclient: dump: 2024-09-13T10:39:58.611 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.612 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2cbded4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.582+0000 7f2cbded4640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2c980065c0 con 0x7f2c98002860 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.583+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2cac0042e0 con 0x7f2cb8139040 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.583+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(313..313 src has 1..313) ==== 3898+0+0 (unknown 2536213411 0 0) 0x7f2cac04e470 con 0x7f2cb8139040 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.583+0000 7f2cb7fff640 10 monclient: get_auth_request con 0x7f2ca40407b0 auth_method 0 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2cb77fe640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.181:6789/0 conn(0x7f2c98002860 legacy=0x7f2c98004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2649508571 0 0) 0x7f2c980065c0 con 0x7f2c98002860 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 10 monclient(hunting): my global_id is 174195 2024-09-13T10:39:58.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb8135700 con 0x7f2c98002860 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3966758405 0 0) 0x7f2cb8135700 con 0x7f2c98002860 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c980065c0 con 0x7f2c98002860 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ca8001d30 con 0x7f2c98002860 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 10 monclient: dump: 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.614 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 636240939 0 0) 0x7f2c980065c0 con 0x7f2c98002860 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c9800a160 con 0x7f2c98002860 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2ca80048a0 con 0x7f2c98002860 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:58.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.181:6789/0 conn(0x7f2c98002860 legacy=0x7f2c98004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.585+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.181:6789/0 conn(0x7f2c98002860 legacy=0x7f2c98004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:58.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.591+0000 7f2cbded4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:58.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.591+0000 7f2cbded4640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2c98009e70 con 0x7f2c98009130 2024-09-13T10:39:58.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2cb77fe640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.181:6789/0 conn(0x7f2c98009130 legacy=0x7f2c980095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933588969 0 0) 0x7f2c98009e70 con 0x7f2c98009130 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 10 monclient(hunting): my global_id is 174204 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c980065c0 con 0x7f2c98009130 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2863262738 0 0) 0x7f2c980065c0 con 0x7f2c98009130 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c98009e70 con 0x7f2c98009130 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2ca8005b10 con 0x7f2c98009130 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 10 monclient: dump: 2024-09-13T10:39:58.618 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.619 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.620 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1754319563 0 0) 0x7f2c98009e70 con 0x7f2c98009130 2024-09-13T10:39:58.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2c9800c410 con 0x7f2c98009130 2024-09-13T10:39:58.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 1248225538) 0x7f2ca8005f50 con 0x7f2c98009130 2024-09-13T10:39:58.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:58.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:58.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.181:6789/0 conn(0x7f2c98009130 legacy=0x7f2c980095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.594+0000 7f2c9ffff640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.181:6789/0 conn(0x7f2c98009130 legacy=0x7f2c980095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:58.620 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:58.620 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:58.620 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 11759, 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:58.621 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:58.622 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:58.623 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:58.624 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:58.625 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.628 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.629 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:58.630 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.631 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:58.634 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.637 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.638 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.639 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:58.640 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:58.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.595+0000 7f2cbded4640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.195:6800/1839191919 conn(0x7f2ca40407b0 legacy=0x7f2ca4042c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.595+0000 7f2cbded4640 10 monclient: shutdown 2024-09-13T10:39:58.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.595+0000 7f2cbded4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:58.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.595+0000 7f2cbded4640 1 -- 172.21.15.181:0/827396576 >> v1:172.21.15.181:6790/0 conn(0x7f2cb8139040 legacy=0x7f2cb8134780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.595+0000 7f2cb7fff640 1 -- 172.21.15.181:0/827396576 reap_dead start 2024-09-13T10:39:58.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.595+0000 7f2cb7fff640 1 -- 172.21.15.181:0/827396576 reap_dead start 2024-09-13T10:39:58.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.595+0000 7f2cbded4640 1 -- 172.21.15.181:0/827396576 shutdown_connections 2024-09-13T10:39:58.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.595+0000 7f2cbded4640 1 -- 172.21.15.181:0/827396576 >> 172.21.15.181:0/827396576 conn(0x7f2cb8077120 msgr2=0x7f2cb80a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:58.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.595+0000 7f2cbded4640 1 -- 172.21.15.181:0/827396576 shutdown_connections 2024-09-13T10:39:58.641 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.595+0000 7f2cbded4640 1 -- 172.21.15.181:0/827396576 wait complete. 2024-09-13T10:39:58.642 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:58.642 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:39:58.642 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:39:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.739+0000 7f431a90e640 10 monclient: get_monmap_and_config 2024-09-13T10:39:58.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.739+0000 7f431a90e640 10 monclient: build_initial_monmap 2024-09-13T10:39:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.739+0000 7f431a90e640 10 monclient: monmap: 2024-09-13T10:39:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:58.739798+0000 2024-09-13T10:39:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:58.739798+0000 2024-09-13T10:39:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:58.741 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:58.742 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:58.742 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.747 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.739+0000 7f431a90e640 1 Processor -- start 2024-09-13T10:39:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.739+0000 7f431a90e640 1 -- start start 2024-09-13T10:39:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.739+0000 7f431a90e640 10 monclient: init 2024-09-13T10:39:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.740+0000 7f431a90e640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.740+0000 7f431a90e640 10 monclient: _add_conns ranks=[2,3,5,6,1,8,7,4,0] 2024-09-13T10:39:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.740+0000 7f431a90e640 10 monclient(hunting): picked mon.noname-b con 0x7f43140a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.740+0000 7f431a90e640 10 monclient(hunting): picked mon.noname-g con 0x7f43140a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.740+0000 7f431a90e640 10 monclient(hunting): picked mon.noname-h con 0x7f431413f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.740+0000 7f431a90e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140a5fe0 con 0x7f43140a66d0 2024-09-13T10:39:58.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.740+0000 7f431a90e640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140a8080 con 0x7f43140a6ab0 2024-09-13T10:39:58.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.740+0000 7f431a90e640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140a42c0 con 0x7f431413f9a0 2024-09-13T10:39:58.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.740+0000 7f431a90e640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:58.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.740+0000 7f431a90e640 10 monclient(hunting): authenticate will time out at 1338.245510s 2024-09-13T10:39:58.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.740+0000 7f4313fff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f43140a66d0 0x7f43140a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:46578/0 (socket says 172.21.15.181:46578) 2024-09-13T10:39:58.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.740+0000 7f4313fff640 1 -- 172.21.15.181:0/1992868348 learned_addr learned my addr 172.21.15.181:0/1992868348 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:58.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.742+0000 7f4313fff640 1 -- 172.21.15.181:0/1992868348 >> v1:172.21.15.181:6790/0 conn(0x7f43140a66d0 legacy=0x7f43140a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.742+0000 7f43137fe640 1 -- 172.21.15.181:0/1992868348 >> v1:172.21.15.195:6790/0 conn(0x7f43140a6ab0 legacy=0x7f43140a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.742+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047513427 0 0) 0x7f43140a5fe0 con 0x7f43140a66d0 2024-09-13T10:39:58.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.742+0000 7f4312ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.742+0000 7f4312ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.742+0000 7f4312ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.742+0000 7f4312ffd640 10 monclient(hunting): my global_id is 174215 2024-09-13T10:39:58.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.742+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4300003520 con 0x7f43140a66d0 2024-09-13T10:39:58.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.742+0000 7f4318eab640 1 -- 172.21.15.181:0/1992868348 >> v1:172.21.15.195:6791/0 conn(0x7f431413f9a0 legacy=0x7f4314141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 587518916 0 0) 0x7f43140a8080 con 0x7f43140a6ab0 2024-09-13T10:39:58.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient(hunting): my global_id is 164523 2024-09-13T10:39:58.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43140a5fe0 con 0x7f43140a6ab0 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148558179 0 0) 0x7f43140a42c0 con 0x7f431413f9a0 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient(hunting): my global_id is 105872 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43140a8080 con 0x7f431413f9a0 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2724457637 0 0) 0x7f4300003520 con 0x7f43140a66d0 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 >> v1:172.21.15.195:6791/0 conn(0x7f431413f9a0 legacy=0x7f4314141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 >> v1:172.21.15.195:6790/0 conn(0x7f43140a6ab0 legacy=0x7f43140a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 1 monclient: found mon.noname-b 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:39:58.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43141464e0 con 0x7f43140a66d0 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient: _finish_auth 0 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f431a90e640 5 monclient: authenticate success, global_id 174215 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4304001ad0 con 0x7f43140a66d0 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient: dump: 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.752 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f431a90e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f43040048a0 con 0x7f43140a66d0 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:58.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f431a90e640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 1 -- 172.21.15.181:0/1992868348 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4304004e10 con 0x7f43140a66d0 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f431a90e640 4 set_mon_vals no callback set 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f4312ffd640 10 monclient: dump: 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.754 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f431a90e640 10 monclient: shutdown 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f431a90e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f431a90e640 1 -- 172.21.15.181:0/1992868348 >> v1:172.21.15.181:6790/0 conn(0x7f43140a66d0 legacy=0x7f43140a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f431a90e640 1 -- 172.21.15.181:0/1992868348 shutdown_connections 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f431a90e640 1 -- 172.21.15.181:0/1992868348 >> 172.21.15.181:0/1992868348 conn(0x7f43140abcd0 msgr2=0x7f43140ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:58.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f431a90e640 1 -- 172.21.15.181:0/1992868348 shutdown_connections 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.743+0000 7f431a90e640 1 -- 172.21.15.181:0/1992868348 wait complete. 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.744+0000 7f431a90e640 10 monclient: build_initial_monmap 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.744+0000 7f431a90e640 10 monclient: monmap: 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:58.756 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.744+0000 7f431a90e640 1 Processor -- start 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.744+0000 7f431a90e640 1 -- start start 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.744+0000 7f431a90e640 10 monclient: init 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.745+0000 7f431a90e640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.745+0000 7f431a90e640 10 monclient: _add_conns ranks=[7,5,2,0,6,4,3,8,1] 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.745+0000 7f431a90e640 10 monclient(hunting): picked mon.noname-i con 0x7f43140a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.745+0000 7f431a90e640 10 monclient(hunting): picked mon.noname-h con 0x7f43140a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.745+0000 7f431a90e640 10 monclient(hunting): picked mon.noname-b con 0x7f431413f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:58.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.745+0000 7f431a90e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43140a2a90 con 0x7f431413f9a0 2024-09-13T10:39:58.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.745+0000 7f431a90e640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43141cf210 con 0x7f43140a6ab0 2024-09-13T10:39:58.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.745+0000 7f431a90e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431413ce80 con 0x7f43140a66d0 2024-09-13T10:39:58.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.745+0000 7f431a90e640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:58.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.745+0000 7f431a90e640 10 monclient(hunting): authenticate will time out at 1338.250294s 2024-09-13T10:39:58.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.745+0000 7f4318eab640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f431413f9a0 0x7f43141d6650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:46588/0 (socket says 172.21.15.181:46588) 2024-09-13T10:39:58.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.745+0000 7f4318eab640 1 -- 172.21.15.181:0/1394128504 learned_addr learned my addr 172.21.15.181:0/1394128504 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:58.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4318eab640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.181:6790/0 conn(0x7f431413f9a0 legacy=0x7f43141d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f43137fe640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.195:6791/0 conn(0x7f43140a6ab0 legacy=0x7f43141ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4313fff640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.195:6792/0 conn(0x7f43140a66d0 legacy=0x7f43141ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215235808 0 0) 0x7f431413ce80 con 0x7f43140a66d0 2024-09-13T10:39:58.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 10 monclient(hunting): my global_id is 57895 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42f4003520 con 0x7f43140a66d0 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206172384 0 0) 0x7f43141cf210 con 0x7f43140a6ab0 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 10 monclient(hunting): my global_id is 105881 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f431413ce80 con 0x7f43140a6ab0 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454105805 0 0) 0x7f43140a2a90 con 0x7f431413f9a0 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 10 monclient(hunting): my global_id is 174224 2024-09-13T10:39:58.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.747+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43141cf210 con 0x7f431413f9a0 2024-09-13T10:39:58.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1750735688 0 0) 0x7f42f4003520 con 0x7f43140a66d0 2024-09-13T10:39:58.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43140a2a90 con 0x7f43140a66d0 2024-09-13T10:39:58.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4304004d90 con 0x7f43140a66d0 2024-09-13T10:39:58.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:58.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:39:58.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:58.765 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.765 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.765 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.765 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1439305858 0 0) 0x7f431413ce80 con 0x7f43140a6ab0 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42f4003520 con 0x7f43140a6ab0 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3976044169 0 0) 0x7f43141cf210 con 0x7f431413f9a0 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f431413ce80 con 0x7f431413f9a0 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f42fc003610 con 0x7f43140a6ab0 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.767 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f430c003990 con 0x7f431413f9a0 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:58.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.769 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2749686 0 0) 0x7f43140a2a90 con 0x7f43140a66d0 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.195:6791/0 conn(0x7f43140a6ab0 legacy=0x7f43141ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.181:6790/0 conn(0x7f431413f9a0 legacy=0x7f43141d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 monclient: found mon.i 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4314068960 con 0x7f43140a66d0 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient: _finish_auth 0 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:39:58.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f431a90e640 5 monclient: authenticate success, global_id 57895 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f431a90e640 10 monclient: _renew_subs 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f431a90e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f431a90e640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f431413e370 con 0x7f43140a66d0 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f431a90e640 10 monclient: _renew_subs 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f431a90e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f431a90e640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f431413f690 con 0x7f43140a66d0 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f43040048a0 con 0x7f43140a66d0 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f4304001d20 con 0x7f43140a66d0 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f43127fc640 4 set_mon_vals no callback set 2024-09-13T10:39:58.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.748+0000 7f4310ff9640 10 monclient: dump: 2024-09-13T10:39:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.772 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.749+0000 7f431a90e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.749+0000 7f431a90e640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f42f80065c0 con 0x7f42f8002860 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.749+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f4304011c20 con 0x7f43140a66d0 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.749+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(313..313 src has 1..313) ==== 3898+0+0 (unknown 2536213411 0 0) 0x7f430404e220 con 0x7f43140a66d0 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.749+0000 7f4318eab640 10 monclient: get_auth_request con 0x7f42f4040670 auth_method 0 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f43137fe640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.181:6790/0 conn(0x7f42f8002860 legacy=0x7f42f8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3207770113 0 0) 0x7f42f80065c0 con 0x7f42f8002860 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 10 monclient(hunting): my global_id is 174233 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43140a2a90 con 0x7f42f8002860 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3125968103 0 0) 0x7f43140a2a90 con 0x7f42f8002860 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42f80065c0 con 0x7f42f8002860 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f42fc003d60 con 0x7f42f8002860 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 10 monclient: dump: 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.774 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2333295076 0 0) 0x7f42f80065c0 con 0x7f42f8002860 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.751+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42f800a160 con 0x7f42f8002860 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.752+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f42fc004010 con 0x7f42f8002860 2024-09-13T10:39:58.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.752+0000 7f4310ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.752+0000 7f4310ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.752+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.181:6790/0 conn(0x7f42f8002860 legacy=0x7f42f8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.752+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.181:6790/0 conn(0x7f42f8002860 legacy=0x7f42f8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.758+0000 7f431a90e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.758+0000 7f431a90e640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f42f8009e70 con 0x7f42f8009130 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f43137fe640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.181:6790/0 conn(0x7f42f8009130 legacy=0x7f42f80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730867992 0 0) 0x7f42f8009e70 con 0x7f42f8009130 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f4310ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f4310ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f4310ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f4310ff9640 10 monclient(hunting): my global_id is 174242 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42f80065c0 con 0x7f42f8009130 2024-09-13T10:39:58.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2187685209 0 0) 0x7f42f80065c0 con 0x7f42f8009130 2024-09-13T10:39:58.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42f8009e70 con 0x7f42f8009130 2024-09-13T10:39:58.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f42fc0043f0 con 0x7f42f8009130 2024-09-13T10:39:58.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f4310ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f4310ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:58.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.760+0000 7f4310ff9640 10 monclient: dump: 2024-09-13T10:39:58.777 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.777 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.777 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.777 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.777 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.777 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.777 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1125098974 0 0) 0x7f42f8009e70 con 0x7f42f8009130 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f42f800c410 con 0x7f42f8009130 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 3427043745) 0x7f42fc007bc0 con 0x7f42f8009130 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f4310ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:58.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f4310ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:58.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.181:6790/0 conn(0x7f42f8009130 legacy=0x7f42f80095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f4310ff9640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.181:6790/0 conn(0x7f42f8009130 legacy=0x7f42f80095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:58.779 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 11917, 2024-09-13T10:39:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:58.798 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:58.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f431a90e640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.195:6800/1839191919 conn(0x7f42f4040670 legacy=0x7f42f4042b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f431a90e640 10 monclient: shutdown 2024-09-13T10:39:58.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f431a90e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:58.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f431a90e640 1 -- 172.21.15.181:0/1394128504 >> v1:172.21.15.195:6792/0 conn(0x7f43140a66d0 legacy=0x7f43141ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f4318eab640 1 -- 172.21.15.181:0/1394128504 reap_dead start 2024-09-13T10:39:58.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f4318eab640 1 -- 172.21.15.181:0/1394128504 reap_dead start 2024-09-13T10:39:58.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f431a90e640 1 -- 172.21.15.181:0/1394128504 shutdown_connections 2024-09-13T10:39:58.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f431a90e640 1 -- 172.21.15.181:0/1394128504 >> 172.21.15.181:0/1394128504 conn(0x7f43140abcd0 msgr2=0x7f43140a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:58.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f431a90e640 1 -- 172.21.15.181:0/1394128504 shutdown_connections 2024-09-13T10:39:58.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.761+0000 7f431a90e640 1 -- 172.21.15.181:0/1394128504 wait complete. 2024-09-13T10:39:58.800 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:58.800 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:39:58.801 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:39:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.899+0000 7f1f69f94640 10 monclient: get_monmap_and_config 2024-09-13T10:39:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.899+0000 7f1f69f94640 10 monclient: build_initial_monmap 2024-09-13T10:39:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.899+0000 7f1f69f94640 10 monclient: monmap: 2024-09-13T10:39:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:58.901 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:58.900310+0000 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:58.900310+0000 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:58.902 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.900+0000 7f1f69f94640 1 Processor -- start 2024-09-13T10:39:58.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.900+0000 7f1f69f94640 1 -- start start 2024-09-13T10:39:58.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.900+0000 7f1f69f94640 10 monclient: init 2024-09-13T10:39:58.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.900+0000 7f1f69f94640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.900+0000 7f1f69f94640 10 monclient: _add_conns ranks=[8,6,3,4,0,7,5,1,2] 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.900+0000 7f1f69f94640 10 monclient(hunting): picked mon.noname-e con 0x7f1f640a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.900+0000 7f1f69f94640 10 monclient(hunting): picked mon.noname-d con 0x7f1f640a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.900+0000 7f1f69f94640 10 monclient(hunting): picked mon.noname-g con 0x7f1f6413f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.900+0000 7f1f69f94640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f640a4bc0 con 0x7f1f6413f750 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.900+0000 7f1f69f94640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6413a320 con 0x7f1f640a8340 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.901+0000 7f1f69f94640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f640a8100 con 0x7f1f640a6640 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.901+0000 7f1f69f94640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.901+0000 7f1f69f94640 10 monclient(hunting): authenticate will time out at 1338.406016s 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.901+0000 7f1f637fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f1f640a6640 0x7f1f64139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:42612/0 (socket says 172.21.15.181:42612) 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.901+0000 7f1f637fe640 1 -- 172.21.15.181:0/2467433558 learned_addr learned my addr 172.21.15.181:0/2467433558 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f637fe640 1 -- 172.21.15.181:0/2467433558 >> v1:172.21.15.181:6793/0 conn(0x7f1f640a6640 legacy=0x7f1f64139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f62ffd640 1 -- 172.21.15.181:0/2467433558 >> v1:172.21.15.181:6792/0 conn(0x7f1f640a8340 legacy=0x7f1f64139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f63fff640 1 -- 172.21.15.181:0/2467433558 >> v1:172.21.15.195:6790/0 conn(0x7f1f6413f750 legacy=0x7f1f64141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962052824 0 0) 0x7f1f640a8100 con 0x7f1f640a6640 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient(hunting): my global_id is 105974 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f4c003520 con 0x7f1f640a6640 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3268273475 0 0) 0x7f1f6413a320 con 0x7f1f640a8340 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient(hunting): my global_id is 174219 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f640a8100 con 0x7f1f640a8340 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 338358609 0 0) 0x7f1f640a4bc0 con 0x7f1f6413f750 2024-09-13T10:39:58.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient(hunting): my global_id is 164532 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f6413a320 con 0x7f1f6413f750 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1675116168 0 0) 0x7f1f4c003520 con 0x7f1f640a6640 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 >> v1:172.21.15.181:6792/0 conn(0x7f1f640a8340 legacy=0x7f1f64139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 >> v1:172.21.15.195:6790/0 conn(0x7f1f6413f750 legacy=0x7f1f64141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 monclient: found mon.noname-e 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f640a48e0 con 0x7f1f640a6640 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:58.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f54001ae0 con 0x7f1f640a6640 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f69f94640 5 monclient: authenticate success, global_id 105974 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient: dump: 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.912 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f69f94640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f540048a0 con 0x7f1f640a6640 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 1 -- 172.21.15.181:0/2467433558 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f54004e10 con 0x7f1f640a6640 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f69f94640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:58.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f69f94640 4 set_mon_vals no callback set 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.903+0000 7f1f627fc640 10 monclient: dump: 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.914 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.904+0000 7f1f69f94640 10 monclient: shutdown 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.904+0000 7f1f69f94640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.904+0000 7f1f69f94640 1 -- 172.21.15.181:0/2467433558 >> v1:172.21.15.181:6793/0 conn(0x7f1f640a6640 legacy=0x7f1f64139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.904+0000 7f1f69f94640 1 -- 172.21.15.181:0/2467433558 shutdown_connections 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.904+0000 7f1f69f94640 1 -- 172.21.15.181:0/2467433558 >> 172.21.15.181:0/2467433558 conn(0x7f1f64077170 msgr2=0x7f1f640abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.904+0000 7f1f69f94640 1 -- 172.21.15.181:0/2467433558 shutdown_connections 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.904+0000 7f1f69f94640 1 -- 172.21.15.181:0/2467433558 wait complete. 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.904+0000 7f1f69f94640 10 monclient: build_initial_monmap 2024-09-13T10:39:58.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.904+0000 7f1f69f94640 10 monclient: monmap: 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:58.916 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.905+0000 7f1f69f94640 1 Processor -- start 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.905+0000 7f1f69f94640 1 -- start start 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.905+0000 7f1f69f94640 10 monclient: init 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.905+0000 7f1f69f94640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.905+0000 7f1f69f94640 10 monclient: _add_conns ranks=[2,7,4,6,0,1,8,3,5] 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.905+0000 7f1f69f94640 10 monclient(hunting): picked mon.noname-b con 0x7f1f640a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.905+0000 7f1f69f94640 10 monclient(hunting): picked mon.noname-i con 0x7f1f6413f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.905+0000 7f1f69f94640 10 monclient(hunting): picked mon.noname-c con 0x7f1f6413df70 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.906+0000 7f1f69f94640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6413d410 con 0x7f1f640a8340 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.906+0000 7f1f69f94640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f641355e0 con 0x7f1f6413df70 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.906+0000 7f1f637fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f1f640a8340 0x7f1f641ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:46620/0 (socket says 172.21.15.181:46620) 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.906+0000 7f1f637fe640 1 -- 172.21.15.181:0/640358057 learned_addr learned my addr 172.21.15.181:0/640358057 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:58.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.906+0000 7f1f69f94640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f64134d00 con 0x7f1f6413f750 2024-09-13T10:39:58.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.906+0000 7f1f69f94640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:58.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.906+0000 7f1f69f94640 10 monclient(hunting): authenticate will time out at 1338.411077s 2024-09-13T10:39:58.920 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1314241533}) 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742427830}) 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1314241533}) 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=657970261}) 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1314241533}) 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3095122965}) 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1314241533}) 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2769418918}) 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.921 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1314241533}) 2024-09-13T10:39:58.922 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1798002338}) 2024-09-13T10:39:58.922 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.922 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1314241533}) 2024-09-13T10:39:58.922 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4014587417}) 2024-09-13T10:39:58.922 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.922 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1314241533}) 2024-09-13T10:39:58.922 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3746870456}) 2024-09-13T10:39:58.922 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:58.922 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1314241533}) 2024-09-13T10:39:58.922 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:58.913+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=886234533}) 2024-09-13T10:39:58.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f637fe640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.181:6790/0 conn(0x7f1f640a8340 legacy=0x7f1f641ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f63fff640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.181:6791/0 conn(0x7f1f6413df70 legacy=0x7f1f641d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102139343 0 0) 0x7f1f6413d410 con 0x7f1f640a8340 2024-09-13T10:39:58.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): my global_id is 174251 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f50003550 con 0x7f1f640a8340 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373297836 0 0) 0x7f1f641355e0 con 0x7f1f6413df70 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): my global_id is 174199 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f6413d410 con 0x7f1f6413df70 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f62ffd640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.195:6792/0 conn(0x7f1f6413f750 legacy=0x7f1f641d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2239842139 0 0) 0x7f1f64134d00 con 0x7f1f6413f750 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): my global_id is 57904 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f641355e0 con 0x7f1f6413f750 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1536018986 0 0) 0x7f1f50003550 con 0x7f1f640a8340 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f64134d00 con 0x7f1f640a8340 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f54004d90 con 0x7f1f640a8340 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): dump: 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.928 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:58.929 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3551692423 0 0) 0x7f1f6413d410 con 0x7f1f6413df70 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f50003550 con 0x7f1f6413df70 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f5c002070 con 0x7f1f6413df70 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient(hunting): dump: 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.930 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3212244343 0 0) 0x7f1f64134d00 con 0x7f1f640a8340 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.195:6792/0 conn(0x7f1f6413f750 legacy=0x7f1f641d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.181:6791/0 conn(0x7f1f6413df70 legacy=0x7f1f641d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 monclient: found mon.b 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:58.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f64134460 con 0x7f1f640a8340 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient: _finish_auth 0 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f69f94640 5 monclient: authenticate success, global_id 174251 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f69f94640 10 monclient: _renew_subs 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f69f94640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f69f94640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6413ca20 con 0x7f1f640a8340 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f69f94640 10 monclient: _renew_subs 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f69f94640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f69f94640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1f641cecb0 con 0x7f1f640a8340 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f54001d30 con 0x7f1f640a8340 2024-09-13T10:39:58.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f540048a0 con 0x7f1f640a8340 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f61ffb640 4 set_mon_vals no callback set 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.908+0000 7f1f4bfff640 10 monclient: dump: 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.933 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.909+0000 7f1f69f94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.909+0000 7f1f69f94640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1f440065c0 con 0x7f1f44002860 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.909+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f1f54011c20 con 0x7f1f640a8340 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.910+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(313..313 src has 1..313) ==== 3898+0+0 (unknown 2536213411 0 0) 0x7f1f5404e3a0 con 0x7f1f640a8340 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.910+0000 7f1f63fff640 10 monclient: get_auth_request con 0x7f1f50040470 auth_method 0 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.911+0000 7f1f62ffd640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.181:6791/0 conn(0x7f1f44002860 legacy=0x7f1f44004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.911+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183257798 0 0) 0x7f1f440065c0 con 0x7f1f44002860 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.911+0000 7f1f4bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.911+0000 7f1f4bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.911+0000 7f1f4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.911+0000 7f1f4bfff640 10 monclient(hunting): my global_id is 174208 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.911+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f64134d00 con 0x7f1f44002860 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3228305521 0 0) 0x7f1f64134d00 con 0x7f1f44002860 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f440065c0 con 0x7f1f44002860 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f58003950 con 0x7f1f44002860 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 10 monclient: dump: 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.935 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 767014237 0 0) 0x7f1f440065c0 con 0x7f1f44002860 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f4400a160 con 0x7f1f44002860 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1f580057c0 con 0x7f1f44002860 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.181:6791/0 conn(0x7f1f44002860 legacy=0x7f1f44004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.912+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.181:6791/0 conn(0x7f1f44002860 legacy=0x7f1f44004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.918+0000 7f1f69f94640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.918+0000 7f1f69f94640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1f44009e50 con 0x7f1f44009110 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f62ffd640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.181:6791/0 conn(0x7f1f44009110 legacy=0x7f1f440095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131110902 0 0) 0x7f1f44009e50 con 0x7f1f44009110 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:58.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 10 monclient(hunting): my global_id is 174217 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f440065c0 con 0x7f1f44009110 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2204832518 0 0) 0x7f1f440065c0 con 0x7f1f44009110 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f44009e50 con 0x7f1f44009110 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1f58004120 con 0x7f1f44009110 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 10 monclient: dump: 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:58.938 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 171963833 0 0) 0x7f1f44009e50 con 0x7f1f44009110 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1f4400c3f0 con 0x7f1f44009110 2024-09-13T10:39:58.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 977023301) 0x7f1f58004430 con 0x7f1f44009110 2024-09-13T10:39:58.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:58.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:58.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.181:6791/0 conn(0x7f1f44009110 legacy=0x7f1f440095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.921+0000 7f1f4bfff640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.181:6791/0 conn(0x7f1f44009110 legacy=0x7f1f440095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:58.940 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:58.940 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:58.940 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:58.940 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:58.940 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:58.940 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 12103, 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 5, 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:58.941 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:58.942 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:58.943 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.944 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:58.944 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:58.944 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:58.944 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:58.944 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:58.944 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:58.944 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:58.944 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:58.944 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:58.944 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:58.944 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:58.945 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:58.948 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:58.949 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.950 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:58.952 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.953 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.955 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:58.956 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:58.956 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.956 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.956 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.956 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:58.956 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.956 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.956 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.956 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:58.956 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:58.957 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:58.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:58.959 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:58.960 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:58.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.922+0000 7f1f69f94640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.195:6800/1839191919 conn(0x7f1f50040470 legacy=0x7f1f50042930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.922+0000 7f1f69f94640 10 monclient: shutdown 2024-09-13T10:39:58.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.922+0000 7f1f69f94640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:58.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.922+0000 7f1f69f94640 1 -- 172.21.15.181:0/640358057 >> v1:172.21.15.181:6790/0 conn(0x7f1f640a8340 legacy=0x7f1f641ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:58.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.922+0000 7f1f63fff640 1 -- 172.21.15.181:0/640358057 reap_dead start 2024-09-13T10:39:58.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.922+0000 7f1f63fff640 1 -- 172.21.15.181:0/640358057 reap_dead start 2024-09-13T10:39:58.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.922+0000 7f1f69f94640 1 -- 172.21.15.181:0/640358057 shutdown_connections 2024-09-13T10:39:58.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.922+0000 7f1f69f94640 1 -- 172.21.15.181:0/640358057 >> 172.21.15.181:0/640358057 conn(0x7f1f640a6640 msgr2=0x7f1f640a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:58.961 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.922+0000 7f1f69f94640 1 -- 172.21.15.181:0/640358057 shutdown_connections 2024-09-13T10:39:58.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:58.922+0000 7f1f69f94640 1 -- 172.21.15.181:0/640358057 wait complete. 2024-09-13T10:39:58.962 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:58.962 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:39:58.962 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:39:59.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1507148320}) 2024-09-13T10:39:59.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1734510123}) 2024-09-13T10:39:59.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1507148320}) 2024-09-13T10:39:59.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=570911333}) 2024-09-13T10:39:59.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1507148320}) 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4206822850}) 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1507148320}) 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1613755893}) 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1507148320}) 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2076524205}) 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1507148320}) 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=351831711}) 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1507148320}) 2024-09-13T10:39:59.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2435059938}) 2024-09-13T10:39:59.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1507148320}) 2024-09-13T10:39:59.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.017+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2739922166}) 2024-09-13T10:39:59.025 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.023+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.026 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.023+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=502913923}) 2024-09-13T10:39:59.026 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4025398814}) 2024-09-13T10:39:59.026 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.026 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=502913923}) 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1062008683}) 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=502913923}) 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3114902237}) 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=502913923}) 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1196738930}) 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=502913923}) 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2296188524}) 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=502913923}) 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2671120693}) 2024-09-13T10:39:59.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=502913923}) 2024-09-13T10:39:59.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3650056216}) 2024-09-13T10:39:59.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=502913923}) 2024-09-13T10:39:59.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.024+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1018850608}) 2024-09-13T10:39:59.030 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40919]: starting. 2024-09-13T10:39:59.030 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40919]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40917 2024-09-13T10:39:59.030 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[40919]: shutting down. 2024-09-13T10:39:59.039 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.039 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4280998641}) 2024-09-13T10:39:59.039 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3309831524}) 2024-09-13T10:39:59.039 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.039 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4280998641}) 2024-09-13T10:39:59.039 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3907434934}) 2024-09-13T10:39:59.039 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.039 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4280998641}) 2024-09-13T10:39:59.039 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2555624257}) 2024-09-13T10:39:59.039 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.039 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4280998641}) 2024-09-13T10:39:59.039 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3641116412}) 2024-09-13T10:39:59.040 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.040 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4280998641}) 2024-09-13T10:39:59.040 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1715661563}) 2024-09-13T10:39:59.040 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.040 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4280998641}) 2024-09-13T10:39:59.040 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4057064497}) 2024-09-13T10:39:59.040 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.040 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4280998641}) 2024-09-13T10:39:59.040 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=72984358}) 2024-09-13T10:39:59.040 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.040 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4280998641}) 2024-09-13T10:39:59.040 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.037+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=173729607}) 2024-09-13T10:39:59.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.067+0000 7f8693d24640 10 monclient: get_monmap_and_config 2024-09-13T10:39:59.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.067+0000 7f8693d24640 10 monclient: build_initial_monmap 2024-09-13T10:39:59.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.067+0000 7f8693d24640 10 monclient: monmap: 2024-09-13T10:39:59.069 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:59.069 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.069 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:59.068348+0000 2024-09-13T10:39:59.069 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:59.068348+0000 2024-09-13T10:39:59.069 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:59.070 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.070 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:59.070 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:59.070 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:59.070 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:59.070 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:59.070 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:59.070 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:59.070 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:59.070 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:59.070 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.068+0000 7f8693d24640 1 Processor -- start 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.068+0000 7f8693d24640 1 -- start start 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.068+0000 7f8693d24640 10 monclient: init 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.069+0000 7f8693d24640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.069+0000 7f8693d24640 10 monclient: _add_conns ranks=[0,5,1,7,8,6,4,3,2] 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.069+0000 7f8693d24640 10 monclient(hunting): picked mon.noname-a con 0x7f868c133d50 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.069+0000 7f8693d24640 10 monclient(hunting): picked mon.noname-h con 0x7f868c133890 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.069+0000 7f8693d24640 10 monclient(hunting): picked mon.noname-f con 0x7f868c13d870 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.069+0000 7f8693d24640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868c0737d0 con 0x7f868c133d50 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.069+0000 7f8693d24640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868c073ab0 con 0x7f868c13d870 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.069+0000 7f8693d24640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868c073d90 con 0x7f868c133890 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.069+0000 7f8693d24640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:59.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.069+0000 7f8693d24640 10 monclient(hunting): authenticate will time out at 1338.574179s 2024-09-13T10:39:59.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.069+0000 7f8691ac0640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f868c133d50 0x7f868c134130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:40994/0 (socket says 172.21.15.181:40994) 2024-09-13T10:39:59.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.069+0000 7f8691ac0640 1 -- 172.21.15.181:0/942563846 learned_addr learned my addr 172.21.15.181:0/942563846 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:59.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8691ac0640 1 -- 172.21.15.181:0/942563846 >> v1:172.21.15.181:6789/0 conn(0x7f868c133d50 legacy=0x7f868c134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f86912bf640 1 -- 172.21.15.181:0/942563846 >> v1:172.21.15.195:6791/0 conn(0x7f868c133890 legacy=0x7f868c13c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4018270354 0 0) 0x7f868c0737d0 con 0x7f868c133d50 2024-09-13T10:39:59.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f86922c1640 1 -- 172.21.15.181:0/942563846 >> v1:172.21.15.195:6789/0 conn(0x7f868c13d870 legacy=0x7f868c13fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient(hunting): my global_id is 174222 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8678003520 con 0x7f868c133d50 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498631244 0 0) 0x7f868c073d90 con 0x7f868c133890 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient(hunting): my global_id is 105917 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f868c0737d0 con 0x7f868c133890 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3103013812 0 0) 0x7f868c073ab0 con 0x7f868c13d870 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient(hunting): my global_id is 134911 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f868c073d90 con 0x7f868c13d870 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1222510455 0 0) 0x7f8678003520 con 0x7f868c133d50 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 >> v1:172.21.15.195:6791/0 conn(0x7f868c133890 legacy=0x7f868c13c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 >> v1:172.21.15.195:6789/0 conn(0x7f868c13d870 legacy=0x7f868c13fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 monclient: found mon.noname-a 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c074070 con 0x7f868c133d50 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient: _finish_auth 0 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8688001ae0 con 0x7f868c133d50 2024-09-13T10:39:59.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient: dump: 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.079 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8693d24640 5 monclient: authenticate success, global_id 174222 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8693d24640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f86880048a0 con 0x7f868c133d50 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 1 -- 172.21.15.181:0/942563846 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8688004e10 con 0x7f868c133d50 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8693d24640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8693d24640 4 set_mon_vals no callback set 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.071+0000 7f8690abe640 10 monclient: dump: 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.080 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.081 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.072+0000 7f8693d24640 10 monclient: shutdown 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.072+0000 7f8693d24640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.072+0000 7f8693d24640 1 -- 172.21.15.181:0/942563846 >> v1:172.21.15.181:6789/0 conn(0x7f868c133d50 legacy=0x7f868c134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.072+0000 7f8693d24640 1 -- 172.21.15.181:0/942563846 shutdown_connections 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.072+0000 7f8693d24640 1 -- 172.21.15.181:0/942563846 >> 172.21.15.181:0/942563846 conn(0x7f868c0aa1c0 msgr2=0x7f868c0a65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.072+0000 7f8693d24640 1 -- 172.21.15.181:0/942563846 shutdown_connections 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.072+0000 7f8693d24640 1 -- 172.21.15.181:0/942563846 wait complete. 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 10 monclient: build_initial_monmap 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 10 monclient: monmap: 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:59.082 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 1 Processor -- start 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 1 -- start start 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 10 monclient: init 2024-09-13T10:39:59.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:59.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 10 monclient: _add_conns ranks=[7,5,4,0,3,2,1,8,6] 2024-09-13T10:39:59.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 10 monclient(hunting): picked mon.noname-i con 0x7f868c133890 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:59.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 10 monclient(hunting): picked mon.noname-h con 0x7f868c133d50 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:59.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 10 monclient(hunting): picked mon.noname-c con 0x7f868c13d870 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:59.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868c13d200 con 0x7f868c13d870 2024-09-13T10:39:59.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868c070120 con 0x7f868c133d50 2024-09-13T10:39:59.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868c09e5c0 con 0x7f868c133890 2024-09-13T10:39:59.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:59.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.073+0000 7f8693d24640 10 monclient(hunting): authenticate will time out at 1338.578966s 2024-09-13T10:39:59.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.074+0000 7f86922c1640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f868c13d870 0x7f868c1d6ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51554/0 (socket says 172.21.15.181:51554) 2024-09-13T10:39:59.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.074+0000 7f86922c1640 1 -- 172.21.15.181:0/1601532711 learned_addr learned my addr 172.21.15.181:0/1601532711 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:59.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86922c1640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.181:6791/0 conn(0x7f868c13d870 legacy=0x7f868c1d6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2665209625 0 0) 0x7f868c073d90 con 0x7f868c13d870 2024-09-13T10:39:59.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.088 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): my global_id is 174253 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8670003520 con 0x7f868c13d870 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86912bf640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.195:6791/0 conn(0x7f868c133d50 legacy=0x7f868c1d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f8691ac0640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.195:6792/0 conn(0x7f868c133890 legacy=0x7f868c1ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3381404171 0 0) 0x7f8670003520 con 0x7f868c13d870 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f868c073d90 con 0x7f868c13d870 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8684003990 con 0x7f868c13d870 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): dump: 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.089 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:59.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615159043 0 0) 0x7f868c070120 con 0x7f868c133d50 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): my global_id is 105926 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8670003520 con 0x7f868c133d50 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713174869 0 0) 0x7f868c09e5c0 con 0x7f868c133890 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient(hunting): my global_id is 57931 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f868c070120 con 0x7f868c133890 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1081204969 0 0) 0x7f868c073d90 con 0x7f868c13d870 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.195:6792/0 conn(0x7f868c133890 legacy=0x7f868c1ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.195:6791/0 conn(0x7f868c133d50 legacy=0x7f868c1d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 monclient: found mon.c 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c1410d0 con 0x7f868c13d870 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f8693d24640 5 monclient: authenticate success, global_id 174253 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f8693d24640 10 monclient: _renew_subs 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f8693d24640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f8693d24640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f868c140c80 con 0x7f868c13d870 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f8693d24640 10 monclient: _renew_subs 2024-09-13T10:39:59.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f8693d24640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f8693d24640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f868c09e2e0 con 0x7f868c13d870 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8684003ed0 con 0x7f868c13d870 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8684004400 con 0x7f868c13d870 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f8683fff640 4 set_mon_vals no callback set 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.076+0000 7f86827fc640 10 monclient: dump: 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.093 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.077+0000 7f8693d24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.077+0000 7f8693d24640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f86740065c0 con 0x7f8674002860 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.077+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f86840045a0 con 0x7f868c13d870 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.078+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7f868404e600 con 0x7f868c13d870 2024-09-13T10:39:59.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.078+0000 7f86912bf640 10 monclient: get_auth_request con 0x7f867003fc80 auth_method 0 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.079+0000 7f8691ac0640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.181:6792/0 conn(0x7f8674002860 legacy=0x7f8674004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.079+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020986034 0 0) 0x7f86740065c0 con 0x7f8674002860 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.079+0000 7f86827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.079+0000 7f86827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.079+0000 7f86827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.079+0000 7f86827fc640 10 monclient(hunting): my global_id is 174237 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.079+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f868c073d90 con 0x7f8674002860 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 156135196 0 0) 0x7f868c073d90 con 0x7f8674002860 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86740065c0 con 0x7f8674002860 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8688004be0 con 0x7f8674002860 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 10 monclient: dump: 2024-09-13T10:39:59.095 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.096 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.097 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1944777064 0 0) 0x7f86740065c0 con 0x7f8674002860 2024-09-13T10:39:59.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f867400a160 con 0x7f8674002860 2024-09-13T10:39:59.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8688001990 con 0x7f8674002860 2024-09-13T10:39:59.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:59.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:59.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.181:6792/0 conn(0x7f8674002860 legacy=0x7f8674004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.080+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.181:6792/0 conn(0x7f8674002860 legacy=0x7f8674004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:59.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.086+0000 7f8693d24640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:59.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.086+0000 7f8693d24640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8674009e70 con 0x7f8674009130 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.088+0000 7f8691ac0640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.181:6792/0 conn(0x7f8674009130 legacy=0x7f86740095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3689153207 0 0) 0x7f8674009e70 con 0x7f8674009130 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 10 monclient(hunting): my global_id is 174246 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86740065c0 con 0x7f8674009130 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2343398948 0 0) 0x7f86740065c0 con 0x7f8674009130 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8674009e70 con 0x7f8674009130 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8688005490 con 0x7f8674009130 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 10 monclient: dump: 2024-09-13T10:39:59.099 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.100 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.101 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.101 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2945795160 0 0) 0x7f8674009e70 con 0x7f8674009130 2024-09-13T10:39:59.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f867400c410 con 0x7f8674009130 2024-09-13T10:39:59.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 3564029252) 0x7f8688007d90 con 0x7f8674009130 2024-09-13T10:39:59.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:59.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:59.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.181:6792/0 conn(0x7f8674009130 legacy=0x7f86740095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86827fc640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.181:6792/0 conn(0x7f8674009130 legacy=0x7f86740095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:59.101 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:59.101 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 12270, 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:59.102 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 6, 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.103 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.104 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:59.105 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.106 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.107 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.108 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.110 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:59.111 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.113 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.114 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.115 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:59.116 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:59.118 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.119 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:59.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.120 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.120 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.120 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:59.120 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.120 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.120 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:59.120 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:59.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f8693d24640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.195:6800/1839191919 conn(0x7f867003fc80 legacy=0x7f8670042140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.121 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f8693d24640 10 monclient: shutdown 2024-09-13T10:39:59.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f8693d24640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:59.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f8693d24640 1 -- 172.21.15.181:0/1601532711 >> v1:172.21.15.181:6791/0 conn(0x7f868c13d870 legacy=0x7f868c1d6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86922c1640 1 -- 172.21.15.181:0/1601532711 reap_dead start 2024-09-13T10:39:59.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f86922c1640 1 -- 172.21.15.181:0/1601532711 reap_dead start 2024-09-13T10:39:59.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f8693d24640 1 -- 172.21.15.181:0/1601532711 shutdown_connections 2024-09-13T10:39:59.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.089+0000 7f8693d24640 1 -- 172.21.15.181:0/1601532711 >> 172.21.15.181:0/1601532711 conn(0x7f868c0aa1c0 msgr2=0x7f868c0a51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:59.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.090+0000 7f8693d24640 1 -- 172.21.15.181:0/1601532711 shutdown_connections 2024-09-13T10:39:59.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.090+0000 7f8693d24640 1 -- 172.21.15.181:0/1601532711 wait complete. 2024-09-13T10:39:59.122 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:59.122 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:39:59.123 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:39:59.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.219+0000 7fa489794640 10 monclient: get_monmap_and_config 2024-09-13T10:39:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.219+0000 7fa489794640 10 monclient: build_initial_monmap 2024-09-13T10:39:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.219+0000 7fa489794640 10 monclient: monmap: 2024-09-13T10:39:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:59.219978+0000 2024-09-13T10:39:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:59.219978+0000 2024-09-13T10:39:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.221 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:59.222 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:59.222 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.219+0000 7fa489794640 1 Processor -- start 2024-09-13T10:39:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.219+0000 7fa489794640 1 -- start start 2024-09-13T10:39:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.219+0000 7fa489794640 10 monclient: init 2024-09-13T10:39:59.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.220+0000 7fa489794640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:59.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.220+0000 7fa489794640 10 monclient: _add_conns ranks=[3,1,8,0,4,7,6,5,2] 2024-09-13T10:39:59.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.220+0000 7fa489794640 10 monclient(hunting): picked mon.noname-g con 0x7fa4840a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:59.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.220+0000 7fa489794640 10 monclient(hunting): picked mon.noname-f con 0x7fa4840a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:59.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.220+0000 7fa489794640 10 monclient(hunting): picked mon.noname-e con 0x7fa48413f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:59.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.220+0000 7fa489794640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4840a4bc0 con 0x7fa4840a8340 2024-09-13T10:39:59.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.220+0000 7fa489794640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa48413a320 con 0x7fa4840a6640 2024-09-13T10:39:59.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.220+0000 7fa489794640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4840a8100 con 0x7fa48413f750 2024-09-13T10:39:59.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.220+0000 7fa489794640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:59.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.220+0000 7fa489794640 10 monclient(hunting): authenticate will time out at 1338.725496s 2024-09-13T10:39:59.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.220+0000 7fa4837fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7fa48413f750 0x7fa484141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:42620/0 (socket says 172.21.15.181:42620) 2024-09-13T10:39:59.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.220+0000 7fa4837fe640 1 -- 172.21.15.181:0/692950655 learned_addr learned my addr 172.21.15.181:0/692950655 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:59.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.222+0000 7fa4837fe640 1 -- 172.21.15.181:0/692950655 >> v1:172.21.15.181:6793/0 conn(0x7fa48413f750 legacy=0x7fa484141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.222+0000 7fa482ffd640 1 -- 172.21.15.181:0/692950655 >> v1:172.21.15.195:6790/0 conn(0x7fa4840a6640 legacy=0x7fa484139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.222+0000 7fa4827fc640 1 -- 172.21.15.181:0/692950655 >> v1:172.21.15.195:6789/0 conn(0x7fa4840a8340 legacy=0x7fa484139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4166833097 0 0) 0x7fa4840a8100 con 0x7fa48413f750 2024-09-13T10:39:59.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient(hunting): my global_id is 105992 2024-09-13T10:39:59.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa46c003520 con 0x7fa48413f750 2024-09-13T10:39:59.229 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2084706860 0 0) 0x7fa4840a4bc0 con 0x7fa4840a8340 2024-09-13T10:39:59.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient(hunting): my global_id is 134920 2024-09-13T10:39:59.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4840a8100 con 0x7fa4840a8340 2024-09-13T10:39:59.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425560034 0 0) 0x7fa48413a320 con 0x7fa4840a6640 2024-09-13T10:39:59.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient(hunting): my global_id is 164541 2024-09-13T10:39:59.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4840a4bc0 con 0x7fa4840a6640 2024-09-13T10:39:59.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1291026209 0 0) 0x7fa46c003520 con 0x7fa48413f750 2024-09-13T10:39:59.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 >> v1:172.21.15.195:6790/0 conn(0x7fa4840a6640 legacy=0x7fa484139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 >> v1:172.21.15.195:6789/0 conn(0x7fa4840a8340 legacy=0x7fa484139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:39:59.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 monclient: found mon.noname-e 2024-09-13T10:39:59.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:59.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:59.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4840a48e0 con 0x7fa48413f750 2024-09-13T10:39:59.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient: _finish_auth 0 2024-09-13T10:39:59.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:39:59.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:59.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa47c001e60 con 0x7fa48413f750 2024-09-13T10:39:59.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa489794640 5 monclient: authenticate success, global_id 105992 2024-09-13T10:39:59.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa489794640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:59.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:59.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient: dump: 2024-09-13T10:39:59.232 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.232 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.232 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.232 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.232 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.232 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.232 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.232 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.233 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.233 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.233 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.233 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.233 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.233 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.233 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.233 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa489794640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:59.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa47c004c20 con 0x7fa48413f750 2024-09-13T10:39:59.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:59.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 1 -- 172.21.15.181:0/692950655 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa47c005190 con 0x7fa48413f750 2024-09-13T10:39:59.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa489794640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:59.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa489794640 4 set_mon_vals no callback set 2024-09-13T10:39:59.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:59.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa481ffb640 10 monclient: dump: 2024-09-13T10:39:59.234 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.234 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.234 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.234 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.234 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.234 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.234 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.235 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.235 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.235 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.235 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.235 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.235 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.235 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.235 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.235 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa489794640 10 monclient: shutdown 2024-09-13T10:39:59.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa489794640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:59.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa489794640 1 -- 172.21.15.181:0/692950655 >> v1:172.21.15.181:6793/0 conn(0x7fa48413f750 legacy=0x7fa484141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa489794640 1 -- 172.21.15.181:0/692950655 shutdown_connections 2024-09-13T10:39:59.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.223+0000 7fa489794640 1 -- 172.21.15.181:0/692950655 >> 172.21.15.181:0/692950655 conn(0x7fa484077170 msgr2=0x7fa4840abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:59.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.224+0000 7fa489794640 1 -- 172.21.15.181:0/692950655 shutdown_connections 2024-09-13T10:39:59.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.224+0000 7fa489794640 1 -- 172.21.15.181:0/692950655 wait complete. 2024-09-13T10:39:59.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.224+0000 7fa489794640 10 monclient: build_initial_monmap 2024-09-13T10:39:59.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.224+0000 7fa489794640 10 monclient: monmap: 2024-09-13T10:39:59.236 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:59.236 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:59.236 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:59.236 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 1 Processor -- start 2024-09-13T10:39:59.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 1 -- start start 2024-09-13T10:39:59.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 10 monclient: init 2024-09-13T10:39:59.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:59.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 10 monclient: _add_conns ranks=[3,1,5,2,6,0,4,8,7] 2024-09-13T10:39:59.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 10 monclient(hunting): picked mon.noname-g con 0x7fa4840a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:59.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 10 monclient(hunting): picked mon.noname-f con 0x7fa48413f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:59.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 10 monclient(hunting): picked mon.noname-h con 0x7fa48409f840 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:59.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4840a1040 con 0x7fa48413f750 2024-09-13T10:39:59.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa484142ed0 con 0x7fa4840a8340 2024-09-13T10:39:59.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4840a2a20 con 0x7fa48409f840 2024-09-13T10:39:59.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:59.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa489794640 10 monclient(hunting): authenticate will time out at 1338.730525s 2024-09-13T10:39:59.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa482ffd640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7fa4840a8340 0x7fa48409d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:34208/0 (socket says 172.21.15.181:34208) 2024-09-13T10:39:59.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.225+0000 7fa482ffd640 1 -- 172.21.15.181:0/291616696 learned_addr learned my addr 172.21.15.181:0/291616696 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:59.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.227+0000 7fa482ffd640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.195:6790/0 conn(0x7fa4840a8340 legacy=0x7fa48409d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.227+0000 7fa4837fe640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.195:6791/0 conn(0x7fa48409f840 legacy=0x7fa4841d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.227+0000 7fa4827fc640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.195:6789/0 conn(0x7fa48413f750 legacy=0x7fa48409d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.227+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:39:59.246 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.246 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=96616533}) 2024-09-13T10:39:59.247 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1340965239}) 2024-09-13T10:39:59.247 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.247 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=96616533}) 2024-09-13T10:39:59.247 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1834449650}) 2024-09-13T10:39:59.247 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.247 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=96616533}) 2024-09-13T10:39:59.247 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1886743553}) 2024-09-13T10:39:59.247 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.247 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=96616533}) 2024-09-13T10:39:59.247 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4251102594}) 2024-09-13T10:39:59.247 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.247 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=96616533}) 2024-09-13T10:39:59.248 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1218008181}) 2024-09-13T10:39:59.248 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.248 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=96616533}) 2024-09-13T10:39:59.248 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4249522751}) 2024-09-13T10:39:59.248 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.248 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=96616533}) 2024-09-13T10:39:59.248 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=586173301}) 2024-09-13T10:39:59.248 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.248 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=96616533}) 2024-09-13T10:39:59.248 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.236+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4098041237}) 2024-09-13T10:39:59.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179383520 0 0) 0x7fa484142ed0 con 0x7fa4840a8340 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 10 monclient(hunting): my global_id is 164550 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa470003550 con 0x7fa4840a8340 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637753758 0 0) 0x7fa4840a1040 con 0x7fa48413f750 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 10 monclient(hunting): my global_id is 134929 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa484142ed0 con 0x7fa48413f750 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186792521 0 0) 0x7fa4840a2a20 con 0x7fa48409f840 2024-09-13T10:39:59.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 10 monclient(hunting): my global_id is 105935 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.229+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4840a1040 con 0x7fa48409f840 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3809505945 0 0) 0x7fa484142ed0 con 0x7fa48413f750 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4840a2a20 con 0x7fa48413f750 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa478003610 con 0x7fa48413f750 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.254 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:59.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2135387062 0 0) 0x7fa470003550 con 0x7fa4840a8340 2024-09-13T10:39:59.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa484142ed0 con 0x7fa4840a8340 2024-09-13T10:39:59.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa474003950 con 0x7fa4840a8340 2024-09-13T10:39:59.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:59.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:59.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:59.256 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.256 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.256 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.256 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.256 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.256 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.256 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.257 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.257 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.257 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.257 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.257 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.257 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.257 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.257 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.257 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 858762089 0 0) 0x7fa4840a1040 con 0x7fa48409f840 2024-09-13T10:39:59.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa470003550 con 0x7fa48409f840 2024-09-13T10:39:59.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa47c0020b0 con 0x7fa48409f840 2024-09-13T10:39:59.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:59.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:59.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient(hunting): dump: 2024-09-13T10:39:59.258 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.258 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.258 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.258 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1416715559 0 0) 0x7fa4840a2a20 con 0x7fa48413f750 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.195:6791/0 conn(0x7fa48409f840 legacy=0x7fa4841d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.195:6790/0 conn(0x7fa4840a8340 legacy=0x7fa48409d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 monclient: found mon.f 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4840a01d0 con 0x7fa48413f750 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa489794640 5 monclient: authenticate success, global_id 134929 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa489794640 10 monclient: _renew_subs 2024-09-13T10:39:59.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa489794640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa489794640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa48409ece0 con 0x7fa48413f750 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa489794640 10 monclient: _renew_subs 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa489794640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa489794640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4840a0d60 con 0x7fa48413f750 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa478003ae0 con 0x7fa48413f750 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa478003fd0 con 0x7fa48413f750 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa4817fa640 4 set_mon_vals no callback set 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.230+0000 7fa46b7fe640 10 monclient: dump: 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.261 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.262 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.231+0000 7fa489794640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.231+0000 7fa489794640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa4640065c0 con 0x7fa464002860 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.231+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fa478004270 con 0x7fa48413f750 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.231+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7fa47804e070 con 0x7fa48413f750 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.231+0000 7fa4837fe640 10 monclient: get_auth_request con 0x7fa4700406c0 auth_method 0 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa482ffd640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.181:6793/0 conn(0x7fa464002860 legacy=0x7fa464004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164110624 0 0) 0x7fa4640065c0 con 0x7fa464002860 2024-09-13T10:39:59.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 10 monclient(hunting): my global_id is 106001 2024-09-13T10:39:59.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4840a2a20 con 0x7fa464002860 2024-09-13T10:39:59.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2226315296 0 0) 0x7fa4840a2a20 con 0x7fa464002860 2024-09-13T10:39:59.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4640065c0 con 0x7fa464002860 2024-09-13T10:39:59.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa474003eb0 con 0x7fa464002860 2024-09-13T10:39:59.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:59.264 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 10 monclient: dump: 2024-09-13T10:39:59.264 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.264 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.265 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 198763479 0 0) 0x7fa4640065c0 con 0x7fa464002860 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.233+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa46400a160 con 0x7fa464002860 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.234+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa4740041c0 con 0x7fa464002860 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.234+0000 7fa46b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.234+0000 7fa46b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.234+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.181:6793/0 conn(0x7fa464002860 legacy=0x7fa464004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.234+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.181:6793/0 conn(0x7fa464002860 legacy=0x7fa464004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.240+0000 7fa489794640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.240+0000 7fa489794640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa464009e50 con 0x7fa464009110 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.242+0000 7fa482ffd640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.181:6793/0 conn(0x7fa464009110 legacy=0x7fa4640095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 565702512 0 0) 0x7fa464009e50 con 0x7fa464009110 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.266 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 10 monclient(hunting): my global_id is 106010 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4640065c0 con 0x7fa464009110 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2133968536 0 0) 0x7fa4640065c0 con 0x7fa464009110 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa464009e50 con 0x7fa464009110 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fa474005cf0 con 0x7fa464009110 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 10 monclient: dump: 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.267 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 671587620 0 0) 0x7fa464009e50 con 0x7fa464009110 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa46400c3a0 con 0x7fa464009110 2024-09-13T10:39:59.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 3958607061) 0x7fa474005f50 con 0x7fa464009110 2024-09-13T10:39:59.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:59.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:59.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.181:6793/0 conn(0x7fa464009110 legacy=0x7fa4640095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.269 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa46b7fe640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.181:6793/0 conn(0x7fa464009110 legacy=0x7fa4640095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:59.269 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 282946, 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 6, 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:59.270 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.271 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.272 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:59.273 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:59.274 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.275 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.277 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.278 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.279 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.280 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.282 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:59.283 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.284 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:59.286 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:59.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:59.290 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:59.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa489794640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.195:6800/1839191919 conn(0x7fa4700406c0 legacy=0x7fa470042b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa489794640 10 monclient: shutdown 2024-09-13T10:39:59.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa489794640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:59.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa489794640 1 -- 172.21.15.181:0/291616696 >> v1:172.21.15.195:6789/0 conn(0x7fa48413f750 legacy=0x7fa48409d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa4837fe640 1 -- 172.21.15.181:0/291616696 reap_dead start 2024-09-13T10:39:59.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa4837fe640 1 -- 172.21.15.181:0/291616696 reap_dead start 2024-09-13T10:39:59.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa489794640 1 -- 172.21.15.181:0/291616696 shutdown_connections 2024-09-13T10:39:59.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.243+0000 7fa489794640 1 -- 172.21.15.181:0/291616696 >> 172.21.15.181:0/291616696 conn(0x7fa4840a6640 msgr2=0x7fa48413ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:59.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.244+0000 7fa489794640 1 -- 172.21.15.181:0/291616696 shutdown_connections 2024-09-13T10:39:59.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.244+0000 7fa489794640 1 -- 172.21.15.181:0/291616696 wait complete. 2024-09-13T10:39:59.292 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:59.293 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:39:59.293 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:39:59.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.390+0000 7f7f56553640 10 monclient: get_monmap_and_config 2024-09-13T10:39:59.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.390+0000 7f7f56553640 10 monclient: build_initial_monmap 2024-09-13T10:39:59.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.390+0000 7f7f56553640 10 monclient: monmap: 2024-09-13T10:39:59.392 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:59.392 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.392 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:59.391173+0000 2024-09-13T10:39:59.392 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:59.391173+0000 2024-09-13T10:39:59.392 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:59.392 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.392 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:59.393 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:59.393 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:59.393 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:59.393 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:59.393 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:59.393 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:59.393 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:59.393 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:59.393 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 1 Processor -- start 2024-09-13T10:39:59.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 1 -- start start 2024-09-13T10:39:59.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 10 monclient: init 2024-09-13T10:39:59.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:59.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 10 monclient: _add_conns ranks=[8,6,3,5,4,2,0,7,1] 2024-09-13T10:39:59.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 10 monclient(hunting): picked mon.noname-e con 0x7f7f500a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:59.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 10 monclient(hunting): picked mon.noname-d con 0x7f7f500a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:59.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 10 monclient(hunting): picked mon.noname-g con 0x7f7f5013f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:59.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f500a4bc0 con 0x7f7f5013f750 2024-09-13T10:39:59.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f5013a320 con 0x7f7f500a8340 2024-09-13T10:39:59.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f500a8100 con 0x7f7f500a6640 2024-09-13T10:39:59.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:59.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.391+0000 7f7f56553640 10 monclient(hunting): authenticate will time out at 1338.896986s 2024-09-13T10:39:59.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.392+0000 7f7f4ffff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f7f500a6640 0x7f7f50139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:42640/0 (socket says 172.21.15.181:42640) 2024-09-13T10:39:59.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.392+0000 7f7f4ffff640 1 -- 172.21.15.181:0/2010661248 learned_addr learned my addr 172.21.15.181:0/2010661248 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:59.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4f7fe640 1 -- 172.21.15.181:0/2010661248 >> v1:172.21.15.181:6792/0 conn(0x7f7f500a8340 legacy=0x7f7f50139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4ffff640 1 -- 172.21.15.181:0/2010661248 >> v1:172.21.15.181:6793/0 conn(0x7f7f500a6640 legacy=0x7f7f50139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 1 -- 172.21.15.181:0/2010661248 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168016055 0 0) 0x7f7f5013a320 con 0x7f7f500a8340 2024-09-13T10:39:59.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient(hunting): my global_id is 174255 2024-09-13T10:39:59.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 1 -- 172.21.15.181:0/2010661248 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f38003520 con 0x7f7f500a8340 2024-09-13T10:39:59.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 1 -- 172.21.15.181:0/2010661248 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1023725945 0 0) 0x7f7f500a8100 con 0x7f7f500a6640 2024-09-13T10:39:59.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient(hunting): my global_id is 106019 2024-09-13T10:39:59.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 1 -- 172.21.15.181:0/2010661248 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f5013a320 con 0x7f7f500a6640 2024-09-13T10:39:59.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f54af0640 1 -- 172.21.15.181:0/2010661248 >> v1:172.21.15.195:6790/0 conn(0x7f7f5013f750 legacy=0x7f7f50141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 1 -- 172.21.15.181:0/2010661248 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2105411029 0 0) 0x7f7f38003520 con 0x7f7f500a8340 2024-09-13T10:39:59.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 1 -- 172.21.15.181:0/2010661248 >> v1:172.21.15.181:6793/0 conn(0x7f7f500a6640 legacy=0x7f7f50139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 1 -- 172.21.15.181:0/2010661248 >> v1:172.21.15.195:6790/0 conn(0x7f7f5013f750 legacy=0x7f7f50141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:59.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 1 monclient: found mon.noname-d 2024-09-13T10:39:59.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:59.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:39:59.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 1 -- 172.21.15.181:0/2010661248 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f500a48e0 con 0x7f7f500a8340 2024-09-13T10:39:59.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient: _finish_auth 0 2024-09-13T10:39:59.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:59.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:59.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f56553640 5 monclient: authenticate success, global_id 174255 2024-09-13T10:39:59.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 1 -- 172.21.15.181:0/2010661248 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f44001b30 con 0x7f7f500a8340 2024-09-13T10:39:59.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f56553640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:59.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:39:59.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient: dump: 2024-09-13T10:39:59.415 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.415 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.415 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.415 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.415 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.416 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.416 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.416 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.416 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.416 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.417 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.417 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.417 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.417 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.417 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.417 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f56553640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:59.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 1 -- 172.21.15.181:0/2010661248 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f44003610 con 0x7f7f500a8340 2024-09-13T10:39:59.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:59.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 1 -- 172.21.15.181:0/2010661248 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f44003b80 con 0x7f7f500a8340 2024-09-13T10:39:59.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f56553640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:59.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f56553640 4 set_mon_vals no callback set 2024-09-13T10:39:59.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:59.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.394+0000 7f7f4effd640 10 monclient: dump: 2024-09-13T10:39:59.419 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.419 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.420 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.420 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.420 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.421 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.421 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.421 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.421 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.421 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.421 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.422 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.422 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.422 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.422 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.422 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.395+0000 7f7f56553640 10 monclient: shutdown 2024-09-13T10:39:59.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.395+0000 7f7f56553640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:59.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.395+0000 7f7f56553640 1 -- 172.21.15.181:0/2010661248 >> v1:172.21.15.181:6792/0 conn(0x7f7f500a8340 legacy=0x7f7f50139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.395+0000 7f7f56553640 1 -- 172.21.15.181:0/2010661248 shutdown_connections 2024-09-13T10:39:59.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.395+0000 7f7f56553640 1 -- 172.21.15.181:0/2010661248 >> 172.21.15.181:0/2010661248 conn(0x7f7f50077170 msgr2=0x7f7f500abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:59.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.395+0000 7f7f56553640 1 -- 172.21.15.181:0/2010661248 shutdown_connections 2024-09-13T10:39:59.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.395+0000 7f7f56553640 1 -- 172.21.15.181:0/2010661248 wait complete. 2024-09-13T10:39:59.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.395+0000 7f7f56553640 10 monclient: build_initial_monmap 2024-09-13T10:39:59.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.395+0000 7f7f56553640 10 monclient: monmap: 2024-09-13T10:39:59.424 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:59.424 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:59.424 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:59.425 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:59.425 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:59.425 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:59.425 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:59.425 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:59.425 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:59.426 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:59.426 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:59.426 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:59.426 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:59.426 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:59.427 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:59.427 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 1 Processor -- start 2024-09-13T10:39:59.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 1 -- start start 2024-09-13T10:39:59.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 10 monclient: init 2024-09-13T10:39:59.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 10 monclient: _add_conns ranks=[5,0,6,4,1,8,2,3,7] 2024-09-13T10:39:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 10 monclient(hunting): picked mon.noname-h con 0x7f7f500a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 10 monclient(hunting): picked mon.noname-a con 0x7f7f5013f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 10 monclient(hunting): picked mon.noname-d con 0x7f7f5009f6c0 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:59.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f500a0050 con 0x7f7f5013f750 2024-09-13T10:39:59.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f501ce250 con 0x7f7f500a8340 2024-09-13T10:39:59.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f5009eb60 con 0x7f7f5009f6c0 2024-09-13T10:39:59.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:59.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.396+0000 7f7f56553640 10 monclient(hunting): authenticate will time out at 1338.901982s 2024-09-13T10:39:59.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.397+0000 7f7f4f7fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7f5013f750 0x7f7f501d2d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:40996/0 (socket says 172.21.15.181:40996) 2024-09-13T10:39:59.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.397+0000 7f7f54af0640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f7f5009f6c0 0x7f7f501d6480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:36674/0 (socket says 172.21.15.181:36674) 2024-09-13T10:39:59.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.397+0000 7f7f4f7fe640 1 -- 172.21.15.181:0/3310631872 learned_addr learned my addr 172.21.15.181:0/3310631872 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:59.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4f7fe640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.181:6789/0 conn(0x7f7f5013f750 legacy=0x7f7f501d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f54af0640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.181:6792/0 conn(0x7f7f5009f6c0 legacy=0x7f7f501d6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1027736303 0 0) 0x7f7f500a0050 con 0x7f7f5013f750 2024-09-13T10:39:59.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): my global_id is 174231 2024-09-13T10:39:59.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f3c003520 con 0x7f7f5013f750 2024-09-13T10:39:59.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398810748 0 0) 0x7f7f5009eb60 con 0x7f7f5009f6c0 2024-09-13T10:39:59.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): my global_id is 174264 2024-09-13T10:39:59.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f500a0050 con 0x7f7f5009f6c0 2024-09-13T10:39:59.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4ffff640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.195:6791/0 conn(0x7f7f500a8340 legacy=0x7f7f500a22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2696483511 0 0) 0x7f7f501ce250 con 0x7f7f500a8340 2024-09-13T10:39:59.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): my global_id is 105944 2024-09-13T10:39:59.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f5009eb60 con 0x7f7f500a8340 2024-09-13T10:39:59.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3800001920 0 0) 0x7f7f3c003520 con 0x7f7f5013f750 2024-09-13T10:39:59.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f501ce250 con 0x7f7f5013f750 2024-09-13T10:39:59.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f44003b00 con 0x7f7f5013f750 2024-09-13T10:39:59.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:59.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:39:59.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): dump: 2024-09-13T10:39:59.435 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.435 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.435 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.435 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.435 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.435 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.436 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.436 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.436 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.436 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.436 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.437 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.437 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.437 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.437 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.437 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:59.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3323790710 0 0) 0x7f7f500a0050 con 0x7f7f5009f6c0 2024-09-13T10:39:59.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f3c003520 con 0x7f7f5009f6c0 2024-09-13T10:39:59.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f48001fd0 con 0x7f7f5009f6c0 2024-09-13T10:39:59.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:59.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:39:59.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): dump: 2024-09-13T10:39:59.439 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.439 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.439 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.439 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.439 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.440 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.440 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.440 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.440 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.440 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.441 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.444 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.444 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.445 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.445 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.445 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 386003453 0 0) 0x7f7f5009eb60 con 0x7f7f500a8340 2024-09-13T10:39:59.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f500a0050 con 0x7f7f500a8340 2024-09-13T10:39:59.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f40001320 con 0x7f7f500a8340 2024-09-13T10:39:59.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:59.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:59.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient(hunting): dump: 2024-09-13T10:39:59.447 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.447 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.447 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.447 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.447 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.448 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.448 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.448 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.448 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.449 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.449 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.449 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.449 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.450 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.450 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.450 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 767119129 0 0) 0x7f7f501ce250 con 0x7f7f5013f750 2024-09-13T10:39:59.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.181:6792/0 conn(0x7f7f5009f6c0 legacy=0x7f7f501d6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.195:6791/0 conn(0x7f7f500a8340 legacy=0x7f7f500a22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient: _finish_hunting 0 2024-09-13T10:39:59.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 monclient: found mon.a 2024-09-13T10:39:59.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:59.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:59.451 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f500a0ec0 con 0x7f7f5013f750 2024-09-13T10:39:59.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient: _finish_auth 0 2024-09-13T10:39:59.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 10 monclient: _check_auth_tickets 2024-09-13T10:39:59.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f4cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:59.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f56553640 5 monclient: authenticate success, global_id 174231 2024-09-13T10:39:59.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f56553640 10 monclient: _renew_subs 2024-09-13T10:39:59.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f56553640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:59.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f56553640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7f500a0620 con 0x7f7f5013f750 2024-09-13T10:39:59.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f56553640 10 monclient: _renew_subs 2024-09-13T10:39:59.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f56553640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:59.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.399+0000 7f7f56553640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7f501cde90 con 0x7f7f5013f750 2024-09-13T10:39:59.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.400+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f44003610 con 0x7f7f5013f750 2024-09-13T10:39:59.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.400+0000 7f7f4cff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:59.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.400+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f44001350 con 0x7f7f5013f750 2024-09-13T10:39:59.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.400+0000 7f7f4cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.400+0000 7f7f4cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:59.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.400+0000 7f7f4e7fc640 4 set_mon_vals no callback set 2024-09-13T10:39:59.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.400+0000 7f7f4cff9640 10 monclient: dump: 2024-09-13T10:39:59.455 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.455 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.455 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.455 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.455 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.456 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.456 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.456 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.456 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.456 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.457 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.457 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.457 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.457 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.457 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.457 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.400+0000 7f7f56553640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:59.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.400+0000 7f7f56553640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7f300065c0 con 0x7f7f30002860 2024-09-13T10:39:59.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.400+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7f44011ca0 con 0x7f7f5013f750 2024-09-13T10:39:59.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.401+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7f7f4404e170 con 0x7f7f5013f750 2024-09-13T10:39:59.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.401+0000 7f7f54af0640 10 monclient: get_auth_request con 0x7f7f3c040600 auth_method 0 2024-09-13T10:39:59.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4ffff640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.195:6789/0 conn(0x7f7f30002860 legacy=0x7f7f30004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2486667055 0 0) 0x7f7f300065c0 con 0x7f7f30002860 2024-09-13T10:39:59.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 10 monclient(hunting): my global_id is 134938 2024-09-13T10:39:59.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f501ce250 con 0x7f7f30002860 2024-09-13T10:39:59.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3579871307 0 0) 0x7f7f501ce250 con 0x7f7f30002860 2024-09-13T10:39:59.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f300065c0 con 0x7f7f30002860 2024-09-13T10:39:59.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f40004e20 con 0x7f7f30002860 2024-09-13T10:39:59.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:59.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 10 monclient: dump: 2024-09-13T10:39:59.461 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.461 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.461 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.461 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.462 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.462 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.462 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.462 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.462 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.462 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.463 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.463 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.463 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.463 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.463 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.464 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3355561862 0 0) 0x7f7f300065c0 con 0x7f7f30002860 2024-09-13T10:39:59.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.403+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f3000a160 con 0x7f7f30002860 2024-09-13T10:39:59.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.404+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7f400070c0 con 0x7f7f30002860 2024-09-13T10:39:59.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.404+0000 7f7f4cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:59.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.404+0000 7f7f4cff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:59.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.404+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.195:6789/0 conn(0x7f7f30002860 legacy=0x7f7f30004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.404+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.195:6789/0 conn(0x7f7f30002860 legacy=0x7f7f30004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:59.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.410+0000 7f7f56553640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:59.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.410+0000 7f7f56553640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7f30009e70 con 0x7f7f30009130 2024-09-13T10:39:59.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.412+0000 7f7f4ffff640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.195:6789/0 conn(0x7f7f30009130 legacy=0x7f7f300095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.412+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2023920769 0 0) 0x7f7f30009e70 con 0x7f7f30009130 2024-09-13T10:39:59.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.412+0000 7f7f4cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.412+0000 7f7f4cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.412+0000 7f7f4cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.412+0000 7f7f4cff9640 10 monclient(hunting): my global_id is 134947 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.412+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f300065c0 con 0x7f7f30009130 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 946003199 0 0) 0x7f7f300065c0 con 0x7f7f30009130 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f30009e70 con 0x7f7f30009130 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7f40005840 con 0x7f7f30009130 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 10 monclient: dump: 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.469 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 653857141 0 0) 0x7f7f30009e70 con 0x7f7f30009130 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7f3000c410 con 0x7f7f30009130 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 2689606141) 0x7f7f4000a0e0 con 0x7f7f30009130 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:59.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:59.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.195:6789/0 conn(0x7f7f30009130 legacy=0x7f7f300095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f4cff9640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.195:6789/0 conn(0x7f7f30009130 legacy=0x7f7f300095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:59.471 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:59.471 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:59.471 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:59.471 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:59.471 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:59.471 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 131442, 2024-09-13T10:39:59.471 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:59.471 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:59.471 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 6, 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:59.472 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:59.473 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:59.474 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:59.475 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.476 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.478 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:59.479 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.480 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.481 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.482 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.484 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.485 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.486 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:59.487 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.488 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.489 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.490 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.490 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:59.490 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.490 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.490 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:59.490 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f56553640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7f3c040600 legacy=0x7f7f3c042ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f56553640 10 monclient: shutdown 2024-09-13T10:39:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f56553640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:59.491 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f56553640 1 -- 172.21.15.181:0/3310631872 >> v1:172.21.15.181:6789/0 conn(0x7f7f5013f750 legacy=0x7f7f501d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f54af0640 1 -- 172.21.15.181:0/3310631872 reap_dead start 2024-09-13T10:39:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f54af0640 1 -- 172.21.15.181:0/3310631872 reap_dead start 2024-09-13T10:39:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f56553640 1 -- 172.21.15.181:0/3310631872 shutdown_connections 2024-09-13T10:39:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.413+0000 7f7f56553640 1 -- 172.21.15.181:0/3310631872 >> 172.21.15.181:0/3310631872 conn(0x7f7f500a6640 msgr2=0x7f7f500aa310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.414+0000 7f7f56553640 1 -- 172.21.15.181:0/3310631872 shutdown_connections 2024-09-13T10:39:59.492 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.414+0000 7f7f56553640 1 -- 172.21.15.181:0/3310631872 wait complete. 2024-09-13T10:39:59.492 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:59.492 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:39:59.492 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:39:59.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.589+0000 7f9041e86640 10 monclient: get_monmap_and_config 2024-09-13T10:39:59.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.589+0000 7f9041e86640 10 monclient: build_initial_monmap 2024-09-13T10:39:59.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.589+0000 7f9041e86640 10 monclient: monmap: 2024-09-13T10:39:59.591 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:59.591 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.591 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:59.589988+0000 2024-09-13T10:39:59.591 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:59.589988+0000 2024-09-13T10:39:59.591 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:59.591 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.591 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:59.591 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:59.591 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:59.592 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:59.592 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:59.592 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:59.592 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:59.592 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:59.592 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:59.592 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.593 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 1 Processor -- start 2024-09-13T10:39:59.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 1 -- start start 2024-09-13T10:39:59.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 10 monclient: init 2024-09-13T10:39:59.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:59.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 10 monclient: _add_conns ranks=[8,7,5,1,2,3,4,6,0] 2024-09-13T10:39:59.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 10 monclient(hunting): picked mon.noname-e con 0x7f903c0a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:59.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 10 monclient(hunting): picked mon.noname-i con 0x7f903c0a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:39:59.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 10 monclient(hunting): picked mon.noname-h con 0x7f903c13f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:59.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c0a4bc0 con 0x7f903c13f750 2024-09-13T10:39:59.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c13a320 con 0x7f903c0a8340 2024-09-13T10:39:59.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c0a8100 con 0x7f903c0a6640 2024-09-13T10:39:59.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:59.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f9041e86640 10 monclient(hunting): authenticate will time out at 1339.095684s 2024-09-13T10:39:59.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f903b7fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f903c0a6640 0x7f903c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:42654/0 (socket says 172.21.15.181:42654) 2024-09-13T10:39:59.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.590+0000 7f903b7fe640 1 -- 172.21.15.181:0/1801502994 learned_addr learned my addr 172.21.15.181:0/1801502994 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:59.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903b7fe640 1 -- 172.21.15.181:0/1801502994 >> v1:172.21.15.181:6793/0 conn(0x7f903c0a6640 legacy=0x7f903c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 1 -- 172.21.15.181:0/1801502994 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659081865 0 0) 0x7f903c0a8100 con 0x7f903c0a6640 2024-09-13T10:39:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient(hunting): my global_id is 106028 2024-09-13T10:39:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 1 -- 172.21.15.181:0/1801502994 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9024003520 con 0x7f903c0a6640 2024-09-13T10:39:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903bfff640 1 -- 172.21.15.181:0/1801502994 >> v1:172.21.15.195:6791/0 conn(0x7f903c13f750 legacy=0x7f903c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903affd640 1 -- 172.21.15.181:0/1801502994 >> v1:172.21.15.195:6792/0 conn(0x7f903c0a8340 legacy=0x7f903c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 1 -- 172.21.15.181:0/1801502994 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2976343507 0 0) 0x7f9024003520 con 0x7f903c0a6640 2024-09-13T10:39:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 1 -- 172.21.15.181:0/1801502994 >> v1:172.21.15.195:6792/0 conn(0x7f903c0a8340 legacy=0x7f903c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 1 -- 172.21.15.181:0/1801502994 >> v1:172.21.15.195:6791/0 conn(0x7f903c13f750 legacy=0x7f903c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:59.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 1 monclient: found mon.noname-e 2024-09-13T10:39:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:39:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 1 -- 172.21.15.181:0/1801502994 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c0a48e0 con 0x7f903c0a6640 2024-09-13T10:39:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f9041e86640 5 monclient: authenticate success, global_id 106028 2024-09-13T10:39:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f9041e86640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 1 -- 172.21.15.181:0/1801502994 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f902c001ae0 con 0x7f903c0a6640 2024-09-13T10:39:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.600 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient: dump: 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.601 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f9041e86640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 1 -- 172.21.15.181:0/1801502994 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f902c0048a0 con 0x7f903c0a6640 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f9041e86640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 1 -- 172.21.15.181:0/1801502994 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f902c004e10 con 0x7f903c0a6640 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f9041e86640 4 set_mon_vals no callback set 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f903a7fc640 10 monclient: dump: 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.602 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f9041e86640 10 monclient: shutdown 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f9041e86640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.593+0000 7f9041e86640 1 -- 172.21.15.181:0/1801502994 >> v1:172.21.15.181:6793/0 conn(0x7f903c0a6640 legacy=0x7f903c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.594+0000 7f9041e86640 1 -- 172.21.15.181:0/1801502994 shutdown_connections 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.594+0000 7f9041e86640 1 -- 172.21.15.181:0/1801502994 >> 172.21.15.181:0/1801502994 conn(0x7f903c077170 msgr2=0x7f903c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.594+0000 7f9041e86640 1 -- 172.21.15.181:0/1801502994 shutdown_connections 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.594+0000 7f9041e86640 1 -- 172.21.15.181:0/1801502994 wait complete. 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.594+0000 7f9041e86640 10 monclient: build_initial_monmap 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.594+0000 7f9041e86640 10 monclient: monmap: 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:59.604 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:59.605 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:59.605 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:59.605 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:59.605 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:59.605 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:59.605 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:59.605 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:59.605 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:59.605 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.594+0000 7f9041e86640 1 Processor -- start 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f9041e86640 1 -- start start 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f9041e86640 10 monclient: init 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f9041e86640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f9041e86640 10 monclient: _add_conns ranks=[1,3,4,6,8,2,7,5,0] 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f9041e86640 10 monclient(hunting): picked mon.noname-f con 0x7f903c0a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f9041e86640 10 monclient(hunting): picked mon.noname-g con 0x7f903c13f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f9041e86640 10 monclient(hunting): picked mon.noname-c con 0x7f903c13ca90 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f9041e86640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c134c50 con 0x7f903c0a8340 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f9041e86640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c13e700 con 0x7f903c13f750 2024-09-13T10:39:59.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f9041e86640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c13d3c0 con 0x7f903c13ca90 2024-09-13T10:39:59.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f9041e86640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:59.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f9041e86640 10 monclient(hunting): authenticate will time out at 1339.100727s 2024-09-13T10:39:59.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f903bfff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f903c13ca90 0x7f903c1d6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51556/0 (socket says 172.21.15.181:51556) 2024-09-13T10:39:59.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.595+0000 7f903bfff640 1 -- 172.21.15.181:0/2657719730 learned_addr learned my addr 172.21.15.181:0/2657719730 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:59.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.597+0000 7f903bfff640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.181:6791/0 conn(0x7f903c13ca90 legacy=0x7f903c1d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f903affd640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.195:6790/0 conn(0x7f903c13f750 legacy=0x7f903c13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f903b7fe640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.195:6789/0 conn(0x7f903c0a8340 legacy=0x7f903c13bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603401735 0 0) 0x7f903c13d3c0 con 0x7f903c13ca90 2024-09-13T10:39:59.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): my global_id is 174262 2024-09-13T10:39:59.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9028003550 con 0x7f903c13ca90 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243868558 0 0) 0x7f903c134c50 con 0x7f903c0a8340 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): my global_id is 134956 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f903c13d3c0 con 0x7f903c0a8340 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 680396515 0 0) 0x7f9028003550 con 0x7f903c13ca90 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f903c134c50 con 0x7f903c13ca90 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f90340020b0 con 0x7f903c13ca90 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): dump: 2024-09-13T10:39:59.612 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.613 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1773903511 0 0) 0x7f903c13e700 con 0x7f903c13f750 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient(hunting): my global_id is 164568 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9028003550 con 0x7f903c13f750 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2387603993 0 0) 0x7f903c134c50 con 0x7f903c13ca90 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.195:6790/0 conn(0x7f903c13f750 legacy=0x7f903c13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.195:6789/0 conn(0x7f903c0a8340 legacy=0x7f903c13bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient: _finish_hunting 0 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 monclient: found mon.c 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:59.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c1343b0 con 0x7f903c13ca90 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient: _finish_auth 0 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient: _check_auth_tickets 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9041e86640 5 monclient: authenticate success, global_id 174262 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9041e86640 10 monclient: _renew_subs 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9041e86640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9041e86640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f903c134690 con 0x7f903c13ca90 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9041e86640 10 monclient: _renew_subs 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9041e86640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9041e86640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f903c1d7a40 con 0x7f903c13ca90 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9034003db0 con 0x7f903c13ca90 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:59.615 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f90340042e0 con 0x7f903c13ca90 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9039ffb640 4 set_mon_vals no callback set 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.598+0000 7f9023fff640 10 monclient: dump: 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.616 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.599+0000 7f9041e86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.599+0000 7f9041e86640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f901c0065c0 con 0x7f901c002860 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.599+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f9034004480 con 0x7f903c13ca90 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.599+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7f903404e430 con 0x7f903c13ca90 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.599+0000 7f903affd640 10 monclient: get_auth_request con 0x7f902803fc20 auth_method 0 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.601+0000 7f903b7fe640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.195:6790/0 conn(0x7f901c002860 legacy=0x7f901c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.601+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 888741323 0 0) 0x7f901c0065c0 con 0x7f901c002860 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.601+0000 7f9023fff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.601+0000 7f9023fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.601+0000 7f9023fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.601+0000 7f9023fff640 10 monclient(hunting): my global_id is 164577 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.601+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f903c134c50 con 0x7f901c002860 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3679528429 0 0) 0x7f903c134c50 con 0x7f901c002860 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f901c0065c0 con 0x7f901c002860 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f902c001580 con 0x7f901c002860 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 10 monclient: dump: 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.618 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.619 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2624014673 0 0) 0x7f901c0065c0 con 0x7f901c002860 2024-09-13T10:39:59.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f901c00a160 con 0x7f901c002860 2024-09-13T10:39:59.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f902c0048a0 con 0x7f901c002860 2024-09-13T10:39:59.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:59.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:59.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.195:6790/0 conn(0x7f901c002860 legacy=0x7f901c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.602+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.195:6790/0 conn(0x7f901c002860 legacy=0x7f901c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:59.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.608+0000 7f9041e86640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:59.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.609+0000 7f9041e86640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f901c009e70 con 0x7f901c009130 2024-09-13T10:39:59.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.611+0000 7f903b7fe640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.195:6790/0 conn(0x7f901c009130 legacy=0x7f901c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.611+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 673344044 0 0) 0x7f901c009e70 con 0x7f901c009130 2024-09-13T10:39:59.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.611+0000 7f9023fff640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.611+0000 7f9023fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.611+0000 7f9023fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.611+0000 7f9023fff640 10 monclient(hunting): my global_id is 164586 2024-09-13T10:39:59.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.611+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f901c0065c0 con 0x7f901c009130 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 976830031 0 0) 0x7f901c0065c0 con 0x7f901c009130 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f901c009e70 con 0x7f901c009130 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f902c0059c0 con 0x7f901c009130 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 10 monclient: dump: 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.623 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2379182070 0 0) 0x7f901c009e70 con 0x7f901c009130 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f901c00c410 con 0x7f901c009130 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 1860704174) 0x7f902c005d10 con 0x7f901c009130 2024-09-13T10:39:59.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:59.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:59.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.195:6790/0 conn(0x7f901c009130 legacy=0x7f901c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9023fff640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.195:6790/0 conn(0x7f901c009130 legacy=0x7f901c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:59.625 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:59.625 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:59.625 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:59.625 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:59.625 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:59.625 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 79071, 2024-09-13T10:39:59.625 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:59.626 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:59.626 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:59.626 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:59.626 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:59.626 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:59.626 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:59.626 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:59.626 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:59.626 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:59.626 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.626 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 6, 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.627 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.628 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:59.629 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:59.630 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:59.630 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:59.630 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:59.630 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:59.630 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:59.630 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:59.630 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.630 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.630 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.630 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.630 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.630 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.631 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.633 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.634 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:59.635 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.636 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.637 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:59.640 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:59.641 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.642 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.642 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.642 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:59.642 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:59.642 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.642 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.642 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.642 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:59.642 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:59.643 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.643 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.643 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.643 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:59.643 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.643 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.643 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.643 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:59.643 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:59.643 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.644 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.644 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.644 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.644 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.644 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:59.644 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:59.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.644 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.644 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.644 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:59.644 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.645 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.645 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:59.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.645 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.645 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.645 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:59.645 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.645 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.646 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:59.646 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:59.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9041e86640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.195:6800/1839191919 conn(0x7f902803fc20 legacy=0x7f90280420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9041e86640 10 monclient: shutdown 2024-09-13T10:39:59.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9041e86640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:59.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9041e86640 1 -- 172.21.15.181:0/2657719730 >> v1:172.21.15.181:6791/0 conn(0x7f903c13ca90 legacy=0x7f903c1d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f903bfff640 1 -- 172.21.15.181:0/2657719730 reap_dead start 2024-09-13T10:39:59.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f903bfff640 1 -- 172.21.15.181:0/2657719730 reap_dead start 2024-09-13T10:39:59.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9041e86640 1 -- 172.21.15.181:0/2657719730 shutdown_connections 2024-09-13T10:39:59.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.612+0000 7f9041e86640 1 -- 172.21.15.181:0/2657719730 >> 172.21.15.181:0/2657719730 conn(0x7f903c0a6640 msgr2=0x7f903c0a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:59.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.613+0000 7f9041e86640 1 -- 172.21.15.181:0/2657719730 shutdown_connections 2024-09-13T10:39:59.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.613+0000 7f9041e86640 1 -- 172.21.15.181:0/2657719730 wait complete. 2024-09-13T10:39:59.650 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:59.650 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:39:59.650 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:39:59.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.747+0000 7ff510a23640 10 monclient: get_monmap_and_config 2024-09-13T10:39:59.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.747+0000 7ff510a23640 10 monclient: build_initial_monmap 2024-09-13T10:39:59.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.747+0000 7ff510a23640 10 monclient: monmap: 2024-09-13T10:39:59.749 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:59.749 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.750 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:59.748215+0000 2024-09-13T10:39:59.750 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:59.748215+0000 2024-09-13T10:39:59.750 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:59.750 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.750 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:59.750 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:59.750 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:59.750 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:59.750 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:59.750 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:59.750 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:59.750 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:59.751 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:59.751 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 1 Processor -- start 2024-09-13T10:39:59.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 1 -- start start 2024-09-13T10:39:59.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 10 monclient: init 2024-09-13T10:39:59.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:59.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 10 monclient: _add_conns ranks=[4,5,6,1,3,7,8,2,0] 2024-09-13T10:39:59.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 10 monclient(hunting): picked mon.noname-c con 0x7ff50c0a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:59.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 10 monclient(hunting): picked mon.noname-h con 0x7ff50c0a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 10 monclient(hunting): picked mon.noname-d con 0x7ff50c13f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c0a4bc0 con 0x7ff50c0a6640 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c13a320 con 0x7ff50c0a8340 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c0a8100 con 0x7ff50c13f750 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.748+0000 7ff510a23640 10 monclient(hunting): authenticate will time out at 1339.253933s 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.749+0000 7ff50a59c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ff50c0a6640 0x7ff50c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51564/0 (socket says 172.21.15.181:51564) 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.749+0000 7ff50a59c640 1 -- 172.21.15.181:0/2812448889 learned_addr learned my addr 172.21.15.181:0/2812448889 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50ad9d640 1 -- 172.21.15.181:0/2812448889 >> v1:172.21.15.181:6792/0 conn(0x7ff50c13f750 legacy=0x7ff50c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50a59c640 1 -- 172.21.15.181:0/2812448889 >> v1:172.21.15.181:6791/0 conn(0x7ff50c0a6640 legacy=0x7ff50c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 1 -- 172.21.15.181:0/2812448889 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3904872684 0 0) 0x7ff50c0a4bc0 con 0x7ff50c0a6640 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient(hunting): my global_id is 174271 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 1 -- 172.21.15.181:0/2812448889 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4f4003520 con 0x7ff50c0a6640 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 1 -- 172.21.15.181:0/2812448889 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4235120333 0 0) 0x7ff50c0a8100 con 0x7ff50c13f750 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient(hunting): my global_id is 174273 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 1 -- 172.21.15.181:0/2812448889 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff50c0a4bc0 con 0x7ff50c13f750 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff509d9b640 1 -- 172.21.15.181:0/2812448889 >> v1:172.21.15.195:6791/0 conn(0x7ff50c0a8340 legacy=0x7ff50c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 1 -- 172.21.15.181:0/2812448889 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1452677812 0 0) 0x7ff4f4003520 con 0x7ff50c0a6640 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 1 -- 172.21.15.181:0/2812448889 >> v1:172.21.15.181:6792/0 conn(0x7ff50c13f750 legacy=0x7ff50c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 1 -- 172.21.15.181:0/2812448889 >> v1:172.21.15.195:6791/0 conn(0x7ff50c0a8340 legacy=0x7ff50c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient: _finish_hunting 0 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 1 monclient: found mon.noname-c 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 1 -- 172.21.15.181:0/2812448889 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c0a48e0 con 0x7ff50c0a6640 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient: _finish_auth 0 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient: _check_auth_tickets 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff510a23640 5 monclient: authenticate success, global_id 174271 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 1 -- 172.21.15.181:0/2812448889 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff4fc001ae0 con 0x7ff50c0a6640 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient: dump: 2024-09-13T10:39:59.758 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.759 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff510a23640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 1 -- 172.21.15.181:0/2812448889 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff4fc0048a0 con 0x7ff50c0a6640 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff510a23640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 1 -- 172.21.15.181:0/2812448889 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff4fc004e10 con 0x7ff50c0a6640 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff510a23640 4 set_mon_vals no callback set 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.751+0000 7ff50959a640 10 monclient: dump: 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.760 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.752+0000 7ff510a23640 10 monclient: shutdown 2024-09-13T10:39:59.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.752+0000 7ff510a23640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.752+0000 7ff510a23640 1 -- 172.21.15.181:0/2812448889 >> v1:172.21.15.181:6791/0 conn(0x7ff50c0a6640 legacy=0x7ff50c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.752+0000 7ff510a23640 1 -- 172.21.15.181:0/2812448889 shutdown_connections 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.752+0000 7ff510a23640 1 -- 172.21.15.181:0/2812448889 >> 172.21.15.181:0/2812448889 conn(0x7ff50c077170 msgr2=0x7ff50c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.752+0000 7ff510a23640 1 -- 172.21.15.181:0/2812448889 shutdown_connections 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.752+0000 7ff510a23640 1 -- 172.21.15.181:0/2812448889 wait complete. 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 10 monclient: build_initial_monmap 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 10 monclient: monmap: 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:59.762 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 1 Processor -- start 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 1 -- start start 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 10 monclient: init 2024-09-13T10:39:59.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:59.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 10 monclient: _add_conns ranks=[2,0,5,8,3,1,6,4,7] 2024-09-13T10:39:59.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 10 monclient(hunting): picked mon.noname-b con 0x7ff50c0a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:39:59.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 10 monclient(hunting): picked mon.noname-a con 0x7ff50c13f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:39:59.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 10 monclient(hunting): picked mon.noname-h con 0x7ff50c1d4520 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:59.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c142bf0 con 0x7ff50c13f750 2024-09-13T10:39:59.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c0a11c0 con 0x7ff50c0a8340 2024-09-13T10:39:59.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c0a14a0 con 0x7ff50c1d4520 2024-09-13T10:39:59.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:59.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff510a23640 10 monclient(hunting): authenticate will time out at 1339.258829s 2024-09-13T10:39:59.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff50a59c640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7ff50c0a8340 0x7ff50c1384f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:46622/0 (socket says 172.21.15.181:46622) 2024-09-13T10:39:59.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff509d9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff50c13f750 0x7ff50c138c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:41012/0 (socket says 172.21.15.181:41012) 2024-09-13T10:39:59.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.753+0000 7ff50a59c640 1 -- 172.21.15.181:0/3046629896 learned_addr learned my addr 172.21.15.181:0/3046629896 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:59.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff50a59c640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.181:6790/0 conn(0x7ff50c0a8340 legacy=0x7ff50c1384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff509d9b640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.181:6789/0 conn(0x7ff50c13f750 legacy=0x7ff50c138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643919044 0 0) 0x7ff5000015f0 con 0x7ff50c13f750 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): my global_id is 174240 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4ec003550 con 0x7ff50c13f750 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2187778937 0 0) 0x7ff50c0a11c0 con 0x7ff50c0a8340 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): my global_id is 174269 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5000015f0 con 0x7ff50c0a8340 2024-09-13T10:39:59.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff50ad9d640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.195:6791/0 conn(0x7ff50c1d4520 legacy=0x7ff50c1d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812529943 0 0) 0x7ff50c0a14a0 con 0x7ff50c1d4520 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): my global_id is 105971 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff50c0a11c0 con 0x7ff50c1d4520 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 96906756 0 0) 0x7ff4ec003550 con 0x7ff50c13f750 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff50c0a14a0 con 0x7ff50c13f750 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3315952167 0 0) 0x7ff5000015f0 con 0x7ff50c0a8340 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4ec003550 con 0x7ff50c0a8340 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff500003950 con 0x7ff50c13f750 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:59.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): dump: 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.771 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff4fc004d90 con 0x7ff50c0a8340 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient(hunting): dump: 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.772 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2472452313 0 0) 0x7ff50c0a14a0 con 0x7ff50c13f750 2024-09-13T10:39:59.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.195:6791/0 conn(0x7ff50c1d4520 legacy=0x7ff50c1d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.181:6790/0 conn(0x7ff50c0a8340 legacy=0x7ff50c1384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient: _finish_hunting 0 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 monclient: found mon.a 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c139310 con 0x7ff50c13f750 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient: _finish_auth 0 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient: _check_auth_tickets 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff510a23640 5 monclient: authenticate success, global_id 174240 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff510a23640 10 monclient: _renew_subs 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff510a23640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff510a23640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff50c09fca0 con 0x7ff50c13f750 2024-09-13T10:39:59.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff510a23640 10 monclient: _renew_subs 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff510a23640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff510a23640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff50c09f140 con 0x7ff50c13f750 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff500003da0 con 0x7ff50c13f750 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff500001d40 con 0x7ff50c13f750 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff508d99640 4 set_mon_vals no callback set 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.756+0000 7ff4faffd640 10 monclient: dump: 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.775 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.757+0000 7ff510a23640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:59.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.757+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff500011ca0 con 0x7ff50c13f750 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.757+0000 7ff510a23640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff4f00065c0 con 0x7ff4f0002860 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.757+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7ff50004e340 con 0x7ff50c13f750 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.757+0000 7ff50ad9d640 10 monclient: get_auth_request con 0x7ff4ec03ff90 auth_method 0 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.759+0000 7ff50a59c640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.195:6791/0 conn(0x7ff4f0002860 legacy=0x7ff4f0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4058063263 0 0) 0x7ff4f00065c0 con 0x7ff4f0002860 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 10 monclient(hunting): my global_id is 105980 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff50c0a14a0 con 0x7ff4f0002860 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1719801340 0 0) 0x7ff50c0a14a0 con 0x7ff4f0002860 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4f00065c0 con 0x7ff4f0002860 2024-09-13T10:39:59.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff4fc0048a0 con 0x7ff4f0002860 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 10 monclient: dump: 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.778 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1435944728 0 0) 0x7ff4f00065c0 con 0x7ff4f0002860 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4f000a160 con 0x7ff4f0002860 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff4fc005740 con 0x7ff4f0002860 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.195:6791/0 conn(0x7ff4f0002860 legacy=0x7ff4f0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.760+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.195:6791/0 conn(0x7ff4f0002860 legacy=0x7ff4f0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.766+0000 7ff510a23640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:59.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.766+0000 7ff510a23640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff4f0009e70 con 0x7ff4f0009130 2024-09-13T10:39:59.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.769+0000 7ff50a59c640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.195:6791/0 conn(0x7ff4f0009130 legacy=0x7ff4f00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.769+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062806229 0 0) 0x7ff4f0009e70 con 0x7ff4f0009130 2024-09-13T10:39:59.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.769+0000 7ff4faffd640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.769+0000 7ff4faffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.769+0000 7ff4faffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.769+0000 7ff4faffd640 10 monclient(hunting): my global_id is 105989 2024-09-13T10:39:59.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.769+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4f00065c0 con 0x7ff4f0009130 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.769+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3234146139 0 0) 0x7ff4f00065c0 con 0x7ff4f0009130 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4f0009e70 con 0x7ff4f0009130 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff4fc005ea0 con 0x7ff4f0009130 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff4faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff4faffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff4faffd640 10 monclient: dump: 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.782 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 121339760 0 0) 0x7ff4f0009e70 con 0x7ff4f0009130 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff4f000c410 con 0x7ff4f0009130 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 3560950951) 0x7ff4fc007410 con 0x7ff4f0009130 2024-09-13T10:39:59.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff4faffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:59.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff4faffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:59.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.195:6791/0 conn(0x7ff4f0009130 legacy=0x7ff4f00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff4faffd640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.195:6791/0 conn(0x7ff4f0009130 legacy=0x7ff4f00095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:59.784 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:59.784 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:59.784 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:59.784 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:39:59.784 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:59.784 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 283470, 2024-09-13T10:39:59.784 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 6, 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:59.785 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.786 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.787 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:59.788 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.789 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.790 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.791 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:59.792 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.793 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:59.796 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.797 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.798 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:59.799 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:59.800 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.800 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.800 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.800 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:59.800 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.800 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.800 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.800 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:59.800 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:59.800 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.801 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.802 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.803 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:39:59.804 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.804 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.804 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:59.804 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:59.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff510a23640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff4ec03ff90 legacy=0x7ff4ec042450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff510a23640 10 monclient: shutdown 2024-09-13T10:39:59.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff510a23640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:59.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff510a23640 1 -- 172.21.15.181:0/3046629896 >> v1:172.21.15.181:6789/0 conn(0x7ff50c13f750 legacy=0x7ff50c138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff50ad9d640 1 -- 172.21.15.181:0/3046629896 reap_dead start 2024-09-13T10:39:59.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff50ad9d640 1 -- 172.21.15.181:0/3046629896 reap_dead start 2024-09-13T10:39:59.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff510a23640 1 -- 172.21.15.181:0/3046629896 shutdown_connections 2024-09-13T10:39:59.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff510a23640 1 -- 172.21.15.181:0/3046629896 >> 172.21.15.181:0/3046629896 conn(0x7ff50c0a6640 msgr2=0x7ff50c142200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:59.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff510a23640 1 -- 172.21.15.181:0/3046629896 shutdown_connections 2024-09-13T10:39:59.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.770+0000 7ff510a23640 1 -- 172.21.15.181:0/3046629896 wait complete. 2024-09-13T10:39:59.806 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:59.806 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:39:59.806 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:39:59.864 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.861+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.864 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4180458085}) 2024-09-13T10:39:59.864 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319484647}) 2024-09-13T10:39:59.864 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4180458085}) 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=101974703}) 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4180458085}) 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1350538267}) 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4180458085}) 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2652889457}) 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4180458085}) 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=232942438}) 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.865 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4180458085}) 2024-09-13T10:39:59.866 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=371412755}) 2024-09-13T10:39:59.866 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.866 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4180458085}) 2024-09-13T10:39:59.866 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1148775398}) 2024-09-13T10:39:59.866 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.866 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4180458085}) 2024-09-13T10:39:59.866 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.862+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=658305590}) 2024-09-13T10:39:59.869 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.869 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1443491274}) 2024-09-13T10:39:59.869 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3306919618}) 2024-09-13T10:39:59.869 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.869 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1443491274}) 2024-09-13T10:39:59.869 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2213784457}) 2024-09-13T10:39:59.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1443491274}) 2024-09-13T10:39:59.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=805330692}) 2024-09-13T10:39:59.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1443491274}) 2024-09-13T10:39:59.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2551727179}) 2024-09-13T10:39:59.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1443491274}) 2024-09-13T10:39:59.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=936389659}) 2024-09-13T10:39:59.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1443491274}) 2024-09-13T10:39:59.870 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2406155773}) 2024-09-13T10:39:59.871 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.871 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1443491274}) 2024-09-13T10:39:59.871 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1069440063}) 2024-09-13T10:39:59.871 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.871 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1443491274}) 2024-09-13T10:39:59.871 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.867+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2518192476}) 2024-09-13T10:39:59.874 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.874 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987983802}) 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990719248}) 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987983802}) 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=973920721}) 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987983802}) 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1856801579}) 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987983802}) 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4083268679}) 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987983802}) 2024-09-13T10:39:59.875 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=800422653}) 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987983802}) 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3754824154}) 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987983802}) 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=430345749}) 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987983802}) 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.868+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1004672802}) 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1913968590}) 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800471100}) 2024-09-13T10:39:59.876 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1913968590}) 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4234914338}) 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1913968590}) 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2595823892}) 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1913968590}) 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1275976509}) 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1913968590}) 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3648866473}) 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.877 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1913968590}) 2024-09-13T10:39:59.878 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4097641755}) 2024-09-13T10:39:59.878 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.878 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1913968590}) 2024-09-13T10:39:59.878 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3348971430}) 2024-09-13T10:39:59.878 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.878 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1913968590}) 2024-09-13T10:39:59.878 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.870+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3626600295}) 2024-09-13T10:39:59.888 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.888 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3664745984}) 2024-09-13T10:39:59.888 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=358881318}) 2024-09-13T10:39:59.888 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3664745984}) 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=257382646}) 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3664745984}) 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=955015176}) 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3664745984}) 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1663598393}) 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3664745984}) 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2942681358}) 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3664745984}) 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=337434487}) 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3664745984}) 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2666458535}) 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3664745984}) 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.882+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1581213376}) 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.883+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3997151625}) 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337411669}) 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3997151625}) 2024-09-13T10:39:59.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3533693942}) 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3997151625}) 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2535266217}) 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3997151625}) 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3798345077}) 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3997151625}) 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2675868241}) 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3997151625}) 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3133955299}) 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.891 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3997151625}) 2024-09-13T10:39:59.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1757503503}) 2024-09-13T10:39:59.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3997151625}) 2024-09-13T10:39:59.892 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.884+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2098954852}) 2024-09-13T10:39:59.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.901 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3644195062}) 2024-09-13T10:39:59.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789821195}) 2024-09-13T10:39:59.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3644195062}) 2024-09-13T10:39:59.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3450146342}) 2024-09-13T10:39:59.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3644195062}) 2024-09-13T10:39:59.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2496479616}) 2024-09-13T10:39:59.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3644195062}) 2024-09-13T10:39:59.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=112682545}) 2024-09-13T10:39:59.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.902 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3644195062}) 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1314911892}) 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3644195062}) 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1100405810}) 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3644195062}) 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1405423304}) 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3644195062}) 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.896+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1501818766}) 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2926731049}) 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3875818178}) 2024-09-13T10:39:59.903 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2926731049}) 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4055534158}) 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2926731049}) 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4207303920}) 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2926731049}) 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1436021495}) 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2926731049}) 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3094065820}) 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2926731049}) 2024-09-13T10:39:59.904 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3209941529}) 2024-09-13T10:39:59.905 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.905 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2926731049}) 2024-09-13T10:39:59.905 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2290683308}) 2024-09-13T10:39:59.905 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.897+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.905 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.898+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2926731049}) 2024-09-13T10:39:59.905 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.898+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=737768085}) 2024-09-13T10:39:59.905 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.905 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1171775226}) 2024-09-13T10:39:59.905 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2440707763}) 2024-09-13T10:39:59.905 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.905 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1171775226}) 2024-09-13T10:39:59.905 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2274152219}) 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1171775226}) 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=288156224}) 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1171775226}) 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=45387563}) 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1171775226}) 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2034553116}) 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1171775226}) 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3925458935}) 2024-09-13T10:39:59.906 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.907 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1171775226}) 2024-09-13T10:39:59.907 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1050535757}) 2024-09-13T10:39:59.907 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:39:59.907 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1171775226}) 2024-09-13T10:39:59.907 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:39:59.899+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1805690847}) 2024-09-13T10:39:59.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.910+0000 7f8089849640 10 monclient: get_monmap_and_config 2024-09-13T10:39:59.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.910+0000 7f8089849640 10 monclient: build_initial_monmap 2024-09-13T10:39:59.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.910+0000 7f8089849640 10 monclient: monmap: 2024-09-13T10:39:59.912 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:59.912 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.912 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:39:59.911336+0000 2024-09-13T10:39:59.912 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:39:59.911336+0000 2024-09-13T10:39:59.912 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:59.912 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.912 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:59.912 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:59.913 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:59.913 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:59.913 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:59.913 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:59.913 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:59.913 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:59.913 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:59.913 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.911+0000 7f8089849640 1 Processor -- start 2024-09-13T10:39:59.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.911+0000 7f8089849640 1 -- start start 2024-09-13T10:39:59.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.911+0000 7f8089849640 10 monclient: init 2024-09-13T10:39:59.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.911+0000 7f8089849640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:59.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.911+0000 7f8089849640 10 monclient: _add_conns ranks=[4,3,1,7,0,8,6,2,5] 2024-09-13T10:39:59.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.911+0000 7f8089849640 10 monclient(hunting): picked mon.noname-c con 0x7f80840a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:39:59.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.911+0000 7f8089849640 10 monclient(hunting): picked mon.noname-g con 0x7f80840a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:39:59.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.911+0000 7f8089849640 10 monclient(hunting): picked mon.noname-f con 0x7f808413f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:59.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.911+0000 7f8089849640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80840a4bc0 con 0x7f808413f750 2024-09-13T10:39:59.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.911+0000 7f8089849640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808413a320 con 0x7f80840a8340 2024-09-13T10:39:59.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.912+0000 7f8089849640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80840a8100 con 0x7f80840a6640 2024-09-13T10:39:59.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.912+0000 7f8089849640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:59.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.912+0000 7f8089849640 10 monclient(hunting): authenticate will time out at 1339.417019s 2024-09-13T10:39:59.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.912+0000 7f8082ffd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f80840a6640 0x7f8084139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:51574/0 (socket says 172.21.15.181:51574) 2024-09-13T10:39:59.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.912+0000 7f8082ffd640 1 -- 172.21.15.181:0/2444578598 learned_addr learned my addr 172.21.15.181:0/2444578598 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:59.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f8082ffd640 1 -- 172.21.15.181:0/2444578598 >> v1:172.21.15.181:6791/0 conn(0x7f80840a6640 legacy=0x7f8084139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 1 -- 172.21.15.181:0/2444578598 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3723545339 0 0) 0x7f80840a8100 con 0x7f80840a6640 2024-09-13T10:39:59.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient(hunting): my global_id is 174280 2024-09-13T10:39:59.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 1 -- 172.21.15.181:0/2444578598 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8070003520 con 0x7f80840a6640 2024-09-13T10:39:59.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80837fe640 1 -- 172.21.15.181:0/2444578598 >> v1:172.21.15.195:6789/0 conn(0x7f808413f750 legacy=0x7f8084141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f807bfff640 1 -- 172.21.15.181:0/2444578598 >> v1:172.21.15.195:6790/0 conn(0x7f80840a8340 legacy=0x7f8084139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 1 -- 172.21.15.181:0/2444578598 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2981802460 0 0) 0x7f8070003520 con 0x7f80840a6640 2024-09-13T10:39:59.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 1 -- 172.21.15.181:0/2444578598 >> v1:172.21.15.195:6790/0 conn(0x7f80840a8340 legacy=0x7f8084139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 1 -- 172.21.15.181:0/2444578598 >> v1:172.21.15.195:6789/0 conn(0x7f808413f750 legacy=0x7f8084141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient: _finish_hunting 0 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 1 monclient: found mon.noname-c 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 1 -- 172.21.15.181:0/2444578598 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80840a48e0 con 0x7f80840a6640 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient: _finish_auth 0 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient: _check_auth_tickets 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f8089849640 5 monclient: authenticate success, global_id 174280 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 1 -- 172.21.15.181:0/2444578598 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8074001ae0 con 0x7f80840a6640 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f8089849640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:39:59.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient: dump: 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.921 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f8089849640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 1 -- 172.21.15.181:0/2444578598 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80740048a0 con 0x7f80840a6640 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 1 -- 172.21.15.181:0/2444578598 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8074004dd0 con 0x7f80840a6640 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f8089849640 10 monclient: get_monmap_and_config success 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f8089849640 4 set_mon_vals no callback set 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.914+0000 7f80827fc640 10 monclient: dump: 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.922 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.923 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.915+0000 7f8089849640 10 monclient: shutdown 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.915+0000 7f8089849640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.915+0000 7f8089849640 1 -- 172.21.15.181:0/2444578598 >> v1:172.21.15.181:6791/0 conn(0x7f80840a6640 legacy=0x7f8084139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.915+0000 7f8089849640 1 -- 172.21.15.181:0/2444578598 shutdown_connections 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.915+0000 7f8089849640 1 -- 172.21.15.181:0/2444578598 >> 172.21.15.181:0/2444578598 conn(0x7f8084077170 msgr2=0x7f80840abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.915+0000 7f8089849640 1 -- 172.21.15.181:0/2444578598 shutdown_connections 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.915+0000 7f8089849640 1 -- 172.21.15.181:0/2444578598 wait complete. 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.915+0000 7f8089849640 10 monclient: build_initial_monmap 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 10 monclient: monmap: 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:39:59.924 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 1 Processor -- start 2024-09-13T10:39:59.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 1 -- start start 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 10 monclient: init 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 10 monclient: _reopen_session rank -1 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 10 monclient: _add_conns ranks=[1,8,5,2,3,0,7,6,4] 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 10 monclient(hunting): picked mon.noname-f con 0x7f80840a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 10 monclient(hunting): picked mon.noname-e con 0x7f808413f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 10 monclient(hunting): picked mon.noname-h con 0x7f808413ca90 addr v1:172.21.15.195:6791/0 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8084134c50 con 0x7f80840a8340 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808413e700 con 0x7f808413ca90 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808413d3c0 con 0x7f808413f750 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 10 monclient(hunting): _renew_subs 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f8089849640 10 monclient(hunting): authenticate will time out at 1339.421860s 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f807bfff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f808413f750 0x7f808413c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:42664/0 (socket says 172.21.15.181:42664) 2024-09-13T10:39:59.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.916+0000 7f807bfff640 1 -- 172.21.15.181:0/2355296412 learned_addr learned my addr 172.21.15.181:0/2355296412 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:39:59.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f807bfff640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.181:6793/0 conn(0x7f808413f750 legacy=0x7f808413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f80837fe640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.195:6791/0 conn(0x7f808413ca90 legacy=0x7f80841d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164962216 0 0) 0x7f808413d3c0 con 0x7f808413f750 2024-09-13T10:39:59.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): my global_id is 106037 2024-09-13T10:39:59.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8064003550 con 0x7f808413f750 2024-09-13T10:39:59.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8082ffd640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.195:6789/0 conn(0x7f80840a8340 legacy=0x7f808413bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.930 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1599564669 0 0) 0x7f808413e700 con 0x7f808413ca90 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): my global_id is 105998 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f808413d3c0 con 0x7f808413ca90 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4184853906 0 0) 0x7f8064003550 con 0x7f808413f750 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f808413e700 con 0x7f808413f750 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394012403 0 0) 0x7f8084134c50 con 0x7f80840a8340 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): my global_id is 134974 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8064003550 con 0x7f80840a8340 2024-09-13T10:39:59.931 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f806c003610 con 0x7f808413f750 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): dump: 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.932 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 86804115 0 0) 0x7f808413e700 con 0x7f808413f750 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.195:6791/0 conn(0x7f808413ca90 legacy=0x7f80841d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.195:6789/0 conn(0x7f80840a8340 legacy=0x7f808413bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 monclient: found mon.e 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:39:59.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80841343b0 con 0x7f808413f750 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient: _finish_auth 0 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8089849640 5 monclient: authenticate success, global_id 106037 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8089849640 10 monclient: _renew_subs 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8089849640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8089849640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8084134690 con 0x7f808413f750 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8089849640 10 monclient: _renew_subs 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8089849640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8089849640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f80841d7a40 con 0x7f808413f750 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f806c003b20 con 0x7f808413f750 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:39:59.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f806c004010 con 0x7f808413f750 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8080ff9640 10 monclient: dump: 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.935 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.919+0000 7f8081ffb640 4 set_mon_vals no callback set 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.920+0000 7f8089849640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.920+0000 7f8089849640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f80840a9c20 con 0x7f8084077170 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.920+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f806c004260 con 0x7f808413f750 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.920+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7f806c04e130 con 0x7f808413f750 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.920+0000 7f80837fe640 10 monclient: get_auth_request con 0x7f806403fd30 auth_method 0 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.922+0000 7f8082ffd640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.195:6792/0 conn(0x7f8084077170 legacy=0x7f808413fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.922+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2086027919 0 0) 0x7f80840a9c20 con 0x7f8084077170 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.922+0000 7f8080ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.922+0000 7f8080ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.922+0000 7f8080ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.922+0000 7f8080ff9640 10 monclient(hunting): my global_id is 57949 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.922+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f808413e700 con 0x7f8084077170 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4135533430 0 0) 0x7f808413e700 con 0x7f8084077170 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80840a9c20 con 0x7f8084077170 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8074004be0 con 0x7f8084077170 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 10 monclient: dump: 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.937 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2922176904 0 0) 0x7f80840a9c20 con 0x7f8084077170 2024-09-13T10:39:59.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80841348b0 con 0x7f8084077170 2024-09-13T10:39:59.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8074001320 con 0x7f8084077170 2024-09-13T10:39:59.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:39:59.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:39:59.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.195:6792/0 conn(0x7f8084077170 legacy=0x7f808413fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.923+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.195:6792/0 conn(0x7f8084077170 legacy=0x7f808413fb30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:59.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.929+0000 7f8089849640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:39:59.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.929+0000 7f8089849640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8084143260 con 0x7f8084069b40 2024-09-13T10:39:59.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8082ffd640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.195:6792/0 conn(0x7f8084069b40 legacy=0x7f8084140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4006227415 0 0) 0x7f8084143260 con 0x7f8084069b40 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8080ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8080ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8080ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8080ff9640 10 monclient(hunting): my global_id is 57958 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80840a9c20 con 0x7f8084069b40 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 812328301 0 0) 0x7f80840a9c20 con 0x7f8084069b40 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8084143260 con 0x7f8084069b40 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f8074005110 con 0x7f8084069b40 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8080ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8080ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.932+0000 7f8080ff9640 10 monclient: dump: 2024-09-13T10:39:59.941 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:39:59.942 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:39:59.943 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:39:59.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1610378509 0 0) 0x7f8084143260 con 0x7f8084069b40 2024-09-13T10:39:59.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8084140950 con 0x7f8084069b40 2024-09-13T10:39:59.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7896 (unknown 0 0 1723705037) 0x7f80740085c0 con 0x7f8084069b40 2024-09-13T10:39:59.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8080ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:39:59.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8080ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:39:59.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.195:6792/0 conn(0x7f8084069b40 legacy=0x7f8084140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8080ff9640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.195:6792/0 conn(0x7f8084069b40 legacy=0x7f8084140240 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:39:59.943 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:39:59.943 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 140, 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 614353, 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:39:59.944 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 6, 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.945 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.946 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:39:59.947 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:39:59.948 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.949 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.951 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.952 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.953 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.954 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:39:59.955 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.956 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.958 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.959 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.961 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.962 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4 2024-09-13T10:39:59.963 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.963 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:39:59.963 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:39:59.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:39:59.963 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:39:59.963 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:39:59.963 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:39:59.963 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:39:59.963 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:39:59.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:39:59.963 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:39:59.963 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:39:59.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8089849640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.195:6800/1839191919 conn(0x7f806403fd30 legacy=0x7f80640421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8089849640 10 monclient: shutdown 2024-09-13T10:39:59.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8089849640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:39:59.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8089849640 1 -- 172.21.15.181:0/2355296412 >> v1:172.21.15.181:6793/0 conn(0x7f808413f750 legacy=0x7f808413c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:39:59.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f80837fe640 1 -- 172.21.15.181:0/2355296412 reap_dead start 2024-09-13T10:39:59.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f80837fe640 1 -- 172.21.15.181:0/2355296412 reap_dead start 2024-09-13T10:39:59.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8089849640 1 -- 172.21.15.181:0/2355296412 shutdown_connections 2024-09-13T10:39:59.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8089849640 1 -- 172.21.15.181:0/2355296412 >> 172.21.15.181:0/2355296412 conn(0x7f80840a6640 msgr2=0x7f80840a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:39:59.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8089849640 1 -- 172.21.15.181:0/2355296412 shutdown_connections 2024-09-13T10:39:59.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:39:59.933+0000 7f8089849640 1 -- 172.21.15.181:0/2355296412 wait complete. 2024-09-13T10:39:59.968 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:39:59.968 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a', 'g', 'e'] 2024-09-13T10:39:59.968 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-13T10:39:59.969 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-13T10:39:59.969 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-13T10:39:59.969 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T10:39:59.969 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:39:59.979 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T10:39:59.979 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2024-09-13T10:39:59.979 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-09-13T10:39:59.980 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-09-13T10:39:59.980 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:39:59.992 INFO:tasks.ceph.mon.g:Stopped 2024-09-13T10:39:59.992 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-09-13T10:39:59.992 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-09-13T10:39:59.993 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-09-13T10:39:59.993 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:40:00.032 INFO:tasks.ceph.mon.e:Stopped 2024-09-13T10:40:00.033 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 6 2024-09-13T10:40:00.033 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:40:00.034 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:00.034 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4050874547}) 2024-09-13T10:40:00.035 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238388731}) 2024-09-13T10:40:00.035 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:00.035 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4050874547}) 2024-09-13T10:40:00.035 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=154770112}) 2024-09-13T10:40:00.035 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:00.035 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4050874547}) 2024-09-13T10:40:00.035 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=249666886}) 2024-09-13T10:40:00.035 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:00.035 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4050874547}) 2024-09-13T10:40:00.035 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3120300930}) 2024-09-13T10:40:00.035 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:00.035 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4050874547}) 2024-09-13T10:40:00.036 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3849827003}) 2024-09-13T10:40:00.036 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:00.036 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4050874547}) 2024-09-13T10:40:00.036 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2451234163}) 2024-09-13T10:40:00.036 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:00.036 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4050874547}) 2024-09-13T10:40:00.036 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2494678427}) 2024-09-13T10:40:00.036 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:00.036 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4050874547}) 2024-09-13T10:40:00.036 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:00.031+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3696030214}) 2024-09-13T10:40:00.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.168+0000 7f2dc7849640 10 monclient: get_monmap_and_config 2024-09-13T10:40:00.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.168+0000 7f2dc7849640 10 monclient: build_initial_monmap 2024-09-13T10:40:00.170 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.168+0000 7f2dc7849640 10 monclient: monmap: 2024-09-13T10:40:00.170 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:00.170 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:00.170 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:00.169376+0000 2024-09-13T10:40:00.170 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:00.169376+0000 2024-09-13T10:40:00.171 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:00.171 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:00.171 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:00.171 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:00.171 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:00.171 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:00.171 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:00.171 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:00.171 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:00.171 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:00.171 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:00.171 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:00.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.169+0000 7f2dc7849640 1 Processor -- start 2024-09-13T10:40:00.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.169+0000 7f2dc7849640 1 -- start start 2024-09-13T10:40:00.172 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.169+0000 7f2dc7849640 10 monclient: init 2024-09-13T10:40:00.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.169+0000 7f2dc7849640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:00.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.169+0000 7f2dc7849640 10 monclient: _add_conns ranks=[5,7,6,8,3,2,1,0,4] 2024-09-13T10:40:00.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.169+0000 7f2dc7849640 10 monclient(hunting): picked mon.noname-h con 0x7f2dc00a34c0 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:00.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.169+0000 7f2dc7849640 10 monclient(hunting): picked mon.noname-i con 0x7f2dc0136e00 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:00.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.169+0000 7f2dc7849640 10 monclient(hunting): picked mon.noname-d con 0x7f2dc013d880 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:00.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.169+0000 7f2dc7849640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc006dc20 con 0x7f2dc00a34c0 2024-09-13T10:40:00.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.170+0000 7f2dc7849640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc00a38a0 con 0x7f2dc013d880 2024-09-13T10:40:00.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.170+0000 7f2dc7849640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc0073ce0 con 0x7f2dc0136e00 2024-09-13T10:40:00.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.170+0000 7f2dc7849640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:00.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.170+0000 7f2dc7849640 10 monclient(hunting): authenticate will time out at 1339.675029s 2024-09-13T10:40:00.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.170+0000 7f2dc5de6640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f2dc013d880 0x7f2dc013fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:36698/0 (socket says 172.21.15.181:36698) 2024-09-13T10:40:00.173 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.170+0000 7f2dc5de6640 1 -- 172.21.15.181:0/2853235069 learned_addr learned my addr 172.21.15.181:0/2853235069 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:00.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.172+0000 7f2dc5de6640 1 -- 172.21.15.181:0/2853235069 >> v1:172.21.15.181:6792/0 conn(0x7f2dc013d880 legacy=0x7f2dc013fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:00.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.172+0000 7f2dc55e5640 1 -- 172.21.15.181:0/2853235069 >> v1:172.21.15.195:6791/0 conn(0x7f2dc00a34c0 legacy=0x7f2dc01373b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:00.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.172+0000 7f2dc4de4640 1 -- 172.21.15.181:0/2853235069 >> v1:172.21.15.195:6792/0 conn(0x7f2dc0136e00 legacy=0x7f2dc013c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:00.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.172+0000 7f2db7fff640 1 -- 172.21.15.181:0/2853235069 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1048303362 0 0) 0x7f2dc0073ce0 con 0x7f2dc0136e00 2024-09-13T10:40:00.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.172+0000 7f2db7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:00.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.172+0000 7f2db7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:00.178 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.172+0000 7f2db7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.172+0000 7f2db7fff640 10 monclient(hunting): my global_id is 57967 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.172+0000 7f2db7fff640 1 -- 172.21.15.181:0/2853235069 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dac003520 con 0x7f2dc0136e00 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 1 -- 172.21.15.181:0/2853235069 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3699726347 0 0) 0x7f2dac003520 con 0x7f2dc0136e00 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 1 -- 172.21.15.181:0/2853235069 >> v1:172.21.15.181:6792/0 conn(0x7f2dc013d880 legacy=0x7f2dc013fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 1 -- 172.21.15.181:0/2853235069 >> v1:172.21.15.195:6791/0 conn(0x7f2dc00a34c0 legacy=0x7f2dc01373b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 10 monclient: _finish_hunting 0 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 1 monclient: found mon.noname-i 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 1 -- 172.21.15.181:0/2853235069 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc0074170 con 0x7f2dc0136e00 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 10 monclient: _finish_auth 0 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 10 monclient: _check_auth_tickets 2024-09-13T10:40:00.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:00.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 1 -- 172.21.15.181:0/2853235069 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2db0001b30 con 0x7f2dc0136e00 2024-09-13T10:40:00.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:00.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:40:00.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 10 monclient: dump: 2024-09-13T10:40:00.180 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:00.180 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:00.180 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:00.180 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:00.180 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:00.180 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2dc7849640 5 monclient: authenticate success, global_id 57967 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2dc7849640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 1 -- 172.21.15.181:0/2853235069 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2db0003610 con 0x7f2dc0136e00 2024-09-13T10:40:00.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2dc7849640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2dc7849640 4 set_mon_vals no callback set 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 1 -- 172.21.15.181:0/2853235069 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2db0003b80 con 0x7f2dc0136e00 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2db7fff640 10 monclient: dump: 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:00.182 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2dc7849640 10 monclient: shutdown 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2dc7849640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2dc7849640 1 -- 172.21.15.181:0/2853235069 >> v1:172.21.15.195:6792/0 conn(0x7f2dc0136e00 legacy=0x7f2dc013c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2dc7849640 1 -- 172.21.15.181:0/2853235069 shutdown_connections 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2dc7849640 1 -- 172.21.15.181:0/2853235069 >> 172.21.15.181:0/2853235069 conn(0x7f2dc00a45b0 msgr2=0x7f2dc00a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:00.183 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2dc7849640 1 -- 172.21.15.181:0/2853235069 shutdown_connections 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.173+0000 7f2dc7849640 1 -- 172.21.15.181:0/2853235069 wait complete. 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.174+0000 7f2dc7849640 10 monclient: build_initial_monmap 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.174+0000 7f2dc7849640 10 monclient: monmap: 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:00.184 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.174+0000 7f2dc7849640 1 Processor -- start 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.174+0000 7f2dc7849640 1 -- start start 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.174+0000 7f2dc7849640 10 monclient: init 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc7849640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc7849640 10 monclient: _add_conns ranks=[5,7,3,2,0,6,4,8,1] 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc7849640 10 monclient(hunting): picked mon.noname-h con 0x7f2dc00a34c0 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc7849640 10 monclient(hunting): picked mon.noname-i con 0x7f2dc0136e00 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:00.185 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc7849640 10 monclient(hunting): picked mon.noname-g con 0x7f2dc013d880 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:00.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc7849640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc0136b30 con 0x7f2dc013d880 2024-09-13T10:40:00.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc7849640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc013c3d0 con 0x7f2dc00a34c0 2024-09-13T10:40:00.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc7849640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc01cd220 con 0x7f2dc0136e00 2024-09-13T10:40:00.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc7849640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:00.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc7849640 10 monclient(hunting): authenticate will time out at 1339.680349s 2024-09-13T10:40:00.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc5de6640 1 -- >> v1:172.21.15.195:6790/0 conn(0x7f2dc013d880 legacy=0x7f2dc01d4660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:40:00.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc4de4640 1 --1- >> v1:172.21.15.195:6792/0 conn(0x7f2dc0136e00 0x7f2dc01ccb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6792/0 says I am v1:172.21.15.181:57492/0 (socket says 172.21.15.181:57492) 2024-09-13T10:40:00.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc55e5640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f2dc00a34c0 0x7f2dc01cc400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:51544/0 (socket says 172.21.15.181:51544) 2024-09-13T10:40:00.186 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.175+0000 7f2dc4de4640 1 -- 172.21.15.181:0/3264664153 learned_addr learned my addr 172.21.15.181:0/3264664153 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:00.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.177+0000 7f2dc55e5640 1 -- 172.21.15.181:0/3264664153 >> v1:172.21.15.195:6791/0 conn(0x7f2dc00a34c0 legacy=0x7f2dc01cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:00.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.177+0000 7f2dc4de4640 1 -- 172.21.15.181:0/3264664153 >> v1:172.21.15.195:6792/0 conn(0x7f2dc0136e00 legacy=0x7f2dc01ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:00.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.177+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211017760 0 0) 0x7f2dc01cd220 con 0x7f2dc0136e00 2024-09-13T10:40:00.189 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.177+0000 7f2db5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.177+0000 7f2db5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.177+0000 7f2db5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.177+0000 7f2db5ffb640 10 monclient(hunting): my global_id is 57976 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.177+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2da4003550 con 0x7f2dc0136e00 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.177+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 936971571 0 0) 0x7f2da4003550 con 0x7f2dc0136e00 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2dc01cd220 con 0x7f2dc0136e00 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2db0003b00 con 0x7f2dc0136e00 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 10 monclient(hunting): dump: 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:00.190 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:00.191 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3759720933 0 0) 0x7f2dc01cd220 con 0x7f2dc0136e00 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 >> v1:172.21.15.195:6791/0 conn(0x7f2dc00a34c0 legacy=0x7f2dc01cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 >> v1:172.21.15.195:6790/0 conn(0x7f2dc013d880 legacy=0x7f2dc01d4660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 1 monclient: found mon.i 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc013a070 con 0x7f2dc0136e00 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 10 monclient: _finish_auth 0 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2dc7849640 5 monclient: authenticate success, global_id 57976 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2dc7849640 10 monclient: _renew_subs 2024-09-13T10:40:00.192 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2dc7849640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2dc7849640 1 -- 172.21.15.181:0/3264664153 --> v1:172.21.15.195:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc013bb30 con 0x7f2dc0136e00 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 <== mon.7 v1:172.21.15.195:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2db0003fd0 con 0x7f2dc0136e00 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 <== mon.7 v1:172.21.15.195:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f2db00057c0 con 0x7f2dc0136e00 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db5ffb640 10 monclient: dump: 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:00.193 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2db77fe640 4 set_mon_vals no callback set 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2dc7849640 10 monclient: _renew_subs 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2dc7849640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:40:00.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.178+0000 7f2dc7849640 1 -- 172.21.15.181:0/3264664153 --> v1:172.21.15.195:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f2dc013cb60 con 0x7f2dc0136e00 2024-09-13T10:40:00.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.179+0000 7f2dc7849640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:00.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.179+0000 7f2dc7849640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:00.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.179+0000 7f2dc7849640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:40:00.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.179+0000 7f2dc7849640 1 -- 172.21.15.181:0/3264664153 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc00a3b80 con 0x7f2dc0136e00 2024-09-13T10:40:00.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.179+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 <== mon.7 v1:172.21.15.195:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f2db0011e40 con 0x7f2dc0136e00 2024-09-13T10:40:00.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.179+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 <== mon.7 v1:172.21.15.195:6792/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7f2db004e290 con 0x7f2dc0136e00 2024-09-13T10:40:00.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.179+0000 7f2dc55e5640 10 monclient: get_auth_request con 0x7f2da403fa70 auth_method 0 2024-09-13T10:40:00.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.184+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 <== mon.7 v1:172.21.15.195:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f2db0017960 con 0x7f2dc0136e00 2024-09-13T10:40:00.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.184+0000 7f2db5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:00.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.184+0000 7f2db5ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:00.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.426+0000 7f2dc7849640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:40:00.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.426+0000 7f2dc7849640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:40:00.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.426+0000 7f2dc7849640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.195:6792/0 2024-09-13T10:40:00.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.426+0000 7f2dc7849640 1 -- 172.21.15.181:0/3264664153 --> v1:172.21.15.195:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2dc006d360 con 0x7f2dc0136e00 2024-09-13T10:40:00.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.427+0000 7f2db5ffb640 1 -- 172.21.15.181:0/3264664153 <== mon.7 v1:172.21.15.195:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 3584239408) 0x7f2db0017260 con 0x7f2dc0136e00 2024-09-13T10:40:00.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.427+0000 7f2db5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:40:00.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.427+0000 7f2db5ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:00.429 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":140,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":7,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:40:00.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.429+0000 7f2dc7849640 1 -- 172.21.15.181:0/3264664153 >> v1:172.21.15.195:6800/1839191919 conn(0x7f2da403fa70 legacy=0x7f2da4041f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:00.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.429+0000 7f2dc7849640 10 monclient: shutdown 2024-09-13T10:40:00.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.429+0000 7f2dc7849640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:00.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.429+0000 7f2dc7849640 1 -- 172.21.15.181:0/3264664153 >> v1:172.21.15.195:6792/0 conn(0x7f2dc0136e00 legacy=0x7f2dc01ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:00.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.429+0000 7f2dc7849640 1 -- 172.21.15.181:0/3264664153 shutdown_connections 2024-09-13T10:40:00.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.429+0000 7f2dc7849640 1 -- 172.21.15.181:0/3264664153 >> 172.21.15.181:0/3264664153 conn(0x7f2dc00a45b0 msgr2=0x7f2dc01362b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:00.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.429+0000 7f2dc7849640 1 -- 172.21.15.181:0/3264664153 shutdown_connections 2024-09-13T10:40:00.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:00.429+0000 7f2dc7849640 1 -- 172.21.15.181:0/3264664153 wait complete. 2024-09-13T10:40:03.444 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:40:03.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.550+0000 7fef076bf640 10 monclient: get_monmap_and_config 2024-09-13T10:40:03.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.550+0000 7fef076bf640 10 monclient: build_initial_monmap 2024-09-13T10:40:03.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.550+0000 7fef076bf640 10 monclient: monmap: 2024-09-13T10:40:03.552 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:03.552 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:03.553 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:03.551390+0000 2024-09-13T10:40:03.553 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:03.551390+0000 2024-09-13T10:40:03.553 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:03.553 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:03.553 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:03.553 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:03.553 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:03.553 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:03.554 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:03.554 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:03.554 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:03.554 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:03.554 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:03.554 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:03.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.551+0000 7fef076bf640 1 Processor -- start 2024-09-13T10:40:03.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.551+0000 7fef076bf640 1 -- start start 2024-09-13T10:40:03.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.551+0000 7fef076bf640 10 monclient: init 2024-09-13T10:40:03.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef076bf640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:03.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef076bf640 10 monclient: _add_conns ranks=[7,2,0,5,4,8,1,6,3] 2024-09-13T10:40:03.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef076bf640 10 monclient(hunting): picked mon.noname-i con 0x7fef00139040 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:03.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef076bf640 10 monclient(hunting): picked mon.noname-b con 0x7fef0009cd50 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:03.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef076bf640 10 monclient(hunting): picked mon.noname-a con 0x7fef0013fae0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:03.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef076bf640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0009dbb0 con 0x7fef0013fae0 2024-09-13T10:40:03.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef076bf640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0009de90 con 0x7fef0009cd50 2024-09-13T10:40:03.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef076bf640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef0009e170 con 0x7fef00139040 2024-09-13T10:40:03.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef076bf640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:03.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef076bf640 10 monclient(hunting): authenticate will time out at 1343.057351s 2024-09-13T10:40:03.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef05c5c640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fef0013fae0 legacy=0x7fef00141ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:40:03.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef04c5a640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fef0009cd50 0x7fef0013e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:50582/0 (socket says 172.21.15.181:50582) 2024-09-13T10:40:03.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.552+0000 7fef04c5a640 1 -- 172.21.15.181:0/1775756333 learned_addr learned my addr 172.21.15.181:0/1775756333 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:03.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.554+0000 7fef04c5a640 1 -- 172.21.15.181:0/1775756333 >> v1:172.21.15.181:6790/0 conn(0x7fef0009cd50 legacy=0x7fef0013e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:03.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.554+0000 7fef0545b640 1 -- 172.21.15.181:0/1775756333 >> v1:172.21.15.195:6792/0 conn(0x7fef00139040 legacy=0x7fef000a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:03.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 1 -- 172.21.15.181:0/1775756333 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665896579 0 0) 0x7fef0009e170 con 0x7fef00139040 2024-09-13T10:40:03.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:03.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:03.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:03.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient(hunting): my global_id is 57985 2024-09-13T10:40:03.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 1 -- 172.21.15.181:0/1775756333 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feeec003520 con 0x7fef00139040 2024-09-13T10:40:03.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 1 -- 172.21.15.181:0/1775756333 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3548136447 0 0) 0x7feeec003520 con 0x7fef00139040 2024-09-13T10:40:03.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 1 -- 172.21.15.181:0/1775756333 >> v1:172.21.15.181:6790/0 conn(0x7fef0009cd50 legacy=0x7fef0013e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:03.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 1 -- 172.21.15.181:0/1775756333 >> v1:172.21.15.181:6789/0 conn(0x7fef0013fae0 legacy=0x7fef00141ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:40:03.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient: _finish_hunting 0 2024-09-13T10:40:03.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 1 monclient: found mon.noname-i 2024-09-13T10:40:03.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:03.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:40:03.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 1 -- 172.21.15.181:0/1775756333 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef000a5ff0 con 0x7fef00139040 2024-09-13T10:40:03.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient: _finish_auth 0 2024-09-13T10:40:03.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient: _check_auth_tickets 2024-09-13T10:40:03.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:03.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 1 -- 172.21.15.181:0/1775756333 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feefc001bf0 con 0x7fef00139040 2024-09-13T10:40:03.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:03.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:40:03.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient: dump: 2024-09-13T10:40:03.563 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:03.564 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:03.564 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:03.564 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:03.564 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:03.564 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:03.564 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:03.564 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:03.564 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:03.565 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:03.565 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:03.565 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:03.565 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:03.565 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:03.565 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:03.565 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:03.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7fef076bf640 5 monclient: authenticate success, global_id 57985 2024-09-13T10:40:03.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7fef076bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:03.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 1 -- 172.21.15.181:0/1775756333 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feefc003610 con 0x7fef00139040 2024-09-13T10:40:03.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:03.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 1 -- 172.21.15.181:0/1775756333 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feefc003c40 con 0x7fef00139040 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7feef7fff640 10 monclient: dump: 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:03.566 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7fef076bf640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7fef076bf640 4 set_mon_vals no callback set 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7fef076bf640 10 monclient: shutdown 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7fef076bf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.555+0000 7fef076bf640 1 -- 172.21.15.181:0/1775756333 >> v1:172.21.15.195:6792/0 conn(0x7fef00139040 legacy=0x7fef000a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.556+0000 7fef076bf640 1 -- 172.21.15.181:0/1775756333 shutdown_connections 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.556+0000 7fef076bf640 1 -- 172.21.15.181:0/1775756333 >> 172.21.15.181:0/1775756333 conn(0x7fef00077120 msgr2=0x7fef000abbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.556+0000 7fef076bf640 1 -- 172.21.15.181:0/1775756333 shutdown_connections 2024-09-13T10:40:03.567 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.556+0000 7fef076bf640 1 -- 172.21.15.181:0/1775756333 wait complete. 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.556+0000 7fef076bf640 10 monclient: build_initial_monmap 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.556+0000 7fef076bf640 10 monclient: monmap: 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:03.568 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 1 Processor -- start 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 1 -- start start 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 10 monclient: init 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 10 monclient: _add_conns ranks=[6,3,0,2,1,4,8,5,7] 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 10 monclient(hunting): picked mon.noname-d con 0x7fef0009cd50 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 10 monclient(hunting): picked mon.noname-g con 0x7fef00139040 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:03.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 10 monclient(hunting): picked mon.noname-a con 0x7fef0013fae0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:03.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef000a5a10 con 0x7fef0013fae0 2024-09-13T10:40:03.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef001355e0 con 0x7fef00139040 2024-09-13T10:40:03.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef00134a60 con 0x7fef0009cd50 2024-09-13T10:40:03.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef05c5c640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fef0013fae0 legacy=0x7fef001d66b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:40:03.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:03.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef076bf640 10 monclient(hunting): authenticate will time out at 1343.062628s 2024-09-13T10:40:03.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef0545b640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fef0009cd50 0x7fef00133c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:54582/0 (socket says 172.21.15.181:54582) 2024-09-13T10:40:03.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef0545b640 1 -- 172.21.15.181:0/4067678768 learned_addr learned my addr 172.21.15.181:0/4067678768 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:03.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.557+0000 7fef04c5a640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.195:6790/0 conn(0x7fef00139040 legacy=0x7fef00134350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:40:03.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.559+0000 7fef0545b640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6792/0 conn(0x7fef0009cd50 legacy=0x7fef00133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.758+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6789/0 conn(0x7fef0013fae0 legacy=0x7fef001d66b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:40:03.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:03.758+0000 7fef04c5a640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.195:6790/0 conn(0x7fef00139040 legacy=0x7fef00134350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:40:04.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:04.159+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6789/0 conn(0x7fef0013fae0 legacy=0x7fef001d66b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:40:04.161 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:04.159+0000 7fef04c5a640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.195:6790/0 conn(0x7fef00139040 legacy=0x7fef00134350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:40:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:04.960+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6789/0 conn(0x7fef0013fae0 legacy=0x7fef001d66b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:40:04.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:04.960+0000 7fef04c5a640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.195:6790/0 conn(0x7fef00139040 legacy=0x7fef00134350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:40:06.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 10 monclient(hunting): tick 2024-09-13T10:40:06.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:40:06.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 1 monclient(hunting): continuing hunt 2024-09-13T10:40:06.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:40:06.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6792/0 conn(0x7fef0009cd50 legacy=0x7fef00133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:06.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.195:6790/0 conn(0x7fef00139040 legacy=0x7fef00134350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:40:06.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6789/0 conn(0x7fef0013fae0 legacy=0x7fef001d66b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:40:06.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 10 monclient: _add_conns ranks=[5,1,8,4,2,7] 2024-09-13T10:40:06.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 10 monclient(hunting): picked mon.noname-h con 0x7feee8003850 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:06.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 10 monclient(hunting): picked mon.noname-f con 0x7feee80074e0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:06.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 10 monclient(hunting): picked mon.noname-e con 0x7feee800b250 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:06.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef00136140 con 0x7feee80074e0 2024-09-13T10:40:06.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef000a5a10 con 0x7feee8003850 2024-09-13T10:40:06.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.557+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef001355e0 con 0x7feee800b250 2024-09-13T10:40:06.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.558+0000 7feef4ff9640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:06.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.558+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6793/0 conn(0x7feee800b250 legacy=0x7feee800d710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:06.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.560+0000 7fef04c5a640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.195:6789/0 conn(0x7feee80074e0 legacy=0x7feee80099a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:06.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.560+0000 7fef0545b640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.195:6791/0 conn(0x7feee8003850 legacy=0x7feee8005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:06.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:06.759+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6793/0 conn(0x7feee800b250 legacy=0x7feee800d710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:07.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:07.161+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6793/0 conn(0x7feee800b250 legacy=0x7feee800d710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:07.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:07.962+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6793/0 conn(0x7feee800b250 legacy=0x7feee800d710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:09.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 10 monclient(hunting): tick 2024-09-13T10:40:09.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:40:09.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 1 monclient(hunting): continuing hunt 2024-09-13T10:40:09.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:40:09.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6793/0 conn(0x7feee800b250 legacy=0x7feee800d710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:40:09.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.195:6791/0 conn(0x7feee8003850 legacy=0x7feee8005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:09.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.195:6789/0 conn(0x7feee80074e0 legacy=0x7feee80099a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:09.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 reap_dead start 2024-09-13T10:40:09.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 10 monclient: _add_conns ranks=[2,7,4] 2024-09-13T10:40:09.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 reap_dead start 2024-09-13T10:40:09.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 10 monclient(hunting): picked mon.noname-b con 0x7feee80101d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:09.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 10 monclient(hunting): picked mon.noname-i con 0x7feee8010670 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:09.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 10 monclient(hunting): picked mon.noname-c con 0x7feee800ef80 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:09.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee80120b0 con 0x7feee80101d0 2024-09-13T10:40:09.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef001355e0 con 0x7feee800ef80 2024-09-13T10:40:09.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee8010df0 con 0x7feee8010670 2024-09-13T10:40:09.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.558+0000 7feef4ff9640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:09.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.560+0000 7fef0545b640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6790/0 conn(0x7feee80101d0 legacy=0x7feee800d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:09.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.560+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6791/0 conn(0x7feee800ef80 legacy=0x7feee800f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:09.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:09.560+0000 7fef04c5a640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.195:6792/0 conn(0x7feee8010670 legacy=0x7feee8005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:12.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 10 monclient(hunting): tick 2024-09-13T10:40:12.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:40:12.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 1 monclient(hunting): continuing hunt 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.195:6792/0 conn(0x7feee8010670 legacy=0x7feee8005ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6791/0 conn(0x7feee800ef80 legacy=0x7feee800f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6790/0 conn(0x7feee80101d0 legacy=0x7feee800d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 10 monclient: _add_conns ranks=[2,8,0,4,6,7,1,5,3] 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 10 monclient(hunting): picked mon.noname-b con 0x7feee800a2f0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 10 monclient(hunting): picked mon.noname-e con 0x7feee800a7f0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 10 monclient(hunting): picked mon.noname-a con 0x7feee8018b30 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee800fbe0 con 0x7feee8018b30 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee800aef0 con 0x7feee800a2f0 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee800c690 con 0x7feee800a7f0 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7fef04c5a640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6793/0 conn(0x7feee800a7f0 legacy=0x7feee8017410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:12.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6789/0 conn(0x7feee8018b30 legacy=0x7feee801af20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:40:12.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.558+0000 7feef4ff9640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:12.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.561+0000 7fef0545b640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6790/0 conn(0x7feee800a2f0 legacy=0x7feee8009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:12.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.759+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6789/0 conn(0x7feee8018b30 legacy=0x7feee801af20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:40:12.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:12.759+0000 7fef04c5a640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6793/0 conn(0x7feee800a7f0 legacy=0x7feee8017410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:13.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:13.160+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6789/0 conn(0x7feee8018b30 legacy=0x7feee801af20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:40:13.162 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:13.160+0000 7fef04c5a640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6793/0 conn(0x7feee800a7f0 legacy=0x7feee8017410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:13.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:13.961+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6789/0 conn(0x7feee8018b30 legacy=0x7feee801af20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:40:13.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:13.961+0000 7fef04c5a640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6793/0 conn(0x7feee800a7f0 legacy=0x7feee8017410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:14.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.047+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813575575 0 0) 0x7feee800aef0 con 0x7feee800a2f0 2024-09-13T10:40:14.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.047+0000 7feef5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.047+0000 7feef5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.047+0000 7feef5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.047+0000 7feef5ffb640 10 monclient(hunting): my global_id is 174278 2024-09-13T10:40:14.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.047+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feee4003520 con 0x7feee800a2f0 2024-09-13T10:40:14.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1534427389 0 0) 0x7feee4003520 con 0x7feee800a2f0 2024-09-13T10:40:14.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feee800aef0 con 0x7feee800a2f0 2024-09-13T10:40:14.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feefc001bb0 con 0x7feee800a2f0 2024-09-13T10:40:14.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:14.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:40:14.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 10 monclient(hunting): dump: 2024-09-13T10:40:14.052 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.052 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.052 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.052 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.052 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.052 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.052 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.052 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.052 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.053 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.053 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.053 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.053 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.053 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.053 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.053 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:14.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3039604375 0 0) 0x7feee800aef0 con 0x7feee800a2f0 2024-09-13T10:40:14.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6793/0 conn(0x7feee800a7f0 legacy=0x7feee8017410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:40:14.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6789/0 conn(0x7feee8018b30 legacy=0x7feee801af20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:40:14.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:40:14.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 1 monclient: found mon.b 2024-09-13T10:40:14.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:14.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:14.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee800d910 con 0x7feee800a2f0 2024-09-13T10:40:14.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 10 monclient: _finish_auth 0 2024-09-13T10:40:14.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:40:14.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7feef5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:14.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7fef076bf640 5 monclient: authenticate success, global_id 174278 2024-09-13T10:40:14.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7fef076bf640 10 monclient: _renew_subs 2024-09-13T10:40:14.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7fef076bf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.048+0000 7fef076bf640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fef0013f000 con 0x7feee800a2f0 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.049+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feefc001350 con 0x7feee800a2f0 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.049+0000 7feef5ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.049+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7feefc003c60 con 0x7feee800a2f0 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.049+0000 7fef076bf640 10 monclient: _renew_subs 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.049+0000 7fef076bf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.049+0000 7fef076bf640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fef00133150 con 0x7feee800a2f0 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.049+0000 7feef5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.049+0000 7feef77fe640 4 set_mon_vals no callback set 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.049+0000 7feef5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.049+0000 7feef5ffb640 10 monclient: dump: 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.055 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.056 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.057 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.049+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7feefc011ca0 con 0x7feee800a2f0 2024-09-13T10:40:14.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.050+0000 7fef076bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:14.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.050+0000 7fef076bf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:14.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.050+0000 7fef076bf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:14.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.050+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7feefc04df30 con 0x7feee800a2f0 2024-09-13T10:40:14.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.050+0000 7fef076bf640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef0013a6f0 con 0x7feee800a2f0 2024-09-13T10:40:14.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.050+0000 7fef04c5a640 10 monclient: get_auth_request con 0x7feee403f880 auth_method 0 2024-09-13T10:40:14.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.055+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fef0013a6f0 con 0x7feee800a2f0 2024-09-13T10:40:14.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.055+0000 7feef5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:14.058 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.055+0000 7feef5ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:14.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.300+0000 7fef076bf640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:40:14.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.301+0000 7fef076bf640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:40:14.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.301+0000 7fef076bf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:14.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.301+0000 7fef076bf640 1 -- 172.21.15.181:0/4067678768 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fef00143330 con 0x7feee800a2f0 2024-09-13T10:40:14.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.301+0000 7feef5ffb640 1 -- 172.21.15.181:0/4067678768 <== mon.2 v1:172.21.15.181:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2727 (unknown 254746657 0 213802521) 0x7feefc017680 con 0x7feee800a2f0 2024-09-13T10:40:14.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.301+0000 7feef5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:40:14.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.301+0000 7feef5ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:14.303 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":144,"quorum":[1,2,4,5,6,7],"quorum_names":["f","b","c","h","d","i"],"quorum_leader_name":"i","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:40:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.303+0000 7fef076bf640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.195:6800/1839191919 conn(0x7feee403f880 legacy=0x7feee4041d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.303+0000 7fef076bf640 10 monclient: shutdown 2024-09-13T10:40:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.303+0000 7fef076bf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.303+0000 7fef076bf640 1 -- 172.21.15.181:0/4067678768 >> v1:172.21.15.181:6790/0 conn(0x7feee800a2f0 legacy=0x7feee8009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.303+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 reap_dead start 2024-09-13T10:40:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.303+0000 7fef05c5c640 1 -- 172.21.15.181:0/4067678768 reap_dead start 2024-09-13T10:40:14.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.303+0000 7fef076bf640 1 -- 172.21.15.181:0/4067678768 shutdown_connections 2024-09-13T10:40:14.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.303+0000 7fef076bf640 1 -- 172.21.15.181:0/4067678768 >> 172.21.15.181:0/4067678768 conn(0x7fef00077120 msgr2=0x7fef0012c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:14.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.303+0000 7fef076bf640 1 -- 172.21.15.181:0/4067678768 shutdown_connections 2024-09-13T10:40:14.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.303+0000 7fef076bf640 1 -- 172.21.15.181:0/4067678768 wait complete. 2024-09-13T10:40:14.316 INFO:tasks.mon_thrash.ceph_manager:quorum is size 6 2024-09-13T10:40:14.316 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon b 2024-09-13T10:40:14.316 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:40:14.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.413+0000 7f02fcf07640 10 monclient: get_monmap_and_config 2024-09-13T10:40:14.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.413+0000 7f02fcf07640 10 monclient: build_initial_monmap 2024-09-13T10:40:14.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.413+0000 7f02fcf07640 10 monclient: monmap: 2024-09-13T10:40:14.415 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:14.415 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.415 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:14.413705+0000 2024-09-13T10:40:14.415 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:14.413705+0000 2024-09-13T10:40:14.415 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:14.415 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.415 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:14.415 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:14.416 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:14.416 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:14.416 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:14.416 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:14.416 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:14.416 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:14.416 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:14.416 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.413+0000 7f02fcf07640 1 Processor -- start 2024-09-13T10:40:14.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.413+0000 7f02fcf07640 1 -- start start 2024-09-13T10:40:14.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.413+0000 7f02fcf07640 10 monclient: init 2024-09-13T10:40:14.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02fcf07640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:14.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02fcf07640 10 monclient: _add_conns ranks=[0,4,8,5,3,1,2,7,6] 2024-09-13T10:40:14.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02fcf07640 10 monclient(hunting): picked mon.noname-a con 0x7f02f80a66d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:14.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02fcf07640 10 monclient(hunting): picked mon.noname-c con 0x7f02f80a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:14.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02fcf07640 10 monclient(hunting): picked mon.noname-e con 0x7f02f813f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:14.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02fcf07640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f80a5fe0 con 0x7f02f80a66d0 2024-09-13T10:40:14.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02fcf07640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f80a8080 con 0x7f02f80a6ab0 2024-09-13T10:40:14.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02fcf07640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f80a42c0 con 0x7f02f813f9a0 2024-09-13T10:40:14.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02fcf07640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:14.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02fcf07640 10 monclient(hunting): authenticate will time out at 1353.919469s 2024-09-13T10:40:14.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02f6d9d640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f02f813f9a0 legacy=0x7f02f8141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:14.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02f659c640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f02f80a66d0 legacy=0x7f02f80a53b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:40:14.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02f5d9b640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f02f80a6ab0 0x7f02f80a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:43052/0 (socket says 172.21.15.181:43052) 2024-09-13T10:40:14.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.414+0000 7f02f5d9b640 1 -- 172.21.15.181:0/1985133193 learned_addr learned my addr 172.21.15.181:0/1985133193 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:14.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.416+0000 7f02f5d9b640 1 -- 172.21.15.181:0/1985133193 >> v1:172.21.15.181:6791/0 conn(0x7f02f80a6ab0 legacy=0x7f02f80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.416+0000 7f02f559a640 1 -- 172.21.15.181:0/1985133193 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512101860 0 0) 0x7f02f80a8080 con 0x7f02f80a6ab0 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient(hunting): my global_id is 174289 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 1 -- 172.21.15.181:0/1985133193 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e0003520 con 0x7f02f80a6ab0 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 1 -- 172.21.15.181:0/1985133193 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2192773726 0 0) 0x7f02e0003520 con 0x7f02f80a6ab0 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 1 -- 172.21.15.181:0/1985133193 >> v1:172.21.15.181:6793/0 conn(0x7f02f813f9a0 legacy=0x7f02f8141d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 1 -- 172.21.15.181:0/1985133193 >> v1:172.21.15.181:6789/0 conn(0x7f02f80a66d0 legacy=0x7f02f80a53b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient: _finish_hunting 0 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 1 monclient: found mon.noname-c 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 1 -- 172.21.15.181:0/1985133193 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f81464e0 con 0x7f02f80a6ab0 2024-09-13T10:40:14.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient: _finish_auth 0 2024-09-13T10:40:14.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient: _check_auth_tickets 2024-09-13T10:40:14.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:14.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 1 -- 172.21.15.181:0/1985133193 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f02ec001ae0 con 0x7f02f80a6ab0 2024-09-13T10:40:14.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02fcf07640 5 monclient: authenticate success, global_id 174289 2024-09-13T10:40:14.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02fcf07640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:14.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:14.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient: dump: 2024-09-13T10:40:14.424 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.424 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.424 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.425 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.425 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.425 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.425 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.425 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.425 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.425 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.425 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.425 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.425 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.425 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.425 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02fcf07640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 1 -- 172.21.15.181:0/1985133193 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02ec0048a0 con 0x7f02f80a6ab0 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 1 -- 172.21.15.181:0/1985133193 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f02ec004e10 con 0x7f02f80a6ab0 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02fcf07640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02fcf07640 4 set_mon_vals no callback set 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02f559a640 10 monclient: dump: 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.426 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02fcf07640 10 monclient: shutdown 2024-09-13T10:40:14.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02fcf07640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02fcf07640 1 -- 172.21.15.181:0/1985133193 >> v1:172.21.15.181:6791/0 conn(0x7f02f80a6ab0 legacy=0x7f02f80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02fcf07640 1 -- 172.21.15.181:0/1985133193 shutdown_connections 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02fcf07640 1 -- 172.21.15.181:0/1985133193 >> 172.21.15.181:0/1985133193 conn(0x7f02f80abcd0 msgr2=0x7f02f80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02fcf07640 1 -- 172.21.15.181:0/1985133193 shutdown_connections 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.417+0000 7f02fcf07640 1 -- 172.21.15.181:0/1985133193 wait complete. 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.418+0000 7f02fcf07640 10 monclient: build_initial_monmap 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.418+0000 7f02fcf07640 10 monclient: monmap: 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:14.428 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.418+0000 7f02fcf07640 1 Processor -- start 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02fcf07640 1 -- start start 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02fcf07640 10 monclient: init 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02fcf07640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:14.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02fcf07640 10 monclient: _add_conns ranks=[1,7,6,2,4,5,0,8,3] 2024-09-13T10:40:14.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02fcf07640 10 monclient(hunting): picked mon.noname-f con 0x7f02f80a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:14.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02fcf07640 10 monclient(hunting): picked mon.noname-i con 0x7f02f80a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:14.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02fcf07640 10 monclient(hunting): picked mon.noname-d con 0x7f02f813f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:14.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02fcf07640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f813f480 con 0x7f02f80a66d0 2024-09-13T10:40:14.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02fcf07640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f8138ef0 con 0x7f02f813f9a0 2024-09-13T10:40:14.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02fcf07640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f8142ed0 con 0x7f02f80a6ab0 2024-09-13T10:40:14.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02fcf07640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:14.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02fcf07640 10 monclient(hunting): authenticate will time out at 1353.924560s 2024-09-13T10:40:14.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02f6d9d640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f02f813f9a0 0x7f02f813c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:42714/0 (socket says 172.21.15.181:42714) 2024-09-13T10:40:14.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.419+0000 7f02f6d9d640 1 -- 172.21.15.181:0/3355959126 learned_addr learned my addr 172.21.15.181:0/3355959126 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:14.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.421+0000 7f02f6d9d640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.181:6792/0 conn(0x7f02f813f9a0 legacy=0x7f02f813c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02f659c640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.195:6789/0 conn(0x7f02f80a66d0 legacy=0x7f02f813b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02f5d9b640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.195:6792/0 conn(0x7f02f80a6ab0 legacy=0x7f02f813bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185277722 0 0) 0x7f02f8138ef0 con 0x7f02f813f9a0 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): my global_id is 174282 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02d8003520 con 0x7f02f813f9a0 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106008642 0 0) 0x7f02f813f480 con 0x7f02f80a66d0 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): my global_id is 134983 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02f8138ef0 con 0x7f02f80a66d0 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439522665 0 0) 0x7f02f8142ed0 con 0x7f02f80a6ab0 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): my global_id is 57994 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02f813f480 con 0x7f02f80a6ab0 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3485037089 0 0) 0x7f02d8003520 con 0x7f02f813f9a0 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02f8142ed0 con 0x7f02f813f9a0 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f02f00049d0 con 0x7f02f813f9a0 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:14.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): dump: 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.437 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4078726801 0 0) 0x7f02f8138ef0 con 0x7f02f80a66d0 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02d8003520 con 0x7f02f80a66d0 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1553535978 0 0) 0x7f02f8142ed0 con 0x7f02f813f9a0 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.195:6792/0 conn(0x7f02f80a6ab0 legacy=0x7f02f813bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.195:6789/0 conn(0x7f02f80a66d0 legacy=0x7f02f813b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 monclient: found mon.d 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:14.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f813ec10 con 0x7f02f813f9a0 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02fcf07640 5 monclient: authenticate success, global_id 174282 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02fcf07640 10 monclient: _renew_subs 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02fcf07640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02fcf07640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f02f813dc60 con 0x7f02f813f9a0 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02fcf07640 10 monclient: _renew_subs 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02fcf07640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02fcf07640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f02f813d3e0 con 0x7f02f813f9a0 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02f0004bf0 con 0x7f02f813f9a0 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f02f00050e0 con 0x7f02f813f9a0 2024-09-13T10:40:14.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02f4d99640 4 set_mon_vals no callback set 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.422+0000 7f02e6ffd640 10 monclient: dump: 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.440 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.441 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.441 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.441 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.441 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.441 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.423+0000 7f02fcf07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:14.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.423+0000 7f02fcf07640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f02dc0065c0 con 0x7f02dc002860 2024-09-13T10:40:14.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.423+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f02f0005410 con 0x7f02f813f9a0 2024-09-13T10:40:14.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.423+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7f02f004e570 con 0x7f02f813f9a0 2024-09-13T10:40:14.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.424+0000 7f02f5d9b640 10 monclient: get_auth_request con 0x7f02d803fcd0 auth_method 0 2024-09-13T10:40:14.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.425+0000 7f02f659c640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.181:6790/0 conn(0x7f02dc002860 legacy=0x7f02dc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.425+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2463282593 0 0) 0x7f02dc0065c0 con 0x7f02dc002860 2024-09-13T10:40:14.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 10 monclient(hunting): my global_id is 174287 2024-09-13T10:40:14.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02f8142ed0 con 0x7f02dc002860 2024-09-13T10:40:14.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3505316006 0 0) 0x7f02f8142ed0 con 0x7f02dc002860 2024-09-13T10:40:14.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02dc0065c0 con 0x7f02dc002860 2024-09-13T10:40:14.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f02e8004cf0 con 0x7f02dc002860 2024-09-13T10:40:14.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 10 monclient: dump: 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.443 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.444 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.444 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.444 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 217584841 0 0) 0x7f02dc0065c0 con 0x7f02dc002860 2024-09-13T10:40:14.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02dc00a160 con 0x7f02dc002860 2024-09-13T10:40:14.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f02e8007050 con 0x7f02dc002860 2024-09-13T10:40:14.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:14.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:14.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.181:6790/0 conn(0x7f02dc002860 legacy=0x7f02dc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.426+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.181:6790/0 conn(0x7f02dc002860 legacy=0x7f02dc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:14.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.432+0000 7f02fcf07640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:14.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.432+0000 7f02fcf07640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f02dc009e50 con 0x7f02dc009110 2024-09-13T10:40:14.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02f659c640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.181:6790/0 conn(0x7f02dc009110 legacy=0x7f02dc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1960193170 0 0) 0x7f02dc009e50 con 0x7f02dc009110 2024-09-13T10:40:14.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 10 monclient(hunting): my global_id is 174296 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02dc0065c0 con 0x7f02dc009110 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4072695890 0 0) 0x7f02dc0065c0 con 0x7f02dc009110 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02dc009e50 con 0x7f02dc009110 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f02e80056d0 con 0x7f02dc009110 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 10 monclient: dump: 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.447 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1098251585 0 0) 0x7f02dc009e50 con 0x7f02dc009110 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f02dc00c3f0 con 0x7f02dc009110 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7526 (unknown 0 0 2893620770) 0x7f02e8006c00 con 0x7f02dc009110 2024-09-13T10:40:14.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.181:6790/0 conn(0x7f02dc009110 legacy=0x7f02dc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.435+0000 7f02e6ffd640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.181:6790/0 conn(0x7f02dc009110 legacy=0x7f02dc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:14.449 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 144, 2024-09-13T10:40:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 27591, 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:14.469 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:14.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.436+0000 7f02fcf07640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.195:6800/1839191919 conn(0x7f02d803fcd0 legacy=0x7f02d8042190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.436+0000 7f02fcf07640 10 monclient: shutdown 2024-09-13T10:40:14.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.436+0000 7f02fcf07640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:14.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.436+0000 7f02fcf07640 1 -- 172.21.15.181:0/3355959126 >> v1:172.21.15.181:6792/0 conn(0x7f02f813f9a0 legacy=0x7f02f813c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.436+0000 7f02f6d9d640 1 -- 172.21.15.181:0/3355959126 reap_dead start 2024-09-13T10:40:14.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.436+0000 7f02f6d9d640 1 -- 172.21.15.181:0/3355959126 reap_dead start 2024-09-13T10:40:14.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.436+0000 7f02fcf07640 1 -- 172.21.15.181:0/3355959126 shutdown_connections 2024-09-13T10:40:14.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.436+0000 7f02fcf07640 1 -- 172.21.15.181:0/3355959126 >> 172.21.15.181:0/3355959126 conn(0x7f02f80abcd0 msgr2=0x7f02f8145ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:14.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.436+0000 7f02fcf07640 1 -- 172.21.15.181:0/3355959126 shutdown_connections 2024-09-13T10:40:14.471 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.436+0000 7f02fcf07640 1 -- 172.21.15.181:0/3355959126 wait complete. 2024-09-13T10:40:14.471 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:40:14.472 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon c 2024-09-13T10:40:14.472 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:40:14.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.569+0000 7f699df0e640 10 monclient: get_monmap_and_config 2024-09-13T10:40:14.570 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.569+0000 7f699df0e640 10 monclient: build_initial_monmap 2024-09-13T10:40:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.569+0000 7f699df0e640 10 monclient: monmap: 2024-09-13T10:40:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:14.569682+0000 2024-09-13T10:40:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:14.569682+0000 2024-09-13T10:40:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:14.571 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:14.572 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:14.572 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:14.572 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:14.572 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:14.572 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.569+0000 7f699df0e640 1 Processor -- start 2024-09-13T10:40:14.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.569+0000 7f699df0e640 1 -- start start 2024-09-13T10:40:14.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.569+0000 7f699df0e640 10 monclient: init 2024-09-13T10:40:14.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f699df0e640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:14.573 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f699df0e640 10 monclient: _add_conns ranks=[8,4,7,1,2,5,6,3,0] 2024-09-13T10:40:14.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f699df0e640 10 monclient(hunting): picked mon.noname-e con 0x7f69980a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:14.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f699df0e640 10 monclient(hunting): picked mon.noname-c con 0x7f69980a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:14.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f699df0e640 10 monclient(hunting): picked mon.noname-i con 0x7f699813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:14.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f699df0e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69980a5fe0 con 0x7f69980a6ab0 2024-09-13T10:40:14.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f699df0e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69980a8080 con 0x7f699813f9a0 2024-09-13T10:40:14.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f699df0e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69980a42c0 con 0x7f69980a66d0 2024-09-13T10:40:14.574 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f699df0e640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:14.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f69977fe640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f69980a66d0 legacy=0x7f69980a53b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:14.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f699df0e640 10 monclient(hunting): authenticate will time out at 1354.075430s 2024-09-13T10:40:14.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f6996ffd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f69980a6ab0 0x7f69980a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:43064/0 (socket says 172.21.15.181:43064) 2024-09-13T10:40:14.575 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.570+0000 7f6996ffd640 1 -- 172.21.15.181:0/1940926520 learned_addr learned my addr 172.21.15.181:0/1940926520 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:14.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.572+0000 7f6996ffd640 1 -- 172.21.15.181:0/1940926520 >> v1:172.21.15.181:6791/0 conn(0x7f69980a6ab0 legacy=0x7f69980a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.572+0000 7f6997fff640 1 -- 172.21.15.181:0/1940926520 >> v1:172.21.15.195:6792/0 conn(0x7f699813f9a0 legacy=0x7f6998141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 1 -- 172.21.15.181:0/1940926520 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1882956779 0 0) 0x7f69980a8080 con 0x7f699813f9a0 2024-09-13T10:40:14.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient(hunting): my global_id is 58003 2024-09-13T10:40:14.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 1 -- 172.21.15.181:0/1940926520 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6980003520 con 0x7f699813f9a0 2024-09-13T10:40:14.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 1 -- 172.21.15.181:0/1940926520 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2760546401 0 0) 0x7f6980003520 con 0x7f699813f9a0 2024-09-13T10:40:14.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 1 -- 172.21.15.181:0/1940926520 >> v1:172.21.15.181:6793/0 conn(0x7f69980a66d0 legacy=0x7f69980a53b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:40:14.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 1 -- 172.21.15.181:0/1940926520 >> v1:172.21.15.181:6791/0 conn(0x7f69980a6ab0 legacy=0x7f69980a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient: _finish_hunting 0 2024-09-13T10:40:14.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 1 monclient: found mon.noname-i 2024-09-13T10:40:14.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:14.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.195:6792/0 2024-09-13T10:40:14.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 1 -- 172.21.15.181:0/1940926520 --> v1:172.21.15.195:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69981464e0 con 0x7f699813f9a0 2024-09-13T10:40:14.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient: _finish_auth 0 2024-09-13T10:40:14.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient: _check_auth_tickets 2024-09-13T10:40:14.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:14.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 1 -- 172.21.15.181:0/1940926520 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6990001eb0 con 0x7f699813f9a0 2024-09-13T10:40:14.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f699df0e640 5 monclient: authenticate success, global_id 58003 2024-09-13T10:40:14.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f699df0e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:14.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient: dump: 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.585 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f699df0e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 1 -- 172.21.15.181:0/1940926520 <== mon.7 v1:172.21.15.195:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6990003990 con 0x7f699813f9a0 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f699df0e640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f699df0e640 4 set_mon_vals no callback set 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 1 -- 172.21.15.181:0/1940926520 <== mon.7 v1:172.21.15.195:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6990003f40 con 0x7f699813f9a0 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.573+0000 7f69967fc640 10 monclient: dump: 2024-09-13T10:40:14.586 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.587 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.574+0000 7f699df0e640 10 monclient: shutdown 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.574+0000 7f699df0e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.574+0000 7f699df0e640 1 -- 172.21.15.181:0/1940926520 >> v1:172.21.15.195:6792/0 conn(0x7f699813f9a0 legacy=0x7f6998141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.574+0000 7f699df0e640 1 -- 172.21.15.181:0/1940926520 shutdown_connections 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.574+0000 7f699df0e640 1 -- 172.21.15.181:0/1940926520 >> 172.21.15.181:0/1940926520 conn(0x7f69980abcd0 msgr2=0x7f69980ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.574+0000 7f699df0e640 1 -- 172.21.15.181:0/1940926520 shutdown_connections 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.574+0000 7f699df0e640 1 -- 172.21.15.181:0/1940926520 wait complete. 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.575+0000 7f699df0e640 10 monclient: build_initial_monmap 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.575+0000 7f699df0e640 10 monclient: monmap: 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:14.588 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:14.589 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.575+0000 7f699df0e640 1 Processor -- start 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.575+0000 7f699df0e640 1 -- start start 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.575+0000 7f699df0e640 10 monclient: init 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.576+0000 7f699df0e640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.576+0000 7f699df0e640 10 monclient: _add_conns ranks=[2,6,7,8,4,0,3,1,5] 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.576+0000 7f699df0e640 10 monclient(hunting): picked mon.noname-b con 0x7f69980a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.576+0000 7f699df0e640 10 monclient(hunting): picked mon.noname-d con 0x7f69980a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.576+0000 7f699df0e640 10 monclient(hunting): picked mon.noname-i con 0x7f699813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.576+0000 7f699df0e640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f699813f680 con 0x7f69980a66d0 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.576+0000 7f699df0e640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6998139050 con 0x7f69980a6ab0 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.576+0000 7f699df0e640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f699813e810 con 0x7f699813f9a0 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.576+0000 7f699df0e640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:14.590 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.576+0000 7f699df0e640 10 monclient(hunting): authenticate will time out at 1354.081132s 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.576+0000 7f69977fe640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f69980a66d0 0x7f699813b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:39908/0 (socket says 172.21.15.181:39908) 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.576+0000 7f69977fe640 1 -- 172.21.15.181:0/3763987011 learned_addr learned my addr 172.21.15.181:0/3763987011 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f69977fe640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.181:6790/0 conn(0x7f69980a66d0 legacy=0x7f699813b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f6996ffd640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.181:6792/0 conn(0x7f69980a6ab0 legacy=0x7f699813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 677823812 0 0) 0x7f699813f680 con 0x7f69980a66d0 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): my global_id is 174305 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f6997fff640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.195:6792/0 conn(0x7f699813f9a0 legacy=0x7f69981d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6984003550 con 0x7f69980a66d0 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164260038 0 0) 0x7f6998139050 con 0x7f69980a6ab0 2024-09-13T10:40:14.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): my global_id is 174291 2024-09-13T10:40:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f699813f680 con 0x7f69980a6ab0 2024-09-13T10:40:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 920311798 0 0) 0x7f699813f680 con 0x7f69980a6ab0 2024-09-13T10:40:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6998139050 con 0x7f69980a6ab0 2024-09-13T10:40:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f698c001c90 con 0x7f69980a6ab0 2024-09-13T10:40:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): dump: 2024-09-13T10:40:14.592 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.593 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2172257161 0 0) 0x7f6984003550 con 0x7f69980a66d0 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f699813f680 con 0x7f69980a66d0 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4015753597 0 0) 0x7f699813e810 con 0x7f699813f9a0 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): my global_id is 58012 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6984003550 con 0x7f699813f9a0 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6988004620 con 0x7f69980a66d0 2024-09-13T10:40:14.594 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient(hunting): dump: 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.595 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1185668087 0 0) 0x7f6998139050 con 0x7f69980a6ab0 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.195:6792/0 conn(0x7f699813f9a0 legacy=0x7f69981d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.181:6790/0 conn(0x7f69980a66d0 legacy=0x7f699813b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 monclient: found mon.d 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699813d320 con 0x7f69980a6ab0 2024-09-13T10:40:14.596 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient: _finish_auth 0 2024-09-13T10:40:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:40:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f697ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f699df0e640 5 monclient: authenticate success, global_id 174291 2024-09-13T10:40:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.578+0000 7f699df0e640 10 monclient: _renew_subs 2024-09-13T10:40:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f699df0e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f699df0e640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f699813c650 con 0x7f69980a6ab0 2024-09-13T10:40:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f699df0e640 10 monclient: _renew_subs 2024-09-13T10:40:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f699df0e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f699df0e640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f699809cb30 con 0x7f69980a6ab0 2024-09-13T10:40:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f698c004a90 con 0x7f69980a6ab0 2024-09-13T10:40:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f697ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:14.597 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f698c004f80 con 0x7f69980a6ab0 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f697ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f6995ffb640 4 set_mon_vals no callback set 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f697ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f697ffff640 10 monclient: dump: 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.598 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.599 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f699df0e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f699df0e640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f69780065c0 con 0x7f6978002860 2024-09-13T10:40:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.579+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f698c005120 con 0x7f69980a6ab0 2024-09-13T10:40:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.580+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7f698c04e110 con 0x7f69980a6ab0 2024-09-13T10:40:14.599 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.580+0000 7f6997fff640 10 monclient: get_auth_request con 0x7f6984040360 auth_method 0 2024-09-13T10:40:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f69977fe640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.181:6791/0 conn(0x7f6978002860 legacy=0x7f6978004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138548778 0 0) 0x7f69780065c0 con 0x7f6978002860 2024-09-13T10:40:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.602 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 10 monclient(hunting): my global_id is 174298 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6998139050 con 0x7f6978002860 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3661997896 0 0) 0x7f6998139050 con 0x7f6978002860 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69780065c0 con 0x7f6978002860 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6988004e30 con 0x7f6978002860 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 10 monclient: dump: 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.603 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.604 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.604 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.604 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.604 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.604 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.604 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.604 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.604 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.604 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.604 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2611458649 0 0) 0x7f69780065c0 con 0x7f6978002860 2024-09-13T10:40:14.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f697800a160 con 0x7f6978002860 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f69880063d0 con 0x7f6978002860 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.181:6791/0 conn(0x7f6978002860 legacy=0x7f6978004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.582+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.181:6791/0 conn(0x7f6978002860 legacy=0x7f6978004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.588+0000 7f699df0e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.588+0000 7f699df0e640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6978009e50 con 0x7f6978009110 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.590+0000 7f69977fe640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.181:6791/0 conn(0x7f6978009110 legacy=0x7f69780095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 305364587 0 0) 0x7f6978009e50 con 0x7f6978009110 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 10 monclient(hunting): my global_id is 174307 2024-09-13T10:40:14.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69780065c0 con 0x7f6978009110 2024-09-13T10:40:14.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2745730949 0 0) 0x7f69780065c0 con 0x7f6978009110 2024-09-13T10:40:14.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6978009e50 con 0x7f6978009110 2024-09-13T10:40:14.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f69880053e0 con 0x7f6978009110 2024-09-13T10:40:14.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:14.606 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 10 monclient: dump: 2024-09-13T10:40:14.606 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.606 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.606 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.606 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.606 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3116176049 0 0) 0x7f6978009e50 con 0x7f6978009110 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f697800c3a0 con 0x7f6978009110 2024-09-13T10:40:14.607 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7526 (unknown 0 0 1677941869) 0x7f6988005810 con 0x7f6978009110 2024-09-13T10:40:14.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:14.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:14.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.181:6791/0 conn(0x7f6978009110 legacy=0x7f69780095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.591+0000 7f697ffff640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.181:6791/0 conn(0x7f6978009110 legacy=0x7f69780095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:14.608 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:14.608 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:14.608 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:14.608 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:14.608 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 144, 2024-09-13T10:40:14.609 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 27773, 2024-09-13T10:40:14.609 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:14.609 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:14.609 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:14.609 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:14.609 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:14.609 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:14.609 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:40:14.609 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.609 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:40:14.609 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:14.610 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:14.611 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.611 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:14.611 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:14.611 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:14.611 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:14.611 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:14.611 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:14.611 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:14.611 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:14.611 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:14.611 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:14.611 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:14.612 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:14.612 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:14.612 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.612 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:14.612 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:14.612 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:14.612 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:14.612 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:14.612 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:14.612 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:14.612 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:14.613 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.614 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.615 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.616 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.618 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.619 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.620 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.620 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:14.620 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:14.620 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.620 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.621 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.622 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.623 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.624 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.625 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.626 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.627 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:14.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.628 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:14.628 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:14.628 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:14.628 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.628 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.628 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:14.628 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:14.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.592+0000 7f699df0e640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6984040360 legacy=0x7f6984042820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.592+0000 7f699df0e640 10 monclient: shutdown 2024-09-13T10:40:14.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.592+0000 7f699df0e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:14.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.592+0000 7f699df0e640 1 -- 172.21.15.181:0/3763987011 >> v1:172.21.15.181:6792/0 conn(0x7f69980a6ab0 legacy=0x7f699813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.592+0000 7f6997fff640 1 -- 172.21.15.181:0/3763987011 reap_dead start 2024-09-13T10:40:14.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.592+0000 7f6997fff640 1 -- 172.21.15.181:0/3763987011 reap_dead start 2024-09-13T10:40:14.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.592+0000 7f699df0e640 1 -- 172.21.15.181:0/3763987011 shutdown_connections 2024-09-13T10:40:14.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.592+0000 7f699df0e640 1 -- 172.21.15.181:0/3763987011 >> 172.21.15.181:0/3763987011 conn(0x7f69980abcd0 msgr2=0x7f6998145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:14.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.592+0000 7f699df0e640 1 -- 172.21.15.181:0/3763987011 shutdown_connections 2024-09-13T10:40:14.630 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.592+0000 7f699df0e640 1 -- 172.21.15.181:0/3763987011 wait complete. 2024-09-13T10:40:14.630 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:40:14.631 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon d 2024-09-13T10:40:14.631 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:40:14.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.728+0000 7f673e507640 10 monclient: get_monmap_and_config 2024-09-13T10:40:14.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.728+0000 7f673e507640 10 monclient: build_initial_monmap 2024-09-13T10:40:14.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.728+0000 7f673e507640 10 monclient: monmap: 2024-09-13T10:40:14.730 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:14.730 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.730 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:14.729200+0000 2024-09-13T10:40:14.730 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:14.729200+0000 2024-09-13T10:40:14.730 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:14.731 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.731 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:14.731 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:14.731 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:14.731 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:14.731 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:14.731 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:14.731 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:14.731 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:14.731 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:14.731 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.729+0000 7f673e507640 1 Processor -- start 2024-09-13T10:40:14.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.729+0000 7f673e507640 1 -- start start 2024-09-13T10:40:14.735 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.729+0000 7f673e507640 10 monclient: init 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.729+0000 7f673e507640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.729+0000 7f673e507640 10 monclient: _add_conns ranks=[3,5,4,1,0,2,7,8,6] 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.730+0000 7f673e507640 10 monclient(hunting): picked mon.noname-g con 0x7f67380a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.730+0000 7f673e507640 10 monclient(hunting): picked mon.noname-h con 0x7f67380a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.730+0000 7f673e507640 10 monclient(hunting): picked mon.noname-c con 0x7f673813f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.730+0000 7f673e507640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67380a5fe0 con 0x7f67380a66d0 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.730+0000 7f673e507640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67380a8080 con 0x7f673813f9a0 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.730+0000 7f673e507640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67380a42c0 con 0x7f67380a6ab0 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.730+0000 7f673e507640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.730+0000 7f673e507640 10 monclient(hunting): authenticate will time out at 1354.235146s 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.730+0000 7f6737fff640 1 -- >> v1:172.21.15.195:6790/0 conn(0x7f67380a66d0 legacy=0x7f67380a53b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.730+0000 7f673caa4640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f673813f9a0 0x7f6738141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:43086/0 (socket says 172.21.15.181:43086) 2024-09-13T10:40:14.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.730+0000 7f673caa4640 1 -- 172.21.15.181:0/1050753276 learned_addr learned my addr 172.21.15.181:0/1050753276 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f673caa4640 1 -- 172.21.15.181:0/1050753276 >> v1:172.21.15.181:6791/0 conn(0x7f673813f9a0 legacy=0x7f6738141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 1 -- 172.21.15.181:0/1050753276 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 913834259 0 0) 0x7f67380a8080 con 0x7f673813f9a0 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f672ffff640 1 -- 172.21.15.181:0/1050753276 >> v1:172.21.15.195:6791/0 conn(0x7f67380a6ab0 legacy=0x7f67380a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient(hunting): my global_id is 174316 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 1 -- 172.21.15.181:0/1050753276 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6724003520 con 0x7f673813f9a0 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 1 -- 172.21.15.181:0/1050753276 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1076515443 0 0) 0x7f6724003520 con 0x7f673813f9a0 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 1 -- 172.21.15.181:0/1050753276 >> v1:172.21.15.195:6791/0 conn(0x7f67380a6ab0 legacy=0x7f67380a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 1 -- 172.21.15.181:0/1050753276 >> v1:172.21.15.195:6790/0 conn(0x7f67380a66d0 legacy=0x7f67380a53b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient: _finish_hunting 0 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 1 monclient: found mon.noname-c 2024-09-13T10:40:14.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 1 -- 172.21.15.181:0/1050753276 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67381464e0 con 0x7f673813f9a0 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient: _finish_auth 0 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient: _check_auth_tickets 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 1 -- 172.21.15.181:0/1050753276 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6730001f20 con 0x7f673813f9a0 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f673e507640 5 monclient: authenticate success, global_id 174316 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f673e507640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient: dump: 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.738 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.739 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f673e507640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 1 -- 172.21.15.181:0/1050753276 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6730004c20 con 0x7f673813f9a0 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f673e507640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 1 -- 172.21.15.181:0/1050753276 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6730005190 con 0x7f673813f9a0 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f673e507640 4 set_mon_vals no callback set 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.732+0000 7f67377fe640 10 monclient: dump: 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.740 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.733+0000 7f673e507640 10 monclient: shutdown 2024-09-13T10:40:14.741 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.733+0000 7f673e507640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.733+0000 7f673e507640 1 -- 172.21.15.181:0/1050753276 >> v1:172.21.15.181:6791/0 conn(0x7f673813f9a0 legacy=0x7f6738141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.733+0000 7f673e507640 1 -- 172.21.15.181:0/1050753276 shutdown_connections 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.733+0000 7f673e507640 1 -- 172.21.15.181:0/1050753276 >> 172.21.15.181:0/1050753276 conn(0x7f67380abcd0 msgr2=0x7f67380ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.733+0000 7f673e507640 1 -- 172.21.15.181:0/1050753276 shutdown_connections 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.733+0000 7f673e507640 1 -- 172.21.15.181:0/1050753276 wait complete. 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 10 monclient: build_initial_monmap 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 10 monclient: monmap: 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:14.742 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 1 Processor -- start 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 1 -- start start 2024-09-13T10:40:14.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 10 monclient: init 2024-09-13T10:40:14.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:14.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 10 monclient: _add_conns ranks=[4,2,6,0,1,7,8,3,5] 2024-09-13T10:40:14.748 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 10 monclient(hunting): picked mon.noname-c con 0x7f67380a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 10 monclient(hunting): picked mon.noname-b con 0x7f67380a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 10 monclient(hunting): picked mon.noname-d con 0x7f673813f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673813f2c0 con 0x7f67380a6ab0 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6738138f60 con 0x7f67380a66d0 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673813cf60 con 0x7f673813f9a0 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f673e507640 10 monclient(hunting): authenticate will time out at 1354.239874s 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f6737fff640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f67380a66d0 0x7f673813b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:43090/0 (socket says 172.21.15.181:43090) 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.734+0000 7f6737fff640 1 -- 172.21.15.181:0/843210989 learned_addr learned my addr 172.21.15.181:0/843210989 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f672ffff640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.181:6790/0 conn(0x7f67380a6ab0 legacy=0x7f673813be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f6737fff640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.181:6791/0 conn(0x7f67380a66d0 legacy=0x7f673813b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f673caa4640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.181:6792/0 conn(0x7f673813f9a0 legacy=0x7f67381d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3403471684 0 0) 0x7f6738138f60 con 0x7f67380a66d0 2024-09-13T10:40:14.749 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): my global_id is 174325 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6718003520 con 0x7f67380a66d0 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009675222 0 0) 0x7f673813f2c0 con 0x7f67380a6ab0 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): my global_id is 174314 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6738138f60 con 0x7f67380a6ab0 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1114074206 0 0) 0x7f673813cf60 con 0x7f673813f9a0 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): my global_id is 174300 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f673813f2c0 con 0x7f673813f9a0 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2304053663 0 0) 0x7f6718003520 con 0x7f67380a66d0 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f673813cf60 con 0x7f67380a66d0 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 781977539 0 0) 0x7f6738138f60 con 0x7f67380a6ab0 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6718003520 con 0x7f67380a6ab0 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6728004670 con 0x7f67380a66d0 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): dump: 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.751 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6720001ce0 con 0x7f67380a6ab0 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): dump: 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.753 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2635008709 0 0) 0x7f673813f2c0 con 0x7f673813f9a0 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6738138f60 con 0x7f673813f9a0 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6730001ee0 con 0x7f673813f9a0 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient(hunting): dump: 2024-09-13T10:40:14.754 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.755 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2272078481 0 0) 0x7f673813cf60 con 0x7f67380a66d0 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.181:6792/0 conn(0x7f673813f9a0 legacy=0x7f67381d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.181:6790/0 conn(0x7f67380a6ab0 legacy=0x7f673813be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient: _finish_hunting 0 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 monclient: found mon.c 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673813ea20 con 0x7f67380a66d0 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient: _finish_auth 0 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient: _check_auth_tickets 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:14.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f673e507640 5 monclient: authenticate success, global_id 174325 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f673e507640 10 monclient: _renew_subs 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f673e507640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f673e507640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f673813ed00 con 0x7f67380a66d0 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f673e507640 10 monclient: _renew_subs 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f673e507640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f673e507640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f67380a2910 con 0x7f67380a66d0 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6728004940 con 0x7f67380a66d0 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6728004eb0 con 0x7f67380a66d0 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f6736ffd640 4 set_mon_vals no callback set 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:14.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.737+0000 7f67357fa640 10 monclient: dump: 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.758 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.738+0000 7f673e507640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.738+0000 7f673e507640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f671c0065c0 con 0x7f671c002860 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.738+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6728005050 con 0x7f67380a66d0 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.738+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7f672804e280 con 0x7f67380a66d0 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.739+0000 7f673caa4640 10 monclient: get_auth_request con 0x7f67180404c0 auth_method 0 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.740+0000 7f672ffff640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.181:6792/0 conn(0x7f671c002860 legacy=0x7f671c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300940503 0 0) 0x7f671c0065c0 con 0x7f671c002860 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 10 monclient(hunting): my global_id is 174309 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f673813cf60 con 0x7f671c002860 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3620969806 0 0) 0x7f673813cf60 con 0x7f671c002860 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f671c0065c0 con 0x7f671c002860 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6720003ed0 con 0x7f671c002860 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 10 monclient: dump: 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.760 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 688125230 0 0) 0x7f671c0065c0 con 0x7f671c002860 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f671c00a160 con 0x7f671c002860 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f67200041b0 con 0x7f671c002860 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:14.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:14.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.181:6792/0 conn(0x7f671c002860 legacy=0x7f671c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.741+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.181:6792/0 conn(0x7f671c002860 legacy=0x7f671c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:14.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.747+0000 7f673e507640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:14.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.747+0000 7f673e507640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f671c009e50 con 0x7f671c009110 2024-09-13T10:40:14.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f672ffff640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.181:6792/0 conn(0x7f671c009110 legacy=0x7f671c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347272107 0 0) 0x7f671c009e50 con 0x7f671c009110 2024-09-13T10:40:14.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 10 monclient(hunting): my global_id is 174318 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f671c0065c0 con 0x7f671c009110 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2635993113 0 0) 0x7f671c0065c0 con 0x7f671c009110 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f671c009e50 con 0x7f671c009110 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6720004470 con 0x7f671c009110 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 10 monclient: dump: 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.764 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3841279858 0 0) 0x7f671c009e50 con 0x7f671c009110 2024-09-13T10:40:14.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.750+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f671c00c3f0 con 0x7f671c009110 2024-09-13T10:40:14.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7526 (unknown 0 0 2580924164) 0x7f6720005ee0 con 0x7f671c009110 2024-09-13T10:40:14.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f67357fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:14.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f67357fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:14.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.181:6792/0 conn(0x7f671c009110 legacy=0x7f671c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f67357fa640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.181:6792/0 conn(0x7f671c009110 legacy=0x7f671c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:14.766 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:14.766 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:14.766 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:14.766 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:14.766 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 144, 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 27932, 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:14.767 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:14.768 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.769 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:14.770 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:14.771 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:14.772 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.773 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:14.775 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:14.776 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.777 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:14.779 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.780 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.781 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:14.783 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.784 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.785 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:14.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.785 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:14.785 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:14.785 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:14.785 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.785 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.785 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:14.785 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:14.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f673e507640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.195:6800/1839191919 conn(0x7f67180404c0 legacy=0x7f6718042980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f673e507640 10 monclient: shutdown 2024-09-13T10:40:14.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f673e507640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:14.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f673e507640 1 -- 172.21.15.181:0/843210989 >> v1:172.21.15.181:6791/0 conn(0x7f67380a66d0 legacy=0x7f673813b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f673caa4640 1 -- 172.21.15.181:0/843210989 reap_dead start 2024-09-13T10:40:14.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f673caa4640 1 -- 172.21.15.181:0/843210989 reap_dead start 2024-09-13T10:40:14.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f673e507640 1 -- 172.21.15.181:0/843210989 shutdown_connections 2024-09-13T10:40:14.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f673e507640 1 -- 172.21.15.181:0/843210989 >> 172.21.15.181:0/843210989 conn(0x7f67380abcd0 msgr2=0x7f6738068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:14.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f673e507640 1 -- 172.21.15.181:0/843210989 shutdown_connections 2024-09-13T10:40:14.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.751+0000 7f673e507640 1 -- 172.21.15.181:0/843210989 wait complete. 2024-09-13T10:40:14.788 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:40:14.788 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon f 2024-09-13T10:40:14.788 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:40:14.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.885+0000 7f6307e86640 10 monclient: get_monmap_and_config 2024-09-13T10:40:14.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.885+0000 7f6307e86640 10 monclient: build_initial_monmap 2024-09-13T10:40:14.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.885+0000 7f6307e86640 10 monclient: monmap: 2024-09-13T10:40:14.887 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:14.886518+0000 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:14.886518+0000 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:14.888 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:14.889 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.886+0000 7f6307e86640 1 Processor -- start 2024-09-13T10:40:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.886+0000 7f6307e86640 1 -- start start 2024-09-13T10:40:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.886+0000 7f6307e86640 10 monclient: init 2024-09-13T10:40:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6307e86640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6307e86640 10 monclient: _add_conns ranks=[1,8,2,6,0,7,5,4,3] 2024-09-13T10:40:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6307e86640 10 monclient(hunting): picked mon.noname-f con 0x7f63000a6640 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6307e86640 10 monclient(hunting): picked mon.noname-e con 0x7f63000a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:14.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6307e86640 10 monclient(hunting): picked mon.noname-b con 0x7f630013f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6307e86640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63000a4bc0 con 0x7f63000a6640 2024-09-13T10:40:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6307e86640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f630013a320 con 0x7f630013f750 2024-09-13T10:40:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6307e86640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63000a8100 con 0x7f63000a8340 2024-09-13T10:40:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6307e86640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6307e86640 10 monclient(hunting): authenticate will time out at 1354.392272s 2024-09-13T10:40:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6305421640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7f63000a8340 legacy=0x7f6300139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6306423640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f630013f750 0x7f6300141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:39922/0 (socket says 172.21.15.181:39922) 2024-09-13T10:40:14.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.887+0000 7f6306423640 1 -- 172.21.15.181:0/1016056267 learned_addr learned my addr 172.21.15.181:0/1016056267 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:14.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6306423640 1 -- 172.21.15.181:0/1016056267 >> v1:172.21.15.181:6790/0 conn(0x7f630013f750 legacy=0x7f6300141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6305c22640 1 -- 172.21.15.181:0/1016056267 >> v1:172.21.15.195:6789/0 conn(0x7f63000a6640 legacy=0x7f6300139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 1 -- 172.21.15.181:0/1016056267 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755316203 0 0) 0x7f630013a320 con 0x7f630013f750 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 10 monclient(hunting): my global_id is 174323 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 1 -- 172.21.15.181:0/1016056267 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62ec003520 con 0x7f630013f750 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 1 -- 172.21.15.181:0/1016056267 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2067823358 0 0) 0x7f62ec003520 con 0x7f630013f750 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 1 -- 172.21.15.181:0/1016056267 >> v1:172.21.15.181:6793/0 conn(0x7f63000a8340 legacy=0x7f6300139c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 1 -- 172.21.15.181:0/1016056267 >> v1:172.21.15.195:6789/0 conn(0x7f63000a6640 legacy=0x7f6300139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 10 monclient: _finish_hunting 0 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 1 monclient: found mon.noname-b 2024-09-13T10:40:14.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:40:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 1 -- 172.21.15.181:0/1016056267 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63000a48e0 con 0x7f630013f750 2024-09-13T10:40:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 10 monclient: _finish_auth 0 2024-09-13T10:40:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 10 monclient: _check_auth_tickets 2024-09-13T10:40:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 1 -- 172.21.15.181:0/1016056267 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62f8001e60 con 0x7f630013f750 2024-09-13T10:40:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6307e86640 5 monclient: authenticate success, global_id 174323 2024-09-13T10:40:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6307e86640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:40:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6304c20640 10 monclient: dump: 2024-09-13T10:40:14.896 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.897 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.889+0000 7f6307e86640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6304c20640 1 -- 172.21.15.181:0/1016056267 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62f8004c20 con 0x7f630013f750 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6304c20640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6304c20640 1 -- 172.21.15.181:0/1016056267 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62f8005190 con 0x7f630013f750 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6307e86640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6307e86640 4 set_mon_vals no callback set 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6304c20640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6304c20640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6304c20640 10 monclient: dump: 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.898 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6307e86640 10 monclient: shutdown 2024-09-13T10:40:14.899 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6307e86640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6307e86640 1 -- 172.21.15.181:0/1016056267 >> v1:172.21.15.181:6790/0 conn(0x7f630013f750 legacy=0x7f6300141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6307e86640 1 -- 172.21.15.181:0/1016056267 shutdown_connections 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6307e86640 1 -- 172.21.15.181:0/1016056267 >> 172.21.15.181:0/1016056267 conn(0x7f6300077170 msgr2=0x7f63000abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6307e86640 1 -- 172.21.15.181:0/1016056267 shutdown_connections 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.890+0000 7f6307e86640 1 -- 172.21.15.181:0/1016056267 wait complete. 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 10 monclient: build_initial_monmap 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 10 monclient: monmap: 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:14.900 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 1 Processor -- start 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 1 -- start start 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 10 monclient: init 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:14.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 10 monclient: _add_conns ranks=[1,4,5,0,8,6,3,7,2] 2024-09-13T10:40:14.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 10 monclient(hunting): picked mon.noname-f con 0x7f63000a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:14.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 10 monclient(hunting): picked mon.noname-c con 0x7f630013f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:14.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 10 monclient(hunting): picked mon.noname-h con 0x7f63001d4310 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:14.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63000a10c0 con 0x7f63000a8340 2024-09-13T10:40:14.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63000a9bb0 con 0x7f630013f750 2024-09-13T10:40:14.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6300142d60 con 0x7f63001d4310 2024-09-13T10:40:14.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:14.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.891+0000 7f6307e86640 10 monclient(hunting): authenticate will time out at 1354.396926s 2024-09-13T10:40:14.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.892+0000 7f6305421640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f630013f750 0x7f630009d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:43100/0 (socket says 172.21.15.181:43100) 2024-09-13T10:40:14.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.892+0000 7f6305421640 1 -- 172.21.15.181:0/2516740280 learned_addr learned my addr 172.21.15.181:0/2516740280 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:14.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f6305421640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.181:6791/0 conn(0x7f630013f750 legacy=0x7f630009d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1836159136 0 0) 0x7f63000a9bb0 con 0x7f630013f750 2024-09-13T10:40:14.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): my global_id is 174334 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e4003520 con 0x7f630013f750 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f6306423640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.195:6791/0 conn(0x7f63001d4310 legacy=0x7f63001d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f6305c22640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.195:6789/0 conn(0x7f63000a8340 legacy=0x7f630009d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2598958585 0 0) 0x7f62e4003520 con 0x7f630013f750 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63000a9bb0 con 0x7f630013f750 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62f0004620 con 0x7f630013f750 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): dump: 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.907 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:14.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3389700420 0 0) 0x7f6300142d60 con 0x7f63001d4310 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): my global_id is 106016 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e4003520 con 0x7f63001d4310 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627842614 0 0) 0x7f63000a10c0 con 0x7f63000a8340 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient(hunting): my global_id is 135001 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6300142d60 con 0x7f63000a8340 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1118223512 0 0) 0x7f63000a9bb0 con 0x7f630013f750 2024-09-13T10:40:14.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.195:6791/0 conn(0x7f63001d4310 legacy=0x7f63001d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.195:6789/0 conn(0x7f63000a8340 legacy=0x7f630009d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:40:14.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 monclient: found mon.c 2024-09-13T10:40:14.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:14.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:14.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63000a0250 con 0x7f630013f750 2024-09-13T10:40:14.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient: _finish_auth 0 2024-09-13T10:40:14.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:40:14.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:14.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f6307e86640 5 monclient: authenticate success, global_id 174334 2024-09-13T10:40:14.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f6307e86640 10 monclient: _renew_subs 2024-09-13T10:40:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f6307e86640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f6307e86640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f630009ed60 con 0x7f630013f750 2024-09-13T10:40:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f6307e86640 10 monclient: _renew_subs 2024-09-13T10:40:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f6307e86640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f6307e86640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f63000a0de0 con 0x7f630013f750 2024-09-13T10:40:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62f0004930 con 0x7f630013f750 2024-09-13T10:40:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62f0004ea0 con 0x7f630013f750 2024-09-13T10:40:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:14.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f7fff640 4 set_mon_vals no callback set 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.894+0000 7f62f67fc640 10 monclient: dump: 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.912 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.895+0000 7f6307e86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.895+0000 7f6307e86640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f62e80065c0 con 0x7f62e8002860 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.895+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f62f0005040 con 0x7f630013f750 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.896+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7f62f004e200 con 0x7f630013f750 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.896+0000 7f6306423640 10 monclient: get_auth_request con 0x7f62e403fdd0 auth_method 0 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f6305c22640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.195:6789/0 conn(0x7f62e8002860 legacy=0x7f62e8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605770789 0 0) 0x7f62e80065c0 con 0x7f62e8002860 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 10 monclient(hunting): my global_id is 135010 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63000a9bb0 con 0x7f62e8002860 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2040718412 0 0) 0x7f63000a9bb0 con 0x7f62e8002860 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62e80065c0 con 0x7f62e8002860 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62fc001c20 con 0x7f62e8002860 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 10 monclient: dump: 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.914 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3713890121 0 0) 0x7f62e80065c0 con 0x7f62e8002860 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.898+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62e800a160 con 0x7f62e8002860 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.899+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f62fc0057c0 con 0x7f62e8002860 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.899+0000 7f62f67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:14.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.899+0000 7f62f67fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:14.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.899+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.195:6789/0 conn(0x7f62e8002860 legacy=0x7f62e8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.899+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.195:6789/0 conn(0x7f62e8002860 legacy=0x7f62e8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:14.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.905+0000 7f6307e86640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:14.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.905+0000 7f6307e86640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f62e8009e50 con 0x7f62e8009110 2024-09-13T10:40:14.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.907+0000 7f6305c22640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.195:6789/0 conn(0x7f62e8009110 legacy=0x7f62e80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:14.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705299198 0 0) 0x7f62e8009e50 con 0x7f62e8009110 2024-09-13T10:40:14.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:14.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:14.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:14.917 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 10 monclient(hunting): my global_id is 135019 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e80065c0 con 0x7f62e8009110 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 998508087 0 0) 0x7f62e80065c0 con 0x7f62e8009110 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62e8009e50 con 0x7f62e8009110 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f62fc003cc0 con 0x7f62e8009110 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 10 monclient: dump: 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:14.918 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:14.919 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:14.919 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 330326214 0 0) 0x7f62e8009e50 con 0x7f62e8009110 2024-09-13T10:40:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.908+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f62e800c3f0 con 0x7f62e8009110 2024-09-13T10:40:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7694 (unknown 0 0 3565044725) 0x7f62fc005a50 con 0x7f62e8009110 2024-09-13T10:40:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f62f67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f62f67fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.195:6789/0 conn(0x7f62e8009110 legacy=0x7f62e80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f62f67fc640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.195:6789/0 conn(0x7f62e8009110 legacy=0x7f62e80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:14.920 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:14.920 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 144, 2024-09-13T10:40:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 146936, 2024-09-13T10:40:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:14.921 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 0, 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:14.922 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:14.923 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:14.924 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:14.925 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:14.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:14.927 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.928 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:14.929 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.930 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.931 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:14.933 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.935 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.936 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:14.937 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:14.938 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.939 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:14.940 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f6307e86640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.195:6800/1839191919 conn(0x7f62e403fdd0 legacy=0x7f62e4042290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f6307e86640 10 monclient: shutdown 2024-09-13T10:40:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f6307e86640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f6307e86640 1 -- 172.21.15.181:0/2516740280 >> v1:172.21.15.181:6791/0 conn(0x7f630013f750 legacy=0x7f630009d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f6306423640 1 -- 172.21.15.181:0/2516740280 reap_dead start 2024-09-13T10:40:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f6306423640 1 -- 172.21.15.181:0/2516740280 reap_dead start 2024-09-13T10:40:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f6307e86640 1 -- 172.21.15.181:0/2516740280 shutdown_connections 2024-09-13T10:40:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f6307e86640 1 -- 172.21.15.181:0/2516740280 >> 172.21.15.181:0/2516740280 conn(0x7f63000a6640 msgr2=0x7f6300141e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:14.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f6307e86640 1 -- 172.21.15.181:0/2516740280 shutdown_connections 2024-09-13T10:40:14.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:14.909+0000 7f6307e86640 1 -- 172.21.15.181:0/2516740280 wait complete. 2024-09-13T10:40:14.943 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:40:14.943 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon h 2024-09-13T10:40:14.943 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:40:15.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.040+0000 7f7781439640 10 monclient: get_monmap_and_config 2024-09-13T10:40:15.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.040+0000 7f7781439640 10 monclient: build_initial_monmap 2024-09-13T10:40:15.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.040+0000 7f7781439640 10 monclient: monmap: 2024-09-13T10:40:15.041 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:15.041 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:15.040653+0000 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:15.040653+0000 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:15.042 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.040+0000 7f7781439640 1 Processor -- start 2024-09-13T10:40:15.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.040+0000 7f7781439640 1 -- start start 2024-09-13T10:40:15.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.040+0000 7f7781439640 10 monclient: init 2024-09-13T10:40:15.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f7781439640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:15.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f7781439640 10 monclient: _add_conns ranks=[4,3,6,2,1,0,8,7,5] 2024-09-13T10:40:15.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f7781439640 10 monclient(hunting): picked mon.noname-c con 0x7f777c0a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:15.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f7781439640 10 monclient(hunting): picked mon.noname-g con 0x7f777c0a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:15.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f7781439640 10 monclient(hunting): picked mon.noname-d con 0x7f777c13f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:15.044 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f7781439640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777c0a4bc0 con 0x7f777c0a8340 2024-09-13T10:40:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f7781439640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777c13a320 con 0x7f777c0a6640 2024-09-13T10:40:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f7781439640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777c0a8100 con 0x7f777c13f750 2024-09-13T10:40:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f7781439640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f7781439640 10 monclient(hunting): authenticate will time out at 1354.546197s 2024-09-13T10:40:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f777affd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f777c0a6640 0x7f777c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:43114/0 (socket says 172.21.15.181:43114) 2024-09-13T10:40:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f777affd640 1 -- 172.21.15.181:0/475177860 learned_addr learned my addr 172.21.15.181:0/475177860 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f777b7fe640 1 --1- 172.21.15.181:0/475177860 >> v1:172.21.15.181:6792/0 conn(0x7f777c13f750 0x7f777c141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:42746/0 (socket says 172.21.15.181:42746) 2024-09-13T10:40:15.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.041+0000 7f777a7fc640 1 -- 172.21.15.181:0/475177860 >> v1:172.21.15.195:6790/0 conn(0x7f777c0a8340 legacy=0x7f777c139c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.195:6790/0 2024-09-13T10:40:15.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f777affd640 1 -- 172.21.15.181:0/475177860 >> v1:172.21.15.181:6791/0 conn(0x7f777c0a6640 legacy=0x7f777c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:15.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f777b7fe640 1 -- 172.21.15.181:0/475177860 >> v1:172.21.15.181:6792/0 conn(0x7f777c13f750 legacy=0x7f777c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:15.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 1 -- 172.21.15.181:0/475177860 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921952509 0 0) 0x7f777c13a320 con 0x7f777c0a6640 2024-09-13T10:40:15.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:15.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:15.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:15.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient(hunting): my global_id is 174343 2024-09-13T10:40:15.049 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 1 -- 172.21.15.181:0/475177860 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7768003520 con 0x7f777c0a6640 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 1 -- 172.21.15.181:0/475177860 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2670563021 0 0) 0x7f777c0a8100 con 0x7f777c13f750 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient(hunting): my global_id is 174327 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 1 -- 172.21.15.181:0/475177860 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f777c13a320 con 0x7f777c13f750 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 1 -- 172.21.15.181:0/475177860 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3075216211 0 0) 0x7f777c13a320 con 0x7f777c13f750 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 1 -- 172.21.15.181:0/475177860 >> v1:172.21.15.181:6791/0 conn(0x7f777c0a6640 legacy=0x7f777c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 1 -- 172.21.15.181:0/475177860 >> v1:172.21.15.195:6790/0 conn(0x7f777c0a8340 legacy=0x7f777c139c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 1 monclient: found mon.noname-d 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:15.050 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 1 -- 172.21.15.181:0/475177860 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777c0a48e0 con 0x7f777c13f750 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient: _finish_auth 0 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 1 -- 172.21.15.181:0/475177860 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f776c0019f0 con 0x7f777c13f750 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7781439640 5 monclient: authenticate success, global_id 174327 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7781439640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient: dump: 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.051 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7781439640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:15.052 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 1 -- 172.21.15.181:0/475177860 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f776c001cc0 con 0x7f777c13f750 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7781439640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 1 -- 172.21.15.181:0/475177860 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f776c004b20 con 0x7f777c13f750 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7781439640 4 set_mon_vals no callback set 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.043+0000 7f7779ffb640 10 monclient: dump: 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.053 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.044+0000 7f7781439640 10 monclient: shutdown 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.044+0000 7f7781439640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.044+0000 7f7781439640 1 -- 172.21.15.181:0/475177860 >> v1:172.21.15.181:6792/0 conn(0x7f777c13f750 legacy=0x7f777c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.044+0000 7f7781439640 1 -- 172.21.15.181:0/475177860 shutdown_connections 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.044+0000 7f7781439640 1 -- 172.21.15.181:0/475177860 >> 172.21.15.181:0/475177860 conn(0x7f777c077170 msgr2=0x7f777c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:15.054 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.044+0000 7f7781439640 1 -- 172.21.15.181:0/475177860 shutdown_connections 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.044+0000 7f7781439640 1 -- 172.21.15.181:0/475177860 wait complete. 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.045+0000 7f7781439640 10 monclient: build_initial_monmap 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.045+0000 7f7781439640 10 monclient: monmap: 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:15.055 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.045+0000 7f7781439640 1 Processor -- start 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.045+0000 7f7781439640 1 -- start start 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.045+0000 7f7781439640 10 monclient: init 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f7781439640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f7781439640 10 monclient: _add_conns ranks=[0,2,4,6,8,1,3,5,7] 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f7781439640 10 monclient(hunting): picked mon.noname-a con 0x7f777c0a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f7781439640 10 monclient(hunting): picked mon.noname-b con 0x7f777c13f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:15.056 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f7781439640 10 monclient(hunting): picked mon.noname-c con 0x7f777c1d4730 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:15.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f7781439640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777c0a1000 con 0x7f777c0a8340 2024-09-13T10:40:15.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f7781439640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777c0a12e0 con 0x7f777c13f750 2024-09-13T10:40:15.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f7781439640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777c139310 con 0x7f777c1d4730 2024-09-13T10:40:15.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f7781439640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:15.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f777affd640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7f777c0a8340 legacy=0x7f777c1384f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:40:15.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f7781439640 10 monclient(hunting): authenticate will time out at 1354.551218s 2024-09-13T10:40:15.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f777a7fc640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f777c13f750 0x7f777c138c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:39936/0 (socket says 172.21.15.181:39936) 2024-09-13T10:40:15.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f777b7fe640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f777c1d4730 0x7f777c1d6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:43126/0 (socket says 172.21.15.181:43126) 2024-09-13T10:40:15.057 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.046+0000 7f777a7fc640 1 -- 172.21.15.181:0/2539135710 learned_addr learned my addr 172.21.15.181:0/2539135710 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:15.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.048+0000 7f777a7fc640 1 -- 172.21.15.181:0/2539135710 >> v1:172.21.15.181:6790/0 conn(0x7f777c13f750 legacy=0x7f777c138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:15.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.048+0000 7f777b7fe640 1 -- 172.21.15.181:0/2539135710 >> v1:172.21.15.181:6791/0 conn(0x7f777c1d4730 legacy=0x7f777c1d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:15.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 134833546 0 0) 0x7f777c139310 con 0x7f777c1d4730 2024-09-13T10:40:15.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:15.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:15.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:15.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient(hunting): my global_id is 174352 2024-09-13T10:40:15.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f775c003550 con 0x7f777c1d4730 2024-09-13T10:40:15.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1691043049 0 0) 0x7f775c003550 con 0x7f777c1d4730 2024-09-13T10:40:15.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f777c139310 con 0x7f777c1d4730 2024-09-13T10:40:15.060 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f776c004b20 con 0x7f777c1d4730 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient(hunting): dump: 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:15.061 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1650210634 0 0) 0x7f777c139310 con 0x7f777c1d4730 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 >> v1:172.21.15.181:6790/0 conn(0x7f777c13f750 legacy=0x7f777c138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 >> v1:172.21.15.181:6789/0 conn(0x7f777c0a8340 legacy=0x7f777c1384f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient: _finish_hunting 0 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 1 monclient: found mon.c 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:15.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777c09fdc0 con 0x7f777c1d4730 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient: _finish_auth 0 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient: _check_auth_tickets 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f7781439640 5 monclient: authenticate success, global_id 174352 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f7781439640 10 monclient: _renew_subs 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f7781439640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f7781439640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f777c0a9b40 con 0x7f777c1d4730 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f7781439640 10 monclient: _renew_subs 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f7781439640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f7781439640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f777c0a1d50 con 0x7f777c1d4730 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f776c004f70 con 0x7f777c1d4730 2024-09-13T10:40:15.063 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f776c005460 con 0x7f777c1d4730 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77797fa640 4 set_mon_vals no callback set 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.049+0000 7f77737fe640 10 monclient: dump: 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:15.064 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.050+0000 7f7781439640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.050+0000 7f7781439640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f77600065c0 con 0x7f7760002860 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.050+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f776c011ae0 con 0x7f777c1d4730 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.051+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(314..314 src has 1..314) ==== 3506+0+0 (unknown 1387312133 0 0) 0x7f776c04dfa0 con 0x7f777c1d4730 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.051+0000 7f777a7fc640 10 monclient: get_auth_request con 0x7f775c03faa0 auth_method 0 2024-09-13T10:40:15.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.053+0000 7f777affd640 1 -- 172.21.15.181:0/2539135710 >> v1:172.21.15.195:6791/0 conn(0x7f7760002860 legacy=0x7f7760004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:15.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.060+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 740122094 0 0) 0x7f77600065c0 con 0x7f7760002860 2024-09-13T10:40:15.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.060+0000 7f77737fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:15.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.060+0000 7f77737fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:15.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.060+0000 7f77737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:15.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.060+0000 7f77737fe640 10 monclient(hunting): my global_id is 106025 2024-09-13T10:40:15.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.060+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f777c139310 con 0x7f7760002860 2024-09-13T10:40:15.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.060+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1429800819 0 0) 0x7f777c139310 con 0x7f7760002860 2024-09-13T10:40:15.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.060+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77600065c0 con 0x7f7760002860 2024-09-13T10:40:15.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.060+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7774001d90 con 0x7f7760002860 2024-09-13T10:40:15.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.060+0000 7f77737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:15.067 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.060+0000 7f77737fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.060+0000 7f77737fe640 10 monclient: dump: 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:15.068 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:15.069 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:15.069 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:15.069 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:15.069 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.061+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3433902023 0 0) 0x7f77600065c0 con 0x7f7760002860 2024-09-13T10:40:15.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.061+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f776000a160 con 0x7f7760002860 2024-09-13T10:40:15.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.061+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7774001d10 con 0x7f7760002860 2024-09-13T10:40:15.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.061+0000 7f77737fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:15.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.061+0000 7f77737fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:15.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.061+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 >> v1:172.21.15.195:6791/0 conn(0x7f7760002860 legacy=0x7f7760004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.069 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.061+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 >> v1:172.21.15.195:6791/0 conn(0x7f7760002860 legacy=0x7f7760004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:15.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.067+0000 7f7781439640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:15.070 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.068+0000 7f7781439640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7760009e50 con 0x7f7760009110 2024-09-13T10:40:15.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f777affd640 1 -- 172.21.15.181:0/2539135710 >> v1:172.21.15.195:6791/0 conn(0x7f7760009110 legacy=0x7f77600095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:15.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 783410788 0 0) 0x7f7760009e50 con 0x7f7760009110 2024-09-13T10:40:15.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:15.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:15.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:15.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 10 monclient(hunting): my global_id is 106034 2024-09-13T10:40:15.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77600065c0 con 0x7f7760009110 2024-09-13T10:40:15.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1536353901 0 0) 0x7f77600065c0 con 0x7f7760009110 2024-09-13T10:40:15.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7760009e50 con 0x7f7760009110 2024-09-13T10:40:15.072 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7774005530 con 0x7f7760009110 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 10 monclient: dump: 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:15.073 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:15.074 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:15.074 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:15.074 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:15.074 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:15.074 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4219438817 0 0) 0x7f7760009e50 con 0x7f7760009110 2024-09-13T10:40:15.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.070+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f776000c3f0 con 0x7f7760009110 2024-09-13T10:40:15.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7694 (unknown 0 0 1431165429) 0x7f77740077d0 con 0x7f7760009110 2024-09-13T10:40:15.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f77737fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:15.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f77737fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:15.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 >> v1:172.21.15.195:6791/0 conn(0x7f7760009110 legacy=0x7f77600095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f77737fe640 1 -- 172.21.15.181:0/2539135710 >> v1:172.21.15.195:6791/0 conn(0x7f7760009110 legacy=0x7f77600095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:15.075 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 144, 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 298769, 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:15.095 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f7781439640 1 -- 172.21.15.181:0/2539135710 >> v1:172.21.15.195:6800/1839191919 conn(0x7f775c03faa0 legacy=0x7f775c041f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f7781439640 10 monclient: shutdown 2024-09-13T10:40:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f7781439640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f7781439640 1 -- 172.21.15.181:0/2539135710 >> v1:172.21.15.181:6791/0 conn(0x7f777c1d4730 legacy=0x7f777c1d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f777b7fe640 1 -- 172.21.15.181:0/2539135710 reap_dead start 2024-09-13T10:40:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f777b7fe640 1 -- 172.21.15.181:0/2539135710 reap_dead start 2024-09-13T10:40:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f7781439640 1 -- 172.21.15.181:0/2539135710 shutdown_connections 2024-09-13T10:40:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f7781439640 1 -- 172.21.15.181:0/2539135710 >> 172.21.15.181:0/2539135710 conn(0x7f777c0a6640 msgr2=0x7f777c141ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f7781439640 1 -- 172.21.15.181:0/2539135710 shutdown_connections 2024-09-13T10:40:15.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.071+0000 7f7781439640 1 -- 172.21.15.181:0/2539135710 wait complete. 2024-09-13T10:40:15.097 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:40:15.097 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon i 2024-09-13T10:40:15.097 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:40:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.194+0000 7fe8723ec640 10 monclient: get_monmap_and_config 2024-09-13T10:40:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.194+0000 7fe8723ec640 10 monclient: build_initial_monmap 2024-09-13T10:40:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.194+0000 7fe8723ec640 10 monclient: monmap: 2024-09-13T10:40:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:15.195 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:15.194700+0000 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:15.194700+0000 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:15.196 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:15.197 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.194+0000 7fe8723ec640 1 Processor -- start 2024-09-13T10:40:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe8723ec640 1 -- start start 2024-09-13T10:40:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe8723ec640 10 monclient: init 2024-09-13T10:40:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe8723ec640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe8723ec640 10 monclient: _add_conns ranks=[8,1,0,5,4,2,6,3,7] 2024-09-13T10:40:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe8723ec640 10 monclient(hunting): picked mon.noname-e con 0x7fe86c0a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe8723ec640 10 monclient(hunting): picked mon.noname-f con 0x7fe86c0a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe8723ec640 10 monclient(hunting): picked mon.noname-a con 0x7fe86c13f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe8723ec640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c0a5fe0 con 0x7fe86c13f9a0 2024-09-13T10:40:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe8723ec640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c0a8080 con 0x7fe86c0a6ab0 2024-09-13T10:40:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe8723ec640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c0a42c0 con 0x7fe86c0a66d0 2024-09-13T10:40:15.198 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe8723ec640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:15.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe8723ec640 10 monclient(hunting): authenticate will time out at 1354.700579s 2024-09-13T10:40:15.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe870989640 1 -- >> v1:172.21.15.181:6789/0 conn(0x7fe86c13f9a0 legacy=0x7fe86c141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6789/0 2024-09-13T10:40:15.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe86bfff640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7fe86c0a66d0 legacy=0x7fe86c0a53b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:15.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe863fff640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe86c0a6ab0 0x7fe86c0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:37014/0 (socket says 172.21.15.181:37014) 2024-09-13T10:40:15.199 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.195+0000 7fe863fff640 1 -- 172.21.15.181:0/841005160 learned_addr learned my addr 172.21.15.181:0/841005160 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe863fff640 1 -- 172.21.15.181:0/841005160 >> v1:172.21.15.195:6789/0 conn(0x7fe86c0a6ab0 legacy=0x7fe86c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 1 -- 172.21.15.181:0/841005160 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910727123 0 0) 0x7fe86c0a8080 con 0x7fe86c0a6ab0 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient(hunting): my global_id is 135028 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 1 -- 172.21.15.181:0/841005160 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe858003520 con 0x7fe86c0a6ab0 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 1 -- 172.21.15.181:0/841005160 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2803146269 0 0) 0x7fe858003520 con 0x7fe86c0a6ab0 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 1 -- 172.21.15.181:0/841005160 >> v1:172.21.15.181:6793/0 conn(0x7fe86c0a66d0 legacy=0x7fe86c0a53b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 1 -- 172.21.15.181:0/841005160 >> v1:172.21.15.181:6789/0 conn(0x7fe86c13f9a0 legacy=0x7fe86c141d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 1 monclient: found mon.noname-f 2024-09-13T10:40:15.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 1 -- 172.21.15.181:0/841005160 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c1464e0 con 0x7fe86c0a6ab0 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 1 -- 172.21.15.181:0/841005160 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe854001ba0 con 0x7fe86c0a6ab0 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe8723ec640 5 monclient: authenticate success, global_id 135028 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe8723ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient: dump: 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:15.204 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:15.205 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe8723ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 1 -- 172.21.15.181:0/841005160 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8540048a0 con 0x7fe86c0a6ab0 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe8723ec640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe8723ec640 4 set_mon_vals no callback set 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 1 -- 172.21.15.181:0/841005160 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe854004ed0 con 0x7fe86c0a6ab0 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.198+0000 7fe86b7fe640 10 monclient: dump: 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:15.206 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.199+0000 7fe8723ec640 10 monclient: shutdown 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.199+0000 7fe8723ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.199+0000 7fe8723ec640 1 -- 172.21.15.181:0/841005160 >> v1:172.21.15.195:6789/0 conn(0x7fe86c0a6ab0 legacy=0x7fe86c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.199+0000 7fe8723ec640 1 -- 172.21.15.181:0/841005160 shutdown_connections 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.199+0000 7fe8723ec640 1 -- 172.21.15.181:0/841005160 >> 172.21.15.181:0/841005160 conn(0x7fe86c0abcd0 msgr2=0x7fe86c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.199+0000 7fe8723ec640 1 -- 172.21.15.181:0/841005160 shutdown_connections 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.199+0000 7fe8723ec640 1 -- 172.21.15.181:0/841005160 wait complete. 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.199+0000 7fe8723ec640 10 monclient: build_initial_monmap 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.199+0000 7fe8723ec640 10 monclient: monmap: 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:15.208 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 1 Processor -- start 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 1 -- start start 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 10 monclient: init 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 10 monclient: _add_conns ranks=[8,7,1,3,5,2,0,6,4] 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 10 monclient(hunting): picked mon.noname-e con 0x7fe86c0a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 10 monclient(hunting): picked mon.noname-i con 0x7fe86c0a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:15.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 10 monclient(hunting): picked mon.noname-f con 0x7fe86c13f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c138eb0 con 0x7fe86c13f9a0 2024-09-13T10:40:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c142e40 con 0x7fe86c0a6ab0 2024-09-13T10:40:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c13f420 con 0x7fe86c0a66d0 2024-09-13T10:40:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe86bfff640 1 -- >> v1:172.21.15.181:6793/0 conn(0x7fe86c0a66d0 legacy=0x7fe86c13bb90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.181:6793/0 2024-09-13T10:40:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.200+0000 7fe8723ec640 10 monclient(hunting): authenticate will time out at 1354.705854s 2024-09-13T10:40:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.201+0000 7fe870989640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe86c13f9a0 0x7fe86c13c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:37028/0 (socket says 172.21.15.181:37028) 2024-09-13T10:40:15.210 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.201+0000 7fe870989640 1 -- 172.21.15.181:0/1337172584 learned_addr learned my addr 172.21.15.181:0/1337172584 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:15.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe870989640 1 -- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6789/0 conn(0x7fe86c13f9a0 legacy=0x7fe86c13c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:15.214 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe863fff640 1 -- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6792/0 conn(0x7fe86c0a6ab0 legacy=0x7fe86c13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe863fff640 1 --1- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6792/0 conn(0x7fe86c0a6ab0 0x7fe86c13c2a0 :-1 s=OPENED pgs=971 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fe86c142e40 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1658544309 0 0) 0x7fe86c138eb0 con 0x7fe86c13f9a0 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe8697fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe8697fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe8697fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe8697fa640 10 monclient(hunting): my global_id is 135037 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe84c003550 con 0x7fe86c13f9a0 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 103132283 0 0) 0x7fe84c003550 con 0x7fe86c13f9a0 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe86c138eb0 con 0x7fe86c13f9a0 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe864004940 con 0x7fe86c13f9a0 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.203+0000 7fe8697fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:40:15.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 10 monclient(hunting): dump: 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:15.216 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 284971209 0 0) 0x7fe86c138eb0 con 0x7fe86c13f9a0 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 >> v1:172.21.15.181:6793/0 conn(0x7fe86c0a66d0 legacy=0x7fe86c13bb90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6792/0 conn(0x7fe86c0a6ab0 legacy=0x7fe86c13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 10 monclient: _finish_hunting 0 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 1 monclient: found mon.f 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c09cb60 con 0x7fe86c13f9a0 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 10 monclient: _finish_auth 0 2024-09-13T10:40:15.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 10 monclient: _check_auth_tickets 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 93596779 0 0) 0x7fe86c142e40 con 0x7fe86c0a6ab0 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8723ec640 5 monclient: authenticate success, global_id 135037 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8723ec640 10 monclient: _renew_subs 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8723ec640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8723ec640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c0a29d0 con 0x7fe86c13f9a0 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8723ec640 10 monclient: _renew_subs 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8723ec640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.195:6789/0 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8723ec640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe86c1d7630 con 0x7fe86c13f9a0 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.1 v1:172.21.15.195:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe864004b60 con 0x7fe86c13f9a0 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.1 v1:172.21.15.195:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe8640050d0 con 0x7fe86c13f9a0 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:15.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe86affd640 4 set_mon_vals no callback set 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.204+0000 7fe8697fa640 10 monclient: dump: 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:15.219 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.205+0000 7fe8723ec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.205+0000 7fe8723ec640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe8500065c0 con 0x7fe850002860 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.205+0000 7fe870989640 1 --1- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6789/0 conn(0x7fe86c13f9a0 0x7fe86c13c9b0 :-1 s=OPENED pgs=830 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fe864005320 mgrmap(e 5) 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.205+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.1 v1:172.21.15.195:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe864005320 con 0x7fe86c13f9a0 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.205+0000 7fe863fff640 10 monclient: get_auth_request con 0x7fe84c03f9f0 auth_method 0 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe86bfff640 1 -- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6792/0 conn(0x7fe850002860 legacy=0x7fe850004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785933462 0 0) 0x7fe8500065c0 con 0x7fe850002860 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:15.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 10 monclient(hunting): my global_id is 58030 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe86c142e40 con 0x7fe850002860 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1926794699 0 0) 0x7fe86c142e40 con 0x7fe850002860 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8500065c0 con 0x7fe850002860 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe85c0043e0 con 0x7fe850002860 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 10 monclient: dump: 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.221 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1718144393 0 0) 0x7fe8500065c0 con 0x7fe850002860 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.207+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe85000a160 con 0x7fe850002860 2024-09-13T10:40:15.222 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.208+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe85c0066a0 con 0x7fe850002860 2024-09-13T10:40:15.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.208+0000 7fe8697fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:15.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.208+0000 7fe8697fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:15.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.208+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6792/0 conn(0x7fe850002860 legacy=0x7fe850004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.208+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6792/0 conn(0x7fe850002860 legacy=0x7fe850004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.214+0000 7fe8723ec640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.214+0000 7fe8723ec640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe850009e70 con 0x7fe850009130 2024-09-13T10:40:15.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe86bfff640 1 -- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6792/0 conn(0x7fe850009130 legacy=0x7fe8500095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 107790264 0 0) 0x7fe850009e70 con 0x7fe850009130 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 10 monclient(hunting): my global_id is 58039 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8500065c0 con 0x7fe850009130 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 251305729 0 0) 0x7fe8500065c0 con 0x7fe850009130 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe850009e70 con 0x7fe850009130 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe85c005e90 con 0x7fe850009130 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 10 monclient: dump: 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:15.225 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:15.226 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:15.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3005176389 0 0) 0x7fe850009e70 con 0x7fe850009130 2024-09-13T10:40:15.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.217+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe85000c410 con 0x7fe850009130 2024-09-13T10:40:15.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7863 (unknown 0 0 4115443602) 0x7fe85c006130 con 0x7fe850009130 2024-09-13T10:40:15.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8697fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:15.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8697fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:15.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6792/0 conn(0x7fe850009130 legacy=0x7fe8500095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6792/0 conn(0x7fe850009130 legacy=0x7fe8500095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:15.227 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 144, 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 629638, 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: 7 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:40:15.228 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:15.229 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:15.230 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:15.231 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:15.232 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.233 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:15.235 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.236 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.237 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:15.239 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.240 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.242 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.243 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:15.245 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:15.246 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 4 2024-09-13T10:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:15.247 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:15.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8723ec640 1 -- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6800/1839191919 conn(0x7fe84c03f9f0 legacy=0x7fe84c041eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8723ec640 10 monclient: shutdown 2024-09-13T10:40:15.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8723ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:15.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8723ec640 1 -- 172.21.15.181:0/1337172584 >> v1:172.21.15.195:6789/0 conn(0x7fe86c13f9a0 legacy=0x7fe86c13c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:15.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe870989640 1 -- 172.21.15.181:0/1337172584 reap_dead start 2024-09-13T10:40:15.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe870989640 1 -- 172.21.15.181:0/1337172584 reap_dead start 2024-09-13T10:40:15.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8697fa640 1 -- 172.21.15.181:0/1337172584 <== mon.1 v1:172.21.15.195:6789/0 8 ==== osd_map(315..315 src has 1..315) ==== 3898+0+0 (unknown 1086757166 0 0) 0x7fe86404e6d0 con 0x7fe86c13f9a0 2024-09-13T10:40:15.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8723ec640 1 -- 172.21.15.181:0/1337172584 shutdown_connections 2024-09-13T10:40:15.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8723ec640 1 -- 172.21.15.181:0/1337172584 >> 172.21.15.181:0/1337172584 conn(0x7fe86c0abcd0 msgr2=0x7fe86c0a8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:15.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8723ec640 1 -- 172.21.15.181:0/1337172584 shutdown_connections 2024-09-13T10:40:15.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:15.218+0000 7fe8723ec640 1 -- 172.21.15.181:0/1337172584 wait complete. 2024-09-13T10:40:15.250 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2024-09-13T10:40:15.250 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T10:40:16.170 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:16.171 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40954]: starting. 2024-09-13T10:40:16.171 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40954]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-40917 2024-09-13T10:40:16.171 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40954]: created object 0... 2024-09-13T10:40:16.171 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40954]: created object 25... 2024-09-13T10:40:16.171 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40954]: created object 49... 2024-09-13T10:40:16.171 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40954]: finishing. 2024-09-13T10:40:16.171 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[40954]: shutting down. 2024-09-13T10:40:16.208 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:16.208 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40956]: starting. 2024-09-13T10:40:16.208 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40956]: listing objects. 2024-09-13T10:40:16.208 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40956]: listed object 0... 2024-09-13T10:40:16.208 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40956]: listed object 25... 2024-09-13T10:40:16.209 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40956]: saw 50 objects 2024-09-13T10:40:16.209 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[40956]: shutting down. 2024-09-13T10:40:17.290 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:17.290 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40955]: starting. 2024-09-13T10:40:17.290 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40955]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-40917 2024-09-13T10:40:17.290 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[40955]: shutting down. 2024-09-13T10:40:17.292 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:17.292 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:17.292 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:40:17.295 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:40:19.957 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41028]: starting. 2024-09-13T10:40:19.958 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41028]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-41027 2024-09-13T10:40:19.958 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41028]: created object 0... 2024-09-13T10:40:19.958 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41028]: created object 25... 2024-09-13T10:40:19.958 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41028]: created object 49... 2024-09-13T10:40:19.958 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41028]: finishing. 2024-09-13T10:40:19.958 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41028]: shutting down. 2024-09-13T10:40:20.860 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[41029]: starting. 2024-09-13T10:40:20.860 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[41029]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-41027 2024-09-13T10:40:20.860 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[41029]: shutting down. 2024-09-13T10:40:23.567 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:23.567 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41065]: starting. 2024-09-13T10:40:23.567 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41065]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-41027 2024-09-13T10:40:23.568 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41065]: created object 0... 2024-09-13T10:40:23.568 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41065]: created object 25... 2024-09-13T10:40:23.568 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41065]: created object 49... 2024-09-13T10:40:23.568 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41065]: finishing. 2024-09-13T10:40:23.568 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41065]: shutting down. 2024-09-13T10:40:23.604 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:23.605 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[41067]: starting. 2024-09-13T10:40:23.605 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[41067]: listing objects. 2024-09-13T10:40:23.605 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[41067]: listed object 0... 2024-09-13T10:40:23.605 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[41067]: listed object 25... 2024-09-13T10:40:23.605 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[41067]: saw 50 objects 2024-09-13T10:40:23.605 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[41067]: shutting down. 2024-09-13T10:40:24.460 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:24.461 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[41066]: starting. 2024-09-13T10:40:24.461 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[41066]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-41027 2024-09-13T10:40:24.461 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[41066]: shutting down. 2024-09-13T10:40:24.462 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:24.462 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:24.462 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:40:24.465 DEBUG:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-13T10:40:26.590 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41136]: starting. 2024-09-13T10:40:26.590 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41136]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-41135 2024-09-13T10:40:26.590 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41136]: created object 0... 2024-09-13T10:40:26.590 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41136]: created object 25... 2024-09-13T10:40:26.591 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41136]: created object 49... 2024-09-13T10:40:26.591 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41136]: finishing. 2024-09-13T10:40:26.591 INFO:teuthology.orchestra.run.smithi195.stdout:process_1_[41136]: shutting down. 2024-09-13T10:40:27.497 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[41137]: starting. 2024-09-13T10:40:27.497 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[41137]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-41135 2024-09-13T10:40:27.497 INFO:teuthology.orchestra.run.smithi195.stdout:process_2_[41137]: shutting down. 2024-09-13T10:40:29.592 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:29.592 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41172]: starting. 2024-09-13T10:40:29.592 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41172]: creating pool ceph_test_rados_delete_pools_parallel.smithi195-41135 2024-09-13T10:40:29.592 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41172]: created object 0... 2024-09-13T10:40:29.592 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41172]: created object 25... 2024-09-13T10:40:29.592 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41172]: created object 49... 2024-09-13T10:40:29.592 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41172]: finishing. 2024-09-13T10:40:29.592 INFO:teuthology.orchestra.run.smithi195.stdout:process_3_[41172]: shutting down. 2024-09-13T10:40:29.629 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:29.629 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[41174]: starting. 2024-09-13T10:40:29.629 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[41174]: listing objects. 2024-09-13T10:40:29.629 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[41174]: listed object 0... 2024-09-13T10:40:29.629 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[41174]: listed object 25... 2024-09-13T10:40:29.629 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[41174]: saw 50 objects 2024-09-13T10:40:29.630 INFO:teuthology.orchestra.run.smithi195.stdout:process_5_[41174]: shutting down. 2024-09-13T10:40:30.503 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:30.503 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[41173]: starting. 2024-09-13T10:40:30.503 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[41173]: deleting pool ceph_test_rados_delete_pools_parallel.smithi195-41135 2024-09-13T10:40:30.503 INFO:teuthology.orchestra.run.smithi195.stdout:process_4_[41173]: shutting down. 2024-09-13T10:40:30.504 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:30.504 INFO:teuthology.orchestra.run.smithi195.stdout:******************************* 2024-09-13T10:40:30.504 INFO:teuthology.orchestra.run.smithi195.stdout:******* SUCCESS ********** 2024-09-13T10:40:30.507 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-09-13T10:40:30.516 INFO:tasks.mon_thrash:joining mon_thrasher 2024-09-13T10:40:35.251 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-13T10:40:35.251 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T10:40:35.251 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T10:40:35.254 INFO:tasks.ceph.mon.a:Started 2024-09-13T10:40:35.254 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2024-09-13T10:40:35.254 INFO:tasks.ceph.mon.g:Restarting daemon 2024-09-13T10:40:35.254 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-09-13T10:40:35.257 INFO:tasks.ceph.mon.g:Started 2024-09-13T10:40:35.257 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-09-13T10:40:35.257 INFO:tasks.ceph.mon.e:Restarting daemon 2024-09-13T10:40:35.257 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-09-13T10:40:35.259 INFO:tasks.ceph.mon.e:Started 2024-09-13T10:40:35.260 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:40:35.260 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:40:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.371+0000 7f20f3af7640 10 monclient: get_monmap_and_config 2024-09-13T10:40:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.371+0000 7f20f3af7640 10 monclient: build_initial_monmap 2024-09-13T10:40:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.371+0000 7f20f3af7640 10 monclient: monmap: 2024-09-13T10:40:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:35.372515+0000 2024-09-13T10:40:35.373 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:35.372515+0000 2024-09-13T10:40:35.374 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:35.374 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:35.374 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:35.374 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:35.374 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:35.374 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:35.374 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:35.374 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:35.374 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:35.374 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:35.374 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:35.374 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:35.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.372+0000 7f20f3af7640 1 Processor -- start 2024-09-13T10:40:35.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.372+0000 7f20f3af7640 1 -- start start 2024-09-13T10:40:35.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.372+0000 7f20f3af7640 10 monclient: init 2024-09-13T10:40:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.373+0000 7f20f3af7640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.373+0000 7f20f3af7640 10 monclient: _add_conns ranks=[6,0,4,2,1,7,3,8,5] 2024-09-13T10:40:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.373+0000 7f20f3af7640 10 monclient(hunting): picked mon.noname-d con 0x7f20ec0a6640 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.373+0000 7f20f3af7640 10 monclient(hunting): picked mon.noname-a con 0x7f20ec0a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.373+0000 7f20f3af7640 10 monclient(hunting): picked mon.noname-c con 0x7f20ec13f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.373+0000 7f20f3af7640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ec0a4bc0 con 0x7f20ec0a8340 2024-09-13T10:40:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.373+0000 7f20f3af7640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ec13a320 con 0x7f20ec13f750 2024-09-13T10:40:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.373+0000 7f20f3af7640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ec0a8100 con 0x7f20ec0a6640 2024-09-13T10:40:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.373+0000 7f20f3af7640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.373+0000 7f20f3af7640 10 monclient(hunting): authenticate will time out at 1374.878587s 2024-09-13T10:40:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.373+0000 7f20f1092640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f20ec0a8340 0x7f20ec139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49474/0 (socket says 172.21.15.181:49474) 2024-09-13T10:40:35.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.373+0000 7f20f1092640 1 -- 172.21.15.181:0/3946192130 learned_addr learned my addr 172.21.15.181:0/3946192130 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:35.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.375+0000 7f20f1092640 1 -- 172.21.15.181:0/3946192130 >> v1:172.21.15.181:6789/0 conn(0x7f20ec0a8340 legacy=0x7f20ec139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:35.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.376+0000 7f20f1893640 1 -- 172.21.15.181:0/3946192130 >> v1:172.21.15.181:6792/0 conn(0x7f20ec0a6640 legacy=0x7f20ec139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:35.382 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:35.381+0000 7f20f2094640 1 -- 172.21.15.181:0/3946192130 >> v1:172.21.15.181:6791/0 conn(0x7f20ec13f750 legacy=0x7f20ec141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 10 monclient(hunting): tick 2024-09-13T10:40:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 10 monclient(hunting): _check_auth_tickets 2024-09-13T10:40:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 1 monclient(hunting): continuing hunt 2024-09-13T10:40:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 10 monclient(hunting): _reopen_session rank -1 2024-09-13T10:40:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 1 -- 172.21.15.181:0/3946192130 >> v1:172.21.15.181:6792/0 conn(0x7f20ec0a6640 legacy=0x7f20ec139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 1 -- 172.21.15.181:0/3946192130 >> v1:172.21.15.181:6791/0 conn(0x7f20ec13f750 legacy=0x7f20ec141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:38.375 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 1 -- 172.21.15.181:0/3946192130 >> v1:172.21.15.181:6789/0 conn(0x7f20ec0a8340 legacy=0x7f20ec139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:38.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 10 monclient: _add_conns ranks=[8,2,1,3,5,7] 2024-09-13T10:40:38.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 10 monclient(hunting): picked mon.noname-e con 0x7f20d0003960 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:38.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 10 monclient(hunting): picked mon.noname-b con 0x7f20d00075f0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:38.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 10 monclient(hunting): picked mon.noname-f con 0x7f20d000b360 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:38.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 1 -- 172.21.15.181:0/3946192130 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ec0a48e0 con 0x7f20d000b360 2024-09-13T10:40:38.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 1 -- 172.21.15.181:0/3946192130 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d0010160 con 0x7f20d00075f0 2024-09-13T10:40:38.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 1 -- 172.21.15.181:0/3946192130 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d0011400 con 0x7f20d0003960 2024-09-13T10:40:38.376 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.373+0000 7f20e37fe640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:38.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.376+0000 7f20f1893640 1 -- 172.21.15.181:0/3946192130 >> v1:172.21.15.181:6793/0 conn(0x7f20d0003960 legacy=0x7f20d0005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:38.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.376+0000 7f20f1092640 1 -- 172.21.15.181:0/3946192130 >> v1:172.21.15.181:6790/0 conn(0x7f20d00075f0 legacy=0x7f20d0009a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:38.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.376+0000 7f20f2094640 1 -- 172.21.15.181:0/3946192130 >> v1:172.21.15.195:6789/0 conn(0x7f20d000b360 legacy=0x7f20d000d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:38.377 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:38.376+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:40:40.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.856+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046403276 0 0) 0x7f20ec0a48e0 con 0x7f20d000b360 2024-09-13T10:40:40.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.856+0000 7f20f0891640 10 monclient(hunting): _negotiate 2024-09-13T10:40:40.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.856+0000 7f20f0891640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:40.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.856+0000 7f20f0891640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:40.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.856+0000 7f20f0891640 10 monclient(hunting): my global_id is 135118 2024-09-13T10:40:40.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.856+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20d8003520 con 0x7f20d000b360 2024-09-13T10:40:40.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.856+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 81609785 0 0) 0x7f20d0010160 con 0x7f20d00075f0 2024-09-13T10:40:40.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.856+0000 7f20f0891640 10 monclient(hunting): _negotiate 2024-09-13T10:40:40.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.856+0000 7f20f0891640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:40.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.856+0000 7f20f0891640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:40.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.856+0000 7f20f0891640 10 monclient(hunting): my global_id is 174377 2024-09-13T10:40:40.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.856+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20ec0a48e0 con 0x7f20d00075f0 2024-09-13T10:40:40.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1125046285 0 0) 0x7f20d8003520 con 0x7f20d000b360 2024-09-13T10:40:40.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 >> v1:172.21.15.181:6793/0 conn(0x7f20d0003960 legacy=0x7f20d0005db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:40.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 >> v1:172.21.15.181:6790/0 conn(0x7f20d00075f0 legacy=0x7f20d0009a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:40.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 10 monclient: _finish_hunting 0 2024-09-13T10:40:40.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 1 monclient: found mon.noname-f 2024-09-13T10:40:40.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f2094640 1 -- 172.21.15.181:0/3946192130 reap_dead start 2024-09-13T10:40:40.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:40.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.195:6789/0 2024-09-13T10:40:40.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d0012760 con 0x7f20d000b360 2024-09-13T10:40:40.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 10 monclient: _finish_auth 0 2024-09-13T10:40:40.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 10 monclient: _check_auth_tickets 2024-09-13T10:40:40.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:40.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f20e4001e40 con 0x7f20d000b360 2024-09-13T10:40:40.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:40.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-13T10:40:40.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 10 monclient: dump: 2024-09-13T10:40:40.862 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:40.862 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:40.863 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:40.864 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:40.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f20dc001a60 con 0x7f20d00075f0 2024-09-13T10:40:40.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f3af7640 5 monclient: authenticate success, global_id 135118 2024-09-13T10:40:40.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f3af7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:40.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:40:40.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 <== mon.1 v1:172.21.15.195:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f20e4003990 con 0x7f20d000b360 2024-09-13T10:40:40.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:40.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 1 -- 172.21.15.181:0/3946192130 <== mon.1 v1:172.21.15.195:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f20e4003e80 con 0x7f20d000b360 2024-09-13T10:40:40.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f3af7640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:40.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f3af7640 4 set_mon_vals no callback set 2024-09-13T10:40:40.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:40.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.857+0000 7f20f0891640 10 monclient: dump: 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:40.865 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.858+0000 7f20f3af7640 10 monclient: shutdown 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.858+0000 7f20f3af7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.858+0000 7f20f3af7640 1 -- 172.21.15.181:0/3946192130 >> v1:172.21.15.195:6789/0 conn(0x7f20d000b360 legacy=0x7f20d000d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.858+0000 7f20f3af7640 1 -- 172.21.15.181:0/3946192130 shutdown_connections 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.858+0000 7f20f3af7640 1 -- 172.21.15.181:0/3946192130 >> 172.21.15.181:0/3946192130 conn(0x7f20ec077170 msgr2=0x7f20ec0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.858+0000 7f20f3af7640 1 -- 172.21.15.181:0/3946192130 shutdown_connections 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.858+0000 7f20f3af7640 1 -- 172.21.15.181:0/3946192130 wait complete. 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.859+0000 7f20f3af7640 10 monclient: build_initial_monmap 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.859+0000 7f20f3af7640 10 monclient: monmap: 2024-09-13T10:40:40.866 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:40.867 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:40.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.859+0000 7f20f3af7640 1 Processor -- start 2024-09-13T10:40:40.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.859+0000 7f20f3af7640 1 -- start start 2024-09-13T10:40:40.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.859+0000 7f20f3af7640 10 monclient: init 2024-09-13T10:40:40.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f3af7640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:40.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f3af7640 10 monclient: _add_conns ranks=[0,5,8,6,1,7,4,2,3] 2024-09-13T10:40:40.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f3af7640 10 monclient(hunting): picked mon.noname-a con 0x7f20ec138a10 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:40.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f3af7640 10 monclient(hunting): picked mon.noname-h con 0x7f20ec1cac50 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:40.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f3af7640 10 monclient(hunting): picked mon.noname-e con 0x7f20ec1cb100 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:40.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f3af7640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ec0a2540 con 0x7f20ec138a10 2024-09-13T10:40:40.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f3af7640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ec123540 con 0x7f20ec1cac50 2024-09-13T10:40:40.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f3af7640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ec123c10 con 0x7f20ec1cb100 2024-09-13T10:40:40.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f3af7640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:40.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f3af7640 10 monclient(hunting): authenticate will time out at 1380.365322s 2024-09-13T10:40:40.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f1893640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f20ec138a10 0x7f20ec138df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49490/0 (socket says 172.21.15.181:49490) 2024-09-13T10:40:40.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f1893640 1 -- 172.21.15.181:0/1117756451 learned_addr learned my addr 172.21.15.181:0/1117756451 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:40.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.860+0000 7f20f2094640 1 --1- 172.21.15.181:0/1117756451 >> v1:172.21.15.181:6793/0 conn(0x7f20ec1cb100 0x7f20ec1d6990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:44990/0 (socket says 172.21.15.181:44990) 2024-09-13T10:40:40.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.862+0000 7f20f1092640 1 -- 172.21.15.181:0/1117756451 >> v1:172.21.15.195:6791/0 conn(0x7f20ec1cac50 legacy=0x7f20ec1d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:40.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.862+0000 7f20f2094640 1 -- 172.21.15.181:0/1117756451 >> v1:172.21.15.181:6793/0 conn(0x7f20ec1cb100 legacy=0x7f20ec1d6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:40.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.862+0000 7f20f1893640 1 -- 172.21.15.181:0/1117756451 >> v1:172.21.15.181:6789/0 conn(0x7f20ec138a10 legacy=0x7f20ec138df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:40.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.919+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958918972 0 0) 0x7f20ec123540 con 0x7f20ec1cac50 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.919+0000 7f20e27fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.919+0000 7f20e27fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.919+0000 7f20e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.919+0000 7f20e27fc640 10 monclient(hunting): my global_id is 106079 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.919+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20d00115d0 con 0x7f20ec1cac50 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.920+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2934428046 0 0) 0x7f20d00115d0 con 0x7f20ec1cac50 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.920+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20ec123540 con 0x7f20ec1cac50 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.920+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f20dc001cf0 con 0x7f20ec1cac50 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.920+0000 7f20e27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.920+0000 7f20e27fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.920+0000 7f20e27fc640 10 monclient(hunting): dump: 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:40.922 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:40.923 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:40.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:40.920+0000 7f20e27fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:41.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2566573689 0 0) 0x7f20ec123540 con 0x7f20ec1cac50 2024-09-13T10:40:41.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 >> v1:172.21.15.181:6793/0 conn(0x7f20ec1cb100 legacy=0x7f20ec1d6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:41.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 >> v1:172.21.15.181:6789/0 conn(0x7f20ec138a10 legacy=0x7f20ec138df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:41.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 10 monclient: _finish_hunting 0 2024-09-13T10:40:41.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 1 monclient: found mon.h 2024-09-13T10:40:41.581 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ec123ef0 con 0x7f20ec1cac50 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 10 monclient: _finish_auth 0 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 10 monclient: _check_auth_tickets 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20f3af7640 5 monclient: authenticate success, global_id 106079 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20f3af7640 10 monclient: _renew_subs 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20f3af7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20f3af7640 1 -- 172.21.15.181:0/1117756451 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f20ec1241d0 con 0x7f20ec1cac50 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20f3af7640 10 monclient: _renew_subs 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f20dc004dd0 con 0x7f20ec1cac50 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20f3af7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:40:41.582 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20f3af7640 1 -- 172.21.15.181:0/1117756451 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f20ec1d8290 con 0x7f20ec1cac50 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f20dc0052c0 con 0x7f20ec1cac50 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e27fc640 10 monclient: dump: 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:41.583 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:41.584 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:41.584 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:41.584 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:41.584 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:41.584 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:41.584 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:41.584 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:41.584 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:41.584 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.579+0000 7f20e3fff640 4 set_mon_vals no callback set 2024-09-13T10:40:41.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.580+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f20dc011940 con 0x7f20ec1cac50 2024-09-13T10:40:41.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.581+0000 7f20f3af7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:41.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.581+0000 7f20f3af7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:41.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.581+0000 7f20f3af7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:40:41.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.581+0000 7f20f3af7640 1 -- 172.21.15.181:0/1117756451 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ec0a5ca0 con 0x7f20ec1cac50 2024-09-13T10:40:41.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.581+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f20dc04e140 con 0x7f20ec1cac50 2024-09-13T10:40:41.585 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.581+0000 7f20f1893640 10 monclient: get_auth_request con 0x7f20d0040ef0 auth_method 0 2024-09-13T10:40:41.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.586+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 <== mon.5 v1:172.21.15.195:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f20ec0a5ca0 con 0x7f20ec1cac50 2024-09-13T10:40:41.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.586+0000 7f20e27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:41.587 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.586+0000 7f20e27fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:41.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.842+0000 7f20f3af7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:40:41.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.842+0000 7f20f3af7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:40:41.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.842+0000 7f20f3af7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:40:41.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.842+0000 7f20f3af7640 1 -- 172.21.15.181:0/1117756451 --> v1:172.21.15.195:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f20ec050c40 con 0x7f20ec1cac50 2024-09-13T10:40:41.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.843+0000 7f20e27fc640 1 -- 172.21.15.181:0/1117756451 <== mon.5 v1:172.21.15.195:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 1434909140) 0x7f20dc01b800 con 0x7f20ec1cac50 2024-09-13T10:40:41.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.843+0000 7f20e27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:40:41.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.843+0000 7f20e27fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:41.845 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":148,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:40:41.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.845+0000 7f20f3af7640 1 -- 172.21.15.181:0/1117756451 >> v1:172.21.15.195:6800/1839191919 conn(0x7f20d0040ef0 legacy=0x7f20d00433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:41.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.845+0000 7f20f3af7640 10 monclient: shutdown 2024-09-13T10:40:41.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.845+0000 7f20f3af7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:41.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.845+0000 7f20f3af7640 1 -- 172.21.15.181:0/1117756451 >> v1:172.21.15.195:6791/0 conn(0x7f20ec1cac50 legacy=0x7f20ec1d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:41.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.845+0000 7f20f3af7640 1 -- 172.21.15.181:0/1117756451 shutdown_connections 2024-09-13T10:40:41.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.845+0000 7f20f3af7640 1 -- 172.21.15.181:0/1117756451 >> 172.21.15.181:0/1117756451 conn(0x7f20d000b360 msgr2=0x7f20ec13c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:41.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.845+0000 7f20f3af7640 1 -- 172.21.15.181:0/1117756451 shutdown_connections 2024-09-13T10:40:41.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.845+0000 7f20f3af7640 1 -- 172.21.15.181:0/1117756451 wait complete. 2024-09-13T10:40:41.857 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:40:41.857 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-13T10:40:41.857 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T10:40:41.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.954+0000 7f82f81f5640 10 monclient: get_monmap_and_config 2024-09-13T10:40:41.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.954+0000 7f82f81f5640 10 monclient: build_initial_monmap 2024-09-13T10:40:41.956 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.954+0000 7f82f81f5640 10 monclient: monmap: 2024-09-13T10:40:41.956 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:41.956 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:41.956 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:41.955184+0000 2024-09-13T10:40:41.956 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:41.955184+0000 2024-09-13T10:40:41.956 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:41.956 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:41.956 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:41.957 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:41.957 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:41.957 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:41.957 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:41.957 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:41.957 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:41.957 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:41.957 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:41.957 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:41.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 1 Processor -- start 2024-09-13T10:40:41.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 1 -- start start 2024-09-13T10:40:41.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 10 monclient: init 2024-09-13T10:40:41.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:41.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 10 monclient: _add_conns ranks=[8,4,7,0,6,5,2,1,3] 2024-09-13T10:40:41.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 10 monclient(hunting): picked mon.noname-e con 0x7f82f00a6640 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:41.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 10 monclient(hunting): picked mon.noname-c con 0x7f82f00a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:41.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 10 monclient(hunting): picked mon.noname-i con 0x7f82f013f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:41.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f00a4bc0 con 0x7f82f00a8340 2024-09-13T10:40:41.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f013a320 con 0x7f82f013f750 2024-09-13T10:40:41.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f00a8100 con 0x7f82f00a6640 2024-09-13T10:40:41.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:41.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f81f5640 10 monclient(hunting): authenticate will time out at 1381.460865s 2024-09-13T10:40:41.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f5f91640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f82f00a6640 0x7f82f0139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:45000/0 (socket says 172.21.15.181:45000) 2024-09-13T10:40:41.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f5790640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f82f00a8340 0x7f82f0139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:46620/0 (socket says 172.21.15.181:46620) 2024-09-13T10:40:41.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.955+0000 7f82f5f91640 1 -- 172.21.15.181:0/1810082161 learned_addr learned my addr 172.21.15.181:0/1810082161 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:41.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f5790640 1 -- 172.21.15.181:0/1810082161 >> v1:172.21.15.181:6791/0 conn(0x7f82f00a8340 legacy=0x7f82f0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:41.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f5f91640 1 -- 172.21.15.181:0/1810082161 >> v1:172.21.15.181:6793/0 conn(0x7f82f00a6640 legacy=0x7f82f0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:41.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 1 -- 172.21.15.181:0/1810082161 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1982810301 0 0) 0x7f82f00a4bc0 con 0x7f82f00a8340 2024-09-13T10:40:41.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient(hunting): _negotiate 2024-09-13T10:40:41.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient(hunting): my global_id is 174415 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 1 -- 172.21.15.181:0/1810082161 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82dc003520 con 0x7f82f00a8340 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 1 -- 172.21.15.181:0/1810082161 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382746923 0 0) 0x7f82f00a8100 con 0x7f82f00a6640 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient(hunting): _negotiate 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient(hunting): my global_id is 184112 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 1 -- 172.21.15.181:0/1810082161 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f00a4bc0 con 0x7f82f00a6640 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f6792640 1 -- 172.21.15.181:0/1810082161 >> v1:172.21.15.195:6792/0 conn(0x7f82f013f750 legacy=0x7f82f0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 1 -- 172.21.15.181:0/1810082161 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1136964821 0 0) 0x7f82f00a4bc0 con 0x7f82f00a6640 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 1 -- 172.21.15.181:0/1810082161 >> v1:172.21.15.195:6792/0 conn(0x7f82f013f750 legacy=0x7f82f0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:41.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 1 -- 172.21.15.181:0/1810082161 >> v1:172.21.15.181:6791/0 conn(0x7f82f00a8340 legacy=0x7f82f0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient: _finish_hunting 0 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 1 monclient: found mon.noname-e 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 1 -- 172.21.15.181:0/1810082161 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f00a48e0 con 0x7f82f00a6640 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient: _finish_auth 0 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient: _check_auth_tickets 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 1 -- 172.21.15.181:0/1810082161 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f82ec001a30 con 0x7f82f00a6640 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f81f5640 5 monclient: authenticate success, global_id 184112 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f81f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:40:41.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient: dump: 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:41.966 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f81f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 1 -- 172.21.15.181:0/1810082161 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82ec001bd0 con 0x7f82f00a6640 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 1 -- 172.21.15.181:0/1810082161 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f82ec004be0 con 0x7f82f00a6640 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f81f5640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f81f5640 4 set_mon_vals no callback set 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.958+0000 7f82f4f8f640 10 monclient: dump: 2024-09-13T10:40:41.967 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:41.968 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:41.969 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:41.969 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:41.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.959+0000 7f82f81f5640 10 monclient: shutdown 2024-09-13T10:40:41.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.959+0000 7f82f81f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:41.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.959+0000 7f82f81f5640 1 -- 172.21.15.181:0/1810082161 >> v1:172.21.15.181:6793/0 conn(0x7f82f00a6640 legacy=0x7f82f0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:41.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.959+0000 7f82f81f5640 1 -- 172.21.15.181:0/1810082161 shutdown_connections 2024-09-13T10:40:41.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.959+0000 7f82f81f5640 1 -- 172.21.15.181:0/1810082161 >> 172.21.15.181:0/1810082161 conn(0x7f82f0077170 msgr2=0x7f82f00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:41.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.959+0000 7f82f81f5640 1 -- 172.21.15.181:0/1810082161 shutdown_connections 2024-09-13T10:40:41.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.959+0000 7f82f81f5640 1 -- 172.21.15.181:0/1810082161 wait complete. 2024-09-13T10:40:41.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.959+0000 7f82f81f5640 10 monclient: build_initial_monmap 2024-09-13T10:40:41.969 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.959+0000 7f82f81f5640 10 monclient: monmap: 2024-09-13T10:40:41.969 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:41.970 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:41.971 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:41.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 1 Processor -- start 2024-09-13T10:40:41.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 1 -- start start 2024-09-13T10:40:41.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 10 monclient: init 2024-09-13T10:40:41.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:41.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 10 monclient: _add_conns ranks=[1,7,5,4,6,0,2,3,8] 2024-09-13T10:40:41.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 10 monclient(hunting): picked mon.noname-f con 0x7f82f00a8340 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:41.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 10 monclient(hunting): picked mon.noname-i con 0x7f82f013f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:41.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 10 monclient(hunting): picked mon.noname-h con 0x7f82f013cb50 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:41.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f013d4a0 con 0x7f82f00a8340 2024-09-13T10:40:41.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f00a9ed0 con 0x7f82f013cb50 2024-09-13T10:40:41.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f0134bb0 con 0x7f82f013f750 2024-09-13T10:40:41.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:41.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f81f5640 10 monclient(hunting): authenticate will time out at 1381.465669s 2024-09-13T10:40:41.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f6792640 1 --1- >> v1:172.21.15.195:6791/0 conn(0x7f82f013cb50 0x7f82f01d6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.195:6791/0 says I am v1:172.21.15.181:45834/0 (socket says 172.21.15.181:45834) 2024-09-13T10:40:41.972 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.960+0000 7f82f6792640 1 -- 172.21.15.181:0/4189045601 learned_addr learned my addr 172.21.15.181:0/4189045601 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:41.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.962+0000 7f82f6792640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.195:6791/0 conn(0x7f82f013cb50 legacy=0x7f82f01d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:41.978 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82f5790640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.195:6792/0 conn(0x7f82f013f750 legacy=0x7f82f013c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:41.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82f5f91640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.195:6789/0 conn(0x7f82f00a8340 legacy=0x7f82f013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:41.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413673977 0 0) 0x7f82f013a320 con 0x7f82f013cb50 2024-09-13T10:40:41.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:41.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:41.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:41.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): my global_id is 106088 2024-09-13T10:40:41.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82d4003550 con 0x7f82f013cb50 2024-09-13T10:40:41.979 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2680260687 0 0) 0x7f82f0134bb0 con 0x7f82f013f750 2024-09-13T10:40:41.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:41.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:41.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:41.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): my global_id is 58102 2024-09-13T10:40:41.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f013a320 con 0x7f82f013f750 2024-09-13T10:40:41.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3193978328 0 0) 0x7f82f013d4a0 con 0x7f82f00a8340 2024-09-13T10:40:41.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:41.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:41.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:41.980 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): my global_id is 135127 2024-09-13T10:40:41.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f0134bb0 con 0x7f82f00a8340 2024-09-13T10:40:41.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3383763847 0 0) 0x7f82d4003550 con 0x7f82f013cb50 2024-09-13T10:40:41.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82f013d4a0 con 0x7f82f013cb50 2024-09-13T10:40:41.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f82e8003990 con 0x7f82f013cb50 2024-09-13T10:40:41.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:41.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:40:41.981 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): dump: 2024-09-13T10:40:41.981 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:41.981 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:41.981 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.981 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.981 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 394364887 0 0) 0x7f82f0134bb0 con 0x7f82f00a8340 2024-09-13T10:40:41.982 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82d4003550 con 0x7f82f00a8340 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f82ec004b20 con 0x7f82f00a8340 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): dump: 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:41.983 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3420301423 0 0) 0x7f82f013a320 con 0x7f82f013f750 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82f0134bb0 con 0x7f82f013f750 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f82e00047e0 con 0x7f82f013f750 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:40:41.984 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient(hunting): dump: 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:41.985 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1382453529 0 0) 0x7f82f013d4a0 con 0x7f82f013cb50 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.195:6792/0 conn(0x7f82f013f750 legacy=0x7f82f013c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.195:6789/0 conn(0x7f82f00a8340 legacy=0x7f82f013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 monclient: found mon.h 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f01348d0 con 0x7f82f013cb50 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient: _finish_auth 0 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:40:41.986 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82f81f5640 5 monclient: authenticate success, global_id 106088 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82f81f5640 10 monclient: _renew_subs 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82f81f5640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82f81f5640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f82f013e000 con 0x7f82f013cb50 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82f81f5640 10 monclient: _renew_subs 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82f81f5640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82f81f5640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f82f01d7c20 con 0x7f82f013cb50 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82e8003e60 con 0x7f82f013cb50 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f82e80043d0 con 0x7f82f013cb50 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:40:41.987 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e7fff640 4 set_mon_vals no callback set 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.963+0000 7f82e67fc640 10 monclient: dump: 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:41.988 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:41.989 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:41.989 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:41.989 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:41.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.964+0000 7f82f81f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:41.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.964+0000 7f82f81f5640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f82d80065c0 con 0x7f82d8002860 2024-09-13T10:40:41.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.964+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f82e80045f0 con 0x7f82f013cb50 2024-09-13T10:40:41.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.964+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f82e804e650 con 0x7f82f013cb50 2024-09-13T10:40:41.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.965+0000 7f82f5790640 10 monclient: get_auth_request con 0x7f82d40404e0 auth_method 0 2024-09-13T10:40:41.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.966+0000 7f82f5f91640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.181:6789/0 conn(0x7f82d8002860 legacy=0x7f82d8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:41.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.966+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928827417 0 0) 0x7f82d80065c0 con 0x7f82d8002860 2024-09-13T10:40:41.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.966+0000 7f82e67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:41.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.966+0000 7f82e67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:41.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.966+0000 7f82e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:41.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.966+0000 7f82e67fc640 10 monclient(hunting): my global_id is 184104 2024-09-13T10:40:41.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.966+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f013d4a0 con 0x7f82d8002860 2024-09-13T10:40:41.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.966+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 731142871 0 0) 0x7f82f013d4a0 con 0x7f82d8002860 2024-09-13T10:40:41.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.966+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82d80065c0 con 0x7f82d8002860 2024-09-13T10:40:41.990 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.966+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f82ec004f50 con 0x7f82d8002860 2024-09-13T10:40:41.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.966+0000 7f82e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:41.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.967+0000 7f82e67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:41.991 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.967+0000 7f82e67fc640 10 monclient: dump: 2024-09-13T10:40:41.991 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:41.991 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:41.991 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.991 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.991 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:41.991 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:41.991 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.967+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3535906719 0 0) 0x7f82d80065c0 con 0x7f82d8002860 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.967+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.181:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82d800a160 con 0x7f82d8002860 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.967+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f82ec005080 con 0x7f82d8002860 2024-09-13T10:40:41.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.967+0000 7f82e67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:41.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.967+0000 7f82e67fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:41.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.967+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.181:6789/0 conn(0x7f82d8002860 legacy=0x7f82d8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:41.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.967+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.181:6789/0 conn(0x7f82d8002860 legacy=0x7f82d8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:41.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.973+0000 7f82f81f5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:41.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.973+0000 7f82f81f5640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f82d8009e50 con 0x7f82d8009110 2024-09-13T10:40:41.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.975+0000 7f82f5f91640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.181:6789/0 conn(0x7f82d8009110 legacy=0x7f82d80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:41.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92658445 0 0) 0x7f82d8009e50 con 0x7f82d8009110 2024-09-13T10:40:41.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:41.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:41.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:41.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 10 monclient(hunting): my global_id is 184113 2024-09-13T10:40:41.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82d80065c0 con 0x7f82d8009110 2024-09-13T10:40:41.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3608103346 0 0) 0x7f82d80065c0 con 0x7f82d8009110 2024-09-13T10:40:41.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82d8009e50 con 0x7f82d8009110 2024-09-13T10:40:41.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f82ec0057a0 con 0x7f82d8009110 2024-09-13T10:40:41.994 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:41.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:41.995 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 10 monclient: dump: 2024-09-13T10:40:41.995 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:41.995 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:41.995 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.995 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:41.995 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:41.995 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:41.995 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:41.995 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:41.996 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:41.996 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:41.996 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:41.996 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:41.996 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:41.996 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:41.996 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:41.996 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:41.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1656009077 0 0) 0x7f82d8009e50 con 0x7f82d8009110 2024-09-13T10:40:41.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 --> v1:172.21.15.181:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f82d800c3f0 con 0x7f82d8009110 2024-09-13T10:40:41.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 <== mon.0 v1:172.21.15.181:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 2187767355) 0x7f82ec007d00 con 0x7f82d8009110 2024-09-13T10:40:41.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:41.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:41.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.181:6789/0 conn(0x7f82d8009110 legacy=0x7f82d80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:41.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82e67fc640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.181:6789/0 conn(0x7f82d8009110 legacy=0x7f82d80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:41.997 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:41.997 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:41.997 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 148, 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 6625, 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:40:41.998 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:41.999 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.002 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.003 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:42.004 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:42.004 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.004 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.004 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.004 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:42.004 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.004 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.004 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.004 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.004 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:42.005 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:42.006 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.007 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.008 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.009 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:42.010 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.011 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.013 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:42.014 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.015 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.016 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.016 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.016 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:42.016 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:42.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.016 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.016 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.016 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.016 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.016 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.016 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:42.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.017 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.017 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.017 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.017 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.017 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.017 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:42.017 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:42.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82f81f5640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.195:6800/1839191919 conn(0x7f82d40404e0 legacy=0x7f82d40429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82f81f5640 10 monclient: shutdown 2024-09-13T10:40:42.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82f81f5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82f81f5640 1 -- 172.21.15.181:0/4189045601 >> v1:172.21.15.195:6791/0 conn(0x7f82f013cb50 legacy=0x7f82f01d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82f6792640 1 -- 172.21.15.181:0/4189045601 reap_dead start 2024-09-13T10:40:42.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82f6792640 1 -- 172.21.15.181:0/4189045601 reap_dead start 2024-09-13T10:40:42.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82f81f5640 1 -- 172.21.15.181:0/4189045601 shutdown_connections 2024-09-13T10:40:42.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82f81f5640 1 -- 172.21.15.181:0/4189045601 >> 172.21.15.181:0/4189045601 conn(0x7f82f00a6640 msgr2=0x7f82f00a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.976+0000 7f82f81f5640 1 -- 172.21.15.181:0/4189045601 shutdown_connections 2024-09-13T10:40:42.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:41.977+0000 7f82f81f5640 1 -- 172.21.15.181:0/4189045601 wait complete. 2024-09-13T10:40:42.020 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:40:42.020 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-13T10:40:42.020 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T10:40:42.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.117+0000 7f28d19d1640 10 monclient: get_monmap_and_config 2024-09-13T10:40:42.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.117+0000 7f28d19d1640 10 monclient: build_initial_monmap 2024-09-13T10:40:42.119 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.117+0000 7f28d19d1640 10 monclient: monmap: 2024-09-13T10:40:42.119 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:42.119 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.119 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:42.118410+0000 2024-09-13T10:40:42.119 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:42.118410+0000 2024-09-13T10:40:42.120 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:42.120 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.120 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:42.120 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:42.120 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:42.120 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:42.120 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:42.120 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:42.120 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:42.120 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:42.120 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:42.120 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.118+0000 7f28d19d1640 1 Processor -- start 2024-09-13T10:40:42.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.118+0000 7f28d19d1640 1 -- start start 2024-09-13T10:40:42.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.118+0000 7f28d19d1640 10 monclient: init 2024-09-13T10:40:42.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.118+0000 7f28d19d1640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:42.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.118+0000 7f28d19d1640 10 monclient: _add_conns ranks=[8,7,0,6,5,1,4,2,3] 2024-09-13T10:40:42.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.119+0000 7f28d19d1640 10 monclient(hunting): picked mon.noname-e con 0x7f28cc0a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:42.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.119+0000 7f28d19d1640 10 monclient(hunting): picked mon.noname-i con 0x7f28cc0a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:42.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.119+0000 7f28d19d1640 10 monclient(hunting): picked mon.noname-a con 0x7f28cc13f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:42.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.119+0000 7f28d19d1640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc0a5fe0 con 0x7f28cc13f9a0 2024-09-13T10:40:42.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.119+0000 7f28d19d1640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc0a8080 con 0x7f28cc0a6ab0 2024-09-13T10:40:42.126 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.119+0000 7f28d19d1640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc0a42c0 con 0x7f28cc0a66d0 2024-09-13T10:40:42.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.119+0000 7f28d19d1640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:42.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.119+0000 7f28d19d1640 10 monclient(hunting): authenticate will time out at 1381.624154s 2024-09-13T10:40:42.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.119+0000 7f28caffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f28cc0a66d0 0x7f28cc0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:45002/0 (socket says 172.21.15.181:45002) 2024-09-13T10:40:42.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.119+0000 7f28caffd640 1 -- 172.21.15.181:0/561458819 learned_addr learned my addr 172.21.15.181:0/561458819 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:42.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28caffd640 1 -- 172.21.15.181:0/561458819 >> v1:172.21.15.181:6793/0 conn(0x7f28cc0a66d0 legacy=0x7f28cc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28cb7fe640 1 -- 172.21.15.181:0/561458819 >> v1:172.21.15.181:6789/0 conn(0x7f28cc13f9a0 legacy=0x7f28cc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 1 -- 172.21.15.181:0/561458819 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154286677 0 0) 0x7f28cc0a42c0 con 0x7f28cc0a66d0 2024-09-13T10:40:42.127 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient(hunting): my global_id is 184121 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 1 -- 172.21.15.181:0/561458819 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28b4003520 con 0x7f28cc0a66d0 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 1 -- 172.21.15.181:0/561458819 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2379697270 0 0) 0x7f28cc0a5fe0 con 0x7f28cc13f9a0 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient(hunting): my global_id is 184122 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 1 -- 172.21.15.181:0/561458819 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28cc0a42c0 con 0x7f28cc13f9a0 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28ca7fc640 1 -- 172.21.15.181:0/561458819 >> v1:172.21.15.195:6792/0 conn(0x7f28cc0a6ab0 legacy=0x7f28cc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 1 -- 172.21.15.181:0/561458819 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4078434279 0 0) 0x7f28b4003520 con 0x7f28cc0a66d0 2024-09-13T10:40:42.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 1 -- 172.21.15.181:0/561458819 >> v1:172.21.15.195:6792/0 conn(0x7f28cc0a6ab0 legacy=0x7f28cc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 1 -- 172.21.15.181:0/561458819 >> v1:172.21.15.181:6789/0 conn(0x7f28cc13f9a0 legacy=0x7f28cc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 1 monclient: found mon.noname-e 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 1 -- 172.21.15.181:0/561458819 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28cc1464e0 con 0x7f28cc0a66d0 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient: _finish_auth 0 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 1 -- 172.21.15.181:0/561458819 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28bc001e50 con 0x7f28cc0a66d0 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28d19d1640 5 monclient: authenticate success, global_id 184121 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28d19d1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:42.129 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient: dump: 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.130 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28d19d1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 1 -- 172.21.15.181:0/561458819 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28bc004c20 con 0x7f28cc0a66d0 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 1 -- 172.21.15.181:0/561458819 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28bc005150 con 0x7f28cc0a66d0 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28d19d1640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28d19d1640 4 set_mon_vals no callback set 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.121+0000 7f28c9ffb640 10 monclient: dump: 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.132 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.122+0000 7f28d19d1640 10 monclient: shutdown 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.122+0000 7f28d19d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.122+0000 7f28d19d1640 1 -- 172.21.15.181:0/561458819 >> v1:172.21.15.181:6793/0 conn(0x7f28cc0a66d0 legacy=0x7f28cc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.122+0000 7f28d19d1640 1 -- 172.21.15.181:0/561458819 shutdown_connections 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.122+0000 7f28d19d1640 1 -- 172.21.15.181:0/561458819 >> 172.21.15.181:0/561458819 conn(0x7f28cc0abcd0 msgr2=0x7f28cc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.122+0000 7f28d19d1640 1 -- 172.21.15.181:0/561458819 shutdown_connections 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.122+0000 7f28d19d1640 1 -- 172.21.15.181:0/561458819 wait complete. 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.122+0000 7f28d19d1640 10 monclient: build_initial_monmap 2024-09-13T10:40:42.133 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.122+0000 7f28d19d1640 10 monclient: monmap: 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:42.134 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.123+0000 7f28d19d1640 1 Processor -- start 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.123+0000 7f28d19d1640 1 -- start start 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.123+0000 7f28d19d1640 10 monclient: init 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.123+0000 7f28d19d1640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.123+0000 7f28d19d1640 10 monclient: _add_conns ranks=[8,0,4,3,1,5,2,6,7] 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.123+0000 7f28d19d1640 10 monclient(hunting): picked mon.noname-e con 0x7f28cc0a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.123+0000 7f28d19d1640 10 monclient(hunting): picked mon.noname-a con 0x7f28cc0a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.123+0000 7f28d19d1640 10 monclient(hunting): picked mon.noname-c con 0x7f28cc13f9a0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.123+0000 7f28d19d1640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc13f090 con 0x7f28cc0a6ab0 2024-09-13T10:40:42.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.124+0000 7f28d19d1640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc13c130 con 0x7f28cc13f9a0 2024-09-13T10:40:42.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.124+0000 7f28d19d1640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc139050 con 0x7f28cc0a66d0 2024-09-13T10:40:42.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.124+0000 7f28d19d1640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:42.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.124+0000 7f28d19d1640 10 monclient(hunting): authenticate will time out at 1381.629033s 2024-09-13T10:40:42.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.124+0000 7f28caffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f28cc0a66d0 0x7f28cc13b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:45018/0 (socket says 172.21.15.181:45018) 2024-09-13T10:40:42.136 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.124+0000 7f28caffd640 1 -- 172.21.15.181:0/62899688 learned_addr learned my addr 172.21.15.181:0/62899688 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:42.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.126+0000 7f28caffd640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.181:6793/0 conn(0x7f28cc0a66d0 legacy=0x7f28cc13b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.126+0000 7f28ca7fc640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.181:6789/0 conn(0x7f28cc0a6ab0 legacy=0x7f28cc13ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.126+0000 7f28cb7fe640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.181:6791/0 conn(0x7f28cc13f9a0 legacy=0x7f28cc1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.126+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:40:42.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655372854 0 0) 0x7f28cc139050 con 0x7f28cc0a66d0 2024-09-13T10:40:42.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): my global_id is 184130 2024-09-13T10:40:42.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28b8003520 con 0x7f28cc0a66d0 2024-09-13T10:40:42.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414324377 0 0) 0x7f28cc13f090 con 0x7f28cc0a6ab0 2024-09-13T10:40:42.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): my global_id is 184131 2024-09-13T10:40:42.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28cc139050 con 0x7f28cc0a6ab0 2024-09-13T10:40:42.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475448589 0 0) 0x7f28cc13c130 con 0x7f28cc13f9a0 2024-09-13T10:40:42.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): my global_id is 174424 2024-09-13T10:40:42.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28cc13f090 con 0x7f28cc13f9a0 2024-09-13T10:40:42.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1448100361 0 0) 0x7f28cc139050 con 0x7f28cc0a6ab0 2024-09-13T10:40:42.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28cc13c130 con 0x7f28cc0a6ab0 2024-09-13T10:40:42.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3399927743 0 0) 0x7f28b8003520 con 0x7f28cc0a66d0 2024-09-13T10:40:42.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28cc139050 con 0x7f28cc0a66d0 2024-09-13T10:40:42.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28c0001d10 con 0x7f28cc0a6ab0 2024-09-13T10:40:42.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:42.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:42.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): dump: 2024-09-13T10:40:42.144 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.144 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.144 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.144 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.144 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.144 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.144 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.144 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.144 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.144 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.144 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.144 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3124624833 0 0) 0x7f28cc13f090 con 0x7f28cc13f9a0 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28b8003520 con 0x7f28cc13f9a0 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28bc005110 con 0x7f28cc0a66d0 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): dump: 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.145 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28c4001cc0 con 0x7f28cc13f9a0 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient(hunting): dump: 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.147 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3188441019 0 0) 0x7f28cc139050 con 0x7f28cc0a66d0 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.181:6791/0 conn(0x7f28cc13f9a0 legacy=0x7f28cc1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.181:6789/0 conn(0x7f28cc0a6ab0 legacy=0x7f28cc13ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient: _finish_hunting 0 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 monclient: found mon.e 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28cc13e220 con 0x7f28cc0a66d0 2024-09-13T10:40:42.148 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient: _finish_auth 0 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 10 monclient: _check_auth_tickets 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28d19d1640 5 monclient: authenticate success, global_id 184130 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28d19d1640 10 monclient: _renew_subs 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28d19d1640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.128+0000 7f28d19d1640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f28cc13edb0 con 0x7f28cc0a66d0 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28d19d1640 10 monclient: _renew_subs 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28d19d1640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28d19d1640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f28cc13f770 con 0x7f28cc0a66d0 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28bc001e70 con 0x7f28cc0a66d0 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28b3fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28bc005a80 con 0x7f28cc0a66d0 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28b3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28b3fff640 10 monclient: dump: 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.150 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28c97fa640 4 set_mon_vals no callback set 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28d19d1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28d19d1640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f28cc0a3240 con 0x7f28cc13d890 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.129+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f28bc012100 con 0x7f28cc0a66d0 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.130+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f28bc04e4c0 con 0x7f28cc0a66d0 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.130+0000 7f28cb7fe640 10 monclient: get_auth_request con 0x7f28b8040460 auth_method 0 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28ca7fc640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.181:6790/0 conn(0x7f28cc13d890 legacy=0x7f28cc13fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3403889371 0 0) 0x7f28cc0a3240 con 0x7f28cc13d890 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 10 monclient(hunting): my global_id is 174386 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28cc139050 con 0x7f28cc13d890 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2522318040 0 0) 0x7f28cc139050 con 0x7f28cc13d890 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28cc0a3240 con 0x7f28cc13d890 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28c00040d0 con 0x7f28cc13d890 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 10 monclient: dump: 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.152 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 328483853 0 0) 0x7f28cc0a3240 con 0x7f28cc13d890 2024-09-13T10:40:42.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28cc068a90 con 0x7f28cc13d890 2024-09-13T10:40:42.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f28c00042f0 con 0x7f28cc13d890 2024-09-13T10:40:42.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:42.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:42.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.181:6790/0 conn(0x7f28cc13d890 legacy=0x7f28cc13fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.132+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.181:6790/0 conn(0x7f28cc13d890 legacy=0x7f28cc13fd80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.138+0000 7f28d19d1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:42.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.138+0000 7f28d19d1640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f28cc069af0 con 0x7f28cc02e200 2024-09-13T10:40:42.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28ca7fc640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.181:6790/0 conn(0x7f28cc02e200 legacy=0x7f28cc140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 585787674 0 0) 0x7f28cc069af0 con 0x7f28cc02e200 2024-09-13T10:40:42.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 10 monclient(hunting): my global_id is 174395 2024-09-13T10:40:42.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28cc0a3240 con 0x7f28cc02e200 2024-09-13T10:40:42.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3471750449 0 0) 0x7f28cc0a3240 con 0x7f28cc02e200 2024-09-13T10:40:42.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28cc069af0 con 0x7f28cc02e200 2024-09-13T10:40:42.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f28c0005cf0 con 0x7f28cc02e200 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 10 monclient: dump: 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.157 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.158 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.158 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.158 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.158 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.158 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1371950633 0 0) 0x7f28cc069af0 con 0x7f28cc02e200 2024-09-13T10:40:42.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 --> v1:172.21.15.181:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f28cc13dc70 con 0x7f28cc02e200 2024-09-13T10:40:42.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 <== mon.2 v1:172.21.15.181:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 4200959116) 0x7f28c0007220 con 0x7f28cc02e200 2024-09-13T10:40:42.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:42.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:42.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.181:6790/0 conn(0x7f28cc02e200 legacy=0x7f28cc140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.141+0000 7f28b3fff640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.181:6790/0 conn(0x7f28cc02e200 legacy=0x7f28cc140490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.159 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 148, 2024-09-13T10:40:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 55297, 2024-09-13T10:40:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:40:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:40:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:40:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:40:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:40:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.175 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.177 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.177 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:42.177 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.177 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.177 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.177 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.177 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.177 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.177 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.177 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.177 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:42.179 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:42.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.142+0000 7f28d19d1640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.195:6800/1839191919 conn(0x7f28b8040460 legacy=0x7f28b8042920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.142+0000 7f28d19d1640 10 monclient: shutdown 2024-09-13T10:40:42.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.142+0000 7f28d19d1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.142+0000 7f28d19d1640 1 -- 172.21.15.181:0/62899688 >> v1:172.21.15.181:6793/0 conn(0x7f28cc0a66d0 legacy=0x7f28cc13b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.142+0000 7f28cb7fe640 1 -- 172.21.15.181:0/62899688 reap_dead start 2024-09-13T10:40:42.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.142+0000 7f28cb7fe640 1 -- 172.21.15.181:0/62899688 reap_dead start 2024-09-13T10:40:42.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.142+0000 7f28d19d1640 1 -- 172.21.15.181:0/62899688 shutdown_connections 2024-09-13T10:40:42.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.142+0000 7f28d19d1640 1 -- 172.21.15.181:0/62899688 >> 172.21.15.181:0/62899688 conn(0x7f28cc0abcd0 msgr2=0x7f28cc0a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.142+0000 7f28d19d1640 1 -- 172.21.15.181:0/62899688 shutdown_connections 2024-09-13T10:40:42.181 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.142+0000 7f28d19d1640 1 -- 172.21.15.181:0/62899688 wait complete. 2024-09-13T10:40:42.181 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:40:42.181 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-13T10:40:42.182 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T10:40:42.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.279+0000 7f91f4d1e640 10 monclient: get_monmap_and_config 2024-09-13T10:40:42.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.279+0000 7f91f4d1e640 10 monclient: build_initial_monmap 2024-09-13T10:40:42.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.279+0000 7f91f4d1e640 10 monclient: monmap: 2024-09-13T10:40:42.281 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:42.281 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.281 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:42.279865+0000 2024-09-13T10:40:42.281 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:42.279865+0000 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.279+0000 7f91f4d1e640 1 Processor -- start 2024-09-13T10:40:42.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.279+0000 7f91f4d1e640 1 -- start start 2024-09-13T10:40:42.283 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.279+0000 7f91f4d1e640 10 monclient: init 2024-09-13T10:40:42.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91f4d1e640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:42.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91f4d1e640 10 monclient: _add_conns ranks=[4,8,0,1,5,6,3,7,2] 2024-09-13T10:40:42.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91f4d1e640 10 monclient(hunting): picked mon.noname-c con 0x7f91f00a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:42.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91f4d1e640 10 monclient(hunting): picked mon.noname-e con 0x7f91f00a6ab0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:42.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91f4d1e640 10 monclient(hunting): picked mon.noname-a con 0x7f91f013f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:42.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91f4d1e640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91f00a5fe0 con 0x7f91f013f9a0 2024-09-13T10:40:42.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91f4d1e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91f00a8080 con 0x7f91f00a66d0 2024-09-13T10:40:42.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91f4d1e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91f00a42c0 con 0x7f91f00a6ab0 2024-09-13T10:40:42.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91f4d1e640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91f4d1e640 10 monclient(hunting): authenticate will time out at 1381.785535s 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91edd9b640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f91f00a6ab0 0x7f91f00a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:45030/0 (socket says 172.21.15.181:45030) 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91eed9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f91f013f9a0 0x7f91f0141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49544/0 (socket says 172.21.15.181:49544) 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91ee59c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f91f00a66d0 0x7f91f00a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:46636/0 (socket says 172.21.15.181:46636) 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.280+0000 7f91eed9d640 1 -- 172.21.15.181:0/729471183 learned_addr learned my addr 172.21.15.181:0/729471183 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.282+0000 7f91edd9b640 1 -- 172.21.15.181:0/729471183 >> v1:172.21.15.181:6793/0 conn(0x7f91f00a6ab0 legacy=0x7f91f00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.282+0000 7f91ee59c640 1 -- 172.21.15.181:0/729471183 >> v1:172.21.15.181:6791/0 conn(0x7f91f00a66d0 legacy=0x7f91f00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.282+0000 7f91eed9d640 1 -- 172.21.15.181:0/729471183 >> v1:172.21.15.181:6789/0 conn(0x7f91f013f9a0 legacy=0x7f91f0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.282+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2655999359 0 0) 0x7f91f00a42c0 con 0x7f91f00a6ab0 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.288 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient(hunting): my global_id is 184139 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91dc003520 con 0x7f91f00a6ab0 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4162248096 0 0) 0x7f91f00a5fe0 con 0x7f91f013f9a0 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient(hunting): my global_id is 184140 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91f00a42c0 con 0x7f91f013f9a0 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479769833 0 0) 0x7f91f00a8080 con 0x7f91f00a66d0 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient(hunting): my global_id is 174433 2024-09-13T10:40:42.289 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91f00a5fe0 con 0x7f91f00a66d0 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 928274683 0 0) 0x7f91dc003520 con 0x7f91f00a6ab0 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 >> v1:172.21.15.181:6791/0 conn(0x7f91f00a66d0 legacy=0x7f91f00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 >> v1:172.21.15.181:6789/0 conn(0x7f91f013f9a0 legacy=0x7f91f0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient: _finish_hunting 0 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 monclient: found mon.noname-e 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f01464e0 con 0x7f91f00a6ab0 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient: _finish_auth 0 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient: _check_auth_tickets 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f91d8001ad0 con 0x7f91f00a6ab0 2024-09-13T10:40:42.290 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient: dump: 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.291 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91f4d1e640 5 monclient: authenticate success, global_id 184139 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91f4d1e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91d80047e0 con 0x7f91f00a6ab0 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 1 -- 172.21.15.181:0/729471183 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f91d8004d10 con 0x7f91f00a6ab0 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91ed59a640 10 monclient: dump: 2024-09-13T10:40:42.292 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.293 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91f4d1e640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91f4d1e640 4 set_mon_vals no callback set 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91f4d1e640 10 monclient: shutdown 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91f4d1e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.283+0000 7f91f4d1e640 1 -- 172.21.15.181:0/729471183 >> v1:172.21.15.181:6793/0 conn(0x7f91f00a6ab0 legacy=0x7f91f00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.284+0000 7f91f4d1e640 1 -- 172.21.15.181:0/729471183 shutdown_connections 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.284+0000 7f91f4d1e640 1 -- 172.21.15.181:0/729471183 >> 172.21.15.181:0/729471183 conn(0x7f91f00abcd0 msgr2=0x7f91f00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.284+0000 7f91f4d1e640 1 -- 172.21.15.181:0/729471183 shutdown_connections 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.284+0000 7f91f4d1e640 1 -- 172.21.15.181:0/729471183 wait complete. 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.284+0000 7f91f4d1e640 10 monclient: build_initial_monmap 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.284+0000 7f91f4d1e640 10 monclient: monmap: 2024-09-13T10:40:42.294 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:42.295 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 1 Processor -- start 2024-09-13T10:40:42.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 1 -- start start 2024-09-13T10:40:42.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 10 monclient: init 2024-09-13T10:40:42.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:42.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 10 monclient: _add_conns ranks=[4,1,8,2,3,0,7,6,5] 2024-09-13T10:40:42.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 10 monclient(hunting): picked mon.noname-c con 0x7f91f00a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:42.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 10 monclient(hunting): picked mon.noname-f con 0x7f91f00a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:42.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 10 monclient(hunting): picked mon.noname-e con 0x7f91f013f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:42.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91f013d540 con 0x7f91f00a6ab0 2024-09-13T10:40:42.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91f013ed80 con 0x7f91f00a66d0 2024-09-13T10:40:42.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91f013f060 con 0x7f91f013f9a0 2024-09-13T10:40:42.296 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:42.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91f4d1e640 10 monclient(hunting): authenticate will time out at 1381.790561s 2024-09-13T10:40:42.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91ee59c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f91f00a66d0 0x7f91f00a21e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:46642/0 (socket says 172.21.15.181:46642) 2024-09-13T10:40:42.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.285+0000 7f91ee59c640 1 -- 172.21.15.181:0/871727407 learned_addr learned my addr 172.21.15.181:0/871727407 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:42.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91eed9d640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.181:6793/0 conn(0x7f91f013f9a0 legacy=0x7f91f01d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91ee59c640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.181:6791/0 conn(0x7f91f00a66d0 legacy=0x7f91f00a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113733534 0 0) 0x7f91f013f060 con 0x7f91f013f9a0 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91e6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91e6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91e6ffd640 10 monclient(hunting): my global_id is 184148 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91d0003550 con 0x7f91f013f9a0 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2466369003 0 0) 0x7f91f013ed80 con 0x7f91f00a66d0 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91e6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91e6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91e6ffd640 10 monclient(hunting): my global_id is 174442 2024-09-13T10:40:42.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.287+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91f013f060 con 0x7f91f00a66d0 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 60995017 0 0) 0x7f91f013f060 con 0x7f91f00a66d0 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91edd9b640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.195:6789/0 conn(0x7f91f00a6ab0 legacy=0x7f91f01d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91f013ed80 con 0x7f91f00a66d0 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f91e8004b60 con 0x7f91f00a66d0 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient(hunting): dump: 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.306 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1634465405 0 0) 0x7f91d0003550 con 0x7f91f013f9a0 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91f013f060 con 0x7f91f013f9a0 2024-09-13T10:40:42.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f91e0001c30 con 0x7f91f013f9a0 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient(hunting): dump: 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.308 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3426135113 0 0) 0x7f91f013ed80 con 0x7f91f00a66d0 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.181:6793/0 conn(0x7f91f013f9a0 legacy=0x7f91f01d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.195:6789/0 conn(0x7f91f00a6ab0 legacy=0x7f91f01d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 monclient: found mon.c 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:42.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f013f340 con 0x7f91f00a66d0 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91f4d1e640 5 monclient: authenticate success, global_id 174442 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91f4d1e640 10 monclient: _renew_subs 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91f4d1e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91f4d1e640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f91f01374e0 con 0x7f91f00a66d0 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91f4d1e640 10 monclient: _renew_subs 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91f4d1e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91f4d1e640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f91f013de20 con 0x7f91f00a66d0 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91e8005060 con 0x7f91f00a66d0 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f91e8005610 con 0x7f91f00a66d0 2024-09-13T10:40:42.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91ecd99640 4 set_mon_vals no callback set 2024-09-13T10:40:42.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:42.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.288+0000 7f91e6ffd640 10 monclient: dump: 2024-09-13T10:40:42.311 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.311 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.311 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.311 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.311 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.311 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.311 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.311 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.311 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.289+0000 7f91f4d1e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.289+0000 7f91f4d1e640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f91d40065c0 con 0x7f91d4002860 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.289+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f91e8011c90 con 0x7f91f00a66d0 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.289+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f91e804e5e0 con 0x7f91f00a66d0 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.289+0000 7f91eed9d640 10 monclient: get_auth_request con 0x7f91d0040170 auth_method 0 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91edd9b640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.181:6791/0 conn(0x7f91d4002860 legacy=0x7f91d4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.312 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440457319 0 0) 0x7f91d40065c0 con 0x7f91d4002860 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 10 monclient(hunting): my global_id is 174451 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91f013ed80 con 0x7f91d4002860 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2986282708 0 0) 0x7f91f013ed80 con 0x7f91d4002860 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91d40065c0 con 0x7f91d4002860 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f91d8001d20 con 0x7f91d4002860 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 10 monclient: dump: 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.313 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.314 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 225214820 0 0) 0x7f91d40065c0 con 0x7f91d4002860 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.291+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91d400a160 con 0x7f91d4002860 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.292+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f91d8004890 con 0x7f91d4002860 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.292+0000 7f91e6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.292+0000 7f91e6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.292+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.181:6791/0 conn(0x7f91d4002860 legacy=0x7f91d4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.292+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.181:6791/0 conn(0x7f91d4002860 legacy=0x7f91d4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.298+0000 7f91f4d1e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.298+0000 7f91f4d1e640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f91d4009e40 con 0x7f91d4009100 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91edd9b640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.181:6791/0 conn(0x7f91d4009100 legacy=0x7f91d4009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3371929264 0 0) 0x7f91d4009e40 con 0x7f91d4009100 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 10 monclient(hunting): my global_id is 174460 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91d40065c0 con 0x7f91d4009100 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3072625694 0 0) 0x7f91d40065c0 con 0x7f91d4009100 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91d4009e40 con 0x7f91d4009100 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f91d8005390 con 0x7f91d4009100 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 10 monclient: dump: 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.316 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2085949118 0 0) 0x7f91d4009e40 con 0x7f91d4009100 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.300+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 --> v1:172.21.15.181:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f91d400c3f0 con 0x7f91d4009100 2024-09-13T10:40:42.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 <== mon.4 v1:172.21.15.181:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7559 (unknown 0 0 170786452) 0x7f91d8007d90 con 0x7f91d4009100 2024-09-13T10:40:42.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91e6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:42.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91e6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:42.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.181:6791/0 conn(0x7f91d4009100 legacy=0x7f91d4009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91e6ffd640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.181:6791/0 conn(0x7f91d4009100 legacy=0x7f91d4009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.318 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:42.318 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:42.318 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:42.318 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:42.318 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 148, 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 55482, 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.319 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.320 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.321 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:42.322 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.323 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.324 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.324 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.324 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.324 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.324 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.324 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:42.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.324 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:42.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.324 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:42.324 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:42.324 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.326 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.327 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:42.328 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.328 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.328 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.328 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.328 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.328 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.328 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.328 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.328 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.329 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.330 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.331 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.332 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:42.332 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.332 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.332 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.332 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.332 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.332 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.332 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.334 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:42.335 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.336 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.337 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.338 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.338 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:40:42.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.338 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.338 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:42.338 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:42.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91f4d1e640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.195:6800/1839191919 conn(0x7f91d0040170 legacy=0x7f91d0042630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91f4d1e640 10 monclient: shutdown 2024-09-13T10:40:42.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91f4d1e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91f4d1e640 1 -- 172.21.15.181:0/871727407 >> v1:172.21.15.181:6791/0 conn(0x7f91f00a66d0 legacy=0x7f91f00a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91eed9d640 1 -- 172.21.15.181:0/871727407 reap_dead start 2024-09-13T10:40:42.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91eed9d640 1 -- 172.21.15.181:0/871727407 reap_dead start 2024-09-13T10:40:42.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91f4d1e640 1 -- 172.21.15.181:0/871727407 shutdown_connections 2024-09-13T10:40:42.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91f4d1e640 1 -- 172.21.15.181:0/871727407 >> 172.21.15.181:0/871727407 conn(0x7f91f00abcd0 msgr2=0x7f91f0138cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91f4d1e640 1 -- 172.21.15.181:0/871727407 shutdown_connections 2024-09-13T10:40:42.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.301+0000 7f91f4d1e640 1 -- 172.21.15.181:0/871727407 wait complete. 2024-09-13T10:40:42.340 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:40:42.340 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-13T10:40:42.341 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-13T10:40:42.439 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.438+0000 7f3e49baa640 10 monclient: get_monmap_and_config 2024-09-13T10:40:42.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.438+0000 7f3e49baa640 10 monclient: build_initial_monmap 2024-09-13T10:40:42.440 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.438+0000 7f3e49baa640 10 monclient: monmap: 2024-09-13T10:40:42.440 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:42.440 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.440 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:42.439018+0000 2024-09-13T10:40:42.440 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:42.439018+0000 2024-09-13T10:40:42.440 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:42.440 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.440 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:42.441 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:42.441 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:42.441 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:42.441 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:42.441 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:42.441 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:42.441 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:42.441 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:42.441 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 1 Processor -- start 2024-09-13T10:40:42.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 1 -- start start 2024-09-13T10:40:42.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 10 monclient: init 2024-09-13T10:40:42.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:42.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 10 monclient: _add_conns ranks=[3,8,4,6,0,7,2,5,1] 2024-09-13T10:40:42.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 10 monclient(hunting): picked mon.noname-g con 0x7f3e440a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:42.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 10 monclient(hunting): picked mon.noname-e con 0x7f3e440a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 10 monclient(hunting): picked mon.noname-c con 0x7f3e4413f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e440a4bc0 con 0x7f3e440a6640 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e4413a320 con 0x7f3e4413f750 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e440a8100 con 0x7f3e440a8340 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e49baa640 10 monclient(hunting): authenticate will time out at 1381.944779s 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e42ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f3e440a8340 0x7f3e44139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:45056/0 (socket says 172.21.15.181:45056) 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e42ffd640 1 -- 172.21.15.181:0/2127131274 learned_addr learned my addr 172.21.15.181:0/2127131274 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.439+0000 7f3e43fff640 1 --1- 172.21.15.181:0/2127131274 >> v1:172.21.15.181:6791/0 conn(0x7f3e4413f750 0x7f3e44141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:46670/0 (socket says 172.21.15.181:46670) 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e42ffd640 1 -- 172.21.15.181:0/2127131274 >> v1:172.21.15.181:6793/0 conn(0x7f3e440a8340 legacy=0x7f3e44139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e43fff640 1 -- 172.21.15.181:0/2127131274 >> v1:172.21.15.181:6791/0 conn(0x7f3e4413f750 legacy=0x7f3e44141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 1 -- 172.21.15.181:0/2127131274 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940982415 0 0) 0x7f3e4413a320 con 0x7f3e4413f750 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient(hunting): my global_id is 174469 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 1 -- 172.21.15.181:0/2127131274 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e2c003520 con 0x7f3e4413f750 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e437fe640 1 -- 172.21.15.181:0/2127131274 >> v1:172.21.15.195:6790/0 conn(0x7f3e440a6640 legacy=0x7f3e44139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 1 -- 172.21.15.181:0/2127131274 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2241970171 0 0) 0x7f3e440a8100 con 0x7f3e440a8340 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient(hunting): my global_id is 184157 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 1 -- 172.21.15.181:0/2127131274 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e4413a320 con 0x7f3e440a8340 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 1 -- 172.21.15.181:0/2127131274 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2989363833 0 0) 0x7f3e2c003520 con 0x7f3e4413f750 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 1 -- 172.21.15.181:0/2127131274 >> v1:172.21.15.181:6793/0 conn(0x7f3e440a8340 legacy=0x7f3e44139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 1 -- 172.21.15.181:0/2127131274 >> v1:172.21.15.195:6790/0 conn(0x7f3e440a6640 legacy=0x7f3e44139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient: _finish_hunting 0 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 1 monclient: found mon.noname-c 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 1 -- 172.21.15.181:0/2127131274 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e440a48e0 con 0x7f3e4413f750 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient: _finish_auth 0 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient: _check_auth_tickets 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 1 -- 172.21.15.181:0/2127131274 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e3c001d90 con 0x7f3e4413f750 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e49baa640 5 monclient: authenticate success, global_id 174469 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e49baa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient: dump: 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.449 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e49baa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 1 -- 172.21.15.181:0/2127131274 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e3c002060 con 0x7f3e4413f750 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e49baa640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 1 -- 172.21.15.181:0/2127131274 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e3c004ea0 con 0x7f3e4413f750 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e49baa640 4 set_mon_vals no callback set 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e427fc640 10 monclient: dump: 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.450 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.451 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.452 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e49baa640 10 monclient: shutdown 2024-09-13T10:40:42.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e49baa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.442+0000 7f3e49baa640 1 -- 172.21.15.181:0/2127131274 >> v1:172.21.15.181:6791/0 conn(0x7f3e4413f750 legacy=0x7f3e44141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.443+0000 7f3e49baa640 1 -- 172.21.15.181:0/2127131274 shutdown_connections 2024-09-13T10:40:42.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.443+0000 7f3e49baa640 1 -- 172.21.15.181:0/2127131274 >> 172.21.15.181:0/2127131274 conn(0x7f3e44077170 msgr2=0x7f3e440abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.443+0000 7f3e49baa640 1 -- 172.21.15.181:0/2127131274 shutdown_connections 2024-09-13T10:40:42.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.443+0000 7f3e49baa640 1 -- 172.21.15.181:0/2127131274 wait complete. 2024-09-13T10:40:42.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.443+0000 7f3e49baa640 10 monclient: build_initial_monmap 2024-09-13T10:40:42.452 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.443+0000 7f3e49baa640 10 monclient: monmap: 2024-09-13T10:40:42.452 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:42.452 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:42.453 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:42.454 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.443+0000 7f3e49baa640 1 Processor -- start 2024-09-13T10:40:42.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e49baa640 1 -- start start 2024-09-13T10:40:42.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e49baa640 10 monclient: init 2024-09-13T10:40:42.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e49baa640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:42.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e49baa640 10 monclient: _add_conns ranks=[4,7,0,5,6,8,3,2,1] 2024-09-13T10:40:42.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e49baa640 10 monclient(hunting): picked mon.noname-c con 0x7f3e440a8340 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:42.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e49baa640 10 monclient(hunting): picked mon.noname-i con 0x7f3e4413f750 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:42.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e49baa640 10 monclient(hunting): picked mon.noname-a con 0x7f3e4413ce40 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:42.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e49baa640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e440a9ee0 con 0x7f3e4413ce40 2024-09-13T10:40:42.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e49baa640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e44134350 con 0x7f3e440a8340 2024-09-13T10:40:42.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e49baa640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e4413e740 con 0x7f3e4413f750 2024-09-13T10:40:42.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e49baa640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:42.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e49baa640 10 monclient(hunting): authenticate will time out at 1381.949731s 2024-09-13T10:40:42.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e437fe640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f3e440a8340 0x7f3e4412f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:46676/0 (socket says 172.21.15.181:46676) 2024-09-13T10:40:42.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.444+0000 7f3e437fe640 1 -- 172.21.15.181:0/3720810312 learned_addr learned my addr 172.21.15.181:0/3720810312 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:42.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.446+0000 7f3e437fe640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6791/0 conn(0x7f3e440a8340 legacy=0x7f3e4412f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.446+0000 7f3e43fff640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6789/0 conn(0x7f3e4413ce40 legacy=0x7f3e441d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.446+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 47290693 0 0) 0x7f3e44134350 con 0x7f3e440a8340 2024-09-13T10:40:42.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): my global_id is 174478 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e30003550 con 0x7f3e440a8340 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 554540284 0 0) 0x7f3e440a9ee0 con 0x7f3e4413ce40 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): my global_id is 184149 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e44134350 con 0x7f3e4413ce40 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e42ffd640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.195:6792/0 conn(0x7f3e4413f750 legacy=0x7f3e441d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3851821868 0 0) 0x7f3e30003550 con 0x7f3e440a8340 2024-09-13T10:40:42.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e440a9ee0 con 0x7f3e440a8340 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e34003610 con 0x7f3e440a8340 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): dump: 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.461 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.462 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.462 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.462 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.462 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.462 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.462 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.462 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:42.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1251279505 0 0) 0x7f3e44134350 con 0x7f3e4413ce40 2024-09-13T10:40:42.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e30003550 con 0x7f3e4413ce40 2024-09-13T10:40:42.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e3c001df0 con 0x7f3e4413ce40 2024-09-13T10:40:42.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient(hunting): dump: 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.463 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3777932453 0 0) 0x7f3e440a9ee0 con 0x7f3e440a8340 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.195:6792/0 conn(0x7f3e4413f750 legacy=0x7f3e441d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6789/0 conn(0x7f3e4413ce40 legacy=0x7f3e441d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 monclient: found mon.c 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:42.464 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4413e2d0 con 0x7f3e440a8340 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient: _finish_auth 0 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e49baa640 5 monclient: authenticate success, global_id 174478 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e49baa640 10 monclient: _renew_subs 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e49baa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e49baa640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3e44139020 con 0x7f3e440a8340 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e49baa640 10 monclient: _renew_subs 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e49baa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e49baa640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f3e4413d7f0 con 0x7f3e440a8340 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e34003bc0 con 0x7f3e440a8340 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e340040b0 con 0x7f3e440a8340 2024-09-13T10:40:42.465 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e41ffb640 4 set_mon_vals no callback set 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.447+0000 7f3e2bfff640 10 monclient: dump: 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.466 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.448+0000 7f3e49baa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.448+0000 7f3e49baa640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3e240065c0 con 0x7f3e24002860 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.448+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3e34004250 con 0x7f3e440a8340 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.448+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f3e3404e260 con 0x7f3e440a8340 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.449+0000 7f3e43fff640 10 monclient: get_auth_request con 0x7f3e30040130 auth_method 0 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.450+0000 7f3e42ffd640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e24002860 legacy=0x7f3e24004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.467 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.450+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1749485331 0 0) 0x7f3e240065c0 con 0x7f3e24002860 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.450+0000 7f3e2bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.450+0000 7f3e2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.450+0000 7f3e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.450+0000 7f3e2bfff640 10 monclient(hunting): my global_id is 174399 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.450+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e440a9ee0 con 0x7f3e24002860 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3889953162 0 0) 0x7f3e440a9ee0 con 0x7f3e24002860 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e240065c0 con 0x7f3e24002860 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e38001320 con 0x7f3e24002860 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 10 monclient: dump: 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.468 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.469 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2838614391 0 0) 0x7f3e240065c0 con 0x7f3e24002860 2024-09-13T10:40:42.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e2400a160 con 0x7f3e24002860 2024-09-13T10:40:42.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3e38004910 con 0x7f3e24002860 2024-09-13T10:40:42.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:42.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:42.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e24002860 legacy=0x7f3e24004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.470 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.451+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e24002860 legacy=0x7f3e24004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.457+0000 7f3e49baa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:42.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.457+0000 7f3e49baa640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3e24009e40 con 0x7f3e24009100 2024-09-13T10:40:42.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e42ffd640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e24009100 legacy=0x7f3e24009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.472 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3088797337 0 0) 0x7f3e24009e40 con 0x7f3e24009100 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e2bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e2bfff640 10 monclient(hunting): my global_id is 174408 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e240065c0 con 0x7f3e24009100 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e42ffd640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e24009100 legacy=0x7f3e24009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e42ffd640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e24009100 legacy=0x7f3e24009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e42ffd640 1 --1- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e24009100 0x7f3e24009590 :-1 s=OPENED pgs=683 cs=1 l=1).handle_message read tag failed 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e42ffd640 1 --1- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e24009100 0x7f3e24009590 :-1 s=OPENED pgs=683 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e24009100 legacy=0x7f3e24009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e24009100 legacy=0x7f3e24009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.460+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3e24009e40 con 0x7f3e30048090 2024-09-13T10:40:42.473 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e42ffd640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e30048090 legacy=0x7f3e300465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383262756 0 0) 0x7f3e24009e40 con 0x7f3e30048090 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e2bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e2bfff640 10 monclient(hunting): my global_id is 174417 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e440a9ee0 con 0x7f3e30048090 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1171236074 0 0) 0x7f3e440a9ee0 con 0x7f3e30048090 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e24009e40 con 0x7f3e30048090 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3e38005100 con 0x7f3e30048090 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e2bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.462+0000 7f3e2bfff640 10 monclient: dump: 2024-09-13T10:40:42.474 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.475 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2221517033 0 0) 0x7f3e24009e40 con 0x7f3e30048090 2024-09-13T10:40:42.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 --> v1:172.21.15.181:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3e38004910 con 0x7f3e30048090 2024-09-13T10:40:42.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 <== mon.6 v1:172.21.15.181:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 3064686050) 0x7f3e38007480 con 0x7f3e30048090 2024-09-13T10:40:42.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e2bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:42.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e2bfff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:42.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e30048090 legacy=0x7f3e300465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e2bfff640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6792/0 conn(0x7f3e30048090 legacy=0x7f3e300465e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.476 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e43fff640 1 -- 172.21.15.181:0/3720810312 reap_dead start 2024-09-13T10:40:42.476 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:42.476 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 148, 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 55644, 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:42.477 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.478 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.479 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.480 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.481 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:42.482 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.483 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.485 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.486 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.487 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.488 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.489 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:42.490 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.491 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.493 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.494 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.495 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.496 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.496 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:42.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.496 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.496 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.496 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.496 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.496 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.496 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:42.496 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:42.497 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e49baa640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3e30040130 legacy=0x7f3e300425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e49baa640 10 monclient: shutdown 2024-09-13T10:40:42.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e49baa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e49baa640 1 -- 172.21.15.181:0/3720810312 >> v1:172.21.15.181:6791/0 conn(0x7f3e440a8340 legacy=0x7f3e4412f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e49baa640 1 -- 172.21.15.181:0/3720810312 shutdown_connections 2024-09-13T10:40:42.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e49baa640 1 -- 172.21.15.181:0/3720810312 >> 172.21.15.181:0/3720810312 conn(0x7f3e440a6640 msgr2=0x7f3e440a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e49baa640 1 -- 172.21.15.181:0/3720810312 shutdown_connections 2024-09-13T10:40:42.498 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.463+0000 7f3e49baa640 1 -- 172.21.15.181:0/3720810312 wait complete. 2024-09-13T10:40:42.498 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:40:42.498 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-13T10:40:42.499 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-13T10:40:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.599+0000 7ff5d4364640 10 monclient: get_monmap_and_config 2024-09-13T10:40:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.599+0000 7ff5d4364640 10 monclient: build_initial_monmap 2024-09-13T10:40:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.599+0000 7ff5d4364640 10 monclient: monmap: 2024-09-13T10:40:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:42.600273+0000 2024-09-13T10:40:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:42.600273+0000 2024-09-13T10:40:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.601 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:42.602 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:42.602 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:42.602 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:42.602 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:42.602 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:42.602 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:42.602 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:42.602 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:42.602 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.603 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.600+0000 7ff5d4364640 1 Processor -- start 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.600+0000 7ff5d4364640 1 -- start start 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.600+0000 7ff5d4364640 10 monclient: init 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.600+0000 7ff5d4364640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.600+0000 7ff5d4364640 10 monclient: _add_conns ranks=[5,3,6,4,8,2,0,7,1] 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.600+0000 7ff5d4364640 10 monclient(hunting): picked mon.noname-h con 0x7ff5cc0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.600+0000 7ff5d4364640 10 monclient(hunting): picked mon.noname-g con 0x7ff5cc0a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.600+0000 7ff5d4364640 10 monclient(hunting): picked mon.noname-d con 0x7ff5cc13f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.601+0000 7ff5d4364640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5cc0a5fe0 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.601+0000 7ff5d4364640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5cc0a8080 con 0x7ff5cc0a66d0 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.601+0000 7ff5d4364640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5cc0a42c0 con 0x7ff5cc13f9a0 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.601+0000 7ff5d4364640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.601+0000 7ff5d4364640 10 monclient(hunting): authenticate will time out at 1382.106053s 2024-09-13T10:40:42.604 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.601+0000 7ff5d2901640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7ff5cc13f9a0 0x7ff5cc141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:56812/0 (socket says 172.21.15.181:56812) 2024-09-13T10:40:42.605 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.601+0000 7ff5d2901640 1 -- 172.21.15.181:0/3205291141 learned_addr learned my addr 172.21.15.181:0/3205291141 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:42.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d2901640 1 -- 172.21.15.181:0/3205291141 >> v1:172.21.15.181:6792/0 conn(0x7ff5cc13f9a0 legacy=0x7ff5cc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286086112 0 0) 0x7ff5cc0a42c0 con 0x7ff5cc13f9a0 2024-09-13T10:40:42.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d18ff640 1 -- 172.21.15.181:0/3205291141 >> v1:172.21.15.195:6790/0 conn(0x7ff5cc0a6ab0 legacy=0x7ff5cc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.608 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient(hunting): my global_id is 174426 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5b8003520 con 0x7ff5cc13f9a0 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d2100640 1 -- 172.21.15.181:0/3205291141 >> v1:172.21.15.195:6791/0 conn(0x7ff5cc0a66d0 legacy=0x7ff5cc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636236911 0 0) 0x7ff5cc0a5fe0 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient(hunting): my global_id is 184116 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5cc0a42c0 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1015829340 0 0) 0x7ff5cc0a8080 con 0x7ff5cc0a66d0 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.609 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient(hunting): my global_id is 106097 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5cc0a5fe0 con 0x7ff5cc0a66d0 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2387435682 0 0) 0x7ff5b8003520 con 0x7ff5cc13f9a0 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 >> v1:172.21.15.195:6791/0 conn(0x7ff5cc0a66d0 legacy=0x7ff5cc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 >> v1:172.21.15.195:6790/0 conn(0x7ff5cc0a6ab0 legacy=0x7ff5cc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient: _finish_hunting 0 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 monclient: found mon.noname-d 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc1464e0 con 0x7ff5cc13f9a0 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient: _finish_auth 0 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient: _check_auth_tickets 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff5c4001e50 con 0x7ff5cc13f9a0 2024-09-13T10:40:42.610 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d4364640 5 monclient: authenticate success, global_id 174426 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d4364640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient: dump: 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.611 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d4364640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5c40020a0 con 0x7ff5cc13f9a0 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 1 -- 172.21.15.181:0/3205291141 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff5c4004f60 con 0x7ff5cc13f9a0 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d4364640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d4364640 4 set_mon_vals no callback set 2024-09-13T10:40:42.612 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.603+0000 7ff5d10fe640 10 monclient: dump: 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.613 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.604+0000 7ff5d4364640 10 monclient: shutdown 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.604+0000 7ff5d4364640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.604+0000 7ff5d4364640 1 -- 172.21.15.181:0/3205291141 >> v1:172.21.15.181:6792/0 conn(0x7ff5cc13f9a0 legacy=0x7ff5cc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.604+0000 7ff5d4364640 1 -- 172.21.15.181:0/3205291141 shutdown_connections 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.604+0000 7ff5d4364640 1 -- 172.21.15.181:0/3205291141 >> 172.21.15.181:0/3205291141 conn(0x7ff5cc0abcd0 msgr2=0x7ff5cc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.604+0000 7ff5d4364640 1 -- 172.21.15.181:0/3205291141 shutdown_connections 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.604+0000 7ff5d4364640 1 -- 172.21.15.181:0/3205291141 wait complete. 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.604+0000 7ff5d4364640 10 monclient: build_initial_monmap 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.604+0000 7ff5d4364640 10 monclient: monmap: 2024-09-13T10:40:42.614 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:42.615 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 1 Processor -- start 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 1 -- start start 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 10 monclient: init 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 10 monclient: _add_conns ranks=[2,4,5,7,1,0,8,3,6] 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 10 monclient(hunting): picked mon.noname-b con 0x7ff5cc0a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 10 monclient(hunting): picked mon.noname-c con 0x7ff5cc0a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 10 monclient(hunting): picked mon.noname-h con 0x7ff5cc13f9a0 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5cc13f780 con 0x7ff5cc0a66d0 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5cc13df80 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5cc068a70 con 0x7ff5cc13f9a0 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:42.616 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d4364640 10 monclient(hunting): authenticate will time out at 1382.110750s 2024-09-13T10:40:42.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d2100640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7ff5cc0a66d0 0x7ff5cc1ce810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:42696/0 (socket says 172.21.15.181:42696) 2024-09-13T10:40:42.617 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.605+0000 7ff5d2100640 1 -- 172.21.15.181:0/2651080423 learned_addr learned my addr 172.21.15.181:0/2651080423 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:42.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.607+0000 7ff5d2100640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.181:6790/0 conn(0x7ff5cc0a66d0 legacy=0x7ff5cc1ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.620 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.607+0000 7ff5d18ff640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.181:6791/0 conn(0x7ff5cc0a6ab0 legacy=0x7ff5cc1d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5d2100640 1 --1- 172.21.15.181:0/2651080423 >> v1:172.21.15.181:6790/0 conn(0x7ff5cc0a66d0 0x7ff5cc1ce810 :-1 s=OPENED pgs=547 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7ff5cc13f780 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051722264 0 0) 0x7ff5cc13df80 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient(hunting): my global_id is 174487 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5d2901640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.195:6791/0 conn(0x7ff5cc13f9a0 legacy=0x7ff5cc1d6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5b0003550 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2784122373 0 0) 0x7ff5b0003550 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5cc13df80 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff5bc003610 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:42.621 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient(hunting): dump: 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.622 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 112850915 0 0) 0x7ff5cc13df80 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.195:6791/0 conn(0x7ff5cc13f9a0 legacy=0x7ff5cc1d6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.181:6790/0 conn(0x7ff5cc0a66d0 legacy=0x7ff5cc1ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 monclient: found mon.c 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc13d420 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient: _finish_auth 0 2024-09-13T10:40:42.623 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:40:42.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:42.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2444681334 0 0) 0x7ff5cc13f780 con 0x7ff5cc0a66d0 2024-09-13T10:40:42.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5d4364640 5 monclient: authenticate success, global_id 174487 2024-09-13T10:40:42.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:40:42.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5d4364640 10 monclient: _renew_subs 2024-09-13T10:40:42.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5d4364640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:42.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5d4364640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff5cc13eee0 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5d4364640 10 monclient: _renew_subs 2024-09-13T10:40:42.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5d4364640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:42.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5d4364640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7ff5cc09d2d0 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5bc003bd0 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.624 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff5bc0040c0 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5d08fd640 4 set_mon_vals no callback set 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.608+0000 7ff5c2ffd640 10 monclient: dump: 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.625 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.609+0000 7ff5d4364640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.609+0000 7ff5d4364640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff5b40065c0 con 0x7ff5b4002860 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.609+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff5bc004260 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.609+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7ff5bc04e2e0 con 0x7ff5cc0a6ab0 2024-09-13T10:40:42.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.609+0000 7ff5d2901640 10 monclient: get_auth_request con 0x7ff5b003fa90 auth_method 0 2024-09-13T10:40:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5d2100640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.181:6793/0 conn(0x7ff5b4002860 legacy=0x7ff5b4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 993591764 0 0) 0x7ff5b40065c0 con 0x7ff5b4002860 2024-09-13T10:40:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 10 monclient(hunting): my global_id is 184166 2024-09-13T10:40:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5cc13f780 con 0x7ff5b4002860 2024-09-13T10:40:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1342241273 0 0) 0x7ff5cc13f780 con 0x7ff5b4002860 2024-09-13T10:40:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5b40065c0 con 0x7ff5b4002860 2024-09-13T10:40:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff5c8001c20 con 0x7ff5b4002860 2024-09-13T10:40:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 10 monclient: dump: 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.628 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.629 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.629 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.629 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.611+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2970242556 0 0) 0x7ff5b40065c0 con 0x7ff5b4002860 2024-09-13T10:40:42.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.612+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5b400a160 con 0x7ff5b4002860 2024-09-13T10:40:42.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.612+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff5c8006830 con 0x7ff5b4002860 2024-09-13T10:40:42.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.612+0000 7ff5c2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:42.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.612+0000 7ff5c2ffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:42.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.612+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.181:6793/0 conn(0x7ff5b4002860 legacy=0x7ff5b4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.612+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.181:6793/0 conn(0x7ff5b4002860 legacy=0x7ff5b4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.618+0000 7ff5d4364640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:42.629 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.618+0000 7ff5d4364640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff5b4009e70 con 0x7ff5b4009130 2024-09-13T10:40:42.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5d2100640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.181:6793/0 conn(0x7ff5b4009130 legacy=0x7ff5b40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2521718043 0 0) 0x7ff5b4009e70 con 0x7ff5b4009130 2024-09-13T10:40:42.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 10 monclient(hunting): my global_id is 184175 2024-09-13T10:40:42.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5b40065c0 con 0x7ff5b4009130 2024-09-13T10:40:42.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4121469699 0 0) 0x7ff5b40065c0 con 0x7ff5b4009130 2024-09-13T10:40:42.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5b4009e70 con 0x7ff5b4009130 2024-09-13T10:40:42.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff5c8003d80 con 0x7ff5b4009130 2024-09-13T10:40:42.631 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 10 monclient: dump: 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.632 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.633 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.633 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.633 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.633 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.633 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 963768006 0 0) 0x7ff5b4009e70 con 0x7ff5b4009130 2024-09-13T10:40:42.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.620+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 --> v1:172.21.15.181:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff5b400c410 con 0x7ff5b4009130 2024-09-13T10:40:42.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 <== mon.8 v1:172.21.15.181:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 3154128584) 0x7ff5c80040d0 con 0x7ff5b4009130 2024-09-13T10:40:42.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5c2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:42.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5c2ffd640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:42.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.181:6793/0 conn(0x7ff5b4009130 legacy=0x7ff5b40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.633 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5c2ffd640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.181:6793/0 conn(0x7ff5b4009130 legacy=0x7ff5b40095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.634 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:42.634 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:42.634 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:42.634 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:42.634 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 148, 2024-09-13T10:40:42.634 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 7270, 2024-09-13T10:40:42.634 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:42.634 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:40:42.634 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:42.634 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:42.634 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.635 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.636 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:42.637 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.638 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:42.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.641 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:42.642 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.643 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.644 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.645 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:42.646 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.647 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.648 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:42.649 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.650 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.651 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.652 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.653 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.653 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.653 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.653 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:42.653 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:42.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5d4364640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff5b003fa90 legacy=0x7ff5b0041f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5d4364640 10 monclient: shutdown 2024-09-13T10:40:42.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5d4364640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5d4364640 1 -- 172.21.15.181:0/2651080423 >> v1:172.21.15.181:6791/0 conn(0x7ff5cc0a6ab0 legacy=0x7ff5cc1d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.654 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5d2901640 1 -- 172.21.15.181:0/2651080423 reap_dead start 2024-09-13T10:40:42.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5d2901640 1 -- 172.21.15.181:0/2651080423 reap_dead start 2024-09-13T10:40:42.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5d4364640 1 -- 172.21.15.181:0/2651080423 shutdown_connections 2024-09-13T10:40:42.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5d4364640 1 -- 172.21.15.181:0/2651080423 >> 172.21.15.181:0/2651080423 conn(0x7ff5cc0abcd0 msgr2=0x7ff5cc137d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5d4364640 1 -- 172.21.15.181:0/2651080423 shutdown_connections 2024-09-13T10:40:42.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.621+0000 7ff5d4364640 1 -- 172.21.15.181:0/2651080423 wait complete. 2024-09-13T10:40:42.655 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:40:42.655 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-13T10:40:42.655 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-13T10:40:42.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.752+0000 7f076a495640 10 monclient: get_monmap_and_config 2024-09-13T10:40:42.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.752+0000 7f076a495640 10 monclient: build_initial_monmap 2024-09-13T10:40:42.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.752+0000 7f076a495640 10 monclient: monmap: 2024-09-13T10:40:42.754 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:42.754 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.754 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:42.753102+0000 2024-09-13T10:40:42.754 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:42.753102+0000 2024-09-13T10:40:42.754 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:42.754 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.754 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:42.754 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:42.755 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:42.755 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:42.755 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:42.755 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:42.755 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:42.755 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:42.755 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:42.755 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 1 Processor -- start 2024-09-13T10:40:42.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 1 -- start start 2024-09-13T10:40:42.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 10 monclient: init 2024-09-13T10:40:42.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:42.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 10 monclient: _add_conns ranks=[0,1,5,4,7,3,2,6,8] 2024-09-13T10:40:42.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 10 monclient(hunting): picked mon.noname-a con 0x7f07641399b0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:42.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 10 monclient(hunting): picked mon.noname-f con 0x7f076409d2a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:42.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 10 monclient(hunting): picked mon.noname-h con 0x7f0764139d90 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:42.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07640a8070 con 0x7f07641399b0 2024-09-13T10:40:42.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f076409cb80 con 0x7f076409d2a0 2024-09-13T10:40:42.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f076409e4c0 con 0x7f0764139d90 2024-09-13T10:40:42.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:42.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f076a495640 10 monclient(hunting): authenticate will time out at 1382.258820s 2024-09-13T10:40:42.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f0763fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f07641399b0 0x7f07640a64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49564/0 (socket says 172.21.15.181:49564) 2024-09-13T10:40:42.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.753+0000 7f0763fff640 1 -- 172.21.15.181:0/1384932818 learned_addr learned my addr 172.21.15.181:0/1384932818 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:42.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0763fff640 1 -- 172.21.15.181:0/1384932818 >> v1:172.21.15.181:6789/0 conn(0x7f07641399b0 legacy=0x7f07640a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f07637fe640 1 -- 172.21.15.181:0/1384932818 >> v1:172.21.15.195:6789/0 conn(0x7f076409d2a0 legacy=0x7f07640a6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0768a32640 1 -- 172.21.15.181:0/1384932818 >> v1:172.21.15.195:6791/0 conn(0x7f0764139d90 legacy=0x7f07640a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197482364 0 0) 0x7f07640a8070 con 0x7f07641399b0 2024-09-13T10:40:42.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient(hunting): my global_id is 184158 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f074c003520 con 0x7f07641399b0 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014685170 0 0) 0x7f076409cb80 con 0x7f076409d2a0 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient(hunting): my global_id is 135145 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07640a8070 con 0x7f076409d2a0 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081096350 0 0) 0x7f076409e4c0 con 0x7f0764139d90 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient(hunting): my global_id is 106106 2024-09-13T10:40:42.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f076409cb80 con 0x7f0764139d90 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2769290131 0 0) 0x7f074c003520 con 0x7f07641399b0 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 >> v1:172.21.15.195:6791/0 conn(0x7f0764139d90 legacy=0x7f07640a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 >> v1:172.21.15.195:6789/0 conn(0x7f076409d2a0 legacy=0x7f07640a6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 monclient: found mon.noname-a 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07640a82b0 con 0x7f07641399b0 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient: _finish_auth 0 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0754001ad0 con 0x7f07641399b0 2024-09-13T10:40:42.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f076a495640 5 monclient: authenticate success, global_id 184158 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f076a495640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient: dump: 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.768 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f076a495640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f07540048a0 con 0x7f07641399b0 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f076a495640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 1 -- 172.21.15.181:0/1384932818 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0754004e10 con 0x7f07641399b0 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f076a495640 4 set_mon_vals no callback set 2024-09-13T10:40:42.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.756+0000 7f0762ffd640 10 monclient: dump: 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.770 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.771 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.771 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.757+0000 7f076a495640 10 monclient: shutdown 2024-09-13T10:40:42.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.757+0000 7f076a495640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.757+0000 7f076a495640 1 -- 172.21.15.181:0/1384932818 >> v1:172.21.15.181:6789/0 conn(0x7f07641399b0 legacy=0x7f07640a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.757+0000 7f076a495640 1 -- 172.21.15.181:0/1384932818 shutdown_connections 2024-09-13T10:40:42.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.757+0000 7f076a495640 1 -- 172.21.15.181:0/1384932818 >> 172.21.15.181:0/1384932818 conn(0x7f07640abdb0 msgr2=0x7f07640ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.757+0000 7f076a495640 1 -- 172.21.15.181:0/1384932818 shutdown_connections 2024-09-13T10:40:42.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.757+0000 7f076a495640 1 -- 172.21.15.181:0/1384932818 wait complete. 2024-09-13T10:40:42.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.758+0000 7f076a495640 10 monclient: build_initial_monmap 2024-09-13T10:40:42.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.758+0000 7f076a495640 10 monclient: monmap: 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:42.772 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.758+0000 7f076a495640 1 Processor -- start 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.758+0000 7f076a495640 1 -- start start 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.758+0000 7f076a495640 10 monclient: init 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.758+0000 7f076a495640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.758+0000 7f076a495640 10 monclient: _add_conns ranks=[6,0,7,2,8,1,3,5,4] 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.758+0000 7f076a495640 10 monclient(hunting): picked mon.noname-d con 0x7f076409d2a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.758+0000 7f076a495640 10 monclient(hunting): picked mon.noname-a con 0x7f07641399b0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.758+0000 7f076a495640 10 monclient(hunting): picked mon.noname-i con 0x7f0764139d90 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.759+0000 7f076a495640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0764137dc0 con 0x7f07641399b0 2024-09-13T10:40:42.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.759+0000 7f076a495640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07640a9160 con 0x7f076409d2a0 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.759+0000 7f076a495640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07641cf530 con 0x7f0764139d90 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.759+0000 7f076a495640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.759+0000 7f076a495640 10 monclient(hunting): authenticate will time out at 1382.264071s 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.759+0000 7f07637fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f07641399b0 0x7f07641cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49570/0 (socket says 172.21.15.181:49570) 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.759+0000 7f0763fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f076409d2a0 0x7f07641ce710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:56822/0 (socket says 172.21.15.181:56822) 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.759+0000 7f07637fe640 1 -- 172.21.15.181:0/1400491496 learned_addr learned my addr 172.21.15.181:0/1400491496 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f07637fe640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.181:6789/0 conn(0x7f07641399b0 legacy=0x7f07641cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0763fff640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.181:6792/0 conn(0x7f076409d2a0 legacy=0x7f07641ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 166131113 0 0) 0x7f0764137dc0 con 0x7f07641399b0 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): my global_id is 184167 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0768a32640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.195:6792/0 conn(0x7f0764139d90 legacy=0x7f07641d6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0750003520 con 0x7f07641399b0 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4123620919 0 0) 0x7f07640a9160 con 0x7f076409d2a0 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): my global_id is 174435 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0764137dc0 con 0x7f076409d2a0 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785666022 0 0) 0x7f07641cf530 con 0x7f0764139d90 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): my global_id is 58129 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07640a9160 con 0x7f0764139d90 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3416161779 0 0) 0x7f0750003520 con 0x7f07641399b0 2024-09-13T10:40:42.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07641cf530 con 0x7f07641399b0 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0758003610 con 0x7f07641399b0 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): dump: 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.776 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2817968796 0 0) 0x7f0764137dc0 con 0x7f076409d2a0 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0750003520 con 0x7f076409d2a0 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0754004d90 con 0x7f076409d2a0 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:42.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient(hunting): dump: 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.778 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.779 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.779 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2942420180 0 0) 0x7f07641cf530 con 0x7f07641399b0 2024-09-13T10:40:42.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.195:6792/0 conn(0x7f0764139d90 legacy=0x7f07641d6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.181:6792/0 conn(0x7f076409d2a0 legacy=0x7f07641ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:40:42.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 monclient: found mon.a 2024-09-13T10:40:42.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:42.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:42.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07641365c0 con 0x7f07641399b0 2024-09-13T10:40:42.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient: _finish_auth 0 2024-09-13T10:40:42.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f076a495640 5 monclient: authenticate success, global_id 184167 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f076a495640 10 monclient: _renew_subs 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f076a495640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f076a495640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0764135a60 con 0x7f07641399b0 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f076a495640 10 monclient: _renew_subs 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f076a495640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f076a495640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0764137800 con 0x7f07641399b0 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0758003b90 con 0x7f07641399b0 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0758004080 con 0x7f07641399b0 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f0760ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.761+0000 7f07627fc640 4 set_mon_vals no callback set 2024-09-13T10:40:42.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.762+0000 7f0760ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.762+0000 7f0760ff9640 10 monclient: dump: 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.781 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.782 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.782 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.782 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.762+0000 7f076a495640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:42.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.762+0000 7f076a495640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f07440065c0 con 0x7f0744002860 2024-09-13T10:40:42.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.762+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0758004220 con 0x7f07641399b0 2024-09-13T10:40:42.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.762+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f075804e2b0 con 0x7f07641399b0 2024-09-13T10:40:42.782 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.763+0000 7f0768a32640 10 monclient: get_auth_request con 0x7f07500400a0 auth_method 0 2024-09-13T10:40:42.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.764+0000 7f0763fff640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.195:6789/0 conn(0x7f0744002860 legacy=0x7f0744004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149070057 0 0) 0x7f07440065c0 con 0x7f0744002860 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 10 monclient(hunting): my global_id is 135154 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07641cf530 con 0x7f0744002860 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4232658675 0 0) 0x7f07641cf530 con 0x7f0744002860 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07440065c0 con 0x7f0744002860 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f07540048a0 con 0x7f0744002860 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 10 monclient: dump: 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.785 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.786 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 372975556 0 0) 0x7f07440065c0 con 0x7f0744002860 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.765+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.195:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f074400a160 con 0x7f0744002860 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.766+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0754005490 con 0x7f0744002860 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.766+0000 7f0760ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.766+0000 7f0760ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.766+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.195:6789/0 conn(0x7f0744002860 legacy=0x7f0744004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.766+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.195:6789/0 conn(0x7f0744002860 legacy=0x7f0744004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.772+0000 7f076a495640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.772+0000 7f076a495640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0744009e70 con 0x7f0744009130 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.774+0000 7f0763fff640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.195:6789/0 conn(0x7f0744009130 legacy=0x7f07440095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.774+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141546188 0 0) 0x7f0744009e70 con 0x7f0744009130 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.774+0000 7f0760ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.774+0000 7f0760ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.774+0000 7f0760ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.774+0000 7f0760ff9640 10 monclient(hunting): my global_id is 135163 2024-09-13T10:40:42.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07440065c0 con 0x7f0744009130 2024-09-13T10:40:42.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 452315696 0 0) 0x7f07440065c0 con 0x7f0744009130 2024-09-13T10:40:42.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0744009e70 con 0x7f0744009130 2024-09-13T10:40:42.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0754005b70 con 0x7f0744009130 2024-09-13T10:40:42.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-13T10:40:42.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 10 monclient: dump: 2024-09-13T10:40:42.788 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.788 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.788 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.789 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.789 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.789 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.789 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.789 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.789 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.789 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.789 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.789 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.789 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.789 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.789 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.790 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.1 v1:172.21.15.195:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4121680568 0 0) 0x7f0744009e70 con 0x7f0744009130 2024-09-13T10:40:42.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 --> v1:172.21.15.195:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f074400c3f0 con 0x7f0744009130 2024-09-13T10:40:42.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 <== mon.1 v1:172.21.15.195:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 3791250335) 0x7f0754007e40 con 0x7f0744009130 2024-09-13T10:40:42.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:42.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:42.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.195:6789/0 conn(0x7f0744009130 legacy=0x7f07440095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.775+0000 7f0760ff9640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.195:6789/0 conn(0x7f0744009130 legacy=0x7f07440095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.790 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:42.791 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:42.791 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:42.791 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:42.791 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 148, 2024-09-13T10:40:42.791 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 174804, 2024-09-13T10:40:42.791 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:42.791 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:40:42.791 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:42.791 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:42.791 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:40:42.791 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:42.792 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:42.792 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:42.792 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:40:42.792 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:40:42.792 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.792 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 1, 2024-09-13T10:40:42.792 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.792 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:42.792 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:42.792 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.792 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.792 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.793 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.793 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.793 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.793 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.793 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.793 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.793 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.793 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.794 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.794 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:42.794 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:42.794 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.794 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.794 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.794 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.794 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.794 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.794 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.794 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.794 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.795 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.795 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.795 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.795 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:42.795 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:42.795 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:42.795 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:42.795 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:42.795 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:42.795 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.795 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.796 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:42.796 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:42.796 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:42.796 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:42.796 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:42.796 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:42.796 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:42.796 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.796 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:42.796 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.796 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.796 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:42.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.798 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.800 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:42.801 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.802 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.803 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:42.804 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:42.805 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.806 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.807 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:42.807 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:42.807 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.807 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.807 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.807 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:42.807 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.807 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.807 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.809 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.810 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.811 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.811 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:42.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.811 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.811 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.811 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:40:42.811 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.811 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.811 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:42.811 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:42.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.776+0000 7f076a495640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.195:6800/1839191919 conn(0x7f07500400a0 legacy=0x7f0750042560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.812 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.776+0000 7f076a495640 10 monclient: shutdown 2024-09-13T10:40:42.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.776+0000 7f076a495640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.776+0000 7f076a495640 1 -- 172.21.15.181:0/1400491496 >> v1:172.21.15.181:6789/0 conn(0x7f07641399b0 legacy=0x7f07641cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.776+0000 7f0768a32640 1 -- 172.21.15.181:0/1400491496 reap_dead start 2024-09-13T10:40:42.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.776+0000 7f0768a32640 1 -- 172.21.15.181:0/1400491496 reap_dead start 2024-09-13T10:40:42.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.776+0000 7f076a495640 1 -- 172.21.15.181:0/1400491496 shutdown_connections 2024-09-13T10:40:42.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.776+0000 7f076a495640 1 -- 172.21.15.181:0/1400491496 >> 172.21.15.181:0/1400491496 conn(0x7f07640abdb0 msgr2=0x7f0764132870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.776+0000 7f076a495640 1 -- 172.21.15.181:0/1400491496 shutdown_connections 2024-09-13T10:40:42.813 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.776+0000 7f076a495640 1 -- 172.21.15.181:0/1400491496 wait complete. 2024-09-13T10:40:42.813 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:40:42.814 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-13T10:40:42.814 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-13T10:40:42.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.911+0000 7f586253d640 10 monclient: get_monmap_and_config 2024-09-13T10:40:42.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.911+0000 7f586253d640 10 monclient: build_initial_monmap 2024-09-13T10:40:42.913 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.911+0000 7f586253d640 10 monclient: monmap: 2024-09-13T10:40:42.913 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:42.913 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.913 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:42.911798+0000 2024-09-13T10:40:42.913 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:42.911798+0000 2024-09-13T10:40:42.913 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:42.913 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.913 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:42.913 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:42.913 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:42.913 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:42.913 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:42.914 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:42.914 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:42.914 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:42.914 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:42.914 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.911+0000 7f586253d640 1 Processor -- start 2024-09-13T10:40:42.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f586253d640 1 -- start start 2024-09-13T10:40:42.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f586253d640 10 monclient: init 2024-09-13T10:40:42.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f586253d640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:42.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f586253d640 10 monclient: _add_conns ranks=[8,1,3,0,6,7,5,2,4] 2024-09-13T10:40:42.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f586253d640 10 monclient(hunting): picked mon.noname-e con 0x7f585c0a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:42.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f586253d640 10 monclient(hunting): picked mon.noname-f con 0x7f585c0a6ab0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:42.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f586253d640 10 monclient(hunting): picked mon.noname-g con 0x7f585c13f9a0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:42.915 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f586253d640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585c0a5fe0 con 0x7f585c0a6ab0 2024-09-13T10:40:42.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f586253d640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585c0a8080 con 0x7f585c13f9a0 2024-09-13T10:40:42.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f586253d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585c0a42c0 con 0x7f585c0a66d0 2024-09-13T10:40:42.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f586253d640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:42.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f586253d640 10 monclient(hunting): authenticate will time out at 1382.417518s 2024-09-13T10:40:42.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f585bfff640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f585c0a66d0 0x7f585c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:45068/0 (socket says 172.21.15.181:45068) 2024-09-13T10:40:42.916 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.912+0000 7f585bfff640 1 -- 172.21.15.181:0/3009648778 learned_addr learned my addr 172.21.15.181:0/3009648778 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:42.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.914+0000 7f585bfff640 1 -- 172.21.15.181:0/3009648778 >> v1:172.21.15.181:6793/0 conn(0x7f585c0a66d0 legacy=0x7f585c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.914+0000 7f585affd640 1 -- 172.21.15.181:0/3009648778 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2492432800 0 0) 0x7f585c0a42c0 con 0x7f585c0a66d0 2024-09-13T10:40:42.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.914+0000 7f585affd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.914+0000 7f585affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.914+0000 7f585affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.914+0000 7f585affd640 10 monclient(hunting): my global_id is 184184 2024-09-13T10:40:42.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.914+0000 7f5860ada640 1 -- 172.21.15.181:0/3009648778 >> v1:172.21.15.195:6790/0 conn(0x7f585c13f9a0 legacy=0x7f585c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.914+0000 7f585affd640 1 -- 172.21.15.181:0/3009648778 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5844003520 con 0x7f585c0a66d0 2024-09-13T10:40:42.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.914+0000 7f585b7fe640 1 -- 172.21.15.181:0/3009648778 >> v1:172.21.15.195:6789/0 conn(0x7f585c0a6ab0 legacy=0x7f585c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 1 -- 172.21.15.181:0/3009648778 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2716116680 0 0) 0x7f585c0a8080 con 0x7f585c13f9a0 2024-09-13T10:40:42.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient(hunting): my global_id is 184125 2024-09-13T10:40:42.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 1 -- 172.21.15.181:0/3009648778 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f585c0a42c0 con 0x7f585c13f9a0 2024-09-13T10:40:42.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 1 -- 172.21.15.181:0/3009648778 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4188829350 0 0) 0x7f5844003520 con 0x7f585c0a66d0 2024-09-13T10:40:42.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 1 -- 172.21.15.181:0/3009648778 >> v1:172.21.15.195:6790/0 conn(0x7f585c13f9a0 legacy=0x7f585c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.920 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 1 -- 172.21.15.181:0/3009648778 >> v1:172.21.15.195:6789/0 conn(0x7f585c0a6ab0 legacy=0x7f585c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient: _finish_hunting 0 2024-09-13T10:40:42.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 1 monclient: found mon.noname-e 2024-09-13T10:40:42.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:42.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:40:42.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 1 -- 172.21.15.181:0/3009648778 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585c1464e0 con 0x7f585c0a66d0 2024-09-13T10:40:42.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient: _finish_auth 0 2024-09-13T10:40:42.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient: _check_auth_tickets 2024-09-13T10:40:42.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:42.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 1 -- 172.21.15.181:0/3009648778 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f584c001ad0 con 0x7f585c0a66d0 2024-09-13T10:40:42.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.921 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient: dump: 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.922 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f586253d640 5 monclient: authenticate success, global_id 184184 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f586253d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 1 -- 172.21.15.181:0/3009648778 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f584c0048a0 con 0x7f585c0a66d0 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 1 -- 172.21.15.181:0/3009648778 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f584c004e10 con 0x7f585c0a66d0 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f586253d640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f586253d640 4 set_mon_vals no callback set 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.923 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:42.924 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f585affd640 10 monclient: dump: 2024-09-13T10:40:42.924 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.924 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.924 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.924 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.924 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.924 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.924 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.924 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.924 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.924 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f586253d640 10 monclient: shutdown 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f586253d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f586253d640 1 -- 172.21.15.181:0/3009648778 >> v1:172.21.15.181:6793/0 conn(0x7f585c0a66d0 legacy=0x7f585c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f586253d640 1 -- 172.21.15.181:0/3009648778 shutdown_connections 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f586253d640 1 -- 172.21.15.181:0/3009648778 >> 172.21.15.181:0/3009648778 conn(0x7f585c0abcd0 msgr2=0x7f585c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f586253d640 1 -- 172.21.15.181:0/3009648778 shutdown_connections 2024-09-13T10:40:42.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.915+0000 7f586253d640 1 -- 172.21.15.181:0/3009648778 wait complete. 2024-09-13T10:40:42.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.916+0000 7f586253d640 10 monclient: build_initial_monmap 2024-09-13T10:40:42.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.916+0000 7f586253d640 10 monclient: monmap: 2024-09-13T10:40:42.926 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:42.926 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:42.926 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:42.926 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:42.926 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:42.926 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:42.926 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:42.926 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:42.926 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:42.926 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.916+0000 7f586253d640 1 Processor -- start 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.916+0000 7f586253d640 1 -- start start 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.916+0000 7f586253d640 10 monclient: init 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.917+0000 7f586253d640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.917+0000 7f586253d640 10 monclient: _add_conns ranks=[7,3,8,4,5,1,0,6,2] 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.917+0000 7f586253d640 10 monclient(hunting): picked mon.noname-i con 0x7f585c0a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.917+0000 7f586253d640 10 monclient(hunting): picked mon.noname-g con 0x7f585c0a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:42.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.917+0000 7f586253d640 10 monclient(hunting): picked mon.noname-e con 0x7f585c13f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:42.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.917+0000 7f586253d640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585c13e1e0 con 0x7f585c0a6ab0 2024-09-13T10:40:42.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.917+0000 7f586253d640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585c068b90 con 0x7f585c0a66d0 2024-09-13T10:40:42.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.917+0000 7f586253d640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585c13ccf0 con 0x7f585c13f9a0 2024-09-13T10:40:42.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.917+0000 7f586253d640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:42.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.917+0000 7f586253d640 10 monclient(hunting): authenticate will time out at 1382.422397s 2024-09-13T10:40:42.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.917+0000 7f5860ada640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f585c13f9a0 0x7f585c1d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:45070/0 (socket says 172.21.15.181:45070) 2024-09-13T10:40:42.928 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.917+0000 7f5860ada640 1 -- 172.21.15.181:0/130880748 learned_addr learned my addr 172.21.15.181:0/130880748 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:42.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5860ada640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.181:6793/0 conn(0x7f585c13f9a0 legacy=0x7f585c1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f585b7fe640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.195:6790/0 conn(0x7f585c0a6ab0 legacy=0x7f585c13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f585bfff640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.195:6792/0 conn(0x7f585c0a66d0 legacy=0x7f585c13b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1784921125 0 0) 0x7f585c13ccf0 con 0x7f585c13f9a0 2024-09-13T10:40:42.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 10 monclient(hunting): my global_id is 184193 2024-09-13T10:40:42.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5848003520 con 0x7f585c13f9a0 2024-09-13T10:40:42.933 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3056347908 0 0) 0x7f585c13e1e0 con 0x7f585c0a6ab0 2024-09-13T10:40:42.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 10 monclient(hunting): my global_id is 184134 2024-09-13T10:40:42.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f585c13ccf0 con 0x7f585c0a6ab0 2024-09-13T10:40:42.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2387401276 0 0) 0x7f585c068b90 con 0x7f585c0a66d0 2024-09-13T10:40:42.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 10 monclient(hunting): my global_id is 58138 2024-09-13T10:40:42.934 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f585c13e1e0 con 0x7f585c0a66d0 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3043889852 0 0) 0x7f5848003520 con 0x7f585c13f9a0 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.919+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f585c068b90 con 0x7f585c13f9a0 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5854003990 con 0x7f585c13f9a0 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient(hunting): dump: 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.935 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3093812049 0 0) 0x7f585c13e1e0 con 0x7f585c0a66d0 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5848003520 con 0x7f585c0a66d0 2024-09-13T10:40:42.936 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f584c004d90 con 0x7f585c0a66d0 2024-09-13T10:40:42.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:42.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:40:42.937 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient(hunting): dump: 2024-09-13T10:40:42.937 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.937 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.937 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.937 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.937 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.937 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.937 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.937 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.937 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2035751240 0 0) 0x7f585c13ccf0 con 0x7f585c0a6ab0 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f585c13e1e0 con 0x7f585c0a6ab0 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2475520328 0 0) 0x7f585c068b90 con 0x7f585c13f9a0 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.195:6792/0 conn(0x7f585c0a66d0 legacy=0x7f585c13b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.195:6790/0 conn(0x7f585c0a6ab0 legacy=0x7f585c13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.938 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient: _finish_hunting 0 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 monclient: found mon.e 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585c13c020 con 0x7f585c13f9a0 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient: _finish_auth 0 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient: _check_auth_tickets 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f586253d640 5 monclient: authenticate success, global_id 184193 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f586253d640 10 monclient: _renew_subs 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f586253d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f586253d640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f585c13f050 con 0x7f585c13f9a0 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f586253d640 10 monclient: _renew_subs 2024-09-13T10:40:42.939 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f586253d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f586253d640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f585c1374e0 con 0x7f585c13f9a0 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5854003e80 con 0x7f585c13f9a0 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f58540043b0 con 0x7f585c13f9a0 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f585a7fc640 4 set_mon_vals no callback set 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.920+0000 7f5858ff9640 10 monclient: dump: 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.940 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.921+0000 7f586253d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:42.941 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.921+0000 7f586253d640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f583c0065c0 con 0x7f583c002860 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.921+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5854004600 con 0x7f585c13f9a0 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.921+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f585404e4c0 con 0x7f585c13f9a0 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.921+0000 7f585b7fe640 10 monclient: get_auth_request con 0x7f5848040380 auth_method 0 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f585bfff640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.195:6790/0 conn(0x7f583c002860 legacy=0x7f583c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314625836 0 0) 0x7f583c0065c0 con 0x7f583c002860 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 10 monclient(hunting): my global_id is 184143 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f585c068b90 con 0x7f583c002860 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2245398365 0 0) 0x7f585c068b90 con 0x7f583c002860 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f583c0065c0 con 0x7f583c002860 2024-09-13T10:40:42.942 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f584c0048a0 con 0x7f583c002860 2024-09-13T10:40:42.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:40:42.943 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 10 monclient: dump: 2024-09-13T10:40:42.943 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.943 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.943 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.943 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.943 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.943 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.943 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.943 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.943 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1952288708 0 0) 0x7f583c0065c0 con 0x7f583c002860 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.923+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.195:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f583c00a160 con 0x7f583c002860 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.924+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f584c005490 con 0x7f583c002860 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.924+0000 7f5858ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.924+0000 7f5858ff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:42.944 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.924+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.195:6790/0 conn(0x7f583c002860 legacy=0x7f583c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.924+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.195:6790/0 conn(0x7f583c002860 legacy=0x7f583c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.930+0000 7f586253d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:42.945 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.930+0000 7f586253d640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f583c009e70 con 0x7f583c009130 2024-09-13T10:40:42.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.932+0000 7f585bfff640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.195:6790/0 conn(0x7f583c009130 legacy=0x7f583c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:42.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430110241 0 0) 0x7f583c009e70 con 0x7f583c009130 2024-09-13T10:40:42.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:42.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:42.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:42.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 10 monclient(hunting): my global_id is 184152 2024-09-13T10:40:42.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f583c0065c0 con 0x7f583c009130 2024-09-13T10:40:42.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 521037842 0 0) 0x7f583c0065c0 con 0x7f583c009130 2024-09-13T10:40:42.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f583c009e70 con 0x7f583c009130 2024-09-13T10:40:42.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f584c005c70 con 0x7f583c009130 2024-09-13T10:40:42.947 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 10 monclient: dump: 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:42.948 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:42.949 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:42.949 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:42.949 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:42.949 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:42.949 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:42.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.3 v1:172.21.15.195:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3567405461 0 0) 0x7f583c009e70 con 0x7f583c009130 2024-09-13T10:40:42.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 --> v1:172.21.15.195:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f583c00c3f0 con 0x7f583c009130 2024-09-13T10:40:42.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 <== mon.3 v1:172.21.15.195:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7558 (unknown 0 0 4194633576) 0x7f584c007100 con 0x7f583c009130 2024-09-13T10:40:42.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:42.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:42.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.195:6790/0 conn(0x7f583c009130 legacy=0x7f583c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.949 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.933+0000 7f5858ff9640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.195:6790/0 conn(0x7f583c009130 legacy=0x7f583c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:42.950 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:42.950 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:42.950 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:42.950 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:42.950 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 148, 2024-09-13T10:40:42.950 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 7584, 2024-09-13T10:40:42.950 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:42.950 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:40:42.950 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:42.950 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:42.950 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:40:42.950 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.951 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.952 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:42.953 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:42.954 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:42.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.956 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.957 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.959 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:42.960 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.961 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.962 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.964 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.965 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:42.966 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:42.967 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:42.968 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.968 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.968 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:42.968 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:42.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.968 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.968 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.968 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.968 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.968 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:42.969 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:42.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:42.969 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:42.969 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:42.969 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:42.969 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:42.969 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:42.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:42.969 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:42.969 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:42.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.934+0000 7f586253d640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5848040380 legacy=0x7f5848042840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.934+0000 7f586253d640 10 monclient: shutdown 2024-09-13T10:40:42.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.934+0000 7f586253d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:42.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.934+0000 7f586253d640 1 -- 172.21.15.181:0/130880748 >> v1:172.21.15.181:6793/0 conn(0x7f585c13f9a0 legacy=0x7f585c1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:42.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.934+0000 7f5860ada640 1 -- 172.21.15.181:0/130880748 reap_dead start 2024-09-13T10:40:42.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.934+0000 7f5860ada640 1 -- 172.21.15.181:0/130880748 reap_dead start 2024-09-13T10:40:42.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.934+0000 7f586253d640 1 -- 172.21.15.181:0/130880748 shutdown_connections 2024-09-13T10:40:42.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.934+0000 7f586253d640 1 -- 172.21.15.181:0/130880748 >> 172.21.15.181:0/130880748 conn(0x7f585c0abcd0 msgr2=0x7f585c0a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:42.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.934+0000 7f586253d640 1 -- 172.21.15.181:0/130880748 shutdown_connections 2024-09-13T10:40:42.971 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:42.934+0000 7f586253d640 1 -- 172.21.15.181:0/130880748 wait complete. 2024-09-13T10:40:42.972 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:40:42.972 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-13T10:40:42.972 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-13T10:40:43.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.069+0000 7fe49e1ab640 10 monclient: get_monmap_and_config 2024-09-13T10:40:43.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.069+0000 7fe49e1ab640 10 monclient: build_initial_monmap 2024-09-13T10:40:43.071 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.069+0000 7fe49e1ab640 10 monclient: monmap: 2024-09-13T10:40:43.071 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:43.071 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.071 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:43.070341+0000 2024-09-13T10:40:43.071 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:43.070341+0000 2024-09-13T10:40:43.072 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:43.072 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.072 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:43.072 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:43.072 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:43.072 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:43.072 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:43.072 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:43.072 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:43.072 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:43.072 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:43.072 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.070+0000 7fe49e1ab640 1 Processor -- start 2024-09-13T10:40:43.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.070+0000 7fe49e1ab640 1 -- start start 2024-09-13T10:40:43.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.070+0000 7fe49e1ab640 10 monclient: init 2024-09-13T10:40:43.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.070+0000 7fe49e1ab640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:43.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.070+0000 7fe49e1ab640 10 monclient: _add_conns ranks=[5,6,1,4,2,7,3,8,0] 2024-09-13T10:40:43.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.070+0000 7fe49e1ab640 10 monclient(hunting): picked mon.noname-h con 0x7fe4980a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:43.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.070+0000 7fe49e1ab640 10 monclient(hunting): picked mon.noname-d con 0x7fe4980a8340 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:43.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.071+0000 7fe49e1ab640 10 monclient(hunting): picked mon.noname-f con 0x7fe49813f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:43.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.071+0000 7fe49e1ab640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4980a4bc0 con 0x7fe49813f750 2024-09-13T10:40:43.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.071+0000 7fe49e1ab640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe49813a320 con 0x7fe4980a6640 2024-09-13T10:40:43.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.071+0000 7fe49e1ab640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4980a8100 con 0x7fe4980a8340 2024-09-13T10:40:43.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.071+0000 7fe49e1ab640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:43.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.071+0000 7fe49e1ab640 10 monclient(hunting): authenticate will time out at 1382.576056s 2024-09-13T10:40:43.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.071+0000 7fe496ffd640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fe4980a8340 0x7fe498139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:56830/0 (socket says 172.21.15.181:56830) 2024-09-13T10:40:43.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.071+0000 7fe496ffd640 1 -- 172.21.15.181:0/2521209465 learned_addr learned my addr 172.21.15.181:0/2521209465 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe496ffd640 1 -- 172.21.15.181:0/2521209465 >> v1:172.21.15.181:6792/0 conn(0x7fe4980a8340 legacy=0x7fe498139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4977fe640 1 -- 172.21.15.181:0/2521209465 >> v1:172.21.15.195:6791/0 conn(0x7fe4980a6640 legacy=0x7fe498139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 1 -- 172.21.15.181:0/2521209465 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003119958 0 0) 0x7fe4980a8100 con 0x7fe4980a8340 2024-09-13T10:40:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient(hunting): my global_id is 174444 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 1 -- 172.21.15.181:0/2521209465 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe480003520 con 0x7fe4980a8340 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe497fff640 1 -- 172.21.15.181:0/2521209465 >> v1:172.21.15.195:6789/0 conn(0x7fe49813f750 legacy=0x7fe498141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 1 -- 172.21.15.181:0/2521209465 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3817003795 0 0) 0x7fe480003520 con 0x7fe4980a8340 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 1 -- 172.21.15.181:0/2521209465 >> v1:172.21.15.195:6791/0 conn(0x7fe4980a6640 legacy=0x7fe498139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 1 -- 172.21.15.181:0/2521209465 >> v1:172.21.15.195:6789/0 conn(0x7fe49813f750 legacy=0x7fe498141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient: _finish_hunting 0 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 1 monclient: found mon.noname-d 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 1 -- 172.21.15.181:0/2521209465 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4980a48e0 con 0x7fe4980a8340 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient: _finish_auth 0 2024-09-13T10:40:43.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient: _check_auth_tickets 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 1 -- 172.21.15.181:0/2521209465 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe48c001ae0 con 0x7fe4980a8340 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe49e1ab640 5 monclient: authenticate success, global_id 174444 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe49e1ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient: dump: 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.080 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe49e1ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 1 -- 172.21.15.181:0/2521209465 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe48c0048a0 con 0x7fe4980a8340 2024-09-13T10:40:43.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 1 -- 172.21.15.181:0/2521209465 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe48c004dd0 con 0x7fe4980a8340 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe49e1ab640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe49e1ab640 4 set_mon_vals no callback set 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.073+0000 7fe4967fc640 10 monclient: dump: 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.082 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.074+0000 7fe49e1ab640 10 monclient: shutdown 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.074+0000 7fe49e1ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.074+0000 7fe49e1ab640 1 -- 172.21.15.181:0/2521209465 >> v1:172.21.15.181:6792/0 conn(0x7fe4980a8340 legacy=0x7fe498139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.074+0000 7fe49e1ab640 1 -- 172.21.15.181:0/2521209465 shutdown_connections 2024-09-13T10:40:43.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.074+0000 7fe49e1ab640 1 -- 172.21.15.181:0/2521209465 >> 172.21.15.181:0/2521209465 conn(0x7fe498077170 msgr2=0x7fe4980abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:43.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.074+0000 7fe49e1ab640 1 -- 172.21.15.181:0/2521209465 shutdown_connections 2024-09-13T10:40:43.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.074+0000 7fe49e1ab640 1 -- 172.21.15.181:0/2521209465 wait complete. 2024-09-13T10:40:43.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.074+0000 7fe49e1ab640 10 monclient: build_initial_monmap 2024-09-13T10:40:43.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.074+0000 7fe49e1ab640 10 monclient: monmap: 2024-09-13T10:40:43.084 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:43.084 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:43.084 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:43.084 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:43.084 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:43.084 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.075+0000 7fe49e1ab640 1 Processor -- start 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.075+0000 7fe49e1ab640 1 -- start start 2024-09-13T10:40:43.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.075+0000 7fe49e1ab640 10 monclient: init 2024-09-13T10:40:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.075+0000 7fe49e1ab640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.075+0000 7fe49e1ab640 10 monclient: _add_conns ranks=[0,8,3,7,4,2,6,1,5] 2024-09-13T10:40:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.075+0000 7fe49e1ab640 10 monclient(hunting): picked mon.noname-a con 0x7fe4980a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.075+0000 7fe49e1ab640 10 monclient(hunting): picked mon.noname-e con 0x7fe49813f750 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.075+0000 7fe49e1ab640 10 monclient(hunting): picked mon.noname-g con 0x7fe49813ca90 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.075+0000 7fe49e1ab640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe498134c50 con 0x7fe4980a8340 2024-09-13T10:40:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.076+0000 7fe49e1ab640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe49813e700 con 0x7fe49813ca90 2024-09-13T10:40:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.076+0000 7fe49e1ab640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe49813d3c0 con 0x7fe49813f750 2024-09-13T10:40:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.076+0000 7fe49e1ab640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.076+0000 7fe49e1ab640 10 monclient(hunting): authenticate will time out at 1382.581052s 2024-09-13T10:40:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.076+0000 7fe4977fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe4980a8340 0x7fe49813bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:49582/0 (socket says 172.21.15.181:49582) 2024-09-13T10:40:43.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.076+0000 7fe4977fe640 1 -- 172.21.15.181:0/3460201113 learned_addr learned my addr 172.21.15.181:0/3460201113 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe4977fe640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.181:6789/0 conn(0x7fe4980a8340 legacy=0x7fe49813bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe496ffd640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.181:6793/0 conn(0x7fe49813f750 legacy=0x7fe49813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 52091454 0 0) 0x7fe498134c50 con 0x7fe4980a8340 2024-09-13T10:40:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): my global_id is 184176 2024-09-13T10:40:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe484003550 con 0x7fe4980a8340 2024-09-13T10:40:43.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1240362946 0 0) 0x7fe49813d3c0 con 0x7fe49813f750 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): my global_id is 184202 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe498134c50 con 0x7fe49813f750 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe497fff640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.195:6790/0 conn(0x7fe49813ca90 legacy=0x7fe4981d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2537335251 0 0) 0x7fe484003550 con 0x7fe4980a8340 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe49813d3c0 con 0x7fe4980a8340 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe488003990 con 0x7fe4980a8340 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): dump: 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.092 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.093 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.094 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 868816116 0 0) 0x7fe498134c50 con 0x7fe49813f750 2024-09-13T10:40:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe484003550 con 0x7fe49813f750 2024-09-13T10:40:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481167375 0 0) 0x7fe49813e700 con 0x7fe49813ca90 2024-09-13T10:40:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): my global_id is 184161 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe498134c50 con 0x7fe49813ca90 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe48c004d90 con 0x7fe49813f750 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient(hunting): dump: 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.095 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3379469619 0 0) 0x7fe49813d3c0 con 0x7fe4980a8340 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.181:6793/0 conn(0x7fe49813f750 legacy=0x7fe49813c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.195:6790/0 conn(0x7fe49813ca90 legacy=0x7fe4981d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient: _finish_hunting 0 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 monclient: found mon.a 2024-09-13T10:40:43.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4981343b0 con 0x7fe4980a8340 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient: _finish_auth 0 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient: _check_auth_tickets 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe49e1ab640 5 monclient: authenticate success, global_id 184176 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe49e1ab640 10 monclient: _renew_subs 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe49e1ab640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe49e1ab640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe498134690 con 0x7fe4980a8340 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe49e1ab640 10 monclient: _renew_subs 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe49e1ab640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe49e1ab640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe4981d7a40 con 0x7fe4980a8340 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe488003f80 con 0x7fe4980a8340 2024-09-13T10:40:43.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe488004470 con 0x7fe4980a8340 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe495ffb640 4 set_mon_vals no callback set 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.078+0000 7fe47ffff640 10 monclient: dump: 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.098 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.079+0000 7fe49e1ab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.079+0000 7fe49e1ab640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe4780065c0 con 0x7fe478002860 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.079+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe488004610 con 0x7fe4980a8340 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.080+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7fe48804e640 con 0x7fe4980a8340 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.080+0000 7fe497fff640 10 monclient: get_auth_request con 0x7fe4840402e0 auth_method 0 2024-09-13T10:40:43.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe496ffd640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.195:6791/0 conn(0x7fe478002860 legacy=0x7fe478004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291519475 0 0) 0x7fe4780065c0 con 0x7fe478002860 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 10 monclient(hunting): my global_id is 106124 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe49813d3c0 con 0x7fe478002860 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3375459905 0 0) 0x7fe49813d3c0 con 0x7fe478002860 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4780065c0 con 0x7fe478002860 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe48c001d30 con 0x7fe478002860 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 10 monclient: dump: 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.100 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.101 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.102 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2696072789 0 0) 0x7fe4780065c0 con 0x7fe478002860 2024-09-13T10:40:43.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.082+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.195:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe47800a160 con 0x7fe478002860 2024-09-13T10:40:43.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.083+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe48c005450 con 0x7fe478002860 2024-09-13T10:40:43.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.083+0000 7fe47ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:43.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.083+0000 7fe47ffff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:43.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.083+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.195:6791/0 conn(0x7fe478002860 legacy=0x7fe478004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.083+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.195:6791/0 conn(0x7fe478002860 legacy=0x7fe478004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:43.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.089+0000 7fe49e1ab640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:43.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.089+0000 7fe49e1ab640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe478009e70 con 0x7fe478009130 2024-09-13T10:40:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.091+0000 7fe496ffd640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.195:6791/0 conn(0x7fe478009130 legacy=0x7fe4780095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.091+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 294673501 0 0) 0x7fe478009e70 con 0x7fe478009130 2024-09-13T10:40:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.091+0000 7fe47ffff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.091+0000 7fe47ffff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.091+0000 7fe47ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.091+0000 7fe47ffff640 10 monclient(hunting): my global_id is 106133 2024-09-13T10:40:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.091+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4780065c0 con 0x7fe478009130 2024-09-13T10:40:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3030615012 0 0) 0x7fe4780065c0 con 0x7fe478009130 2024-09-13T10:40:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe478009e70 con 0x7fe478009130 2024-09-13T10:40:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe48c005b30 con 0x7fe478009130 2024-09-13T10:40:43.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:40:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 10 monclient: dump: 2024-09-13T10:40:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.105 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.106 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 242090635 0 0) 0x7fe478009e70 con 0x7fe478009130 2024-09-13T10:40:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 --> v1:172.21.15.195:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe47800c3f0 con 0x7fe478009130 2024-09-13T10:40:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 <== mon.5 v1:172.21.15.195:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7727 (unknown 0 0 1349427030) 0x7fe48c006fa0 con 0x7fe478009130 2024-09-13T10:40:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:43.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.195:6791/0 conn(0x7fe478009130 legacy=0x7fe4780095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.092+0000 7fe47ffff640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.195:6791/0 conn(0x7fe478009130 legacy=0x7fe4780095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:43.107 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:43.107 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:43.107 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:43.107 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "peon", 2024-09-13T10:40:43.107 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 148, 2024-09-13T10:40:43.107 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 326792, 2024-09-13T10:40:43.107 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:43.107 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:43.108 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:43.109 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.110 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:43.111 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:43.112 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.113 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.114 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:43.115 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.116 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.118 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.119 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:43.121 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.122 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:40:43.125 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:40:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.126 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:43.126 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:43.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.093+0000 7fe49e1ab640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.195:6800/1839191919 conn(0x7fe4840402e0 legacy=0x7fe4840427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.093+0000 7fe49e1ab640 10 monclient: shutdown 2024-09-13T10:40:43.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.093+0000 7fe49e1ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:43.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.093+0000 7fe49e1ab640 1 -- 172.21.15.181:0/3460201113 >> v1:172.21.15.181:6789/0 conn(0x7fe4980a8340 legacy=0x7fe49813bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.093+0000 7fe497fff640 1 -- 172.21.15.181:0/3460201113 reap_dead start 2024-09-13T10:40:43.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.093+0000 7fe497fff640 1 -- 172.21.15.181:0/3460201113 reap_dead start 2024-09-13T10:40:43.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.093+0000 7fe49e1ab640 1 -- 172.21.15.181:0/3460201113 shutdown_connections 2024-09-13T10:40:43.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.093+0000 7fe49e1ab640 1 -- 172.21.15.181:0/3460201113 >> 172.21.15.181:0/3460201113 conn(0x7fe4980a6640 msgr2=0x7fe4980a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:43.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.093+0000 7fe49e1ab640 1 -- 172.21.15.181:0/3460201113 shutdown_connections 2024-09-13T10:40:43.128 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.093+0000 7fe49e1ab640 1 -- 172.21.15.181:0/3460201113 wait complete. 2024-09-13T10:40:43.129 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:40:43.129 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-13T10:40:43.129 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-13T10:40:43.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.226+0000 7f14a7608640 10 monclient: get_monmap_and_config 2024-09-13T10:40:43.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.226+0000 7f14a7608640 10 monclient: build_initial_monmap 2024-09-13T10:40:43.228 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.226+0000 7f14a7608640 10 monclient: monmap: 2024-09-13T10:40:43.228 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:43.228 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.228 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:43.227153+0000 2024-09-13T10:40:43.228 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:43.227153+0000 2024-09-13T10:40:43.228 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:43.228 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.229 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:43.229 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:43.229 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:43.229 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:43.229 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:43.229 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:43.229 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:43.229 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:43.229 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:43.229 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 1 Processor -- start 2024-09-13T10:40:43.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 1 -- start start 2024-09-13T10:40:43.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 10 monclient: init 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 10 monclient: _add_conns ranks=[4,2,1,3,5,6,0,8,7] 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 10 monclient(hunting): picked mon.noname-c con 0x7f14a0135980 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 10 monclient(hunting): picked mon.noname-b con 0x7f14a00739c0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 10 monclient(hunting): picked mon.noname-f con 0x7f14a013c910 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a0071aa0 con 0x7f14a013c910 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a0071d10 con 0x7f14a00739c0 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a0071ff0 con 0x7f14a0135980 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a7608640 10 monclient(hunting): authenticate will time out at 1382.732776s 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a53a4640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f14a0135980 0x7f14a00a34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:46682/0 (socket says 172.21.15.181:46682) 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a4ba3640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f14a00739c0 0x7f14a0073dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:42708/0 (socket says 172.21.15.181:42708) 2024-09-13T10:40:43.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.227+0000 7f14a53a4640 1 -- 172.21.15.181:0/4278767700 learned_addr learned my addr 172.21.15.181:0/4278767700 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:43.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f14a4ba3640 1 -- 172.21.15.181:0/4278767700 >> v1:172.21.15.181:6790/0 conn(0x7f14a00739c0 legacy=0x7f14a0073dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f14a53a4640 1 -- 172.21.15.181:0/4278767700 >> v1:172.21.15.181:6791/0 conn(0x7f14a0135980 legacy=0x7f14a00a34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291196835 0 0) 0x7f14a0071d10 con 0x7f14a00739c0 2024-09-13T10:40:43.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient(hunting): my global_id is 174413 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f14a5ba5640 1 -- 172.21.15.181:0/4278767700 >> v1:172.21.15.195:6789/0 conn(0x7f14a013c910 legacy=0x7f14a013ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f148c003520 con 0x7f14a00739c0 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337176156 0 0) 0x7f14a0071ff0 con 0x7f14a0135980 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient(hunting): my global_id is 174496 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14a0071d10 con 0x7f14a0135980 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2548184427 0 0) 0x7f14a0071aa0 con 0x7f14a013c910 2024-09-13T10:40:43.236 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient(hunting): my global_id is 135190 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14a0071ff0 con 0x7f14a013c910 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1681544815 0 0) 0x7f14a0071d10 con 0x7f14a0135980 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 >> v1:172.21.15.181:6790/0 conn(0x7f14a00739c0 legacy=0x7f14a0073dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 >> v1:172.21.15.195:6789/0 conn(0x7f14a013c910 legacy=0x7f14a013ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient: _finish_hunting 0 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 monclient: found mon.noname-c 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a00722d0 con 0x7f14a0135980 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient: _finish_auth 0 2024-09-13T10:40:43.237 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient: _check_auth_tickets 2024-09-13T10:40:43.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:43.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f149c001ac0 con 0x7f14a0135980 2024-09-13T10:40:43.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f14a7608640 5 monclient: authenticate success, global_id 174496 2024-09-13T10:40:43.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f14a7608640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:43.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:43.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient: dump: 2024-09-13T10:40:43.238 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.238 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.238 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.238 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.238 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.239 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.239 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.239 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.239 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.239 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.239 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.239 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.239 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.239 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.239 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.239 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f14a7608640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f149c0048a0 con 0x7f14a0135980 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 1 -- 172.21.15.181:0/4278767700 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f149c004e10 con 0x7f14a0135980 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f14a7608640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f14a7608640 4 set_mon_vals no callback set 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.230+0000 7f1497fff640 10 monclient: dump: 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.240 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.231+0000 7f14a7608640 10 monclient: shutdown 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.231+0000 7f14a7608640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.231+0000 7f14a7608640 1 -- 172.21.15.181:0/4278767700 >> v1:172.21.15.181:6791/0 conn(0x7f14a0135980 legacy=0x7f14a00a34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.241 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.231+0000 7f14a7608640 1 -- 172.21.15.181:0/4278767700 shutdown_connections 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.231+0000 7f14a7608640 1 -- 172.21.15.181:0/4278767700 >> 172.21.15.181:0/4278767700 conn(0x7f14a00a45b0 msgr2=0x7f14a00a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.231+0000 7f14a7608640 1 -- 172.21.15.181:0/4278767700 shutdown_connections 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.231+0000 7f14a7608640 1 -- 172.21.15.181:0/4278767700 wait complete. 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.231+0000 7f14a7608640 10 monclient: build_initial_monmap 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.231+0000 7f14a7608640 10 monclient: monmap: 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:43.242 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:43.243 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 1 Processor -- start 2024-09-13T10:40:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 1 -- start start 2024-09-13T10:40:43.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 10 monclient: init 2024-09-13T10:40:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 10 monclient: _add_conns ranks=[3,1,6,4,7,2,5,0,8] 2024-09-13T10:40:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 10 monclient(hunting): picked mon.noname-g con 0x7f14a00739c0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 10 monclient(hunting): picked mon.noname-f con 0x7f14a0135980 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 10 monclient(hunting): picked mon.noname-d con 0x7f14a013c910 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a00a3300 con 0x7f14a0135980 2024-09-13T10:40:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a01372b0 con 0x7f14a00739c0 2024-09-13T10:40:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a011ea30 con 0x7f14a013c910 2024-09-13T10:40:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a7608640 10 monclient(hunting): authenticate will time out at 1382.737701s 2024-09-13T10:40:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a5ba5640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f14a013c910 0x7f14a01d6220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:56832/0 (socket says 172.21.15.181:56832) 2024-09-13T10:40:43.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.232+0000 7f14a5ba5640 1 -- 172.21.15.181:0/3293767438 learned_addr learned my addr 172.21.15.181:0/3293767438 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.234+0000 7f14a5ba5640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.181:6792/0 conn(0x7f14a013c910 legacy=0x7f14a01d6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.234+0000 7f14a4ba3640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.195:6789/0 conn(0x7f14a0135980 legacy=0x7f14a01d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768052645 0 0) 0x7f14a011ea30 con 0x7f14a013c910 2024-09-13T10:40:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.249 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): my global_id is 174453 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f14a53a4640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.195:6790/0 conn(0x7f14a00739c0 legacy=0x7f14a011f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1484003550 con 0x7f14a013c910 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 292400295 0 0) 0x7f1484003550 con 0x7f14a013c910 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14a011ea30 con 0x7f14a013c910 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2898608877 0 0) 0x7f14a00a3300 con 0x7f14a0135980 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): my global_id is 135199 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1484003550 con 0x7f14a0135980 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1498003990 con 0x7f14a013c910 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:43.250 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): dump: 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.251 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026766171 0 0) 0x7f14a01372b0 con 0x7f14a00739c0 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient(hunting): my global_id is 184170 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14a00a3300 con 0x7f14a00739c0 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 321257519 0 0) 0x7f14a011ea30 con 0x7f14a013c910 2024-09-13T10:40:43.252 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.195:6790/0 conn(0x7f14a00739c0 legacy=0x7f14a011f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.195:6789/0 conn(0x7f14a0135980 legacy=0x7f14a01d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 monclient: found mon.d 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a011ed10 con 0x7f14a013c910 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient: _finish_auth 0 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f14a7608640 5 monclient: authenticate success, global_id 174453 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f14a7608640 10 monclient: _renew_subs 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f14a7608640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:43.253 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f14a7608640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f14a00a0f50 con 0x7f14a013c910 2024-09-13T10:40:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1498003f20 con 0x7f14a013c910 2024-09-13T10:40:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f1498004450 con 0x7f14a013c910 2024-09-13T10:40:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f1495ffb640 10 monclient: dump: 2024-09-13T10:40:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.254 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f14977fe640 4 set_mon_vals no callback set 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f14a7608640 10 monclient: _renew_subs 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f14a7608640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:43.255 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.235+0000 7f14a7608640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f14a01d7940 con 0x7f14a013c910 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.236+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f14980046a0 con 0x7f14a013c910 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.236+0000 7f14a7608640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.236+0000 7f14a7608640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f14a00a3b50 con 0x7f14a013a900 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.236+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f149804e560 con 0x7f14a013c910 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.236+0000 7f14a4ba3640 10 monclient: get_auth_request con 0x7f148403fd10 auth_method 0 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.238+0000 7f14a53a4640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.195:6792/0 conn(0x7f14a013a900 legacy=0x7f14a013ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3762225008 0 0) 0x7f14a00a3b50 con 0x7f14a013a900 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 10 monclient(hunting): my global_id is 58147 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14a011ea30 con 0x7f14a013a900 2024-09-13T10:40:43.256 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3051887382 0 0) 0x7f14a011ea30 con 0x7f14a013a900 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14a00a3b50 con 0x7f14a013a900 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f149c001d10 con 0x7f14a013a900 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 10 monclient: dump: 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.257 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2165194080 0 0) 0x7f14a00a3b50 con 0x7f14a013a900 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.195:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14a00a7080 con 0x7f14a013a900 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f149c0048a0 con 0x7f14a013a900 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:43.258 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.195:6792/0 conn(0x7f14a013a900 legacy=0x7f14a013ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.239+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.195:6792/0 conn(0x7f14a013a900 legacy=0x7f14a013ace0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.245+0000 7f14a7608640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-13T10:40:43.259 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.245+0000 7f14a7608640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f14a006efd0 con 0x7f14a013b3f0 2024-09-13T10:40:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.248+0000 7f14a53a4640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.195:6792/0 conn(0x7f14a013b3f0 legacy=0x7f14a01dbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.248+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466707107 0 0) 0x7f14a006efd0 con 0x7f14a013b3f0 2024-09-13T10:40:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.248+0000 7f1495ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.248+0000 7f1495ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.260 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.248+0000 7f1495ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.248+0000 7f1495ffb640 10 monclient(hunting): my global_id is 58156 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.248+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14a00a3b50 con 0x7f14a013b3f0 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1427499372 0 0) 0x7f14a00a3b50 con 0x7f14a013b3f0 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14a006efd0 con 0x7f14a013b3f0 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f149c005150 con 0x7f14a013b3f0 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 10 monclient: dump: 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.261 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.7 v1:172.21.15.195:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 854204318 0 0) 0x7f14a006efd0 con 0x7f14a013b3f0 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 --> v1:172.21.15.195:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f14a00a6bc0 con 0x7f14a013b3f0 2024-09-13T10:40:43.262 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 <== mon.7 v1:172.21.15.195:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7896 (unknown 0 0 1264344648) 0x7f149c008600 con 0x7f14a013b3f0 2024-09-13T10:40:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-13T10:40:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.195:6792/0 conn(0x7f14a013b3f0 legacy=0x7f14a01dbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.263 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.249+0000 7f1495ffb640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.195:6792/0 conn(0x7f14a013b3f0 legacy=0x7f14a01dbb30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:43.263 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:43.263 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:43.263 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:43.263 INFO:teuthology.orchestra.run.smithi181.stdout: "state": "leader", 2024-09-13T10:40:43.263 INFO:teuthology.orchestra.run.smithi181.stdout: "election_epoch": 148, 2024-09-13T10:40:43.263 INFO:teuthology.orchestra.run.smithi181.stdout: "uptime": 657669, 2024-09-13T10:40:43.264 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum": [ 2024-09-13T10:40:43.264 INFO:teuthology.orchestra.run.smithi181.stdout: 0, 2024-09-13T10:40:43.264 INFO:teuthology.orchestra.run.smithi181.stdout: 1, 2024-09-13T10:40:43.264 INFO:teuthology.orchestra.run.smithi181.stdout: 2, 2024-09-13T10:40:43.264 INFO:teuthology.orchestra.run.smithi181.stdout: 3, 2024-09-13T10:40:43.264 INFO:teuthology.orchestra.run.smithi181.stdout: 4, 2024-09-13T10:40:43.264 INFO:teuthology.orchestra.run.smithi181.stdout: 5, 2024-09-13T10:40:43.264 INFO:teuthology.orchestra.run.smithi181.stdout: 6, 2024-09-13T10:40:43.264 INFO:teuthology.orchestra.run.smithi181.stdout: 7, 2024-09-13T10:40:43.264 INFO:teuthology.orchestra.run.smithi181.stdout: 8 2024-09-13T10:40:43.264 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:43.264 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_age": 2, 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "required_con": "2450521708007866372", 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "required_mon": [ 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:43.265 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_con": "4540719139924082687", 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "quorum_mon": [ 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:43.266 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "outside_quorum": [], 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "extra_probe_peers": [], 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "sync_provider": [], 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "monmap": { 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "epoch": 1, 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "fsid": "de6e6e36-ff0f-4526-9812-870bc0eec0ee", 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "modified": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "created": "2024-09-13T10:29:19.709789Z", 2024-09-13T10:40:43.267 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release": 19, 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "min_mon_release_name": "squid", 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "election_strategy": 3, 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "disallowed_leaders: ": "", 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false, 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "tiebreaker_mon": "", 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "removed_ranks: ": "", 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "features": { 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "persistent": [ 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "kraken", 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "luminous", 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "mimic", 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap-prune", 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "nautilus", 2024-09-13T10:40:43.268 INFO:teuthology.orchestra.run.smithi181.stdout: "octopus", 2024-09-13T10:40:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "pacific", 2024-09-13T10:40:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "elector-pinging", 2024-09-13T10:40:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "quincy", 2024-09-13T10:40:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "reef", 2024-09-13T10:40:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "squid" 2024-09-13T10:40:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "optional": [] 2024-09-13T10:40:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "mons": [ 2024-09-13T10:40:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 0, 2024-09-13T10:40:43.269 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "a", 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789", 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6789/0", 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6789/0", 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.270 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 1, 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "f", 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789", 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.271 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6789/0", 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6789/0", 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 2, 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "b", 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790", 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6790/0", 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6790/0", 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.273 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 3, 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "g", 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790", 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6790/0", 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6790/0", 2024-09-13T10:40:43.274 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 4, 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "c", 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791", 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.275 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6791/0", 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6791/0", 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 5, 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "h", 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.276 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791", 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6791/0", 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6791/0", 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 6, 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "d", 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792", 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6792/0", 2024-09-13T10:40:43.278 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6792/0", 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 7, 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "i", 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792", 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.195:6792/0", 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.195:6792/0", 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "rank": 8, 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "name": "e", 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addrs": { 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: "addrvec": [ 2024-09-13T10:40:43.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "type": "v1", 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793", 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "nonce": 0 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "addr": "172.21.15.181:6793/0", 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "public_addr": "172.21.15.181:6793/0", 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "priority": 0, 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "weight": 0, 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: "crush_location": "{}" 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "feature_map": { 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "mon": [ 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "osd": [ 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 2 2024-09-13T10:40:43.282 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "client": [ 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 3 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "mgr": [ 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "features": "0x3f03dffffffdffff", 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "release": "squid", 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: "num": 1 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-09-13T10:40:43.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-09-13T10:40:43.284 INFO:teuthology.orchestra.run.smithi181.stdout: "stretch_mode": false 2024-09-13T10:40:43.284 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.250+0000 7f14a7608640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.195:6800/1839191919 conn(0x7f148403fd10 legacy=0x7f14840421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.250+0000 7f14a7608640 10 monclient: shutdown 2024-09-13T10:40:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.250+0000 7f14a7608640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.250+0000 7f14a7608640 1 -- 172.21.15.181:0/3293767438 >> v1:172.21.15.181:6792/0 conn(0x7f14a013c910 legacy=0x7f14a01d6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.250+0000 7f14a5ba5640 1 -- 172.21.15.181:0/3293767438 reap_dead start 2024-09-13T10:40:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.250+0000 7f14a5ba5640 1 -- 172.21.15.181:0/3293767438 reap_dead start 2024-09-13T10:40:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.250+0000 7f14a7608640 1 -- 172.21.15.181:0/3293767438 shutdown_connections 2024-09-13T10:40:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.250+0000 7f14a7608640 1 -- 172.21.15.181:0/3293767438 >> 172.21.15.181:0/3293767438 conn(0x7f14a00a45b0 msgr2=0x7f14a006fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.250+0000 7f14a7608640 1 -- 172.21.15.181:0/3293767438 shutdown_connections 2024-09-13T10:40:43.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.250+0000 7f14a7608640 1 -- 172.21.15.181:0/3293767438 wait complete. 2024-09-13T10:40:43.286 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-13T10:40:43.286 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T10:40:43.286 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T10:40:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.382+0000 7f7082fec640 10 monclient: get_monmap_and_config 2024-09-13T10:40:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.382+0000 7f7082fec640 10 monclient: build_initial_monmap 2024-09-13T10:40:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.382+0000 7f7082fec640 10 monclient: monmap: 2024-09-13T10:40:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:43.383164+0000 2024-09-13T10:40:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:43.383164+0000 2024-09-13T10:40:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:43.384 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:43.385 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:43.385 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 1 Processor -- start 2024-09-13T10:40:43.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 1 -- start start 2024-09-13T10:40:43.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 10 monclient: init 2024-09-13T10:40:43.386 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 10 monclient: _add_conns ranks=[2,0,7,3,5,1,8,6,4] 2024-09-13T10:40:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 10 monclient(hunting): picked mon.noname-b con 0x7f707c0a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 10 monclient(hunting): picked mon.noname-a con 0x7f707c0a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 10 monclient(hunting): picked mon.noname-i con 0x7f707c13f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707c0a5fe0 con 0x7f707c0a6ab0 2024-09-13T10:40:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707c0a8080 con 0x7f707c0a66d0 2024-09-13T10:40:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707c0a42c0 con 0x7f707c13f9a0 2024-09-13T10:40:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7082fec640 10 monclient(hunting): authenticate will time out at 1382.888806s 2024-09-13T10:40:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f707bfff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f707c0a6ab0 0x7f707c0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50774/0 (socket says 172.21.15.181:50774) 2024-09-13T10:40:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f707bfff640 1 -- 172.21.15.181:0/3997756875 learned_addr learned my addr 172.21.15.181:0/3997756875 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:43.387 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.383+0000 7f7080d88640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f707c0a66d0 0x7f707c0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:51412/0 (socket says 172.21.15.181:51412) 2024-09-13T10:40:43.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707bfff640 1 -- 172.21.15.181:0/3997756875 >> v1:172.21.15.181:6789/0 conn(0x7f707c0a6ab0 legacy=0x7f707c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f7080d88640 1 -- 172.21.15.181:0/3997756875 >> v1:172.21.15.181:6790/0 conn(0x7f707c0a66d0 legacy=0x7f707c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 1 -- 172.21.15.181:0/3997756875 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868397913 0 0) 0x7f707c0a8080 con 0x7f707c0a66d0 2024-09-13T10:40:43.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f7081589640 1 -- 172.21.15.181:0/3997756875 >> v1:172.21.15.195:6792/0 conn(0x7f707c13f9a0 legacy=0x7f707c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient(hunting): my global_id is 174422 2024-09-13T10:40:43.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 1 -- 172.21.15.181:0/3997756875 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f706c003520 con 0x7f707c0a66d0 2024-09-13T10:40:43.391 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 1 -- 172.21.15.181:0/3997756875 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354991125 0 0) 0x7f707c0a5fe0 con 0x7f707c0a6ab0 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient(hunting): my global_id is 184185 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 1 -- 172.21.15.181:0/3997756875 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f707c0a8080 con 0x7f707c0a6ab0 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 1 -- 172.21.15.181:0/3997756875 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3091419793 0 0) 0x7f706c003520 con 0x7f707c0a66d0 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 1 -- 172.21.15.181:0/3997756875 >> v1:172.21.15.195:6792/0 conn(0x7f707c13f9a0 legacy=0x7f707c141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 1 -- 172.21.15.181:0/3997756875 >> v1:172.21.15.181:6789/0 conn(0x7f707c0a6ab0 legacy=0x7f707c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 1 monclient: found mon.noname-b 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.181:6790/0 2024-09-13T10:40:43.392 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 1 -- 172.21.15.181:0/3997756875 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707c1464e0 con 0x7f707c0a66d0 2024-09-13T10:40:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient: _finish_auth 0 2024-09-13T10:40:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:40:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 1 -- 172.21.15.181:0/3997756875 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7070001ae0 con 0x7f707c0a66d0 2024-09-13T10:40:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f7082fec640 5 monclient: authenticate success, global_id 174422 2024-09-13T10:40:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f7082fec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:40:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient: dump: 2024-09-13T10:40:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.393 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.394 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f7082fec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 1 -- 172.21.15.181:0/3997756875 <== mon.2 v1:172.21.15.181:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70700047e0 con 0x7f707c0a66d0 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 1 -- 172.21.15.181:0/3997756875 <== mon.2 v1:172.21.15.181:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7070004d50 con 0x7f707c0a66d0 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f7082fec640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f7082fec640 4 set_mon_vals no callback set 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.386+0000 7f707b7fe640 10 monclient: dump: 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.395 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.387+0000 7f7082fec640 10 monclient: shutdown 2024-09-13T10:40:43.396 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.387+0000 7f7082fec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.387+0000 7f7082fec640 1 -- 172.21.15.181:0/3997756875 >> v1:172.21.15.181:6790/0 conn(0x7f707c0a66d0 legacy=0x7f707c0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.387+0000 7f7082fec640 1 -- 172.21.15.181:0/3997756875 shutdown_connections 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.387+0000 7f7082fec640 1 -- 172.21.15.181:0/3997756875 >> 172.21.15.181:0/3997756875 conn(0x7f707c0abcd0 msgr2=0x7f707c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.387+0000 7f7082fec640 1 -- 172.21.15.181:0/3997756875 shutdown_connections 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.387+0000 7f7082fec640 1 -- 172.21.15.181:0/3997756875 wait complete. 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.387+0000 7f7082fec640 10 monclient: build_initial_monmap 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.387+0000 7f7082fec640 10 monclient: monmap: 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:43.397 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 1 Processor -- start 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 1 -- start start 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 10 monclient: init 2024-09-13T10:40:43.398 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 10 monclient: _add_conns ranks=[2,6,1,3,5,8,0,4,7] 2024-09-13T10:40:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 10 monclient(hunting): picked mon.noname-b con 0x7f707c0a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 10 monclient(hunting): picked mon.noname-d con 0x7f707c0a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 10 monclient(hunting): picked mon.noname-f con 0x7f707c13f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707c13e330 con 0x7f707c13f9a0 2024-09-13T10:40:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707c13f5c0 con 0x7f707c0a66d0 2024-09-13T10:40:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707c068c50 con 0x7f707c0a6ab0 2024-09-13T10:40:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7082fec640 10 monclient(hunting): authenticate will time out at 1382.893850s 2024-09-13T10:40:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7080d88640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f707c0a66d0 0x7f707c13b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:51418/0 (socket says 172.21.15.181:51418) 2024-09-13T10:40:43.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.388+0000 7f7080d88640 1 -- 172.21.15.181:0/3370181137 learned_addr learned my addr 172.21.15.181:0/3370181137 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:43.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f7080d88640 1 -- 172.21.15.181:0/3370181137 >> v1:172.21.15.181:6790/0 conn(0x7f707c0a66d0 legacy=0x7f707c13b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f707bfff640 1 -- 172.21.15.181:0/3370181137 >> v1:172.21.15.181:6792/0 conn(0x7f707c0a6ab0 legacy=0x7f707c13ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f7081589640 1 -- 172.21.15.181:0/3370181137 >> v1:172.21.15.195:6789/0 conn(0x7f707c13f9a0 legacy=0x7f707c1d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:43.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981809468 0 0) 0x7f707c068c50 con 0x7f707c0a6ab0 2024-09-13T10:40:43.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): my global_id is 174462 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7060003520 con 0x7f707c0a6ab0 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004799162 0 0) 0x7f707c1464e0 con 0x7f707c0a66d0 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): my global_id is 174431 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f707c068c50 con 0x7f707c0a66d0 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578334794 0 0) 0x7f707c13e330 con 0x7f707c13f9a0 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:43.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): my global_id is 135208 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f707c1464e0 con 0x7f707c13f9a0 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2289499376 0 0) 0x7f7060003520 con 0x7f707c0a6ab0 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f707c13e330 con 0x7f707c0a6ab0 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f70680047e0 con 0x7f707c0a6ab0 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): dump: 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.405 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 965194871 0 0) 0x7f707c068c50 con 0x7f707c0a66d0 2024-09-13T10:40:43.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7060003520 con 0x7f707c0a66d0 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7070004cd0 con 0x7f707c0a66d0 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): dump: 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.407 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 347036586 0 0) 0x7f707c1464e0 con 0x7f707c13f9a0 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f707c068c50 con 0x7f707c13f9a0 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f7074001f40 con 0x7f707c13f9a0 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient(hunting): dump: 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.408 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.409 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 106321223 0 0) 0x7f707c13e330 con 0x7f707c0a6ab0 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 >> v1:172.21.15.181:6790/0 conn(0x7f707c0a66d0 legacy=0x7f707c13b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 >> v1:172.21.15.195:6789/0 conn(0x7f707c13f9a0 legacy=0x7f707c1d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient: _finish_hunting 0 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 monclient: found mon.d 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707c13c1a0 con 0x7f707c0a6ab0 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient: _finish_auth 0 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient: _check_auth_tickets 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f7082fec640 5 monclient: authenticate success, global_id 174462 2024-09-13T10:40:43.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f7082fec640 10 monclient: _renew_subs 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f7082fec640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f7082fec640 1 -- 172.21.15.181:0/3370181137 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f707c13ce40 con 0x7f707c0a6ab0 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f7082fec640 10 monclient: _renew_subs 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f7082fec640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f7082fec640 1 -- 172.21.15.181:0/3370181137 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f707c0a2a70 con 0x7f707c0a6ab0 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7068004cb0 con 0x7f707c0a6ab0 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f70680051e0 con 0x7f707c0a6ab0 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f707affd640 4 set_mon_vals no callback set 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.391+0000 7f70797fa640 10 monclient: dump: 2024-09-13T10:40:43.411 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:43.412 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:43.413 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:43.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.392+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7068005380 con 0x7f707c0a6ab0 2024-09-13T10:40:43.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.392+0000 7f7082fec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:43.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.392+0000 7f7082fec640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:43.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.392+0000 7f7082fec640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:43.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.392+0000 7f7082fec640 1 -- 172.21.15.181:0/3370181137 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f705c005080 con 0x7f707c0a6ab0 2024-09-13T10:40:43.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.392+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f706804e160 con 0x7f707c0a6ab0 2024-09-13T10:40:43.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.392+0000 7f7080d88640 10 monclient: get_auth_request con 0x7f70600404b0 auth_method 0 2024-09-13T10:40:43.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.397+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f70680177d0 con 0x7f707c0a6ab0 2024-09-13T10:40:43.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.397+0000 7f70797fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:43.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.397+0000 7f70797fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:43.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.642+0000 7f7082fec640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-13T10:40:43.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.642+0000 7f7082fec640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-13T10:40:43.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.642+0000 7f7082fec640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:43.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.642+0000 7f7082fec640 1 -- 172.21.15.181:0/3370181137 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f705c005c40 con 0x7f707c0a6ab0 2024-09-13T10:40:43.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.644+0000 7f70797fa640 1 -- 172.21.15.181:0/3370181137 <== mon.6 v1:172.21.15.181:6792/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f70680170d0 con 0x7f707c0a6ab0 2024-09-13T10:40:43.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.644+0000 7f70797fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-13T10:40:43.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.644+0000 7f70797fa640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:43.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.646+0000 7f7082fec640 1 -- 172.21.15.181:0/3370181137 >> v1:172.21.15.195:6800/1839191919 conn(0x7f70600404b0 legacy=0x7f7060042970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.646+0000 7f7082fec640 10 monclient: shutdown 2024-09-13T10:40:43.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.646+0000 7f7082fec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:43.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.646+0000 7f7082fec640 1 -- 172.21.15.181:0/3370181137 >> v1:172.21.15.181:6792/0 conn(0x7f707c0a6ab0 legacy=0x7f707c13ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:43.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.647+0000 7f7082fec640 1 -- 172.21.15.181:0/3370181137 shutdown_connections 2024-09-13T10:40:43.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.647+0000 7f7082fec640 1 -- 172.21.15.181:0/3370181137 >> 172.21.15.181:0/3370181137 conn(0x7f707c0abcd0 msgr2=0x7f707c145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:43.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.647+0000 7f7082fec640 1 -- 172.21.15.181:0/3370181137 shutdown_connections 2024-09-13T10:40:43.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:43.647+0000 7f7082fec640 1 -- 172.21.15.181:0/3370181137 wait complete. 2024-09-13T10:40:43.659 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-13T10:40:44.310 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.311 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=2843497539,config=2586702516,health=4152849255,kv=3467323233,logm=3641691495}) 2024-09-13T10:40:44.311 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=12,kv=11,logm=47} crc {auth=4183962856,config=2586702516,health=2739075239,kv=3279620548,logm=136326134}) 2024-09-13T10:40:44.311 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.311 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=2843497539,config=2586702516,health=4152849255,kv=3467323233,logm=3641691495}) 2024-09-13T10:40:44.311 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=28,config=2,health=11,kv=11,logm=48} crc {auth=4106527682,config=2586702516,health=1653820738,kv=3467323233,logm=683037714}) 2024-09-13T10:40:44.311 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.311 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=2843497539,config=2586702516,health=4152849255,kv=3467323233,logm=3641691495}) 2024-09-13T10:40:44.311 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=29,config=2,health=12,kv=12,logm=45} crc {auth=893820922,config=2586702516,health=2739075239,kv=3467323233,logm=894618137}) 2024-09-13T10:40:44.311 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.311 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=2843497539,config=2586702516,health=4152849255,kv=3467323233,logm=3641691495}) 2024-09-13T10:40:44.311 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=28,config=2,health=12,kv=11,logm=47} crc {auth=744959776,config=2586702516,health=2739075239,kv=3074811039,logm=179459910}) 2024-09-13T10:40:44.311 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.312 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=2843497539,config=2586702516,health=4152849255,kv=3467323233,logm=3641691495}) 2024-09-13T10:40:44.312 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=29,config=2,health=11,kv=12,logm=46} crc {auth=893820922,config=2586702516,health=2169531732,kv=3467323233,logm=3600279320}) 2024-09-13T10:40:44.312 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.312 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=2843497539,config=2586702516,health=4152849255,kv=3467323233,logm=3641691495}) 2024-09-13T10:40:44.312 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=27,config=2,health=12,kv=11,logm=48} crc {auth=714017663,config=2586702516,health=2739075239,kv=1054420120,logm=1811680655}) 2024-09-13T10:40:44.312 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.312 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=2843497539,config=2586702516,health=4152849255,kv=3467323233,logm=3641691495}) 2024-09-13T10:40:44.312 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=28,config=2,health=12,kv=11,logm=47} crc {auth=573989070,config=2586702516,health=3211519395,kv=3759619045,logm=4221291855}) 2024-09-13T10:40:44.312 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.312 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=2843497539,config=2586702516,health=4152849255,kv=3467323233,logm=3641691495}) 2024-09-13T10:40:44.312 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.308+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=27,config=2,health=12,kv=11,logm=48} crc {auth=2707129804,config=2586702516,health=2739075239,kv=3226510214,logm=3039499558}) 2024-09-13T10:40:44.314 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.314 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2051127618}) 2024-09-13T10:40:44.314 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1689267589}) 2024-09-13T10:40:44.314 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.314 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2051127618}) 2024-09-13T10:40:44.314 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=597800346}) 2024-09-13T10:40:44.314 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2051127618}) 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1189223594}) 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2051127618}) 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1154533320}) 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2051127618}) 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3303598253}) 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2051127618}) 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3332604369}) 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2051127618}) 2024-09-13T10:40:44.315 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2811713551}) 2024-09-13T10:40:44.316 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.316 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2051127618}) 2024-09-13T10:40:44.316 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.311+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3539736964}) 2024-09-13T10:40:44.343 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.313+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.343 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.313+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=568328199}) 2024-09-13T10:40:44.343 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.313+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=582500362}) 2024-09-13T10:40:44.343 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.313+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.343 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.313+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=568328199}) 2024-09-13T10:40:44.343 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.313+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=446658590}) 2024-09-13T10:40:44.343 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.313+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.343 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.313+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=568328199}) 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.313+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1476171035}) 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=568328199}) 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=93757577}) 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=568328199}) 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=281582950}) 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=568328199}) 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=28634489}) 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=568328199}) 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=554067054}) 2024-09-13T10:40:44.344 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=568328199}) 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.314+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2436180719}) 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=642295670}) 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=178185558}) 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=642295670}) 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2893296841}) 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=642295670}) 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=99777083}) 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.345 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=642295670}) 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=32741694}) 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=642295670}) 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3692979485}) 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=642295670}) 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3341713194}) 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=642295670}) 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=655411595}) 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=642295670}) 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.315+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=362377866}) 2024-09-13T10:40:44.346 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1990498055}) 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=127537206}) 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1990498055}) 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=743695619}) 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1990498055}) 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=138010448}) 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1990498055}) 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1060236312}) 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1990498055}) 2024-09-13T10:40:44.347 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=291620406}) 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1990498055}) 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1106027364}) 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1990498055}) 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4098454986}) 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1990498055}) 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.317+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3436611236}) 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2953997018}) 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3817946126}) 2024-09-13T10:40:44.348 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2953997018}) 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=255507832}) 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2953997018}) 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=887613156}) 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2953997018}) 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1587626132}) 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2953997018}) 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2108058741}) 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2953997018}) 2024-09-13T10:40:44.349 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=403516148}) 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2953997018}) 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2053379800}) 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2953997018}) 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.318+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2046497441}) 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.319+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.319+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=727773446}) 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.319+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3939953506}) 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.319+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.319+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=727773446}) 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.319+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3280315600}) 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.319+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.350 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.319+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=727773446}) 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.319+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=7858592}) 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.319+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.319+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=727773446}) 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.319+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=271885447}) 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.320+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.320+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=727773446}) 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.320+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3645804012}) 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.320+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.320+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=727773446}) 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.320+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4057703970}) 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.320+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.320+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=727773446}) 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.320+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1257399542}) 2024-09-13T10:40:44.351 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.320+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.320+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=727773446}) 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.320+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2815488817}) 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2301386016}) 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=528596756}) 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2301386016}) 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=617799273}) 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2301386016}) 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3263344578}) 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.352 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2301386016}) 2024-09-13T10:40:44.353 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3717142215}) 2024-09-13T10:40:44.353 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.353 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2301386016}) 2024-09-13T10:40:44.353 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4125743007}) 2024-09-13T10:40:44.353 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.353 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2301386016}) 2024-09-13T10:40:44.353 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1835675}) 2024-09-13T10:40:44.353 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.353 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2301386016}) 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2696177325}) 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2301386016}) 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.321+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1150494775}) 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2776129248}) 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4175515508}) 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2776129248}) 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4187703523}) 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2776129248}) 2024-09-13T10:40:44.354 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2157140013}) 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2776129248}) 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=225223771}) 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2776129248}) 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1663773281}) 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2776129248}) 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3294193031}) 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2776129248}) 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3559324669}) 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.355 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2776129248}) 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.322+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1001173154}) 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3557506470}) 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1565997378}) 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3557506470}) 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2153991314}) 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3557506470}) 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=539938712}) 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3557506470}) 2024-09-13T10:40:44.356 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1863487626}) 2024-09-13T10:40:44.357 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.357 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3557506470}) 2024-09-13T10:40:44.357 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4280325192}) 2024-09-13T10:40:44.357 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.357 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3557506470}) 2024-09-13T10:40:44.357 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2181126346}) 2024-09-13T10:40:44.357 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.357 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3557506470}) 2024-09-13T10:40:44.357 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=588793943}) 2024-09-13T10:40:44.357 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.357 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3557506470}) 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.323+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1604518322}) 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1842643971}) 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882058280}) 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1842643971}) 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2207124529}) 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1842643971}) 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1990903478}) 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1842643971}) 2024-09-13T10:40:44.358 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1066650154}) 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1842643971}) 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=434677182}) 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1842643971}) 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3088217905}) 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1842643971}) 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=587530681}) 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1842643971}) 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.325+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1656206975}) 2024-09-13T10:40:44.359 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=905789929}) 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2305509570}) 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=905789929}) 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1741818397}) 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=905789929}) 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2088839584}) 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=905789929}) 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=366502269}) 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.360 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=905789929}) 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1123733865}) 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=905789929}) 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3093646036}) 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=905789929}) 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3920248792}) 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=905789929}) 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.326+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2898108377}) 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3978470942}) 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3939285115}) 2024-09-13T10:40:44.361 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3978470942}) 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=410919666}) 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3978470942}) 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4216275759}) 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3978470942}) 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=972564814}) 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3978470942}) 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2890875115}) 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3978470942}) 2024-09-13T10:40:44.362 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1863338869}) 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3978470942}) 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=198242049}) 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3978470942}) 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.327+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1515530043}) 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=443319617}) 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4108587791}) 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=443319617}) 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2122521234}) 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.363 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=443319617}) 2024-09-13T10:40:44.364 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1576087554}) 2024-09-13T10:40:44.364 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.364 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=443319617}) 2024-09-13T10:40:44.364 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1769255721}) 2024-09-13T10:40:44.364 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.364 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=443319617}) 2024-09-13T10:40:44.364 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=56369915}) 2024-09-13T10:40:44.364 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.364 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=443319617}) 2024-09-13T10:40:44.364 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=308687875}) 2024-09-13T10:40:44.364 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.364 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=443319617}) 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=799505702}) 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=443319617}) 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.329+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3371489010}) 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3155893026}) 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2257409680}) 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3155893026}) 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4201213804}) 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3155893026}) 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=986074449}) 2024-09-13T10:40:44.365 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3155893026}) 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3437599471}) 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3155893026}) 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4007440714}) 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3155893026}) 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=83070244}) 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3155893026}) 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=381536630}) 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3155893026}) 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.330+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3970538021}) 2024-09-13T10:40:44.366 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.331+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.367 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.331+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=762733303}) 2024-09-13T10:40:44.367 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.331+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=633438545}) 2024-09-13T10:40:44.367 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.331+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.367 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.331+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=762733303}) 2024-09-13T10:40:44.367 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.331+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2622798948}) 2024-09-13T10:40:44.367 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.331+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.367 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.331+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=762733303}) 2024-09-13T10:40:44.367 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.331+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=41758157}) 2024-09-13T10:40:44.367 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.367 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=762733303}) 2024-09-13T10:40:44.367 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1333470743}) 2024-09-13T10:40:44.367 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=762733303}) 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2320342355}) 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=762733303}) 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1457694065}) 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=762733303}) 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1293936777}) 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=762733303}) 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.332+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=543028421}) 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.368 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2101736101}) 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=220374973}) 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2101736101}) 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=28977091}) 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2101736101}) 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3577174089}) 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2101736101}) 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1645101694}) 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2101736101}) 2024-09-13T10:40:44.369 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=195785075}) 2024-09-13T10:40:44.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2101736101}) 2024-09-13T10:40:44.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=833359061}) 2024-09-13T10:40:44.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2101736101}) 2024-09-13T10:40:44.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2800901285}) 2024-09-13T10:40:44.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2101736101}) 2024-09-13T10:40:44.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.333+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2943769165}) 2024-09-13T10:40:44.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.334+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.334+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=468606263}) 2024-09-13T10:40:44.370 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.334+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291263727}) 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.334+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.334+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=468606263}) 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.334+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=878821861}) 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.334+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.334+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=468606263}) 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2688050328}) 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=468606263}) 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=333163635}) 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=468606263}) 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2175724374}) 2024-09-13T10:40:44.371 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=468606263}) 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2240882134}) 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=468606263}) 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4057674512}) 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=468606263}) 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.335+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=932375831}) 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3820911874}) 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3380282558}) 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3820911874}) 2024-09-13T10:40:44.372 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2376937050}) 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3820911874}) 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2495771904}) 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3820911874}) 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=944456877}) 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3820911874}) 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3741299909}) 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3820911874}) 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2878841876}) 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.373 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3820911874}) 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2748742834}) 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3820911874}) 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.336+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2485904976}) 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.337+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1717792902}) 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2479872915}) 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1717792902}) 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2998604048}) 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1717792902}) 2024-09-13T10:40:44.374 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=812873063}) 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1717792902}) 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=909815846}) 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1717792902}) 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3522320846}) 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1717792902}) 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=999346773}) 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1717792902}) 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=354839017}) 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1717792902}) 2024-09-13T10:40:44.375 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.338+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1781457826}) 2024-09-13T10:40:44.440 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.440 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=895553854}) 2024-09-13T10:40:44.441 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4196323510}) 2024-09-13T10:40:44.441 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.441 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=895553854}) 2024-09-13T10:40:44.441 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1025866824}) 2024-09-13T10:40:44.441 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.441 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=895553854}) 2024-09-13T10:40:44.441 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=373651254}) 2024-09-13T10:40:44.441 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.441 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=895553854}) 2024-09-13T10:40:44.441 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1944572427}) 2024-09-13T10:40:44.441 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.441 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=895553854}) 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1213395699}) 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=895553854}) 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2182470643}) 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=895553854}) 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3515388463}) 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=895553854}) 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.347+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2582500855}) 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1330903345}) 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1315807471}) 2024-09-13T10:40:44.442 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.443 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1330903345}) 2024-09-13T10:40:44.443 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2394748993}) 2024-09-13T10:40:44.443 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.443 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1330903345}) 2024-09-13T10:40:44.443 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2792321719}) 2024-09-13T10:40:44.443 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.443 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1330903345}) 2024-09-13T10:40:44.443 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2033994993}) 2024-09-13T10:40:44.443 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.443 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1330903345}) 2024-09-13T10:40:44.443 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1350094206}) 2024-09-13T10:40:44.443 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.348+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.349+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1330903345}) 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.349+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1179129554}) 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.349+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.349+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1330903345}) 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.349+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2686315768}) 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.349+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.349+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1330903345}) 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.349+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=521476074}) 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1675792450}) 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3348336856}) 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1675792450}) 2024-09-13T10:40:44.444 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3933639334}) 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1675792450}) 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=976761947}) 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1675792450}) 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3943332070}) 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1675792450}) 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1731987419}) 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1675792450}) 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2663128421}) 2024-09-13T10:40:44.445 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1675792450}) 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=117674175}) 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1675792450}) 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.350+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1135685382}) 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3471095039}) 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2655209277}) 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3471095039}) 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3810558109}) 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.446 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3471095039}) 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3577611315}) 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3471095039}) 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2195857614}) 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3471095039}) 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=864066115}) 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.351+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.352+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3471095039}) 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.352+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2398889284}) 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.352+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.352+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3471095039}) 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.352+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3981263151}) 2024-09-13T10:40:44.447 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.352+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.352+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3471095039}) 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.352+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=222219776}) 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3144595926}) 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2035571741}) 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3144595926}) 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=234839265}) 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3144595926}) 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2974709199}) 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.448 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3144595926}) 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1955284912}) 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3144595926}) 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4171545212}) 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3144595926}) 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=32140988}) 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3144595926}) 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2169006887}) 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3144595926}) 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.353+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1421513897}) 2024-09-13T10:40:44.449 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3754083046}) 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1420363966}) 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3754083046}) 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2594055928}) 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3754083046}) 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=88706799}) 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3754083046}) 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=18142400}) 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3754083046}) 2024-09-13T10:40:44.450 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2875625767}) 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3754083046}) 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1819286612}) 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3754083046}) 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1550593817}) 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3754083046}) 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.354+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3602638161}) 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=921154390}) 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=108391812}) 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.451 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=921154390}) 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2180235985}) 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=921154390}) 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=861169037}) 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=921154390}) 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=320836455}) 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=921154390}) 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3456591362}) 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=921154390}) 2024-09-13T10:40:44.452 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=563223345}) 2024-09-13T10:40:44.453 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.366+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.453 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.367+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=921154390}) 2024-09-13T10:40:44.453 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.367+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3257528567}) 2024-09-13T10:40:44.453 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.367+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.453 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.367+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=921154390}) 2024-09-13T10:40:44.453 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.367+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3409798755}) 2024-09-13T10:40:44.453 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.453 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=611036525}) 2024-09-13T10:40:44.453 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2566627335}) 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=611036525}) 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2343071219}) 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=611036525}) 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2273041822}) 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=611036525}) 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1650987494}) 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=611036525}) 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1758530596}) 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.454 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=611036525}) 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1059863611}) 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=611036525}) 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2320478426}) 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=611036525}) 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.368+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1905835774}) 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1261297259}) 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2078384048}) 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1261297259}) 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2359658900}) 2024-09-13T10:40:44.455 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.456 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1261297259}) 2024-09-13T10:40:44.456 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=560141330}) 2024-09-13T10:40:44.456 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.456 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1261297259}) 2024-09-13T10:40:44.456 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4032258266}) 2024-09-13T10:40:44.456 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.456 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1261297259}) 2024-09-13T10:40:44.456 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4143306356}) 2024-09-13T10:40:44.456 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.456 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1261297259}) 2024-09-13T10:40:44.456 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2180398701}) 2024-09-13T10:40:44.456 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1261297259}) 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3925101234}) 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1261297259}) 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.369+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3031425256}) 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.370+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.370+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=523664469}) 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.370+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1049992714}) 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.370+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.370+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=523664469}) 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.370+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=684252580}) 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.370+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.457 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.370+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=523664469}) 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.370+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=420045506}) 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.370+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.370+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=523664469}) 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.370+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2261336361}) 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.371+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.371+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=523664469}) 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.371+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2947204938}) 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.371+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.371+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=523664469}) 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.371+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3238295380}) 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.371+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.371+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=523664469}) 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.371+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1027527631}) 2024-09-13T10:40:44.458 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.371+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.371+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=523664469}) 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.371+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=346922856}) 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=219774765}) 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2311163847}) 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=219774765}) 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3678099617}) 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=219774765}) 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=99528885}) 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=219774765}) 2024-09-13T10:40:44.459 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=269410904}) 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=219774765}) 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1252319422}) 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=219774765}) 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1587045279}) 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=219774765}) 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3033300658}) 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=219774765}) 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.372+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=153100941}) 2024-09-13T10:40:44.460 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3970061953}) 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4198124159}) 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3970061953}) 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=672982432}) 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3970061953}) 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1691038808}) 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3970061953}) 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3418934772}) 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3970061953}) 2024-09-13T10:40:44.461 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2577730566}) 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3970061953}) 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.373+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=111977122}) 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.374+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.374+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3970061953}) 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.374+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3338718253}) 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.374+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.374+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3970061953}) 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.374+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2556538114}) 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3742113360}) 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2112321724}) 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.462 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3742113360}) 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2332451950}) 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3742113360}) 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1241244411}) 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3742113360}) 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=745538187}) 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3742113360}) 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=303503892}) 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3742113360}) 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4187609434}) 2024-09-13T10:40:44.463 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3742113360}) 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=204095528}) 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3742113360}) 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.375+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=593692645}) 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4268185518}) 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3856482466}) 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4268185518}) 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2005786197}) 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4268185518}) 2024-09-13T10:40:44.464 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3995945061}) 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4268185518}) 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2330405266}) 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4268185518}) 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1346440064}) 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4268185518}) 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=888892478}) 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4268185518}) 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1032306342}) 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.465 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4268185518}) 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=48646959}) 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=322367764}) 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2732374129}) 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=322367764}) 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2958938324}) 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=322367764}) 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1615258083}) 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=322367764}) 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=731872318}) 2024-09-13T10:40:44.466 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=322367764}) 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1153838372}) 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=322367764}) 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3923109922}) 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=322367764}) 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4198548298}) 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=322367764}) 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.378+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2069127602}) 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1881065543}) 2024-09-13T10:40:44.467 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1291441266}) 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1881065543}) 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3331302021}) 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1881065543}) 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2695434211}) 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1881065543}) 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=90226627}) 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1881065543}) 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3382196946}) 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.468 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1881065543}) 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1722148540}) 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1881065543}) 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2888777918}) 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1881065543}) 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.379+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=287786381}) 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.380+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.380+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=469431938}) 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.380+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3206384983}) 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.380+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.380+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=469431938}) 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.380+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1963578430}) 2024-09-13T10:40:44.469 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.380+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.380+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=469431938}) 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.380+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1743567674}) 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=469431938}) 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=334178507}) 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=469431938}) 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3037632862}) 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=469431938}) 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=496459458}) 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=469431938}) 2024-09-13T10:40:44.470 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2075026308}) 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=469431938}) 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.381+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=197951632}) 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2982174340}) 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2893154742}) 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2982174340}) 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2619113557}) 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2982174340}) 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2610740056}) 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.471 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2982174340}) 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1718556121}) 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2982174340}) 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1218347041}) 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2982174340}) 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3975368887}) 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2982174340}) 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=416520703}) 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2982174340}) 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.382+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=73644441}) 2024-09-13T10:40:44.472 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1860458862}) 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2373203349}) 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1860458862}) 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1049834416}) 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1860458862}) 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1632517439}) 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1860458862}) 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.383+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2623457833}) 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.384+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.384+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1860458862}) 2024-09-13T10:40:44.473 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.384+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=971318506}) 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.384+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.384+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1860458862}) 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.384+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2019117698}) 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.384+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.384+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1860458862}) 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.384+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3087689952}) 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.384+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.384+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1860458862}) 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.384+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2611180725}) 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2204031968}) 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3010107034}) 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.474 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2204031968}) 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3722009068}) 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2204031968}) 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3251306161}) 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2204031968}) 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1111245737}) 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2204031968}) 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2067171609}) 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2204031968}) 2024-09-13T10:40:44.475 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=201060044}) 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2204031968}) 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1711345940}) 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2204031968}) 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.385+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2431020488}) 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1993446744}) 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3921256485}) 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1993446744}) 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3048135443}) 2024-09-13T10:40:44.476 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1993446744}) 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3136086028}) 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1993446744}) 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2477441647}) 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1993446744}) 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2493309729}) 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1993446744}) 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2744989718}) 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.477 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1993446744}) 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3920796339}) 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.386+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1993446744}) 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.387+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=360022414}) 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2804193580}) 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1609050114}) 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2804193580}) 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1936451}) 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2804193580}) 2024-09-13T10:40:44.478 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1974286163}) 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2804193580}) 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=261941603}) 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2804193580}) 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1644319049}) 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2804193580}) 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=523261802}) 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2804193580}) 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2246336249}) 2024-09-13T10:40:44.479 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2804193580}) 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.388+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4226430841}) 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=654482470}) 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1973708987}) 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=654482470}) 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3382562245}) 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=654482470}) 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1844192290}) 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=654482470}) 2024-09-13T10:40:44.480 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=455982093}) 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=654482470}) 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=347464737}) 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=654482470}) 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1903996977}) 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.390+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=654482470}) 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.390+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1198280864}) 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.390+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.390+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=654482470}) 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.390+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1973708987}) 2024-09-13T10:40:44.481 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1716060889}) 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1449205973}) 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1716060889}) 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=467245187}) 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1716060889}) 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2462156183}) 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1716060889}) 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1147183526}) 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.482 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1716060889}) 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4265425590}) 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1716060889}) 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=267263186}) 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1716060889}) 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4090458245}) 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1716060889}) 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.391+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2194472844}) 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2134432148}) 2024-09-13T10:40:44.483 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2639087464}) 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2134432148}) 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2851021668}) 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2134432148}) 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3251754388}) 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2134432148}) 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1325482766}) 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2134432148}) 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1668731176}) 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.484 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2134432148}) 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1479766110}) 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2134432148}) 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=973331044}) 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2134432148}) 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.392+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1233087333}) 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.393+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.393+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3098632267}) 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.393+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2003293254}) 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.393+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.393+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3098632267}) 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2065171808}) 2024-09-13T10:40:44.485 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3098632267}) 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=56576797}) 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3098632267}) 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=886964068}) 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3098632267}) 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1453820674}) 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3098632267}) 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3969442656}) 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3098632267}) 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2934761569}) 2024-09-13T10:40:44.486 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3098632267}) 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.394+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=253221042}) 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3096269470}) 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=575448562}) 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3096269470}) 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3403469403}) 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3096269470}) 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2745902924}) 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3096269470}) 2024-09-13T10:40:44.487 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=350798182}) 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3096269470}) 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3747551219}) 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3096269470}) 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3481508805}) 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3096269470}) 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3731749176}) 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3096269470}) 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.395+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3012064405}) 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.488 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2375531994}) 2024-09-13T10:40:44.489 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=289904294}) 2024-09-13T10:40:44.489 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.489 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2375531994}) 2024-09-13T10:40:44.489 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=352775849}) 2024-09-13T10:40:44.489 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.489 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2375531994}) 2024-09-13T10:40:44.489 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4199409606}) 2024-09-13T10:40:44.489 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.489 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2375531994}) 2024-09-13T10:40:44.489 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4243592050}) 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2375531994}) 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3141124126}) 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2375531994}) 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3197061134}) 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2375531994}) 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3916191883}) 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2375531994}) 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.404+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3193129578}) 2024-09-13T10:40:44.490 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.405+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.491 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.405+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=70248580}) 2024-09-13T10:40:44.491 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.405+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=72717639}) 2024-09-13T10:40:44.491 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.405+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.491 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=70248580}) 2024-09-13T10:40:44.491 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3501128280}) 2024-09-13T10:40:44.491 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.491 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=70248580}) 2024-09-13T10:40:44.491 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2617312273}) 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=70248580}) 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1320597338}) 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=70248580}) 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2234902743}) 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=70248580}) 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2528608204}) 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=70248580}) 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2861451619}) 2024-09-13T10:40:44.492 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=70248580}) 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.406+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3694135291}) 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3483350480}) 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=858768519}) 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3483350480}) 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4215729581}) 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3483350480}) 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2059309645}) 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3483350480}) 2024-09-13T10:40:44.493 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2687186698}) 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3483350480}) 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3923148190}) 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3483350480}) 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=904382008}) 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3483350480}) 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2421873172}) 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3483350480}) 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.407+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2896143382}) 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.494 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1037794120}) 2024-09-13T10:40:44.495 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1835555978}) 2024-09-13T10:40:44.495 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.495 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1037794120}) 2024-09-13T10:40:44.495 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1716233211}) 2024-09-13T10:40:44.495 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.495 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1037794120}) 2024-09-13T10:40:44.495 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1507353222}) 2024-09-13T10:40:44.495 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.495 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1037794120}) 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=733829385}) 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1037794120}) 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2180829683}) 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1037794120}) 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1545859671}) 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1037794120}) 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=799034016}) 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1037794120}) 2024-09-13T10:40:44.496 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.408+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=697512943}) 2024-09-13T10:40:44.497 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.409+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.497 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.409+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2644154474}) 2024-09-13T10:40:44.497 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.409+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1475410659}) 2024-09-13T10:40:44.497 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.409+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.497 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.409+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2644154474}) 2024-09-13T10:40:44.497 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.409+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1216737401}) 2024-09-13T10:40:44.500 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.409+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.500 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.409+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2644154474}) 2024-09-13T10:40:44.500 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.409+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1092547229}) 2024-09-13T10:40:44.500 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.500 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2644154474}) 2024-09-13T10:40:44.500 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=315804367}) 2024-09-13T10:40:44.500 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.500 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2644154474}) 2024-09-13T10:40:44.500 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3232623945}) 2024-09-13T10:40:44.500 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.500 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2644154474}) 2024-09-13T10:40:44.501 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1450788311}) 2024-09-13T10:40:44.501 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.501 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2644154474}) 2024-09-13T10:40:44.501 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3402565639}) 2024-09-13T10:40:44.501 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.501 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2644154474}) 2024-09-13T10:40:44.501 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.410+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1119815559}) 2024-09-13T10:40:44.501 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.501 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=724557471}) 2024-09-13T10:40:44.502 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=326513042}) 2024-09-13T10:40:44.502 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.502 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=724557471}) 2024-09-13T10:40:44.502 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1942341539}) 2024-09-13T10:40:44.502 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.502 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=724557471}) 2024-09-13T10:40:44.502 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1151756975}) 2024-09-13T10:40:44.502 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.502 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=724557471}) 2024-09-13T10:40:44.502 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3131996594}) 2024-09-13T10:40:44.502 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.503 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=724557471}) 2024-09-13T10:40:44.503 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4217571880}) 2024-09-13T10:40:44.503 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.503 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=724557471}) 2024-09-13T10:40:44.503 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3162159349}) 2024-09-13T10:40:44.503 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.503 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=724557471}) 2024-09-13T10:40:44.503 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3296323256}) 2024-09-13T10:40:44.503 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.503 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=724557471}) 2024-09-13T10:40:44.503 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.411+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3699071948}) 2024-09-13T10:40:44.603 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.603 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=512706840}) 2024-09-13T10:40:44.603 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4170996588}) 2024-09-13T10:40:44.603 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.603 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=512706840}) 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.599+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4258649970}) 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=512706840}) 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=571865679}) 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=512706840}) 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2717188476}) 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=512706840}) 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2574908818}) 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=512706840}) 2024-09-13T10:40:44.604 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=572284774}) 2024-09-13T10:40:44.605 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.605 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=512706840}) 2024-09-13T10:40:44.605 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2596878978}) 2024-09-13T10:40:44.605 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.605 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=512706840}) 2024-09-13T10:40:44.605 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.600+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4102722764}) 2024-09-13T10:40:44.611 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.612 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.608+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3628142127}) 2024-09-13T10:40:44.612 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3732262335}) 2024-09-13T10:40:44.612 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.612 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3628142127}) 2024-09-13T10:40:44.612 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2730471289}) 2024-09-13T10:40:44.612 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.612 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3628142127}) 2024-09-13T10:40:44.612 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=673231008}) 2024-09-13T10:40:44.612 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.612 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3628142127}) 2024-09-13T10:40:44.612 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3697860027}) 2024-09-13T10:40:44.612 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.613 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3628142127}) 2024-09-13T10:40:44.613 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1439065542}) 2024-09-13T10:40:44.613 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.613 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3628142127}) 2024-09-13T10:40:44.613 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=729098015}) 2024-09-13T10:40:44.613 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.613 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3628142127}) 2024-09-13T10:40:44.613 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1023397734}) 2024-09-13T10:40:44.613 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.613 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3628142127}) 2024-09-13T10:40:44.613 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.609+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3431258682}) 2024-09-13T10:40:44.655 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3445626261}) 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3267677411}) 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3445626261}) 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1752122473}) 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3445626261}) 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3760105207}) 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3445626261}) 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2196045604}) 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3445626261}) 2024-09-13T10:40:44.656 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3863882149}) 2024-09-13T10:40:44.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3445626261}) 2024-09-13T10:40:44.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2691568105}) 2024-09-13T10:40:44.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3445626261}) 2024-09-13T10:40:44.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3110595513}) 2024-09-13T10:40:44.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:44.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3445626261}) 2024-09-13T10:40:44.657 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:44.652+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3094541253}) 2024-09-13T10:40:44.660 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-13T10:40:44.660 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T10:40:44.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.755+0000 7f47d667c640 10 monclient: get_monmap_and_config 2024-09-13T10:40:44.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.755+0000 7f47d667c640 10 monclient: build_initial_monmap 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.755+0000 7f47d667c640 10 monclient: monmap: 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:44.755709+0000 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:44.755709+0000 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:44.757 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:44.758 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:44.758 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:44.758 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:44.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.755+0000 7f47d667c640 1 Processor -- start 2024-09-13T10:40:44.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.755+0000 7f47d667c640 1 -- start start 2024-09-13T10:40:44.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.755+0000 7f47d667c640 10 monclient: init 2024-09-13T10:40:44.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47d667c640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:44.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47d667c640 10 monclient: _add_conns ranks=[3,5,1,6,2,0,8,7,4] 2024-09-13T10:40:44.759 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47d667c640 10 monclient(hunting): picked mon.noname-g con 0x7f47d00a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:44.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47d667c640 10 monclient(hunting): picked mon.noname-h con 0x7f47d00a6ab0 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:44.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47d667c640 10 monclient(hunting): picked mon.noname-f con 0x7f47d013f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:44.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47d667c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d00a5fe0 con 0x7f47d013f9a0 2024-09-13T10:40:44.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47d667c640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d00a8080 con 0x7f47d00a66d0 2024-09-13T10:40:44.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47d667c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d00a42c0 con 0x7f47d00a6ab0 2024-09-13T10:40:44.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47d667c640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:44.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47d667c640 10 monclient(hunting): authenticate will time out at 1384.261399s 2024-09-13T10:40:44.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47d4c19640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f47d013f9a0 0x7f47d0141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.181:53644/0 (socket says 172.21.15.181:53644) 2024-09-13T10:40:44.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47d4c19640 1 -- 172.21.15.181:0/1500174595 learned_addr learned my addr 172.21.15.181:0/1500174595 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:44.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.756+0000 7f47cffff640 1 --1- >> v1:172.21.15.195:6790/0 conn(0x7f47d00a66d0 0x7f47d00a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6790/0 says I am v1:172.21.15.181:49648/0 (socket says 172.21.15.181:49648) 2024-09-13T10:40:44.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.758+0000 7f47d4c19640 1 -- 172.21.15.181:0/1500174595 >> v1:172.21.15.195:6789/0 conn(0x7f47d013f9a0 legacy=0x7f47d0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:44.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.758+0000 7f47cffff640 1 -- 172.21.15.181:0/1500174595 >> v1:172.21.15.195:6790/0 conn(0x7f47d00a66d0 legacy=0x7f47d00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:44.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.758+0000 7f47cf7fe640 1 -- 172.21.15.181:0/1500174595 >> v1:172.21.15.195:6791/0 conn(0x7f47d00a6ab0 legacy=0x7f47d00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:44.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802608779 0 0) 0x7f47d00a8080 con 0x7f47d00a66d0 2024-09-13T10:40:44.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:44.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:44.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:44.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient(hunting): my global_id is 184179 2024-09-13T10:40:44.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47bc003520 con 0x7f47d00a66d0 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938253545 0 0) 0x7f47d00a5fe0 con 0x7f47d013f9a0 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient(hunting): my global_id is 135217 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d00a8080 con 0x7f47d013f9a0 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212881377 0 0) 0x7f47d00a42c0 con 0x7f47d00a6ab0 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient(hunting): my global_id is 106142 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d00a5fe0 con 0x7f47d00a6ab0 2024-09-13T10:40:44.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1942515347 0 0) 0x7f47d00a5fe0 con 0x7f47d00a6ab0 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47cffff640 1 --1- 172.21.15.181:0/1500174595 >> v1:172.21.15.195:6790/0 conn(0x7f47d00a66d0 0x7f47d00a53b0 :-1 s=OPENED pgs=888 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f47c0001a50 mon_map magic: 0 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 >> v1:172.21.15.195:6790/0 conn(0x7f47d00a66d0 legacy=0x7f47d00a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 >> v1:172.21.15.195:6789/0 conn(0x7f47d013f9a0 legacy=0x7f47d0141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient: _finish_hunting 0 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 monclient: found mon.noname-h 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.195:6791/0 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d01464e0 con 0x7f47d00a6ab0 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient: _finish_auth 0 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient: _check_auth_tickets 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f47c0001a50 con 0x7f47d00a66d0 2024-09-13T10:40:44.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f47b80019b0 con 0x7f47d00a6ab0 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47d667c640 5 monclient: authenticate success, global_id 106142 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47d667c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient: dump: 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:44.767 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47d667c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 <== mon.5 v1:172.21.15.195:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47b8001b50 con 0x7f47d00a6ab0 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 1 -- 172.21.15.181:0/1500174595 <== mon.5 v1:172.21.15.195:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f47b8003950 con 0x7f47d00a6ab0 2024-09-13T10:40:44.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47d667c640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47d667c640 4 set_mon_vals no callback set 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47ceffd640 10 monclient: dump: 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:44.769 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:44.770 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:44.770 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:44.770 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:44.770 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:44.770 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:44.770 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:44.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47d667c640 10 monclient: shutdown 2024-09-13T10:40:44.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47d667c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:44.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47d667c640 1 -- 172.21.15.181:0/1500174595 >> v1:172.21.15.195:6791/0 conn(0x7f47d00a6ab0 legacy=0x7f47d00a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:44.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47d667c640 1 -- 172.21.15.181:0/1500174595 shutdown_connections 2024-09-13T10:40:44.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.759+0000 7f47d667c640 1 -- 172.21.15.181:0/1500174595 >> 172.21.15.181:0/1500174595 conn(0x7f47d00abcd0 msgr2=0x7f47d00ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:44.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.760+0000 7f47d667c640 1 -- 172.21.15.181:0/1500174595 shutdown_connections 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.760+0000 7f47d667c640 1 -- 172.21.15.181:0/1500174595 wait complete. 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.760+0000 7f47d667c640 10 monclient: build_initial_monmap 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.760+0000 7f47d667c640 10 monclient: monmap: 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:44.771 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.760+0000 7f47d667c640 1 Processor -- start 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d667c640 1 -- start start 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d667c640 10 monclient: init 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d667c640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d667c640 10 monclient: _add_conns ranks=[5,7,2,8,0,1,3,4,6] 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d667c640 10 monclient(hunting): picked mon.noname-h con 0x7f47d00a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d667c640 10 monclient(hunting): picked mon.noname-i con 0x7f47d00a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:44.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d667c640 10 monclient(hunting): picked mon.noname-b con 0x7f47d013f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:44.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d667c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d013e170 con 0x7f47d013f9a0 2024-09-13T10:40:44.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d667c640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d013e740 con 0x7f47d00a66d0 2024-09-13T10:40:44.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d667c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d01378e0 con 0x7f47d00a6ab0 2024-09-13T10:40:44.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d667c640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:44.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d667c640 10 monclient(hunting): authenticate will time out at 1384.266555s 2024-09-13T10:40:44.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d4c19640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f47d013f9a0 0x7f47d01d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:51420/0 (socket says 172.21.15.181:51420) 2024-09-13T10:40:44.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.761+0000 7f47d4c19640 1 -- 172.21.15.181:0/1439128771 learned_addr learned my addr 172.21.15.181:0/1439128771 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:44.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.763+0000 7f47d4c19640 1 -- 172.21.15.181:0/1439128771 >> v1:172.21.15.181:6790/0 conn(0x7f47d013f9a0 legacy=0x7f47d01d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:44.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.763+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3665950402 0 0) 0x7f47d013e170 con 0x7f47d013f9a0 2024-09-13T10:40:44.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.763+0000 7f47ccff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:44.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.763+0000 7f47cffff640 1 -- 172.21.15.181:0/1439128771 >> v1:172.21.15.195:6791/0 conn(0x7f47d00a66d0 legacy=0x7f47d013b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:44.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.763+0000 7f47ccff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.763+0000 7f47ccff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.763+0000 7f47ccff9640 10 monclient(hunting): my global_id is 174440 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.763+0000 7f47cf7fe640 1 -- 172.21.15.181:0/1439128771 >> v1:172.21.15.195:6792/0 conn(0x7f47d00a6ab0 legacy=0x7f47d013b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.763+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47b0003520 con 0x7f47d013f9a0 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 443547573 0 0) 0x7f47b0003520 con 0x7f47d013f9a0 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47d013e170 con 0x7f47d013f9a0 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f47c80020b0 con 0x7f47d013f9a0 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient(hunting): dump: 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:44.777 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:44.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1784280635 0 0) 0x7f47d01378e0 con 0x7f47d00a6ab0 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient(hunting): my global_id is 58174 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47b0003520 con 0x7f47d00a6ab0 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 374578362 0 0) 0x7f47c0001d10 con 0x7f47d00a66d0 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient(hunting): my global_id is 106151 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d01378e0 con 0x7f47d00a66d0 2024-09-13T10:40:44.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 509771898 0 0) 0x7f47d013e170 con 0x7f47d013f9a0 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 >> v1:172.21.15.195:6792/0 conn(0x7f47d00a6ab0 legacy=0x7f47d013b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 >> v1:172.21.15.195:6791/0 conn(0x7f47d00a66d0 legacy=0x7f47d013b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient: _finish_hunting 0 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 monclient: found mon.b 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d013c0d0 con 0x7f47d013f9a0 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient: _finish_auth 0 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient: _check_auth_tickets 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47d667c640 5 monclient: authenticate success, global_id 174440 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47d667c640 10 monclient: _renew_subs 2024-09-13T10:40:44.780 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47d667c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47d667c640 1 -- 172.21.15.181:0/1439128771 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47d013efe0 con 0x7f47d013f9a0 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47d667c640 10 monclient: _renew_subs 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47d667c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47d667c640 1 -- 172.21.15.181:0/1439128771 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f47d00a28c0 con 0x7f47d013f9a0 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47c8004ed0 con 0x7f47d013f9a0 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f47c80053c0 con 0x7f47d013f9a0 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ce7fc640 4 set_mon_vals no callback set 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.764+0000 7f47ccff9640 10 monclient: dump: 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:44.781 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:44.782 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:44.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.765+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f47c8005690 con 0x7f47d013f9a0 2024-09-13T10:40:44.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.765+0000 7f47d667c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:44.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.765+0000 7f47d667c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:44.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.765+0000 7f47d667c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:44.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.765+0000 7f47d667c640 1 -- 172.21.15.181:0/1439128771 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b4005080 con 0x7f47d013f9a0 2024-09-13T10:40:44.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.765+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f47c804e5e0 con 0x7f47d013f9a0 2024-09-13T10:40:44.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.765+0000 7f47cffff640 10 monclient: get_auth_request con 0x7f47b003ff00 auth_method 0 2024-09-13T10:40:44.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.769+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f47c8017bf0 con 0x7f47d013f9a0 2024-09-13T10:40:44.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.769+0000 7f47ccff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:44.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:44.769+0000 7f47ccff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.011+0000 7f47d667c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-13T10:40:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.011+0000 7f47d667c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-13T10:40:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.011+0000 7f47d667c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.011+0000 7f47d667c640 1 -- 172.21.15.181:0/1439128771 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f47b4005370 con 0x7f47d013f9a0 2024-09-13T10:40:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.011+0000 7f47ccff9640 1 -- 172.21.15.181:0/1439128771 <== mon.2 v1:172.21.15.181:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 2004139067) 0x7f47c80174f0 con 0x7f47d013f9a0 2024-09-13T10:40:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.011+0000 7f47ccff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-13T10:40:45.013 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.011+0000 7f47ccff9640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:45.013 INFO:teuthology.orchestra.run.smithi181.stdout:{"election_epoch":148,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":4,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","modified":"2024-09-13T10:29:19.709789Z","created":"2024-09-13T10:29:19.709789Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6790","nonce":0}]},"addr":"172.21.15.181:6790/0","public_addr":"172.21.15.181:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6790","nonce":0}]},"addr":"172.21.15.195:6790/0","public_addr":"172.21.15.195:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6791","nonce":0}]},"addr":"172.21.15.181:6791/0","public_addr":"172.21.15.181:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6791","nonce":0}]},"addr":"172.21.15.195:6791/0","public_addr":"172.21.15.195:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6792","nonce":0}]},"addr":"172.21.15.181:6792/0","public_addr":"172.21.15.181:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6792","nonce":0}]},"addr":"172.21.15.195:6792/0","public_addr":"172.21.15.195:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6793","nonce":0}]},"addr":"172.21.15.181:6793/0","public_addr":"172.21.15.181:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T10:40:45.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.013+0000 7f47d667c640 1 -- 172.21.15.181:0/1439128771 >> v1:172.21.15.195:6800/1839191919 conn(0x7f47b003ff00 legacy=0x7f47b00423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.013+0000 7f47d667c640 10 monclient: shutdown 2024-09-13T10:40:45.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.013+0000 7f47d667c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:45.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.013+0000 7f47d667c640 1 -- 172.21.15.181:0/1439128771 >> v1:172.21.15.181:6790/0 conn(0x7f47d013f9a0 legacy=0x7f47d01d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.013+0000 7f47d667c640 1 -- 172.21.15.181:0/1439128771 shutdown_connections 2024-09-13T10:40:45.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.013+0000 7f47d667c640 1 -- 172.21.15.181:0/1439128771 >> 172.21.15.181:0/1439128771 conn(0x7f47d00abcd0 msgr2=0x7f47d0145ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:45.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.013+0000 7f47d667c640 1 -- 172.21.15.181:0/1439128771 shutdown_connections 2024-09-13T10:40:45.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.013+0000 7f47d667c640 1 -- 172.21.15.181:0/1439128771 wait complete. 2024-09-13T10:40:45.025 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-13T10:40:45.025 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T10:40:45.034 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T10:40:45.034 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T10:40:45.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.129+0000 7f85f7ea2640 10 monclient: get_monmap_and_config 2024-09-13T10:40:45.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.129+0000 7f85f7ea2640 10 monclient: build_initial_monmap 2024-09-13T10:40:45.131 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.130+0000 7f85f7ea2640 10 monclient: monmap: 2024-09-13T10:40:45.131 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:45.131 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:45.130584+0000 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:45.130584+0000 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:45.132 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.130+0000 7f85f7ea2640 1 Processor -- start 2024-09-13T10:40:45.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.130+0000 7f85f7ea2640 1 -- start start 2024-09-13T10:40:45.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.130+0000 7f85f7ea2640 10 monclient: init 2024-09-13T10:40:45.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.131+0000 7f85f7ea2640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:45.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.131+0000 7f85f7ea2640 10 monclient: _add_conns ranks=[8,1,5,6,3,0,4,2,7] 2024-09-13T10:40:45.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.131+0000 7f85f7ea2640 10 monclient(hunting): picked mon.noname-e con 0x7f85f00a6f30 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:45.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.131+0000 7f85f7ea2640 10 monclient(hunting): picked mon.noname-f con 0x7f85f0074360 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:45.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.131+0000 7f85f7ea2640 10 monclient(hunting): picked mon.noname-h con 0x7f85f01342c0 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:45.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.131+0000 7f85f7ea2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f0073980 con 0x7f85f0074360 2024-09-13T10:40:45.134 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.131+0000 7f85f7ea2640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f00a7310 con 0x7f85f01342c0 2024-09-13T10:40:45.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.131+0000 7f85f7ea2640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f00736a0 con 0x7f85f00a6f30 2024-09-13T10:40:45.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.131+0000 7f85f7ea2640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:45.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.131+0000 7f85f7ea2640 10 monclient(hunting): authenticate will time out at 1384.636398s 2024-09-13T10:40:45.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.131+0000 7f85f5c3e640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f85f00a6f30 0x7f85f0133bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41708/0 (socket says 172.21.15.181:41708) 2024-09-13T10:40:45.135 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.131+0000 7f85f5c3e640 1 -- 172.21.15.181:0/103210111 learned_addr learned my addr 172.21.15.181:0/103210111 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:45.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.133+0000 7f85f5c3e640 1 -- 172.21.15.181:0/103210111 >> v1:172.21.15.181:6793/0 conn(0x7f85f00a6f30 legacy=0x7f85f0133bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.133+0000 7f85f543d640 1 -- 172.21.15.181:0/103210111 >> v1:172.21.15.195:6789/0 conn(0x7f85f0074360 legacy=0x7f85f013c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.138 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.133+0000 7f85f4c3c640 1 -- 172.21.15.181:0/103210111 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093057948 0 0) 0x7f85f00736a0 con 0x7f85f00a6f30 2024-09-13T10:40:45.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.133+0000 7f85f4c3c640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.133+0000 7f85f4c3c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.133+0000 7f85f4c3c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.133+0000 7f85f4c3c640 10 monclient(hunting): my global_id is 184211 2024-09-13T10:40:45.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.133+0000 7f85f643f640 1 -- 172.21.15.181:0/103210111 >> v1:172.21.15.195:6791/0 conn(0x7f85f01342c0 legacy=0x7f85f013f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.133+0000 7f85f4c3c640 1 -- 172.21.15.181:0/103210111 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85dc003520 con 0x7f85f00a6f30 2024-09-13T10:40:45.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 1 -- 172.21.15.181:0/103210111 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 215757824 0 0) 0x7f85dc003520 con 0x7f85f00a6f30 2024-09-13T10:40:45.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 1 -- 172.21.15.181:0/103210111 >> v1:172.21.15.195:6791/0 conn(0x7f85f01342c0 legacy=0x7f85f013f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 1 -- 172.21.15.181:0/103210111 >> v1:172.21.15.195:6789/0 conn(0x7f85f0074360 legacy=0x7f85f013c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.139 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 10 monclient: _finish_hunting 0 2024-09-13T10:40:45.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 1 monclient: found mon.noname-e 2024-09-13T10:40:45.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:45.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:40:45.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 1 -- 172.21.15.181:0/103210111 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f0073c60 con 0x7f85f00a6f30 2024-09-13T10:40:45.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 10 monclient: _finish_auth 0 2024-09-13T10:40:45.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 10 monclient: _check_auth_tickets 2024-09-13T10:40:45.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:45.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f7ea2640 5 monclient: authenticate success, global_id 184211 2024-09-13T10:40:45.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 1 -- 172.21.15.181:0/103210111 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f85ec001ae0 con 0x7f85f00a6f30 2024-09-13T10:40:45.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f7ea2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:45.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:45.140 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 10 monclient: dump: 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.141 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f7ea2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 1 -- 172.21.15.181:0/103210111 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f85ec0048a0 con 0x7f85f00a6f30 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 1 -- 172.21.15.181:0/103210111 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f85ec004e10 con 0x7f85f00a6f30 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f7ea2640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f7ea2640 4 set_mon_vals no callback set 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f4c3c640 10 monclient: dump: 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.142 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.143 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f7ea2640 10 monclient: shutdown 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f7ea2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f7ea2640 1 -- 172.21.15.181:0/103210111 >> v1:172.21.15.181:6793/0 conn(0x7f85f00a6f30 legacy=0x7f85f0133bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f7ea2640 1 -- 172.21.15.181:0/103210111 shutdown_connections 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f7ea2640 1 -- 172.21.15.181:0/103210111 >> 172.21.15.181:0/103210111 conn(0x7f85f00aa310 msgr2=0x7f85f00a6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f7ea2640 1 -- 172.21.15.181:0/103210111 shutdown_connections 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.134+0000 7f85f7ea2640 1 -- 172.21.15.181:0/103210111 wait complete. 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.135+0000 7f85f7ea2640 10 monclient: build_initial_monmap 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.135+0000 7f85f7ea2640 10 monclient: monmap: 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:45.144 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.135+0000 7f85f7ea2640 1 Processor -- start 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.135+0000 7f85f7ea2640 1 -- start start 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.135+0000 7f85f7ea2640 10 monclient: init 2024-09-13T10:40:45.145 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.136+0000 7f85f7ea2640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:45.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.136+0000 7f85f7ea2640 10 monclient: _add_conns ranks=[4,8,5,7,3,1,6,0,2] 2024-09-13T10:40:45.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.136+0000 7f85f7ea2640 10 monclient(hunting): picked mon.noname-c con 0x7f85f00a6f30 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:45.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.136+0000 7f85f7ea2640 10 monclient(hunting): picked mon.noname-e con 0x7f85f01342c0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:45.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.136+0000 7f85f7ea2640 10 monclient(hunting): picked mon.noname-h con 0x7f85f00a2ed0 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:45.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.136+0000 7f85f7ea2640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f0070010 con 0x7f85f00a6f30 2024-09-13T10:40:45.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.136+0000 7f85f7ea2640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f00702f0 con 0x7f85f00a2ed0 2024-09-13T10:40:45.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.136+0000 7f85f7ea2640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f0129af0 con 0x7f85f01342c0 2024-09-13T10:40:45.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.136+0000 7f85f7ea2640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:45.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.136+0000 7f85f7ea2640 10 monclient(hunting): authenticate will time out at 1384.641144s 2024-09-13T10:40:45.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.136+0000 7f85f543d640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f85f01342c0 0x7f85f01d3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41720/0 (socket says 172.21.15.181:41720) 2024-09-13T10:40:45.146 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.136+0000 7f85f543d640 1 -- 172.21.15.181:0/2905697750 learned_addr learned my addr 172.21.15.181:0/2905697750 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:45.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.138+0000 7f85f543d640 1 -- 172.21.15.181:0/2905697750 >> v1:172.21.15.181:6793/0 conn(0x7f85f01342c0 legacy=0x7f85f01d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.138+0000 7f85f5c3e640 1 -- 172.21.15.181:0/2905697750 >> v1:172.21.15.181:6791/0 conn(0x7f85f00a6f30 legacy=0x7f85f01ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.138+0000 7f85f643f640 1 -- 172.21.15.181:0/2905697750 >> v1:172.21.15.195:6791/0 conn(0x7f85f00a2ed0 legacy=0x7f85f01d6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.138+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785416572 0 0) 0x7f85f0129af0 con 0x7f85f01342c0 2024-09-13T10:40:45.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.138+0000 7f85e67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.138+0000 7f85e67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.138+0000 7f85e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.138+0000 7f85e67fc640 10 monclient(hunting): my global_id is 184220 2024-09-13T10:40:45.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.138+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85d4003520 con 0x7f85f01342c0 2024-09-13T10:40:45.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.138+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:40:45.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3994097624 0 0) 0x7f85f0070010 con 0x7f85f00a6f30 2024-09-13T10:40:45.149 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient(hunting): my global_id is 174505 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85f0129af0 con 0x7f85f00a6f30 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3519400584 0 0) 0x7f85d4003520 con 0x7f85f01342c0 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f85f0070010 con 0x7f85f01342c0 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4061163198 0 0) 0x7f85f00702f0 con 0x7f85f00a2ed0 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient(hunting): my global_id is 106169 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85d4003520 con 0x7f85f00a2ed0 2024-09-13T10:40:45.150 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f85e0003610 con 0x7f85f01342c0 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient(hunting): dump: 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.151 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 295456730 0 0) 0x7f85f0070010 con 0x7f85f01342c0 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 >> v1:172.21.15.195:6791/0 conn(0x7f85f00a2ed0 legacy=0x7f85f01d6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 >> v1:172.21.15.181:6791/0 conn(0x7f85f00a6f30 legacy=0x7f85f01ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient: _finish_hunting 0 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 monclient: found mon.e 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:45.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f006fd30 con 0x7f85f01342c0 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient: _finish_auth 0 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient: _check_auth_tickets 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85f7ea2640 5 monclient: authenticate success, global_id 184220 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85f7ea2640 10 monclient: _renew_subs 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85f7ea2640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85f7ea2640 1 -- 172.21.15.181:0/2905697750 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f85f01ce900 con 0x7f85f01342c0 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85f7ea2640 10 monclient: _renew_subs 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85f7ea2640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85f7ea2640 1 -- 172.21.15.181:0/2905697750 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f85f01d8080 con 0x7f85f01342c0 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f85e0003a60 con 0x7f85f01342c0 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f85e0003fd0 con 0x7f85f01342c0 2024-09-13T10:40:45.153 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:45.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:45.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e7fff640 4 set_mon_vals no callback set 2024-09-13T10:40:45.154 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.140+0000 7f85e67fc640 10 monclient: dump: 2024-09-13T10:40:45.154 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.154 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.154 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.154 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.154 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.154 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.141+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f85e0004220 con 0x7f85f01342c0 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.141+0000 7f85f7ea2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.141+0000 7f85f7ea2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:45.155 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.141+0000 7f85f7ea2640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:45.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.141+0000 7f85f7ea2640 1 -- 172.21.15.181:0/2905697750 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d8005080 con 0x7f85f01342c0 2024-09-13T10:40:45.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.142+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f85e004e180 con 0x7f85f01342c0 2024-09-13T10:40:45.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.142+0000 7f85f5c3e640 10 monclient: get_auth_request con 0x7f85d403fe20 auth_method 0 2024-09-13T10:40:45.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.146+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f85f0073980 con 0x7f85f01342c0 2024-09-13T10:40:45.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.146+0000 7f85e67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:45.156 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.146+0000 7f85e67fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:45.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.316+0000 7f85f7ea2640 1 -- 172.21.15.181:0/2905697750 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85d8000b90 con 0x7f85d403fe20 2024-09-13T10:40:45.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.317+0000 7f85e67fc640 1 -- 172.21.15.181:0/2905697750 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33934 (unknown 2965378022 0 3445222799) 0x7f85ec0114a0 con 0x7f85d403fe20 2024-09-13T10:40:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:40:45.319 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-13T10:40:45.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.319+0000 7f85f7ea2640 1 -- 172.21.15.181:0/2905697750 >> v1:172.21.15.195:6800/1839191919 conn(0x7f85d403fe20 legacy=0x7f85d40422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.319+0000 7f85f7ea2640 10 monclient: shutdown 2024-09-13T10:40:45.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.319+0000 7f85f7ea2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:45.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.319+0000 7f85f7ea2640 1 -- 172.21.15.181:0/2905697750 >> v1:172.21.15.181:6793/0 conn(0x7f85f01342c0 legacy=0x7f85f01d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.319+0000 7f85f7ea2640 1 -- 172.21.15.181:0/2905697750 shutdown_connections 2024-09-13T10:40:45.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.319+0000 7f85f7ea2640 1 -- 172.21.15.181:0/2905697750 >> 172.21.15.181:0/2905697750 conn(0x7f85f00aa310 msgr2=0x7f85f00a5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:45.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.319+0000 7f85f7ea2640 1 -- 172.21.15.181:0/2905697750 shutdown_connections 2024-09-13T10:40:45.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.319+0000 7f85f7ea2640 1 -- 172.21.15.181:0/2905697750 wait complete. 2024-09-13T10:40:45.331 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":649,"stamp":"2024-09-13T10:40:43.986811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":206560,"kb_used_data":19456,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566024480,"statfs":{"total":579820584960,"available":579609067520,"internally_reserved":0,"allocated":19922944,"data_stored":9435130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":191486624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002227"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":641,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611249+0000","last_change":"2024-09-13T10:30:24.839549+0000","last_active":"2024-09-13T10:40:32.611249+0000","last_peered":"2024-09-13T10:40:32.611249+0000","last_clean":"2024-09-13T10:40:32.611249+0000","last_became_active":"2024-09-13T10:30:22.828862+0000","last_became_peered":"2024-09-13T10:30:22.828862+0000","last_unstale":"2024-09-13T10:40:32.611249+0000","last_undegraded":"2024-09-13T10:40:32.611249+0000","last_fullsized":"2024-09-13T10:40:32.611249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:07.535710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013355629999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":645,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.764929+0000","last_change":"2024-09-13T10:30:24.834024+0000","last_active":"2024-09-13T10:40:32.764929+0000","last_peered":"2024-09-13T10:40:32.764929+0000","last_clean":"2024-09-13T10:40:32.764929+0000","last_became_active":"2024-09-13T10:30:22.822788+0000","last_became_peered":"2024-09-13T10:30:22.822788+0000","last_unstale":"2024-09-13T10:40:32.764929+0000","last_undegraded":"2024-09-13T10:40:32.764929+0000","last_fullsized":"2024-09-13T10:40:32.764929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:02.717016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050450899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":641,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611243+0000","last_change":"2024-09-13T10:30:24.839303+0000","last_active":"2024-09-13T10:40:32.611243+0000","last_peered":"2024-09-13T10:40:32.611243+0000","last_clean":"2024-09-13T10:40:32.611243+0000","last_became_active":"2024-09-13T10:30:22.818560+0000","last_became_peered":"2024-09-13T10:30:22.818560+0000","last_unstale":"2024-09-13T10:40:32.611243+0000","last_undegraded":"2024-09-13T10:40:32.611243+0000","last_fullsized":"2024-09-13T10:40:32.611243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:20.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012649200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":644,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.084224+0000","last_change":"2024-09-13T10:30:24.833843+0000","last_active":"2024-09-13T10:40:31.084224+0000","last_peered":"2024-09-13T10:40:31.084224+0000","last_clean":"2024-09-13T10:40:31.084224+0000","last_became_active":"2024-09-13T10:30:22.816554+0000","last_became_peered":"2024-09-13T10:30:22.816554+0000","last_unstale":"2024-09-13T10:40:31.084224+0000","last_undegraded":"2024-09-13T10:40:31.084224+0000","last_fullsized":"2024-09-13T10:40:31.084224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:55.701606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066494999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":634,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.085237+0000","last_change":"2024-09-13T10:30:24.845556+0000","last_active":"2024-09-13T10:40:31.085237+0000","last_peered":"2024-09-13T10:40:31.085237+0000","last_clean":"2024-09-13T10:40:31.085237+0000","last_became_active":"2024-09-13T10:30:22.821223+0000","last_became_peered":"2024-09-13T10:30:22.821223+0000","last_unstale":"2024-09-13T10:40:31.085237+0000","last_undegraded":"2024-09-13T10:40:31.085237+0000","last_fullsized":"2024-09-13T10:40:31.085237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:43.560455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036258549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":635,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.084199+0000","last_change":"2024-09-13T10:30:24.833851+0000","last_active":"2024-09-13T10:40:31.084199+0000","last_peered":"2024-09-13T10:40:31.084199+0000","last_clean":"2024-09-13T10:40:31.084199+0000","last_became_active":"2024-09-13T10:30:22.816447+0000","last_became_peered":"2024-09-13T10:30:22.816447+0000","last_unstale":"2024-09-13T10:40:31.084199+0000","last_undegraded":"2024-09-13T10:40:31.084199+0000","last_fullsized":"2024-09-13T10:40:31.084199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:43.342134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084575600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":641,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.088704+0000","last_change":"2024-09-13T10:30:24.838514+0000","last_active":"2024-09-13T10:40:31.088704+0000","last_peered":"2024-09-13T10:40:31.088704+0000","last_clean":"2024-09-13T10:40:31.088704+0000","last_became_active":"2024-09-13T10:30:22.822750+0000","last_became_peered":"2024-09-13T10:30:22.822750+0000","last_unstale":"2024-09-13T10:40:31.088704+0000","last_undegraded":"2024-09-13T10:40:31.088704+0000","last_fullsized":"2024-09-13T10:40:31.088704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:13.913264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062120600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":642,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611249+0000","last_change":"2024-09-13T10:30:24.839249+0000","last_active":"2024-09-13T10:40:32.611249+0000","last_peered":"2024-09-13T10:40:32.611249+0000","last_clean":"2024-09-13T10:40:32.611249+0000","last_became_active":"2024-09-13T10:30:22.820901+0000","last_became_peered":"2024-09-13T10:30:22.820901+0000","last_unstale":"2024-09-13T10:40:32.611249+0000","last_undegraded":"2024-09-13T10:40:32.611249+0000","last_fullsized":"2024-09-13T10:40:32.611249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:36.190102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001249939,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":733,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611207+0000","last_change":"2024-09-13T10:30:15.731747+0000","last_active":"2024-09-13T10:40:32.611207+0000","last_peered":"2024-09-13T10:40:32.611207+0000","last_clean":"2024-09-13T10:40:32.611207+0000","last_became_active":"2024-09-13T10:30:15.730748+0000","last_became_peered":"2024-09-13T10:30:15.730748+0000","last_unstale":"2024-09-13T10:40:32.611207+0000","last_undegraded":"2024-09-13T10:40:32.611207+0000","last_fullsized":"2024-09-13T10:40:32.611207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_clean_scrub_stamp":"2024-09-13T10:30:14.708874+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:14.488037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574977,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38392,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333448,"statfs":{"total":96636764160,"available":96597450752,"internally_reserved":0,"allocated":3121152,"data_stored":1375726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30072,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341768,"statfs":{"total":96636764160,"available":96605970432,"internally_reserved":0,"allocated":3121152,"data_stored":1375726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34812,"kb_used_data":3628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337028,"statfs":{"total":96636764160,"available":96601116672,"internally_reserved":0,"allocated":3715072,"data_stored":1966094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607683,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34812,"kb_used_data":3628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337028,"statfs":{"total":96636764160,"available":96601116672,"internally_reserved":0,"allocated":3715072,"data_stored":1966094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640386,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38396,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333444,"statfs":{"total":96636764160,"available":96597446656,"internally_reserved":0,"allocated":3125248,"data_stored":1375745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607680,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30076,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341764,"statfs":{"total":96636764160,"available":96605966336,"internally_reserved":0,"allocated":3125248,"data_stored":1375745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T10:40:45.332 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T10:40:45.379 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.376+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.379 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3568609693}) 2024-09-13T10:40:45.379 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=604646984}) 2024-09-13T10:40:45.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3568609693}) 2024-09-13T10:40:45.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4290461957}) 2024-09-13T10:40:45.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3568609693}) 2024-09-13T10:40:45.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1983394792}) 2024-09-13T10:40:45.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3568609693}) 2024-09-13T10:40:45.380 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1287236598}) 2024-09-13T10:40:45.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3568609693}) 2024-09-13T10:40:45.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=71175989}) 2024-09-13T10:40:45.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3568609693}) 2024-09-13T10:40:45.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3306248505}) 2024-09-13T10:40:45.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3568609693}) 2024-09-13T10:40:45.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2092627493}) 2024-09-13T10:40:45.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.381 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3568609693}) 2024-09-13T10:40:45.382 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.377+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1518279621}) 2024-09-13T10:40:45.391 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2968394200}) 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3918786891}) 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2968394200}) 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=978988463}) 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2968394200}) 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4182015889}) 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2968394200}) 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3179845387}) 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.392 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2968394200}) 2024-09-13T10:40:45.393 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3443883642}) 2024-09-13T10:40:45.393 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.393 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2968394200}) 2024-09-13T10:40:45.393 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1903184853}) 2024-09-13T10:40:45.393 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.393 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2968394200}) 2024-09-13T10:40:45.393 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3875240716}) 2024-09-13T10:40:45.393 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.393 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2968394200}) 2024-09-13T10:40:45.393 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.389+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1367948440}) 2024-09-13T10:40:45.421 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.422 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2913920236}) 2024-09-13T10:40:45.422 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2864221030}) 2024-09-13T10:40:45.422 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.422 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2913920236}) 2024-09-13T10:40:45.422 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1877115753}) 2024-09-13T10:40:45.422 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.422 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2913920236}) 2024-09-13T10:40:45.422 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2363033113}) 2024-09-13T10:40:45.422 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.422 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2913920236}) 2024-09-13T10:40:45.422 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1245836060}) 2024-09-13T10:40:45.422 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2913920236}) 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3865147571}) 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2913920236}) 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1242075024}) 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2913920236}) 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3934374596}) 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2913920236}) 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.417+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1160011072}) 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1691330639}) 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1741309060}) 2024-09-13T10:40:45.423 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1691330639}) 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3736181855}) 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1691330639}) 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2448968083}) 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1691330639}) 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=462653192}) 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1691330639}) 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4087664069}) 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.424 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1691330639}) 2024-09-13T10:40:45.425 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2819168239}) 2024-09-13T10:40:45.425 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.425 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1691330639}) 2024-09-13T10:40:45.425 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=183887557}) 2024-09-13T10:40:45.425 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.425 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1691330639}) 2024-09-13T10:40:45.425 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.418+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1379404275}) 2024-09-13T10:40:45.431 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.431 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2728646492}) 2024-09-13T10:40:45.431 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2302908486}) 2024-09-13T10:40:45.431 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.431 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2728646492}) 2024-09-13T10:40:45.431 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2598785222}) 2024-09-13T10:40:45.431 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.431 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2728646492}) 2024-09-13T10:40:45.431 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1357123754}) 2024-09-13T10:40:45.432 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.432 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2728646492}) 2024-09-13T10:40:45.432 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=859615419}) 2024-09-13T10:40:45.432 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.432 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2728646492}) 2024-09-13T10:40:45.432 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=831769276}) 2024-09-13T10:40:45.432 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.432 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2728646492}) 2024-09-13T10:40:45.432 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1279839875}) 2024-09-13T10:40:45.432 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.433 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2728646492}) 2024-09-13T10:40:45.433 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=993637163}) 2024-09-13T10:40:45.433 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.433 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2728646492}) 2024-09-13T10:40:45.433 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.428+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1985136021}) 2024-09-13T10:40:45.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.432+0000 7f3257f64640 10 monclient: get_monmap_and_config 2024-09-13T10:40:45.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.432+0000 7f3257f64640 10 monclient: build_initial_monmap 2024-09-13T10:40:45.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.432+0000 7f3257f64640 10 monclient: monmap: 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:45.432722+0000 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:45.432722+0000 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:45.434 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:45.435 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:45.435 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.432+0000 7f3257f64640 1 Processor -- start 2024-09-13T10:40:45.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.432+0000 7f3257f64640 1 -- start start 2024-09-13T10:40:45.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.432+0000 7f3257f64640 10 monclient: init 2024-09-13T10:40:45.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.433+0000 7f3257f64640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:45.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.433+0000 7f3257f64640 10 monclient: _add_conns ranks=[8,7,1,4,5,2,3,6,0] 2024-09-13T10:40:45.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.433+0000 7f3257f64640 10 monclient(hunting): picked mon.noname-e con 0x7f32500a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:45.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.433+0000 7f3257f64640 10 monclient(hunting): picked mon.noname-i con 0x7f32500a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:45.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.433+0000 7f3257f64640 10 monclient(hunting): picked mon.noname-f con 0x7f325013f9a0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:45.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.433+0000 7f3257f64640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32500a5fe0 con 0x7f325013f9a0 2024-09-13T10:40:45.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.433+0000 7f3257f64640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32500a8080 con 0x7f32500a6ab0 2024-09-13T10:40:45.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.433+0000 7f3257f64640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32500a42c0 con 0x7f32500a66d0 2024-09-13T10:40:45.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.433+0000 7f3257f64640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:45.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.433+0000 7f3257f64640 10 monclient(hunting): authenticate will time out at 1384.938372s 2024-09-13T10:40:45.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.433+0000 7f3255d00640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f32500a66d0 0x7f32500a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41732/0 (socket says 172.21.15.181:41732) 2024-09-13T10:40:45.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.433+0000 7f3255d00640 1 -- 172.21.15.181:0/343329997 learned_addr learned my addr 172.21.15.181:0/343329997 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3255d00640 1 -- 172.21.15.181:0/343329997 >> v1:172.21.15.181:6793/0 conn(0x7f32500a66d0 legacy=0x7f32500a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3256501640 1 -- 172.21.15.181:0/343329997 >> v1:172.21.15.195:6789/0 conn(0x7f325013f9a0 legacy=0x7f3250141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f32554ff640 1 -- 172.21.15.181:0/343329997 >> v1:172.21.15.195:6792/0 conn(0x7f32500a6ab0 legacy=0x7f32500a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650039769 0 0) 0x7f32500a42c0 con 0x7f32500a66d0 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 10 monclient(hunting): my global_id is 184229 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f323c003520 con 0x7f32500a66d0 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174262036 0 0) 0x7f32500a5fe0 con 0x7f325013f9a0 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.441 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 10 monclient(hunting): my global_id is 135235 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32500a42c0 con 0x7f325013f9a0 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163112748 0 0) 0x7f32500a8080 con 0x7f32500a6ab0 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 10 monclient(hunting): my global_id is 58183 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32500a5fe0 con 0x7f32500a6ab0 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2605646583 0 0) 0x7f323c003520 con 0x7f32500a66d0 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.435+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 >> v1:172.21.15.195:6792/0 conn(0x7f32500a6ab0 legacy=0x7f32500a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 >> v1:172.21.15.195:6789/0 conn(0x7f325013f9a0 legacy=0x7f3250141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 10 monclient: _finish_hunting 0 2024-09-13T10:40:45.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 1 monclient: found mon.noname-e 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32501464e0 con 0x7f32500a66d0 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 10 monclient: _finish_auth 0 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 10 monclient: _check_auth_tickets 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f324c001ad0 con 0x7f32500a66d0 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3257f64640 5 monclient: authenticate success, global_id 184229 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3257f64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 10 monclient: dump: 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.443 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.444 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3257f64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f324c0048a0 con 0x7f32500a66d0 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3257f64640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3257f64640 4 set_mon_vals no callback set 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 1 -- 172.21.15.181:0/343329997 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f324c004e50 con 0x7f32500a66d0 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3254cfe640 10 monclient: dump: 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.445 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3257f64640 10 monclient: shutdown 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3257f64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:45.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3257f64640 1 -- 172.21.15.181:0/343329997 >> v1:172.21.15.181:6793/0 conn(0x7f32500a66d0 legacy=0x7f32500a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3257f64640 1 -- 172.21.15.181:0/343329997 shutdown_connections 2024-09-13T10:40:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3257f64640 1 -- 172.21.15.181:0/343329997 >> 172.21.15.181:0/343329997 conn(0x7f32500abcd0 msgr2=0x7f32500ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3257f64640 1 -- 172.21.15.181:0/343329997 shutdown_connections 2024-09-13T10:40:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.436+0000 7f3257f64640 1 -- 172.21.15.181:0/343329997 wait complete. 2024-09-13T10:40:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.437+0000 7f3257f64640 10 monclient: build_initial_monmap 2024-09-13T10:40:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.437+0000 7f3257f64640 10 monclient: monmap: 2024-09-13T10:40:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:45.447 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.437+0000 7f3257f64640 1 Processor -- start 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.437+0000 7f3257f64640 1 -- start start 2024-09-13T10:40:45.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.437+0000 7f3257f64640 10 monclient: init 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3257f64640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3257f64640 10 monclient: _add_conns ranks=[6,7,2,8,3,4,1,5,0] 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3257f64640 10 monclient(hunting): picked mon.noname-d con 0x7f32500a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3257f64640 10 monclient(hunting): picked mon.noname-i con 0x7f32500a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3257f64640 10 monclient(hunting): picked mon.noname-b con 0x7f325013f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3257f64640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325013d260 con 0x7f325013f9a0 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3257f64640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325013f5c0 con 0x7f32500a66d0 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3257f64640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325013ed20 con 0x7f32500a6ab0 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3257f64640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3257f64640 10 monclient(hunting): authenticate will time out at 1384.943216s 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3255d00640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f32500a66d0 0x7f32500a1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55284/0 (socket says 172.21.15.181:55284) 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3255d00640 1 -- 172.21.15.181:0/2629332126 learned_addr learned my addr 172.21.15.181:0/2629332126 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:45.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.438+0000 7f3256501640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f325013f9a0 0x7f32501d6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:51428/0 (socket says 172.21.15.181:51428) 2024-09-13T10:40:45.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f3256501640 1 -- 172.21.15.181:0/2629332126 >> v1:172.21.15.181:6790/0 conn(0x7f325013f9a0 legacy=0x7f32501d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f3255d00640 1 -- 172.21.15.181:0/2629332126 >> v1:172.21.15.181:6792/0 conn(0x7f32500a66d0 legacy=0x7f32500a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32554ff640 1 -- 172.21.15.181:0/2629332126 >> v1:172.21.15.195:6792/0 conn(0x7f32500a6ab0 legacy=0x7f32501d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4257601117 0 0) 0x7f325013d260 con 0x7f325013f9a0 2024-09-13T10:40:45.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): my global_id is 174449 2024-09-13T10:40:45.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3234003520 con 0x7f325013f9a0 2024-09-13T10:40:45.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2774736374 0 0) 0x7f325013ed20 con 0x7f32500a6ab0 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): my global_id is 58192 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f325013d260 con 0x7f32500a6ab0 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3048824013 0 0) 0x7f3234003520 con 0x7f325013f9a0 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f325013ed20 con 0x7f325013f9a0 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3248002040 con 0x7f325013f9a0 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): dump: 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.456 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.457 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2188388594 0 0) 0x7f325013d260 con 0x7f32500a6ab0 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3234003520 con 0x7f32500a6ab0 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3240003610 con 0x7f32500a6ab0 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.440+0000 7f32467fc640 10 monclient(hunting): dump: 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.458 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1264493978 0 0) 0x7f325013ed20 con 0x7f325013f9a0 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 >> v1:172.21.15.195:6792/0 conn(0x7f32500a6ab0 legacy=0x7f32501d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 >> v1:172.21.15.181:6792/0 conn(0x7f32500a66d0 legacy=0x7f32500a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 10 monclient: _finish_hunting 0 2024-09-13T10:40:45.459 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 1 monclient: found mon.b 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325013ddc0 con 0x7f325013f9a0 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 10 monclient: _finish_auth 0 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 10 monclient: _check_auth_tickets 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f3257f64640 5 monclient: authenticate success, global_id 174449 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f3257f64640 10 monclient: _renew_subs 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f3257f64640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f3257f64640 1 -- 172.21.15.181:0/2629332126 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f32500a2650 con 0x7f325013f9a0 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f3257f64640 10 monclient: _renew_subs 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f3257f64640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f3257f64640 1 -- 172.21.15.181:0/2629332126 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f325013c800 con 0x7f325013f9a0 2024-09-13T10:40:45.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3248003c40 con 0x7f325013f9a0 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f32480041b0 con 0x7f325013f9a0 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f3247fff640 4 set_mon_vals no callback set 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.441+0000 7f32467fc640 10 monclient: dump: 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.461 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.442+0000 7f3257f64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.442+0000 7f3257f64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.442+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3248004350 con 0x7f325013f9a0 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.442+0000 7f3257f64640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.442+0000 7f3257f64640 1 -- 172.21.15.181:0/2629332126 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3238005080 con 0x7f325013f9a0 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.442+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f324804e3f0 con 0x7f325013f9a0 2024-09-13T10:40:45.462 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.442+0000 7f3255d00640 10 monclient: get_auth_request con 0x7f32340401b0 auth_method 0 2024-09-13T10:40:45.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.447+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f3248017a40 con 0x7f325013f9a0 2024-09-13T10:40:45.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.447+0000 7f32467fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:45.463 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.447+0000 7f32467fc640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:45.510 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.510 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3708378278}) 2024-09-13T10:40:45.510 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1850530312}) 2024-09-13T10:40:45.510 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.510 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3708378278}) 2024-09-13T10:40:45.510 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3220105975}) 2024-09-13T10:40:45.510 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3708378278}) 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2921167001}) 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3708378278}) 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1523728117}) 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3708378278}) 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3322103429}) 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3708378278}) 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2114041459}) 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.511 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3708378278}) 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2320173235}) 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3708378278}) 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.438+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3817322050}) 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2516923357}) 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1290145066}) 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2516923357}) 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3334292721}) 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2516923357}) 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=594007793}) 2024-09-13T10:40:45.512 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2516923357}) 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3677874972}) 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2516923357}) 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2438758307}) 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2516923357}) 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1348084775}) 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2516923357}) 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=755895802}) 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.513 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2516923357}) 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.441+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=36385887}) 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.448+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.448+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587147794}) 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.448+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3059887141}) 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.448+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.448+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587147794}) 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.448+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3959170376}) 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.448+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.448+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587147794}) 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.448+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1177853478}) 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.448+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.448+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587147794}) 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.448+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2677286597}) 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.449+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.514 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.449+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587147794}) 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.449+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1652814906}) 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.449+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.449+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587147794}) 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.449+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=408743786}) 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.449+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.449+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587147794}) 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.449+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2793871682}) 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.449+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.449+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587147794}) 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.449+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2815028852}) 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3112507243}) 2024-09-13T10:40:45.515 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=654213289}) 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3112507243}) 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3883928055}) 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3112507243}) 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=506365745}) 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3112507243}) 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=630943756}) 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3112507243}) 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3527627051}) 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.516 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3112507243}) 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3057691457}) 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3112507243}) 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3000164131}) 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3112507243}) 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.450+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4002101965}) 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3293275416}) 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4014709679}) 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3293275416}) 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1746424204}) 2024-09-13T10:40:45.517 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3293275416}) 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3691670366}) 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3293275416}) 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3679137260}) 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3293275416}) 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3918842750}) 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3293275416}) 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2717271062}) 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3293275416}) 2024-09-13T10:40:45.518 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1516298918}) 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3293275416}) 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.451+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3124989149}) 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=350629201}) 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1575191897}) 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=350629201}) 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2251764895}) 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=350629201}) 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1466136776}) 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.519 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=350629201}) 2024-09-13T10:40:45.520 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3789988687}) 2024-09-13T10:40:45.520 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.520 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=350629201}) 2024-09-13T10:40:45.520 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1043251578}) 2024-09-13T10:40:45.520 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.520 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=350629201}) 2024-09-13T10:40:45.520 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=118514416}) 2024-09-13T10:40:45.520 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.520 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=350629201}) 2024-09-13T10:40:45.520 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3412303996}) 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=350629201}) 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.452+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4026797347}) 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2378499563}) 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3151298451}) 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2378499563}) 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3423522598}) 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2378499563}) 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2365624197}) 2024-09-13T10:40:45.521 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2378499563}) 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1027034780}) 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2378499563}) 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3615474026}) 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2378499563}) 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2561435129}) 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2378499563}) 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1281468627}) 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2378499563}) 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.454+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2414226792}) 2024-09-13T10:40:45.522 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.455+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.455+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097526004}) 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=893149360}) 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097526004}) 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4103166414}) 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097526004}) 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4231271319}) 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097526004}) 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=78080207}) 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097526004}) 2024-09-13T10:40:45.523 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3374463581}) 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097526004}) 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3231534845}) 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097526004}) 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=250785685}) 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3097526004}) 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.456+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3726100388}) 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1811094770}) 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923888230}) 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.524 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1811094770}) 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2955373173}) 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1811094770}) 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4017346850}) 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1811094770}) 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2755710550}) 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1811094770}) 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=62858365}) 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1811094770}) 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=809202001}) 2024-09-13T10:40:45.525 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1811094770}) 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3896449406}) 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1811094770}) 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.457+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1250904126}) 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2131130776}) 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=359563848}) 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2131130776}) 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2984999752}) 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2131130776}) 2024-09-13T10:40:45.526 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1176469164}) 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2131130776}) 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2651533145}) 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2131130776}) 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1159657447}) 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2131130776}) 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1595467537}) 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2131130776}) 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2478982765}) 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.527 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2131130776}) 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.458+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1967443241}) 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587845678}) 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2500578645}) 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587845678}) 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1544125230}) 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587845678}) 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2800615638}) 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587845678}) 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3654224480}) 2024-09-13T10:40:45.528 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587845678}) 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4292100121}) 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587845678}) 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=196724778}) 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587845678}) 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4003155123}) 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587845678}) 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.459+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1526601839}) 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2738123244}) 2024-09-13T10:40:45.529 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1776365117}) 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2738123244}) 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1403636177}) 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2738123244}) 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2139592035}) 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2738123244}) 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1163670945}) 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2738123244}) 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3948814091}) 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.530 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2738123244}) 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3468932443}) 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2738123244}) 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2411679678}) 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2738123244}) 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.461+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3982836472}) 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=53210310}) 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=358667798}) 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=53210310}) 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=942973553}) 2024-09-13T10:40:45.531 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=53210310}) 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2031040896}) 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=53210310}) 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=286272725}) 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=53210310}) 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2863707232}) 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=53210310}) 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1712862317}) 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=53210310}) 2024-09-13T10:40:45.532 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1417887471}) 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=53210310}) 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.462+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=925369596}) 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2357238698}) 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203283091}) 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2357238698}) 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=312823850}) 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2357238698}) 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2279789065}) 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.533 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2357238698}) 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2096465284}) 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2357238698}) 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3071798780}) 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2357238698}) 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1268575263}) 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2357238698}) 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1275571476}) 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2357238698}) 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.463+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1416062869}) 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.534 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1368717608}) 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1367164141}) 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1368717608}) 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4276228182}) 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1368717608}) 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3873309024}) 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1368717608}) 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3777874623}) 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1368717608}) 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3920498163}) 2024-09-13T10:40:45.535 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1368717608}) 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=308031959}) 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1368717608}) 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1227497106}) 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1368717608}) 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.464+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1861965289}) 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.465+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.465+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=461958203}) 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.465+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=215778652}) 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.536 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=461958203}) 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3170297617}) 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=461958203}) 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3802133713}) 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=461958203}) 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=507979347}) 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=461958203}) 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=409783763}) 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=461958203}) 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2917138726}) 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.537 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=461958203}) 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3850810751}) 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=461958203}) 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.466+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2711647462}) 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4274192282}) 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1898535985}) 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4274192282}) 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=501249278}) 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4274192282}) 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2118542702}) 2024-09-13T10:40:45.538 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4274192282}) 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2120572557}) 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4274192282}) 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2254404491}) 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4274192282}) 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1324841983}) 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4274192282}) 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1178781608}) 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4274192282}) 2024-09-13T10:40:45.539 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.467+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=249236391}) 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1624867409}) 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504804210}) 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1624867409}) 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=552108352}) 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1624867409}) 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1386611209}) 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1624867409}) 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3241256719}) 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.540 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1624867409}) 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3289442612}) 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1624867409}) 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1977848166}) 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1624867409}) 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2287481835}) 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.468+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.469+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1624867409}) 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.469+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2388921766}) 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3580362752}) 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=830033268}) 2024-09-13T10:40:45.541 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3580362752}) 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4056064313}) 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3580362752}) 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3047705960}) 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3580362752}) 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4211366799}) 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3580362752}) 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4164817402}) 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3580362752}) 2024-09-13T10:40:45.542 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=809541026}) 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3580362752}) 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2129624564}) 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3580362752}) 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.470+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=602399999}) 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=442458509}) 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319937661}) 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=442458509}) 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3003827177}) 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.543 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=442458509}) 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3655964380}) 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=442458509}) 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=461172997}) 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=442458509}) 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1727708160}) 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=442458509}) 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3227137635}) 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=442458509}) 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1771654006}) 2024-09-13T10:40:45.544 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=442458509}) 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.479+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=948929842}) 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2401507948}) 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4032228801}) 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2401507948}) 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2111083113}) 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2401507948}) 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1786613904}) 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2401507948}) 2024-09-13T10:40:45.545 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1467485562}) 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2401507948}) 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1518361810}) 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2401507948}) 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=40730062}) 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2401507948}) 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=784007172}) 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2401507948}) 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.491+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=217783110}) 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.546 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4071849201}) 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493213897}) 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4071849201}) 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=685095031}) 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4071849201}) 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=370648235}) 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4071849201}) 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4258504609}) 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4071849201}) 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.492+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3964961793}) 2024-09-13T10:40:45.547 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4071849201}) 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2468675283}) 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4071849201}) 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2533114034}) 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4071849201}) 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.493+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2804296472}) 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=698252466}) 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2200978402}) 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=698252466}) 2024-09-13T10:40:45.548 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3207533735}) 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=698252466}) 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=194862448}) 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=698252466}) 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=510329785}) 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=698252466}) 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1871863664}) 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=698252466}) 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4151334873}) 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.549 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=698252466}) 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=139830507}) 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=698252466}) 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.494+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=892343082}) 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=456841540}) 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131763646}) 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=456841540}) 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2216791206}) 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=456841540}) 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=451653163}) 2024-09-13T10:40:45.550 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=456841540}) 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2792326867}) 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=456841540}) 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3837388765}) 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=456841540}) 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2957434402}) 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=456841540}) 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2615341532}) 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=456841540}) 2024-09-13T10:40:45.551 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.495+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=151758147}) 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1603472795}) 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1131006829}) 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1603472795}) 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3133951825}) 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1603472795}) 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3901167652}) 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1603472795}) 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1162444522}) 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.552 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1603472795}) 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.496+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=337881714}) 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1603472795}) 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4186197467}) 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1603472795}) 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2171800025}) 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1603472795}) 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.497+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1202786497}) 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2626086167}) 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2951187308}) 2024-09-13T10:40:45.553 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2626086167}) 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=162929699}) 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2626086167}) 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2265489472}) 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2626086167}) 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=967144118}) 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2626086167}) 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1068967400}) 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.554 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2626086167}) 2024-09-13T10:40:45.555 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=589269174}) 2024-09-13T10:40:45.555 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.555 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2626086167}) 2024-09-13T10:40:45.555 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2842668780}) 2024-09-13T10:40:45.555 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.555 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2626086167}) 2024-09-13T10:40:45.555 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.498+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1875556199}) 2024-09-13T10:40:45.555 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.555 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2006420444}) 2024-09-13T10:40:45.555 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2643459846}) 2024-09-13T10:40:45.555 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2006420444}) 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1946468514}) 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2006420444}) 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3886464240}) 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2006420444}) 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=599402204}) 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2006420444}) 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4228030042}) 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.556 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2006420444}) 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=325471292}) 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2006420444}) 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3857134656}) 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2006420444}) 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.499+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2214582842}) 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1427262442}) 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2285073837}) 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1427262442}) 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4179971200}) 2024-09-13T10:40:45.557 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1427262442}) 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2414831043}) 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1427262442}) 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1536882452}) 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1427262442}) 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=842929803}) 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1427262442}) 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=583698177}) 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.500+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1427262442}) 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3414233576}) 2024-09-13T10:40:45.558 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.559 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1427262442}) 2024-09-13T10:40:45.559 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.501+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1733514427}) 2024-09-13T10:40:45.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2071002166}) 2024-09-13T10:40:45.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2610421771}) 2024-09-13T10:40:45.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2071002166}) 2024-09-13T10:40:45.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2366219549}) 2024-09-13T10:40:45.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2071002166}) 2024-09-13T10:40:45.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4167514803}) 2024-09-13T10:40:45.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.567 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2071002166}) 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.509+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1098344461}) 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2071002166}) 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=26394777}) 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2071002166}) 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3710470770}) 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2071002166}) 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3055976306}) 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2071002166}) 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.510+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=378824302}) 2024-09-13T10:40:45.568 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3435030279}) 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3927291754}) 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3435030279}) 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2250567812}) 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3435030279}) 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3917287906}) 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3435030279}) 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3761230846}) 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3435030279}) 2024-09-13T10:40:45.569 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2246340069}) 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3435030279}) 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2895996053}) 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3435030279}) 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3821911028}) 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3435030279}) 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.511+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=5173893}) 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=178052380}) 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=717677544}) 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.570 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=178052380}) 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=688245644}) 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=178052380}) 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2092849366}) 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=178052380}) 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=673953567}) 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=178052380}) 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=305624144}) 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=178052380}) 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=984529316}) 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=178052380}) 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1541031977}) 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=178052380}) 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.512+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3601202215}) 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2122564356}) 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1048830817}) 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2122564356}) 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3473940719}) 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2122564356}) 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2717351302}) 2024-09-13T10:40:45.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2122564356}) 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1829117528}) 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2122564356}) 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=956096446}) 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2122564356}) 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1900356077}) 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2122564356}) 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2661313768}) 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2122564356}) 2024-09-13T10:40:45.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.514+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3569075005}) 2024-09-13T10:40:45.633 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.634 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1200546046}) 2024-09-13T10:40:45.634 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202902163}) 2024-09-13T10:40:45.634 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.634 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1200546046}) 2024-09-13T10:40:45.634 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=982897082}) 2024-09-13T10:40:45.634 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.634 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1200546046}) 2024-09-13T10:40:45.634 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=816434423}) 2024-09-13T10:40:45.634 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.634 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1200546046}) 2024-09-13T10:40:45.634 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2514238691}) 2024-09-13T10:40:45.635 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.635 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1200546046}) 2024-09-13T10:40:45.635 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2240280385}) 2024-09-13T10:40:45.635 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.629+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.635 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1200546046}) 2024-09-13T10:40:45.635 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2549720921}) 2024-09-13T10:40:45.635 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.635 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1200546046}) 2024-09-13T10:40:45.635 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4035144284}) 2024-09-13T10:40:45.635 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.636 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1200546046}) 2024-09-13T10:40:45.636 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.630+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4212373932}) 2024-09-13T10:40:45.636 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.634+0000 7f3257f64640 1 -- 172.21.15.181:0/2629332126 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3238000b90 con 0x7f32340401b0 2024-09-13T10:40:45.637 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.636+0000 7f32467fc640 1 -- 172.21.15.181:0/2629332126 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33934 (unknown 2965378022 0 3445222799) 0x7f3238000b90 con 0x7f32340401b0 2024-09-13T10:40:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:40:45.641 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-13T10:40:45.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.649+0000 7f3257f64640 1 -- 172.21.15.181:0/2629332126 >> v1:172.21.15.195:6800/1839191919 conn(0x7f32340401b0 legacy=0x7f3234042670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.649+0000 7f3257f64640 10 monclient: shutdown 2024-09-13T10:40:45.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.649+0000 7f3257f64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:45.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.649+0000 7f3257f64640 1 -- 172.21.15.181:0/2629332126 >> v1:172.21.15.181:6790/0 conn(0x7f325013f9a0 legacy=0x7f32501d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.649+0000 7f3257f64640 1 -- 172.21.15.181:0/2629332126 shutdown_connections 2024-09-13T10:40:45.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.649+0000 7f3257f64640 1 -- 172.21.15.181:0/2629332126 >> 172.21.15.181:0/2629332126 conn(0x7f32500abcd0 msgr2=0x7f32500a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:45.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.651+0000 7f3257f64640 1 -- 172.21.15.181:0/2629332126 shutdown_connections 2024-09-13T10:40:45.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.651+0000 7f3257f64640 1 -- 172.21.15.181:0/2629332126 wait complete. 2024-09-13T10:40:45.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1127091584}) 2024-09-13T10:40:45.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4262836875}) 2024-09-13T10:40:45.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1127091584}) 2024-09-13T10:40:45.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2828939868}) 2024-09-13T10:40:45.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1127091584}) 2024-09-13T10:40:45.662 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1097173814}) 2024-09-13T10:40:45.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1127091584}) 2024-09-13T10:40:45.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3874815093}) 2024-09-13T10:40:45.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1127091584}) 2024-09-13T10:40:45.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1237802616}) 2024-09-13T10:40:45.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1127091584}) 2024-09-13T10:40:45.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2153099051}) 2024-09-13T10:40:45.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.663 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1127091584}) 2024-09-13T10:40:45.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=590725683}) 2024-09-13T10:40:45.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:45.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1127091584}) 2024-09-13T10:40:45.664 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:45.658+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2118564123}) 2024-09-13T10:40:45.665 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":649,"stamp":"2024-09-13T10:40:43.986811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":206560,"kb_used_data":19456,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566024480,"statfs":{"total":579820584960,"available":579609067520,"internally_reserved":0,"allocated":19922944,"data_stored":9435130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":191486624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002227"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":641,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611249+0000","last_change":"2024-09-13T10:30:24.839549+0000","last_active":"2024-09-13T10:40:32.611249+0000","last_peered":"2024-09-13T10:40:32.611249+0000","last_clean":"2024-09-13T10:40:32.611249+0000","last_became_active":"2024-09-13T10:30:22.828862+0000","last_became_peered":"2024-09-13T10:30:22.828862+0000","last_unstale":"2024-09-13T10:40:32.611249+0000","last_undegraded":"2024-09-13T10:40:32.611249+0000","last_fullsized":"2024-09-13T10:40:32.611249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:07.535710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013355629999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":645,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.764929+0000","last_change":"2024-09-13T10:30:24.834024+0000","last_active":"2024-09-13T10:40:32.764929+0000","last_peered":"2024-09-13T10:40:32.764929+0000","last_clean":"2024-09-13T10:40:32.764929+0000","last_became_active":"2024-09-13T10:30:22.822788+0000","last_became_peered":"2024-09-13T10:30:22.822788+0000","last_unstale":"2024-09-13T10:40:32.764929+0000","last_undegraded":"2024-09-13T10:40:32.764929+0000","last_fullsized":"2024-09-13T10:40:32.764929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:02.717016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050450899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":641,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611243+0000","last_change":"2024-09-13T10:30:24.839303+0000","last_active":"2024-09-13T10:40:32.611243+0000","last_peered":"2024-09-13T10:40:32.611243+0000","last_clean":"2024-09-13T10:40:32.611243+0000","last_became_active":"2024-09-13T10:30:22.818560+0000","last_became_peered":"2024-09-13T10:30:22.818560+0000","last_unstale":"2024-09-13T10:40:32.611243+0000","last_undegraded":"2024-09-13T10:40:32.611243+0000","last_fullsized":"2024-09-13T10:40:32.611243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:20.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012649200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":644,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.084224+0000","last_change":"2024-09-13T10:30:24.833843+0000","last_active":"2024-09-13T10:40:31.084224+0000","last_peered":"2024-09-13T10:40:31.084224+0000","last_clean":"2024-09-13T10:40:31.084224+0000","last_became_active":"2024-09-13T10:30:22.816554+0000","last_became_peered":"2024-09-13T10:30:22.816554+0000","last_unstale":"2024-09-13T10:40:31.084224+0000","last_undegraded":"2024-09-13T10:40:31.084224+0000","last_fullsized":"2024-09-13T10:40:31.084224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:55.701606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066494999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":634,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.085237+0000","last_change":"2024-09-13T10:30:24.845556+0000","last_active":"2024-09-13T10:40:31.085237+0000","last_peered":"2024-09-13T10:40:31.085237+0000","last_clean":"2024-09-13T10:40:31.085237+0000","last_became_active":"2024-09-13T10:30:22.821223+0000","last_became_peered":"2024-09-13T10:30:22.821223+0000","last_unstale":"2024-09-13T10:40:31.085237+0000","last_undegraded":"2024-09-13T10:40:31.085237+0000","last_fullsized":"2024-09-13T10:40:31.085237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:43.560455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036258549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":635,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.084199+0000","last_change":"2024-09-13T10:30:24.833851+0000","last_active":"2024-09-13T10:40:31.084199+0000","last_peered":"2024-09-13T10:40:31.084199+0000","last_clean":"2024-09-13T10:40:31.084199+0000","last_became_active":"2024-09-13T10:30:22.816447+0000","last_became_peered":"2024-09-13T10:30:22.816447+0000","last_unstale":"2024-09-13T10:40:31.084199+0000","last_undegraded":"2024-09-13T10:40:31.084199+0000","last_fullsized":"2024-09-13T10:40:31.084199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:43.342134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084575600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":641,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.088704+0000","last_change":"2024-09-13T10:30:24.838514+0000","last_active":"2024-09-13T10:40:31.088704+0000","last_peered":"2024-09-13T10:40:31.088704+0000","last_clean":"2024-09-13T10:40:31.088704+0000","last_became_active":"2024-09-13T10:30:22.822750+0000","last_became_peered":"2024-09-13T10:30:22.822750+0000","last_unstale":"2024-09-13T10:40:31.088704+0000","last_undegraded":"2024-09-13T10:40:31.088704+0000","last_fullsized":"2024-09-13T10:40:31.088704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:13.913264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062120600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":642,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611249+0000","last_change":"2024-09-13T10:30:24.839249+0000","last_active":"2024-09-13T10:40:32.611249+0000","last_peered":"2024-09-13T10:40:32.611249+0000","last_clean":"2024-09-13T10:40:32.611249+0000","last_became_active":"2024-09-13T10:30:22.820901+0000","last_became_peered":"2024-09-13T10:30:22.820901+0000","last_unstale":"2024-09-13T10:40:32.611249+0000","last_undegraded":"2024-09-13T10:40:32.611249+0000","last_fullsized":"2024-09-13T10:40:32.611249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:36.190102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001249939,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":733,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611207+0000","last_change":"2024-09-13T10:30:15.731747+0000","last_active":"2024-09-13T10:40:32.611207+0000","last_peered":"2024-09-13T10:40:32.611207+0000","last_clean":"2024-09-13T10:40:32.611207+0000","last_became_active":"2024-09-13T10:30:15.730748+0000","last_became_peered":"2024-09-13T10:30:15.730748+0000","last_unstale":"2024-09-13T10:40:32.611207+0000","last_undegraded":"2024-09-13T10:40:32.611207+0000","last_fullsized":"2024-09-13T10:40:32.611207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_clean_scrub_stamp":"2024-09-13T10:30:14.708874+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:14.488037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574977,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38392,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333448,"statfs":{"total":96636764160,"available":96597450752,"internally_reserved":0,"allocated":3121152,"data_stored":1375726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30072,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341768,"statfs":{"total":96636764160,"available":96605970432,"internally_reserved":0,"allocated":3121152,"data_stored":1375726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34812,"kb_used_data":3628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337028,"statfs":{"total":96636764160,"available":96601116672,"internally_reserved":0,"allocated":3715072,"data_stored":1966094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607683,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34812,"kb_used_data":3628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337028,"statfs":{"total":96636764160,"available":96601116672,"internally_reserved":0,"allocated":3715072,"data_stored":1966094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640386,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38396,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333444,"statfs":{"total":96636764160,"available":96597446656,"internally_reserved":0,"allocated":3125248,"data_stored":1375745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607680,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30076,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341764,"statfs":{"total":96636764160,"available":96605966336,"internally_reserved":0,"allocated":3125248,"data_stored":1375745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T10:40:45.666 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T10:40:45.666 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T10:40:45.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.761+0000 7ff1190cd640 10 monclient: get_monmap_and_config 2024-09-13T10:40:45.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.761+0000 7ff1190cd640 10 monclient: build_initial_monmap 2024-09-13T10:40:45.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.761+0000 7ff1190cd640 10 monclient: monmap: 2024-09-13T10:40:45.763 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:45.763 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:45.762216+0000 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:45.762216+0000 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:45.764 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 1 Processor -- start 2024-09-13T10:40:45.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 1 -- start start 2024-09-13T10:40:45.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 10 monclient: init 2024-09-13T10:40:45.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:45.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 10 monclient: _add_conns ranks=[0,5,6,3,7,4,2,1,8] 2024-09-13T10:40:45.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 10 monclient(hunting): picked mon.noname-a con 0x7ff1140a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 10 monclient(hunting): picked mon.noname-h con 0x7ff1140a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 10 monclient(hunting): picked mon.noname-d con 0x7ff11413f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1140a4bc0 con 0x7ff1140a6640 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11413a320 con 0x7ff1140a8340 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1140a8100 con 0x7ff11413f750 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff1190cd640 10 monclient(hunting): authenticate will time out at 1385.267775s 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff112d9d640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff1140a6640 0x7ff114139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50776/0 (socket says 172.21.15.181:50776) 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff112d9d640 1 -- 172.21.15.181:0/3199647637 learned_addr learned my addr 172.21.15.181:0/3199647637 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.762+0000 7ff11359e640 1 --1- 172.21.15.181:0/3199647637 >> v1:172.21.15.181:6792/0 conn(0x7ff11413f750 0x7ff114141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55290/0 (socket says 172.21.15.181:55290) 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11359e640 1 -- 172.21.15.181:0/3199647637 >> v1:172.21.15.181:6792/0 conn(0x7ff11413f750 legacy=0x7ff114141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff112d9d640 1 -- 172.21.15.181:0/3199647637 >> v1:172.21.15.181:6789/0 conn(0x7ff1140a6640 legacy=0x7ff114139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.770 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff10a59c640 1 -- 172.21.15.181:0/3199647637 >> v1:172.21.15.195:6791/0 conn(0x7ff1140a8340 legacy=0x7ff114139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479431351 0 0) 0x7ff1140a8100 con 0x7ff11413f750 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient(hunting): my global_id is 174471 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff100003520 con 0x7ff11413f750 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2334193515 0 0) 0x7ff1140a4bc0 con 0x7ff1140a6640 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient(hunting): my global_id is 184194 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1140a8100 con 0x7ff1140a6640 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3408700836 0 0) 0x7ff11413a320 con 0x7ff1140a8340 2024-09-13T10:40:45.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient(hunting): my global_id is 106178 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1140a4bc0 con 0x7ff1140a8340 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2012571405 0 0) 0x7ff100003520 con 0x7ff11413f750 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 >> v1:172.21.15.195:6791/0 conn(0x7ff1140a8340 legacy=0x7ff114139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 >> v1:172.21.15.181:6789/0 conn(0x7ff1140a6640 legacy=0x7ff114139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient: _finish_hunting 0 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 monclient: found mon.noname-d 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1140a48e0 con 0x7ff11413f750 2024-09-13T10:40:45.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient: _finish_auth 0 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient: _check_auth_tickets 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff10c001e60 con 0x7ff11413f750 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient: dump: 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.773 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff1190cd640 5 monclient: authenticate success, global_id 174471 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff1190cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff10c004b60 con 0x7ff11413f750 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:45.774 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 1 -- 172.21.15.181:0/3199647637 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff10c0050d0 con 0x7ff11413f750 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff1190cd640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff1190cd640 4 set_mon_vals no callback set 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.765+0000 7ff11259c640 10 monclient: dump: 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.775 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.766+0000 7ff1190cd640 10 monclient: shutdown 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.766+0000 7ff1190cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.766+0000 7ff1190cd640 1 -- 172.21.15.181:0/3199647637 >> v1:172.21.15.181:6792/0 conn(0x7ff11413f750 legacy=0x7ff114141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.766+0000 7ff1190cd640 1 -- 172.21.15.181:0/3199647637 shutdown_connections 2024-09-13T10:40:45.776 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.766+0000 7ff1190cd640 1 -- 172.21.15.181:0/3199647637 >> 172.21.15.181:0/3199647637 conn(0x7ff114077170 msgr2=0x7ff1140abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.766+0000 7ff1190cd640 1 -- 172.21.15.181:0/3199647637 shutdown_connections 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.766+0000 7ff1190cd640 1 -- 172.21.15.181:0/3199647637 wait complete. 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.766+0000 7ff1190cd640 10 monclient: build_initial_monmap 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.766+0000 7ff1190cd640 10 monclient: monmap: 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:45.777 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 1 Processor -- start 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 1 -- start start 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 10 monclient: init 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 10 monclient: _add_conns ranks=[5,6,8,4,7,2,3,0,1] 2024-09-13T10:40:45.778 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 10 monclient(hunting): picked mon.noname-h con 0x7ff1140a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:45.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 10 monclient(hunting): picked mon.noname-d con 0x7ff11413f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:45.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 10 monclient(hunting): picked mon.noname-e con 0x7ff1140a1b90 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:45.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1140a28e0 con 0x7ff1140a8340 2024-09-13T10:40:45.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1140a1400 con 0x7ff11413f750 2024-09-13T10:40:45.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1141cf0f0 con 0x7ff1140a1b90 2024-09-13T10:40:45.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:45.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.767+0000 7ff1190cd640 10 monclient(hunting): authenticate will time out at 1385.272935s 2024-09-13T10:40:45.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.768+0000 7ff10a59c640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7ff11413f750 0x7ff1141ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55300/0 (socket says 172.21.15.181:55300) 2024-09-13T10:40:45.779 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.768+0000 7ff10a59c640 1 -- 172.21.15.181:0/2479809051 learned_addr learned my addr 172.21.15.181:0/2479809051 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:45.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10a59c640 1 -- 172.21.15.181:0/2479809051 >> v1:172.21.15.181:6792/0 conn(0x7ff11413f750 legacy=0x7ff1141ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff11359e640 1 -- 172.21.15.181:0/2479809051 >> v1:172.21.15.181:6793/0 conn(0x7ff1140a1b90 legacy=0x7ff1141d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff112d9d640 1 -- 172.21.15.181:0/2479809051 >> v1:172.21.15.195:6791/0 conn(0x7ff1140a8340 legacy=0x7ff1141ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:45.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665415028 0 0) 0x7ff1141cf0f0 con 0x7ff1140a1b90 2024-09-13T10:40:45.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): my global_id is 184238 2024-09-13T10:40:45.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f4003550 con 0x7ff1140a1b90 2024-09-13T10:40:45.783 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2604141791 0 0) 0x7ff1140a1400 con 0x7ff11413f750 2024-09-13T10:40:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): my global_id is 174480 2024-09-13T10:40:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1141cf0f0 con 0x7ff11413f750 2024-09-13T10:40:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803009507 0 0) 0x7ff1140a28e0 con 0x7ff1140a8340 2024-09-13T10:40:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): my global_id is 106187 2024-09-13T10:40:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1140a1400 con 0x7ff1140a8340 2024-09-13T10:40:45.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2566317983 0 0) 0x7ff1141cf0f0 con 0x7ff11413f750 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1140a28e0 con 0x7ff11413f750 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff0fc003610 con 0x7ff11413f750 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): dump: 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.785 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1365650148 0 0) 0x7ff0f4003550 con 0x7ff1140a1b90 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1141cf0f0 con 0x7ff1140a1b90 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2250968199 0 0) 0x7ff1140a1400 con 0x7ff1140a8340 2024-09-13T10:40:45.786 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0f4003550 con 0x7ff1140a8340 2024-09-13T10:40:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff10c0020b0 con 0x7ff1140a1b90 2024-09-13T10:40:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): dump: 2024-09-13T10:40:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.787 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff1040047e0 con 0x7ff1140a8340 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient(hunting): dump: 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.788 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.789 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.789 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.789 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.789 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.789 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.789 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.789 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.789 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.789 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.789 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.789 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.789 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.790 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1466469357 0 0) 0x7ff1140a28e0 con 0x7ff11413f750 2024-09-13T10:40:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 >> v1:172.21.15.181:6793/0 conn(0x7ff1140a1b90 legacy=0x7ff1141d6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 >> v1:172.21.15.195:6791/0 conn(0x7ff1140a8340 legacy=0x7ff1141ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:40:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 monclient: found mon.d 2024-09-13T10:40:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:45.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1140a1120 con 0x7ff11413f750 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient: _finish_auth 0 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff1190cd640 5 monclient: authenticate success, global_id 174480 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff1190cd640 10 monclient: _renew_subs 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff1190cd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff1190cd640 1 -- 172.21.15.181:0/2479809051 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff11409fc00 con 0x7ff11413f750 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff1190cd640 10 monclient: _renew_subs 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff1190cd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff1190cd640 1 -- 172.21.15.181:0/2479809051 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7ff1141d7e30 con 0x7ff11413f750 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0fc003b60 con 0x7ff11413f750 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:45.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff0fc0040d0 con 0x7ff11413f750 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff111d9b640 4 set_mon_vals no callback set 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.770+0000 7ff10bfff640 10 monclient: dump: 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:45.792 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:45.793 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.771+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff0fc011ca0 con 0x7ff11413f750 2024-09-13T10:40:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.771+0000 7ff1190cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.771+0000 7ff1190cd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:45.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.771+0000 7ff1190cd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:45.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.771+0000 7ff1190cd640 1 -- 172.21.15.181:0/2479809051 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f8005080 con 0x7ff11413f750 2024-09-13T10:40:45.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.772+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7ff0fc04e2b0 con 0x7ff11413f750 2024-09-13T10:40:45.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.772+0000 7ff112d9d640 10 monclient: get_auth_request con 0x7ff0f40406b0 auth_method 0 2024-09-13T10:40:45.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.776+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7ff0fc0178c0 con 0x7ff11413f750 2024-09-13T10:40:45.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.776+0000 7ff10bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:45.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.776+0000 7ff10bfff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:45.950 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.948+0000 7ff1190cd640 1 -- 172.21.15.181:0/2479809051 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff0f8000b90 con 0x7ff0f40406b0 2024-09-13T10:40:45.951 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.949+0000 7ff10bfff640 1 -- 172.21.15.181:0/2479809051 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33934 (unknown 2965378022 0 3445222799) 0x7ff0f8000b90 con 0x7ff0f40406b0 2024-09-13T10:40:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:40:45.952 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-13T10:40:45.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.951+0000 7ff1190cd640 1 -- 172.21.15.181:0/2479809051 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff0f40406b0 legacy=0x7ff0f4042b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.953 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.951+0000 7ff1190cd640 10 monclient: shutdown 2024-09-13T10:40:45.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.951+0000 7ff1190cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:45.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.951+0000 7ff1190cd640 1 -- 172.21.15.181:0/2479809051 >> v1:172.21.15.181:6792/0 conn(0x7ff11413f750 legacy=0x7ff1141ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:45.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.951+0000 7ff1190cd640 1 -- 172.21.15.181:0/2479809051 shutdown_connections 2024-09-13T10:40:45.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.951+0000 7ff1190cd640 1 -- 172.21.15.181:0/2479809051 >> 172.21.15.181:0/2479809051 conn(0x7ff1140a6640 msgr2=0x7ff114142170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:45.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.952+0000 7ff1190cd640 1 -- 172.21.15.181:0/2479809051 shutdown_connections 2024-09-13T10:40:45.954 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:45.952+0000 7ff1190cd640 1 -- 172.21.15.181:0/2479809051 wait complete. 2024-09-13T10:40:45.963 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":649,"stamp":"2024-09-13T10:40:43.986811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":206560,"kb_used_data":19456,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566024480,"statfs":{"total":579820584960,"available":579609067520,"internally_reserved":0,"allocated":19922944,"data_stored":9435130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":191486624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002227"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":641,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611249+0000","last_change":"2024-09-13T10:30:24.839549+0000","last_active":"2024-09-13T10:40:32.611249+0000","last_peered":"2024-09-13T10:40:32.611249+0000","last_clean":"2024-09-13T10:40:32.611249+0000","last_became_active":"2024-09-13T10:30:22.828862+0000","last_became_peered":"2024-09-13T10:30:22.828862+0000","last_unstale":"2024-09-13T10:40:32.611249+0000","last_undegraded":"2024-09-13T10:40:32.611249+0000","last_fullsized":"2024-09-13T10:40:32.611249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:07.535710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013355629999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":645,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.764929+0000","last_change":"2024-09-13T10:30:24.834024+0000","last_active":"2024-09-13T10:40:32.764929+0000","last_peered":"2024-09-13T10:40:32.764929+0000","last_clean":"2024-09-13T10:40:32.764929+0000","last_became_active":"2024-09-13T10:30:22.822788+0000","last_became_peered":"2024-09-13T10:30:22.822788+0000","last_unstale":"2024-09-13T10:40:32.764929+0000","last_undegraded":"2024-09-13T10:40:32.764929+0000","last_fullsized":"2024-09-13T10:40:32.764929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:02.717016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050450899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":641,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611243+0000","last_change":"2024-09-13T10:30:24.839303+0000","last_active":"2024-09-13T10:40:32.611243+0000","last_peered":"2024-09-13T10:40:32.611243+0000","last_clean":"2024-09-13T10:40:32.611243+0000","last_became_active":"2024-09-13T10:30:22.818560+0000","last_became_peered":"2024-09-13T10:30:22.818560+0000","last_unstale":"2024-09-13T10:40:32.611243+0000","last_undegraded":"2024-09-13T10:40:32.611243+0000","last_fullsized":"2024-09-13T10:40:32.611243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:20.942927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012649200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":644,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.084224+0000","last_change":"2024-09-13T10:30:24.833843+0000","last_active":"2024-09-13T10:40:31.084224+0000","last_peered":"2024-09-13T10:40:31.084224+0000","last_clean":"2024-09-13T10:40:31.084224+0000","last_became_active":"2024-09-13T10:30:22.816554+0000","last_became_peered":"2024-09-13T10:30:22.816554+0000","last_unstale":"2024-09-13T10:40:31.084224+0000","last_undegraded":"2024-09-13T10:40:31.084224+0000","last_fullsized":"2024-09-13T10:40:31.084224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:55.701606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066494999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":634,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.085237+0000","last_change":"2024-09-13T10:30:24.845556+0000","last_active":"2024-09-13T10:40:31.085237+0000","last_peered":"2024-09-13T10:40:31.085237+0000","last_clean":"2024-09-13T10:40:31.085237+0000","last_became_active":"2024-09-13T10:30:22.821223+0000","last_became_peered":"2024-09-13T10:30:22.821223+0000","last_unstale":"2024-09-13T10:40:31.085237+0000","last_undegraded":"2024-09-13T10:40:31.085237+0000","last_fullsized":"2024-09-13T10:40:31.085237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:43.560455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036258549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":635,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.084199+0000","last_change":"2024-09-13T10:30:24.833851+0000","last_active":"2024-09-13T10:40:31.084199+0000","last_peered":"2024-09-13T10:40:31.084199+0000","last_clean":"2024-09-13T10:40:31.084199+0000","last_became_active":"2024-09-13T10:30:22.816447+0000","last_became_peered":"2024-09-13T10:30:22.816447+0000","last_unstale":"2024-09-13T10:40:31.084199+0000","last_undegraded":"2024-09-13T10:40:31.084199+0000","last_fullsized":"2024-09-13T10:40:31.084199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:43.342134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084575600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":641,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.088704+0000","last_change":"2024-09-13T10:30:24.838514+0000","last_active":"2024-09-13T10:40:31.088704+0000","last_peered":"2024-09-13T10:40:31.088704+0000","last_clean":"2024-09-13T10:40:31.088704+0000","last_became_active":"2024-09-13T10:30:22.822750+0000","last_became_peered":"2024-09-13T10:30:22.822750+0000","last_unstale":"2024-09-13T10:40:31.088704+0000","last_undegraded":"2024-09-13T10:40:31.088704+0000","last_fullsized":"2024-09-13T10:40:31.088704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:13.913264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062120600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":642,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611249+0000","last_change":"2024-09-13T10:30:24.839249+0000","last_active":"2024-09-13T10:40:32.611249+0000","last_peered":"2024-09-13T10:40:32.611249+0000","last_clean":"2024-09-13T10:40:32.611249+0000","last_became_active":"2024-09-13T10:30:22.820901+0000","last_became_peered":"2024-09-13T10:30:22.820901+0000","last_unstale":"2024-09-13T10:40:32.611249+0000","last_undegraded":"2024-09-13T10:40:32.611249+0000","last_fullsized":"2024-09-13T10:40:32.611249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:36.190102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001249939,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":733,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611207+0000","last_change":"2024-09-13T10:30:15.731747+0000","last_active":"2024-09-13T10:40:32.611207+0000","last_peered":"2024-09-13T10:40:32.611207+0000","last_clean":"2024-09-13T10:40:32.611207+0000","last_became_active":"2024-09-13T10:30:15.730748+0000","last_became_peered":"2024-09-13T10:30:15.730748+0000","last_unstale":"2024-09-13T10:40:32.611207+0000","last_undegraded":"2024-09-13T10:40:32.611207+0000","last_fullsized":"2024-09-13T10:40:32.611207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:14.708874+0000","last_clean_scrub_stamp":"2024-09-13T10:30:14.708874+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:14.488037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574977,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38392,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333448,"statfs":{"total":96636764160,"available":96597450752,"internally_reserved":0,"allocated":3121152,"data_stored":1375726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30072,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341768,"statfs":{"total":96636764160,"available":96605970432,"internally_reserved":0,"allocated":3121152,"data_stored":1375726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34812,"kb_used_data":3628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337028,"statfs":{"total":96636764160,"available":96601116672,"internally_reserved":0,"allocated":3715072,"data_stored":1966094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607683,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34812,"kb_used_data":3628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337028,"statfs":{"total":96636764160,"available":96601116672,"internally_reserved":0,"allocated":3715072,"data_stored":1966094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640386,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38396,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333444,"statfs":{"total":96636764160,"available":96597446656,"internally_reserved":0,"allocated":3125248,"data_stored":1375745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607680,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30076,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341764,"statfs":{"total":96636764160,"available":96605966336,"internally_reserved":0,"allocated":3125248,"data_stored":1375745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T10:40:45.964 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T10:40:46.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.060+0000 7f0b9d356640 10 monclient: get_monmap_and_config 2024-09-13T10:40:46.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.060+0000 7f0b9d356640 10 monclient: build_initial_monmap 2024-09-13T10:40:46.062 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.061+0000 7f0b9d356640 10 monclient: monmap: 2024-09-13T10:40:46.062 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:46.061596+0000 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:46.061596+0000 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:46.063 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:46.064 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:46.064 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:46.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.061+0000 7f0b9d356640 1 Processor -- start 2024-09-13T10:40:46.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.061+0000 7f0b9d356640 1 -- start start 2024-09-13T10:40:46.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.061+0000 7f0b9d356640 10 monclient: init 2024-09-13T10:40:46.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b9d356640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:46.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b9d356640 10 monclient: _add_conns ranks=[4,7,2,6,3,5,0,8,1] 2024-09-13T10:40:46.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b9d356640 10 monclient(hunting): picked mon.noname-c con 0x7f0b980a6640 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:46.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b9d356640 10 monclient(hunting): picked mon.noname-i con 0x7f0b980a8340 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:46.065 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b9d356640 10 monclient(hunting): picked mon.noname-b con 0x7f0b9813f750 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:46.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b9d356640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b980a4bc0 con 0x7f0b9813f750 2024-09-13T10:40:46.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b9d356640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9813a320 con 0x7f0b980a6640 2024-09-13T10:40:46.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b9d356640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b980a8100 con 0x7f0b980a8340 2024-09-13T10:40:46.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b9d356640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:46.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b9d356640 10 monclient(hunting): authenticate will time out at 1385.567158s 2024-09-13T10:40:46.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b96ffd640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f0b980a6640 0x7f0b98139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35766/0 (socket says 172.21.15.181:35766) 2024-09-13T10:40:46.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b96ffd640 1 -- 172.21.15.181:0/3219505554 learned_addr learned my addr 172.21.15.181:0/3219505554 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:46.066 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.062+0000 7f0b977fe640 1 --1- 172.21.15.181:0/3219505554 >> v1:172.21.15.181:6790/0 conn(0x7f0b9813f750 0x7f0b98141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:51434/0 (socket says 172.21.15.181:51434) 2024-09-13T10:40:46.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b977fe640 1 -- 172.21.15.181:0/3219505554 >> v1:172.21.15.181:6790/0 conn(0x7f0b9813f750 legacy=0x7f0b98141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:46.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b96ffd640 1 -- 172.21.15.181:0/3219505554 >> v1:172.21.15.181:6791/0 conn(0x7f0b980a6640 legacy=0x7f0b98139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:46.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472531777 0 0) 0x7f0b980a4bc0 con 0x7f0b9813f750 2024-09-13T10:40:46.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b967fc640 1 -- 172.21.15.181:0/3219505554 >> v1:172.21.15.195:6792/0 conn(0x7f0b980a8340 legacy=0x7f0b98139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:46.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:46.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:46.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:46.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient(hunting): my global_id is 174458 2024-09-13T10:40:46.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b80003520 con 0x7f0b9813f750 2024-09-13T10:40:46.074 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479602584 0 0) 0x7f0b9813a320 con 0x7f0b980a6640 2024-09-13T10:40:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient(hunting): my global_id is 174514 2024-09-13T10:40:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b980a4bc0 con 0x7f0b980a6640 2024-09-13T10:40:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283384316 0 0) 0x7f0b980a8100 con 0x7f0b980a8340 2024-09-13T10:40:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:46.075 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient(hunting): my global_id is 58201 2024-09-13T10:40:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b9813a320 con 0x7f0b980a8340 2024-09-13T10:40:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3964588452 0 0) 0x7f0b980a4bc0 con 0x7f0b980a6640 2024-09-13T10:40:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 >> v1:172.21.15.195:6792/0 conn(0x7f0b980a8340 legacy=0x7f0b98139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 >> v1:172.21.15.181:6790/0 conn(0x7f0b9813f750 legacy=0x7f0b98141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:40:46.076 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 1 monclient: found mon.noname-c 2024-09-13T10:40:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:40:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b980a48e0 con 0x7f0b980a6640 2024-09-13T10:40:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient: _finish_auth 0 2024-09-13T10:40:46.077 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:40:46.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:46.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b9d356640 5 monclient: authenticate success, global_id 174514 2024-09-13T10:40:46.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b9d356640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:46.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0b88001d70 con 0x7f0b980a6640 2024-09-13T10:40:46.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:46.078 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:46.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b95ffb640 10 monclient: dump: 2024-09-13T10:40:46.079 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:46.079 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:46.079 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:46.079 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:46.079 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:46.080 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:46.080 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:46.080 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:46.080 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:46.080 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:46.080 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:46.081 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:46.081 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.064+0000 7f0b9d356640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0b88002040 con 0x7f0b980a6640 2024-09-13T10:40:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b95ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b9d356640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b95ffb640 1 -- 172.21.15.181:0/3219505554 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0b88004f60 con 0x7f0b980a6640 2024-09-13T10:40:46.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b95ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:46.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b9d356640 4 set_mon_vals no callback set 2024-09-13T10:40:46.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b95ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:46.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b95ffb640 10 monclient: dump: 2024-09-13T10:40:46.083 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:46.083 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:46.083 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:46.084 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:46.084 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:46.084 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:46.084 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:46.084 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:46.085 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:46.085 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:46.085 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:46.085 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:46.085 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:46.085 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:46.086 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:46.086 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:46.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b9d356640 10 monclient: shutdown 2024-09-13T10:40:46.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b9d356640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:46.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b9d356640 1 -- 172.21.15.181:0/3219505554 >> v1:172.21.15.181:6791/0 conn(0x7f0b980a6640 legacy=0x7f0b98139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:46.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b9d356640 1 -- 172.21.15.181:0/3219505554 shutdown_connections 2024-09-13T10:40:46.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b9d356640 1 -- 172.21.15.181:0/3219505554 >> 172.21.15.181:0/3219505554 conn(0x7f0b98077170 msgr2=0x7f0b980abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:46.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b9d356640 1 -- 172.21.15.181:0/3219505554 shutdown_connections 2024-09-13T10:40:46.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.065+0000 7f0b9d356640 1 -- 172.21.15.181:0/3219505554 wait complete. 2024-09-13T10:40:46.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.066+0000 7f0b9d356640 10 monclient: build_initial_monmap 2024-09-13T10:40:46.087 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.066+0000 7f0b9d356640 10 monclient: monmap: 2024-09-13T10:40:46.088 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:46.088 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:46.088 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:46.088 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:46.088 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:46.088 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:46.089 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:46.089 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:46.089 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:46.089 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:46.089 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:46.090 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.066+0000 7f0b9d356640 1 Processor -- start 2024-09-13T10:40:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.066+0000 7f0b9d356640 1 -- start start 2024-09-13T10:40:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.066+0000 7f0b9d356640 10 monclient: init 2024-09-13T10:40:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b9d356640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b9d356640 10 monclient: _add_conns ranks=[2,4,8,5,3,1,7,6,0] 2024-09-13T10:40:46.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b9d356640 10 monclient(hunting): picked mon.noname-b con 0x7f0b980a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:46.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b9d356640 10 monclient(hunting): picked mon.noname-c con 0x7f0b9813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:46.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b9d356640 10 monclient(hunting): picked mon.noname-e con 0x7f0b9813cad0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:46.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b9d356640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9813df00 con 0x7f0b980a8340 2024-09-13T10:40:46.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b9d356640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b98134890 con 0x7f0b9813f750 2024-09-13T10:40:46.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b9d356640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b98134b70 con 0x7f0b9813cad0 2024-09-13T10:40:46.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b9d356640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:46.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b9d356640 10 monclient(hunting): authenticate will time out at 1385.572218s 2024-09-13T10:40:46.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b96ffd640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f0b980a8340 0x7f0b9813bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:51440/0 (socket says 172.21.15.181:51440) 2024-09-13T10:40:46.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b96ffd640 1 -- 172.21.15.181:0/4043315993 learned_addr learned my addr 172.21.15.181:0/4043315993 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:46.093 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.067+0000 7f0b967fc640 1 --1- 172.21.15.181:0/4043315993 >> v1:172.21.15.181:6791/0 conn(0x7f0b9813f750 0x7f0b9813c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35780/0 (socket says 172.21.15.181:35780) 2024-09-13T10:40:46.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b967fc640 1 -- 172.21.15.181:0/4043315993 >> v1:172.21.15.181:6791/0 conn(0x7f0b9813f750 legacy=0x7f0b9813c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:46.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b96ffd640 1 -- 172.21.15.181:0/4043315993 >> v1:172.21.15.181:6790/0 conn(0x7f0b980a8340 legacy=0x7f0b9813bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:46.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b977fe640 1 -- 172.21.15.181:0/4043315993 >> v1:172.21.15.181:6793/0 conn(0x7f0b9813cad0 legacy=0x7f0b981d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:46.094 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4288204158 0 0) 0x7f0b98134890 con 0x7f0b9813f750 2024-09-13T10:40:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): my global_id is 174523 2024-09-13T10:40:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b84003550 con 0x7f0b9813f750 2024-09-13T10:40:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 32693863 0 0) 0x7f0b980a48e0 con 0x7f0b980a8340 2024-09-13T10:40:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): my global_id is 174467 2024-09-13T10:40:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b98134890 con 0x7f0b980a8340 2024-09-13T10:40:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2673548209 0 0) 0x7f0b98134b70 con 0x7f0b9813cad0 2024-09-13T10:40:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): my global_id is 184247 2024-09-13T10:40:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b980a48e0 con 0x7f0b9813cad0 2024-09-13T10:40:46.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 979834828 0 0) 0x7f0b84003550 con 0x7f0b9813f750 2024-09-13T10:40:46.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0b98134b70 con 0x7f0b9813f750 2024-09-13T10:40:46.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0b8c003610 con 0x7f0b9813f750 2024-09-13T10:40:46.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:46.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:46.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): dump: 2024-09-13T10:40:46.099 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:46.099 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:46.099 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:46.099 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:46.099 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:46.100 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:46.100 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:46.100 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:46.100 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:46.100 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:46.100 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:46.101 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:46.101 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:46.101 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:46.101 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:46.101 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:46.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:46.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2129954036 0 0) 0x7f0b98134890 con 0x7f0b980a8340 2024-09-13T10:40:46.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0b84003550 con 0x7f0b980a8340 2024-09-13T10:40:46.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 271607183 0 0) 0x7f0b980a48e0 con 0x7f0b9813cad0 2024-09-13T10:40:46.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0b98134890 con 0x7f0b9813cad0 2024-09-13T10:40:46.102 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0b88004ea0 con 0x7f0b980a8340 2024-09-13T10:40:46.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:46.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:46.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.069+0000 7f0b7f7fe640 10 monclient(hunting): dump: 2024-09-13T10:40:46.103 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:46.103 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:46.103 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:46.104 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:46.104 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:46.104 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:46.104 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:46.104 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:46.105 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:46.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0b90001d30 con 0x7f0b9813cad0 2024-09-13T10:40:46.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:46.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:46.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 10 monclient(hunting): dump: 2024-09-13T10:40:46.106 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:46.106 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:46.107 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:46.107 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:46.107 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:46.107 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:46.107 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:46.107 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:46.107 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:46.107 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:46.107 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:46.107 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3191776544 0 0) 0x7f0b98134b70 con 0x7f0b9813f750 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 >> v1:172.21.15.181:6793/0 conn(0x7f0b9813cad0 legacy=0x7f0b981d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 >> v1:172.21.15.181:6790/0 conn(0x7f0b980a8340 legacy=0x7f0b9813bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 1 monclient: found mon.c 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9813d3a0 con 0x7f0b9813f750 2024-09-13T10:40:46.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 10 monclient: _finish_auth 0 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b9d356640 5 monclient: authenticate success, global_id 174523 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b9d356640 10 monclient: _renew_subs 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b9d356640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b9d356640 1 -- 172.21.15.181:0/4043315993 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0b981342d0 con 0x7f0b9813f750 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b9d356640 10 monclient: _renew_subs 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b9d356640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b9d356640 1 -- 172.21.15.181:0/4043315993 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f0b981d7a40 con 0x7f0b9813f750 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0b8c003b90 con 0x7f0b9813f750 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0b8c0040c0 con 0x7f0b9813f750 2024-09-13T10:40:46.109 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b957fa640 4 set_mon_vals no callback set 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.070+0000 7f0b7f7fe640 10 monclient: dump: 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:46.110 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.071+0000 7f0b9d356640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.071+0000 7f0b9d356640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.071+0000 7f0b9d356640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.071+0000 7f0b9d356640 1 -- 172.21.15.181:0/4043315993 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b78005080 con 0x7f0b9813f750 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.071+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0b8c004260 con 0x7f0b9813f750 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.071+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f0b8c04e170 con 0x7f0b9813f750 2024-09-13T10:40:46.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.071+0000 7f0b96ffd640 10 monclient: get_auth_request con 0x7f0b84040640 auth_method 0 2024-09-13T10:40:46.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.075+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f0b8c017720 con 0x7f0b9813f750 2024-09-13T10:40:46.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.075+0000 7f0b7f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:46.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.075+0000 7f0b7f7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:46.114 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.114 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3156683558}) 2024-09-13T10:40:46.114 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3877261682}) 2024-09-13T10:40:46.114 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.114 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3156683558}) 2024-09-13T10:40:46.114 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2114644240}) 2024-09-13T10:40:46.114 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.114 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3156683558}) 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3773311354}) 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3156683558}) 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3567892694}) 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3156683558}) 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=266108252}) 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3156683558}) 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=445335088}) 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3156683558}) 2024-09-13T10:40:46.115 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=535022588}) 2024-09-13T10:40:46.116 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.116 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3156683558}) 2024-09-13T10:40:46.116 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.083+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2270709723}) 2024-09-13T10:40:46.147 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.147 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4262568339}) 2024-09-13T10:40:46.147 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=565789206}) 2024-09-13T10:40:46.147 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.147 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4262568339}) 2024-09-13T10:40:46.147 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3597071313}) 2024-09-13T10:40:46.147 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.147 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4262568339}) 2024-09-13T10:40:46.147 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2820665858}) 2024-09-13T10:40:46.147 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4262568339}) 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4043855689}) 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4262568339}) 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2447463930}) 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4262568339}) 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1577737292}) 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4262568339}) 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=330809958}) 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4262568339}) 2024-09-13T10:40:46.148 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.142+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1879837313}) 2024-09-13T10:40:46.281 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.280+0000 7f0b9d356640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:40:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.280+0000 7f0b9d356640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:40:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.280+0000 7f0b9d356640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.280+0000 7f0b9d356640 1 -- 172.21.15.181:0/4043315993 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b78005370 con 0x7f0b9813f750 2024-09-13T10:40:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.281+0000 7f0b7f7fe640 1 -- 172.21.15.181:0/4043315993 <== mon.4 v1:172.21.15.181:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v331) ==== 74+0+10910 (unknown 3598110246 0 4278115452) 0x7f0b8c017020 con 0x7f0b9813f750 2024-09-13T10:40:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.281+0000 7f0b7f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-13T10:40:46.282 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.281+0000 7f0b7f7fe640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:40:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:40:46.283 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":331,"fsid":"de6e6e36-ff0f-4526-9812-870bc0eec0ee","created":"2024-09-13T10:29:50.823515+0000","modified":"2024-09-13T10:40:31.081212+0000","last_up_change":"2024-09-13T10:30:13.707133+0000","last_in_change":"2024-09-13T10:30:04.743077+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":100,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T10:30:13.877061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T10:30:20.723608+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"222eae7d-397c-40de-9975-11705817eae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":328,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6804","nonce":3159017208}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6805","nonce":3159017208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6807","nonce":3159017208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6806","nonce":3159017208}]},"public_addr":"172.21.15.181:6804/3159017208","cluster_addr":"172.21.15.181:6805/3159017208","heartbeat_back_addr":"172.21.15.181:6807/3159017208","heartbeat_front_addr":"172.21.15.181:6806/3159017208","state":["exists","up"]},{"osd":1,"uuid":"c241f0df-9ad4-42f4-809b-872d2c14bdc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":328,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6800","nonce":3226877824}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6801","nonce":3226877824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6803","nonce":3226877824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6802","nonce":3226877824}]},"public_addr":"172.21.15.181:6800/3226877824","cluster_addr":"172.21.15.181:6801/3226877824","heartbeat_back_addr":"172.21.15.181:6803/3226877824","heartbeat_front_addr":"172.21.15.181:6802/3226877824","state":["exists","up"]},{"osd":2,"uuid":"efbff8a5-b42c-4e47-92e1-faf8ef9bec2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":328,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6808","nonce":3162343005}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6809","nonce":3162343005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6811","nonce":3162343005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.181:6810","nonce":3162343005}]},"public_addr":"172.21.15.181:6808/3162343005","cluster_addr":"172.21.15.181:6809/3162343005","heartbeat_back_addr":"172.21.15.181:6811/3162343005","heartbeat_front_addr":"172.21.15.181:6810/3162343005","state":["exists","up"]},{"osd":3,"uuid":"11e6b317-e77c-4469-840a-a1d17e9eee86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":328,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6809","nonce":2152618500}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6810","nonce":2152618500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6812","nonce":2152618500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6811","nonce":2152618500}]},"public_addr":"172.21.15.195:6809/2152618500","cluster_addr":"172.21.15.195:6810/2152618500","heartbeat_back_addr":"172.21.15.195:6812/2152618500","heartbeat_front_addr":"172.21.15.195:6811/2152618500","state":["exists","up"]},{"osd":4,"uuid":"78cd8d74-5ffb-4116-aa73-e082ffd9adce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":328,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6805","nonce":1430589228}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6806","nonce":1430589228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6808","nonce":1430589228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6807","nonce":1430589228}]},"public_addr":"172.21.15.195:6805/1430589228","cluster_addr":"172.21.15.195:6806/1430589228","heartbeat_back_addr":"172.21.15.195:6808/1430589228","heartbeat_front_addr":"172.21.15.195:6807/1430589228","state":["exists","up"]},{"osd":5,"uuid":"ecb70959-b169-4fd8-958d-ac5b1d0a3c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":328,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6801","nonce":2714505324}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6802","nonce":2714505324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6804","nonce":2714505324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6803","nonce":2714505324}]},"public_addr":"172.21.15.195:6801/2714505324","cluster_addr":"172.21.15.195:6802/2714505324","heartbeat_back_addr":"172.21.15.195:6804/2714505324","heartbeat_front_addr":"172.21.15.195:6803/2714505324","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.841016+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.270575+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.374446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:11.763765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.551366+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T10:30:10.985540+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T10:40:46.285 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.283+0000 7f0b9d356640 1 -- 172.21.15.181:0/4043315993 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0b84040640 legacy=0x7f0b84042b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.283+0000 7f0b9d356640 10 monclient: shutdown 2024-09-13T10:40:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.283+0000 7f0b9d356640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.283+0000 7f0b9d356640 1 -- 172.21.15.181:0/4043315993 >> v1:172.21.15.181:6791/0 conn(0x7f0b9813f750 legacy=0x7f0b9813c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.283+0000 7f0b9d356640 1 -- 172.21.15.181:0/4043315993 shutdown_connections 2024-09-13T10:40:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.283+0000 7f0b9d356640 1 -- 172.21.15.181:0/4043315993 >> 172.21.15.181:0/4043315993 conn(0x7f0b980a6640 msgr2=0x7f0b980a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:46.286 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.283+0000 7f0b9d356640 1 -- 172.21.15.181:0/4043315993 shutdown_connections 2024-09-13T10:40:46.287 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:46.283+0000 7f0b9d356640 1 -- 172.21.15.181:0/4043315993 wait complete. 2024-09-13T10:40:46.428 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.428 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=379561110}) 2024-09-13T10:40:46.428 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=802849384}) 2024-09-13T10:40:46.428 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.428 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=379561110}) 2024-09-13T10:40:46.428 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1831081916}) 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=379561110}) 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4173547202}) 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=379561110}) 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1865763179}) 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=379561110}) 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2976787353}) 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=379561110}) 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=990099085}) 2024-09-13T10:40:46.429 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.430 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=379561110}) 2024-09-13T10:40:46.430 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2388033900}) 2024-09-13T10:40:46.430 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.430 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=379561110}) 2024-09-13T10:40:46.430 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.424+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1603427966}) 2024-09-13T10:40:46.637 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.637 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1968974895}) 2024-09-13T10:40:46.637 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2874447896}) 2024-09-13T10:40:46.637 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1968974895}) 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=306834229}) 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1968974895}) 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3621262708}) 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1968974895}) 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3372782346}) 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1968974895}) 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2227962302}) 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1968974895}) 2024-09-13T10:40:46.638 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4042466399}) 2024-09-13T10:40:46.639 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.639 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1968974895}) 2024-09-13T10:40:46.639 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3958913077}) 2024-09-13T10:40:46.639 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.639 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1968974895}) 2024-09-13T10:40:46.639 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.634+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1993957877}) 2024-09-13T10:40:46.641 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.641 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3811201713}) 2024-09-13T10:40:46.641 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=490899534}) 2024-09-13T10:40:46.641 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3811201713}) 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=163740021}) 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3811201713}) 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2873374344}) 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3811201713}) 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3086736290}) 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3811201713}) 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3648877362}) 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.642 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3811201713}) 2024-09-13T10:40:46.643 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3753623694}) 2024-09-13T10:40:46.643 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.643 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3811201713}) 2024-09-13T10:40:46.643 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2530409117}) 2024-09-13T10:40:46.643 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.643 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3811201713}) 2024-09-13T10:40:46.643 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.639+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2297459286}) 2024-09-13T10:40:46.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1389363038}) 2024-09-13T10:40:46.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3434262542}) 2024-09-13T10:40:46.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1389363038}) 2024-09-13T10:40:46.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1941504503}) 2024-09-13T10:40:46.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1389363038}) 2024-09-13T10:40:46.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2777498214}) 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1389363038}) 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3572168377}) 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1389363038}) 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=283026574}) 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1389363038}) 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1603441998}) 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1389363038}) 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1048057025}) 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1389363038}) 2024-09-13T10:40:46.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.650+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=317257264}) 2024-09-13T10:40:46.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2807483172}) 2024-09-13T10:40:46.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3423812043}) 2024-09-13T10:40:46.740 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2807483172}) 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3082291981}) 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2807483172}) 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2461889648}) 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2807483172}) 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3494440722}) 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2807483172}) 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=124395003}) 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.741 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2807483172}) 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2648963084}) 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2807483172}) 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=488072967}) 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2807483172}) 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.737+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=396616210}) 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781048364}) 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3259884064}) 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781048364}) 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3535640194}) 2024-09-13T10:40:46.742 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781048364}) 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1637730272}) 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781048364}) 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1507432051}) 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781048364}) 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1294989312}) 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781048364}) 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3508337553}) 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.743 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781048364}) 2024-09-13T10:40:46.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1298133985}) 2024-09-13T10:40:46.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3781048364}) 2024-09-13T10:40:46.744 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.738+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1595191619}) 2024-09-13T10:40:46.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028716163}) 2024-09-13T10:40:46.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1941665608}) 2024-09-13T10:40:46.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028716163}) 2024-09-13T10:40:46.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2530240896}) 2024-09-13T10:40:46.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028716163}) 2024-09-13T10:40:46.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2244010624}) 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028716163}) 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2921677138}) 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028716163}) 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1598218350}) 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028716163}) 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2406929984}) 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028716163}) 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1246977615}) 2024-09-13T10:40:46.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:46.992 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028716163}) 2024-09-13T10:40:46.992 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:46.986+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1524217903}) 2024-09-13T10:40:47.296 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T10:40:47.296 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T10:40:47.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.401+0000 7ffab827f640 10 monclient: get_monmap_and_config 2024-09-13T10:40:47.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.401+0000 7ffab827f640 10 monclient: build_initial_monmap 2024-09-13T10:40:47.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.401+0000 7ffab827f640 10 monclient: monmap: 2024-09-13T10:40:47.403 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:47.403 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:47.402575+0000 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:47.402575+0000 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:47.404 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:47.405 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.402+0000 7ffab827f640 1 Processor -- start 2024-09-13T10:40:47.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.402+0000 7ffab827f640 1 -- start start 2024-09-13T10:40:47.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.402+0000 7ffab827f640 10 monclient: init 2024-09-13T10:40:47.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.403+0000 7ffab827f640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:47.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.403+0000 7ffab827f640 10 monclient: _add_conns ranks=[3,6,5,4,7,2,8,0,1] 2024-09-13T10:40:47.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.403+0000 7ffab827f640 10 monclient(hunting): picked mon.noname-g con 0x7ffab00a67e0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:47.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.403+0000 7ffab827f640 10 monclient(hunting): picked mon.noname-d con 0x7ffab00a8160 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:47.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.403+0000 7ffab827f640 10 monclient(hunting): picked mon.noname-h con 0x7ffab00a72d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:47.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.403+0000 7ffab827f640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab00a4a50 con 0x7ffab00a67e0 2024-09-13T10:40:47.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.403+0000 7ffab827f640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab00a41b0 con 0x7ffab00a72d0 2024-09-13T10:40:47.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.403+0000 7ffab827f640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab00a6260 con 0x7ffab00a8160 2024-09-13T10:40:47.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.403+0000 7ffab827f640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:47.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.403+0000 7ffab827f640 10 monclient(hunting): authenticate will time out at 1386.908331s 2024-09-13T10:40:47.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.403+0000 7ffab581a640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7ffab00a8160 0x7ffab013e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55318/0 (socket says 172.21.15.181:55318) 2024-09-13T10:40:47.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.403+0000 7ffab581a640 1 -- 172.21.15.181:0/3663704840 learned_addr learned my addr 172.21.15.181:0/3663704840 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:47.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab581a640 1 -- 172.21.15.181:0/3663704840 >> v1:172.21.15.181:6792/0 conn(0x7ffab00a8160 legacy=0x7ffab013e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab681c640 1 -- 172.21.15.181:0/3663704840 >> v1:172.21.15.195:6791/0 conn(0x7ffab00a72d0 legacy=0x7ffab0141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab601b640 1 -- 172.21.15.181:0/3663704840 >> v1:172.21.15.195:6790/0 conn(0x7ffab00a67e0 legacy=0x7ffab00a6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1991452983 0 0) 0x7ffab00a6260 con 0x7ffab00a8160 2024-09-13T10:40:47.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 10 monclient(hunting): my global_id is 174489 2024-09-13T10:40:47.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa9c003520 con 0x7ffab00a8160 2024-09-13T10:40:47.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3194985396 0 0) 0x7ffab00a4a50 con 0x7ffab00a67e0 2024-09-13T10:40:47.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 10 monclient(hunting): my global_id is 184188 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffab00a6260 con 0x7ffab00a67e0 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338445008 0 0) 0x7ffab00a41b0 con 0x7ffab00a72d0 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 10 monclient(hunting): my global_id is 106196 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.405+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffab00a4a50 con 0x7ffab00a72d0 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4103790538 0 0) 0x7ffa9c003520 con 0x7ffab00a8160 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 >> v1:172.21.15.195:6791/0 conn(0x7ffab00a72d0 legacy=0x7ffab0141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 >> v1:172.21.15.195:6790/0 conn(0x7ffab00a67e0 legacy=0x7ffab00a6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 10 monclient: _finish_hunting 0 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 1 monclient: found mon.noname-d 2024-09-13T10:40:47.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab00a5270 con 0x7ffab00a8160 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 10 monclient: _finish_auth 0 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 10 monclient: _check_auth_tickets 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffaa0001ba0 con 0x7ffab00a8160 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 10 monclient: dump: 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.417 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab827f640 5 monclient: authenticate success, global_id 174489 2024-09-13T10:40:47.418 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab827f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffaa00048a0 con 0x7ffab00a8160 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 1 -- 172.21.15.181:0/3663704840 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffaa0004dd0 con 0x7ffab00a8160 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab827f640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab827f640 4 set_mon_vals no callback set 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab5019640 10 monclient: dump: 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.419 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab827f640 10 monclient: shutdown 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab827f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab827f640 1 -- 172.21.15.181:0/3663704840 >> v1:172.21.15.181:6792/0 conn(0x7ffab00a8160 legacy=0x7ffab013e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab827f640 1 -- 172.21.15.181:0/3663704840 shutdown_connections 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab827f640 1 -- 172.21.15.181:0/3663704840 >> 172.21.15.181:0/3663704840 conn(0x7ffab0076f90 msgr2=0x7ffab00abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab827f640 1 -- 172.21.15.181:0/3663704840 shutdown_connections 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.406+0000 7ffab827f640 1 -- 172.21.15.181:0/3663704840 wait complete. 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.407+0000 7ffab827f640 10 monclient: build_initial_monmap 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.407+0000 7ffab827f640 10 monclient: monmap: 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:47.421 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.407+0000 7ffab827f640 1 Processor -- start 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.407+0000 7ffab827f640 1 -- start start 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.407+0000 7ffab827f640 10 monclient: init 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab827f640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab827f640 10 monclient: _add_conns ranks=[3,4,0,1,6,2,5,8,7] 2024-09-13T10:40:47.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab827f640 10 monclient(hunting): picked mon.noname-g con 0x7ffab00a67e0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab827f640 10 monclient(hunting): picked mon.noname-c con 0x7ffab00a72d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab827f640 10 monclient(hunting): picked mon.noname-a con 0x7ffab00a8160 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab827f640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab00ab890 con 0x7ffab00a8160 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab827f640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab00a2730 con 0x7ffab00a67e0 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab827f640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab0123200 con 0x7ffab00a72d0 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab827f640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab827f640 10 monclient(hunting): authenticate will time out at 1386.913139s 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab581a640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ffab00a72d0 0x7ffab01414e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35794/0 (socket says 172.21.15.181:35794) 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab681c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ffab00a8160 0x7ffab01d6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50798/0 (socket says 172.21.15.181:50798) 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.408+0000 7ffab581a640 1 -- 172.21.15.181:0/2122656145 learned_addr learned my addr 172.21.15.181:0/2122656145 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffab581a640 1 -- 172.21.15.181:0/2122656145 >> v1:172.21.15.181:6791/0 conn(0x7ffab00a72d0 legacy=0x7ffab01414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffab601b640 1 -- 172.21.15.181:0/2122656145 >> v1:172.21.15.195:6790/0 conn(0x7ffab00a67e0 legacy=0x7ffab0140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffab681c640 1 -- 172.21.15.181:0/2122656145 >> v1:172.21.15.181:6789/0 conn(0x7ffab00a8160 legacy=0x7ffab01d6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1009166878 0 0) 0x7ffab0123200 con 0x7ffab00a72d0 2024-09-13T10:40:47.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): my global_id is 174532 2024-09-13T10:40:47.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa94003520 con 0x7ffab00a72d0 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1337206042 0 0) 0x7ffab00a6260 con 0x7ffab00a67e0 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): my global_id is 184197 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffab0123200 con 0x7ffab00a67e0 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642656651 0 0) 0x7ffab00a4a50 con 0x7ffab00a8160 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): my global_id is 184203 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffab00a6260 con 0x7ffab00a8160 2024-09-13T10:40:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1601603818 0 0) 0x7ffa94003520 con 0x7ffab00a72d0 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffab00a4a50 con 0x7ffab00a72d0 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffaa0001b60 con 0x7ffab00a72d0 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): dump: 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 931663594 0 0) 0x7ffab0123200 con 0x7ffab00a67e0 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa94003520 con 0x7ffab00a67e0 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 341051334 0 0) 0x7ffab00a6260 con 0x7ffab00a8160 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffab0123200 con 0x7ffab00a8160 2024-09-13T10:40:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffaac003990 con 0x7ffab00a67e0 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): dump: 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.428 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffaa8003610 con 0x7ffab00a8160 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 10 monclient(hunting): dump: 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 179671714 0 0) 0x7ffab00a4a50 con 0x7ffab00a72d0 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.410+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 >> v1:172.21.15.195:6790/0 conn(0x7ffab00a67e0 legacy=0x7ffab0140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 >> v1:172.21.15.181:6789/0 conn(0x7ffab00a8160 legacy=0x7ffab01d6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 1 monclient: found mon.c 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab01237c0 con 0x7ffab00a72d0 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 10 monclient: _finish_auth 0 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffab827f640 5 monclient: authenticate success, global_id 174532 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffab827f640 10 monclient: _renew_subs 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffab827f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffab827f640 1 -- 172.21.15.181:0/2122656145 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffab0122f20 con 0x7ffab00a72d0 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffab827f640 10 monclient: _renew_subs 2024-09-13T10:40:47.431 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffab827f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffab827f640 1 -- 172.21.15.181:0/2122656145 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7ffab0141dd0 con 0x7ffab00a72d0 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffaa0004db0 con 0x7ffab00a72d0 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ffaa00048a0 con 0x7ffab00a72d0 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffab4818640 4 set_mon_vals no callback set 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffaa6ffd640 10 monclient: dump: 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffab827f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.411+0000 7ffab827f640 1 -- 172.21.15.181:0/2122656145 --> v1:172.21.15.181:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ffa98000f80 con 0x7ffab00a72d0 2024-09-13T10:40:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.412+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ffaa0011af0 con 0x7ffab00a72d0 2024-09-13T10:40:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.412+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7ffaa004e2c0 con 0x7ffab00a72d0 2024-09-13T10:40:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.412+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 --> v1:172.21.15.181:6804/3159017208 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffaa00048a0 con 0x7ffa94047470 2024-09-13T10:40:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.412+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (unknown 1450749824 0 0) 0x7ffaa004e730 con 0x7ffab00a72d0 2024-09-13T10:40:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.412+0000 7ffaa6ffd640 10 monclient: handle_get_version_reply finishing 1 version 331 2024-09-13T10:40:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.412+0000 7ffab601b640 10 monclient: get_auth_request con 0x7ffa940407c0 auth_method 0 2024-09-13T10:40:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.412+0000 7ffab681c640 10 monclient: get_auth_request con 0x7ffa94047470 auth_method 0 2024-09-13T10:40:47.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.417+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== osd.0 v1:172.21.15.181:6804/3159017208 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7ffaa00048a0 con 0x7ffa94047470 2024-09-13T10:40:47.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.429+0000 7ffab827f640 1 -- 172.21.15.181:0/2122656145 --> v1:172.21.15.181:6804/3159017208 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffa98002cd0 con 0x7ffa94047470 2024-09-13T10:40:47.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.430+0000 7ffaa6ffd640 1 -- 172.21.15.181:0/2122656145 <== osd.0 v1:172.21.15.181:6804/3159017208 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7ffa98002cd0 con 0x7ffa94047470 2024-09-13T10:40:47.435 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:47.435 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T10:40:47.435 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:47.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.430+0000 7ffab827f640 1 -- 172.21.15.181:0/2122656145 >> v1:172.21.15.181:6804/3159017208 conn(0x7ffa94047470 legacy=0x7ffa94049890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.430+0000 7ffab827f640 1 -- 172.21.15.181:0/2122656145 >> v1:172.21.15.195:6800/1839191919 conn(0x7ffa940407c0 legacy=0x7ffa94042c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.430+0000 7ffab827f640 10 monclient: shutdown 2024-09-13T10:40:47.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.430+0000 7ffab827f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:47.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.430+0000 7ffab827f640 1 -- 172.21.15.181:0/2122656145 >> v1:172.21.15.181:6791/0 conn(0x7ffab00a72d0 legacy=0x7ffab01414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.430+0000 7ffab681c640 1 -- 172.21.15.181:0/2122656145 reap_dead start 2024-09-13T10:40:47.436 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.430+0000 7ffab827f640 1 -- 172.21.15.181:0/2122656145 shutdown_connections 2024-09-13T10:40:47.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.430+0000 7ffab827f640 1 -- 172.21.15.181:0/2122656145 >> 172.21.15.181:0/2122656145 conn(0x7ffab0076f90 msgr2=0x7ffab009ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:47.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.430+0000 7ffab827f640 1 -- 172.21.15.181:0/2122656145 shutdown_connections 2024-09-13T10:40:47.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.430+0000 7ffab827f640 1 -- 172.21.15.181:0/2122656145 wait complete. 2024-09-13T10:40:47.441 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T10:40:47.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.538+0000 7fe48b2aa640 10 monclient: get_monmap_and_config 2024-09-13T10:40:47.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.538+0000 7fe48b2aa640 10 monclient: build_initial_monmap 2024-09-13T10:40:47.539 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.538+0000 7fe48b2aa640 10 monclient: monmap: 2024-09-13T10:40:47.539 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:47.538722+0000 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:47.538722+0000 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:47.540 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:47.541 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:47.541 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.538+0000 7fe48b2aa640 1 Processor -- start 2024-09-13T10:40:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.538+0000 7fe48b2aa640 1 -- start start 2024-09-13T10:40:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.538+0000 7fe48b2aa640 10 monclient: init 2024-09-13T10:40:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe48b2aa640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe48b2aa640 10 monclient: _add_conns ranks=[7,6,0,1,4,3,2,8,5] 2024-09-13T10:40:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe48b2aa640 10 monclient(hunting): picked mon.noname-i con 0x7fe4840a66d0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe48b2aa640 10 monclient(hunting): picked mon.noname-d con 0x7fe4840a6ab0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe48b2aa640 10 monclient(hunting): picked mon.noname-a con 0x7fe48413f9a0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe48b2aa640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4840a5fe0 con 0x7fe48413f9a0 2024-09-13T10:40:47.542 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe48b2aa640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4840a8080 con 0x7fe4840a6ab0 2024-09-13T10:40:47.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe48b2aa640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4840a42c0 con 0x7fe4840a66d0 2024-09-13T10:40:47.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe48b2aa640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:47.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe48b2aa640 10 monclient(hunting): authenticate will time out at 1387.044428s 2024-09-13T10:40:47.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe489847640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe48413f9a0 0x7fe484141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50814/0 (socket says 172.21.15.181:50814) 2024-09-13T10:40:47.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe488845640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7fe4840a6ab0 0x7fe4840a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55322/0 (socket says 172.21.15.181:55322) 2024-09-13T10:40:47.543 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.539+0000 7fe489847640 1 -- 172.21.15.181:0/3327432972 learned_addr learned my addr 172.21.15.181:0/3327432972 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:47.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.541+0000 7fe489847640 1 -- 172.21.15.181:0/3327432972 >> v1:172.21.15.181:6789/0 conn(0x7fe48413f9a0 legacy=0x7fe484141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.541+0000 7fe488845640 1 -- 172.21.15.181:0/3327432972 >> v1:172.21.15.181:6792/0 conn(0x7fe4840a6ab0 legacy=0x7fe4840a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.541+0000 7fe489046640 1 -- 172.21.15.181:0/3327432972 >> v1:172.21.15.195:6792/0 conn(0x7fe4840a66d0 legacy=0x7fe4840a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209100943 0 0) 0x7fe4840a5fe0 con 0x7fe48413f9a0 2024-09-13T10:40:47.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.547 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient(hunting): my global_id is 184212 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe470003520 con 0x7fe48413f9a0 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41711337 0 0) 0x7fe4840a8080 con 0x7fe4840a6ab0 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient(hunting): my global_id is 174498 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4840a5fe0 con 0x7fe4840a6ab0 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1274894549 0 0) 0x7fe4840a42c0 con 0x7fe4840a66d0 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.548 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient(hunting): my global_id is 58210 2024-09-13T10:40:47.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4840a8080 con 0x7fe4840a66d0 2024-09-13T10:40:47.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 471853788 0 0) 0x7fe470003520 con 0x7fe48413f9a0 2024-09-13T10:40:47.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 >> v1:172.21.15.195:6792/0 conn(0x7fe4840a66d0 legacy=0x7fe4840a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 >> v1:172.21.15.181:6792/0 conn(0x7fe4840a6ab0 legacy=0x7fe4840a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:40:47.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 monclient: found mon.noname-a 2024-09-13T10:40:47.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:47.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:40:47.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4841464e0 con 0x7fe48413f9a0 2024-09-13T10:40:47.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient: _finish_auth 0 2024-09-13T10:40:47.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:40:47.549 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe47c001e50 con 0x7fe48413f9a0 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe48b2aa640 5 monclient: authenticate success, global_id 184212 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe48b2aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient: dump: 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.550 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe48b2aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe47c004c20 con 0x7fe48413f9a0 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 1 -- 172.21.15.181:0/3327432972 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe47c005150 con 0x7fe48413f9a0 2024-09-13T10:40:47.551 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe48b2aa640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe48b2aa640 4 set_mon_vals no callback set 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe47bfff640 10 monclient: dump: 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.552 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe48b2aa640 10 monclient: shutdown 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe48b2aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.542+0000 7fe48b2aa640 1 -- 172.21.15.181:0/3327432972 >> v1:172.21.15.181:6789/0 conn(0x7fe48413f9a0 legacy=0x7fe484141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.543+0000 7fe48b2aa640 1 -- 172.21.15.181:0/3327432972 shutdown_connections 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.543+0000 7fe48b2aa640 1 -- 172.21.15.181:0/3327432972 >> 172.21.15.181:0/3327432972 conn(0x7fe4840abcd0 msgr2=0x7fe4840ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.543+0000 7fe48b2aa640 1 -- 172.21.15.181:0/3327432972 shutdown_connections 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.543+0000 7fe48b2aa640 1 -- 172.21.15.181:0/3327432972 wait complete. 2024-09-13T10:40:47.553 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.543+0000 7fe48b2aa640 10 monclient: build_initial_monmap 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.543+0000 7fe48b2aa640 10 monclient: monmap: 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:47.554 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.543+0000 7fe48b2aa640 1 Processor -- start 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe48b2aa640 1 -- start start 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe48b2aa640 10 monclient: init 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe48b2aa640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe48b2aa640 10 monclient: _add_conns ranks=[1,4,7,3,8,0,2,5,6] 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe48b2aa640 10 monclient(hunting): picked mon.noname-f con 0x7fe4840a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe48b2aa640 10 monclient(hunting): picked mon.noname-c con 0x7fe4840a6ab0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe48b2aa640 10 monclient(hunting): picked mon.noname-i con 0x7fe48413f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe48b2aa640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48413e2e0 con 0x7fe4840a66d0 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe48b2aa640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe484068680 con 0x7fe4840a6ab0 2024-09-13T10:40:47.555 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe48b2aa640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48413c150 con 0x7fe48413f9a0 2024-09-13T10:40:47.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe48b2aa640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:47.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe48b2aa640 10 monclient(hunting): authenticate will time out at 1387.049461s 2024-09-13T10:40:47.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe488845640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fe4840a6ab0 0x7fe48413ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35808/0 (socket says 172.21.15.181:35808) 2024-09-13T10:40:47.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.544+0000 7fe488845640 1 -- 172.21.15.181:0/1194767866 learned_addr learned my addr 172.21.15.181:0/1194767866 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:47.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.546+0000 7fe488845640 1 -- 172.21.15.181:0/1194767866 >> v1:172.21.15.181:6791/0 conn(0x7fe4840a6ab0 legacy=0x7fe48413ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.558 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.546+0000 7fe489847640 1 -- 172.21.15.181:0/1194767866 >> v1:172.21.15.195:6792/0 conn(0x7fe48413f9a0 legacy=0x7fe4841d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.546+0000 7fe489046640 1 -- 172.21.15.181:0/1194767866 >> v1:172.21.15.195:6789/0 conn(0x7fe4840a66d0 legacy=0x7fe48413b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.546+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1251517393 0 0) 0x7fe484068680 con 0x7fe4840a6ab0 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.546+0000 7fe479ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.546+0000 7fe479ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.546+0000 7fe479ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.546+0000 7fe479ffb640 10 monclient(hunting): my global_id is 174541 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.546+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe468003520 con 0x7fe4840a6ab0 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1515462863 0 0) 0x7fe468003520 con 0x7fe4840a6ab0 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe484068680 con 0x7fe4840a6ab0 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe4740047e0 con 0x7fe4840a6ab0 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:47.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient(hunting): dump: 2024-09-13T10:40:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.560 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.561 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.561 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.561 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.561 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:47.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565500853 0 0) 0x7fe48413c150 con 0x7fe48413f9a0 2024-09-13T10:40:47.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient(hunting): my global_id is 58219 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe468003520 con 0x7fe48413f9a0 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824638767 0 0) 0x7fe48413e2e0 con 0x7fe4840a66d0 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient(hunting): my global_id is 135244 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe48413c150 con 0x7fe4840a66d0 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 <== mon.4 v1:172.21.15.181:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2040495226 0 0) 0x7fe484068680 con 0x7fe4840a6ab0 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 >> v1:172.21.15.195:6792/0 conn(0x7fe48413f9a0 legacy=0x7fe4841d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 >> v1:172.21.15.195:6789/0 conn(0x7fe4840a66d0 legacy=0x7fe48413b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:40:47.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 monclient: found mon.c 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48413cdf0 con 0x7fe4840a6ab0 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient: _finish_auth 0 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe48b2aa640 5 monclient: authenticate success, global_id 174541 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe48b2aa640 10 monclient: _renew_subs 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe48b2aa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe48b2aa640 1 -- 172.21.15.181:0/1194767866 --> v1:172.21.15.181:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe48413f150 con 0x7fe4840a6ab0 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 <== mon.4 v1:172.21.15.181:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe474004cb0 con 0x7fe4840a6ab0 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 <== mon.4 v1:172.21.15.181:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fe4740051e0 con 0x7fe4840a6ab0 2024-09-13T10:40:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe479ffb640 10 monclient: dump: 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.564 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.565 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.565 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.565 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.565 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.565 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe48b2aa640 10 monclient: _renew_subs 2024-09-13T10:40:47.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe47b7fe640 4 set_mon_vals no callback set 2024-09-13T10:40:47.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe48b2aa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:47.568 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.547+0000 7fe48b2aa640 1 -- 172.21.15.181:0/1194767866 --> v1:172.21.15.181:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fe4841374e0 con 0x7fe4840a6ab0 2024-09-13T10:40:47.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.548+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 <== mon.4 v1:172.21.15.181:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fe474005480 con 0x7fe4840a6ab0 2024-09-13T10:40:47.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.548+0000 7fe48b2aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:47.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.548+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 <== mon.4 v1:172.21.15.181:6791/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7fe47404e340 con 0x7fe4840a6ab0 2024-09-13T10:40:47.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.548+0000 7fe48b2aa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:47.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.548+0000 7fe48b2aa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.181:6791/0 2024-09-13T10:40:47.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.548+0000 7fe48b2aa640 1 -- 172.21.15.181:0/1194767866 --> v1:172.21.15.181:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4840a3240 con 0x7fe4840a6ab0 2024-09-13T10:40:47.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.548+0000 7fe489046640 10 monclient: get_auth_request con 0x7fe46803fcf0 auth_method 0 2024-09-13T10:40:47.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.553+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 <== mon.4 v1:172.21.15.181:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fe474017950 con 0x7fe4840a6ab0 2024-09-13T10:40:47.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.553+0000 7fe479ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:47.569 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.553+0000 7fe479ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:47.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1397900389}) 2024-09-13T10:40:47.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1131892149}) 2024-09-13T10:40:47.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1397900389}) 2024-09-13T10:40:47.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=733267210}) 2024-09-13T10:40:47.571 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1397900389}) 2024-09-13T10:40:47.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=99950961}) 2024-09-13T10:40:47.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1397900389}) 2024-09-13T10:40:47.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2100653063}) 2024-09-13T10:40:47.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1397900389}) 2024-09-13T10:40:47.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1260825015}) 2024-09-13T10:40:47.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1397900389}) 2024-09-13T10:40:47.572 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3544546945}) 2024-09-13T10:40:47.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1397900389}) 2024-09-13T10:40:47.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3749221941}) 2024-09-13T10:40:47.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1397900389}) 2024-09-13T10:40:47.573 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.560+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=826927041}) 2024-09-13T10:40:47.649 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.649 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3061908626}) 2024-09-13T10:40:47.649 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=446781592}) 2024-09-13T10:40:47.649 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3061908626}) 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1763207261}) 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3061908626}) 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=786091000}) 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3061908626}) 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=552303106}) 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3061908626}) 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1901113229}) 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.650 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3061908626}) 2024-09-13T10:40:47.651 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1775831978}) 2024-09-13T10:40:47.651 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.651 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3061908626}) 2024-09-13T10:40:47.651 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3233216664}) 2024-09-13T10:40:47.651 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.651 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3061908626}) 2024-09-13T10:40:47.651 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.646+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2587471403}) 2024-09-13T10:40:47.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3700053880}) 2024-09-13T10:40:47.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=712479317}) 2024-09-13T10:40:47.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3700053880}) 2024-09-13T10:40:47.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=161820043}) 2024-09-13T10:40:47.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3700053880}) 2024-09-13T10:40:47.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1265182563}) 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3700053880}) 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1656040545}) 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3700053880}) 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=743625094}) 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3700053880}) 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2229969496}) 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3700053880}) 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1173204836}) 2024-09-13T10:40:47.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3700053880}) 2024-09-13T10:40:47.661 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2291860690}) 2024-09-13T10:40:47.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.668+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.668+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3619571678}) 2024-09-13T10:40:47.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.668+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2322936078}) 2024-09-13T10:40:47.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.668+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.668+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3619571678}) 2024-09-13T10:40:47.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.668+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4179558814}) 2024-09-13T10:40:47.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.668+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.668+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3619571678}) 2024-09-13T10:40:47.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.668+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=670400078}) 2024-09-13T10:40:47.681 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.668+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3619571678}) 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2594148041}) 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3619571678}) 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=887481070}) 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3619571678}) 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2231872974}) 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3619571678}) 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2983062483}) 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3619571678}) 2024-09-13T10:40:47.682 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.669+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4203556003}) 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3765935752}) 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2911990471}) 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3765935752}) 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4118820998}) 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3765935752}) 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1342158251}) 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3765935752}) 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2227178927}) 2024-09-13T10:40:47.683 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3765935752}) 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3078964499}) 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3765935752}) 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1765297764}) 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3765935752}) 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1726654010}) 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3765935752}) 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.670+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3863648625}) 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.671+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.684 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.671+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390270973}) 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.671+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=491011694}) 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.671+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.671+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390270973}) 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.671+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2587398216}) 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.671+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390270973}) 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2103203920}) 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390270973}) 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2218384328}) 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390270973}) 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2178563197}) 2024-09-13T10:40:47.685 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390270973}) 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1221440546}) 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390270973}) 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3513628434}) 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3390270973}) 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.672+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3102840489}) 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3385493726}) 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013224062}) 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.686 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3385493726}) 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=979076105}) 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3385493726}) 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1574561266}) 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3385493726}) 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2628774645}) 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3385493726}) 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=48267396}) 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3385493726}) 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2728858031}) 2024-09-13T10:40:47.687 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3385493726}) 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=390147322}) 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3385493726}) 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.673+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1603996228}) 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.674+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.674+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303059716}) 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.674+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=386698062}) 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.674+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.674+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303059716}) 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.674+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=509643253}) 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.674+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.688 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.674+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303059716}) 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.674+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1518407802}) 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.674+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303059716}) 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1489631590}) 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303059716}) 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3883675530}) 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303059716}) 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2963615199}) 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303059716}) 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2660882311}) 2024-09-13T10:40:47.689 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303059716}) 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.675+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3209232816}) 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3812012411}) 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2070728138}) 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3812012411}) 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3481957270}) 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3812012411}) 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2892681197}) 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3812012411}) 2024-09-13T10:40:47.690 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=968790624}) 2024-09-13T10:40:47.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3812012411}) 2024-09-13T10:40:47.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2570291686}) 2024-09-13T10:40:47.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3812012411}) 2024-09-13T10:40:47.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1441721141}) 2024-09-13T10:40:47.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3812012411}) 2024-09-13T10:40:47.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3277277376}) 2024-09-13T10:40:47.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3812012411}) 2024-09-13T10:40:47.691 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.676+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2722298708}) 2024-09-13T10:40:47.736 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.734+0000 7fe48b2aa640 1 -- 172.21.15.181:0/1194767866 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe484069af0 con 0x7fe46803fcf0 2024-09-13T10:40:47.737 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.735+0000 7fe479ffb640 1 -- 172.21.15.181:0/1194767866 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7fe484069af0 con 0x7fe46803fcf0 2024-09-13T10:40:47.737 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T10:40:47.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.737+0000 7fe48b2aa640 1 -- 172.21.15.181:0/1194767866 >> v1:172.21.15.195:6800/1839191919 conn(0x7fe46803fcf0 legacy=0x7fe4680421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.738 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.737+0000 7fe48b2aa640 10 monclient: shutdown 2024-09-13T10:40:47.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.737+0000 7fe48b2aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:47.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.737+0000 7fe48b2aa640 1 -- 172.21.15.181:0/1194767866 >> v1:172.21.15.181:6791/0 conn(0x7fe4840a6ab0 legacy=0x7fe48413ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.737+0000 7fe48b2aa640 1 -- 172.21.15.181:0/1194767866 shutdown_connections 2024-09-13T10:40:47.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.737+0000 7fe48b2aa640 1 -- 172.21.15.181:0/1194767866 >> 172.21.15.181:0/1194767866 conn(0x7fe4840abcd0 msgr2=0x7fe4840a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:47.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.737+0000 7fe48b2aa640 1 -- 172.21.15.181:0/1194767866 shutdown_connections 2024-09-13T10:40:47.739 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.737+0000 7fe48b2aa640 1 -- 172.21.15.181:0/1194767866 wait complete. 2024-09-13T10:40:47.749 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T10:40:47.750 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T10:40:47.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.849+0000 7f89cca31640 10 monclient: get_monmap_and_config 2024-09-13T10:40:47.851 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.849+0000 7f89cca31640 10 monclient: build_initial_monmap 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.849+0000 7f89cca31640 10 monclient: monmap: 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:47.850393+0000 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:47.850393+0000 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:47.852 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:47.853 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:47.853 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:47.853 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:47.853 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 1 Processor -- start 2024-09-13T10:40:47.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 1 -- start start 2024-09-13T10:40:47.853 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 10 monclient: init 2024-09-13T10:40:47.858 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 10 monclient: _add_conns ranks=[7,0,2,8,4,5,3,1,6] 2024-09-13T10:40:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 10 monclient(hunting): picked mon.noname-i con 0x7f89c809cb10 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 10 monclient(hunting): picked mon.noname-a con 0x7f89c8136020 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 10 monclient(hunting): picked mon.noname-b con 0x7f89c813fb50 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c8136580 con 0x7f89c8136020 2024-09-13T10:40:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c809cef0 con 0x7f89c813fb50 2024-09-13T10:40:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c809dbb0 con 0x7f89c809cb10 2024-09-13T10:40:47.859 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.850+0000 7f89cca31640 10 monclient(hunting): authenticate will time out at 1387.355922s 2024-09-13T10:40:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.851+0000 7f89bdd9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f89c8136020 0x7f89c813e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50816/0 (socket says 172.21.15.181:50816) 2024-09-13T10:40:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.851+0000 7f89bdd9b640 1 -- 172.21.15.181:0/1537358194 learned_addr learned my addr 172.21.15.181:0/1537358194 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89bdd9b640 1 -- 172.21.15.181:0/1537358194 >> v1:172.21.15.181:6789/0 conn(0x7f89c8136020 legacy=0x7f89c813e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c6d9d640 1 -- 172.21.15.181:0/1537358194 >> v1:172.21.15.181:6790/0 conn(0x7f89c813fb50 legacy=0x7f89c8141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 -- 172.21.15.181:0/1537358194 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778377028 0 0) 0x7f89c8136580 con 0x7f89c8136020 2024-09-13T10:40:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.860 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient(hunting): my global_id is 184221 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 -- 172.21.15.181:0/1537358194 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89b4003520 con 0x7f89c8136020 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 -- 172.21.15.181:0/1537358194 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3535222392 0 0) 0x7f89c809cef0 con 0x7f89c813fb50 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient(hunting): my global_id is 174476 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 -- 172.21.15.181:0/1537358194 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c8136580 con 0x7f89c813fb50 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c659c640 1 -- 172.21.15.181:0/1537358194 >> v1:172.21.15.195:6792/0 conn(0x7f89c809cb10 legacy=0x7f89c80a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 -- 172.21.15.181:0/1537358194 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3932757992 0 0) 0x7f89b4003520 con 0x7f89c8136020 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 -- 172.21.15.181:0/1537358194 >> v1:172.21.15.195:6792/0 conn(0x7f89c809cb10 legacy=0x7f89c80a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 -- 172.21.15.181:0/1537358194 >> v1:172.21.15.181:6790/0 conn(0x7f89c813fb50 legacy=0x7f89c8141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient: _finish_hunting 0 2024-09-13T10:40:47.861 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 monclient: found mon.noname-a 2024-09-13T10:40:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:40:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 -- 172.21.15.181:0/1537358194 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c809de90 con 0x7f89c8136020 2024-09-13T10:40:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient: _finish_auth 0 2024-09-13T10:40:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient: _check_auth_tickets 2024-09-13T10:40:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 -- 172.21.15.181:0/1537358194 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89b0001ae0 con 0x7f89c8136020 2024-09-13T10:40:47.862 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89cca31640 5 monclient: authenticate success, global_id 184221 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89cca31640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient: dump: 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.863 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 -- 172.21.15.181:0/1537358194 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89c0001e90 con 0x7f89c813fb50 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89cca31640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 -- 172.21.15.181:0/1537358194 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89b00048a0 con 0x7f89c8136020 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 1 -- 172.21.15.181:0/1537358194 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89b0004e50 con 0x7f89c8136020 2024-09-13T10:40:47.864 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89cca31640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89cca31640 4 set_mon_vals no callback set 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.853+0000 7f89c5d9b640 10 monclient: dump: 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.865 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.854+0000 7f89cca31640 10 monclient: shutdown 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.854+0000 7f89cca31640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.854+0000 7f89cca31640 1 -- 172.21.15.181:0/1537358194 >> v1:172.21.15.181:6789/0 conn(0x7f89c8136020 legacy=0x7f89c813e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.854+0000 7f89cca31640 1 -- 172.21.15.181:0/1537358194 shutdown_connections 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.854+0000 7f89cca31640 1 -- 172.21.15.181:0/1537358194 >> 172.21.15.181:0/1537358194 conn(0x7f89c8077140 msgr2=0x7f89c80abc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:47.866 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.854+0000 7f89cca31640 1 -- 172.21.15.181:0/1537358194 shutdown_connections 2024-09-13T10:40:47.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.854+0000 7f89cca31640 1 -- 172.21.15.181:0/1537358194 wait complete. 2024-09-13T10:40:47.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.854+0000 7f89cca31640 10 monclient: build_initial_monmap 2024-09-13T10:40:47.867 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.854+0000 7f89cca31640 10 monclient: monmap: 2024-09-13T10:40:47.867 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:47.867 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:47.867 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:47.867 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:47.867 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:47.867 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:47.867 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:47.867 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:47.867 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 1 Processor -- start 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 1 -- start start 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 10 monclient: init 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 10 monclient: _add_conns ranks=[1,6,8,0,4,5,3,7,2] 2024-09-13T10:40:47.868 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 10 monclient(hunting): picked mon.noname-f con 0x7f89c809cb10 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:47.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 10 monclient(hunting): picked mon.noname-d con 0x7f89c8136020 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:47.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 10 monclient(hunting): picked mon.noname-e con 0x7f89c813fb50 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:47.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c80a5d30 con 0x7f89c809cb10 2024-09-13T10:40:47.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c8136c80 con 0x7f89c8136020 2024-09-13T10:40:47.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c8136f60 con 0x7f89c813fb50 2024-09-13T10:40:47.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:47.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.855+0000 7f89cca31640 10 monclient(hunting): authenticate will time out at 1387.360982s 2024-09-13T10:40:47.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.856+0000 7f89bdd9b640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f89c8136020 0x7f89c80a2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55328/0 (socket says 172.21.15.181:55328) 2024-09-13T10:40:47.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.856+0000 7f89c6d9d640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f89c813fb50 0x7f89c81d64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41754/0 (socket says 172.21.15.181:41754) 2024-09-13T10:40:47.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.856+0000 7f89bdd9b640 1 -- 172.21.15.181:0/2565997833 learned_addr learned my addr 172.21.15.181:0/2565997833 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:47.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89c6d9d640 1 -- 172.21.15.181:0/2565997833 >> v1:172.21.15.181:6793/0 conn(0x7f89c813fb50 legacy=0x7f89c81d64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bdd9b640 1 -- 172.21.15.181:0/2565997833 >> v1:172.21.15.181:6792/0 conn(0x7f89c8136020 legacy=0x7f89c80a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89c659c640 1 -- 172.21.15.181:0/2565997833 >> v1:172.21.15.195:6789/0 conn(0x7f89c809cb10 legacy=0x7f89c80a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1938945399 0 0) 0x7f89c8136f60 con 0x7f89c813fb50 2024-09-13T10:40:47.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): my global_id is 184256 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a8003520 con 0x7f89c813fb50 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3476020884 0 0) 0x7f89c8136c80 con 0x7f89c8136020 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): my global_id is 174507 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c8136f60 con 0x7f89c8136020 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317043690 0 0) 0x7f89c809dbb0 con 0x7f89c809cb10 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): my global_id is 135253 2024-09-13T10:40:47.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c8136c80 con 0x7f89c809cb10 2024-09-13T10:40:47.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 920409805 0 0) 0x7f89a8003520 con 0x7f89c813fb50 2024-09-13T10:40:47.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89c809dbb0 con 0x7f89c813fb50 2024-09-13T10:40:47.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89c0003cd0 con 0x7f89c813fb50 2024-09-13T10:40:47.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:47.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:40:47.875 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): dump: 2024-09-13T10:40:47.875 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.875 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.875 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.876 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.876 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.876 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.876 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.876 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.876 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.876 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.876 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.876 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.876 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.876 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.876 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.877 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:47.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4061189218 0 0) 0x7f89c8136f60 con 0x7f89c8136020 2024-09-13T10:40:47.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89a8003520 con 0x7f89c8136020 2024-09-13T10:40:47.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89b0001a60 con 0x7f89c8136020 2024-09-13T10:40:47.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:47.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:47.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): dump: 2024-09-13T10:40:47.877 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.877 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.877 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.878 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.878 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.878 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.878 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.878 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.878 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.878 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.878 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.878 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.878 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.879 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.879 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.879 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3722630798 0 0) 0x7f89c8136c80 con 0x7f89c809cb10 2024-09-13T10:40:47.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89c8136f60 con 0x7f89c809cb10 2024-09-13T10:40:47.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89b8001c30 con 0x7f89c809cb10 2024-09-13T10:40:47.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:47.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:40:47.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient(hunting): dump: 2024-09-13T10:40:47.879 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.880 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.880 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.880 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.880 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.880 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.880 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.880 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.880 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.880 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.880 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.880 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.880 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 27218676 0 0) 0x7f89c809dbb0 con 0x7f89c813fb50 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 >> v1:172.21.15.181:6792/0 conn(0x7f89c8136020 legacy=0x7f89c80a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 >> v1:172.21.15.195:6789/0 conn(0x7f89c809cb10 legacy=0x7f89c80a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 monclient: found mon.e 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c80a4650 con 0x7f89c813fb50 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient: _finish_auth 0 2024-09-13T10:40:47.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89cca31640 5 monclient: authenticate success, global_id 184256 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89cca31640 10 monclient: _renew_subs 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89cca31640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89cca31640 1 -- 172.21.15.181:0/2565997833 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89c80ab010 con 0x7f89c813fb50 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89cca31640 10 monclient: _renew_subs 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89cca31640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.858+0000 7f89cca31640 1 -- 172.21.15.181:0/2565997833 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f89c80a33e0 con 0x7f89c813fb50 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.859+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89c0001950 con 0x7f89c813fb50 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.859+0000 7f89bf7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.859+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f89c0004460 con 0x7f89c813fb50 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.859+0000 7f89bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:47.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.859+0000 7f89bf7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.859+0000 7f89c559a640 4 set_mon_vals no callback set 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.859+0000 7f89bf7fe640 10 monclient: dump: 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:47.883 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:47.884 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:47.884 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:47.884 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:47.884 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:47.884 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.859+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f89c0004600 con 0x7f89c813fb50 2024-09-13T10:40:47.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.859+0000 7f89cca31640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:40:47.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.859+0000 7f89cca31640 1 -- 172.21.15.181:0/2565997833 --> v1:172.21.15.181:6793/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f89ac000f80 con 0x7f89c813fb50 2024-09-13T10:40:47.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.859+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f89c004e440 con 0x7f89c813fb50 2024-09-13T10:40:47.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.860+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 --> v1:172.21.15.181:6800/3226877824 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89a804acd0 con 0x7f89a8047060 2024-09-13T10:40:47.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.860+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (unknown 1450749824 0 0) 0x7f89c0001eb0 con 0x7f89c813fb50 2024-09-13T10:40:47.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.860+0000 7f89bf7fe640 10 monclient: handle_get_version_reply finishing 1 version 331 2024-09-13T10:40:47.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.860+0000 7f89bdd9b640 10 monclient: get_auth_request con 0x7f89a8047060 auth_method 0 2024-09-13T10:40:47.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.860+0000 7f89c659c640 10 monclient: get_auth_request con 0x7f89a80404b0 auth_method 0 2024-09-13T10:40:47.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.865+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== osd.1 v1:172.21.15.181:6800/3226877824 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f89a804acd0 con 0x7f89a8047060 2024-09-13T10:40:47.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.878+0000 7f89cca31640 1 -- 172.21.15.181:0/2565997833 --> v1:172.21.15.181:6800/3226877824 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f89ac002cd0 con 0x7f89a8047060 2024-09-13T10:40:47.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.878+0000 7f89bf7fe640 1 -- 172.21.15.181:0/2565997833 <== osd.1 v1:172.21.15.181:6800/3226877824 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f89ac002cd0 con 0x7f89a8047060 2024-09-13T10:40:47.886 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:47.886 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T10:40:47.886 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:47.888 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.888 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4225355902}) 2024-09-13T10:40:47.888 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4267810106}) 2024-09-13T10:40:47.888 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.888 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4225355902}) 2024-09-13T10:40:47.888 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2923094846}) 2024-09-13T10:40:47.888 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4225355902}) 2024-09-13T10:40:47.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=973762158}) 2024-09-13T10:40:47.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4225355902}) 2024-09-13T10:40:47.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3939047040}) 2024-09-13T10:40:47.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.875+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4225355902}) 2024-09-13T10:40:47.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=62772961}) 2024-09-13T10:40:47.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4225355902}) 2024-09-13T10:40:47.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=729777745}) 2024-09-13T10:40:47.889 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4225355902}) 2024-09-13T10:40:47.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=268348222}) 2024-09-13T10:40:47.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:47.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4225355902}) 2024-09-13T10:40:47.890 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:47.876+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1359259110}) 2024-09-13T10:40:47.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.878+0000 7f89cca31640 1 -- 172.21.15.181:0/2565997833 >> v1:172.21.15.181:6800/3226877824 conn(0x7f89a8047060 legacy=0x7f89a8049480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.878+0000 7f89cca31640 1 -- 172.21.15.181:0/2565997833 >> v1:172.21.15.195:6800/1839191919 conn(0x7f89a80404b0 legacy=0x7f89a8042970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.878+0000 7f89cca31640 10 monclient: shutdown 2024-09-13T10:40:47.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.878+0000 7f89cca31640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:47.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.878+0000 7f89cca31640 1 -- 172.21.15.181:0/2565997833 >> v1:172.21.15.181:6793/0 conn(0x7f89c813fb50 legacy=0x7f89c81d64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.878+0000 7f89c6d9d640 1 -- 172.21.15.181:0/2565997833 reap_dead start 2024-09-13T10:40:47.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.878+0000 7f89cca31640 1 -- 172.21.15.181:0/2565997833 shutdown_connections 2024-09-13T10:40:47.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.878+0000 7f89cca31640 1 -- 172.21.15.181:0/2565997833 >> 172.21.15.181:0/2565997833 conn(0x7f89c8077140 msgr2=0x7f89c813f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:47.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.878+0000 7f89cca31640 1 -- 172.21.15.181:0/2565997833 shutdown_connections 2024-09-13T10:40:47.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.878+0000 7f89cca31640 1 -- 172.21.15.181:0/2565997833 wait complete. 2024-09-13T10:40:47.892 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T10:40:47.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.988+0000 7f6f8b8ef640 10 monclient: get_monmap_and_config 2024-09-13T10:40:47.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.988+0000 7f6f8b8ef640 10 monclient: build_initial_monmap 2024-09-13T10:40:47.989 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.988+0000 7f6f8b8ef640 10 monclient: monmap: 2024-09-13T10:40:47.989 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:47.988784+0000 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:47.988784+0000 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:47.990 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:47.991 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:47.991 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:47.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.988+0000 7f6f8b8ef640 1 Processor -- start 2024-09-13T10:40:47.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f8b8ef640 1 -- start start 2024-09-13T10:40:47.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f8b8ef640 10 monclient: init 2024-09-13T10:40:47.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f8b8ef640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:47.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f8b8ef640 10 monclient: _add_conns ranks=[1,3,8,5,0,7,6,4,2] 2024-09-13T10:40:47.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f8b8ef640 10 monclient(hunting): picked mon.noname-f con 0x7f6f840a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:47.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f8b8ef640 10 monclient(hunting): picked mon.noname-g con 0x7f6f840a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:47.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f8b8ef640 10 monclient(hunting): picked mon.noname-e con 0x7f6f8413f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:47.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f8b8ef640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f840a5fe0 con 0x7f6f840a66d0 2024-09-13T10:40:47.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f8b8ef640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f840a8080 con 0x7f6f840a6ab0 2024-09-13T10:40:47.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f8b8ef640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f840a42c0 con 0x7f6f8413f9a0 2024-09-13T10:40:47.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f8b8ef640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:47.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f8b8ef640 10 monclient(hunting): authenticate will time out at 1387.494531s 2024-09-13T10:40:47.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f89e8c640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f6f8413f9a0 0x7f6f84141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41756/0 (socket says 172.21.15.181:41756) 2024-09-13T10:40:47.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.989+0000 7f6f89e8c640 1 -- 172.21.15.181:0/31824321 learned_addr learned my addr 172.21.15.181:0/31824321 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:47.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.991+0000 7f6f89e8c640 1 -- 172.21.15.181:0/31824321 >> v1:172.21.15.181:6793/0 conn(0x7f6f8413f9a0 legacy=0x7f6f84141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.991+0000 7f6f8968b640 1 -- 172.21.15.181:0/31824321 >> v1:172.21.15.195:6789/0 conn(0x7f6f840a66d0 legacy=0x7f6f840a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f88e8a640 1 -- 172.21.15.181:0/31824321 >> v1:172.21.15.195:6790/0 conn(0x7f6f840a6ab0 legacy=0x7f6f840a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:47.997 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2826054246 0 0) 0x7f6f840a42c0 con 0x7f6f8413f9a0 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient(hunting): my global_id is 184265 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f70003520 con 0x7f6f8413f9a0 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3083846561 0 0) 0x7f6f840a5fe0 con 0x7f6f840a66d0 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient(hunting): my global_id is 135262 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f840a42c0 con 0x7f6f840a66d0 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632096692 0 0) 0x7f6f840a8080 con 0x7f6f840a6ab0 2024-09-13T10:40:47.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient(hunting): my global_id is 184206 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f840a5fe0 con 0x7f6f840a6ab0 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3743194027 0 0) 0x7f6f70003520 con 0x7f6f8413f9a0 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 >> v1:172.21.15.195:6790/0 conn(0x7f6f840a6ab0 legacy=0x7f6f840a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 >> v1:172.21.15.195:6789/0 conn(0x7f6f840a66d0 legacy=0x7f6f840a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient: _finish_hunting 0 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 monclient: found mon.noname-e 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f841464e0 con 0x7f6f8413f9a0 2024-09-13T10:40:47.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient: _finish_auth 0 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient: _check_auth_tickets 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6f7c001e50 con 0x7f6f8413f9a0 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f8b8ef640 5 monclient: authenticate success, global_id 184265 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f8b8ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient: dump: 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.000 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f8b8ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f7c004c20 con 0x7f6f8413f9a0 2024-09-13T10:40:48.001 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 1 -- 172.21.15.181:0/31824321 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6f7c005150 con 0x7f6f8413f9a0 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f8b8ef640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f8b8ef640 4 set_mon_vals no callback set 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.992+0000 7f6f7bfff640 10 monclient: dump: 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.002 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.993+0000 7f6f8b8ef640 10 monclient: shutdown 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.993+0000 7f6f8b8ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.993+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/31824321 >> v1:172.21.15.181:6793/0 conn(0x7f6f8413f9a0 legacy=0x7f6f84141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.993+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/31824321 shutdown_connections 2024-09-13T10:40:48.003 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.993+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/31824321 >> 172.21.15.181:0/31824321 conn(0x7f6f840abcd0 msgr2=0x7f6f840ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.993+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/31824321 shutdown_connections 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.993+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/31824321 wait complete. 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.993+0000 7f6f8b8ef640 10 monclient: build_initial_monmap 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.993+0000 7f6f8b8ef640 10 monclient: monmap: 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:48.004 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 1 Processor -- start 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 1 -- start start 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 10 monclient: init 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 10 monclient: _add_conns ranks=[5,3,2,0,8,6,1,4,7] 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 10 monclient(hunting): picked mon.noname-h con 0x7f6f840a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 10 monclient(hunting): picked mon.noname-g con 0x7f6f840a6ab0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:48.005 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 10 monclient(hunting): picked mon.noname-b con 0x7f6f8413f9a0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:48.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8413eff0 con 0x7f6f8413f9a0 2024-09-13T10:40:48.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8413f2d0 con 0x7f6f840a6ab0 2024-09-13T10:40:48.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f84142db0 con 0x7f6f840a66d0 2024-09-13T10:40:48.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:48.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f8b8ef640 10 monclient(hunting): authenticate will time out at 1387.499804s 2024-09-13T10:40:48.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f89e8c640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f6f8413f9a0 0x7f6f841d6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:51448/0 (socket says 172.21.15.181:51448) 2024-09-13T10:40:48.006 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.994+0000 7f6f89e8c640 1 -- 172.21.15.181:0/1121835289 learned_addr learned my addr 172.21.15.181:0/1121835289 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:48.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.996+0000 7f6f89e8c640 1 -- 172.21.15.181:0/1121835289 >> v1:172.21.15.181:6790/0 conn(0x7f6f8413f9a0 legacy=0x7f6f841d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f88e8a640 1 -- 172.21.15.181:0/1121835289 >> v1:172.21.15.195:6790/0 conn(0x7f6f840a6ab0 legacy=0x7f6f841d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f8968b640 1 -- 172.21.15.181:0/1121835289 >> v1:172.21.15.195:6791/0 conn(0x7f6f840a66d0 legacy=0x7f6f841ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217070766 0 0) 0x7f6f8413eff0 con 0x7f6f8413f9a0 2024-09-13T10:40:48.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): my global_id is 174485 2024-09-13T10:40:48.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f68003520 con 0x7f6f8413f9a0 2024-09-13T10:40:48.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457473633 0 0) 0x7f6f8413f2d0 con 0x7f6f840a6ab0 2024-09-13T10:40:48.010 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): my global_id is 184215 2024-09-13T10:40:48.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f8413eff0 con 0x7f6f840a6ab0 2024-09-13T10:40:48.011 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029940027 0 0) 0x7f6f84142db0 con 0x7f6f840a66d0 2024-09-13T10:40:48.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): my global_id is 106205 2024-09-13T10:40:48.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f8413f2d0 con 0x7f6f840a66d0 2024-09-13T10:40:48.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4034415016 0 0) 0x7f6f68003520 con 0x7f6f8413f9a0 2024-09-13T10:40:48.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f84142db0 con 0x7f6f8413f9a0 2024-09-13T10:40:48.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6f7c0020a0 con 0x7f6f8413f9a0 2024-09-13T10:40:48.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:48.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:40:48.012 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): dump: 2024-09-13T10:40:48.012 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.013 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.3 v1:172.21.15.195:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 168131381 0 0) 0x7f6f8413eff0 con 0x7f6f840a6ab0 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 --> v1:172.21.15.195:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f68003520 con 0x7f6f840a6ab0 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.3 v1:172.21.15.195:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6f74001d10 con 0x7f6f840a6ab0 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient(hunting): dump: 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.014 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2898692904 0 0) 0x7f6f84142db0 con 0x7f6f8413f9a0 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 >> v1:172.21.15.195:6791/0 conn(0x7f6f840a66d0 legacy=0x7f6f841ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 >> v1:172.21.15.195:6790/0 conn(0x7f6f840a6ab0 legacy=0x7f6f841d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.015 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 monclient: found mon.b 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f84068680 con 0x7f6f8413f9a0 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient: _finish_auth 0 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f8b8ef640 5 monclient: authenticate success, global_id 174485 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f8b8ef640 10 monclient: _renew_subs 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f8b8ef640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/1121835289 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8413ed10 con 0x7f6f8413f9a0 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f7c0053c0 con 0x7f6f8413f9a0 2024-09-13T10:40:48.016 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f6f7c0058b0 con 0x7f6f8413f9a0 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f79ffb640 10 monclient: dump: 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.017 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f8b8ef640 10 monclient: _renew_subs 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f7b7fe640 4 set_mon_vals no callback set 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f8b8ef640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.997+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/1121835289 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f8413c530 con 0x7f6f8413f9a0 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.998+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f6f7c011f30 con 0x7f6f8413f9a0 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.998+0000 7f6f8b8ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.998+0000 7f6f8b8ef640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:48.018 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.998+0000 7f6f8b8ef640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:48.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.998+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/1121835289 --> v1:172.21.15.181:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f8406cab0 con 0x7f6f8413f9a0 2024-09-13T10:40:48.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.998+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f6f7c04e440 con 0x7f6f8413f9a0 2024-09-13T10:40:48.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:47.999+0000 7f6f8968b640 10 monclient: get_auth_request con 0x7f6f680400c0 auth_method 0 2024-09-13T10:40:48.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.003+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f6f8406cab0 con 0x7f6f8413f9a0 2024-09-13T10:40:48.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.003+0000 7f6f79ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:48.019 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.003+0000 7f6f79ffb640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:48.179 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.177+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/1121835289 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f6f8413d410 con 0x7f6f680400c0 2024-09-13T10:40:48.180 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.178+0000 7f6f79ffb640 1 -- 172.21.15.181:0/1121835289 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f6f8413d410 con 0x7f6f680400c0 2024-09-13T10:40:48.180 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T10:40:48.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.180+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/1121835289 >> v1:172.21.15.195:6800/1839191919 conn(0x7f6f680400c0 legacy=0x7f6f68042580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.180+0000 7f6f8b8ef640 10 monclient: shutdown 2024-09-13T10:40:48.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.180+0000 7f6f8b8ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:48.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.180+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/1121835289 >> v1:172.21.15.181:6790/0 conn(0x7f6f8413f9a0 legacy=0x7f6f841d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.180+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/1121835289 shutdown_connections 2024-09-13T10:40:48.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.180+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/1121835289 >> 172.21.15.181:0/1121835289 conn(0x7f6f840abcd0 msgr2=0x7f6f840a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:48.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.180+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/1121835289 shutdown_connections 2024-09-13T10:40:48.182 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.180+0000 7f6f8b8ef640 1 -- 172.21.15.181:0/1121835289 wait complete. 2024-09-13T10:40:48.192 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T10:40:48.192 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T10:40:48.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.292+0000 7f722a7a4640 10 monclient: get_monmap_and_config 2024-09-13T10:40:48.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.292+0000 7f722a7a4640 10 monclient: build_initial_monmap 2024-09-13T10:40:48.294 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.292+0000 7f722a7a4640 10 monclient: monmap: 2024-09-13T10:40:48.294 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:48.294 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.294 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:48.293387+0000 2024-09-13T10:40:48.294 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:48.293387+0000 2024-09-13T10:40:48.294 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:48.294 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.295 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:48.295 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:48.295 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:48.295 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:48.295 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:48.295 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:48.295 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:48.295 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:48.295 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:48.295 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.293+0000 7f722a7a4640 1 Processor -- start 2024-09-13T10:40:48.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.293+0000 7f722a7a4640 1 -- start start 2024-09-13T10:40:48.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.293+0000 7f722a7a4640 10 monclient: init 2024-09-13T10:40:48.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f722a7a4640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:48.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f722a7a4640 10 monclient: _add_conns ranks=[6,0,3,2,7,8,5,1,4] 2024-09-13T10:40:48.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f722a7a4640 10 monclient(hunting): picked mon.noname-d con 0x7f72240a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:48.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f722a7a4640 10 monclient(hunting): picked mon.noname-a con 0x7f72240a82d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:48.297 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f722a7a4640 10 monclient(hunting): picked mon.noname-g con 0x7f722413f7c0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f722a7a4640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72240a4bc0 con 0x7f72240a82d0 2024-09-13T10:40:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f722a7a4640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72240a2f40 con 0x7f722413f7c0 2024-09-13T10:40:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f722a7a4640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72240a8090 con 0x7f72240a66d0 2024-09-13T10:40:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f722a7a4640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f722a7a4640 10 monclient(hunting): authenticate will time out at 1387.799372s 2024-09-13T10:40:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f7223fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f72240a66d0 0x7f72240a6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55334/0 (socket says 172.21.15.181:55334) 2024-09-13T10:40:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f7223fff640 1 -- 172.21.15.181:0/3472863965 learned_addr learned my addr 172.21.15.181:0/3472863965 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:48.298 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.294+0000 7f721bfff640 1 --1- 172.21.15.181:0/3472863965 >> v1:172.21.15.181:6789/0 conn(0x7f72240a82d0 0x7f72240a71c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50832/0 (socket says 172.21.15.181:50832) 2024-09-13T10:40:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f7223fff640 1 -- 172.21.15.181:0/3472863965 >> v1:172.21.15.181:6792/0 conn(0x7f72240a66d0 legacy=0x7f72240a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f721bfff640 1 -- 172.21.15.181:0/3472863965 >> v1:172.21.15.181:6789/0 conn(0x7f72240a82d0 legacy=0x7f72240a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.302 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f72237fe640 1 -- 172.21.15.181:0/3472863965 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545109673 0 0) 0x7f72240a8090 con 0x7f72240a66d0 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f72237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f72237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f72237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f72237fe640 10 monclient(hunting): my global_id is 174516 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f72237fe640 1 -- 172.21.15.181:0/3472863965 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7210003520 con 0x7f72240a66d0 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f72237fe640 1 -- 172.21.15.181:0/3472863965 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216959772 0 0) 0x7f72240a4bc0 con 0x7f72240a82d0 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f72237fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f72237fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f72237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f72237fe640 10 monclient(hunting): my global_id is 184230 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f72237fe640 1 -- 172.21.15.181:0/3472863965 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72240a8090 con 0x7f72240a82d0 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.296+0000 7f7228d41640 1 -- 172.21.15.181:0/3472863965 >> v1:172.21.15.195:6790/0 conn(0x7f722413f7c0 legacy=0x7f7224141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 1 -- 172.21.15.181:0/3472863965 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3240604719 0 0) 0x7f72240a8090 con 0x7f72240a82d0 2024-09-13T10:40:48.303 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 1 -- 172.21.15.181:0/3472863965 >> v1:172.21.15.181:6792/0 conn(0x7f72240a66d0 legacy=0x7f72240a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 1 -- 172.21.15.181:0/3472863965 >> v1:172.21.15.195:6790/0 conn(0x7f722413f7c0 legacy=0x7f7224141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 10 monclient: _finish_hunting 0 2024-09-13T10:40:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 1 monclient: found mon.noname-a 2024-09-13T10:40:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:40:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 1 -- 172.21.15.181:0/3472863965 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72240a48e0 con 0x7f72240a82d0 2024-09-13T10:40:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 10 monclient: _finish_auth 0 2024-09-13T10:40:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 10 monclient: _check_auth_tickets 2024-09-13T10:40:48.304 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 1 -- 172.21.15.181:0/3472863965 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f720c001ac0 con 0x7f72240a82d0 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f722a7a4640 5 monclient: authenticate success, global_id 184230 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f722a7a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 10 monclient: dump: 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.305 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f722a7a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 1 -- 172.21.15.181:0/3472863965 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f720c0047e0 con 0x7f72240a82d0 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 1 -- 172.21.15.181:0/3472863965 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f720c004d10 con 0x7f72240a82d0 2024-09-13T10:40:48.306 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f722a7a4640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f722a7a4640 4 set_mon_vals no callback set 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f72237fe640 10 monclient: dump: 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.307 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f722a7a4640 10 monclient: shutdown 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f722a7a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f722a7a4640 1 -- 172.21.15.181:0/3472863965 >> v1:172.21.15.181:6789/0 conn(0x7f72240a82d0 legacy=0x7f72240a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f722a7a4640 1 -- 172.21.15.181:0/3472863965 shutdown_connections 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f722a7a4640 1 -- 172.21.15.181:0/3472863965 >> 172.21.15.181:0/3472863965 conn(0x7f72240abcd0 msgr2=0x7f72240ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f722a7a4640 1 -- 172.21.15.181:0/3472863965 shutdown_connections 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.297+0000 7f722a7a4640 1 -- 172.21.15.181:0/3472863965 wait complete. 2024-09-13T10:40:48.308 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.298+0000 7f722a7a4640 10 monclient: build_initial_monmap 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.298+0000 7f722a7a4640 10 monclient: monmap: 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:48.309 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.298+0000 7f722a7a4640 1 Processor -- start 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.298+0000 7f722a7a4640 1 -- start start 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.298+0000 7f722a7a4640 10 monclient: init 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.299+0000 7f722a7a4640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.299+0000 7f722a7a4640 10 monclient: _add_conns ranks=[2,1,4,5,8,6,0,7,3] 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.299+0000 7f722a7a4640 10 monclient(hunting): picked mon.noname-b con 0x7f72240a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.299+0000 7f722a7a4640 10 monclient(hunting): picked mon.noname-f con 0x7f72240a82d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.299+0000 7f722a7a4640 10 monclient(hunting): picked mon.noname-c con 0x7f722413f7c0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.299+0000 7f722a7a4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7224134cc0 con 0x7f72240a82d0 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.299+0000 7f722a7a4640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72241cf160 con 0x7f72240a66d0 2024-09-13T10:40:48.310 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.299+0000 7f722a7a4640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72240a1650 con 0x7f722413f7c0 2024-09-13T10:40:48.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.299+0000 7f722a7a4640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:48.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.299+0000 7f722a7a4640 10 monclient(hunting): authenticate will time out at 1387.804189s 2024-09-13T10:40:48.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.299+0000 7f7223fff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f72240a66d0 0x7f72241ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:51452/0 (socket says 172.21.15.181:51452) 2024-09-13T10:40:48.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.299+0000 7f7223fff640 1 -- 172.21.15.181:0/2700266834 learned_addr learned my addr 172.21.15.181:0/2700266834 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:48.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.301+0000 7f7223fff640 1 -- 172.21.15.181:0/2700266834 >> v1:172.21.15.181:6790/0 conn(0x7f72240a66d0 legacy=0x7f72241ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.301+0000 7f7228d41640 1 -- 172.21.15.181:0/2700266834 >> v1:172.21.15.181:6791/0 conn(0x7f722413f7c0 legacy=0x7f72241d65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.301+0000 7f721bfff640 1 -- 172.21.15.181:0/2700266834 >> v1:172.21.15.195:6789/0 conn(0x7f72240a82d0 legacy=0x7f72241cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.311 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.301+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:40:48.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3676539300 0 0) 0x7f72240a1650 con 0x7f722413f7c0 2024-09-13T10:40:48.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 10 monclient(hunting): my global_id is 174550 2024-09-13T10:40:48.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7204003520 con 0x7f722413f7c0 2024-09-13T10:40:48.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025157002 0 0) 0x7f72241cf160 con 0x7f72240a66d0 2024-09-13T10:40:48.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 10 monclient(hunting): my global_id is 174494 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72240a1650 con 0x7f72240a66d0 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 769396812 0 0) 0x7f7224134cc0 con 0x7f72240a82d0 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 10 monclient(hunting): my global_id is 135271 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72241cf160 con 0x7f72240a82d0 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4054487750 0 0) 0x7f72240a1650 con 0x7f72240a66d0 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7224134cc0 con 0x7f72240a66d0 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.303+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3011370671 0 0) 0x7f7204003520 con 0x7f722413f7c0 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72240a1650 con 0x7f722413f7c0 2024-09-13T10:40:48.316 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f72140047e0 con 0x7f72240a66d0 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient(hunting): dump: 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.317 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f721c002030 con 0x7f722413f7c0 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient(hunting): dump: 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.318 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1808896180 0 0) 0x7f72241cf160 con 0x7f72240a82d0 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 --> v1:172.21.15.195:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7204003520 con 0x7f72240a82d0 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f720c004cd0 con 0x7f72240a82d0 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient(hunting): dump: 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.320 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.2 v1:172.21.15.181:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4232925827 0 0) 0x7f7224134cc0 con 0x7f72240a66d0 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 >> v1:172.21.15.181:6791/0 conn(0x7f722413f7c0 legacy=0x7f72241d65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 >> v1:172.21.15.195:6789/0 conn(0x7f72240a82d0 legacy=0x7f72241cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient: _finish_hunting 0 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 monclient: found mon.b 2024-09-13T10:40:48.321 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 --> v1:172.21.15.181:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7224143050 con 0x7f72240a66d0 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient: _finish_auth 0 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient: _check_auth_tickets 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f722a7a4640 5 monclient: authenticate success, global_id 174494 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f722a7a4640 10 monclient: _renew_subs 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f722a7a4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f722a7a4640 1 -- 172.21.15.181:0/2700266834 --> v1:172.21.15.181:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f72240aade0 con 0x7f72240a66d0 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f722a7a4640 10 monclient: _renew_subs 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f722a7a4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f722a7a4640 1 -- 172.21.15.181:0/2700266834 --> v1:172.21.15.181:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f72240a29f0 con 0x7f72240a66d0 2024-09-13T10:40:48.322 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.2 v1:172.21.15.181:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7214004ca0 con 0x7f72240a66d0 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.2 v1:172.21.15.181:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f72140051d0 con 0x7f72240a66d0 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f7222ffd640 4 set_mon_vals no callback set 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.304+0000 7f72217fa640 10 monclient: dump: 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.323 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.305+0000 7f722a7a4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.181:6790/0 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.305+0000 7f722a7a4640 1 -- 172.21.15.181:0/2700266834 --> v1:172.21.15.181:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f7208000f80 con 0x7f72240a66d0 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.305+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.2 v1:172.21.15.181:6790/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f7214005370 con 0x7f72240a66d0 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.305+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.2 v1:172.21.15.181:6790/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f721404e040 con 0x7f72240a66d0 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.305+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 --> v1:172.21.15.181:6808/3162343005 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f720404ad70 con 0x7f7204047100 2024-09-13T10:40:48.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.305+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== mon.2 v1:172.21.15.181:6790/0 9 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (unknown 1450749824 0 0) 0x7f721404e4b0 con 0x7f72240a66d0 2024-09-13T10:40:48.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.305+0000 7f72217fa640 10 monclient: handle_get_version_reply finishing 1 version 331 2024-09-13T10:40:48.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.305+0000 7f7228d41640 10 monclient: get_auth_request con 0x7f7204047100 auth_method 0 2024-09-13T10:40:48.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.305+0000 7f721bfff640 10 monclient: get_auth_request con 0x7f7204040470 auth_method 0 2024-09-13T10:40:48.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.310+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== osd.2 v1:172.21.15.181:6808/3162343005 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f720404ad70 con 0x7f7204047100 2024-09-13T10:40:48.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.323+0000 7f722a7a4640 1 -- 172.21.15.181:0/2700266834 --> v1:172.21.15.181:6808/3162343005 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7208002cd0 con 0x7f7204047100 2024-09-13T10:40:48.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.323+0000 7f72217fa640 1 -- 172.21.15.181:0/2700266834 <== osd.2 v1:172.21.15.181:6808/3162343005 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f7208002cd0 con 0x7f7204047100 2024-09-13T10:40:48.326 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:48.326 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T10:40:48.326 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.323+0000 7f722a7a4640 1 -- 172.21.15.181:0/2700266834 >> v1:172.21.15.181:6808/3162343005 conn(0x7f7204047100 legacy=0x7f7204049520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.323+0000 7f722a7a4640 1 -- 172.21.15.181:0/2700266834 >> v1:172.21.15.195:6800/1839191919 conn(0x7f7204040470 legacy=0x7f7204042930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.323+0000 7f722a7a4640 10 monclient: shutdown 2024-09-13T10:40:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.323+0000 7f722a7a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.323+0000 7f722a7a4640 1 -- 172.21.15.181:0/2700266834 >> v1:172.21.15.181:6790/0 conn(0x7f72240a66d0 legacy=0x7f72241ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.323+0000 7f7228d41640 1 -- 172.21.15.181:0/2700266834 reap_dead start 2024-09-13T10:40:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.323+0000 7f722a7a4640 1 -- 172.21.15.181:0/2700266834 shutdown_connections 2024-09-13T10:40:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.323+0000 7f722a7a4640 1 -- 172.21.15.181:0/2700266834 >> 172.21.15.181:0/2700266834 conn(0x7f72240abcd0 msgr2=0x7f72240a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.323+0000 7f722a7a4640 1 -- 172.21.15.181:0/2700266834 shutdown_connections 2024-09-13T10:40:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.323+0000 7f722a7a4640 1 -- 172.21.15.181:0/2700266834 wait complete. 2024-09-13T10:40:48.335 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T10:40:48.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.433+0000 7febc2df8640 10 monclient: get_monmap_and_config 2024-09-13T10:40:48.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.433+0000 7febc2df8640 10 monclient: build_initial_monmap 2024-09-13T10:40:48.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.433+0000 7febc2df8640 10 monclient: monmap: 2024-09-13T10:40:48.434 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:48.433718+0000 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:48.433718+0000 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:48.435 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:48.436 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.433+0000 7febc2df8640 1 Processor -- start 2024-09-13T10:40:48.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.433+0000 7febc2df8640 1 -- start start 2024-09-13T10:40:48.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.433+0000 7febc2df8640 10 monclient: init 2024-09-13T10:40:48.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febc2df8640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:48.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febc2df8640 10 monclient: _add_conns ranks=[6,0,8,1,2,5,7,4,3] 2024-09-13T10:40:48.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febc2df8640 10 monclient(hunting): picked mon.noname-d con 0x7febbc0a66d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:48.437 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febc2df8640 10 monclient(hunting): picked mon.noname-a con 0x7febbc0a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:48.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febc2df8640 10 monclient(hunting): picked mon.noname-e con 0x7febbc13f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:48.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febc2df8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febbc0a5fe0 con 0x7febbc0a6ab0 2024-09-13T10:40:48.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febc2df8640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febbc0a8080 con 0x7febbc0a66d0 2024-09-13T10:40:48.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febc2df8640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febbc0a42c0 con 0x7febbc13f9a0 2024-09-13T10:40:48.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febc2df8640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:48.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febc2df8640 10 monclient(hunting): authenticate will time out at 1387.939391s 2024-09-13T10:40:48.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febb3fff640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7febbc0a6ab0 0x7febbc0a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50848/0 (socket says 172.21.15.181:50848) 2024-09-13T10:40:48.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febb3fff640 1 -- 172.21.15.181:0/3442018795 learned_addr learned my addr 172.21.15.181:0/3442018795 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:48.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febc1395640 1 --1- 172.21.15.181:0/3442018795 >> v1:172.21.15.181:6793/0 conn(0x7febbc13f9a0 0x7febbc141d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41766/0 (socket says 172.21.15.181:41766) 2024-09-13T10:40:48.438 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.434+0000 7febc0b94640 1 --1- 172.21.15.181:0/3442018795 >> v1:172.21.15.181:6792/0 conn(0x7febbc0a66d0 0x7febbc0a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55350/0 (socket says 172.21.15.181:55350) 2024-09-13T10:40:48.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb3fff640 1 -- 172.21.15.181:0/3442018795 >> v1:172.21.15.181:6789/0 conn(0x7febbc0a6ab0 legacy=0x7febbc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febc0b94640 1 -- 172.21.15.181:0/3442018795 >> v1:172.21.15.181:6792/0 conn(0x7febbc0a66d0 legacy=0x7febbc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febc1395640 1 -- 172.21.15.181:0/3442018795 >> v1:172.21.15.181:6793/0 conn(0x7febbc13f9a0 legacy=0x7febbc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430403023 0 0) 0x7febbc0a5fe0 con 0x7febbc0a6ab0 2024-09-13T10:40:48.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 10 monclient(hunting): my global_id is 184239 2024-09-13T10:40:48.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feba4003520 con 0x7febbc0a6ab0 2024-09-13T10:40:48.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3707422871 0 0) 0x7febbc0a8080 con 0x7febbc0a66d0 2024-09-13T10:40:48.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.442 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 10 monclient(hunting): my global_id is 174525 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febbc0a5fe0 con 0x7febbc0a66d0 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3575764304 0 0) 0x7febbc0a42c0 con 0x7febbc13f9a0 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 10 monclient(hunting): my global_id is 184274 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.436+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febbc0a8080 con 0x7febbc13f9a0 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb3fff640 1 --1- 172.21.15.181:0/3442018795 >> v1:172.21.15.181:6789/0 conn(0x7febbc0a6ab0 0x7febbc0a6ec0 :-1 s=OPENED pgs=734 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7febac001ad0 mon_map magic: 0 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 618716419 0 0) 0x7febbc0a5fe0 con 0x7febbc0a66d0 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 >> v1:172.21.15.181:6793/0 conn(0x7febbc13f9a0 legacy=0x7febbc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 >> v1:172.21.15.181:6789/0 conn(0x7febbc0a6ab0 legacy=0x7febbc0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.443 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 10 monclient: _finish_hunting 0 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 1 monclient: found mon.noname-d 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febbc1464e0 con 0x7febbc0a66d0 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 10 monclient: _finish_auth 0 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 10 monclient: _check_auth_tickets 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7febb8001ac0 con 0x7febbc0a66d0 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 10 monclient: dump: 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.444 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.445 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7febac001ad0 con 0x7febbc0a6ab0 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febc2df8640 5 monclient: authenticate success, global_id 174525 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febc2df8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 10 monclient: discarding stray monitor message mon_map magic: 0 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7febb80047e0 con 0x7febbc0a66d0 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 1 -- 172.21.15.181:0/3442018795 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7febb8004d50 con 0x7febbc0a66d0 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febc2df8640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febc2df8640 4 set_mon_vals no callback set 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febb37fe640 10 monclient: dump: 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.446 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.447 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febc2df8640 10 monclient: shutdown 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febc2df8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febc2df8640 1 -- 172.21.15.181:0/3442018795 >> v1:172.21.15.181:6792/0 conn(0x7febbc0a66d0 legacy=0x7febbc0a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febc2df8640 1 -- 172.21.15.181:0/3442018795 shutdown_connections 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febc2df8640 1 -- 172.21.15.181:0/3442018795 >> 172.21.15.181:0/3442018795 conn(0x7febbc0abcd0 msgr2=0x7febbc0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febc2df8640 1 -- 172.21.15.181:0/3442018795 shutdown_connections 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.437+0000 7febc2df8640 1 -- 172.21.15.181:0/3442018795 wait complete. 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.438+0000 7febc2df8640 10 monclient: build_initial_monmap 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.438+0000 7febc2df8640 10 monclient: monmap: 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:48.448 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.438+0000 7febc2df8640 1 Processor -- start 2024-09-13T10:40:48.449 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.438+0000 7febc2df8640 1 -- start start 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.438+0000 7febc2df8640 10 monclient: init 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.439+0000 7febc2df8640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.439+0000 7febc2df8640 10 monclient: _add_conns ranks=[3,7,6,0,1,8,2,5,4] 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.439+0000 7febc2df8640 10 monclient(hunting): picked mon.noname-g con 0x7febbc0a66d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.439+0000 7febc2df8640 10 monclient(hunting): picked mon.noname-i con 0x7febbc0a6ab0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.439+0000 7febc2df8640 10 monclient(hunting): picked mon.noname-d con 0x7febbc13f9a0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.439+0000 7febc2df8640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febbc13dd60 con 0x7febbc0a66d0 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.439+0000 7febc2df8640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febbc09cf50 con 0x7febbc13f9a0 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.439+0000 7febc2df8640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febbc09ccb0 con 0x7febbc0a6ab0 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.439+0000 7febc2df8640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.439+0000 7febc2df8640 10 monclient(hunting): authenticate will time out at 1387.944400s 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.439+0000 7febc1395640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7febbc13f9a0 0x7febbc1d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55358/0 (socket says 172.21.15.181:55358) 2024-09-13T10:40:48.450 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.439+0000 7febc1395640 1 -- 172.21.15.181:0/1186468507 learned_addr learned my addr 172.21.15.181:0/1186468507 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:48.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.441+0000 7febc1395640 1 -- 172.21.15.181:0/1186468507 >> v1:172.21.15.181:6792/0 conn(0x7febbc13f9a0 legacy=0x7febbc1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.441+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401695844 0 0) 0x7febbc09cf50 con 0x7febbc13f9a0 2024-09-13T10:40:48.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.441+0000 7febb17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.441+0000 7febb17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.453 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.441+0000 7febb17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.441+0000 7febb17fa640 10 monclient(hunting): my global_id is 174534 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.441+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feba8003550 con 0x7febbc13f9a0 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.441+0000 7febc0b94640 1 -- 172.21.15.181:0/1186468507 >> v1:172.21.15.195:6790/0 conn(0x7febbc0a66d0 legacy=0x7febbc13c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.441+0000 7febb3fff640 1 -- 172.21.15.181:0/1186468507 >> v1:172.21.15.195:6792/0 conn(0x7febbc0a6ab0 legacy=0x7febbc13ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.441+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2660519083 0 0) 0x7feba8003550 con 0x7febbc13f9a0 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7febbc09cf50 con 0x7febbc13f9a0 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7febb4002060 con 0x7febbc13f9a0 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient(hunting): dump: 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.454 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.455 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:48.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244445604 0 0) 0x7febbc13dd60 con 0x7febbc0a66d0 2024-09-13T10:40:48.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient(hunting): my global_id is 184233 2024-09-13T10:40:48.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feba8003550 con 0x7febbc0a66d0 2024-09-13T10:40:48.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182463530 0 0) 0x7febbc09ccb0 con 0x7febbc0a6ab0 2024-09-13T10:40:48.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.456 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient(hunting): my global_id is 58237 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febbc13dd60 con 0x7febbc0a6ab0 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 233159216 0 0) 0x7febbc09cf50 con 0x7febbc13f9a0 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 >> v1:172.21.15.195:6792/0 conn(0x7febbc0a6ab0 legacy=0x7febbc13ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 >> v1:172.21.15.195:6790/0 conn(0x7febbc0a66d0 legacy=0x7febbc13c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient: _finish_hunting 0 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 monclient: found mon.d 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febbc139390 con 0x7febbc13f9a0 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient: _finish_auth 0 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient: _check_auth_tickets 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febc2df8640 5 monclient: authenticate success, global_id 174534 2024-09-13T10:40:48.457 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febc2df8640 10 monclient: _renew_subs 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febc2df8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febc2df8640 1 -- 172.21.15.181:0/1186468507 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7febbc13eb90 con 0x7febbc13f9a0 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febc2df8640 10 monclient: _renew_subs 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febc2df8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febc2df8640 1 -- 172.21.15.181:0/1186468507 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7febbc13d400 con 0x7febbc13f9a0 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7febb4004ec0 con 0x7febbc13f9a0 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7febb40053f0 con 0x7febbc13f9a0 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb2ffd640 4 set_mon_vals no callback set 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.442+0000 7febb17fa640 10 monclient: dump: 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.458 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.459 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.443+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7febb4005690 con 0x7febbc13f9a0 2024-09-13T10:40:48.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.443+0000 7febc2df8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:48.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.443+0000 7febc2df8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:48.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.443+0000 7febc2df8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:48.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.443+0000 7febc2df8640 1 -- 172.21.15.181:0/1186468507 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb9c005080 con 0x7febbc13f9a0 2024-09-13T10:40:48.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.443+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7febb404e560 con 0x7febbc13f9a0 2024-09-13T10:40:48.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.443+0000 7febc0b94640 10 monclient: get_auth_request con 0x7feba803fca0 auth_method 0 2024-09-13T10:40:48.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.447+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7febb4017b70 con 0x7febbc13f9a0 2024-09-13T10:40:48.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.448+0000 7febb17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:48.460 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.448+0000 7febb17fa640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:48.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.621+0000 7febc2df8640 1 -- 172.21.15.181:0/1186468507 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7feb9c000b90 con 0x7feba803fca0 2024-09-13T10:40:48.622 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.621+0000 7febb17fa640 1 -- 172.21.15.181:0/1186468507 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7feb9c000b90 con 0x7feba803fca0 2024-09-13T10:40:48.622 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T10:40:48.623 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=398988454}) 2024-09-13T10:40:48.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1542100098}) 2024-09-13T10:40:48.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=398988454}) 2024-09-13T10:40:48.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2994986287}) 2024-09-13T10:40:48.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=398988454}) 2024-09-13T10:40:48.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1326490318}) 2024-09-13T10:40:48.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=398988454}) 2024-09-13T10:40:48.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3173168718}) 2024-09-13T10:40:48.624 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=398988454}) 2024-09-13T10:40:48.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3568468861}) 2024-09-13T10:40:48.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=398988454}) 2024-09-13T10:40:48.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3502742527}) 2024-09-13T10:40:48.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=398988454}) 2024-09-13T10:40:48.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1453344292}) 2024-09-13T10:40:48.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=398988454}) 2024-09-13T10:40:48.625 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.621+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4239998520}) 2024-09-13T10:40:48.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.623+0000 7febc2df8640 1 -- 172.21.15.181:0/1186468507 >> v1:172.21.15.195:6800/1839191919 conn(0x7feba803fca0 legacy=0x7feba8042160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.623+0000 7febc2df8640 10 monclient: shutdown 2024-09-13T10:40:48.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.623+0000 7febc2df8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:48.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.623+0000 7febc2df8640 1 -- 172.21.15.181:0/1186468507 >> v1:172.21.15.181:6792/0 conn(0x7febbc13f9a0 legacy=0x7febbc1d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.623+0000 7febc2df8640 1 -- 172.21.15.181:0/1186468507 shutdown_connections 2024-09-13T10:40:48.626 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.623+0000 7febc2df8640 1 -- 172.21.15.181:0/1186468507 >> 172.21.15.181:0/1186468507 conn(0x7febbc0abcd0 msgr2=0x7febbc0a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:48.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.623+0000 7febc2df8640 1 -- 172.21.15.181:0/1186468507 shutdown_connections 2024-09-13T10:40:48.627 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.623+0000 7febc2df8640 1 -- 172.21.15.181:0/1186468507 wait complete. 2024-09-13T10:40:48.636 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T10:40:48.636 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T10:40:48.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4246053560}) 2024-09-13T10:40:48.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3024142654}) 2024-09-13T10:40:48.652 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4246053560}) 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=415325963}) 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4246053560}) 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2534581568}) 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4246053560}) 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1141005529}) 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4246053560}) 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1124346191}) 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4246053560}) 2024-09-13T10:40:48.653 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3839774340}) 2024-09-13T10:40:48.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4246053560}) 2024-09-13T10:40:48.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1581406217}) 2024-09-13T10:40:48.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4246053560}) 2024-09-13T10:40:48.654 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.649+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1547699538}) 2024-09-13T10:40:48.658 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2444001929}) 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1138867456}) 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2444001929}) 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4060349058}) 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2444001929}) 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=467020196}) 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2444001929}) 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3999493102}) 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2444001929}) 2024-09-13T10:40:48.659 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2341981802}) 2024-09-13T10:40:48.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2444001929}) 2024-09-13T10:40:48.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=910142088}) 2024-09-13T10:40:48.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2444001929}) 2024-09-13T10:40:48.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=973355160}) 2024-09-13T10:40:48.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2444001929}) 2024-09-13T10:40:48.660 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.656+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2496282369}) 2024-09-13T10:40:48.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=72012626}) 2024-09-13T10:40:48.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3808177530}) 2024-09-13T10:40:48.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.670 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=72012626}) 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=251486078}) 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=72012626}) 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3386143292}) 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=72012626}) 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=994878091}) 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=72012626}) 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2706853647}) 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=72012626}) 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4135706277}) 2024-09-13T10:40:48.671 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=72012626}) 2024-09-13T10:40:48.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1236658421}) 2024-09-13T10:40:48.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=72012626}) 2024-09-13T10:40:48.672 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.667+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3714059876}) 2024-09-13T10:40:48.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.741+0000 7f0adb110640 10 monclient: get_monmap_and_config 2024-09-13T10:40:48.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.741+0000 7f0adb110640 10 monclient: build_initial_monmap 2024-09-13T10:40:48.743 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.741+0000 7f0adb110640 10 monclient: monmap: 2024-09-13T10:40:48.743 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:48.743 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.743 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:48.742259+0000 2024-09-13T10:40:48.743 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:48.742259+0000 2024-09-13T10:40:48.743 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:48.743 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.743 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:48.743 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:48.743 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:48.744 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:48.744 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:48.744 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:48.744 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:48.744 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:48.744 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:48.744 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 1 Processor -- start 2024-09-13T10:40:48.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 1 -- start start 2024-09-13T10:40:48.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 10 monclient: init 2024-09-13T10:40:48.745 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:48.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 10 monclient: _add_conns ranks=[6,1,0,2,5,8,7,4,3] 2024-09-13T10:40:48.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 10 monclient(hunting): picked mon.noname-d con 0x7f0ad40a4e60 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:48.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 10 monclient(hunting): picked mon.noname-f con 0x7f0ad40a6de0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:48.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 10 monclient(hunting): picked mon.noname-a con 0x7f0ad40a71f0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:48.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad40a3240 con 0x7f0ad40a71f0 2024-09-13T10:40:48.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad40a82c0 con 0x7f0ad40a6de0 2024-09-13T10:40:48.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad40a40c0 con 0x7f0ad40a4e60 2024-09-13T10:40:48.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:48.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.742+0000 7f0adb110640 10 monclient(hunting): authenticate will time out at 1388.247947s 2024-09-13T10:40:48.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.743+0000 7f0ad96ad640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0ad40a71f0 0x7f0ad4141e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50856/0 (socket says 172.21.15.181:50856) 2024-09-13T10:40:48.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.743+0000 7f0ad96ad640 1 -- 172.21.15.181:0/1997817728 learned_addr learned my addr 172.21.15.181:0/1997817728 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:48.746 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.743+0000 7f0ad8eac640 1 --1- 172.21.15.181:0/1997817728 >> v1:172.21.15.181:6792/0 conn(0x7f0ad40a4e60 0x7f0ad40a66d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55364/0 (socket says 172.21.15.181:55364) 2024-09-13T10:40:48.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad96ad640 1 -- 172.21.15.181:0/1997817728 >> v1:172.21.15.181:6789/0 conn(0x7f0ad40a71f0 legacy=0x7f0ad4141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad8eac640 1 -- 172.21.15.181:0/1997817728 >> v1:172.21.15.181:6792/0 conn(0x7f0ad40a4e60 legacy=0x7f0ad40a66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad3fff640 1 -- 172.21.15.181:0/1997817728 >> v1:172.21.15.195:6789/0 conn(0x7f0ad40a6de0 legacy=0x7f0ad413e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 1 -- 172.21.15.181:0/1997817728 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231509000 0 0) 0x7f0ad40a40c0 con 0x7f0ad40a4e60 2024-09-13T10:40:48.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient(hunting): my global_id is 174543 2024-09-13T10:40:48.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 1 -- 172.21.15.181:0/1997817728 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ac4003520 con 0x7f0ad40a4e60 2024-09-13T10:40:48.750 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 1 -- 172.21.15.181:0/1997817728 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 550133495 0 0) 0x7f0ad40a3240 con 0x7f0ad40a71f0 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient(hunting): my global_id is 184248 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 1 -- 172.21.15.181:0/1997817728 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ad40a40c0 con 0x7f0ad40a71f0 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 1 -- 172.21.15.181:0/1997817728 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 255839933 0 0) 0x7f0ad40a40c0 con 0x7f0ad40a71f0 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 1 -- 172.21.15.181:0/1997817728 >> v1:172.21.15.181:6792/0 conn(0x7f0ad40a4e60 legacy=0x7f0ad40a66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 1 -- 172.21.15.181:0/1997817728 >> v1:172.21.15.195:6789/0 conn(0x7f0ad40a6de0 legacy=0x7f0ad413e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient: _finish_hunting 0 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 1 monclient: found mon.noname-a 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 1 -- 172.21.15.181:0/1997817728 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad40a43a0 con 0x7f0ad40a71f0 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient: _finish_auth 0 2024-09-13T10:40:48.751 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient: _check_auth_tickets 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 1 -- 172.21.15.181:0/1997817728 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0acc001e40 con 0x7f0ad40a71f0 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0adb110640 5 monclient: authenticate success, global_id 184248 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0adb110640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient: dump: 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.752 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0adb110640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 1 -- 172.21.15.181:0/1997817728 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0acc004c20 con 0x7f0ad40a71f0 2024-09-13T10:40:48.753 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0adb110640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 1 -- 172.21.15.181:0/1997817728 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0acc005190 con 0x7f0ad40a71f0 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0adb110640 4 set_mon_vals no callback set 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.745+0000 7f0ad37fe640 10 monclient: dump: 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.754 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.746+0000 7f0adb110640 10 monclient: shutdown 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.746+0000 7f0adb110640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.746+0000 7f0adb110640 1 -- 172.21.15.181:0/1997817728 >> v1:172.21.15.181:6789/0 conn(0x7f0ad40a71f0 legacy=0x7f0ad4141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.746+0000 7f0adb110640 1 -- 172.21.15.181:0/1997817728 shutdown_connections 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.746+0000 7f0adb110640 1 -- 172.21.15.181:0/1997817728 >> 172.21.15.181:0/1997817728 conn(0x7f0ad40abeb0 msgr2=0x7f0ad40ac2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:48.755 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.746+0000 7f0adb110640 1 -- 172.21.15.181:0/1997817728 shutdown_connections 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.746+0000 7f0adb110640 1 -- 172.21.15.181:0/1997817728 wait complete. 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.746+0000 7f0adb110640 10 monclient: build_initial_monmap 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.746+0000 7f0adb110640 10 monclient: monmap: 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:48.756 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 1 Processor -- start 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 1 -- start start 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 10 monclient: init 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 10 monclient: _add_conns ranks=[5,6,3,1,2,8,0,4,7] 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 10 monclient(hunting): picked mon.noname-h con 0x7f0ad40a4e60 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 10 monclient(hunting): picked mon.noname-d con 0x7f0ad40a6de0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:48.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 10 monclient(hunting): picked mon.noname-g con 0x7f0ad40a71f0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:48.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad4126d60 con 0x7f0ad40a71f0 2024-09-13T10:40:48.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad4127040 con 0x7f0ad40a4e60 2024-09-13T10:40:48.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad4124ce0 con 0x7f0ad40a6de0 2024-09-13T10:40:48.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:48.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0adb110640 10 monclient(hunting): authenticate will time out at 1388.252885s 2024-09-13T10:40:48.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0ad3fff640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f0ad40a6de0 0x7f0ad41d29f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55380/0 (socket says 172.21.15.181:55380) 2024-09-13T10:40:48.758 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.747+0000 7f0ad3fff640 1 -- 172.21.15.181:0/1114022874 learned_addr learned my addr 172.21.15.181:0/1114022874 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:48.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad3fff640 1 -- 172.21.15.181:0/1114022874 >> v1:172.21.15.181:6792/0 conn(0x7f0ad40a6de0 legacy=0x7f0ad41d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2390765843 0 0) 0x7f0ad4124ce0 con 0x7f0ad40a6de0 2024-09-13T10:40:48.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): my global_id is 174552 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ab8003520 con 0x7f0ad40a6de0 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad8eac640 1 -- 172.21.15.181:0/1114022874 >> v1:172.21.15.195:6791/0 conn(0x7f0ad40a4e60 legacy=0x7f0ad4139680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad96ad640 1 -- 172.21.15.181:0/1114022874 >> v1:172.21.15.195:6790/0 conn(0x7f0ad40a71f0 legacy=0x7f0ad41d6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2326299682 0 0) 0x7f0ab8003520 con 0x7f0ad40a6de0 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ad4124ce0 con 0x7f0ad40a6de0 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0ac0003610 con 0x7f0ad40a6de0 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): dump: 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.762 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.763 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258890389 0 0) 0x7f0ad4127040 con 0x7f0ad40a4e60 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): my global_id is 106214 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ab8003520 con 0x7f0ad40a4e60 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3837393177 0 0) 0x7f0ad4126d60 con 0x7f0ad40a71f0 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient(hunting): my global_id is 184242 2024-09-13T10:40:48.764 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ad4127040 con 0x7f0ad40a71f0 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 431318927 0 0) 0x7f0ad4124ce0 con 0x7f0ad40a6de0 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 >> v1:172.21.15.195:6791/0 conn(0x7f0ad40a4e60 legacy=0x7f0ad4139680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 >> v1:172.21.15.195:6790/0 conn(0x7f0ad40a71f0 legacy=0x7f0ad41d6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient: _finish_hunting 0 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 monclient: found mon.d 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad41267a0 con 0x7f0ad40a6de0 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient: _finish_auth 0 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient: _check_auth_tickets 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0adb110640 5 monclient: authenticate success, global_id 174552 2024-09-13T10:40:48.765 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0adb110640 10 monclient: _renew_subs 2024-09-13T10:40:48.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0adb110640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:48.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0adb110640 1 -- 172.21.15.181:0/1114022874 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad4125840 con 0x7f0ad40a6de0 2024-09-13T10:40:48.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0adb110640 10 monclient: _renew_subs 2024-09-13T10:40:48.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0adb110640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:48.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0adb110640 1 -- 172.21.15.181:0/1114022874 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f0ad4139f70 con 0x7f0ad40a6de0 2024-09-13T10:40:48.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ac0003be0 con 0x7f0ad40a6de0 2024-09-13T10:40:48.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:48.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0ac00041d0 con 0x7f0ad40a6de0 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad2ffd640 4 set_mon_vals no callback set 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.750+0000 7f0ad17fa640 10 monclient: dump: 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.767 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.751+0000 7f0adb110640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.751+0000 7f0adb110640 1 -- 172.21.15.181:0/1114022874 --> v1:172.21.15.181:6792/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0ab4000f80 con 0x7f0ad40a6de0 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.751+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0ac0011ca0 con 0x7f0ad40a6de0 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.752+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f0ac004e3f0 con 0x7f0ad40a6de0 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.752+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 --> v1:172.21.15.195:6809/2152618500 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ab804a4f0 con 0x7f0ab8046880 2024-09-13T10:40:48.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.752+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (unknown 1450749824 0 0) 0x7f0ac004e860 con 0x7f0ad40a6de0 2024-09-13T10:40:48.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.752+0000 7f0ad17fa640 10 monclient: handle_get_version_reply finishing 1 version 331 2024-09-13T10:40:48.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.752+0000 7f0ad8eac640 10 monclient: get_auth_request con 0x7f0ab803fcc0 auth_method 0 2024-09-13T10:40:48.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.752+0000 7f0ad96ad640 10 monclient: get_auth_request con 0x7f0ab8046880 auth_method 0 2024-09-13T10:40:48.769 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.757+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== osd.3 v1:172.21.15.195:6809/2152618500 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f0ab804a4f0 con 0x7f0ab8046880 2024-09-13T10:40:48.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.769+0000 7f0adb110640 1 -- 172.21.15.181:0/1114022874 --> v1:172.21.15.195:6809/2152618500 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0ab4002cd0 con 0x7f0ab8046880 2024-09-13T10:40:48.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.770+0000 7f0ad17fa640 1 -- 172.21.15.181:0/1114022874 <== osd.3 v1:172.21.15.195:6809/2152618500 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f0ab4002cd0 con 0x7f0ab8046880 2024-09-13T10:40:48.771 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:48.771 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T10:40:48.772 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:48.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.770+0000 7f0adb110640 1 -- 172.21.15.181:0/1114022874 >> v1:172.21.15.195:6809/2152618500 conn(0x7f0ab8046880 legacy=0x7f0ab8048ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.770+0000 7f0adb110640 1 -- 172.21.15.181:0/1114022874 >> v1:172.21.15.195:6800/1839191919 conn(0x7f0ab803fcc0 legacy=0x7f0ab8042180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.770+0000 7f0adb110640 10 monclient: shutdown 2024-09-13T10:40:48.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.770+0000 7f0adb110640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:48.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.770+0000 7f0adb110640 1 -- 172.21.15.181:0/1114022874 >> v1:172.21.15.181:6792/0 conn(0x7f0ad40a6de0 legacy=0x7f0ad41d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.770+0000 7f0ad96ad640 1 -- 172.21.15.181:0/1114022874 reap_dead start 2024-09-13T10:40:48.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.770+0000 7f0adb110640 1 -- 172.21.15.181:0/1114022874 shutdown_connections 2024-09-13T10:40:48.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.770+0000 7f0adb110640 1 -- 172.21.15.181:0/1114022874 >> 172.21.15.181:0/1114022874 conn(0x7f0ad40abeb0 msgr2=0x7f0ad40ab280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:48.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.770+0000 7f0adb110640 1 -- 172.21.15.181:0/1114022874 shutdown_connections 2024-09-13T10:40:48.773 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.770+0000 7f0adb110640 1 -- 172.21.15.181:0/1114022874 wait complete. 2024-09-13T10:40:48.782 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T10:40:48.880 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.878+0000 7f3ded717640 10 monclient: get_monmap_and_config 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.878+0000 7f3ded717640 10 monclient: build_initial_monmap 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.879+0000 7f3ded717640 10 monclient: monmap: 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:48.879594+0000 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:48.879594+0000 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:48.881 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:48.882 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:48.882 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:48.882 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:48.882 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:48.882 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.879+0000 7f3ded717640 1 Processor -- start 2024-09-13T10:40:48.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.879+0000 7f3ded717640 1 -- start start 2024-09-13T10:40:48.882 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.879+0000 7f3ded717640 10 monclient: init 2024-09-13T10:40:48.886 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.879+0000 7f3ded717640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:48.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.879+0000 7f3ded717640 10 monclient: _add_conns ranks=[5,8,0,2,3,6,4,7,1] 2024-09-13T10:40:48.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.880+0000 7f3ded717640 10 monclient(hunting): picked mon.noname-h con 0x7f3de80a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:48.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.880+0000 7f3ded717640 10 monclient(hunting): picked mon.noname-e con 0x7f3de80a8340 addr v1:172.21.15.181:6793/0 2024-09-13T10:40:48.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.880+0000 7f3ded717640 10 monclient(hunting): picked mon.noname-a con 0x7f3de813f750 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:48.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.880+0000 7f3ded717640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de80a4bc0 con 0x7f3de813f750 2024-09-13T10:40:48.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.880+0000 7f3ded717640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de813a320 con 0x7f3de80a6640 2024-09-13T10:40:48.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.880+0000 7f3ded717640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de80a8100 con 0x7f3de80a8340 2024-09-13T10:40:48.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.880+0000 7f3ded717640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:48.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.880+0000 7f3ded717640 10 monclient(hunting): authenticate will time out at 1388.385100s 2024-09-13T10:40:48.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.880+0000 7f3de67fc640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f3de80a8340 0x7f3de8139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:41782/0 (socket says 172.21.15.181:41782) 2024-09-13T10:40:48.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.880+0000 7f3de67fc640 1 -- 172.21.15.181:0/4193255585 learned_addr learned my addr 172.21.15.181:0/4193255585 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:48.887 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de67fc640 1 -- 172.21.15.181:0/4193255585 >> v1:172.21.15.181:6793/0 conn(0x7f3de80a8340 legacy=0x7f3de8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de77fe640 1 -- 172.21.15.181:0/4193255585 >> v1:172.21.15.181:6789/0 conn(0x7f3de813f750 legacy=0x7f3de8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de6ffd640 1 -- 172.21.15.181:0/4193255585 >> v1:172.21.15.195:6791/0 conn(0x7f3de80a6640 legacy=0x7f3de8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1983384420 0 0) 0x7f3de80a8100 con 0x7f3de80a8340 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient(hunting): my global_id is 184283 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dd0003520 con 0x7f3de80a8340 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593246231 0 0) 0x7f3de80a4bc0 con 0x7f3de813f750 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.888 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient(hunting): my global_id is 184257 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de80a8100 con 0x7f3de813f750 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 58003079 0 0) 0x7f3de813a320 con 0x7f3de80a6640 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient(hunting): my global_id is 106223 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de80a4bc0 con 0x7f3de80a6640 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3157705649 0 0) 0x7f3dd0003520 con 0x7f3de80a8340 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 >> v1:172.21.15.195:6791/0 conn(0x7f3de80a6640 legacy=0x7f3de8139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 >> v1:172.21.15.181:6789/0 conn(0x7f3de813f750 legacy=0x7f3de8141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 monclient: found mon.noname-e 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:48.889 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de80a48e0 con 0x7f3de80a8340 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient: _finish_auth 0 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3ddc001ae0 con 0x7f3de80a8340 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3ded717640 5 monclient: authenticate success, global_id 184283 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3ded717640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient: dump: 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.890 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3ded717640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ddc0048a0 con 0x7f3de80a8340 2024-09-13T10:40:48.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 1 -- 172.21.15.181:0/4193255585 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3ddc004e10 con 0x7f3de80a8340 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3de5ffb640 10 monclient: dump: 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.892 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3ded717640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.882+0000 7f3ded717640 4 set_mon_vals no callback set 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.883+0000 7f3ded717640 10 monclient: shutdown 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.883+0000 7f3ded717640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.883+0000 7f3ded717640 1 -- 172.21.15.181:0/4193255585 >> v1:172.21.15.181:6793/0 conn(0x7f3de80a8340 legacy=0x7f3de8139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.883+0000 7f3ded717640 1 -- 172.21.15.181:0/4193255585 shutdown_connections 2024-09-13T10:40:48.893 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.883+0000 7f3ded717640 1 -- 172.21.15.181:0/4193255585 >> 172.21.15.181:0/4193255585 conn(0x7f3de8077170 msgr2=0x7f3de80abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.883+0000 7f3ded717640 1 -- 172.21.15.181:0/4193255585 shutdown_connections 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.883+0000 7f3ded717640 1 -- 172.21.15.181:0/4193255585 wait complete. 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.883+0000 7f3ded717640 10 monclient: build_initial_monmap 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.883+0000 7f3ded717640 10 monclient: monmap: 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:48.894 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:48.895 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:48.895 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:48.895 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:48.895 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:48.895 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:48.895 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 1 Processor -- start 2024-09-13T10:40:48.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 1 -- start start 2024-09-13T10:40:48.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 10 monclient: init 2024-09-13T10:40:48.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:48.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 10 monclient: _add_conns ranks=[0,4,6,8,7,3,2,5,1] 2024-09-13T10:40:48.895 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 10 monclient(hunting): picked mon.noname-a con 0x7f3de80a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:48.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 10 monclient(hunting): picked mon.noname-c con 0x7f3de813f750 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:48.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 10 monclient(hunting): picked mon.noname-d con 0x7f3de813cb10 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:48.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de80a9ed0 con 0x7f3de80a8340 2024-09-13T10:40:48.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de8142f60 con 0x7f3de813f750 2024-09-13T10:40:48.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de813de30 con 0x7f3de813cb10 2024-09-13T10:40:48.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:48.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3ded717640 10 monclient(hunting): authenticate will time out at 1388.389931s 2024-09-13T10:40:48.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.884+0000 7f3de6ffd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f3de80a8340 0x7f3de813bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50874/0 (socket says 172.21.15.181:50874) 2024-09-13T10:40:48.896 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.885+0000 7f3de6ffd640 1 -- 172.21.15.181:0/178738443 learned_addr learned my addr 172.21.15.181:0/178738443 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:48.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3de6ffd640 1 -- 172.21.15.181:0/178738443 >> v1:172.21.15.181:6789/0 conn(0x7f3de80a8340 legacy=0x7f3de813bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.900 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3de77fe640 1 -- 172.21.15.181:0/178738443 >> v1:172.21.15.181:6792/0 conn(0x7f3de813cb10 legacy=0x7f3de81d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3de67fc640 1 -- 172.21.15.181:0/178738443 >> v1:172.21.15.181:6791/0 conn(0x7f3de813f750 legacy=0x7f3de813c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:48.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168081866 0 0) 0x7f3de80a9ed0 con 0x7f3de80a8340 2024-09-13T10:40:48.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): my global_id is 184266 2024-09-13T10:40:48.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dd4003550 con 0x7f3de80a8340 2024-09-13T10:40:48.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3222703905 0 0) 0x7f3de813de30 con 0x7f3de813cb10 2024-09-13T10:40:48.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.901 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): my global_id is 174561 2024-09-13T10:40:48.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de80a9ed0 con 0x7f3de813cb10 2024-09-13T10:40:48.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2182857034 0 0) 0x7f3de8142f60 con 0x7f3de813f750 2024-09-13T10:40:48.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:40:48.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:48.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:48.902 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): my global_id is 174559 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de813de30 con 0x7f3de813f750 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1776173529 0 0) 0x7f3dd4003550 con 0x7f3de80a8340 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3de8142f60 con 0x7f3de80a8340 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3dd8003610 con 0x7f3de80a8340 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): dump: 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.903 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.904 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.904 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.904 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.904 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.904 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.904 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.904 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.904 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.904 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:48.904 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1064813321 0 0) 0x7f3de80a9ed0 con 0x7f3de813cb10 2024-09-13T10:40:48.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3dd4003550 con 0x7f3de813cb10 2024-09-13T10:40:48.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3de0003990 con 0x7f3de813cb10 2024-09-13T10:40:48.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:48.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:48.905 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): dump: 2024-09-13T10:40:48.905 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.905 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.905 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.905 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.905 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.905 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1740352886 0 0) 0x7f3de813de30 con 0x7f3de813f750 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3de80a9ed0 con 0x7f3de813f750 2024-09-13T10:40:48.906 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3ddc004d90 con 0x7f3de813f750 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient(hunting): dump: 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.907 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2861908001 0 0) 0x7f3de8142f60 con 0x7f3de80a8340 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 >> v1:172.21.15.181:6792/0 conn(0x7f3de813cb10 legacy=0x7f3de81d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 >> v1:172.21.15.181:6791/0 conn(0x7f3de813f750 legacy=0x7f3de813c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 monclient: found mon.a 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de8134360 con 0x7f3de80a8340 2024-09-13T10:40:48.908 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient: _finish_auth 0 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3ded717640 5 monclient: authenticate success, global_id 184266 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3ded717640 10 monclient: _renew_subs 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3ded717640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3ded717640 1 -- 172.21.15.181:0/178738443 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3de8134640 con 0x7f3de80a8340 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3ded717640 10 monclient: _renew_subs 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3ded717640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3ded717640 1 -- 172.21.15.181:0/178738443 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3de81d7a40 con 0x7f3de80a8340 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.887+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3dd8003bd0 con 0x7f3de80a8340 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.888+0000 7f3dcf7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.888+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3dd8004180 con 0x7f3de80a8340 2024-09-13T10:40:48.909 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.888+0000 7f3dcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.888+0000 7f3dcf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.888+0000 7f3de57fa640 4 set_mon_vals no callback set 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.888+0000 7f3dcf7fe640 10 monclient: dump: 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:48.910 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.888+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3dd8004320 con 0x7f3de80a8340 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.888+0000 7f3ded717640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.888+0000 7f3ded717640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.888+0000 7f3ded717640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.888+0000 7f3ded717640 1 -- 172.21.15.181:0/178738443 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc8005080 con 0x7f3de80a8340 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.889+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f3dd804e3c0 con 0x7f3de80a8340 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.889+0000 7f3de67fc640 10 monclient: get_auth_request con 0x7f3dd4040470 auth_method 0 2024-09-13T10:40:48.911 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.893+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f3dd8017970 con 0x7f3de80a8340 2024-09-13T10:40:48.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.893+0000 7f3dcf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:48.912 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:48.893+0000 7f3dcf7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:48.981 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.982 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3283799377}) 2024-09-13T10:40:48.982 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1986317803}) 2024-09-13T10:40:48.982 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.982 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3283799377}) 2024-09-13T10:40:48.982 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1093308562}) 2024-09-13T10:40:48.982 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.982 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3283799377}) 2024-09-13T10:40:48.982 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=713443405}) 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3283799377}) 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3162810596}) 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3283799377}) 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3786965458}) 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3283799377}) 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1855238489}) 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3283799377}) 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2522707324}) 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.983 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3283799377}) 2024-09-13T10:40:48.984 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.935+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3671149343}) 2024-09-13T10:40:48.984 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.984 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3569192640}) 2024-09-13T10:40:48.984 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=363611005}) 2024-09-13T10:40:48.984 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.984 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3569192640}) 2024-09-13T10:40:48.984 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3313403210}) 2024-09-13T10:40:48.984 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.984 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3569192640}) 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1877779708}) 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3569192640}) 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2087939555}) 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3569192640}) 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1001773910}) 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3569192640}) 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1444468778}) 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3569192640}) 2024-09-13T10:40:48.985 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=285801338}) 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3569192640}) 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.936+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1019025227}) 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1912056888}) 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1746411516}) 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1912056888}) 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2054992116}) 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1912056888}) 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2958592778}) 2024-09-13T10:40:48.986 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.987 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1912056888}) 2024-09-13T10:40:48.987 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2914467169}) 2024-09-13T10:40:48.987 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.987 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1912056888}) 2024-09-13T10:40:48.987 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1277845466}) 2024-09-13T10:40:48.987 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.987 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1912056888}) 2024-09-13T10:40:48.987 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2457892287}) 2024-09-13T10:40:48.987 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.987 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1912056888}) 2024-09-13T10:40:48.987 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3047907414}) 2024-09-13T10:40:48.987 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1912056888}) 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.938+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3148663105}) 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4149713626}) 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=166590194}) 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4149713626}) 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1975527288}) 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4149713626}) 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2754083472}) 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.988 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4149713626}) 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1327817019}) 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4149713626}) 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1109778996}) 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4149713626}) 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4161954267}) 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4149713626}) 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=815283647}) 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4149713626}) 2024-09-13T10:40:48.989 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.939+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1912975366}) 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1091148946}) 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1050342236}) 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1091148946}) 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3371447728}) 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1091148946}) 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=733513801}) 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1091148946}) 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3460037751}) 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.990 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1091148946}) 2024-09-13T10:40:48.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1568296761}) 2024-09-13T10:40:48.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1091148946}) 2024-09-13T10:40:48.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=571362563}) 2024-09-13T10:40:48.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1091148946}) 2024-09-13T10:40:48.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2789245881}) 2024-09-13T10:40:48.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1091148946}) 2024-09-13T10:40:48.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.940+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3383453483}) 2024-09-13T10:40:48.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.941+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.991 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.941+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2843089534}) 2024-09-13T10:40:48.992 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.941+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1064467711}) 2024-09-13T10:40:48.992 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.941+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.992 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.941+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2843089534}) 2024-09-13T10:40:48.992 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2279303295}) 2024-09-13T10:40:48.992 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.992 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2843089534}) 2024-09-13T10:40:48.992 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2899936658}) 2024-09-13T10:40:48.992 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.992 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2843089534}) 2024-09-13T10:40:48.993 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2814095549}) 2024-09-13T10:40:48.993 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.993 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2843089534}) 2024-09-13T10:40:48.993 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3074027610}) 2024-09-13T10:40:48.993 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.993 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2843089534}) 2024-09-13T10:40:48.993 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=720507411}) 2024-09-13T10:40:48.993 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.993 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2843089534}) 2024-09-13T10:40:48.993 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3722800170}) 2024-09-13T10:40:48.993 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.994 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2843089534}) 2024-09-13T10:40:48.994 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.942+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3842069417}) 2024-09-13T10:40:48.994 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.994 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=856755369}) 2024-09-13T10:40:48.994 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3644133662}) 2024-09-13T10:40:48.994 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.994 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=856755369}) 2024-09-13T10:40:48.994 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2541636845}) 2024-09-13T10:40:48.994 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.994 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=856755369}) 2024-09-13T10:40:48.995 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4183995722}) 2024-09-13T10:40:48.995 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.995 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=856755369}) 2024-09-13T10:40:48.995 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3792368806}) 2024-09-13T10:40:48.995 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.995 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=856755369}) 2024-09-13T10:40:48.995 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=225482708}) 2024-09-13T10:40:48.995 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.995 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=856755369}) 2024-09-13T10:40:48.995 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2549962157}) 2024-09-13T10:40:48.995 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=856755369}) 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2736446677}) 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=856755369}) 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.943+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=438158647}) 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787679659}) 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3856621445}) 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787679659}) 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=666698559}) 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787679659}) 2024-09-13T10:40:48.996 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=236008127}) 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787679659}) 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2729931265}) 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787679659}) 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2431215619}) 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787679659}) 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=101809550}) 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787679659}) 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2343863826}) 2024-09-13T10:40:48.997 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1787679659}) 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.944+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3584911481}) 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2325153610}) 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2590570720}) 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2325153610}) 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3156036905}) 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2325153610}) 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3420519841}) 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2325153610}) 2024-09-13T10:40:48.998 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3737835718}) 2024-09-13T10:40:48.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2325153610}) 2024-09-13T10:40:48.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1660926659}) 2024-09-13T10:40:48.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2325153610}) 2024-09-13T10:40:48.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1792831243}) 2024-09-13T10:40:48.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:48.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2325153610}) 2024-09-13T10:40:48.999 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=377801479}) 2024-09-13T10:40:49.000 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.000 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2325153610}) 2024-09-13T10:40:49.000 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.946+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3523722576}) 2024-09-13T10:40:49.000 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.000 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2838996783}) 2024-09-13T10:40:49.000 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2713439972}) 2024-09-13T10:40:49.000 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.001 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2838996783}) 2024-09-13T10:40:49.001 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1303605326}) 2024-09-13T10:40:49.001 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.001 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2838996783}) 2024-09-13T10:40:49.001 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1875351704}) 2024-09-13T10:40:49.001 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.001 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2838996783}) 2024-09-13T10:40:49.002 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2432607095}) 2024-09-13T10:40:49.002 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.002 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2838996783}) 2024-09-13T10:40:49.002 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=304361826}) 2024-09-13T10:40:49.002 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.002 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2838996783}) 2024-09-13T10:40:49.003 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2948130420}) 2024-09-13T10:40:49.003 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.003 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2838996783}) 2024-09-13T10:40:49.003 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2118442987}) 2024-09-13T10:40:49.003 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.003 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2838996783}) 2024-09-13T10:40:49.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.947+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=918199633}) 2024-09-13T10:40:49.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303625167}) 2024-09-13T10:40:49.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1806929736}) 2024-09-13T10:40:49.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.004 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303625167}) 2024-09-13T10:40:49.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3912832159}) 2024-09-13T10:40:49.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303625167}) 2024-09-13T10:40:49.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2107674621}) 2024-09-13T10:40:49.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.005 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303625167}) 2024-09-13T10:40:49.006 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=821704075}) 2024-09-13T10:40:49.006 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.006 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303625167}) 2024-09-13T10:40:49.006 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2848120835}) 2024-09-13T10:40:49.006 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.006 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303625167}) 2024-09-13T10:40:49.007 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2634326577}) 2024-09-13T10:40:49.007 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.007 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303625167}) 2024-09-13T10:40:49.007 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2498688710}) 2024-09-13T10:40:49.007 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.007 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303625167}) 2024-09-13T10:40:49.008 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.948+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3363401373}) 2024-09-13T10:40:49.008 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.008 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3744193762}) 2024-09-13T10:40:49.008 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2356837135}) 2024-09-13T10:40:49.008 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.008 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3744193762}) 2024-09-13T10:40:49.009 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3431424180}) 2024-09-13T10:40:49.009 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.009 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3744193762}) 2024-09-13T10:40:49.009 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1466013834}) 2024-09-13T10:40:49.009 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.010 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3744193762}) 2024-09-13T10:40:49.010 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=95176677}) 2024-09-13T10:40:49.010 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.010 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3744193762}) 2024-09-13T10:40:49.010 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=285733987}) 2024-09-13T10:40:49.010 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.011 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3744193762}) 2024-09-13T10:40:49.011 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=624737307}) 2024-09-13T10:40:49.011 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.011 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3744193762}) 2024-09-13T10:40:49.011 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1984932722}) 2024-09-13T10:40:49.011 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3744193762}) 2024-09-13T10:40:49.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.949+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3608854270}) 2024-09-13T10:40:49.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1233701864}) 2024-09-13T10:40:49.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2494712222}) 2024-09-13T10:40:49.012 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1233701864}) 2024-09-13T10:40:49.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3148118932}) 2024-09-13T10:40:49.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1233701864}) 2024-09-13T10:40:49.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1785748975}) 2024-09-13T10:40:49.013 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.014 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1233701864}) 2024-09-13T10:40:49.014 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3853540093}) 2024-09-13T10:40:49.014 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.014 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1233701864}) 2024-09-13T10:40:49.014 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2781401507}) 2024-09-13T10:40:49.014 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.014 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1233701864}) 2024-09-13T10:40:49.015 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2384222640}) 2024-09-13T10:40:49.015 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.015 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1233701864}) 2024-09-13T10:40:49.015 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=471003186}) 2024-09-13T10:40:49.015 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.015 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1233701864}) 2024-09-13T10:40:49.015 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.950+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3646516149}) 2024-09-13T10:40:49.016 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.016 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=538706785}) 2024-09-13T10:40:49.016 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=171979947}) 2024-09-13T10:40:49.016 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.016 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=538706785}) 2024-09-13T10:40:49.016 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3913809126}) 2024-09-13T10:40:49.017 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.017 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=538706785}) 2024-09-13T10:40:49.018 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2471427334}) 2024-09-13T10:40:49.018 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.018 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=538706785}) 2024-09-13T10:40:49.018 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3781348266}) 2024-09-13T10:40:49.018 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.018 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=538706785}) 2024-09-13T10:40:49.018 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=807601796}) 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=538706785}) 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1487861145}) 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=538706785}) 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2727425828}) 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=538706785}) 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.951+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3808219603}) 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2259806601}) 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3327746123}) 2024-09-13T10:40:49.019 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2259806601}) 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1573698980}) 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2259806601}) 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3618531378}) 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2259806601}) 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3442574658}) 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2259806601}) 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3483417551}) 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.020 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2259806601}) 2024-09-13T10:40:49.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=982344684}) 2024-09-13T10:40:49.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2259806601}) 2024-09-13T10:40:49.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=98682231}) 2024-09-13T10:40:49.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2259806601}) 2024-09-13T10:40:49.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.952+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1164697157}) 2024-09-13T10:40:49.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3873531630,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3448196750,mon_config_key=2562329318,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=2159323046,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=4214337164}) 2024-09-13T10:40:49.021 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=35,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=12} crc {logm=2396118642,mdsmap=2874252693,mgr=1131724149,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1462774421,mon_config_key=3365362204,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=468574113}) 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3873531630,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3448196750,mon_config_key=2562329318,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=2159323046,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=4214337164}) 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=14,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=2757365905,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3448196750,mon_config_key=704706844,monmap=2763160955,nvmeofgw=3140514009,osd_metadata=2159323046,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=3765526433}) 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3873531630,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3448196750,mon_config_key=2562329318,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=2159323046,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=4214337164}) 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=36,mdsmap=2,mgr=7,mgr_command_descs=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=14} crc {logm=3267991044,mdsmap=3140514009,mgr=4031651612,mgr_command_descs=3192186153,mgrstat=1299306916,mon_config_key=2857462867,monmap=2763160955,nvmeofgw=598337686,osd_metadata=2159323046,osd_pg_creating=1355322054,osd_snap=3823785925,osdmap=433640629}) 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3873531630,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3448196750,mon_config_key=2562329318,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=2159323046,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=4214337164}) 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=34,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=43607387,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3664974098,mon_config_key=4256284388,monmap=2763160955,nvmeofgw=598337686,osd_metadata=1827433543,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=3860081854}) 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3873531630,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3448196750,mon_config_key=2562329318,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=2159323046,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=4214337164}) 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=2,nvmeofgw=3,osd_metadata=3,osd_pg_creating=1,osd_snap=1,osdmap=14} crc {logm=3242782828,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1299306916,mon_config_key=2028827378,monmap=2232244610,nvmeofgw=598337686,osd_metadata=1283370650,osd_pg_creating=1355322054,osd_snap=1914091869,osdmap=433640629}) 2024-09-13T10:40:49.022 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.023 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3873531630,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3448196750,mon_config_key=2562329318,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=2159323046,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=4214337164}) 2024-09-13T10:40:49.023 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=34,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=17} crc {logm=1159866065,mdsmap=2874252693,mgr=1442310424,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1299306917,mon_config_key=4289664554,monmap=1455321221,nvmeofgw=598337686,osd_metadata=4136060328,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=2737450086}) 2024-09-13T10:40:49.023 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.023 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3873531630,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3448196750,mon_config_key=2562329318,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=2159323046,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=4214337164}) 2024-09-13T10:40:49.023 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=10} crc {logm=1216280499,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1299306916,mon_config_key=3365362204,monmap=2763160955,nvmeofgw=598337686,osd_metadata=936212169,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=3001791808}) 2024-09-13T10:40:49.023 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.023 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=36,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=13} crc {logm=3873531630,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=3448196750,mon_config_key=2562329318,monmap=2763160955,nvmeofgw=1596038039,osd_metadata=2159323046,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=4214337164}) 2024-09-13T10:40:49.023 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.954+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=35,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=11} crc {logm=812639723,mdsmap=2874252693,mgr=2286455831,mgr_command_descs=3192186153,mgr_metadata=1537866486,mgrstat=1299306916,mon_config_key=4256284388,monmap=2763160955,nvmeofgw=598337686,osd_metadata=4136060328,osd_pg_creating=1355322054,osd_snap=4133920409,osdmap=291545097}) 2024-09-13T10:40:49.023 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.023 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2698018617}) 2024-09-13T10:40:49.023 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4088823811}) 2024-09-13T10:40:49.023 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.024 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2698018617}) 2024-09-13T10:40:49.024 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=399528219}) 2024-09-13T10:40:49.024 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.024 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2698018617}) 2024-09-13T10:40:49.024 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1845395790}) 2024-09-13T10:40:49.024 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.024 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2698018617}) 2024-09-13T10:40:49.024 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2003171975}) 2024-09-13T10:40:49.024 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.024 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.955+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2698018617}) 2024-09-13T10:40:49.024 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.956+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1646814315}) 2024-09-13T10:40:49.024 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.956+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.025 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.956+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2698018617}) 2024-09-13T10:40:49.025 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.956+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2861086119}) 2024-09-13T10:40:49.025 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.956+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.025 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.956+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2698018617}) 2024-09-13T10:40:49.025 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.956+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3230918565}) 2024-09-13T10:40:49.025 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.956+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.025 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.956+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2698018617}) 2024-09-13T10:40:49.025 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.956+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=460336695}) 2024-09-13T10:40:49.025 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.025 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=591256124}) 2024-09-13T10:40:49.025 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=718578866}) 2024-09-13T10:40:49.026 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.026 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=591256124}) 2024-09-13T10:40:49.026 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2983597903}) 2024-09-13T10:40:49.026 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.026 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=591256124}) 2024-09-13T10:40:49.026 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1411438947}) 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=591256124}) 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3661661300}) 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=591256124}) 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=895860359}) 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=591256124}) 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2107645221}) 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=591256124}) 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3068842350}) 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.027 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=591256124}) 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.957+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2334409715}) 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1775231320}) 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=461914605}) 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1775231320}) 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=575479023}) 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1775231320}) 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2175610327}) 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1775231320}) 2024-09-13T10:40:49.028 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=1360461800}) 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.958+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1775231320}) 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.959+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=343045584}) 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.959+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.959+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1775231320}) 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.959+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=1765816252}) 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.959+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.959+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1775231320}) 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.959+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3296423536}) 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.959+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.959+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1775231320}) 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.959+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=1784330754}) 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.960+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.029 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.960+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1390091911}) 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.960+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2098319459}) 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.960+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.960+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1390091911}) 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.960+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=247379932}) 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.960+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.960+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1390091911}) 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=48882739}) 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1390091911}) 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=795665907}) 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1390091911}) 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1338645988}) 2024-09-13T10:40:49.030 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1390091911}) 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2001359161}) 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1390091911}) 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3968106287}) 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1390091911}) 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.961+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=606394596}) 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=72} crc {osdmap=81393853}) 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=76} crc {osdmap=3053282580}) 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=72} crc {osdmap=81393853}) 2024-09-13T10:40:49.031 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=78} crc {osdmap=2536399639}) 2024-09-13T10:40:49.032 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.032 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=72} crc {osdmap=81393853}) 2024-09-13T10:40:49.032 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=79} crc {osdmap=1247104263}) 2024-09-13T10:40:49.032 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.032 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=72} crc {osdmap=81393853}) 2024-09-13T10:40:49.032 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=78} crc {osdmap=3503199507}) 2024-09-13T10:40:49.032 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.032 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=72} crc {osdmap=81393853}) 2024-09-13T10:40:49.033 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=79} crc {osdmap=2833135324}) 2024-09-13T10:40:49.033 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.033 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=72} crc {osdmap=81393853}) 2024-09-13T10:40:49.033 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=78} crc {osdmap=922896465}) 2024-09-13T10:40:49.033 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.033 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=72} crc {osdmap=81393853}) 2024-09-13T10:40:49.033 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=74} crc {osdmap=846361034}) 2024-09-13T10:40:49.033 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-13T10:40:49.033 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=72} crc {osdmap=81393853}) 2024-09-13T10:40:49.033 INFO:tasks.ceph.mon.i.smithi195.stderr:2024-09-13T10:40:48.971+0000 7fdb573b8640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=77} crc {osdmap=62256523}) 2024-09-13T10:40:49.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.077+0000 7f3ded717640 1 -- 172.21.15.181:0/178738443 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f3dc8000b90 con 0x7f3dd4040470 2024-09-13T10:40:49.079 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.078+0000 7f3dcf7fe640 1 -- 172.21.15.181:0/178738443 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f3dc8000b90 con 0x7f3dd4040470 2024-09-13T10:40:49.079 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T10:40:49.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.080+0000 7f3ded717640 1 -- 172.21.15.181:0/178738443 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3dd4040470 legacy=0x7f3dd4042930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.080+0000 7f3ded717640 10 monclient: shutdown 2024-09-13T10:40:49.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.080+0000 7f3ded717640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:49.082 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.080+0000 7f3ded717640 1 -- 172.21.15.181:0/178738443 >> v1:172.21.15.181:6789/0 conn(0x7f3de80a8340 legacy=0x7f3de813bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.080+0000 7f3ded717640 1 -- 172.21.15.181:0/178738443 shutdown_connections 2024-09-13T10:40:49.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.080+0000 7f3ded717640 1 -- 172.21.15.181:0/178738443 >> 172.21.15.181:0/178738443 conn(0x7f3de80a6640 msgr2=0x7f3de80a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:49.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.080+0000 7f3ded717640 1 -- 172.21.15.181:0/178738443 shutdown_connections 2024-09-13T10:40:49.083 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.080+0000 7f3ded717640 1 -- 172.21.15.181:0/178738443 wait complete. 2024-09-13T10:40:49.093 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T10:40:49.093 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T10:40:49.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.192+0000 7ff4b8998640 10 monclient: get_monmap_and_config 2024-09-13T10:40:49.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.192+0000 7ff4b8998640 10 monclient: build_initial_monmap 2024-09-13T10:40:49.194 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.192+0000 7ff4b8998640 10 monclient: monmap: 2024-09-13T10:40:49.194 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:49.194 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.194 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:49.193353+0000 2024-09-13T10:40:49.194 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:49.193353+0000 2024-09-13T10:40:49.194 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:49.194 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.195 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:49.195 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:49.195 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:49.195 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:49.195 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:49.195 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:49.195 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:49.195 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:49.195 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:49.195 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.193+0000 7ff4b8998640 1 Processor -- start 2024-09-13T10:40:49.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.193+0000 7ff4b8998640 1 -- start start 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.193+0000 7ff4b8998640 10 monclient: init 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.193+0000 7ff4b8998640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.193+0000 7ff4b8998640 10 monclient: _add_conns ranks=[4,3,1,8,7,6,0,2,5] 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.194+0000 7ff4b8998640 10 monclient(hunting): picked mon.noname-c con 0x7ff4b40a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.194+0000 7ff4b8998640 10 monclient(hunting): picked mon.noname-g con 0x7ff4b40a82d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.194+0000 7ff4b8998640 10 monclient(hunting): picked mon.noname-f con 0x7ff4b413f7c0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.194+0000 7ff4b8998640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b40a4bc0 con 0x7ff4b413f7c0 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.194+0000 7ff4b8998640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b40a2f40 con 0x7ff4b40a82d0 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.194+0000 7ff4b8998640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b40a8090 con 0x7ff4b40a66d0 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.194+0000 7ff4b8998640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.194+0000 7ff4b8998640 10 monclient(hunting): authenticate will time out at 1388.699069s 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.194+0000 7ff4b259c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7ff4b40a66d0 0x7ff4b40a6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35826/0 (socket says 172.21.15.181:35826) 2024-09-13T10:40:49.197 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.194+0000 7ff4b259c640 1 -- 172.21.15.181:0/2685599274 learned_addr learned my addr 172.21.15.181:0/2685599274 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:49.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b259c640 1 -- 172.21.15.181:0/2685599274 >> v1:172.21.15.181:6791/0 conn(0x7ff4b40a66d0 legacy=0x7ff4b40a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.201 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 1 -- 172.21.15.181:0/2685599274 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158642083 0 0) 0x7ff4b40a8090 con 0x7ff4b40a66d0 2024-09-13T10:40:49.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient(hunting): my global_id is 174568 2024-09-13T10:40:49.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 1 -- 172.21.15.181:0/2685599274 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff49c003520 con 0x7ff4b40a66d0 2024-09-13T10:40:49.202 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b2d9d640 1 -- 172.21.15.181:0/2685599274 >> v1:172.21.15.195:6789/0 conn(0x7ff4b413f7c0 legacy=0x7ff4b4141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b1d9b640 1 -- 172.21.15.181:0/2685599274 >> v1:172.21.15.195:6790/0 conn(0x7ff4b40a82d0 legacy=0x7ff4b40a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 1 -- 172.21.15.181:0/2685599274 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2006039004 0 0) 0x7ff49c003520 con 0x7ff4b40a66d0 2024-09-13T10:40:49.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 1 -- 172.21.15.181:0/2685599274 >> v1:172.21.15.195:6790/0 conn(0x7ff4b40a82d0 legacy=0x7ff4b40a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 1 -- 172.21.15.181:0/2685599274 >> v1:172.21.15.195:6789/0 conn(0x7ff4b413f7c0 legacy=0x7ff4b4141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient: _finish_hunting 0 2024-09-13T10:40:49.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 1 monclient: found mon.noname-c 2024-09-13T10:40:49.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:49.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:40:49.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 1 -- 172.21.15.181:0/2685599274 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b40a48e0 con 0x7ff4b40a66d0 2024-09-13T10:40:49.203 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient: _finish_auth 0 2024-09-13T10:40:49.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient: _check_auth_tickets 2024-09-13T10:40:49.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:49.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 1 -- 172.21.15.181:0/2685599274 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff4a4001ad0 con 0x7ff4b40a66d0 2024-09-13T10:40:49.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b8998640 5 monclient: authenticate success, global_id 174568 2024-09-13T10:40:49.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:49.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:49.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient: dump: 2024-09-13T10:40:49.204 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.204 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.204 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.205 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.205 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.205 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.205 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.205 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.205 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.205 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.206 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.206 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b8998640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 1 -- 172.21.15.181:0/2685599274 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff4a40048a0 con 0x7ff4b40a66d0 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 1 -- 172.21.15.181:0/2685599274 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff4a4004e10 con 0x7ff4b40a66d0 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b8998640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b8998640 4 set_mon_vals no callback set 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:49.207 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.196+0000 7ff4b159a640 10 monclient: dump: 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.208 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.197+0000 7ff4b8998640 10 monclient: shutdown 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.197+0000 7ff4b8998640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.197+0000 7ff4b8998640 1 -- 172.21.15.181:0/2685599274 >> v1:172.21.15.181:6791/0 conn(0x7ff4b40a66d0 legacy=0x7ff4b40a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.197+0000 7ff4b8998640 1 -- 172.21.15.181:0/2685599274 shutdown_connections 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.197+0000 7ff4b8998640 1 -- 172.21.15.181:0/2685599274 >> 172.21.15.181:0/2685599274 conn(0x7ff4b40abcd0 msgr2=0x7ff4b40ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.197+0000 7ff4b8998640 1 -- 172.21.15.181:0/2685599274 shutdown_connections 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.197+0000 7ff4b8998640 1 -- 172.21.15.181:0/2685599274 wait complete. 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.198+0000 7ff4b8998640 10 monclient: build_initial_monmap 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.198+0000 7ff4b8998640 10 monclient: monmap: 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:49.209 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:49.210 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.198+0000 7ff4b8998640 1 Processor -- start 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.198+0000 7ff4b8998640 1 -- start start 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.198+0000 7ff4b8998640 10 monclient: init 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.198+0000 7ff4b8998640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.198+0000 7ff4b8998640 10 monclient: _add_conns ranks=[2,6,0,4,5,7,1,8,3] 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.198+0000 7ff4b8998640 10 monclient(hunting): picked mon.noname-b con 0x7ff4b40a66d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.198+0000 7ff4b8998640 10 monclient(hunting): picked mon.noname-d con 0x7ff4b40a82d0 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.199+0000 7ff4b8998640 10 monclient(hunting): picked mon.noname-a con 0x7ff4b413f7c0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.199+0000 7ff4b8998640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b40a1ee0 con 0x7ff4b413f7c0 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.199+0000 7ff4b8998640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b41cf100 con 0x7ff4b40a66d0 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.199+0000 7ff4b8998640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b40a09f0 con 0x7ff4b40a82d0 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.199+0000 7ff4b8998640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.199+0000 7ff4b8998640 10 monclient(hunting): authenticate will time out at 1388.704091s 2024-09-13T10:40:49.211 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.199+0000 7ff4b1d9b640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7ff4b40a82d0 0x7ff4b41ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55406/0 (socket says 172.21.15.181:55406) 2024-09-13T10:40:49.212 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.199+0000 7ff4b1d9b640 1 -- 172.21.15.181:0/298592167 learned_addr learned my addr 172.21.15.181:0/298592167 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:49.215 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4b2d9d640 1 -- 172.21.15.181:0/298592167 >> v1:172.21.15.181:6789/0 conn(0x7ff4b413f7c0 legacy=0x7ff4b41d6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4b259c640 1 -- 172.21.15.181:0/298592167 >> v1:172.21.15.181:6790/0 conn(0x7ff4b40a66d0 legacy=0x7ff4b41ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4b1d9b640 1 -- 172.21.15.181:0/298592167 >> v1:172.21.15.181:6792/0 conn(0x7ff4b40a82d0 legacy=0x7ff4b41ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148275406 0 0) 0x7ff4b40a1ee0 con 0x7ff4b413f7c0 2024-09-13T10:40:49.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): my global_id is 184275 2024-09-13T10:40:49.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff494003520 con 0x7ff4b413f7c0 2024-09-13T10:40:49.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3202978789 0 0) 0x7ff4b40a09f0 con 0x7ff4b40a82d0 2024-09-13T10:40:49.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.216 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): my global_id is 174570 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4b40a1ee0 con 0x7ff4b40a82d0 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742746918 0 0) 0x7ff4b41cf100 con 0x7ff4b40a66d0 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): my global_id is 174503 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4b40a09f0 con 0x7ff4b40a66d0 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 641502550 0 0) 0x7ff494003520 con 0x7ff4b413f7c0 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4b41cf100 con 0x7ff4b413f7c0 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff4ac002070 con 0x7ff4b413f7c0 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:49.217 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): dump: 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.218 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.219 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.219 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.219 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:49.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2130195699 0 0) 0x7ff4b40a1ee0 con 0x7ff4b40a82d0 2024-09-13T10:40:49.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff494003520 con 0x7ff4b40a82d0 2024-09-13T10:40:49.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1596510376 0 0) 0x7ff4b40a09f0 con 0x7ff4b40a66d0 2024-09-13T10:40:49.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4b40a1ee0 con 0x7ff4b40a66d0 2024-09-13T10:40:49.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff4a8003610 con 0x7ff4b40a82d0 2024-09-13T10:40:49.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:49.219 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): dump: 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.220 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.221 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.221 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.221 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff4a4004d90 con 0x7ff4b40a66d0 2024-09-13T10:40:49.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:49.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:49.221 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient(hunting): dump: 2024-09-13T10:40:49.221 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.221 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.221 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.221 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.221 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.222 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.222 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.222 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.222 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.222 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.222 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.223 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.223 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.223 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.223 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.223 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.223 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 455799906 0 0) 0x7ff4b41cf100 con 0x7ff4b413f7c0 2024-09-13T10:40:49.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 >> v1:172.21.15.181:6792/0 conn(0x7ff4b40a82d0 legacy=0x7ff4b41ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 >> v1:172.21.15.181:6790/0 conn(0x7ff4b40a66d0 legacy=0x7ff4b41ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:40:49.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 monclient: found mon.a 2024-09-13T10:40:49.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:49.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:49.224 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b4134c40 con 0x7ff4b413f7c0 2024-09-13T10:40:49.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.201+0000 7ff4a2ffd640 10 monclient: _finish_auth 0 2024-09-13T10:40:49.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4a2ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:40:49.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:49.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4b8998640 5 monclient: authenticate success, global_id 184275 2024-09-13T10:40:49.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4b8998640 10 monclient: _renew_subs 2024-09-13T10:40:49.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4b8998640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:49.225 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4b8998640 1 -- 172.21.15.181:0/298592167 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b40a2a70 con 0x7ff4b413f7c0 2024-09-13T10:40:49.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4b8998640 10 monclient: _renew_subs 2024-09-13T10:40:49.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4b8998640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:49.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4b8998640 1 -- 172.21.15.181:0/298592167 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff4b413e500 con 0x7ff4b413f7c0 2024-09-13T10:40:49.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff4ac003d60 con 0x7ff4b413f7c0 2024-09-13T10:40:49.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4a2ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:49.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7ff4ac0042d0 con 0x7ff4b413f7c0 2024-09-13T10:40:49.226 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:49.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4b0d99640 4 set_mon_vals no callback set 2024-09-13T10:40:49.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:49.227 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4a2ffd640 10 monclient: dump: 2024-09-13T10:40:49.227 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.227 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.227 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.227 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.228 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.228 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.228 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.228 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.228 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.228 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.229 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.229 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.229 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.229 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.229 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.229 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.202+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7ff4ac004470 con 0x7ff4b413f7c0 2024-09-13T10:40:49.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.203+0000 7ff4b8998640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:49.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.203+0000 7ff4b8998640 1 -- 172.21.15.181:0/298592167 --> v1:172.21.15.181:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff498000f80 con 0x7ff4b413f7c0 2024-09-13T10:40:49.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.203+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7ff4ac04e4a0 con 0x7ff4b413f7c0 2024-09-13T10:40:49.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.203+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 --> v1:172.21.15.195:6805/1430589228 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff49404ac90 con 0x7ff494047020 2024-09-13T10:40:49.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.203+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (unknown 1450749824 0 0) 0x7ff4ac004760 con 0x7ff4b413f7c0 2024-09-13T10:40:49.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.203+0000 7ff4a2ffd640 10 monclient: handle_get_version_reply finishing 1 version 331 2024-09-13T10:40:49.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.203+0000 7ff4b259c640 10 monclient: get_auth_request con 0x7ff4940404e0 auth_method 0 2024-09-13T10:40:49.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.203+0000 7ff4b1d9b640 10 monclient: get_auth_request con 0x7ff494047020 auth_method 0 2024-09-13T10:40:49.230 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.208+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== osd.4 v1:172.21.15.195:6805/1430589228 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7ff49404ac90 con 0x7ff494047020 2024-09-13T10:40:49.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.221+0000 7ff4b8998640 1 -- 172.21.15.181:0/298592167 --> v1:172.21.15.195:6805/1430589228 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff498002cd0 con 0x7ff494047020 2024-09-13T10:40:49.231 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.221+0000 7ff4a2ffd640 1 -- 172.21.15.181:0/298592167 <== osd.4 v1:172.21.15.195:6805/1430589228 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7ff498002cd0 con 0x7ff494047020 2024-09-13T10:40:49.231 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:49.231 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T10:40:49.231 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:49.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.222+0000 7ff4b8998640 1 -- 172.21.15.181:0/298592167 >> v1:172.21.15.195:6805/1430589228 conn(0x7ff494047020 legacy=0x7ff494049440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.222+0000 7ff4b8998640 1 -- 172.21.15.181:0/298592167 >> v1:172.21.15.195:6800/1839191919 conn(0x7ff4940404e0 legacy=0x7ff4940429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.232 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.222+0000 7ff4b8998640 10 monclient: shutdown 2024-09-13T10:40:49.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.222+0000 7ff4b8998640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:49.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.222+0000 7ff4b8998640 1 -- 172.21.15.181:0/298592167 >> v1:172.21.15.181:6789/0 conn(0x7ff4b413f7c0 legacy=0x7ff4b41d6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.222+0000 7ff4b2d9d640 1 -- 172.21.15.181:0/298592167 reap_dead start 2024-09-13T10:40:49.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.222+0000 7ff4b8998640 1 -- 172.21.15.181:0/298592167 shutdown_connections 2024-09-13T10:40:49.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.222+0000 7ff4b8998640 1 -- 172.21.15.181:0/298592167 >> 172.21.15.181:0/298592167 conn(0x7ff4b40abcd0 msgr2=0x7ff4b40a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:49.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.222+0000 7ff4b8998640 1 -- 172.21.15.181:0/298592167 shutdown_connections 2024-09-13T10:40:49.233 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.222+0000 7ff4b8998640 1 -- 172.21.15.181:0/298592167 wait complete. 2024-09-13T10:40:49.234 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T10:40:49.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.330+0000 7f5ee4eb0640 10 monclient: get_monmap_and_config 2024-09-13T10:40:49.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.330+0000 7f5ee4eb0640 10 monclient: build_initial_monmap 2024-09-13T10:40:49.332 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.330+0000 7f5ee4eb0640 10 monclient: monmap: 2024-09-13T10:40:49.332 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:49.332 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.332 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:49.330791+0000 2024-09-13T10:40:49.332 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:49.330791+0000 2024-09-13T10:40:49.332 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:49.332 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.332 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:49.333 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:49.333 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:49.333 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:49.333 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:49.333 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:49.333 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:49.333 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:49.333 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:49.333 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.330+0000 7f5ee4eb0640 1 Processor -- start 2024-09-13T10:40:49.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.330+0000 7f5ee4eb0640 1 -- start start 2024-09-13T10:40:49.333 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.330+0000 7f5ee4eb0640 10 monclient: init 2024-09-13T10:40:49.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.331+0000 7f5ee4eb0640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:49.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.331+0000 7f5ee4eb0640 10 monclient: _add_conns ranks=[3,0,5,1,8,7,6,4,2] 2024-09-13T10:40:49.339 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.331+0000 7f5ee4eb0640 10 monclient(hunting): picked mon.noname-g con 0x7f5ee00a6640 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:49.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.331+0000 7f5ee4eb0640 10 monclient(hunting): picked mon.noname-a con 0x7f5ee00a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:49.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.331+0000 7f5ee4eb0640 10 monclient(hunting): picked mon.noname-h con 0x7f5ee013f750 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:49.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.331+0000 7f5ee4eb0640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ee00a4bc0 con 0x7f5ee00a8340 2024-09-13T10:40:49.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.331+0000 7f5ee4eb0640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ee013a320 con 0x7f5ee00a6640 2024-09-13T10:40:49.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.331+0000 7f5ee4eb0640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ee00a8100 con 0x7f5ee013f750 2024-09-13T10:40:49.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.331+0000 7f5ee4eb0640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:49.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.331+0000 7f5ee4eb0640 10 monclient(hunting): authenticate will time out at 1388.836498s 2024-09-13T10:40:49.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.331+0000 7f5eddd9b640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5ee00a8340 0x7f5ee0139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50886/0 (socket says 172.21.15.181:50886) 2024-09-13T10:40:49.340 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.331+0000 7f5eddd9b640 1 -- 172.21.15.181:0/710274954 learned_addr learned my addr 172.21.15.181:0/710274954 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.333+0000 7f5eddd9b640 1 -- 172.21.15.181:0/710274954 >> v1:172.21.15.181:6789/0 conn(0x7f5ee00a8340 legacy=0x7f5ee0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.333+0000 7f5edd59a640 1 -- 172.21.15.181:0/710274954 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654343355 0 0) 0x7f5ee00a4bc0 con 0x7f5ee00a8340 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.333+0000 7f5edd59a640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.333+0000 7f5edd59a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.333+0000 7f5edd59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.333+0000 7f5edd59a640 10 monclient(hunting): my global_id is 184284 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5eded9d640 1 -- 172.21.15.181:0/710274954 >> v1:172.21.15.195:6791/0 conn(0x7f5ee013f750 legacy=0x7f5ee0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 1 -- 172.21.15.181:0/710274954 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ec8003520 con 0x7f5ee00a8340 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5ede59c640 1 -- 172.21.15.181:0/710274954 >> v1:172.21.15.195:6790/0 conn(0x7f5ee00a6640 legacy=0x7f5ee0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 1 -- 172.21.15.181:0/710274954 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3327288060 0 0) 0x7f5ec8003520 con 0x7f5ee00a8340 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 1 -- 172.21.15.181:0/710274954 >> v1:172.21.15.195:6791/0 conn(0x7f5ee013f750 legacy=0x7f5ee0141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 1 -- 172.21.15.181:0/710274954 >> v1:172.21.15.195:6790/0 conn(0x7f5ee00a6640 legacy=0x7f5ee0139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.341 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 10 monclient: _finish_hunting 0 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 1 monclient: found mon.noname-a 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 1 -- 172.21.15.181:0/710274954 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee00a48e0 con 0x7f5ee00a8340 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 10 monclient: _finish_auth 0 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 10 monclient: _check_auth_tickets 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 1 -- 172.21.15.181:0/710274954 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ed4001ae0 con 0x7f5ee00a8340 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5ee4eb0640 5 monclient: authenticate success, global_id 184284 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5ee4eb0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:49.342 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 10 monclient: dump: 2024-09-13T10:40:49.343 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.343 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.343 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.343 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.343 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.343 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.343 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.343 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.343 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.343 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.343 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.343 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.344 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.344 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.344 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.344 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5ee4eb0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:49.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 1 -- 172.21.15.181:0/710274954 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ed40048a0 con 0x7f5ee00a8340 2024-09-13T10:40:49.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:49.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 1 -- 172.21.15.181:0/710274954 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ed4004dd0 con 0x7f5ee00a8340 2024-09-13T10:40:49.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5ee4eb0640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:49.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5ee4eb0640 4 set_mon_vals no callback set 2024-09-13T10:40:49.344 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:49.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:49.345 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5edd59a640 10 monclient: dump: 2024-09-13T10:40:49.345 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.345 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.345 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.345 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.345 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.345 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.345 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.345 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5ee4eb0640 10 monclient: shutdown 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5ee4eb0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/710274954 >> v1:172.21.15.181:6789/0 conn(0x7f5ee00a8340 legacy=0x7f5ee0139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/710274954 shutdown_connections 2024-09-13T10:40:49.346 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.334+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/710274954 >> 172.21.15.181:0/710274954 conn(0x7f5ee0077170 msgr2=0x7f5ee00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:49.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.335+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/710274954 shutdown_connections 2024-09-13T10:40:49.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.335+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/710274954 wait complete. 2024-09-13T10:40:49.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.335+0000 7f5ee4eb0640 10 monclient: build_initial_monmap 2024-09-13T10:40:49.347 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.335+0000 7f5ee4eb0640 10 monclient: monmap: 2024-09-13T10:40:49.347 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:49.348 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 1 Processor -- start 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 1 -- start start 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 10 monclient: init 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 10 monclient: _add_conns ranks=[0,1,7,3,4,5,2,8,6] 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 10 monclient(hunting): picked mon.noname-a con 0x7f5ee00a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 10 monclient(hunting): picked mon.noname-f con 0x7f5ee013f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 10 monclient(hunting): picked mon.noname-i con 0x7f5ee01420c0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ee00a9c40 con 0x7f5ee00a8340 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ee0142b60 con 0x7f5ee013f750 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ee013bdb0 con 0x7f5ee01420c0 2024-09-13T10:40:49.349 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:49.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ee4eb0640 10 monclient(hunting): authenticate will time out at 1388.841628s 2024-09-13T10:40:49.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ede59c640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5ee00a8340 0x7f5ee012c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50900/0 (socket says 172.21.15.181:50900) 2024-09-13T10:40:49.350 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.336+0000 7f5ede59c640 1 -- 172.21.15.181:0/3524800667 learned_addr learned my addr 172.21.15.181:0/3524800667 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:49.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.338+0000 7f5ede59c640 1 -- 172.21.15.181:0/3524800667 >> v1:172.21.15.181:6789/0 conn(0x7f5ee00a8340 legacy=0x7f5ee012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.338+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017599950 0 0) 0x7f5ee00a9c40 con 0x7f5ee00a8340 2024-09-13T10:40:49.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.338+0000 7f5eceffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.355 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.338+0000 7f5eceffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.338+0000 7f5eceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.338+0000 7f5eceffd640 10 monclient(hunting): my global_id is 184293 2024-09-13T10:40:49.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.338+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ec0003550 con 0x7f5ee00a8340 2024-09-13T10:40:49.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eddd9b640 1 -- 172.21.15.181:0/3524800667 >> v1:172.21.15.195:6789/0 conn(0x7f5ee013f750 legacy=0x7f5ee01d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eded9d640 1 -- 172.21.15.181:0/3524800667 >> v1:172.21.15.195:6792/0 conn(0x7f5ee01420c0 legacy=0x7f5ee01d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.356 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 288566260 0 0) 0x7f5ec0003550 con 0x7f5ee00a8340 2024-09-13T10:40:49.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ee00a9c40 con 0x7f5ee00a8340 2024-09-13T10:40:49.357 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ed0003610 con 0x7f5ee00a8340 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient(hunting): dump: 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.358 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190190714 0 0) 0x7f5ee0142b60 con 0x7f5ee013f750 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient(hunting): my global_id is 135298 2024-09-13T10:40:49.359 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ec0003550 con 0x7f5ee013f750 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1143185513 0 0) 0x7f5ee013bdb0 con 0x7f5ee01420c0 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient(hunting): my global_id is 58246 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ee0142b60 con 0x7f5ee01420c0 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2772664782 0 0) 0x7f5ee00a9c40 con 0x7f5ee00a8340 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 >> v1:172.21.15.195:6792/0 conn(0x7f5ee01420c0 legacy=0x7f5ee01d6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 >> v1:172.21.15.195:6789/0 conn(0x7f5ee013f750 legacy=0x7f5ee01d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient: _finish_hunting 0 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 monclient: found mon.a 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:49.360 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee013baa0 con 0x7f5ee00a8340 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient: _finish_auth 0 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient: _check_auth_tickets 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5ee4eb0640 5 monclient: authenticate success, global_id 184293 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5ee4eb0640 10 monclient: _renew_subs 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5ee4eb0640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/3524800667 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee013ae50 con 0x7f5ee00a8340 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5ee4eb0640 10 monclient: _renew_subs 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5ee4eb0640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/3524800667 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5ee012cff0 con 0x7f5ee00a8340 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ed0003b60 con 0x7f5ee00a8340 2024-09-13T10:40:49.361 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f5ed0004090 con 0x7f5ee00a8340 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5edcd99640 4 set_mon_vals no callback set 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.339+0000 7f5eceffd640 10 monclient: dump: 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.362 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.340+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f5ed00042e0 con 0x7f5ee00a8340 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.340+0000 7f5ee4eb0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.340+0000 7f5ee4eb0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.340+0000 7f5ee4eb0640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.340+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/3524800667 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec4005080 con 0x7f5ee00a8340 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.340+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f5ed004e1a0 con 0x7f5ee00a8340 2024-09-13T10:40:49.363 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.340+0000 7f5eddd9b640 10 monclient: get_auth_request con 0x7f5ec003fd40 auth_method 0 2024-09-13T10:40:49.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.345+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f5ed0017810 con 0x7f5ee00a8340 2024-09-13T10:40:49.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.345+0000 7f5eceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:49.364 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.345+0000 7f5eceffd640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:49.524 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.522+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/3524800667 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f5ec4000b90 con 0x7f5ec003fd40 2024-09-13T10:40:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.523+0000 7f5eceffd640 1 -- 172.21.15.181:0/3524800667 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7f5ec4000b90 con 0x7f5ec003fd40 2024-09-13T10:40:49.525 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T10:40:49.526 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.525+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/3524800667 >> v1:172.21.15.195:6800/1839191919 conn(0x7f5ec003fd40 legacy=0x7f5ec0042200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.525+0000 7f5ee4eb0640 10 monclient: shutdown 2024-09-13T10:40:49.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.525+0000 7f5ee4eb0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:49.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.525+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/3524800667 >> v1:172.21.15.181:6789/0 conn(0x7f5ee00a8340 legacy=0x7f5ee012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.525+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/3524800667 shutdown_connections 2024-09-13T10:40:49.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.525+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/3524800667 >> 172.21.15.181:0/3524800667 conn(0x7f5ee00a6640 msgr2=0x7f5ee00a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:49.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.525+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/3524800667 shutdown_connections 2024-09-13T10:40:49.527 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.525+0000 7f5ee4eb0640 1 -- 172.21.15.181:0/3524800667 wait complete. 2024-09-13T10:40:49.537 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T10:40:49.537 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T10:40:49.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.637+0000 7fdd30f56640 10 monclient: get_monmap_and_config 2024-09-13T10:40:49.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.637+0000 7fdd30f56640 10 monclient: build_initial_monmap 2024-09-13T10:40:49.640 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.637+0000 7fdd30f56640 10 monclient: monmap: 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:49.637942+0000 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:49.637942+0000 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:49.641 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.637+0000 7fdd30f56640 1 Processor -- start 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.637+0000 7fdd30f56640 1 -- start start 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.637+0000 7fdd30f56640 10 monclient: init 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.638+0000 7fdd30f56640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.638+0000 7fdd30f56640 10 monclient: _add_conns ranks=[4,0,1,2,6,8,5,7,3] 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.638+0000 7fdd30f56640 10 monclient(hunting): picked mon.noname-c con 0x7fdd2c0a66d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.638+0000 7fdd30f56640 10 monclient(hunting): picked mon.noname-a con 0x7fdd2c0a82d0 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.638+0000 7fdd30f56640 10 monclient(hunting): picked mon.noname-f con 0x7fdd2c13f7c0 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.638+0000 7fdd30f56640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2c0a4bc0 con 0x7fdd2c0a82d0 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.638+0000 7fdd30f56640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2c0a2f40 con 0x7fdd2c13f7c0 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.638+0000 7fdd30f56640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2c0a8090 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.642 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.638+0000 7fdd30f56640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:49.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.638+0000 7fdd30f56640 10 monclient(hunting): authenticate will time out at 1389.143615s 2024-09-13T10:40:49.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.638+0000 7fdd2a59c640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7fdd2c0a66d0 0x7fdd2c0a6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:35836/0 (socket says 172.21.15.181:35836) 2024-09-13T10:40:49.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.638+0000 7fdd2a59c640 1 -- 172.21.15.181:0/2333886564 learned_addr learned my addr 172.21.15.181:0/2333886564 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:49.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.640+0000 7fdd29d9b640 1 -- 172.21.15.181:0/2333886564 >> v1:172.21.15.181:6789/0 conn(0x7fdd2c0a82d0 legacy=0x7fdd2c0a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.640+0000 7fdd2a59c640 1 -- 172.21.15.181:0/2333886564 >> v1:172.21.15.181:6791/0 conn(0x7fdd2c0a66d0 legacy=0x7fdd2c0a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797368289 0 0) 0x7fdd2c0a8090 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient(hunting): my global_id is 174577 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd18003520 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3730075932 0 0) 0x7fdd2c0a4bc0 con 0x7fdd2c0a82d0 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient(hunting): my global_id is 184302 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd2c0a8090 con 0x7fdd2c0a82d0 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2ad9d640 1 -- 172.21.15.181:0/2333886564 >> v1:172.21.15.195:6789/0 conn(0x7fdd2c13f7c0 legacy=0x7fdd2c141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.647 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551900911 0 0) 0x7fdd2c0a2f40 con 0x7fdd2c13f7c0 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient(hunting): my global_id is 135307 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd2c0a4bc0 con 0x7fdd2c13f7c0 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 117551652 0 0) 0x7fdd18003520 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 >> v1:172.21.15.195:6789/0 conn(0x7fdd2c13f7c0 legacy=0x7fdd2c141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 >> v1:172.21.15.181:6789/0 conn(0x7fdd2c0a82d0 legacy=0x7fdd2c0a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient: _finish_hunting 0 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 monclient: found mon.noname-c 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.181:6791/0 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 --> v1:172.21.15.181:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c0a48e0 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.648 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient: _finish_auth 0 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient: _check_auth_tickets 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdd14001ad0 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd30f56640 5 monclient: authenticate success, global_id 174577 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd30f56640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient: dump: 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.649 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.650 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.650 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.650 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.650 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.650 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.650 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.650 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.650 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.650 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.650 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd30f56640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 <== mon.4 v1:172.21.15.181:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd14001d20 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd30f56640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 1 -- 172.21.15.181:0/2333886564 <== mon.4 v1:172.21.15.181:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdd14004be0 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd30f56640 4 set_mon_vals no callback set 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.641+0000 7fdd2959a640 10 monclient: dump: 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.651 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.642+0000 7fdd30f56640 10 monclient: shutdown 2024-09-13T10:40:49.652 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.642+0000 7fdd30f56640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.642+0000 7fdd30f56640 1 -- 172.21.15.181:0/2333886564 >> v1:172.21.15.181:6791/0 conn(0x7fdd2c0a66d0 legacy=0x7fdd2c0a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.642+0000 7fdd30f56640 1 -- 172.21.15.181:0/2333886564 shutdown_connections 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.642+0000 7fdd30f56640 1 -- 172.21.15.181:0/2333886564 >> 172.21.15.181:0/2333886564 conn(0x7fdd2c0abcd0 msgr2=0x7fdd2c0ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.642+0000 7fdd30f56640 1 -- 172.21.15.181:0/2333886564 shutdown_connections 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.642+0000 7fdd30f56640 1 -- 172.21.15.181:0/2333886564 wait complete. 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.642+0000 7fdd30f56640 10 monclient: build_initial_monmap 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.642+0000 7fdd30f56640 10 monclient: monmap: 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:49.653 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:49.654 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:49.654 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:49.654 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:49.654 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:49.654 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:49.654 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:49.654 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:49.654 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:49.654 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:49.654 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 1 Processor -- start 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 1 -- start start 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 10 monclient: init 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 10 monclient: _add_conns ranks=[5,2,7,6,3,0,4,1,8] 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 10 monclient(hunting): picked mon.noname-h con 0x7fdd2c0a66d0 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 10 monclient(hunting): picked mon.noname-b con 0x7fdd2c0a82d0 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 10 monclient(hunting): picked mon.noname-i con 0x7fdd2c13f7c0 addr v1:172.21.15.195:6792/0 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2c125150 con 0x7fdd2c0a82d0 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2c13dd60 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2c0aaea0 con 0x7fdd2c13f7c0 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd30f56640 10 monclient(hunting): authenticate will time out at 1389.148772s 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd29d9b640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7fdd2c0a82d0 0x7fdd2c1d3520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:51476/0 (socket says 172.21.15.181:51476) 2024-09-13T10:40:49.655 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.643+0000 7fdd29d9b640 1 -- 172.21.15.181:0/1292411106 learned_addr learned my addr 172.21.15.181:0/1292411106 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.645+0000 7fdd29d9b640 1 -- 172.21.15.181:0/1292411106 >> v1:172.21.15.181:6790/0 conn(0x7fdd2c0a82d0 legacy=0x7fdd2c1d3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd2a59c640 1 -- 172.21.15.181:0/1292411106 >> v1:172.21.15.195:6791/0 conn(0x7fdd2c0a66d0 legacy=0x7fdd2c13d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd29d9b640 1 --1- 172.21.15.181:0/1292411106 >> v1:172.21.15.181:6790/0 conn(0x7fdd2c0a82d0 0x7fdd2c1d3520 :-1 s=OPENED pgs=562 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7fdd2c125150 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd2ad9d640 1 -- 172.21.15.181:0/1292411106 >> v1:172.21.15.195:6792/0 conn(0x7fdd2c13f7c0 legacy=0x7fdd2c1d6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.5 v1:172.21.15.195:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228243679 0 0) 0x7fdd2c13dd60 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): my global_id is 106241 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 --> v1:172.21.15.195:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd0c003520 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207335908 0 0) 0x7fdd2c0a4bc0 con 0x7fdd2c13f7c0 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.659 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): my global_id is 58255 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd2c13dd60 con 0x7fdd2c13f7c0 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.5 v1:172.21.15.195:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2692749295 0 0) 0x7fdd0c003520 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 --> v1:172.21.15.195:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd2c0a4bc0 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.5 v1:172.21.15.195:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdd14004b20 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): dump: 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.660 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:49.661 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.7 v1:172.21.15.195:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1421049459 0 0) 0x7fdd2c13dd60 con 0x7fdd2c13f7c0 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 --> v1:172.21.15.195:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd0c003520 con 0x7fdd2c13f7c0 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.7 v1:172.21.15.195:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdd24001ff0 con 0x7fdd2c13f7c0 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient(hunting): dump: 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.662 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.5 v1:172.21.15.195:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 643112974 0 0) 0x7fdd2c0a4bc0 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 >> v1:172.21.15.195:6792/0 conn(0x7fdd2c13f7c0 legacy=0x7fdd2c1d6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 >> v1:172.21.15.181:6790/0 conn(0x7fdd2c0a82d0 legacy=0x7fdd2c1d3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient: _finish_hunting 0 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 monclient: found mon.h 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:49.663 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 --> v1:172.21.15.195:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c0aaae0 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient: _finish_auth 0 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient: _check_auth_tickets 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd30f56640 5 monclient: authenticate success, global_id 106241 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490231837 0 0) 0x7fdd2c125150 con 0x7fdd2c0a82d0 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd30f56640 10 monclient: _renew_subs 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd30f56640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd30f56640 1 -- 172.21.15.181:0/1292411106 --> v1:172.21.15.195:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2c125720 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd30f56640 10 monclient: _renew_subs 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd30f56640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd30f56640 1 -- 172.21.15.181:0/1292411106 --> v1:172.21.15.195:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fdd2c13e780 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.664 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.5 v1:172.21.15.195:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd14001b30 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.5 v1:172.21.15.195:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fdd14001d20 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd28d99640 4 set_mon_vals no callback set 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.646+0000 7fdd22ffd640 10 monclient: dump: 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.665 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.647+0000 7fdd30f56640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.195:6791/0 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.647+0000 7fdd30f56640 1 -- 172.21.15.181:0/1292411106 --> v1:172.21.15.195:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fdd10000f80 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.647+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.5 v1:172.21.15.195:6791/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fdd140119b0 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.648+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.5 v1:172.21.15.195:6791/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7fdd1404e1f0 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.648+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 --> v1:172.21.15.195:6801/2714505324 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd0c04a840 con 0x7fdd0c046bd0 2024-09-13T10:40:49.666 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.648+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== mon.5 v1:172.21.15.195:6791/0 9 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (unknown 1450749824 0 0) 0x7fdd1404e660 con 0x7fdd2c0a66d0 2024-09-13T10:40:49.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.648+0000 7fdd22ffd640 10 monclient: handle_get_version_reply finishing 1 version 331 2024-09-13T10:40:49.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.648+0000 7fdd29d9b640 10 monclient: get_auth_request con 0x7fdd0c03ff80 auth_method 0 2024-09-13T10:40:49.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.648+0000 7fdd2ad9d640 10 monclient: get_auth_request con 0x7fdd0c046bd0 auth_method 0 2024-09-13T10:40:49.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.653+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== osd.5 v1:172.21.15.195:6801/2714505324 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fdd0c04a840 con 0x7fdd0c046bd0 2024-09-13T10:40:49.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.666+0000 7fdd30f56640 1 -- 172.21.15.181:0/1292411106 --> v1:172.21.15.195:6801/2714505324 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdd10002cd0 con 0x7fdd0c046bd0 2024-09-13T10:40:49.669 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.667+0000 7fdd22ffd640 1 -- 172.21.15.181:0/1292411106 <== osd.5 v1:172.21.15.195:6801/2714505324 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fdd10002cd0 con 0x7fdd0c046bd0 2024-09-13T10:40:49.669 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-09-13T10:40:49.669 INFO:teuthology.orchestra.run.smithi181.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T10:40:49.670 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-09-13T10:40:49.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.667+0000 7fdd30f56640 1 -- 172.21.15.181:0/1292411106 >> v1:172.21.15.195:6801/2714505324 conn(0x7fdd0c046bd0 legacy=0x7fdd0c048ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.667+0000 7fdd30f56640 1 -- 172.21.15.181:0/1292411106 >> v1:172.21.15.195:6800/1839191919 conn(0x7fdd0c03ff80 legacy=0x7fdd0c042440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.671 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.667+0000 7fdd30f56640 10 monclient: shutdown 2024-09-13T10:40:49.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.667+0000 7fdd30f56640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:49.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.667+0000 7fdd30f56640 1 -- 172.21.15.181:0/1292411106 >> v1:172.21.15.195:6791/0 conn(0x7fdd2c0a66d0 legacy=0x7fdd2c13d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.667+0000 7fdd2ad9d640 1 -- 172.21.15.181:0/1292411106 reap_dead start 2024-09-13T10:40:49.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.667+0000 7fdd30f56640 1 -- 172.21.15.181:0/1292411106 shutdown_connections 2024-09-13T10:40:49.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.667+0000 7fdd30f56640 1 -- 172.21.15.181:0/1292411106 >> 172.21.15.181:0/1292411106 conn(0x7fdd2c0abcd0 msgr2=0x7fdd2c0a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:49.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.668+0000 7fdd30f56640 1 -- 172.21.15.181:0/1292411106 shutdown_connections 2024-09-13T10:40:49.672 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.668+0000 7fdd30f56640 1 -- 172.21.15.181:0/1292411106 wait complete. 2024-09-13T10:40:49.682 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T10:40:49.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.780+0000 7f08667bb640 10 monclient: get_monmap_and_config 2024-09-13T10:40:49.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.780+0000 7f08667bb640 10 monclient: build_initial_monmap 2024-09-13T10:40:49.781 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.780+0000 7f08667bb640 10 monclient: monmap: 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:49.780788+0000 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:49.780788+0000 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:49.782 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:49.783 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:49.783 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:49.783 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.780+0000 7f08667bb640 1 Processor -- start 2024-09-13T10:40:49.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.780+0000 7f08667bb640 1 -- start start 2024-09-13T10:40:49.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.780+0000 7f08667bb640 10 monclient: init 2024-09-13T10:40:49.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.781+0000 7f08667bb640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:49.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.781+0000 7f08667bb640 10 monclient: _add_conns ranks=[5,3,6,8,4,1,7,0,2] 2024-09-13T10:40:49.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.781+0000 7f08667bb640 10 monclient(hunting): picked mon.noname-h con 0x7f08600a6640 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:49.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.781+0000 7f08667bb640 10 monclient(hunting): picked mon.noname-g con 0x7f08600a8340 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:49.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.781+0000 7f08667bb640 10 monclient(hunting): picked mon.noname-d con 0x7f086013f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:49.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.781+0000 7f08667bb640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08600a4bc0 con 0x7f08600a8340 2024-09-13T10:40:49.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.781+0000 7f08667bb640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086013a320 con 0x7f08600a6640 2024-09-13T10:40:49.784 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.781+0000 7f08667bb640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08600a8100 con 0x7f086013f750 2024-09-13T10:40:49.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.781+0000 7f08667bb640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:49.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.781+0000 7f08667bb640 10 monclient(hunting): authenticate will time out at 1389.286492s 2024-09-13T10:40:49.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.781+0000 7f0864d58640 1 --1- >> v1:172.21.15.181:6792/0 conn(0x7f086013f750 0x7f0860141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6792/0 says I am v1:172.21.15.181:55418/0 (socket says 172.21.15.181:55418) 2024-09-13T10:40:49.785 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.781+0000 7f0864d58640 1 -- 172.21.15.181:0/145170500 learned_addr learned my addr 172.21.15.181:0/145170500 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:49.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.783+0000 7f0864d58640 1 -- 172.21.15.181:0/145170500 >> v1:172.21.15.181:6792/0 conn(0x7f086013f750 legacy=0x7f0860141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085ffff640 1 -- 172.21.15.181:0/145170500 >> v1:172.21.15.195:6791/0 conn(0x7f08600a6640 legacy=0x7f0860139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085f7fe640 1 -- 172.21.15.181:0/145170500 >> v1:172.21.15.195:6790/0 conn(0x7f08600a8340 legacy=0x7f0860139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 1 -- 172.21.15.181:0/145170500 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3403759234 0 0) 0x7f08600a8100 con 0x7f086013f750 2024-09-13T10:40:49.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.788 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient(hunting): my global_id is 174579 2024-09-13T10:40:49.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 1 -- 172.21.15.181:0/145170500 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0848003520 con 0x7f086013f750 2024-09-13T10:40:49.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 1 -- 172.21.15.181:0/145170500 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1316418525 0 0) 0x7f0848003520 con 0x7f086013f750 2024-09-13T10:40:49.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 1 -- 172.21.15.181:0/145170500 >> v1:172.21.15.195:6791/0 conn(0x7f08600a6640 legacy=0x7f0860139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 1 -- 172.21.15.181:0/145170500 >> v1:172.21.15.195:6790/0 conn(0x7f08600a8340 legacy=0x7f0860139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient: _finish_hunting 0 2024-09-13T10:40:49.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 1 monclient: found mon.noname-d 2024-09-13T10:40:49.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:49.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.181:6792/0 2024-09-13T10:40:49.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 1 -- 172.21.15.181:0/145170500 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08600a48e0 con 0x7f086013f750 2024-09-13T10:40:49.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient: _finish_auth 0 2024-09-13T10:40:49.789 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient: _check_auth_tickets 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 1 -- 172.21.15.181:0/145170500 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0858001e60 con 0x7f086013f750 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient: dump: 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.790 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f08667bb640 5 monclient: authenticate success, global_id 174579 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f08667bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 1 -- 172.21.15.181:0/145170500 <== mon.6 v1:172.21.15.181:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0858004c20 con 0x7f086013f750 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 1 -- 172.21.15.181:0/145170500 <== mon.6 v1:172.21.15.181:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0858005190 con 0x7f086013f750 2024-09-13T10:40:49.791 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f08667bb640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f08667bb640 4 set_mon_vals no callback set 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f085effd640 10 monclient: dump: 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.792 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f08667bb640 10 monclient: shutdown 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f08667bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f08667bb640 1 -- 172.21.15.181:0/145170500 >> v1:172.21.15.181:6792/0 conn(0x7f086013f750 legacy=0x7f0860141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f08667bb640 1 -- 172.21.15.181:0/145170500 shutdown_connections 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.784+0000 7f08667bb640 1 -- 172.21.15.181:0/145170500 >> 172.21.15.181:0/145170500 conn(0x7f0860077170 msgr2=0x7f08600abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.785+0000 7f08667bb640 1 -- 172.21.15.181:0/145170500 shutdown_connections 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.785+0000 7f08667bb640 1 -- 172.21.15.181:0/145170500 wait complete. 2024-09-13T10:40:49.793 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.785+0000 7f08667bb640 10 monclient: build_initial_monmap 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.785+0000 7f08667bb640 10 monclient: monmap: 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:49.794 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.785+0000 7f08667bb640 1 Processor -- start 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f08667bb640 1 -- start start 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f08667bb640 10 monclient: init 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f08667bb640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f08667bb640 10 monclient: _add_conns ranks=[2,1,6,8,7,5,4,0,3] 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f08667bb640 10 monclient(hunting): picked mon.noname-b con 0x7f08600a8340 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f08667bb640 10 monclient(hunting): picked mon.noname-f con 0x7f086013f750 addr v1:172.21.15.195:6789/0 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f08667bb640 10 monclient(hunting): picked mon.noname-d con 0x7f0860142420 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f08667bb640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086013aa90 con 0x7f086013f750 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f08667bb640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086013c430 con 0x7f08600a8340 2024-09-13T10:40:49.795 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f08667bb640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086013ac90 con 0x7f0860142420 2024-09-13T10:40:49.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f08667bb640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:49.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f08667bb640 10 monclient(hunting): authenticate will time out at 1389.291650s 2024-09-13T10:40:49.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f085ffff640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f08600a8340 0x7f086012c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:51480/0 (socket says 172.21.15.181:51480) 2024-09-13T10:40:49.796 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.786+0000 7f085ffff640 1 -- 172.21.15.181:0/1867582466 learned_addr learned my addr 172.21.15.181:0/1867582466 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:49.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.788+0000 7f0864d58640 1 -- 172.21.15.181:0/1867582466 >> v1:172.21.15.181:6792/0 conn(0x7f0860142420 legacy=0x7f08601d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.788+0000 7f085ffff640 1 -- 172.21.15.181:0/1867582466 >> v1:172.21.15.181:6790/0 conn(0x7f08600a8340 legacy=0x7f086012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.788+0000 7f085f7fe640 1 -- 172.21.15.181:0/1867582466 >> v1:172.21.15.195:6789/0 conn(0x7f086013f750 legacy=0x7f08601d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:49.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.788+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418305165 0 0) 0x7f086013ac90 con 0x7f0860142420 2024-09-13T10:40:49.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.788+0000 7f085cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.788+0000 7f085cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.788+0000 7f085cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.788+0000 7f085cff9640 10 monclient(hunting): my global_id is 174588 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.788+0000 7f085f7fe640 1 -- 172.21.15.181:0/1867582466 >> v1:172.21.15.195:6789/0 conn(0x7f086013f750 legacy=0x7f08601d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.788+0000 7f085f7fe640 1 -- 172.21.15.181:0/1867582466 >> v1:172.21.15.195:6789/0 conn(0x7f086013f750 legacy=0x7f08601d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.789+0000 7f085f7fe640 1 --1- 172.21.15.181:0/1867582466 >> v1:172.21.15.195:6789/0 conn(0x7f086013f750 0x7f08601d3720 :-1 s=OPENED pgs=886 cs=1 l=1).handle_message read tag failed 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.789+0000 7f085f7fe640 1 --1- 172.21.15.181:0/1867582466 >> v1:172.21.15.195:6789/0 conn(0x7f086013f750 0x7f08601d3720 :-1 s=OPENED pgs=886 cs=1 l=1).fault on lossy channel, failing 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.789+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f084c003550 con 0x7f0860142420 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.789+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 DispatchQueue::entry inject delay of 0.002000 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.195:6789/0 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116632052 0 0) 0x7f086013c430 con 0x7f08600a8340 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient(hunting): _negotiate 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:49.800 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient(hunting): my global_id is 174521 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f086013ac90 con 0x7f08600a8340 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 <== mon.6 v1:172.21.15.181:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 168453428 0 0) 0x7f084c003550 con 0x7f0860142420 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 --> v1:172.21.15.181:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f086013c430 con 0x7f0860142420 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 <== mon.6 v1:172.21.15.181:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f08580020b0 con 0x7f0860142420 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient(hunting): dump: 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.801 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 <== mon.6 v1:172.21.15.181:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 576768971 0 0) 0x7f086013c430 con 0x7f0860142420 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 >> v1:172.21.15.181:6790/0 conn(0x7f08600a8340 legacy=0x7f086012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.802 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 >> v1:172.21.15.195:6789/0 conn(0x7f086013f750 legacy=0x7f08601d3720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient: _finish_hunting 0 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 1 monclient: found mon.d 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 --> v1:172.21.15.181:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086013c710 con 0x7f0860142420 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient: _finish_auth 0 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient: _check_auth_tickets 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f08667bb640 5 monclient: authenticate success, global_id 174588 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f08667bb640 10 monclient: _renew_subs 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f08667bb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f08667bb640 1 -- 172.21.15.181:0/1867582466 --> v1:172.21.15.181:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f086013c150 con 0x7f0860142420 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f08667bb640 10 monclient: _renew_subs 2024-09-13T10:40:49.803 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f08667bb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f08667bb640 1 -- 172.21.15.181:0/1867582466 --> v1:172.21.15.181:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f086012ce10 con 0x7f0860142420 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 <== mon.6 v1:172.21.15.181:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f08580053c0 con 0x7f0860142420 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 <== mon.6 v1:172.21.15.181:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f0858004c20 con 0x7f0860142420 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085e7fc640 4 set_mon_vals no callback set 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.791+0000 7f085cff9640 10 monclient: dump: 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:49.804 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.792+0000 7f08667bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.792+0000 7f08667bb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:49.805 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.792+0000 7f08667bb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.181:6792/0 2024-09-13T10:40:49.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.792+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 <== mon.6 v1:172.21.15.181:6792/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f0858011d90 con 0x7f0860142420 2024-09-13T10:40:49.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.792+0000 7f08667bb640 1 -- 172.21.15.181:0/1867582466 --> v1:172.21.15.181:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0840005080 con 0x7f0860142420 2024-09-13T10:40:49.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.792+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 <== mon.6 v1:172.21.15.181:6792/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f085804e390 con 0x7f0860142420 2024-09-13T10:40:49.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.793+0000 7f085ffff640 10 monclient: get_auth_request con 0x7f084c03fbe0 auth_method 0 2024-09-13T10:40:49.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.797+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 <== mon.6 v1:172.21.15.181:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f08580179c0 con 0x7f0860142420 2024-09-13T10:40:49.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.797+0000 7f085cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:49.806 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.797+0000 7f085cff9640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:49.973 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.972+0000 7f08667bb640 1 -- 172.21.15.181:0/1867582466 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f0840000b90 con 0x7f084c03fbe0 2024-09-13T10:40:49.974 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.972+0000 7f085cff9640 1 -- 172.21.15.181:0/1867582466 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7f0840000b90 con 0x7f084c03fbe0 2024-09-13T10:40:49.974 INFO:teuthology.orchestra.run.smithi181.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T10:40:49.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.974+0000 7f08667bb640 1 -- 172.21.15.181:0/1867582466 >> v1:172.21.15.195:6800/1839191919 conn(0x7f084c03fbe0 legacy=0x7f084c0420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.974+0000 7f08667bb640 10 monclient: shutdown 2024-09-13T10:40:49.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.975+0000 7f08667bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:49.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.975+0000 7f08667bb640 1 -- 172.21.15.181:0/1867582466 >> v1:172.21.15.181:6792/0 conn(0x7f0860142420 legacy=0x7f08601d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:49.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.975+0000 7f08667bb640 1 -- 172.21.15.181:0/1867582466 shutdown_connections 2024-09-13T10:40:49.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.975+0000 7f08667bb640 1 -- 172.21.15.181:0/1867582466 >> 172.21.15.181:0/1867582466 conn(0x7f08600a6640 msgr2=0x7f08600a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:49.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.975+0000 7f08667bb640 1 -- 172.21.15.181:0/1867582466 shutdown_connections 2024-09-13T10:40:49.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:49.975+0000 7f08667bb640 1 -- 172.21.15.181:0/1867582466 wait complete. 2024-09-13T10:40:49.987 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T10:40:50.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.082+0000 7fae713ec640 10 monclient: get_monmap_and_config 2024-09-13T10:40:50.084 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.082+0000 7fae713ec640 10 monclient: build_initial_monmap 2024-09-13T10:40:50.085 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.082+0000 7fae713ec640 10 monclient: monmap: 2024-09-13T10:40:50.085 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:50.085 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:50.085 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:40:50.083306+0000 2024-09-13T10:40:50.085 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:40:50.083306+0000 2024-09-13T10:40:50.085 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:50.085 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:50.085 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:50.085 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:50.085 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:50.085 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:50.085 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:50.086 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:50.086 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:50.086 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:50.086 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:50.086 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:50.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 1 Processor -- start 2024-09-13T10:40:50.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 1 -- start start 2024-09-13T10:40:50.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 10 monclient: init 2024-09-13T10:40:50.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:50.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 10 monclient: _add_conns ranks=[0,5,6,4,2,8,3,7,1] 2024-09-13T10:40:50.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 10 monclient(hunting): picked mon.noname-a con 0x7fae6c0a6640 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:50.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 10 monclient(hunting): picked mon.noname-h con 0x7fae6c0a8340 addr v1:172.21.15.195:6791/0 2024-09-13T10:40:50.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 10 monclient(hunting): picked mon.noname-d con 0x7fae6c13f750 addr v1:172.21.15.181:6792/0 2024-09-13T10:40:50.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6c0a4bc0 con 0x7fae6c0a6640 2024-09-13T10:40:50.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6c13a320 con 0x7fae6c0a8340 2024-09-13T10:40:50.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 1 -- --> v1:172.21.15.181:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6c0a8100 con 0x7fae6c13f750 2024-09-13T10:40:50.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:50.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae713ec640 10 monclient(hunting): authenticate will time out at 1389.588856s 2024-09-13T10:40:50.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae6affd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fae6c0a6640 0x7fae6c139500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50912/0 (socket says 172.21.15.181:50912) 2024-09-13T10:40:50.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.083+0000 7fae6affd640 1 -- 172.21.15.181:0/39297253 learned_addr learned my addr 172.21.15.181:0/39297253 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:50.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6b7fe640 1 -- 172.21.15.181:0/39297253 >> v1:172.21.15.181:6792/0 conn(0x7fae6c13f750 legacy=0x7fae6c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:50.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6affd640 1 -- 172.21.15.181:0/39297253 >> v1:172.21.15.181:6789/0 conn(0x7fae6c0a6640 legacy=0x7fae6c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:50.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 1 -- 172.21.15.181:0/39297253 <== mon.6 v1:172.21.15.181:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2051761327 0 0) 0x7fae6c0a8100 con 0x7fae6c13f750 2024-09-13T10:40:50.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:50.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:50.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:50.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient(hunting): my global_id is 174597 2024-09-13T10:40:50.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 1 -- 172.21.15.181:0/39297253 --> v1:172.21.15.181:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae58003520 con 0x7fae6c13f750 2024-09-13T10:40:50.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 1 -- 172.21.15.181:0/39297253 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950067936 0 0) 0x7fae6c0a4bc0 con 0x7fae6c0a6640 2024-09-13T10:40:50.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient(hunting): _negotiate 2024-09-13T10:40:50.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:50.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:50.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient(hunting): my global_id is 184311 2024-09-13T10:40:50.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 1 -- 172.21.15.181:0/39297253 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae6c0a8100 con 0x7fae6c0a6640 2024-09-13T10:40:50.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae627fc640 1 -- 172.21.15.181:0/39297253 >> v1:172.21.15.195:6791/0 conn(0x7fae6c0a8340 legacy=0x7fae6c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:50.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 1 -- 172.21.15.181:0/39297253 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3060054633 0 0) 0x7fae6c0a8100 con 0x7fae6c0a6640 2024-09-13T10:40:50.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 1 -- 172.21.15.181:0/39297253 >> v1:172.21.15.181:6792/0 conn(0x7fae6c13f750 legacy=0x7fae6c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:50.098 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 1 -- 172.21.15.181:0/39297253 >> v1:172.21.15.195:6791/0 conn(0x7fae6c0a8340 legacy=0x7fae6c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient: _finish_hunting 0 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 1 monclient: found mon.noname-a 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 1 -- 172.21.15.181:0/39297253 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c0a48e0 con 0x7fae6c0a6640 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient: _finish_auth 0 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient: _check_auth_tickets 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 1 -- 172.21.15.181:0/39297253 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae5c001ac0 con 0x7fae6c0a6640 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae713ec640 5 monclient: authenticate success, global_id 184311 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae713ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:50.099 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient: dump: 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:50.100 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae713ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 1 -- 172.21.15.181:0/39297253 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae5c0048a0 con 0x7fae6c0a6640 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae713ec640 10 monclient: get_monmap_and_config success 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 1 -- 172.21.15.181:0/39297253 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae5c004dd0 con 0x7fae6c0a6640 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae713ec640 4 set_mon_vals no callback set 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.086+0000 7fae6a7fc640 10 monclient: dump: 2024-09-13T10:40:50.101 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:50.102 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:50.102 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:50.102 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:50.102 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:50.102 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:50.102 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:50.102 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:50.102 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:50.102 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:50.103 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:50.103 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:50.103 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:50.103 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:50.103 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:50.103 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:50.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.087+0000 7fae713ec640 10 monclient: shutdown 2024-09-13T10:40:50.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.087+0000 7fae713ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:50.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.087+0000 7fae713ec640 1 -- 172.21.15.181:0/39297253 >> v1:172.21.15.181:6789/0 conn(0x7fae6c0a6640 legacy=0x7fae6c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:50.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.087+0000 7fae713ec640 1 -- 172.21.15.181:0/39297253 shutdown_connections 2024-09-13T10:40:50.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.087+0000 7fae713ec640 1 -- 172.21.15.181:0/39297253 >> 172.21.15.181:0/39297253 conn(0x7fae6c077170 msgr2=0x7fae6c0abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:50.103 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.087+0000 7fae713ec640 1 -- 172.21.15.181:0/39297253 shutdown_connections 2024-09-13T10:40:50.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.087+0000 7fae713ec640 1 -- 172.21.15.181:0/39297253 wait complete. 2024-09-13T10:40:50.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.087+0000 7fae713ec640 10 monclient: build_initial_monmap 2024-09-13T10:40:50.104 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.087+0000 7fae713ec640 10 monclient: monmap: 2024-09-13T10:40:50.104 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:40:50.104 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:40:50.104 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:40:50.104 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:40:50.104 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:40:50.105 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:40:50.105 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:40:50.105 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:40:50.105 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:40:50.105 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:40:50.105 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:40:50.105 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:40:50.105 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:40:50.105 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:40:50.105 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:40:50.105 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:50.105 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 1 Processor -- start 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 1 -- start start 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 10 monclient: init 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 10 monclient: _reopen_session rank -1 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 10 monclient: _add_conns ranks=[0,3,2,4,8,5,1,7,6] 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 10 monclient(hunting): picked mon.noname-a con 0x7fae6c0a8340 addr v1:172.21.15.181:6789/0 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 10 monclient(hunting): picked mon.noname-g con 0x7fae6c13f750 addr v1:172.21.15.195:6790/0 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 10 monclient(hunting): picked mon.noname-b con 0x7fae6c1d4310 addr v1:172.21.15.181:6790/0 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6c070700 con 0x7fae6c0a8340 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6c0a0fe0 con 0x7fae6c1d4310 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6c0a12c0 con 0x7fae6c13f750 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 10 monclient(hunting): _renew_subs 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae713ec640 10 monclient(hunting): authenticate will time out at 1389.593764s 2024-09-13T10:40:50.106 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae6affd640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fae6c0a8340 0x7fae6c09d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:50920/0 (socket says 172.21.15.181:50920) 2024-09-13T10:40:50.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.088+0000 7fae6affd640 1 -- 172.21.15.181:0/3728929531 learned_addr learned my addr 172.21.15.181:0/3728929531 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:40:50.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.090+0000 7fae6affd640 1 -- 172.21.15.181:0/3728929531 >> v1:172.21.15.181:6789/0 conn(0x7fae6c0a8340 legacy=0x7fae6c09d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:50.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.090+0000 7fae6b7fe640 1 -- 172.21.15.181:0/3728929531 >> v1:172.21.15.181:6790/0 conn(0x7fae6c1d4310 legacy=0x7fae6c1d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:50.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 99590329 0 0) 0x7fae6c0a48e0 con 0x7fae6c0a8340 2024-09-13T10:40:50.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:50.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:50.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:50.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): my global_id is 184320 2024-09-13T10:40:50.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae4c003550 con 0x7fae6c0a8340 2024-09-13T10:40:50.107 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 906544271 0 0) 0x7fae6c0a0fe0 con 0x7fae6c1d4310 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): my global_id is 174530 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae6c0a48e0 con 0x7fae6c1d4310 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae627fc640 1 -- 172.21.15.181:0/3728929531 >> v1:172.21.15.195:6790/0 conn(0x7fae6c13f750 legacy=0x7fae6c09dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1969958385 0 0) 0x7fae4c003550 con 0x7fae6c0a8340 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 --> v1:172.21.15.181:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae6c0a0fe0 con 0x7fae6c0a8340 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae5c004d90 con 0x7fae6c0a8340 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): dump: 2024-09-13T10:40:50.108 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:50.109 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:50.110 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:50.110 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:50.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:40:50.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3809255814 0 0) 0x7fae6c0a48e0 con 0x7fae6c1d4310 2024-09-13T10:40:50.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae4c003550 con 0x7fae6c1d4310 2024-09-13T10:40:50.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae64003cd0 con 0x7fae6c1d4310 2024-09-13T10:40:50.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:40:50.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:40:50.110 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): dump: 2024-09-13T10:40:50.110 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:50.110 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:50.110 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:50.111 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.3 v1:172.21.15.195:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2279823168 0 0) 0x7fae6c0a12c0 con 0x7fae6c13f750 2024-09-13T10:40:50.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): _negotiate 2024-09-13T10:40:50.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:40:50.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:40:50.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient(hunting): my global_id is 184269 2024-09-13T10:40:50.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 --> v1:172.21.15.195:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae6c0a48e0 con 0x7fae6c13f750 2024-09-13T10:40:50.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.0 v1:172.21.15.181:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2942726866 0 0) 0x7fae6c0a0fe0 con 0x7fae6c0a8340 2024-09-13T10:40:50.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 >> v1:172.21.15.195:6790/0 conn(0x7fae6c13f750 legacy=0x7fae6c09dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:50.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 >> v1:172.21.15.181:6790/0 conn(0x7fae6c1d4310 legacy=0x7fae6c1d6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:50.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient: _finish_hunting 0 2024-09-13T10:40:50.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 monclient: found mon.a 2024-09-13T10:40:50.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:40:50.112 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:50.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c0a9f80 con 0x7fae6c0a8340 2024-09-13T10:40:50.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient: _finish_auth 0 2024-09-13T10:40:50.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient: _check_auth_tickets 2024-09-13T10:40:50.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:40:50.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae713ec640 5 monclient: authenticate success, global_id 184320 2024-09-13T10:40:50.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae713ec640 10 monclient: _renew_subs 2024-09-13T10:40:50.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae713ec640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:50.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae713ec640 1 -- 172.21.15.181:0/3728929531 --> v1:172.21.15.181:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fae6c09e460 con 0x7fae6c0a8340 2024-09-13T10:40:50.113 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae713ec640 10 monclient: _renew_subs 2024-09-13T10:40:50.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae713ec640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:50.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae713ec640 1 -- 172.21.15.181:0/3728929531 --> v1:172.21.15.181:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fae6c0a16e0 con 0x7fae6c0a8340 2024-09-13T10:40:50.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.0 v1:172.21.15.181:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae5c0048a0 con 0x7fae6c0a8340 2024-09-13T10:40:50.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:40:50.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.0 v1:172.21.15.181:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7fae5c001ae0 con 0x7fae6c0a8340 2024-09-13T10:40:50.114 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae69ffb640 4 set_mon_vals no callback set 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.091+0000 7fae63fff640 10 monclient: dump: 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:40:50.115 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:40:50.116 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:40:50.116 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:40:50.116 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:40:50.116 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:40:50.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.092+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.0 v1:172.21.15.181:6789/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7fae5c011be0 con 0x7fae6c0a8340 2024-09-13T10:40:50.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.092+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.0 v1:172.21.15.181:6789/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7fae5c04e2a0 con 0x7fae6c0a8340 2024-09-13T10:40:50.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.092+0000 7fae713ec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:50.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.092+0000 7fae713ec640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:50.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.092+0000 7fae713ec640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.181:6789/0 2024-09-13T10:40:50.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.092+0000 7fae713ec640 1 -- 172.21.15.181:0/3728929531 --> v1:172.21.15.181:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae50005080 con 0x7fae6c0a8340 2024-09-13T10:40:50.116 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.092+0000 7fae627fc640 10 monclient: get_auth_request con 0x7fae4c040040 auth_method 0 2024-09-13T10:40:50.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.097+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mon.0 v1:172.21.15.181:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7fae6c070700 con 0x7fae6c0a8340 2024-09-13T10:40:50.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.097+0000 7fae63fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:40:50.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.097+0000 7fae63fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:40:50.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.266+0000 7fae713ec640 1 -- 172.21.15.181:0/3728929531 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae50000b90 con 0x7fae4c040040 2024-09-13T10:40:50.268 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.267+0000 7fae63fff640 1 -- 172.21.15.181:0/3728929531 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33830 (unknown 2965378022 0 1448851405) 0x7fae50000b90 con 0x7fae4c040040 2024-09-13T10:40:50.269 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:40:50.269 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-13T10:40:50.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.269+0000 7fae713ec640 1 -- 172.21.15.181:0/3728929531 >> v1:172.21.15.195:6800/1839191919 conn(0x7fae4c040040 legacy=0x7fae4c042500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:50.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.269+0000 7fae713ec640 10 monclient: shutdown 2024-09-13T10:40:50.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.269+0000 7fae713ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:40:50.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.269+0000 7fae713ec640 1 -- 172.21.15.181:0/3728929531 >> v1:172.21.15.181:6789/0 conn(0x7fae6c0a8340 legacy=0x7fae6c09d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:40:50.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.269+0000 7fae713ec640 1 -- 172.21.15.181:0/3728929531 shutdown_connections 2024-09-13T10:40:50.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.269+0000 7fae713ec640 1 -- 172.21.15.181:0/3728929531 >> 172.21.15.181:0/3728929531 conn(0x7fae6c0a6640 msgr2=0x7fae6c141fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:40:50.271 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.269+0000 7fae713ec640 1 -- 172.21.15.181:0/3728929531 shutdown_connections 2024-09-13T10:40:50.272 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:40:50.269+0000 7fae713ec640 1 -- 172.21.15.181:0/3728929531 wait complete. 2024-09-13T10:40:50.281 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":652,"stamp":"2024-09-13T10:40:49.987779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":206560,"kb_used_data":19456,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566024480,"statfs":{"total":579820584960,"available":579609067520,"internally_reserved":0,"allocated":19922944,"data_stored":9435130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":191486624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002122"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":641,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611249+0000","last_change":"2024-09-13T10:30:24.839549+0000","last_active":"2024-09-13T10:40:32.611249+0000","last_peered":"2024-09-13T10:40:32.611249+0000","last_clean":"2024-09-13T10:40:32.611249+0000","last_became_active":"2024-09-13T10:30:22.828862+0000","last_became_peered":"2024-09-13T10:30:22.828862+0000","last_unstale":"2024-09-13T10:40:32.611249+0000","last_undegraded":"2024-09-13T10:40:32.611249+0000","last_fullsized":"2024-09-13T10:40:32.611249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:07.535710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013355629999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":645,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.764929+0000","last_change":"2024-09-13T10:30:24.834024+0000","last_active":"2024-09-13T10:40:32.764929+0000","last_peered":"2024-09-13T10:40:32.764929+0000","last_clean":"2024-09-13T10:40:32.764929+0000","last_became_active":"2024-09-13T10:30:22.822788+0000","last_became_peered":"2024-09-13T10:30:22.822788+0000","last_unstale":"2024-09-13T10:40:32.764929+0000","last_undegraded":"2024-09-13T10:40:32.764929+0000","last_fullsized":"2024-09-13T10:40:32.764929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:02.717016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050450899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":642,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611278+0000","last_change":"2024-09-13T10:30:24.839303+0000","last_active":"2024-09-13T10:40:32.611278+0000","last_peered":"2024-09-13T10:40:32.611278+0000","last_clean":"2024-09-13T10:40:32.611278+0000","last_became_active":"2024-09-13T10:30:22.818560+0000","last_became_peered":"2024-09-13T10:30:22.818560+0000","last_unstale":"2024-09-13T10:40:32.611278+0000","last_undegraded":"2024-09-13T10:40:32.611278+0000","last_fullsized":"2024-09-13T10:40:32.611278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012649200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":645,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.084479+0000","last_change":"2024-09-13T10:30:24.833843+0000","last_active":"2024-09-13T10:40:31.084479+0000","last_peered":"2024-09-13T10:40:31.084479+0000","last_clean":"2024-09-13T10:40:31.084479+0000","last_became_active":"2024-09-13T10:30:22.816554+0000","last_became_peered":"2024-09-13T10:30:22.816554+0000","last_unstale":"2024-09-13T10:40:31.084479+0000","last_undegraded":"2024-09-13T10:40:31.084479+0000","last_fullsized":"2024-09-13T10:40:31.084479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:55.701606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066494999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":635,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.085299+0000","last_change":"2024-09-13T10:30:24.845556+0000","last_active":"2024-09-13T10:40:31.085299+0000","last_peered":"2024-09-13T10:40:31.085299+0000","last_clean":"2024-09-13T10:40:31.085299+0000","last_became_active":"2024-09-13T10:30:22.821223+0000","last_became_peered":"2024-09-13T10:30:22.821223+0000","last_unstale":"2024-09-13T10:40:31.085299+0000","last_undegraded":"2024-09-13T10:40:31.085299+0000","last_fullsized":"2024-09-13T10:40:31.085299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:43.560455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036258549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":636,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:31.084261+0000","last_change":"2024-09-13T10:30:24.833851+0000","last_active":"2024-09-13T10:40:31.084261+0000","last_peered":"2024-09-13T10:40:31.084261+0000","last_clean":"2024-09-13T10:40:31.084261+0000","last_became_active":"2024-09-13T10:30:22.816447+0000","last_became_peered":"2024-09-13T10:30:22.816447+0000","last_unstale":"2024-09-13T10:40:31.084261+0000","last_undegraded":"2024-09-13T10:40:31.084261+0000","last_fullsized":"2024-09-13T10:40:31.084261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084575600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":649,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:48.686701+0000","last_change":"2024-09-13T10:40:48.686701+0000","last_active":"2024-09-13T10:40:48.686701+0000","last_peered":"2024-09-13T10:40:48.686701+0000","last_clean":"2024-09-13T10:40:48.686701+0000","last_became_active":"2024-09-13T10:30:22.822750+0000","last_became_peered":"2024-09-13T10:30:22.822750+0000","last_unstale":"2024-09-13T10:40:48.686701+0000","last_undegraded":"2024-09-13T10:40:48.686701+0000","last_fullsized":"2024-09-13T10:40:48.686701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:40:48.686633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:40:48.686633+0000","last_clean_scrub_stamp":"2024-09-13T10:40:48.686633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:15:56.360022+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00062120600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":643,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:32.611309+0000","last_change":"2024-09-13T10:30:24.839249+0000","last_active":"2024-09-13T10:40:32.611309+0000","last_peered":"2024-09-13T10:40:32.611309+0000","last_clean":"2024-09-13T10:40:32.611309+0000","last_became_active":"2024-09-13T10:30:22.820901+0000","last_became_peered":"2024-09-13T10:30:22.820901+0000","last_unstale":"2024-09-13T10:40:32.611309+0000","last_undegraded":"2024-09-13T10:40:32.611309+0000","last_fullsized":"2024-09-13T10:40:32.611309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:30:21.717078+0000","last_clean_scrub_stamp":"2024-09-13T10:30:21.717078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001249939,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"331'74","reported_seq":743,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:48.728106+0000","last_change":"2024-09-13T10:40:48.728106+0000","last_active":"2024-09-13T10:40:48.728106+0000","last_peered":"2024-09-13T10:40:48.728106+0000","last_clean":"2024-09-13T10:40:48.728106+0000","last_became_active":"2024-09-13T10:30:15.730748+0000","last_became_peered":"2024-09-13T10:30:15.730748+0000","last_unstale":"2024-09-13T10:40:48.728106+0000","last_undegraded":"2024-09-13T10:40:48.728106+0000","last_fullsized":"2024-09-13T10:40:48.728106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"331'74","last_scrub_stamp":"2024-09-13T10:40:48.728042+0000","last_deep_scrub":"331'74","last_deep_scrub_stamp":"2024-09-13T10:40:48.728042+0000","last_clean_scrub_stamp":"2024-09-13T10:40:48.728042+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:53.070754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574979,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38392,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333448,"statfs":{"total":96636764160,"available":96597450752,"internally_reserved":0,"allocated":3121152,"data_stored":1375726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574979,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30072,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341768,"statfs":{"total":96636764160,"available":96605970432,"internally_reserved":0,"allocated":3121152,"data_stored":1375726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574980,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34812,"kb_used_data":3628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337028,"statfs":{"total":96636764160,"available":96601116672,"internally_reserved":0,"allocated":3715072,"data_stored":1966094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607684,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34812,"kb_used_data":3628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337028,"statfs":{"total":96636764160,"available":96601116672,"internally_reserved":0,"allocated":3715072,"data_stored":1966094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640387,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38396,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333444,"statfs":{"total":96636764160,"available":96597446656,"internally_reserved":0,"allocated":3125248,"data_stored":1375745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607681,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30076,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341764,"statfs":{"total":96636764160,"available":96605966336,"internally_reserved":0,"allocated":3125248,"data_stored":1375745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T10:40:50.285 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T10:30:21.717078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=30, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=40, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T10:40:50.285 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T10:30:21.717078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=30, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=40, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T10:40:50.285 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T10:30:21.717078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=30, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=40, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T10:40:50.285 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T10:30:21.717078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=30, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=40, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T10:40:50.285 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T10:30:21.717078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=30, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=40, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T10:40:50.286 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T10:30:21.717078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=30, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=40, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T10:40:50.286 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T10:30:21.717078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=30, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=10, tm_min=40, tm_sec=46, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T10:40:50.286 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T10:41:10.287 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T10:41:10.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.398+0000 7f42cd36c640 10 monclient: get_monmap_and_config 2024-09-13T10:41:10.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.398+0000 7f42cd36c640 10 monclient: build_initial_monmap 2024-09-13T10:41:10.399 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.398+0000 7f42cd36c640 10 monclient: monmap: 2024-09-13T10:41:10.399 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:41:10.400 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:41:10.400 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:41:10.398782+0000 2024-09-13T10:41:10.400 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:41:10.398782+0000 2024-09-13T10:41:10.400 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:41:10.400 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:41:10.400 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:41:10.400 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:41:10.400 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:41:10.400 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:41:10.400 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:41:10.400 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:41:10.401 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:41:10.401 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:41:10.401 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:41:10.401 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.398+0000 7f42cd36c640 1 Processor -- start 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.398+0000 7f42cd36c640 1 -- start start 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.398+0000 7f42cd36c640 10 monclient: init 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42cd36c640 10 monclient: _reopen_session rank -1 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42cd36c640 10 monclient: _add_conns ranks=[8,0,7,6,3,1,5,4,2] 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42cd36c640 10 monclient(hunting): picked mon.noname-e con 0x7f42c80a66d0 addr v1:172.21.15.181:6793/0 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42cd36c640 10 monclient(hunting): picked mon.noname-a con 0x7f42c80a6ab0 addr v1:172.21.15.181:6789/0 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42cd36c640 10 monclient(hunting): picked mon.noname-i con 0x7f42c813f9a0 addr v1:172.21.15.195:6792/0 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42cd36c640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c80a5fe0 con 0x7f42c80a6ab0 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42cd36c640 1 -- --> v1:172.21.15.195:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c80a8080 con 0x7f42c813f9a0 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42cd36c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c80a42c0 con 0x7f42c80a66d0 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42cd36c640 10 monclient(hunting): _renew_subs 2024-09-13T10:41:10.402 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42cd36c640 10 monclient(hunting): authenticate will time out at 1409.904374s 2024-09-13T10:41:10.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42c6ffd640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f42c80a66d0 0x7f42c80a53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:44662/0 (socket says 172.21.15.181:44662) 2024-09-13T10:41:10.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42c67fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f42c80a6ab0 0x7f42c80a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35058/0 (socket says 172.21.15.181:35058) 2024-09-13T10:41:10.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.399+0000 7f42c6ffd640 1 -- 172.21.15.181:0/3317803228 learned_addr learned my addr 172.21.15.181:0/3317803228 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:41:10.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c67fc640 1 -- 172.21.15.181:0/3317803228 >> v1:172.21.15.181:6789/0 conn(0x7f42c80a6ab0 legacy=0x7f42c80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:41:10.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c6ffd640 1 -- 172.21.15.181:0/3317803228 >> v1:172.21.15.181:6793/0 conn(0x7f42c80a66d0 legacy=0x7f42c80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:41:10.406 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c77fe640 1 -- 172.21.15.181:0/3317803228 >> v1:172.21.15.195:6792/0 conn(0x7f42c813f9a0 legacy=0x7f42c8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:41:10.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97146162 0 0) 0x7f42c80a5fe0 con 0x7f42c80a6ab0 2024-09-13T10:41:10.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:41:10.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:41:10.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:41:10.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 10 monclient(hunting): my global_id is 184329 2024-09-13T10:41:10.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42b0003520 con 0x7f42c80a6ab0 2024-09-13T10:41:10.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2607429282 0 0) 0x7f42c80a42c0 con 0x7f42c80a66d0 2024-09-13T10:41:10.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:41:10.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:41:10.407 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:41:10.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 10 monclient(hunting): my global_id is 184292 2024-09-13T10:41:10.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c80a5fe0 con 0x7f42c80a66d0 2024-09-13T10:41:10.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.401+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 <== mon.7 v1:172.21.15.195:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744400801 0 0) 0x7f42c80a8080 con 0x7f42c813f9a0 2024-09-13T10:41:10.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient(hunting): _negotiate 2024-09-13T10:41:10.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:41:10.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:41:10.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient(hunting): my global_id is 58264 2024-09-13T10:41:10.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 --> v1:172.21.15.195:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c80a42c0 con 0x7f42c813f9a0 2024-09-13T10:41:10.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 272470886 0 0) 0x7f42c80a5fe0 con 0x7f42c80a66d0 2024-09-13T10:41:10.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 >> v1:172.21.15.195:6792/0 conn(0x7f42c813f9a0 legacy=0x7f42c8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.408 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 >> v1:172.21.15.181:6789/0 conn(0x7f42c80a6ab0 legacy=0x7f42c80a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient: _finish_hunting 0 2024-09-13T10:41:10.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 1 monclient: found mon.noname-e 2024-09-13T10:41:10.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:41:10.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.181:6793/0 2024-09-13T10:41:10.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c81464e0 con 0x7f42c80a66d0 2024-09-13T10:41:10.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient: _finish_auth 0 2024-09-13T10:41:10.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient: _check_auth_tickets 2024-09-13T10:41:10.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:41:10.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f42b8001d00 con 0x7f42c80a66d0 2024-09-13T10:41:10.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42cd36c640 5 monclient: authenticate success, global_id 184292 2024-09-13T10:41:10.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42cd36c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:41:10.409 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient: dump: 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:41:10.410 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:41:10.411 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:41:10.411 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:41:10.411 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:41:10.411 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:41:10.411 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42cd36c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:41:10.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 <== mon.8 v1:172.21.15.181:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42b8001fd0 con 0x7f42c80a66d0 2024-09-13T10:41:10.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:41:10.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 1 -- 172.21.15.181:0/3317803228 <== mon.8 v1:172.21.15.181:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f42b8004f60 con 0x7f42c80a66d0 2024-09-13T10:41:10.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42cd36c640 10 monclient: get_monmap_and_config success 2024-09-13T10:41:10.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42cd36c640 4 set_mon_vals no callback set 2024-09-13T10:41:10.411 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42c5ffb640 10 monclient: dump: 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:41:10.412 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42cd36c640 10 monclient: shutdown 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42cd36c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42cd36c640 1 -- 172.21.15.181:0/3317803228 >> v1:172.21.15.181:6793/0 conn(0x7f42c80a66d0 legacy=0x7f42c80a53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42cd36c640 1 -- 172.21.15.181:0/3317803228 shutdown_connections 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42cd36c640 1 -- 172.21.15.181:0/3317803228 >> 172.21.15.181:0/3317803228 conn(0x7f42c80abcd0 msgr2=0x7f42c80ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42cd36c640 1 -- 172.21.15.181:0/3317803228 shutdown_connections 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.402+0000 7f42cd36c640 1 -- 172.21.15.181:0/3317803228 wait complete. 2024-09-13T10:41:10.413 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.403+0000 7f42cd36c640 10 monclient: build_initial_monmap 2024-09-13T10:41:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.403+0000 7f42cd36c640 10 monclient: monmap: 2024-09-13T10:41:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:41:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:41:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:41:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:41:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:41:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:41:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:41:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:41:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:41:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:41:10.414 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:41:10.415 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:41:10.415 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:41:10.415 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:41:10.415 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:41:10.415 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 1 Processor -- start 2024-09-13T10:41:10.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 1 -- start start 2024-09-13T10:41:10.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 10 monclient: init 2024-09-13T10:41:10.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 10 monclient: _reopen_session rank -1 2024-09-13T10:41:10.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 10 monclient: _add_conns ranks=[1,2,8,0,7,6,4,3,5] 2024-09-13T10:41:10.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 10 monclient(hunting): picked mon.noname-f con 0x7f42c80a66d0 addr v1:172.21.15.195:6789/0 2024-09-13T10:41:10.415 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 10 monclient(hunting): picked mon.noname-b con 0x7f42c80a6ab0 addr v1:172.21.15.181:6790/0 2024-09-13T10:41:10.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 10 monclient(hunting): picked mon.noname-e con 0x7f42c813f9a0 addr v1:172.21.15.181:6793/0 2024-09-13T10:41:10.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c813cc00 con 0x7f42c80a66d0 2024-09-13T10:41:10.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 1 -- --> v1:172.21.15.181:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c813e6c0 con 0x7f42c80a6ab0 2024-09-13T10:41:10.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c813e9a0 con 0x7f42c813f9a0 2024-09-13T10:41:10.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 10 monclient(hunting): _renew_subs 2024-09-13T10:41:10.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42cd36c640 10 monclient(hunting): authenticate will time out at 1409.909670s 2024-09-13T10:41:10.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42c67fc640 1 --1- >> v1:172.21.15.181:6790/0 conn(0x7f42c80a6ab0 0x7f42c813b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6790/0 says I am v1:172.21.15.181:57946/0 (socket says 172.21.15.181:57946) 2024-09-13T10:41:10.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42c67fc640 1 -- 172.21.15.181:0/1784073508 learned_addr learned my addr 172.21.15.181:0/1784073508 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:41:10.416 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.404+0000 7f42c77fe640 1 --1- 172.21.15.181:0/1784073508 >> v1:172.21.15.181:6793/0 conn(0x7f42c813f9a0 0x7f42c81d6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:44666/0 (socket says 172.21.15.181:44666) 2024-09-13T10:41:10.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.406+0000 7f42c77fe640 1 -- 172.21.15.181:0/1784073508 >> v1:172.21.15.181:6793/0 conn(0x7f42c813f9a0 legacy=0x7f42c81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:41:10.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.406+0000 7f42c67fc640 1 -- 172.21.15.181:0/1784073508 >> v1:172.21.15.181:6790/0 conn(0x7f42c80a6ab0 legacy=0x7f42c813b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:41:10.419 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.406+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2579319078 0 0) 0x7f42c813e9a0 con 0x7f42c813f9a0 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): my global_id is 184301 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42b4003520 con 0x7f42c813f9a0 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mon.2 v1:172.21.15.181:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939421520 0 0) 0x7f42c813e6c0 con 0x7f42c80a6ab0 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): _negotiate 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): my global_id is 174539 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 --> v1:172.21.15.181:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c813e9a0 con 0x7f42c80a6ab0 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42c6ffd640 1 -- 172.21.15.181:0/1784073508 >> v1:172.21.15.195:6789/0 conn(0x7f42c80a66d0 legacy=0x7f42c813b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:41:10.420 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3847814364 0 0) 0x7f42b4003520 con 0x7f42c813f9a0 2024-09-13T10:41:10.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42c813e6c0 con 0x7f42c813f9a0 2024-09-13T10:41:10.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f42c0001d30 con 0x7f42c813f9a0 2024-09-13T10:41:10.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:41:10.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:41:10.421 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): dump: 2024-09-13T10:41:10.421 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:41:10.421 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:41:10.421 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.421 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.421 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:41:10.421 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mon.2 v1:172.21.15.181:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2858926659 0 0) 0x7f42c813e9a0 con 0x7f42c80a6ab0 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 --> v1:172.21.15.181:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42b4003520 con 0x7f42c80a6ab0 2024-09-13T10:41:10.422 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mon.2 v1:172.21.15.181:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f42bc001a50 con 0x7f42c80a6ab0 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient(hunting): dump: 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:41:10.423 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2764649524 0 0) 0x7f42c813e6c0 con 0x7f42c813f9a0 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 >> v1:172.21.15.181:6790/0 conn(0x7f42c80a6ab0 legacy=0x7f42c813b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 >> v1:172.21.15.195:6789/0 conn(0x7f42c80a66d0 legacy=0x7f42c813b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient: _finish_hunting 0 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 monclient: found mon.e 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:41:10.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c81374e0 con 0x7f42c813f9a0 2024-09-13T10:41:10.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient: _finish_auth 0 2024-09-13T10:41:10.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient: _check_auth_tickets 2024-09-13T10:41:10.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:41:10.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42cd36c640 5 monclient: authenticate success, global_id 184301 2024-09-13T10:41:10.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42cd36c640 10 monclient: _renew_subs 2024-09-13T10:41:10.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42cd36c640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:41:10.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42cd36c640 1 -- 172.21.15.181:0/1784073508 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f42c813da00 con 0x7f42c813f9a0 2024-09-13T10:41:10.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42cd36c640 10 monclient: _renew_subs 2024-09-13T10:41:10.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42cd36c640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:41:10.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42cd36c640 1 -- 172.21.15.181:0/1784073508 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f42c80a2880 con 0x7f42c813f9a0 2024-09-13T10:41:10.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42c0003a40 con 0x7f42c813f9a0 2024-09-13T10:41:10.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient: handle_config config(0 keys) 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f42c0003f70 con 0x7f42c813f9a0 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42c57fa640 4 set_mon_vals no callback set 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.407+0000 7f42af7fe640 10 monclient: dump: 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:41:10.426 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.408+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f42c0004240 con 0x7f42c813f9a0 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.408+0000 7f42cd36c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.408+0000 7f42cd36c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.408+0000 7f42cd36c640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.408+0000 7f42cd36c640 1 -- 172.21.15.181:0/1784073508 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a8005080 con 0x7f42c813f9a0 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.408+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f42c004e180 con 0x7f42c813f9a0 2024-09-13T10:41:10.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.408+0000 7f42c6ffd640 10 monclient: get_auth_request con 0x7f42b4040160 auth_method 0 2024-09-13T10:41:10.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.413+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f42c0017750 con 0x7f42c813f9a0 2024-09-13T10:41:10.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.413+0000 7f42af7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:41:10.428 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.413+0000 7f42af7fe640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:41:10.588 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.586+0000 7f42cd36c640 1 -- 172.21.15.181:0/1784073508 --> v1:172.21.15.195:6800/1839191919 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42a8000b90 con 0x7f42b4040160 2024-09-13T10:41:10.589 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.587+0000 7f42af7fe640 1 -- 172.21.15.181:0/1784073508 <== mgr.4106 v1:172.21.15.195:6800/1839191919 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33951 (unknown 2965378022 0 2862425011) 0x7f42a8000b90 con 0x7f42b4040160 2024-09-13T10:41:10.589 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-09-13T10:41:10.590 INFO:teuthology.orchestra.run.smithi181.stderr:dumped all 2024-09-13T10:41:10.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.590+0000 7f42cd36c640 1 -- 172.21.15.181:0/1784073508 >> v1:172.21.15.195:6800/1839191919 conn(0x7f42b4040160 legacy=0x7f42b4042620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.590+0000 7f42cd36c640 10 monclient: shutdown 2024-09-13T10:41:10.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.590+0000 7f42cd36c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:41:10.591 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.590+0000 7f42cd36c640 1 -- 172.21.15.181:0/1784073508 >> v1:172.21.15.181:6793/0 conn(0x7f42c813f9a0 legacy=0x7f42c81d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.590+0000 7f42cd36c640 1 -- 172.21.15.181:0/1784073508 shutdown_connections 2024-09-13T10:41:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.590+0000 7f42cd36c640 1 -- 172.21.15.181:0/1784073508 >> 172.21.15.181:0/1784073508 conn(0x7f42c80abcd0 msgr2=0x7f42c80ab450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:41:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.590+0000 7f42cd36c640 1 -- 172.21.15.181:0/1784073508 shutdown_connections 2024-09-13T10:41:10.592 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.590+0000 7f42cd36c640 1 -- 172.21.15.181:0/1784073508 wait complete. 2024-09-13T10:41:10.602 INFO:teuthology.orchestra.run.smithi181.stdout:{"pg_ready":true,"pg_map":{"version":662,"stamp":"2024-09-13T10:41:09.991309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":206560,"kb_used_data":19456,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566024480,"statfs":{"total":579820584960,"available":579609067520,"internally_reserved":0,"allocated":19922944,"data_stored":9435130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":191486624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002228"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":649,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:51.806326+0000","last_change":"2024-09-13T10:40:51.806326+0000","last_active":"2024-09-13T10:40:51.806326+0000","last_peered":"2024-09-13T10:40:51.806326+0000","last_clean":"2024-09-13T10:40:51.806326+0000","last_became_active":"2024-09-13T10:30:22.828862+0000","last_became_peered":"2024-09-13T10:30:22.828862+0000","last_unstale":"2024-09-13T10:40:51.806326+0000","last_undegraded":"2024-09-13T10:40:51.806326+0000","last_fullsized":"2024-09-13T10:40:51.806326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:40:51.806245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:40:51.806245+0000","last_clean_scrub_stamp":"2024-09-13T10:40:51.806245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:24:04.772778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013355629999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":653,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:49.824793+0000","last_change":"2024-09-13T10:40:49.824793+0000","last_active":"2024-09-13T10:40:49.824793+0000","last_peered":"2024-09-13T10:40:49.824793+0000","last_clean":"2024-09-13T10:40:49.824793+0000","last_became_active":"2024-09-13T10:30:22.822788+0000","last_became_peered":"2024-09-13T10:30:22.822788+0000","last_unstale":"2024-09-13T10:40:49.824793+0000","last_undegraded":"2024-09-13T10:40:49.824793+0000","last_fullsized":"2024-09-13T10:40:49.824793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:40:49.824707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:40:49.824707+0000","last_clean_scrub_stamp":"2024-09-13T10:40:49.824707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:28.470417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050450899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":650,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:50.778673+0000","last_change":"2024-09-13T10:40:50.778673+0000","last_active":"2024-09-13T10:40:50.778673+0000","last_peered":"2024-09-13T10:40:50.778673+0000","last_clean":"2024-09-13T10:40:50.778673+0000","last_became_active":"2024-09-13T10:30:22.818560+0000","last_became_peered":"2024-09-13T10:30:22.818560+0000","last_unstale":"2024-09-13T10:40:50.778673+0000","last_undegraded":"2024-09-13T10:40:50.778673+0000","last_fullsized":"2024-09-13T10:40:50.778673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:40:50.778590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:40:50.778590+0000","last_clean_scrub_stamp":"2024-09-13T10:40:50.778590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:37.710714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012649200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":653,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:50.305569+0000","last_change":"2024-09-13T10:40:50.305569+0000","last_active":"2024-09-13T10:40:50.305569+0000","last_peered":"2024-09-13T10:40:50.305569+0000","last_clean":"2024-09-13T10:40:50.305569+0000","last_became_active":"2024-09-13T10:30:22.816554+0000","last_became_peered":"2024-09-13T10:30:22.816554+0000","last_unstale":"2024-09-13T10:40:50.305569+0000","last_undegraded":"2024-09-13T10:40:50.305569+0000","last_fullsized":"2024-09-13T10:40:50.305569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:40:50.305487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:40:50.305487+0000","last_clean_scrub_stamp":"2024-09-13T10:40:50.305487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:42.585218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066494999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"331'3","reported_seq":644,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:48.008368+0000","last_change":"2024-09-13T10:40:48.008368+0000","last_active":"2024-09-13T10:40:48.008368+0000","last_peered":"2024-09-13T10:40:48.008368+0000","last_clean":"2024-09-13T10:40:48.008368+0000","last_became_active":"2024-09-13T10:30:22.821223+0000","last_became_peered":"2024-09-13T10:30:22.821223+0000","last_unstale":"2024-09-13T10:40:48.008368+0000","last_undegraded":"2024-09-13T10:40:48.008368+0000","last_fullsized":"2024-09-13T10:40:48.008368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"331'3","last_scrub_stamp":"2024-09-13T10:40:48.008295+0000","last_deep_scrub":"331'3","last_deep_scrub_stamp":"2024-09-13T10:40:48.008295+0000","last_clean_scrub_stamp":"2024-09-13T10:40:48.008295+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:13.227664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0036258549999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":644,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:49.766781+0000","last_change":"2024-09-13T10:40:49.766781+0000","last_active":"2024-09-13T10:40:49.766781+0000","last_peered":"2024-09-13T10:40:49.766781+0000","last_clean":"2024-09-13T10:40:49.766781+0000","last_became_active":"2024-09-13T10:30:22.816447+0000","last_became_peered":"2024-09-13T10:30:22.816447+0000","last_unstale":"2024-09-13T10:40:49.766781+0000","last_undegraded":"2024-09-13T10:40:49.766781+0000","last_fullsized":"2024-09-13T10:40:49.766781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:40:49.766688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:40:49.766688+0000","last_clean_scrub_stamp":"2024-09-13T10:40:49.766688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:09.937188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084575600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":649,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:48.686701+0000","last_change":"2024-09-13T10:40:48.686701+0000","last_active":"2024-09-13T10:40:48.686701+0000","last_peered":"2024-09-13T10:40:48.686701+0000","last_clean":"2024-09-13T10:40:48.686701+0000","last_became_active":"2024-09-13T10:30:22.822750+0000","last_became_peered":"2024-09-13T10:30:22.822750+0000","last_unstale":"2024-09-13T10:40:48.686701+0000","last_undegraded":"2024-09-13T10:40:48.686701+0000","last_fullsized":"2024-09-13T10:40:48.686701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T10:40:48.686633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T10:40:48.686633+0000","last_clean_scrub_stamp":"2024-09-13T10:40:48.686633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:15:56.360022+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00062120600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"331'2","reported_seq":652,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:49.764190+0000","last_change":"2024-09-13T10:40:49.764190+0000","last_active":"2024-09-13T10:40:49.764190+0000","last_peered":"2024-09-13T10:40:49.764190+0000","last_clean":"2024-09-13T10:40:49.764190+0000","last_became_active":"2024-09-13T10:30:22.820901+0000","last_became_peered":"2024-09-13T10:30:22.820901+0000","last_unstale":"2024-09-13T10:40:49.764190+0000","last_undegraded":"2024-09-13T10:40:49.764190+0000","last_fullsized":"2024-09-13T10:40:49.764190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"331'2","last_scrub_stamp":"2024-09-13T10:40:49.764131+0000","last_deep_scrub":"331'2","last_deep_scrub_stamp":"2024-09-13T10:40:49.764131+0000","last_clean_scrub_stamp":"2024-09-13T10:40:49.764131+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:21.300123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001249939,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"331'74","reported_seq":743,"reported_epoch":331,"state":"active+clean","last_fresh":"2024-09-13T10:40:48.728106+0000","last_change":"2024-09-13T10:40:48.728106+0000","last_active":"2024-09-13T10:40:48.728106+0000","last_peered":"2024-09-13T10:40:48.728106+0000","last_clean":"2024-09-13T10:40:48.728106+0000","last_became_active":"2024-09-13T10:30:15.730748+0000","last_became_peered":"2024-09-13T10:30:15.730748+0000","last_unstale":"2024-09-13T10:40:48.728106+0000","last_undegraded":"2024-09-13T10:40:48.728106+0000","last_fullsized":"2024-09-13T10:40:48.728106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"331'74","last_scrub_stamp":"2024-09-13T10:40:48.728042+0000","last_deep_scrub":"331'74","last_deep_scrub_stamp":"2024-09-13T10:40:48.728042+0000","last_clean_scrub_stamp":"2024-09-13T10:40:48.728042+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:53.070754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38392,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333448,"statfs":{"total":96636764160,"available":96597450752,"internally_reserved":0,"allocated":3121152,"data_stored":1375726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30072,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341768,"statfs":{"total":96636764160,"available":96605970432,"internally_reserved":0,"allocated":3121152,"data_stored":1375726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34812,"kb_used_data":3628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337028,"statfs":{"total":96636764160,"available":96601116672,"internally_reserved":0,"allocated":3715072,"data_stored":1966094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":12,"seq":51539607688,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34812,"kb_used_data":3628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337028,"statfs":{"total":96636764160,"available":96601116672,"internally_reserved":0,"allocated":3715072,"data_stored":1966094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640391,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38396,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333444,"statfs":{"total":96636764160,"available":96597446656,"internally_reserved":0,"allocated":3125248,"data_stored":1375745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607685,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30076,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341764,"statfs":{"total":96636764160,"available":96605966336,"internally_reserved":0,"allocated":3125248,"data_stored":1375745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T10:41:10.603 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T10:41:10.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.698+0000 7f3ec58ef640 10 monclient: get_monmap_and_config 2024-09-13T10:41:10.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.698+0000 7f3ec58ef640 10 monclient: build_initial_monmap 2024-09-13T10:41:10.700 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.698+0000 7f3ec58ef640 10 monclient: monmap: 2024-09-13T10:41:10.700 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:41:10.700 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:41:10.700 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:41:10.699458+0000 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:41:10.699458+0000 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:41:10.701 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.699+0000 7f3ec58ef640 1 Processor -- start 2024-09-13T10:41:10.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.699+0000 7f3ec58ef640 1 -- start start 2024-09-13T10:41:10.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.699+0000 7f3ec58ef640 10 monclient: init 2024-09-13T10:41:10.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.699+0000 7f3ec58ef640 10 monclient: _reopen_session rank -1 2024-09-13T10:41:10.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.699+0000 7f3ec58ef640 10 monclient: _add_conns ranks=[5,0,3,7,8,1,4,2,6] 2024-09-13T10:41:10.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.699+0000 7f3ec58ef640 10 monclient(hunting): picked mon.noname-h con 0x7f3ec00a58b0 addr v1:172.21.15.195:6791/0 2024-09-13T10:41:10.703 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.699+0000 7f3ec58ef640 10 monclient(hunting): picked mon.noname-a con 0x7f3ec009cdb0 addr v1:172.21.15.181:6789/0 2024-09-13T10:41:10.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.699+0000 7f3ec58ef640 10 monclient(hunting): picked mon.noname-g con 0x7f3ec01362d0 addr v1:172.21.15.195:6790/0 2024-09-13T10:41:10.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.700+0000 7f3ec58ef640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec009d8c0 con 0x7f3ec009cdb0 2024-09-13T10:41:10.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.700+0000 7f3ec58ef640 1 -- --> v1:172.21.15.195:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec0139b80 con 0x7f3ec01362d0 2024-09-13T10:41:10.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.700+0000 7f3ec58ef640 1 -- --> v1:172.21.15.195:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec00a7b50 con 0x7f3ec00a58b0 2024-09-13T10:41:10.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.700+0000 7f3ec58ef640 10 monclient(hunting): _renew_subs 2024-09-13T10:41:10.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.700+0000 7f3ec58ef640 10 monclient(hunting): authenticate will time out at 1410.205031s 2024-09-13T10:41:10.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.700+0000 7f3ebe7fc640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f3ec009cdb0 0x7f3ec0139470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:35068/0 (socket says 172.21.15.181:35068) 2024-09-13T10:41:10.704 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.700+0000 7f3ebe7fc640 1 -- 172.21.15.181:0/3874049636 learned_addr learned my addr 172.21.15.181:0/3874049636 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:41:10.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebe7fc640 1 -- 172.21.15.181:0/3874049636 >> v1:172.21.15.181:6789/0 conn(0x7f3ec009cdb0 legacy=0x7f3ec0139470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:41:10.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 1 -- 172.21.15.181:0/3874049636 <== mon.0 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1959103714 0 0) 0x7f3ec009d8c0 con 0x7f3ec009cdb0 2024-09-13T10:41:10.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient(hunting): _negotiate 2024-09-13T10:41:10.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:41:10.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:41:10.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient(hunting): my global_id is 184338 2024-09-13T10:41:10.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 1 -- 172.21.15.181:0/3874049636 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ea8003520 con 0x7f3ec009cdb0 2024-09-13T10:41:10.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebeffd640 1 -- 172.21.15.181:0/3874049636 >> v1:172.21.15.195:6791/0 conn(0x7f3ec00a58b0 legacy=0x7f3ec0138d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:41:10.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebf7fe640 1 -- 172.21.15.181:0/3874049636 >> v1:172.21.15.195:6790/0 conn(0x7f3ec01362d0 legacy=0x7f3ec0142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:41:10.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 1 -- 172.21.15.181:0/3874049636 <== mon.0 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 992766954 0 0) 0x7f3ea8003520 con 0x7f3ec009cdb0 2024-09-13T10:41:10.712 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 1 -- 172.21.15.181:0/3874049636 >> v1:172.21.15.195:6791/0 conn(0x7f3ec00a58b0 legacy=0x7f3ec0138d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 1 -- 172.21.15.181:0/3874049636 >> v1:172.21.15.195:6790/0 conn(0x7f3ec01362d0 legacy=0x7f3ec0142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient: _finish_hunting 0 2024-09-13T10:41:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 1 monclient: found mon.noname-a 2024-09-13T10:41:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:41:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.181:6789/0 2024-09-13T10:41:10.716 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 1 -- 172.21.15.181:0/3874049636 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec009db30 con 0x7f3ec009cdb0 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient: _finish_auth 0 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient: _check_auth_tickets 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 1 -- 172.21.15.181:0/3874049636 <== mon.0 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3eb4001ae0 con 0x7f3ec009cdb0 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ec58ef640 5 monclient: authenticate success, global_id 184338 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ec58ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient: dump: 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.717 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.718 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ec58ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 1 -- 172.21.15.181:0/3874049636 <== mon.0 v1:172.21.15.181:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3eb40048a0 con 0x7f3ec009cdb0 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient: handle_config config(0 keys) 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 1 -- 172.21.15.181:0/3874049636 <== mon.0 v1:172.21.15.181:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3eb4004e10 con 0x7f3ec009cdb0 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ec58ef640 10 monclient: get_monmap_and_config success 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ec58ef640 4 set_mon_vals no callback set 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.702+0000 7f3ebdffb640 10 monclient: dump: 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:41:10.719 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:41:10.720 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:41:10.720 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:41:10.720 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:41:10.720 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:41:10.720 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:41:10.720 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:41:10.720 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:41:10.720 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:41:10.720 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:41:10.720 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.703+0000 7f3ec58ef640 10 monclient: shutdown 2024-09-13T10:41:10.720 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.703+0000 7f3ec58ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.703+0000 7f3ec58ef640 1 -- 172.21.15.181:0/3874049636 >> v1:172.21.15.181:6789/0 conn(0x7f3ec009cdb0 legacy=0x7f3ec0139470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.703+0000 7f3ec58ef640 1 -- 172.21.15.181:0/3874049636 shutdown_connections 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.703+0000 7f3ec58ef640 1 -- 172.21.15.181:0/3874049636 >> 172.21.15.181:0/3874049636 conn(0x7f3ec0077170 msgr2=0x7f3ec00abb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.703+0000 7f3ec58ef640 1 -- 172.21.15.181:0/3874049636 shutdown_connections 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.703+0000 7f3ec58ef640 1 -- 172.21.15.181:0/3874049636 wait complete. 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.703+0000 7f3ec58ef640 10 monclient: build_initial_monmap 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.703+0000 7f3ec58ef640 10 monclient: monmap: 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 0 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 0.000000 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:created 0.000000 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 0 (unknown) 2024-09-13T10:41:10.721 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 1 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.noname-a 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.noname-f 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.noname-b 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.noname-g 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.noname-c 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.noname-h 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.noname-d 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.noname-i 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.noname-e 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 1 Processor -- start 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 1 -- start start 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 10 monclient: init 2024-09-13T10:41:10.722 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 10 monclient: _reopen_session rank -1 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 10 monclient: _add_conns ranks=[1,4,8,3,0,2,6,5,7] 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 10 monclient(hunting): picked mon.noname-f con 0x7f3ec00a58b0 addr v1:172.21.15.195:6789/0 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 10 monclient(hunting): picked mon.noname-c con 0x7f3ec01362d0 addr v1:172.21.15.181:6791/0 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 10 monclient(hunting): picked mon.noname-e con 0x7f3ec00a3660 addr v1:172.21.15.181:6793/0 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec0122950 con 0x7f3ec00a58b0 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 1 -- --> v1:172.21.15.181:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec0122c30 con 0x7f3ec01362d0 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 1 -- --> v1:172.21.15.181:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec00a4b10 con 0x7f3ec00a3660 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 10 monclient(hunting): _renew_subs 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.704+0000 7f3ec58ef640 10 monclient(hunting): authenticate will time out at 1410.209942s 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.705+0000 7f3ebf7fe640 1 --1- >> v1:172.21.15.181:6793/0 conn(0x7f3ec00a3660 0x7f3ec01d6760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6793/0 says I am v1:172.21.15.181:44676/0 (socket says 172.21.15.181:44676) 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.705+0000 7f3ebe7fc640 1 --1- >> v1:172.21.15.181:6791/0 conn(0x7f3ec01362d0 0x7f3ec01d3030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.181:6791/0 says I am v1:172.21.15.181:39754/0 (socket says 172.21.15.181:39754) 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.705+0000 7f3ebf7fe640 1 -- 172.21.15.181:0/1880549854 learned_addr learned my addr 172.21.15.181:0/1880549854 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-09-13T10:41:10.723 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ebf7fe640 1 -- 172.21.15.181:0/1880549854 >> v1:172.21.15.181:6793/0 conn(0x7f3ec00a3660 legacy=0x7f3ec01d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ebe7fc640 1 -- 172.21.15.181:0/1880549854 >> v1:172.21.15.181:6791/0 conn(0x7f3ec01362d0 legacy=0x7f3ec01d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ebeffd640 1 -- 172.21.15.181:0/1880549854 >> v1:172.21.15.195:6789/0 conn(0x7f3ec00a58b0 legacy=0x7f3ec01cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.8 v1:172.21.15.181:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3092635390 0 0) 0x7f3ec00a4b10 con 0x7f3ec00a3660 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): my global_id is 184310 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 --> v1:172.21.15.181:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3eac003520 con 0x7f3ec00a3660 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.4 v1:172.21.15.181:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2881142144 0 0) 0x7f3ec0122c30 con 0x7f3ec01362d0 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): _negotiate 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): _init_auth method 2 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-13T10:41:10.724 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): my global_id is 174586 2024-09-13T10:41:10.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 --> v1:172.21.15.181:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ec00a4b10 con 0x7f3ec01362d0 2024-09-13T10:41:10.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ebeffd640 1 --1- 172.21.15.181:0/1880549854 >> v1:172.21.15.195:6789/0 conn(0x7f3ec00a58b0 0x7f3ec01cddf0 :-1 s=OPENED pgs=892 cs=1 l=1).queue_received will delay after 1.72622e+09 on 0x7f3ec0122950 auth_reply(proto 2 0 (0) Success) 2024-09-13T10:41:10.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.8 v1:172.21.15.181:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3105101882 0 0) 0x7f3eac003520 con 0x7f3ec00a3660 2024-09-13T10:41:10.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 --> v1:172.21.15.181:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ec0122c30 con 0x7f3ec00a3660 2024-09-13T10:41:10.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.8 v1:172.21.15.181:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3eb8003990 con 0x7f3ec00a3660 2024-09-13T10:41:10.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:41:10.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-13T10:41:10.725 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): dump: 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:41:10.726 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:41:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:41:10.727 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): _finish_auth 0 2024-09-13T10:41:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.4 v1:172.21.15.181:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2531527899 0 0) 0x7f3ec00a4b10 con 0x7f3ec01362d0 2024-09-13T10:41:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 --> v1:172.21.15.181:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3eac003520 con 0x7f3ec01362d0 2024-09-13T10:41:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.4 v1:172.21.15.181:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3eb4004d90 con 0x7f3ec01362d0 2024-09-13T10:41:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-13T10:41:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-13T10:41:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient(hunting): dump: 2024-09-13T10:41:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:41:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:41:10.727 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:41:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:41:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:41:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:41:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:41:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:41:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:41:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:41:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:41:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:41:10.728 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.8 v1:172.21.15.181:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3323538934 0 0) 0x7f3ec0122c30 con 0x7f3ec00a3660 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 >> v1:172.21.15.181:6791/0 conn(0x7f3ec01362d0 legacy=0x7f3ec01d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 >> v1:172.21.15.195:6789/0 conn(0x7f3ec00a58b0 legacy=0x7f3ec01cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient: _finish_hunting 0 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 monclient: found mon.e 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 --> v1:172.21.15.181:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec0132130 con 0x7f3ec00a3660 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient: _finish_auth 0 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient: _check_auth_tickets 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ec58ef640 5 monclient: authenticate success, global_id 184310 2024-09-13T10:41:10.729 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ec58ef640 10 monclient: _renew_subs 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016268092 0 0) 0x7f3ec0122950 con 0x7f3ec00a58b0 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ec58ef640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ec58ef640 1 -- 172.21.15.181:0/1880549854 --> v1:172.21.15.181:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec00a3fb0 con 0x7f3ec00a3660 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ec58ef640 10 monclient: _renew_subs 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ec58ef640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ec58ef640 1 -- 172.21.15.181:0/1880549854 --> v1:172.21.15.181:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f3ec0122390 con 0x7f3ec00a3660 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.8 v1:172.21.15.181:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3eb8003e60 con 0x7f3ec00a3660 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient: handle_config config(0 keys) 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.8 v1:172.21.15.181:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2421575117 0 0) 0x7f3eb8004390 con 0x7f3ec00a3660 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-13T10:41:10.730 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ebd7fa640 4 set_mon_vals no callback set 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.707+0000 7f3ea7fff640 10 monclient: dump: 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:epoch 1 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:fsid de6e6e36-ff0f-4526-9812-870bc0eec0ee 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:last_changed 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:created 2024-09-13T10:29:19.709789+0000 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:min_mon_release 19 (squid) 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:election_strategy: 3 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:0: v1:172.21.15.181:6789/0 mon.a 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:1: v1:172.21.15.195:6789/0 mon.f 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:2: v1:172.21.15.181:6790/0 mon.b 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:3: v1:172.21.15.195:6790/0 mon.g 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:4: v1:172.21.15.181:6791/0 mon.c 2024-09-13T10:41:10.731 INFO:teuthology.orchestra.run.smithi181.stderr:5: v1:172.21.15.195:6791/0 mon.h 2024-09-13T10:41:10.732 INFO:teuthology.orchestra.run.smithi181.stderr:6: v1:172.21.15.181:6792/0 mon.d 2024-09-13T10:41:10.732 INFO:teuthology.orchestra.run.smithi181.stderr:7: v1:172.21.15.195:6792/0 mon.i 2024-09-13T10:41:10.732 INFO:teuthology.orchestra.run.smithi181.stderr:8: v1:172.21.15.181:6793/0 mon.e 2024-09-13T10:41:10.732 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:10.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.708+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.8 v1:172.21.15.181:6793/0 7 ==== mgrmap(e 5) ==== 50384+0+0 (unknown 2502967733 0 0) 0x7f3eb80045e0 con 0x7f3ec00a3660 2024-09-13T10:41:10.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.708+0000 7f3ec58ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-13T10:41:10.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.708+0000 7f3ec58ef640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:41:10.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.708+0000 7f3ec58ef640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:41:10.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.708+0000 7f3ec58ef640 1 -- 172.21.15.181:0/1880549854 --> v1:172.21.15.181:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea0005080 con 0x7f3ec00a3660 2024-09-13T10:41:10.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.709+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.8 v1:172.21.15.181:6793/0 8 ==== osd_map(331..331 src has 1..331) ==== 3506+0+0 (unknown 3680887752 0 0) 0x7f3eb804e500 con 0x7f3ec00a3660 2024-09-13T10:41:10.732 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.709+0000 7f3ebeffd640 10 monclient: get_auth_request con 0x7f3eac040100 auth_method 0 2024-09-13T10:41:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.713+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.8 v1:172.21.15.181:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (unknown 1092875540 0 1080655425) 0x7f3eb8017b30 con 0x7f3ec00a3660 2024-09-13T10:41:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.713+0000 7f3ea7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-13T10:41:10.733 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.713+0000 7f3ea7fff640 10 monclient: _finish_command 1 = system:0 2024-09-13T10:41:10.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.889+0000 7f3ec58ef640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-09-13T10:41:10.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.889+0000 7f3ec58ef640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-09-13T10:41:10.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.889+0000 7f3ec58ef640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.181:6793/0 2024-09-13T10:41:10.891 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.890+0000 7f3ec58ef640 1 -- 172.21.15.181:0/1880549854 --> v1:172.21.15.181:6793/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3ea0005370 con 0x7f3ec00a3660 2024-09-13T10:41:10.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.994+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.8 v1:172.21.15.181:6793/0 10 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7f3eb8016fa0 con 0x7f3ec00a3660 2024-09-13T10:41:10.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.994+0000 7f3ea7fff640 10 monclient: handle_config config(1 keys) 2024-09-13T10:41:10.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.994+0000 7f3ebd7fa640 4 set_mon_vals no callback set 2024-09-13T10:41:10.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.994+0000 7f3ebd7fa640 10 set_mon_vals mon_health_to_clog = false 2024-09-13T10:41:10.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.994+0000 7f3ea7fff640 1 -- 172.21.15.181:0/1880549854 <== mon.8 v1:172.21.15.181:6793/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (unknown 1453024670 0 0) 0x7f3eb8017430 con 0x7f3ec00a3660 2024-09-13T10:41:10.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.994+0000 7f3ea7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-09-13T10:41:10.996 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.994+0000 7f3ea7fff640 10 monclient: _finish_command 2 = system:0 2024-09-13T10:41:10.998 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.997+0000 7f3ec58ef640 1 -- 172.21.15.181:0/1880549854 >> v1:172.21.15.195:6800/1839191919 conn(0x7f3eac040100 legacy=0x7f3eac0425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.997+0000 7f3ec58ef640 10 monclient: shutdown 2024-09-13T10:41:10.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.997+0000 7f3ec58ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-13T10:41:10.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.997+0000 7f3ec58ef640 1 -- 172.21.15.181:0/1880549854 >> v1:172.21.15.181:6793/0 conn(0x7f3ec00a3660 legacy=0x7f3ec01d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T10:41:10.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.997+0000 7f3ec58ef640 1 -- 172.21.15.181:0/1880549854 shutdown_connections 2024-09-13T10:41:10.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.997+0000 7f3ec58ef640 1 -- 172.21.15.181:0/1880549854 >> 172.21.15.181:0/1880549854 conn(0x7f3ec009cdb0 msgr2=0x7f3ec0134410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T10:41:10.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.997+0000 7f3ec58ef640 1 -- 172.21.15.181:0/1880549854 shutdown_connections 2024-09-13T10:41:10.999 INFO:teuthology.orchestra.run.smithi181.stderr:2024-09-13T10:41:10.997+0000 7f3ec58ef640 1 -- 172.21.15.181:0/1880549854 wait complete. 2024-09-13T10:41:11.009 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T10:41:11.009 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T10:41:11.009 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T10:41:11.009 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.049 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T10:41:11.049 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T10:41:11.049 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.118 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T10:41:11.118 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T10:41:11.118 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.187 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T10:41:11.187 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T10:41:11.187 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.223 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T10:41:11.223 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T10:41:11.223 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.294 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T10:41:11.294 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T10:41:11.294 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.378 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T10:41:11.379 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T10:41:11.379 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T10:41:11.379 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.408 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T10:41:11.408 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T10:41:11.408 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T10:41:11.408 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.444 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T10:41:11.444 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T10:41:11.444 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.497 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T10:41:11.497 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T10:41:11.497 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.549 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T10:41:11.550 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-09-13T10:41:11.550 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.601 INFO:tasks.ceph.mon.d:Stopped 2024-09-13T10:41:11.602 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-09-13T10:41:11.602 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.653 INFO:tasks.ceph.mon.e:Stopped 2024-09-13T10:41:11.653 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-09-13T10:41:11.653 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.666 INFO:tasks.ceph.mon.f:Stopped 2024-09-13T10:41:11.666 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-09-13T10:41:11.666 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.718 INFO:tasks.ceph.mon.g:Stopped 2024-09-13T10:41:11.718 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-09-13T10:41:11.718 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.772 INFO:tasks.ceph.mon.h:Stopped 2024-09-13T10:41:11.772 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-09-13T10:41:11.772 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T10:41:11.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-13T10:41:11.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-13T10:41:11.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-13T10:41:11.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-13T10:41:11.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-13T10:41:11.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.d is failed for ~0s 2024-09-13T10:41:11.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.e is failed for ~0s 2024-09-13T10:41:11.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.f is failed for ~0s 2024-09-13T10:41:11.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.g is failed for ~0s 2024-09-13T10:41:11.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.h is failed for ~0s 2024-09-13T10:41:11.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.i is failed for ~0s 2024-09-13T10:41:11.829 INFO:tasks.ceph.mon.i:Stopped 2024-09-13T10:41:11.829 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T10:41:11.829 DEBUG:teuthology.orchestra.run.smithi181:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | head -n 1 2024-09-13T10:41:11.881 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T10:41:11.881 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T10:41:12.098 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T10:41:12.098 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T10:41:12.197 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T10:41:12.197 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T10:41:12.265 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T10:41:12.265 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T10:41:12.557 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T10:41:12.558 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T10:41:12.630 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T10:41:12.630 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T10:41:12.687 INFO:tasks.ceph:Archiving mon data... 2024-09-13T10:41:12.689 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/data/mon.a.tgz 2024-09-13T10:41:12.689 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-13T10:41:12.704 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.ZdBi5Gp0yz 2024-09-13T10:41:12.704 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZdBi5Gp0yz 2024-09-13T10:41:13.150 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.ZdBi5Gp0yz 2024-09-13T10:41:13.236 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.ZdBi5Gp0yz is 2MB 2024-09-13T10:41:13.363 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.ZdBi5Gp0yz 2024-09-13T10:41:13.379 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/data/mon.b.tgz 2024-09-13T10:41:13.379 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-13T10:41:13.434 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.xlXDW6AVLH 2024-09-13T10:41:13.435 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.xlXDW6AVLH 2024-09-13T10:41:13.682 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.xlXDW6AVLH 2024-09-13T10:41:13.764 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.xlXDW6AVLH is 1MB 2024-09-13T10:41:13.871 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.xlXDW6AVLH 2024-09-13T10:41:13.886 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/data/mon.c.tgz 2024-09-13T10:41:13.886 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-13T10:41:13.940 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.R4p2j9PwLa 2024-09-13T10:41:13.941 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.R4p2j9PwLa 2024-09-13T10:41:14.185 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.R4p2j9PwLa 2024-09-13T10:41:14.268 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.R4p2j9PwLa is 1MB 2024-09-13T10:41:14.386 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.R4p2j9PwLa 2024-09-13T10:41:14.401 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-d to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/data/mon.d.tgz 2024-09-13T10:41:14.401 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-13T10:41:14.455 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.EbYLuizfqz 2024-09-13T10:41:14.455 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-d -- . > /tmp/tmp.EbYLuizfqz 2024-09-13T10:41:14.703 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.EbYLuizfqz 2024-09-13T10:41:14.785 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.EbYLuizfqz is 1MB 2024-09-13T10:41:14.891 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.EbYLuizfqz 2024-09-13T10:41:14.907 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-e to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/data/mon.e.tgz 2024-09-13T10:41:14.907 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-09-13T10:41:14.961 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.ctNDTsNlHU 2024-09-13T10:41:14.961 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-e -- . > /tmp/tmp.ctNDTsNlHU 2024-09-13T10:41:15.211 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.ctNDTsNlHU 2024-09-13T10:41:15.295 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.ctNDTsNlHU is 1MB 2024-09-13T10:41:15.400 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.ctNDTsNlHU 2024-09-13T10:41:15.415 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-f to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/data/mon.f.tgz 2024-09-13T10:41:15.415 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-09-13T10:41:15.434 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.E4Ssvj3rMq 2024-09-13T10:41:15.434 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-f -- . > /tmp/tmp.E4Ssvj3rMq 2024-09-13T10:41:15.706 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.E4Ssvj3rMq 2024-09-13T10:41:15.789 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.E4Ssvj3rMq is 1MB 2024-09-13T10:41:15.901 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.E4Ssvj3rMq 2024-09-13T10:41:15.916 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-g to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/data/mon.g.tgz 2024-09-13T10:41:15.916 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-09-13T10:41:15.970 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.uOIkJAz9Cq 2024-09-13T10:41:15.971 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-g -- . > /tmp/tmp.uOIkJAz9Cq 2024-09-13T10:41:16.219 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.uOIkJAz9Cq 2024-09-13T10:41:16.304 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.uOIkJAz9Cq is 1MB 2024-09-13T10:41:16.414 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.uOIkJAz9Cq 2024-09-13T10:41:16.430 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-h to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/data/mon.h.tgz 2024-09-13T10:41:16.430 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-09-13T10:41:16.484 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.NwlpVqynsJ 2024-09-13T10:41:16.485 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-h -- . > /tmp/tmp.NwlpVqynsJ 2024-09-13T10:41:16.725 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.NwlpVqynsJ 2024-09-13T10:41:16.808 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.NwlpVqynsJ is 1MB 2024-09-13T10:41:16.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-13T10:41:16.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-13T10:41:16.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-13T10:41:16.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-13T10:41:16.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-13T10:41:16.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.d has been restored 2024-09-13T10:41:16.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.e has been restored 2024-09-13T10:41:16.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.f has been restored 2024-09-13T10:41:16.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.g has been restored 2024-09-13T10:41:16.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.h has been restored 2024-09-13T10:41:16.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.i has been restored 2024-09-13T10:41:16.920 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.NwlpVqynsJ 2024-09-13T10:41:16.935 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-i to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/data/mon.i.tgz 2024-09-13T10:41:16.935 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-09-13T10:41:16.989 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.FO4O0VU2MH 2024-09-13T10:41:16.989 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-i -- . > /tmp/tmp.FO4O0VU2MH 2024-09-13T10:41:17.234 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.FO4O0VU2MH 2024-09-13T10:41:17.316 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.FO4O0VU2MH is 1MB 2024-09-13T10:41:17.424 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.FO4O0VU2MH 2024-09-13T10:41:17.439 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T10:41:17.439 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T10:41:17.442 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T10:41:17.527 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T10:41:17.557 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T10:41:17.558 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T10:41:17.559 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/remote/smithi181/crash 2024-09-13T10:41:17.560 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T10:41:17.595 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/remote/smithi195/crash 2024-09-13T10:41:17.596 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T10:41:17.620 INFO:tasks.ceph:Compressing logs... 2024-09-13T10:41:17.621 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T10:41:17.640 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T10:41:17.664 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-13T10:41:17.926 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43401.log 2024-09-13T10:41:17.926 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40469.log 2024-09-13T10:41:17.926 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39850.log 2024-09-13T10:41:17.926 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40469.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43401.log.gz 2024-09-13T10:41:17.926 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46217.log 2024-09-13T10:41:17.926 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37217.log 2024-09-13T10:41:17.927 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40469.log.gz 2024-09-13T10:41:17.927 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39850.log: /var/log/ceph/ceph-client.admin.46217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41620.log 2024-09-13T10:41:17.927 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37217.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46217.log.gz 2024-09-13T10:41:17.927 INFO:teuthology.orchestra.run.smithi181.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39850.log.gz 2024-09-13T10:41:17.927 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43107.log 2024-09-13T10:41:17.927 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44485.log 2024-09-13T10:41:17.927 INFO:teuthology.orchestra.run.smithi181.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37217.log.gz 2024-09-13T10:41:17.927 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41057.log 2024-09-13T10:41:17.927 INFO:teuthology.orchestra.run.smithi181.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43107.log.gz 2024-09-13T10:41:17.927 INFO:teuthology.orchestra.run.smithi181.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.41620.log.gz 2024-09-13T10:41:17.927 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46553.log 2024-09-13T10:41:17.927 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44485.log: /var/log/ceph/ceph-client.admin.41057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44695.log 2024-09-13T10:41:17.928 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44485.log.gz 2024-09-13T10:41:17.928 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36669.log 2024-09-13T10:41:17.928 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41057.log.gz 2024-09-13T10:41:17.928 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44695.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46553.log.gz 2024-09-13T10:41:17.928 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36169.log 2024-09-13T10:41:17.928 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36669.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44695.log.gz 2024-09-13T10:41:17.928 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45335.log 2024-09-13T10:41:17.928 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43359.log 2024-09-13T10:41:17.928 INFO:teuthology.orchestra.run.smithi181.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36669.log.gz 2024-09-13T10:41:17.928 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45335.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36169.log.gz 2024-09-13T10:41:17.929 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51904.log 2024-09-13T10:41:17.929 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45335.log.gz 2024-09-13T10:41:17.929 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40049.log 2024-09-13T10:41:17.929 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49945.log 2024-09-13T10:41:17.929 INFO:teuthology.orchestra.run.smithi181.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.43359.log.gz 2024-09-13T10:41:17.929 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40049.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.50029.log 2024-09-13T10:41:17.929 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51904.log.gz 2024-09-13T10:41:17.929 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49945.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.38135.log -- replaced with /var/log/ceph/ceph-client.admin.40049.log.gz 2024-09-13T10:41:17.929 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:17.929 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48895.log 2024-09-13T10:41:17.929 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49945.log.gz 2024-09-13T10:41:17.930 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38431.log 2024-09-13T10:41:17.930 INFO:teuthology.orchestra.run.smithi181.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.50029.log.gz 2024-09-13T10:41:17.930 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39050.log 2024-09-13T10:41:17.930 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38135.log.gz 2024-09-13T10:41:17.930 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44359.log 2024-09-13T10:41:17.930 INFO:teuthology.orchestra.run.smithi181.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48895.log.gz 2024-09-13T10:41:17.930 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36330.log 2024-09-13T10:41:17.930 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38431.log.gz 2024-09-13T10:41:17.930 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44359.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39050.log.gz 2024-09-13T10:41:17.930 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52946.log 2024-09-13T10:41:17.930 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42813.log 2024-09-13T10:41:17.930 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44359.log.gz 2024-09-13T10:41:17.931 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52946.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36330.log.gzgzip 2024-09-13T10:41:17.931 INFO:teuthology.orchestra.run.smithi181.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38754.log 2024-09-13T10:41:17.931 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42813.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52946.log.gz -5 2024-09-13T10:41:17.931 INFO:teuthology.orchestra.run.smithi181.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42040.log 2024-09-13T10:41:17.931 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38754.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42813.log.gz 2024-09-13T10:41:17.931 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46469.log 2024-09-13T10:41:17.931 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39556.log 2024-09-13T10:41:17.931 INFO:teuthology.orchestra.run.smithi181.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.38754.log.gz 2024-09-13T10:41:17.931 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36923.log 2024-09-13T10:41:17.931 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42040.log.gz 2024-09-13T10:41:17.931 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39556.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46469.log.gz 2024-09-13T10:41:17.932 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47513.log 2024-09-13T10:41:17.932 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36923.log: gzip -5 --verbose 88.5% -- -- replaced with /var/log/ceph/ceph-client.admin.39556.log.gz /var/log/ceph/ceph-client.admin.53240.log 2024-09-13T10:41:17.932 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:17.932 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47513.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36923.log.gz 2024-09-13T10:41:17.932 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42418.log 2024-09-13T10:41:17.932 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53240.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47513.log.gz 2024-09-13T10:41:17.932 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48811.log 2024-09-13T10:41:17.932 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42418.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.53240.log.gz 2024-09-13T10:41:17.932 INFO:teuthology.orchestra.run.smithi181.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43233.log 2024-09-13T10:41:17.932 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50609.log 2024-09-13T10:41:17.932 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42418.log.gz 2024-09-13T10:41:17.932 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43233.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48811.log.gz 2024-09-13T10:41:17.933 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46511.log 2024-09-13T10:41:17.933 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50609.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43233.log.gz 2024-09-13T10:41:17.933 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42771.log 2024-09-13T10:41:17.933 INFO:teuthology.orchestra.run.smithi181.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50609.log.gz 2024-09-13T10:41:17.933 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45965.log 2024-09-13T10:41:17.933 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52736.log 2024-09-13T10:41:17.933 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46511.log.gz 2024-09-13T10:41:17.933 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45965.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42771.log.gz 2024-09-13T10:41:17.933 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50895.log 2024-09-13T10:41:17.933 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46385.log 2024-09-13T10:41:17.933 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45965.log.gz 2024-09-13T10:41:17.934 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51231.log 2024-09-13T10:41:17.934 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52736.log.gz 2024-09-13T10:41:17.934 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46385.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50895.log.gz 2024-09-13T10:41:17.934 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-13T10:41:17.934 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51231.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46385.log.gz 2024-09-13T10:41:17.934 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32163.log 2024-09-13T10:41:17.934 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46343.log 2024-09-13T10:41:17.934 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51231.log.gz 2024-09-13T10:41:17.934 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.32163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42544.log 2024-09-13T10:41:17.934 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46343.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32163.log.gz 2024-09-13T10:41:17.934 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37624.log 2024-09-13T10:41:17.934 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46343.log.gz 2024-09-13T10:41:17.935 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40301.log 2024-09-13T10:41:17.935 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42544.log: /var/log/ceph/ceph-client.admin.37624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47933.log 2024-09-13T10:41:17.935 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40301.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42544.log.gz 2024-09-13T10:41:17.935 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46677.log 2024-09-13T10:41:17.935 INFO:teuthology.orchestra.run.smithi181.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37624.log.gz 2024-09-13T10:41:17.935 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51105.log 2024-09-13T10:41:17.935 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47933.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40301.log.gz 2024-09-13T10:41:17.935 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38051.log 2024-09-13T10:41:17.935 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47933.log.gz 2024-09-13T10:41:17.935 INFO:teuthology.orchestra.run.smithi181.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46677.log.gz 2024-09-13T10:41:17.935 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49777.log 2024-09-13T10:41:17.935 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37330.log 2024-09-13T10:41:17.936 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51105.log.gz 2024-09-13T10:41:17.936 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52610.log 2024-09-13T10:41:17.936 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38051.log.gz 2024-09-13T10:41:17.936 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37330.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49777.log.gz 2024-09-13T10:41:17.936 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47471.log 2024-09-13T10:41:17.936 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52610.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37330.log.gz 2024-09-13T10:41:17.936 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49693.log 2024-09-13T10:41:17.936 INFO:teuthology.orchestra.run.smithi181.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52610.log.gz 2024-09-13T10:41:17.936 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48643.log 2024-09-13T10:41:17.936 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47471.log: /var/log/ceph/ceph-client.admin.49693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45713.log 2024-09-13T10:41:17.936 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48643.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47471.log.gz 2024-09-13T10:41:17.937 INFO:teuthology.orchestra.run.smithi181.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49693.log.gz 2024-09-13T10:41:17.937 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45755.log 2024-09-13T10:41:17.937 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48643.log.gz 2024-09-13T10:41:17.937 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43485.log 2024-09-13T10:41:17.937 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49525.log 2024-09-13T10:41:17.937 INFO:teuthology.orchestra.run.smithi181.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45713.log.gz 2024-09-13T10:41:17.937 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45755.log.gz 2024-09-13T10:41:17.937 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40721.log 2024-09-13T10:41:17.937 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49525.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43485.log.gz 2024-09-13T10:41:17.937 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42124.log 2024-09-13T10:41:17.937 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49525.log.gz 2024-09-13T10:41:17.937 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52652.log 2024-09-13T10:41:17.938 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40721.log: /var/log/ceph/ceph-client.admin.42124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48265.log 2024-09-13T10:41:17.938 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52652.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40721.log.gz 2024-09-13T10:41:17.938 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41536.log 2024-09-13T10:41:17.938 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42124.log.gz 2024-09-13T10:41:17.938 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47723.log 2024-09-13T10:41:17.938 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48265.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52652.log.gz 2024-09-13T10:41:17.938 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37372.log 2024-09-13T10:41:17.938 INFO:teuthology.orchestra.run.smithi181.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48265.log.gz 2024-09-13T10:41:17.938 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47723.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.41536.log.gz -5 2024-09-13T10:41:17.938 INFO:teuthology.orchestra.run.smithi181.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51694.log 2024-09-13T10:41:17.938 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-09-13T10:41:17.938 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51694.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.47723.log.gz 2024-09-13T10:41:17.939 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37372.log.gz 2024-09-13T10:41:17.939 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41368.log 2024-09-13T10:41:17.939 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50365.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51694.log.gz 2024-09-13T10:41:17.939 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51651.log 2024-09-13T10:41:17.939 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41368.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-09-13T10:41:17.939 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39388.log 2024-09-13T10:41:17.939 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48475.log 2024-09-13T10:41:17.939 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51651.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.41368.log.gz 2024-09-13T10:41:17.939 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43821.log 2024-09-13T10:41:17.939 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51651.log.gz 2024-09-13T10:41:17.939 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48475.log: gzip 89.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.39388.log.gz -- 2024-09-13T10:41:17.939 INFO:teuthology.orchestra.run.smithi181.stderr: /var/log/ceph/ceph-client.admin.47303.log 2024-09-13T10:41:17.940 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52862.log 2024-09-13T10:41:17.940 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43821.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48475.log.gz 2024-09-13T10:41:17.940 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46007.log 2024-09-13T10:41:17.940 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43821.log.gz 2024-09-13T10:41:17.940 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51441.log 2024-09-13T10:41:17.940 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47303.log.gz 2024-09-13T10:41:17.940 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44149.log 2024-09-13T10:41:17.940 INFO:teuthology.orchestra.run.smithi181.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52862.log.gz 2024-09-13T10:41:17.940 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39514.log 2024-09-13T10:41:17.940 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51441.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46007.log.gz 2024-09-13T10:41:17.940 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39346.log 2024-09-13T10:41:17.941 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51441.log.gz 2024-09-13T10:41:17.941 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47807.log 2024-09-13T10:41:17.941 INFO:teuthology.orchestra.run.smithi181.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44149.log.gz 2024-09-13T10:41:17.941 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39346.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39514.log.gz 2024-09-13T10:41:17.941 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43611.log 2024-09-13T10:41:17.941 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39218.log 2024-09-13T10:41:17.941 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47807.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39346.log.gz 2024-09-13T10:41:17.941 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40007.log 2024-09-13T10:41:17.942 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47807.log.gz 2024-09-13T10:41:17.942 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39218.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43611.log.gz 2024-09-13T10:41:17.942 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38838.log 2024-09-13T10:41:17.942 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36922.log 2024-09-13T10:41:17.942 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40007.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39218.log.gz 2024-09-13T10:41:17.942 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44401.log 2024-09-13T10:41:17.942 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40007.log.gz 2024-09-13T10:41:17.942 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39766.log 2024-09-13T10:41:17.942 INFO:teuthology.orchestra.run.smithi181.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38838.log.gz 2024-09-13T10:41:17.942 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53282.log 2024-09-13T10:41:17.942 INFO:teuthology.orchestra.run.smithi181.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36922.log.gz 2024-09-13T10:41:17.943 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44401.log.gz 2024-09-13T10:41:17.943 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38345.log 2024-09-13T10:41:17.943 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52568.log 2024-09-13T10:41:17.943 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53282.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39766.log.gz 2024-09-13T10:41:17.943 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40175.log 2024-09-13T10:41:17.943 INFO:teuthology.orchestra.run.smithi181.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53282.log.gz 2024-09-13T10:41:17.943 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52568.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38345.log.gz 2024-09-13T10:41:17.943 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40637.log 2024-09-13T10:41:17.943 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52568.log.gz 2024-09-13T10:41:17.943 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40511.log 2024-09-13T10:41:17.943 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40175.log: /var/log/ceph/ceph-client.admin.40637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36406.log 2024-09-13T10:41:17.944 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40175.log.gz 2024-09-13T10:41:17.944 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47765.log 2024-09-13T10:41:17.944 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40637.log.gz 2024-09-13T10:41:17.944 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41183.log 2024-09-13T10:41:17.944 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40511.log.gz 2024-09-13T10:41:17.944 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49651.log 2024-09-13T10:41:17.944 INFO:teuthology.orchestra.run.smithi181.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36406.log.gz 2024-09-13T10:41:17.944 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.41183.log: /var/log/ceph/ceph-client.admin.50155.log 2024-09-13T10:41:17.944 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47765.log.gz 2024-09-13T10:41:17.944 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39640.log 2024-09-13T10:41:17.944 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41183.log.gz 2024-09-13T10:41:17.945 INFO:teuthology.orchestra.run.smithi181.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49651.log.gz 2024-09-13T10:41:17.945 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52988.log 2024-09-13T10:41:17.945 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49567.log 2024-09-13T10:41:17.945 INFO:teuthology.orchestra.run.smithi181.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50155.log.gz 2024-09-13T10:41:17.945 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42208.log 2024-09-13T10:41:17.945 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39640.log.gz 2024-09-13T10:41:17.945 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40427.log 2024-09-13T10:41:17.945 INFO:teuthology.orchestra.run.smithi181.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52988.log.gz 2024-09-13T10:41:17.945 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46925.log 2024-09-13T10:41:17.945 INFO:teuthology.orchestra.run.smithi181.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49567.log.gz 2024-09-13T10:41:17.946 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40259.log 2024-09-13T10:41:17.946 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42208.log.gz 2024-09-13T10:41:17.946 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46925.log: gzip -5 88.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz -- 2024-09-13T10:41:17.946 INFO:teuthology.orchestra.run.smithi181.stderr: /var/log/ceph/ceph.audit.log 2024-09-13T10:41:17.946 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45629.log 2024-09-13T10:41:17.946 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.audit.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46925.log.gz 2024-09-13T10:41:17.946 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48853.log 2024-09-13T10:41:17.946 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40259.log.gz 2024-09-13T10:41:17.946 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40973.log 2024-09-13T10:41:17.946 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40679.log 2024-09-13T10:41:17.946 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45629.log.gz 2024-09-13T10:41:17.946 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46841.log 2024-09-13T10:41:17.947 INFO:teuthology.orchestra.run.smithi181.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48853.log.gz 2024-09-13T10:41:17.947 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46301.log 2024-09-13T10:41:17.947 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40973.log.gz 2024-09-13T10:41:17.947 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42855.log 2024-09-13T10:41:17.947 INFO:teuthology.orchestra.run.smithi181.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40679.log.gz 2024-09-13T10:41:17.947 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46301.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46841.log.gz 2024-09-13T10:41:17.947 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43443.log 2024-09-13T10:41:17.947 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39176.log 2024-09-13T10:41:17.947 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46301.log.gz 2024-09-13T10:41:17.947 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43065.log 2024-09-13T10:41:17.947 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42855.log.gz 2024-09-13T10:41:17.947 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45587.log 2024-09-13T10:41:17.948 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43443.log.gz 2024-09-13T10:41:17.948 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37883.log 2024-09-13T10:41:17.948 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39176.log.gz 2024-09-13T10:41:17.948 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48391.log 2024-09-13T10:41:17.948 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45587.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43065.log.gz 2024-09-13T10:41:17.948 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42082.log 2024-09-13T10:41:17.948 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45587.log.gz 2024-09-13T10:41:17.948 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48391.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37883.log.gz 2024-09-13T10:41:17.948 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44906.log 2024-09-13T10:41:17.948 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45839.log 2024-09-13T10:41:17.948 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42082.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48391.log.gz 2024-09-13T10:41:17.949 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43653.log 2024-09-13T10:41:17.949 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42082.log.gz 2024-09-13T10:41:17.949 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45839.log: 96.8% 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-13T10:41:17.949 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44906.log.gz 2024-09-13T10:41:17.949 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45881.log 2024-09-13T10:41:17.949 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49063.log 2024-09-13T10:41:17.949 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45839.log.gz 2024-09-13T10:41:17.949 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43653.log.gz 2024-09-13T10:41:17.949 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37216.log 2024-09-13T10:41:17.949 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49063.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45881.log.gz 2024-09-13T10:41:17.949 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40553.log 2024-09-13T10:41:17.949 INFO:teuthology.orchestra.run.smithi181.stderr:gzip/var/log/ceph/ceph-client.admin.37216.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36448.log 2024-09-13T10:41:17.950 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49063.log.gz 2024-09-13T10:41:17.950 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37799.log 2024-09-13T10:41:17.950 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37216.log.gz 2024-09-13T10:41:17.950 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.36448.log: /var/log/ceph/ceph-client.admin.37097.log 2024-09-13T10:41:17.950 INFO:teuthology.orchestra.run.smithi181.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.40553.log.gz 2024-09-13T10:41:17.950 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41956.log 2024-09-13T10:41:17.950 INFO:teuthology.orchestra.run.smithi181.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36448.log.gz 2024-09-13T10:41:17.950 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45116.log 2024-09-13T10:41:17.950 INFO:teuthology.orchestra.run.smithi181.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37799.log.gz 2024-09-13T10:41:17.950 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41956.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37097.log.gz 2024-09-13T10:41:17.950 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49357.log 2024-09-13T10:41:17.951 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41956.log.gz 2024-09-13T10:41:17.951 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52778.log 2024-09-13T10:41:17.951 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45116.log: /var/log/ceph/ceph-client.admin.49357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50113.log 2024-09-13T10:41:17.951 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52778.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45116.log.gz 2024-09-13T10:41:17.951 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49609.log 2024-09-13T10:41:17.951 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49357.log.gz 2024-09-13T10:41:17.951 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8%/var/log/ceph/ceph-client.admin.50113.log: -- replaced with /var/log/ceph/ceph-client.admin.52778.log.gz 2024-09-13T10:41:17.951 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37540.log 2024-09-13T10:41:17.951 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49483.log 2024-09-13T10:41:17.951 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49609.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.50113.log.gz 2024-09-13T10:41:17.951 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40091.log 2024-09-13T10:41:17.951 INFO:teuthology.orchestra.run.smithi181.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49609.log.gz 2024-09-13T10:41:17.952 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5/var/log/ceph/ceph-client.admin.49483.log: --verbose -- /var/log/ceph/ceph-client.admin.38546.log 2024-09-13T10:41:17.952 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37540.log.gz 2024-09-13T10:41:17.952 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53072.log 2024-09-13T10:41:17.952 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49483.log.gz 2024-09-13T10:41:17.952 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38546.log: gzip 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40091.log.gz -5 2024-09-13T10:41:17.952 INFO:teuthology.orchestra.run.smithi181.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48307.log 2024-09-13T10:41:17.952 INFO:teuthology.orchestra.run.smithi181.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38546.log.gz 2024-09-13T10:41:17.952 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47681.log 2024-09-13T10:41:17.952 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53072.log: /var/log/ceph/ceph-client.admin.48307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51567.log 2024-09-13T10:41:17.952 INFO:teuthology.orchestra.run.smithi181.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53072.log.gz 2024-09-13T10:41:17.952 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47681.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48307.log.gz 2024-09-13T10:41:17.953 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53198.log 2024-09-13T10:41:17.953 INFO:teuthology.orchestra.run.smithi181.stderr:gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47681.log.gz -5 2024-09-13T10:41:17.953 INFO:teuthology.orchestra.run.smithi181.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41284.log 2024-09-13T10:41:17.953 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51567.log: /var/log/ceph/ceph-client.admin.53198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51946.log 2024-09-13T10:41:17.953 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41284.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51567.log.gz 2024-09-13T10:41:17.953 INFO:teuthology.orchestra.run.smithi181.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53198.log.gz 2024-09-13T10:41:17.953 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46883.log 2024-09-13T10:41:17.953 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41284.log.gz 2024-09-13T10:41:17.953 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40385.log 2024-09-13T10:41:17.953 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49273.log 2024-09-13T10:41:17.953 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40385.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51946.log.gz 2024-09-13T10:41:17.953 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46091.log 2024-09-13T10:41:17.954 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46883.log.gz 2024-09-13T10:41:17.954 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49273.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40385.log.gz 2024-09-13T10:41:17.954 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41704.log 2024-09-13T10:41:17.954 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52358.log 2024-09-13T10:41:17.954 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49273.log.gz 2024-09-13T10:41:17.954 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50979.log 2024-09-13T10:41:17.954 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46091.log.gz 2024-09-13T10:41:17.954 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36355.log 2024-09-13T10:41:17.954 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41704.log.gz 2024-09-13T10:41:17.954 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46049.log 2024-09-13T10:41:17.954 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52358.log.gz 2024-09-13T10:41:17.954 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38219.log 2024-09-13T10:41:17.955 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36355.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50979.log.gz 2024-09-13T10:41:17.955 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45419.log 2024-09-13T10:41:17.955 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38219.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36355.log.gz 2024-09-13T10:41:17.955 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47849.log 2024-09-13T10:41:17.955 INFO:teuthology.orchestra.run.smithi181.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46049.log.gz 2024-09-13T10:41:17.955 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45419.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38219.log.gz 2024-09-13T10:41:17.955 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46595.log 2024-09-13T10:41:17.955 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47849.log: gzip -5 --verbose 89.6% -- -- replaced with /var/log/ceph/ceph-client.admin.45419.log.gz /var/log/ceph/ceph-client.admin.40133.log 2024-09-13T10:41:17.955 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:17.955 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36925.log 2024-09-13T10:41:17.955 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47849.log.gz 2024-09-13T10:41:17.955 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40133.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46595.log.gz -5 2024-09-13T10:41:17.956 INFO:teuthology.orchestra.run.smithi181.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41662.log 2024-09-13T10:41:17.956 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38796.log 2024-09-13T10:41:17.956 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36925.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40133.log.gz 2024-09-13T10:41:17.956 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48685.log 2024-09-13T10:41:17.956 INFO:teuthology.orchestra.run.smithi181.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36925.log.gz 2024-09-13T10:41:17.956 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36274.log 2024-09-13T10:41:17.956 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38796.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.41662.log.gz 2024-09-13T10:41:17.956 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46967.log 2024-09-13T10:41:17.956 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38796.log.gz 2024-09-13T10:41:17.956 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48685.log.gz 2024-09-13T10:41:17.956 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38261.log 2024-09-13T10:41:17.957 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36274.log: /var/log/ceph/ceph-client.admin.46967.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-13T10:41:17.957 INFO:teuthology.orchestra.run.smithi181.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36274.log.gz 2024-09-13T10:41:17.957 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51189.log 2024-09-13T10:41:17.957 INFO:teuthology.orchestra.run.smithi181.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46967.log.gz 2024-09-13T10:41:17.957 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49987.log 2024-09-13T10:41:17.957 INFO:teuthology.orchestra.run.smithi181.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38261.log.gz 2024-09-13T10:41:17.957 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42897.log 2024-09-13T10:41:17.957 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49987.log: 89.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.51189.log.gz -5 2024-09-13T10:41:17.957 INFO:teuthology.orchestra.run.smithi181.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48727.log 2024-09-13T10:41:17.957 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39008.log 2024-09-13T10:41:17.957 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42897.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49987.log.gz 2024-09-13T10:41:17.957 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44864.log 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42897.log.gz 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39008.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48727.log.gz 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39262.log 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51862.log 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44864.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39008.log.gz 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39682.log 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44864.log.gz 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51862.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39262.log.gz 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42981.log 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48769.log 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39682.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51862.log.gz 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47555.log 2024-09-13T10:41:17.958 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39682.log.gz 2024-09-13T10:41:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43275.log 2024-09-13T10:41:17.959 INFO:teuthology.orchestra.run.smithi181.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42981.log.gz 2024-09-13T10:41:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53156.log 2024-09-13T10:41:17.959 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48769.log.gz 2024-09-13T10:41:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51736.log 2024-09-13T10:41:17.959 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47555.log.gz 2024-09-13T10:41:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53156.log: gzip -5 --verbose 89.5% -- /var/log/ceph/ceph-client.admin.42292.log -- replaced with /var/log/ceph/ceph-client.admin.43275.log.gz 2024-09-13T10:41:17.959 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51736.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53156.log.gz 2024-09-13T10:41:17.959 INFO:teuthology.orchestra.run.smithi181.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37218.log 2024-09-13T10:41:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42292.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51736.log.gz 2024-09-13T10:41:17.959 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42687.log 2024-09-13T10:41:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49021.log 2024-09-13T10:41:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37218.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42292.log.gz 2024-09-13T10:41:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51820.log 2024-09-13T10:41:17.960 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37218.log.gz 2024-09-13T10:41:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49021.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42687.log.gz 2024-09-13T10:41:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43737.log 2024-09-13T10:41:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41141.log 2024-09-13T10:41:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51820.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49021.log.gz 2024-09-13T10:41:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37967.log 2024-09-13T10:41:17.960 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51820.log.gz 2024-09-13T10:41:17.960 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52274.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43737.log.gz 2024-09-13T10:41:17.960 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:17.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37967.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41141.log.gz 2024-09-13T10:41:17.961 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45074.log 2024-09-13T10:41:17.961 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44527.log 2024-09-13T10:41:17.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52274.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37967.log.gz 2024-09-13T10:41:17.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44065.log 2024-09-13T10:41:17.961 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52274.log.gz 2024-09-13T10:41:17.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44527.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45074.log.gz 2024-09-13T10:41:17.961 INFO:teuthology.orchestra.run.smithi181.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37098.log 2024-09-13T10:41:17.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44065.log: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36926.log 2024-09-13T10:41:17.961 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44527.log.gz 2024-09-13T10:41:17.961 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37098.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44065.log.gz 2024-09-13T10:41:17.961 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37841.log 2024-09-13T10:41:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36926.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37098.log.gz 2024-09-13T10:41:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45377.log 2024-09-13T10:41:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2024-09-13T10:41:17.962 INFO:teuthology.orchestra.run.smithi181.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36926.log.gz 2024-09-13T10:41:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45461.log 2024-09-13T10:41:17.962 INFO:teuthology.orchestra.run.smithi181.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37841.log.gz 2024-09-13T10:41:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42334.log 2024-09-13T10:41:17.962 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45377.log.gz 2024-09-13T10:41:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45461.log: gzip -5 --verbose 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2024-09-13T10:41:17.962 INFO:teuthology.orchestra.run.smithi181.stderr: -- /var/log/ceph/ceph-client.admin.51609.log 2024-09-13T10:41:17.962 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42334.log: gzip -5 --verbose -- 89.6% /var/log/ceph/ceph-mon.a.log 2024-09-13T10:41:17.963 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45461.log.gz 2024-09-13T10:41:17.963 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45032.log 2024-09-13T10:41:17.963 INFO:teuthology.orchestra.run.smithi181.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42334.log.gz 2024-09-13T10:41:17.963 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50491.log 2024-09-13T10:41:17.963 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51609.log.gz 2024-09-13T10:41:17.963 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48601.log 2024-09-13T10:41:17.963 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50407.log 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45032.log.gz 2024-09-13T10:41:17.963 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:17.963 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48601.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40931.log 2024-09-13T10:41:17.963 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50491.log.gz 2024-09-13T10:41:17.963 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50407.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.48601.log.gz 2024-09-13T10:41:17.963 INFO:teuthology.orchestra.run.smithi181.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.e.log 2024-09-13T10:41:17.964 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.40931.log: -- /var/log/ceph/ceph-client.admin.45671.log 2024-09-13T10:41:17.964 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50407.log.gz 2024-09-13T10:41:17.964 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42645.log 2024-09-13T10:41:17.964 INFO:teuthology.orchestra.run.smithi181.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40931.log.gz 2024-09-13T10:41:17.964 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48937.log 2024-09-13T10:41:17.964 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45671.log: /var/log/ceph/ceph-client.admin.42645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52442.log 2024-09-13T10:41:17.964 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48937.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45671.log.gz 2024-09-13T10:41:17.964 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42645.log.gz 2024-09-13T10:41:17.964 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47387.log 2024-09-13T10:41:17.964 INFO:teuthology.orchestra.run.smithi181.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48937.log.gz 2024-09-13T10:41:17.965 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48559.log 2024-09-13T10:41:17.965 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52442.log: /var/log/ceph/ceph-client.admin.47387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36670.log 2024-09-13T10:41:17.965 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3%/var/log/ceph/ceph-client.admin.48559.log: -- replaced with /var/log/ceph/ceph-client.admin.52442.log.gz 2024-09-13T10:41:17.965 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47387.log.gz 2024-09-13T10:41:17.965 INFO:teuthology.orchestra.run.smithi181.stderr:gzip 88.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.52068.log 2024-09-13T10:41:17.965 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48559.log.gz 2024-09-13T10:41:17.965 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41998.log 2024-09-13T10:41:17.965 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52068.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36670.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48181.log 2024-09-13T10:41:17.965 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:17.965 INFO:teuthology.orchestra.run.smithi181.stderr:gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52068.log.gz 2024-09-13T10:41:17.965 INFO:teuthology.orchestra.run.smithi181.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36673.log 2024-09-13T10:41:17.965 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41998.log: /var/log/ceph/ceph-client.admin.48181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38712.log 2024-09-13T10:41:17.966 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36673.log: 89.6% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41998.log.gz 2024-09-13T10:41:17.966 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48181.log.gz 2024-09-13T10:41:17.966 INFO:teuthology.orchestra.run.smithi181.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36673.log.gz 2024-09-13T10:41:17.966 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51063.log 2024-09-13T10:41:17.966 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48016.log 2024-09-13T10:41:17.966 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51063.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39092.log 2024-09-13T10:41:17.966 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38712.log.gz 2024-09-13T10:41:17.966 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49105.log 2024-09-13T10:41:17.966 INFO:teuthology.orchestra.run.smithi181.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.51063.log.gz 2024-09-13T10:41:17.966 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48016.log: /var/log/ceph/ceph-client.admin.39092.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48016.log.gz 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39092.log.gz 2024-09-13T10:41:17.966 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:17.966 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39965.log 2024-09-13T10:41:17.967 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49105.log: -- /var/log/ceph/ceph-client.admin.37715.log 2024-09-13T10:41:17.967 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49903.log 2024-09-13T10:41:17.967 INFO:teuthology.orchestra.run.smithi181.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49105.log.gz 2024-09-13T10:41:17.967 INFO:teuthology.orchestra.run.smithi181.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39965.log.gz 2024-09-13T10:41:17.967 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42376.log 2024-09-13T10:41:17.967 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41914.log 2024-09-13T10:41:17.967 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42376.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37715.log.gz 2024-09-13T10:41:17.967 INFO:teuthology.orchestra.run.smithi181.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49903.log.gz 2024-09-13T10:41:17.967 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42376.log.gz 2024-09-13T10:41:17.967 INFO:teuthology.orchestra.run.smithi181.stderr: /var/log/ceph/ceph-client.admin.44191.log 2024-09-13T10:41:17.967 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41015.log 2024-09-13T10:41:17.968 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44191.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41914.log.gz 2024-09-13T10:41:17.968 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51315.log 2024-09-13T10:41:17.968 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43569.log 2024-09-13T10:41:17.968 INFO:teuthology.orchestra.run.smithi181.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.44191.log.gz 2024-09-13T10:41:17.968 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41015.log: /var/log/ceph/ceph-client.admin.51315.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41015.log.gz 2024-09-13T10:41:17.968 INFO:teuthology.orchestra.run.smithi181.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51315.log.gz 2024-09-13T10:41:17.968 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37582.log 2024-09-13T10:41:17.968 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48433.log 2024-09-13T10:41:17.968 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37582.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43569.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-13T10:41:17.968 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:17.968 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42250.log 2024-09-13T10:41:17.969 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37582.log.gz 2024-09-13T10:41:17.969 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48433.log: /var/log/ceph/ceph-osd.2.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48433.log.gz 2024-09-13T10:41:17.969 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51147.log 2024-09-13T10:41:17.969 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39472.log 2024-09-13T10:41:17.969 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42250.log: /var/log/ceph/ceph-client.admin.51147.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42250.log.gz 2024-09-13T10:41:17.969 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51147.log.gz 2024-09-13T10:41:17.969 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48349.log 2024-09-13T10:41:17.969 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40217.log 2024-09-13T10:41:17.969 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39472.log: /var/log/ceph/ceph-client.admin.48349.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39472.log.gz 2024-09-13T10:41:17.969 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45923.log 2024-09-13T10:41:17.969 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48349.log.gz 2024-09-13T10:41:17.969 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40217.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40217.log.gz 2024-09-13T10:41:17.970 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51273.log 2024-09-13T10:41:17.970 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43149.log 2024-09-13T10:41:17.970 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45923.log: /var/log/ceph/ceph-client.admin.51273.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45923.log.gz 2024-09-13T10:41:17.970 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51273.log.gz 2024-09-13T10:41:17.970 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36672.log 2024-09-13T10:41:17.970 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43149.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43149.log.gz 2024-09-13T10:41:17.970 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51399.log 2024-09-13T10:41:17.970 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38009.log 2024-09-13T10:41:17.970 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36672.log: /var/log/ceph/ceph-client.admin.51399.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36672.log.gz 2024-09-13T10:41:17.970 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41326.log 2024-09-13T10:41:17.970 INFO:teuthology.orchestra.run.smithi181.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51399.log.gz 2024-09-13T10:41:17.970 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38009.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38009.log.gz 2024-09-13T10:41:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49399.log 2024-09-13T10:41:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52904.log 2024-09-13T10:41:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41326.log: /var/log/ceph/ceph-client.admin.49399.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41326.log.gz 2024-09-13T10:41:17.971 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49399.log.gz 2024-09-13T10:41:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50811.log 2024-09-13T10:41:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52904.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52904.log.gz 2024-09-13T10:41:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49819.log 2024-09-13T10:41:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52820.log 2024-09-13T10:41:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50811.log: /var/log/ceph/ceph-client.admin.49819.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50811.log.gz 2024-09-13T10:41:17.971 INFO:teuthology.orchestra.run.smithi181.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49819.log.gz 2024-09-13T10:41:17.971 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49441.log 2024-09-13T10:41:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31743.log 2024-09-13T10:41:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52820.log: /var/log/ceph/ceph-client.admin.49441.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52820.log.gz 2024-09-13T10:41:17.972 INFO:teuthology.orchestra.run.smithi181.stderr: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.49441.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.43779.log 2024-09-13T10:41:17.972 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.31743.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31743.log.gz 2024-09-13T10:41:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27073.log 2024-09-13T10:41:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52190.log 2024-09-13T10:41:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43779.log: /var/log/ceph/ceph.tmp-client.admin.27073.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27073.log.gz 2024-09-13T10:41:17.972 INFO:teuthology.orchestra.run.smithi181.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43779.log.gz 2024-09-13T10:41:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-13T10:41:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41872.log 2024-09-13T10:41:17.972 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52190.log: /var/log/ceph/ceph.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52190.log.gz 2024-09-13T10:41:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53367.log 2024-09-13T10:41:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41872.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41872.log.gz 2024-09-13T10:41:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41099.log 2024-09-13T10:41:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53367.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53367.log.gz 2024-09-13T10:41:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47429.log 2024-09-13T10:41:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41099.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41099.log.gz 2024-09-13T10:41:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46259.log 2024-09-13T10:41:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47429.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47429.log.gz 2024-09-13T10:41:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41578.log 2024-09-13T10:41:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46259.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46259.log.gz 2024-09-13T10:41:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44990.log 2024-09-13T10:41:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41578.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41578.log.gz 2024-09-13T10:41:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36924.log 2024-09-13T10:41:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44990.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44990.log.gz 2024-09-13T10:41:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46133.log 2024-09-13T10:41:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36924.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36924.log.gz 2024-09-13T10:41:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49315.log 2024-09-13T10:41:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46133.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.46133.log.gz 2024-09-13T10:41:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50937.log 2024-09-13T10:41:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49315.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49315.log.gz 2024-09-13T10:41:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36490.log 2024-09-13T10:41:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50937.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50937.log.gz 2024-09-13T10:41:17.974 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43695.log 2024-09-13T10:41:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36490.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36490.log.gz 2024-09-13T10:41:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40595.log 2024-09-13T10:41:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43695.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43695.log.gz 2024-09-13T10:41:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39430.log 2024-09-13T10:41:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40595.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.40595.log.gz 2024-09-13T10:41:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39134.log 2024-09-13T10:41:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39430.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39430.log.gz 2024-09-13T10:41:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40763.log 2024-09-13T10:41:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39134.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39134.log.gz 2024-09-13T10:41:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38628.log 2024-09-13T10:41:17.975 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40763.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.40763.log.gz 2024-09-13T10:41:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44233.log 2024-09-13T10:41:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38628.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38628.log.gz 2024-09-13T10:41:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52400.log 2024-09-13T10:41:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44233.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44233.log.gz 2024-09-13T10:41:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50239.log 2024-09-13T10:41:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52400.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52400.log.gz 2024-09-13T10:41:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38882.log 2024-09-13T10:41:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50239.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50239.log.gz 2024-09-13T10:41:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37211.log 2024-09-13T10:41:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38882.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.38882.log.gz 2024-09-13T10:41:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49861.log 2024-09-13T10:41:17.976 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37211.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37211.log.gz 2024-09-13T10:41:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38473.log 2024-09-13T10:41:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49861.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49861.log.gz 2024-09-13T10:41:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37456.log 2024-09-13T10:41:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38473.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38473.log.gz 2024-09-13T10:41:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38303.log 2024-09-13T10:41:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37456.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37456.log.gz 2024-09-13T10:41:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41452.log 2024-09-13T10:41:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38303.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38303.log.gz 2024-09-13T10:41:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37757.log 2024-09-13T10:41:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41452.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41452.log.gz 2024-09-13T10:41:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48139.log 2024-09-13T10:41:17.977 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37757.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37757.log.gz 2024-09-13T10:41:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42166.log 2024-09-13T10:41:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48139.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48139.log.gz 2024-09-13T10:41:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44107.log 2024-09-13T10:41:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42166.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42166.log.gz 2024-09-13T10:41:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42460.log 2024-09-13T10:41:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44107.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44107.log.gz 2024-09-13T10:41:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.d.log 2024-09-13T10:41:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42460.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42460.log.gz 2024-09-13T10:41:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37671.log 2024-09-13T10:41:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38389.log 2024-09-13T10:41:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37671.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37671.log.gz 2024-09-13T10:41:17.978 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47345.log 2024-09-13T10:41:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38389.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38389.log.gz 2024-09-13T10:41:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36674.log 2024-09-13T10:41:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47345.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47345.log.gz 2024-09-13T10:41:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41410.log 2024-09-13T10:41:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36674.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36674.log.gz 2024-09-13T10:41:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38966.log 2024-09-13T10:41:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41410.log: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49231.log 2024-09-13T10:41:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38966.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41410.log.gz 2024-09-13T10:41:17.979 INFO:teuthology.orchestra.run.smithi181.stderr: 92.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-13T10:41:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44443.log 2024-09-13T10:41:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49231.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49231.log.gz 2024-09-13T10:41:17.979 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47093.log 2024-09-13T10:41:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44443.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44443.log.gz 2024-09-13T10:41:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44821.log 2024-09-13T10:41:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47093.log: -- replaced with /var/log/ceph/ceph-client.admin.38966.log.gz 2024-09-13T10:41:17.980 INFO:teuthology.orchestra.run.smithi181.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47093.log.gz 2024-09-13T10:41:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47261.log 2024-09-13T10:41:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44821.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44821.log.gz 2024-09-13T10:41:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41788.log 2024-09-13T10:41:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47261.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47261.log.gz 2024-09-13T10:41:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43191.log 2024-09-13T10:41:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41788.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41788.log.gz 2024-09-13T10:41:17.980 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46175.log 2024-09-13T10:41:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43191.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.43191.log.gz 2024-09-13T10:41:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50281.log 2024-09-13T10:41:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46175.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46175.log.gz 2024-09-13T10:41:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44737.log 2024-09-13T10:41:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50281.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50281.log.gz 2024-09-13T10:41:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51483.log 2024-09-13T10:41:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44737.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44737.log.gz 2024-09-13T10:41:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38924.log 2024-09-13T10:41:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51483.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51483.log.gz 2024-09-13T10:41:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39598.log 2024-09-13T10:41:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38924.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38924.log.gz 2024-09-13T10:41:17.981 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44023.log 2024-09-13T10:41:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39598.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39598.log.gz 2024-09-13T10:41:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50197.log 2024-09-13T10:41:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44023.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44023.log.gz 2024-09-13T10:41:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43023.log 2024-09-13T10:41:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50197.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50197.log.gz 2024-09-13T10:41:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-13T10:41:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43023.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43023.log.gz 2024-09-13T10:41:17.982 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45503.log 2024-09-13T10:41:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42939.log 2024-09-13T10:41:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45503.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45503.log.gz 2024-09-13T10:41:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53030.log 2024-09-13T10:41:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42939.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42939.log.gz 2024-09-13T10:41:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50853.log 2024-09-13T10:41:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53030.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53030.log.gz 2024-09-13T10:41:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39304.log 2024-09-13T10:41:17.993 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50853.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50853.log.gz 2024-09-13T10:41:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41830.log 2024-09-13T10:41:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39304.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39304.log.gz 2024-09-13T10:41:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38093.log 2024-09-13T10:41:17.994 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41830.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41830.log.gz 2024-09-13T10:41:17.998 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38267.log 2024-09-13T10:41:17.998 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40381.log 2024-09-13T10:41:17.998 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36921.log 2024-09-13T10:41:17.998 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.40381.log: -- /var/log/ceph/ceph-client.admin.37279.log 2024-09-13T10:41:17.998 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38483.log 2024-09-13T10:41:17.998 INFO:teuthology.orchestra.run.smithi195.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.40381.log.gz 2024-09-13T10:41:17.998 INFO:teuthology.orchestra.run.smithi195.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38267.log.gz 2024-09-13T10:41:17.999 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37601.log 2024-09-13T10:41:17.999 INFO:teuthology.orchestra.run.smithi195.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36921.log.gz 2024-09-13T10:41:17.999 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37279.log: /var/log/ceph/ceph-client.admin.38483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40036.log 2024-09-13T10:41:17.999 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37565.log 2024-09-13T10:41:17.999 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37279.log.gz 2024-09-13T10:41:17.999 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39343.log 2024-09-13T10:41:17.999 INFO:teuthology.orchestra.run.smithi195.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37601.log.gz 2024-09-13T10:41:17.999 INFO:teuthology.orchestra.run.smithi195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38483.log.gz 2024-09-13T10:41:17.999 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38698.log 2024-09-13T10:41:17.999 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37565.log: /var/log/ceph/ceph-client.admin.39343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39822.log 2024-09-13T10:41:17.999 INFO:teuthology.orchestra.run.smithi195.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40036.log.gz 2024-09-13T10:41:17.999 INFO:teuthology.orchestra.run.smithi195.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37565.log.gz 2024-09-13T10:41:18.000 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38698.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.39343.log.gz 2024-09-13T10:41:18.000 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38804.log 2024-09-13T10:41:18.000 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37388.log 2024-09-13T10:41:18.000 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38698.log.gz 2024-09-13T10:41:18.000 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32078.log 2024-09-13T10:41:18.000 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37028.log 2024-09-13T10:41:18.000 INFO:teuthology.orchestra.run.smithi195.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39822.log.gz 2024-09-13T10:41:18.000 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.32078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37457.log 2024-09-13T10:41:18.000 INFO:teuthology.orchestra.run.smithi195.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38804.log.gz 2024-09-13T10:41:18.000 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37028.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37388.log.gz 2024-09-13T10:41:18.001 INFO:teuthology.orchestra.run.smithi195.stderr:gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.32078.log.gz 2024-09-13T10:41:18.001 INFO:teuthology.orchestra.run.smithi195.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36117.log 2024-09-13T10:41:18.001 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37457.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37028.log.gz 2024-09-13T10:41:18.001 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37994.log 2024-09-13T10:41:18.001 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36426.log 2024-09-13T10:41:18.001 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37994.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37457.log.gz 2024-09-13T10:41:18.001 INFO:teuthology.orchestra.run.smithi195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36117.log.gz 2024-09-13T10:41:18.001 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40107.log 2024-09-13T10:41:18.001 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37351.log 2024-09-13T10:41:18.001 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32249.log 2024-09-13T10:41:18.001 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37994.log.gz 2024-09-13T10:41:18.001 INFO:teuthology.orchestra.run.smithi195.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36426.log.gz 2024-09-13T10:41:18.002 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38949.log 2024-09-13T10:41:18.002 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.32249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36118.log 2024-09-13T10:41:18.002 INFO:teuthology.orchestra.run.smithi195.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37351.log.gz 2024-09-13T10:41:18.002 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40107.log.gz 2024-09-13T10:41:18.002 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41065.log 2024-09-13T10:41:18.002 INFO:teuthology.orchestra.run.smithi195.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32249.log.gz 2024-09-13T10:41:18.002 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40524.log 2024-09-13T10:41:18.002 INFO:teuthology.orchestra.run.smithi195.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38949.log.gz 2024-09-13T10:41:18.002 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.41065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40309.log 2024-09-13T10:41:18.002 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40524.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36118.log.gz 2024-09-13T10:41:18.002 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39271.log 2024-09-13T10:41:18.002 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36598.log 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41065.log.gz 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37458.log 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40524.log.gz 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36598.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40309.log.gz 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40845.log 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39271.log.gz 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39894.log 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37458.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36598.log.gz 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40845.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.g.log 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37458.log.gz 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40037.log 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.g.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38626.log 2024-09-13T10:41:18.003 INFO:teuthology.orchestra.run.smithi195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39894.log.gz 2024-09-13T10:41:18.004 INFO:teuthology.orchestra.run.smithi195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40845.log.gz 2024-09-13T10:41:18.004 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39823.log 2024-09-13T10:41:18.004 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38626.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40037.log.gz 2024-09-13T10:41:18.004 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40000.log 2024-09-13T10:41:18.004 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38590.log 2024-09-13T10:41:18.004 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40000.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39823.log.gz 2024-09-13T10:41:18.004 INFO:teuthology.orchestra.run.smithi195.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38626.log.gz 2024-09-13T10:41:18.004 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38519.log 2024-09-13T10:41:18.004 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38627.log 2024-09-13T10:41:18.004 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38590.log: /var/log/ceph/ceph-client.admin.38519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38412.log 2024-09-13T10:41:18.004 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36743.log 2024-09-13T10:41:18.005 INFO:teuthology.orchestra.run.smithi195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40000.log.gz 2024-09-13T10:41:18.005 INFO:teuthology.orchestra.run.smithi195.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38590.log.gz 2024-09-13T10:41:18.005 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38412.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38627.log.gz 2024-09-13T10:41:18.005 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38948.log 2024-09-13T10:41:18.005 INFO:teuthology.orchestra.run.smithi195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38519.log.gz 2024-09-13T10:41:18.005 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38733.log 2024-09-13T10:41:18.005 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36743.log: /var/log/ceph/ceph-client.admin.38948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38840.log 2024-09-13T10:41:18.005 INFO:teuthology.orchestra.run.smithi195.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38412.log.gz 2024-09-13T10:41:18.005 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38733.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36743.log.gz 2024-09-13T10:41:18.005 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39593.log 2024-09-13T10:41:18.005 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37778.log 2024-09-13T10:41:18.005 INFO:teuthology.orchestra.run.smithi195.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38948.log.gz 2024-09-13T10:41:18.006 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39593.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38733.log.gz 2024-09-13T10:41:18.006 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39162.log 2024-09-13T10:41:18.006 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose 87.8% -- /var/log/ceph/ceph-client.admin.35910.log -- replaced with /var/log/ceph/ceph-client.admin.38840.log.gz 2024-09-13T10:41:18.006 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:41:18.006 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37778.log: /var/log/ceph/ceph-client.admin.39162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40702.log 2024-09-13T10:41:18.006 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39593.log.gz 2024-09-13T10:41:18.006 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.35910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40001.log 2024-09-13T10:41:18.006 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37065.log 2024-09-13T10:41:18.006 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39162.log.gz 2024-09-13T10:41:18.006 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37778.log.gz 2024-09-13T10:41:18.006 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37241.log 2024-09-13T10:41:18.006 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37065.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35910.log.gz 2024-09-13T10:41:18.007 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38520.log 2024-09-13T10:41:18.007 INFO:teuthology.orchestra.run.smithi195.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40702.log.gz 2024-09-13T10:41:18.007 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40001.log.gz 2024-09-13T10:41:18.007 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38304.log 2024-09-13T10:41:18.007 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38520.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37065.log.gz 2024-09-13T10:41:18.007 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36322.log 2024-09-13T10:41:18.007 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38414.log 2024-09-13T10:41:18.007 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38304.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37241.log.gz 2024-09-13T10:41:18.007 INFO:teuthology.orchestra.run.smithi195.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38520.log.gz 2024-09-13T10:41:18.007 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37602.log 2024-09-13T10:41:18.007 INFO:teuthology.orchestra.run.smithi195.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38304.log.gz 2024-09-13T10:41:18.007 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39487.log 2024-09-13T10:41:18.008 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36221.log 2024-09-13T10:41:18.008 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37602.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36322.log.gz 2024-09-13T10:41:18.008 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39487.log: gzip 88.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.38414.log.gz -- 2024-09-13T10:41:18.008 INFO:teuthology.orchestra.run.smithi195.stderr: /var/log/ceph/ceph-client.admin.40143.log 2024-09-13T10:41:18.008 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36495.log 2024-09-13T10:41:18.008 INFO:teuthology.orchestra.run.smithi195.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39487.log.gz 2024-09-13T10:41:18.008 INFO:teuthology.orchestra.run.smithi195.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37602.log.gz 2024-09-13T10:41:18.008 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38591.log 2024-09-13T10:41:18.008 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36495.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36221.log.gz 2024-09-13T10:41:18.008 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38268.log 2024-09-13T10:41:18.008 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36495.log.gz 2024-09-13T10:41:18.009 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40108.log 2024-09-13T10:41:18.009 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38591.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40143.log.gz 2024-09-13T10:41:18.009 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36013.log 2024-09-13T10:41:18.009 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40108.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38591.log.gz 2024-09-13T10:41:18.009 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35979.log 2024-09-13T10:41:18.009 INFO:teuthology.orchestra.run.smithi195.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38268.log.gz 2024-09-13T10:41:18.009 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36013.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40108.log.gz 2024-09-13T10:41:18.009 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41029.log 2024-09-13T10:41:18.009 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.35979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35774.log 2024-09-13T10:41:18.009 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.41029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40810.log 2024-09-13T10:41:18.009 INFO:teuthology.orchestra.run.smithi195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36013.log.gz 2024-09-13T10:41:18.009 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.35774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36849.log 2024-09-13T10:41:18.010 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35979.log.gz 2024-09-13T10:41:18.010 INFO:teuthology.orchestra.run.smithi195.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41029.log.gz 2024-09-13T10:41:18.010 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40311.log 2024-09-13T10:41:18.010 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36849.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.35774.log.gz 2024-09-13T10:41:18.010 INFO:teuthology.orchestra.run.smithi195.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40810.log.gz 2024-09-13T10:41:18.010 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36632.log 2024-09-13T10:41:18.010 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38950.log 2024-09-13T10:41:18.010 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36632.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36849.log.gz 2024-09-13T10:41:18.010 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38413.log 2024-09-13T10:41:18.010 INFO:teuthology.orchestra.run.smithi195.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40311.log.gz 2024-09-13T10:41:18.010 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2024-09-13T10:41:18.010 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38950.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36632.log.gz 2024-09-13T10:41:18.011 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37885.log 2024-09-13T10:41:18.011 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36958.log 2024-09-13T10:41:18.011 INFO:teuthology.orchestra.run.smithi195.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38413.log.gz 2024-09-13T10:41:18.011 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37885.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38950.log.gz 2024-09-13T10:41:18.011 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39057.log 2024-09-13T10:41:18.011 INFO:teuthology.orchestra.run.smithi195.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2024-09-13T10:41:18.011 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38734.log 2024-09-13T10:41:18.011 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36185.log 2024-09-13T10:41:18.011 INFO:teuthology.orchestra.run.smithi195.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37885.log.gz 2024-09-13T10:41:18.011 INFO:teuthology.orchestra.run.smithi195.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36958.log.gz 2024-09-13T10:41:18.011 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36324.log 2024-09-13T10:41:18.011 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40380.log 2024-09-13T10:41:18.012 INFO:teuthology.orchestra.run.smithi195.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39057.log.gz 2024-09-13T10:41:18.012 INFO:teuthology.orchestra.run.smithi195.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38734.log.gz 2024-09-13T10:41:18.012 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38376.log 2024-09-13T10:41:18.012 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36850.log 2024-09-13T10:41:18.012 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40380.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36185.log.gz 2024-09-13T10:41:18.012 INFO:teuthology.orchestra.run.smithi195.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36324.log.gz 2024-09-13T10:41:18.012 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39127.log 2024-09-13T10:41:18.012 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39486.log 2024-09-13T10:41:18.012 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39127.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36850.log.gz 2024-09-13T10:41:18.012 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40738.log 2024-09-13T10:41:18.012 INFO:teuthology.orchestra.run.smithi195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40380.log.gz 2024-09-13T10:41:18.013 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38376.log.gz 2024-09-13T10:41:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35876.log 2024-09-13T10:41:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39486.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39127.log.gz 2024-09-13T10:41:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38377.log 2024-09-13T10:41:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.35876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40144.log 2024-09-13T10:41:18.013 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39486.log.gz 2024-09-13T10:41:18.013 INFO:teuthology.orchestra.run.smithi195.stderr: 87.7%/var/log/ceph/ceph-client.admin.38377.log: -- replaced with /var/log/ceph/ceph-client.admin.40738.log.gz 2024-09-13T10:41:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-13T10:41:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40310.log 2024-09-13T10:41:18.013 INFO:teuthology.orchestra.run.smithi195.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38377.log.gz 2024-09-13T10:41:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40144.log: /var/log/ceph/ceph-osd.4.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35876.log.gz 2024-09-13T10:41:18.013 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39234.log 2024-09-13T10:41:18.014 INFO:teuthology.orchestra.run.smithi195.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40144.log.gz 2024-09-13T10:41:18.014 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37280.log 2024-09-13T10:41:18.014 INFO:teuthology.orchestra.run.smithi195.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40310.log.gz 2024-09-13T10:41:18.014 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37027.log 2024-09-13T10:41:18.014 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39234.log: /var/log/ceph/ceph-client.admin.37280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40596.log 2024-09-13T10:41:18.014 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37027.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37280.log.gz 2024-09-13T10:41:18.014 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-13T10:41:18.014 INFO:teuthology.orchestra.run.smithi195.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39234.log.gz 2024-09-13T10:41:18.014 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38912.log 2024-09-13T10:41:18.014 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40596.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39055.log 2024-09-13T10:41:18.014 INFO:teuthology.orchestra.run.smithi195.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40596.log.gz 2024-09-13T10:41:18.015 INFO:teuthology.orchestra.run.smithi195.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37027.log.gz 2024-09-13T10:41:18.015 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40739.log 2024-09-13T10:41:18.015 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37923.log 2024-09-13T10:41:18.015 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39055.log: /var/log/ceph/ceph-client.admin.40739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32330.log 2024-09-13T10:41:18.015 INFO:teuthology.orchestra.run.smithi195.stderr: 87.6%/var/log/ceph/ceph-client.admin.37923.log: -- replaced with /var/log/ceph/ceph-client.admin.38912.log.gz 2024-09-13T10:41:18.015 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38032.log 2024-09-13T10:41:18.015 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40739.log.gz 2024-09-13T10:41:18.015 INFO:teuthology.orchestra.run.smithi195.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39055.log.gz 2024-09-13T10:41:18.015 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36702.log 2024-09-13T10:41:18.015 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.32330.log: /var/log/ceph/ceph-client.admin.38032.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37923.log.gz 2024-09-13T10:41:18.015 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40918.log 2024-09-13T10:41:18.016 INFO:teuthology.orchestra.run.smithi195.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32330.log.gz 2024-09-13T10:41:18.016 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36744.log 2024-09-13T10:41:18.016 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40918.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38032.log.gz 2024-09-13T10:41:18.016 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37387.log 2024-09-13T10:41:18.016 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36744.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36702.log.gz 2024-09-13T10:41:18.016 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37779.log 2024-09-13T10:41:18.016 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37387.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40918.log.gz 2024-09-13T10:41:18.016 INFO:teuthology.orchestra.run.smithi195.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35911.log 2024-09-13T10:41:18.016 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37779.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36744.log.gz 2024-09-13T10:41:18.016 INFO:teuthology.orchestra.run.smithi195.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37387.log.gz 2024-09-13T10:41:18.016 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41173.log 2024-09-13T10:41:18.016 INFO:teuthology.orchestra.run.smithi195.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37779.log.gz 2024-09-13T10:41:18.017 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.35911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37672.log 2024-09-13T10:41:18.017 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.41173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37350.log 2024-09-13T10:41:18.017 INFO:teuthology.orchestra.run.smithi195.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35911.log.gz 2024-09-13T10:41:18.017 INFO:teuthology.orchestra.run.smithi195.stderr: 96.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-13T10:41:18.017 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37707.log 2024-09-13T10:41:18.017 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37672.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41173.log.gz 2024-09-13T10:41:18.017 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36703.log 2024-09-13T10:41:18.017 INFO:teuthology.orchestra.run.smithi195.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37672.log.gz 2024-09-13T10:41:18.017 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39379.log 2024-09-13T10:41:18.017 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36528.log 2024-09-13T10:41:18.017 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37350.log.gz 2024-09-13T10:41:18.018 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39379.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.41066.log -- replaced with /var/log/ceph/ceph-client.admin.36703.log.gz 2024-09-13T10:41:18.018 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:41:18.018 INFO:teuthology.orchestra.run.smithi195.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37707.log.gz 2024-09-13T10:41:18.018 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36116.log 2024-09-13T10:41:18.018 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.41066.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39379.log.gz 2024-09-13T10:41:18.018 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32370.log 2024-09-13T10:41:18.018 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36116.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41066.log.gz 2024-09-13T10:41:18.018 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37134.log 2024-09-13T10:41:18.018 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36528.log.gz 2024-09-13T10:41:18.018 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.32370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39164.log 2024-09-13T10:41:18.018 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32370.log.gz 2024-09-13T10:41:18.019 INFO:teuthology.orchestra.run.smithi195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36116.log.gz 2024-09-13T10:41:18.019 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39126.log 2024-09-13T10:41:18.019 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38102.log 2024-09-13T10:41:18.019 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38305.log 2024-09-13T10:41:18.019 INFO:teuthology.orchestra.run.smithi195.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37134.log.gz 2024-09-13T10:41:18.019 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38102.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35912.log 2024-09-13T10:41:18.019 INFO:teuthology.orchestra.run.smithi195.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39164.log.gz 2024-09-13T10:41:18.019 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37708.log 2024-09-13T10:41:18.019 INFO:teuthology.orchestra.run.smithi195.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38102.log.gz 2024-09-13T10:41:18.019 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39126.log.gz 2024-09-13T10:41:18.019 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.35912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36529.log 2024-09-13T10:41:18.019 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37242.log 2024-09-13T10:41:18.020 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37708.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38305.log.gz 2024-09-13T10:41:18.020 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36529.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35912.log.gz 2024-09-13T10:41:18.020 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36851.log 2024-09-13T10:41:18.020 INFO:teuthology.orchestra.run.smithi195.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37708.log.gz 2024-09-13T10:41:18.020 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37242.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36529.log.gz 2024-09-13T10:41:18.020 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40525.log 2024-09-13T10:41:18.020 INFO:teuthology.orchestra.run.smithi195.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37242.log.gz 2024-09-13T10:41:18.020 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39558.log 2024-09-13T10:41:18.020 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36851.log: /var/log/ceph/ceph-client.admin.40525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39893.log 2024-09-13T10:41:18.020 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39558.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.40274.log 2024-09-13T10:41:18.020 INFO:teuthology.orchestra.run.smithi195.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40525.log.gz 2024-09-13T10:41:18.020 INFO:teuthology.orchestra.run.smithi195.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36851.log.gz 2024-09-13T10:41:18.021 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37924.log 2024-09-13T10:41:18.021 INFO:teuthology.orchestra.run.smithi195.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39558.log.gz 2024-09-13T10:41:18.021 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39786.log 2024-09-13T10:41:18.021 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40274.log: /var/log/ceph/ceph-client.admin.37924.log: gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39893.log.gz 2024-09-13T10:41:18.021 INFO:teuthology.orchestra.run.smithi195.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40038.log 2024-09-13T10:41:18.021 INFO:teuthology.orchestra.run.smithi195.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40274.log.gz 2024-09-13T10:41:18.021 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39786.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37924.log.gz 2024-09-13T10:41:18.021 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39380.log 2024-09-13T10:41:18.021 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37172.log 2024-09-13T10:41:18.021 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35807.log 2024-09-13T10:41:18.021 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39786.log.gz 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39380.log.gz 2024-09-13T10:41:18.022 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37172.log: 2024-09-13T10:41:18.022 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40417.log 2024-09-13T10:41:18.022 INFO:teuthology.orchestra.run.smithi195.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40038.log.gz 2024-09-13T10:41:18.022 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35773.log 2024-09-13T10:41:18.022 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.35807.log: /var/log/ceph/ceph-client.admin.40417.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37172.log.gz 2024-09-13T10:41:18.022 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38138.log 2024-09-13T10:41:18.022 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35809.log 2024-09-13T10:41:18.022 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.35773.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40417.log.gz 2024-09-13T10:41:18.022 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36014.log 2024-09-13T10:41:18.022 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35807.log.gz 2024-09-13T10:41:18.022 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40416.log 2024-09-13T10:41:18.023 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.35809.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38138.log.gz 2024-09-13T10:41:18.023 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36014.log: gzip -5 --verbose -- 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35773.log.gz 2024-09-13T10:41:18.023 INFO:teuthology.orchestra.run.smithi195.stderr: /var/log/ceph/ceph-client.admin.39594.log 2024-09-13T10:41:18.023 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40416.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35809.log.gz 2024-09-13T10:41:18.023 INFO:teuthology.orchestra.run.smithi195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36014.log.gz 2024-09-13T10:41:18.023 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37886.log 2024-09-13T10:41:18.023 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40703.log 2024-09-13T10:41:18.023 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37886.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39594.log.gz 2024-09-13T10:41:18.023 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41028.log 2024-09-13T10:41:18.023 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40416.log.gz 2024-09-13T10:41:18.023 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38913.log 2024-09-13T10:41:18.023 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40703.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37886.log.gz 2024-09-13T10:41:18.024 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.41028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39019.log 2024-09-13T10:41:18.024 INFO:teuthology.orchestra.run.smithi195.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40703.log.gz 2024-09-13T10:41:18.024 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39020.log 2024-09-13T10:41:18.024 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38913.log: /var/log/ceph/ceph-client.admin.39019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35877.log 2024-09-13T10:41:18.024 INFO:teuthology.orchestra.run.smithi195.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38913.log.gz 2024-09-13T10:41:18.024 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39020.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41028.log.gz 2024-09-13T10:41:18.024 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36015.log 2024-09-13T10:41:18.024 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.35877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37815.log 2024-09-13T10:41:18.024 INFO:teuthology.orchestra.run.smithi195.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39020.log.gz 2024-09-13T10:41:18.024 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39019.log.gz 2024-09-13T10:41:18.024 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38841.log 2024-09-13T10:41:18.025 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35877.log.gz 2024-09-13T10:41:18.025 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39269.log 2024-09-13T10:41:18.025 INFO:teuthology.orchestra.run.smithi195.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36015.log.gz 2024-09-13T10:41:18.025 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38841.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.h.log 2024-09-13T10:41:18.025 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37815.log.gz 2024-09-13T10:41:18.025 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.i.log 2024-09-13T10:41:18.025 INFO:teuthology.orchestra.run.smithi195.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38841.log.gz 2024-09-13T10:41:18.025 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39269.log: /var/log/ceph/ceph-mon.h.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36220.log 2024-09-13T10:41:18.025 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.i.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40526.log 2024-09-13T10:41:18.025 INFO:teuthology.orchestra.run.smithi195.stderr: 87.6%/var/log/ceph/ceph-client.admin.36220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38139.log 2024-09-13T10:41:18.025 INFO:teuthology.orchestra.run.smithi195.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39269.log.gz 2024-09-13T10:41:18.025 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37995.log 2024-09-13T10:41:18.026 INFO:teuthology.orchestra.run.smithi195.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36220.log.gz 2024-09-13T10:41:18.026 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36425.log 2024-09-13T10:41:18.026 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38139.log: /var/log/ceph/ceph-client.admin.37995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38030.log 2024-09-13T10:41:18.026 INFO:teuthology.orchestra.run.smithi195.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40526.log.gz 2024-09-13T10:41:18.026 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36425.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37995.log.gz 2024-09-13T10:41:18.026 INFO:teuthology.orchestra.run.smithi195.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38139.log.gz 2024-09-13T10:41:18.026 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38805.log 2024-09-13T10:41:18.026 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36425.log.gz 2024-09-13T10:41:18.026 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40489.log 2024-09-13T10:41:18.026 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36742.log 2024-09-13T10:41:18.026 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40489.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32290.log 2024-09-13T10:41:18.026 INFO:teuthology.orchestra.run.smithi195.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38805.log.gz 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38030.log.gz 2024-09-13T10:41:18.027 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:41:18.027 INFO:teuthology.orchestra.run.smithi195.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.40489.log.gz 2024-09-13T10:41:18.027 INFO:teuthology.orchestra.run.smithi195.stderr:gzip/var/log/ceph/ceph-client.admin.36742.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35808.log 2024-09-13T10:41:18.027 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.32290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38697.log 2024-09-13T10:41:18.027 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.35808.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32290.log.gz 2024-09-13T10:41:18.027 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41137.log 2024-09-13T10:41:18.027 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36742.log.gz 2024-09-13T10:41:18.027 INFO:teuthology.orchestra.run.smithi195.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37386.log 2024-09-13T10:41:18.027 INFO:teuthology.orchestra.run.smithi195.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35808.log.gz/var/log/ceph/ceph-client.admin.38697.log: 2024-09-13T10:41:18.027 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.41137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40273.log 2024-09-13T10:41:18.027 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37063.log 2024-09-13T10:41:18.027 INFO:teuthology.orchestra.run.smithi195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41137.log.gz 2024-09-13T10:41:18.028 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37386.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38697.log.gz/var/log/ceph/ceph-client.admin.40273.log: 2024-09-13T10:41:18.028 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40955.log 2024-09-13T10:41:18.028 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39451.log 2024-09-13T10:41:18.028 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37386.log.gz 2024-09-13T10:41:18.028 INFO:teuthology.orchestra.run.smithi195.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40273.log.gz 2024-09-13T10:41:18.028 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40145.log 2024-09-13T10:41:18.028 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39451.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37063.log.gz 2024-09-13T10:41:18.028 INFO:teuthology.orchestra.run.smithi195.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40809.log 2024-09-13T10:41:18.028 INFO:teuthology.orchestra.run.smithi195.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40955.log.gz 2024-09-13T10:41:18.028 INFO:teuthology.orchestra.run.smithi195.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39451.log.gz 2024-09-13T10:41:18.029 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39381.log 2024-09-13T10:41:18.029 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40145.log: /var/log/ceph/ceph-client.admin.40809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36957.log 2024-09-13T10:41:18.029 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36427.log 2024-09-13T10:41:18.029 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36957.log: 89.3% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40145.log.gz 2024-09-13T10:41:18.029 INFO:teuthology.orchestra.run.smithi195.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40809.log.gz 2024-09-13T10:41:18.029 INFO:teuthology.orchestra.run.smithi195.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39381.log.gz 2024-09-13T10:41:18.029 INFO:teuthology.orchestra.run.smithi195.stderr:gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36957.log.gz 2024-09-13T10:41:18.029 INFO:teuthology.orchestra.run.smithi195.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36631.log 2024-09-13T10:41:18.029 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36289.log 2024-09-13T10:41:18.029 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36631.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-13T10:41:18.029 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36289.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36427.log.gz 2024-09-13T10:41:18.029 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36083.log 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr:gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36289.log.gz 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36631.log.gz 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.5.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40740.log 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36288.log 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40740.log: /var/log/ceph/ceph-client.admin.36083.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36288.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36083.log.gz 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40740.log.gz 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38031.log 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36530.log 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36288.log.gz 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.38031.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38031.log.gz 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38484.log 2024-09-13T10:41:18.030 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40595.log 2024-09-13T10:41:18.031 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38484.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36530.log.gz 2024-09-13T10:41:18.031 INFO:teuthology.orchestra.run.smithi195.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38484.log.gz 2024-09-13T10:41:18.031 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38735.log 2024-09-13T10:41:18.031 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40595.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40595.log.gz 2024-09-13T10:41:18.031 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-13T10:41:18.031 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39557.log 2024-09-13T10:41:18.031 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mgr.x.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38735.log.gz 2024-09-13T10:41:18.031 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36219.log 2024-09-13T10:41:18.031 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39557.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39557.log.gz 2024-09-13T10:41:18.031 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39163.log 2024-09-13T10:41:18.031 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36219.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36219.log.gz 2024-09-13T10:41:18.031 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36814.log 2024-09-13T10:41:18.032 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39163.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39163.log.gz 2024-09-13T10:41:18.032 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38628.log 2024-09-13T10:41:18.032 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36814.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36814.log.gz 2024-09-13T10:41:18.032 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36082.log 2024-09-13T10:41:18.032 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38628.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38628.log.gz 2024-09-13T10:41:18.032 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40954.log 2024-09-13T10:41:18.032 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36082.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36082.log.gz 2024-09-13T10:41:18.032 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36392.log 2024-09-13T10:41:18.032 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40954.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40954.log.gz 2024-09-13T10:41:18.032 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41136.log 2024-09-13T10:41:18.032 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36392.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36392.log.gz 2024-09-13T10:41:18.032 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39929.log 2024-09-13T10:41:18.033 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.41136.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41136.log.gz 2024-09-13T10:41:18.033 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40631.log 2024-09-13T10:41:18.033 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39929.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39929.log.gz 2024-09-13T10:41:18.033 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38303.log 2024-09-13T10:41:18.033 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40631.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40631.log.gz 2024-09-13T10:41:18.033 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39931.log 2024-09-13T10:41:18.033 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38303.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38303.log.gz 2024-09-13T10:41:18.033 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36633.log 2024-09-13T10:41:18.033 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39931.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39931.log.gz 2024-09-13T10:41:18.033 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36494.log 2024-09-13T10:41:18.033 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36633.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36633.log.gz 2024-09-13T10:41:18.033 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41067.log 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36494.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36494.log.gz 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36391.log 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.41067.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41067.log.gz 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37671.log 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36391.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36391.log.gz 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37816.log 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37671.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37671.log.gz 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40488.log 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37816.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37816.log.gz 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36186.log 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40488.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40488.log.gz 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40418.log 2024-09-13T10:41:18.034 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36186.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36186.log.gz 2024-09-13T10:41:18.035 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37171.log 2024-09-13T10:41:18.035 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40418.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40418.log.gz 2024-09-13T10:41:18.035 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40956.log 2024-09-13T10:41:18.035 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37171.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.37171.log.gz 2024-09-13T10:41:18.035 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38101.log 2024-09-13T10:41:18.035 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40956.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40956.log.gz 2024-09-13T10:41:18.035 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40633.log 2024-09-13T10:41:18.035 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38101.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38101.log.gz 2024-09-13T10:41:18.035 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37814.log 2024-09-13T10:41:18.035 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40633.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40633.log.gz 2024-09-13T10:41:18.035 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37493.log 2024-09-13T10:41:18.035 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37814.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37814.log.gz 2024-09-13T10:41:18.036 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37281.log 2024-09-13T10:41:18.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37493.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37493.log.gz 2024-09-13T10:41:18.036 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39056.log 2024-09-13T10:41:18.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37281.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37281.log.gz 2024-09-13T10:41:18.036 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37170.log 2024-09-13T10:41:18.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39056.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39056.log.gz 2024-09-13T10:41:18.036 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40846.log 2024-09-13T10:41:18.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37170.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37170.log.gz 2024-09-13T10:41:18.036 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40632.log 2024-09-13T10:41:18.036 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40846.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40846.log.gz 2024-09-13T10:41:18.036 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32184.log 2024-09-13T10:41:18.037 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40632.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.40632.log.gz 2024-09-13T10:41:18.037 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37135.log 2024-09-13T10:41:18.037 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.32184.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32184.log.gz 2024-09-13T10:41:18.037 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36920.log 2024-09-13T10:41:18.037 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37135.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37135.log.gz 2024-09-13T10:41:18.037 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38137.log 2024-09-13T10:41:18.037 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36920.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36920.log.gz 2024-09-13T10:41:18.037 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36813.log 2024-09-13T10:41:18.037 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38137.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38137.log.gz 2024-09-13T10:41:18.037 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39787.log 2024-09-13T10:41:18.037 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36813.log: 92.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-13T10:41:18.037 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41174.log 2024-09-13T10:41:18.038 INFO:teuthology.orchestra.run.smithi195.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36813.log.gz 2024-09-13T10:41:18.038 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39270.log 2024-09-13T10:41:18.038 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.41174.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39787.log.gz 2024-09-13T10:41:18.038 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36956.log 2024-09-13T10:41:18.038 INFO:teuthology.orchestra.run.smithi195.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41174.log.gz 2024-09-13T10:41:18.038 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39270.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.f.log 2024-09-13T10:41:18.038 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36956.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39270.log.gz 2024-09-13T10:41:18.038 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36323.log 2024-09-13T10:41:18.038 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.f.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36956.log.gz 2024-09-13T10:41:18.038 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37564.log 2024-09-13T10:41:18.038 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36323.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36323.log.gz 2024-09-13T10:41:18.039 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36597.log 2024-09-13T10:41:18.039 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37564.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37564.log.gz 2024-09-13T10:41:18.039 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39342.log 2024-09-13T10:41:18.039 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.36597.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36597.log.gz 2024-09-13T10:41:18.039 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37709.log 2024-09-13T10:41:18.039 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39342.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39342.log.gz 2024-09-13T10:41:18.039 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37495.log 2024-09-13T10:41:18.039 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37709.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37709.log.gz 2024-09-13T10:41:18.039 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35980.log 2024-09-13T10:41:18.039 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37495.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37495.log.gz 2024-09-13T10:41:18.039 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40919.log 2024-09-13T10:41:18.040 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.35980.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35980.log.gz 2024-09-13T10:41:18.040 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39450.log 2024-09-13T10:41:18.040 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40919.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40919.log.gz 2024-09-13T10:41:18.040 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37925.log 2024-09-13T10:41:18.040 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39450.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39450.log.gz 2024-09-13T10:41:18.040 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41172.log 2024-09-13T10:41:18.040 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37925.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37925.log.gz 2024-09-13T10:41:18.040 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-13T10:41:18.040 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.41172.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41172.log.gz 2024-09-13T10:41:18.040 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39930.log 2024-09-13T10:41:18.040 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39233.log 2024-09-13T10:41:18.041 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39930.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39930.log.gz 2024-09-13T10:41:18.041 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39824.log 2024-09-13T10:41:18.041 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39233.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39233.log.gz 2024-09-13T10:41:18.041 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40847.log 2024-09-13T10:41:18.041 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39824.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39824.log.gz 2024-09-13T10:41:18.041 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39595.log 2024-09-13T10:41:18.041 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.40847.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40847.log.gz 2024-09-13T10:41:18.041 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37064.log 2024-09-13T10:41:18.041 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39595.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39595.log.gz 2024-09-13T10:41:18.041 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38521.log 2024-09-13T10:41:18.041 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37064.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37064.log.gz 2024-09-13T10:41:18.042 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38842.log 2024-09-13T10:41:18.042 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38521.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38521.log.gz 2024-09-13T10:41:18.042 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39488.log 2024-09-13T10:41:18.042 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.38842.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38842.log.gz 2024-09-13T10:41:18.042 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37600.log 2024-09-13T10:41:18.042 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.39488.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39488.log.gz 2024-09-13T10:41:18.044 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.37600.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37600.log.gz 2024-09-13T10:41:18.044 INFO:teuthology.orchestra.run.smithi195.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-13T10:41:18.047 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52694.log 2024-09-13T10:41:18.047 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38093.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38093.log.gz 2024-09-13T10:41:18.047 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42729.log 2024-09-13T10:41:18.047 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52694.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52694.log.gz 2024-09-13T10:41:18.047 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44569.log 2024-09-13T10:41:18.047 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42729.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42729.log.gz 2024-09-13T10:41:18.047 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52526.log 2024-09-13T10:41:18.047 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44569.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44569.log.gz 2024-09-13T10:41:18.054 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46427.log 2024-09-13T10:41:18.054 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52526.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52526.log.gz 2024-09-13T10:41:18.073 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44611.log 2024-09-13T10:41:18.073 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46427.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46427.log.gz 2024-09-13T10:41:18.081 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40343.log 2024-09-13T10:41:18.091 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38670.log 2024-09-13T10:41:18.094 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40343.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44611.log.gz 2024-09-13T10:41:18.099 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44948.log 2024-09-13T10:41:18.104 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38670.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40343.log.gz 2024-09-13T10:41:18.108 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50323.log 2024-09-13T10:41:18.112 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44948.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.38670.log.gz 2024-09-13T10:41:18.121 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51988.log 2024-09-13T10:41:18.122 INFO:teuthology.orchestra.run.smithi181.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44948.log.gz 2024-09-13T10:41:18.122 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50323.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50323.log.gz 2024-09-13T10:41:18.137 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41746.log 2024-09-13T10:41:18.138 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51988.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51988.log.gz 2024-09-13T10:41:18.146 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44317.log 2024-09-13T10:41:18.156 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32088.log 2024-09-13T10:41:18.159 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44317.log: 89.0% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41746.log.gz 2024-09-13T10:41:18.164 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50449.log 2024-09-13T10:41:18.169 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.32088.log: -- replaced with /var/log/ceph/ceph-client.admin.44317.log.gz 2024-09-13T10:41:18.173 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47177.log 2024-09-13T10:41:18.177 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50449.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32088.log.gz 2024-09-13T10:41:18.187 INFO:teuthology.orchestra.run.smithi181.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50449.log.gz 2024-09-13T10:41:18.192 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51525.log 2024-09-13T10:41:18.193 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47177.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47177.log.gz 2024-09-13T10:41:18.202 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52484.log 2024-09-13T10:41:18.203 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51525.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51525.log.gz 2024-09-13T10:41:18.214 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51021.log 2024-09-13T10:41:18.215 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52484.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52484.log.gz 2024-09-13T10:41:18.223 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43527.log 2024-09-13T10:41:18.233 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47639.log 2024-09-13T10:41:18.237 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43527.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51021.log.gz 2024-09-13T10:41:18.241 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45545.log 2024-09-13T10:41:18.246 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47639.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43527.log.gz 2024-09-13T10:41:18.250 INFO:teuthology.orchestra.run.smithi181.stderr: 90.6% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47639.log.gz 2024-09-13T10:41:18.250 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-mon.e.log.gz 2024-09-13T10:41:18.251 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47051.log 2024-09-13T10:41:18.251 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45545.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45545.log.gz 2024-09-13T10:41:18.251 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51357.log 2024-09-13T10:41:18.254 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47051.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47051.log.gz 2024-09-13T10:41:18.255 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36671.log 2024-09-13T10:41:18.255 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51357.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51357.log.gz 2024-09-13T10:41:18.255 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52232.log 2024-09-13T10:41:18.255 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36671.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36671.log.gz 2024-09-13T10:41:18.255 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49735.log 2024-09-13T10:41:18.273 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52232.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.52232.log.gz 2024-09-13T10:41:18.273 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51778.log 2024-09-13T10:41:18.273 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49735.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49735.log.gz 2024-09-13T10:41:18.273 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43901.log 2024-09-13T10:41:18.273 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.51778.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51778.log.gz 2024-09-13T10:41:18.273 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36532.log 2024-09-13T10:41:18.273 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43901.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43901.log.gz 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50071.log 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36532.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36532.log.gz 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47009.log 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.50071.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50071.log.gz 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38177.log 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47009.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47009.log.gz 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45797.log 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38177.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38177.log.gz 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44653.log 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.45797.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45797.log.gz 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53407.log 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44653.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.44653.log.gz 2024-09-13T10:41:18.274 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48223.log 2024-09-13T10:41:18.275 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53407.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53407.log.gz 2024-09-13T10:41:18.275 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36914.log 2024-09-13T10:41:18.275 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48223.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48223.log.gz 2024-09-13T10:41:18.275 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41494.log 2024-09-13T10:41:18.275 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.36914.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36914.log.gz 2024-09-13T10:41:18.275 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53114.log 2024-09-13T10:41:18.279 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.41494.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41494.log.gz 2024-09-13T10:41:18.279 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47891.log 2024-09-13T10:41:18.279 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53114.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53114.log.gz 2024-09-13T10:41:18.279 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44779.log 2024-09-13T10:41:18.279 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47891.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47891.log.gz 2024-09-13T10:41:18.279 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37925.log 2024-09-13T10:41:18.279 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44779.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44779.log.gz 2024-09-13T10:41:18.280 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46799.log 2024-09-13T10:41:18.281 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37925.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.37925.log.gz 2024-09-13T10:41:18.281 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44275.log 2024-09-13T10:41:18.281 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.46799.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46799.log.gz 2024-09-13T10:41:18.282 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40889.log 2024-09-13T10:41:18.285 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.44275.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44275.log.gz 2024-09-13T10:41:18.285 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52316.log 2024-09-13T10:41:18.285 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40889.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40889.log.gz 2024-09-13T10:41:18.285 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42502.log 2024-09-13T10:41:18.286 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.52316.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52316.log.gz 2024-09-13T10:41:18.287 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43317.log 2024-09-13T10:41:18.288 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.42502.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42502.log.gz 2024-09-13T10:41:18.288 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40847.log 2024-09-13T10:41:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.43317.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43317.log.gz 2024-09-13T10:41:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48517.log 2024-09-13T10:41:18.298 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40847.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40847.log.gz 2024-09-13T10:41:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37498.log 2024-09-13T10:41:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48517.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48517.log.gz 2024-09-13T10:41:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49147.log 2024-09-13T10:41:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37498.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37498.log.gz 2024-09-13T10:41:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47135.log 2024-09-13T10:41:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49147.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49147.log.gz 2024-09-13T10:41:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48979.log 2024-09-13T10:41:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47135.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47135.log.gz 2024-09-13T10:41:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37414.log 2024-09-13T10:41:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.48979.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48979.log.gz 2024-09-13T10:41:18.299 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49189.log 2024-09-13T10:41:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37414.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37414.log.gz 2024-09-13T10:41:18.301 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40805.log 2024-09-13T10:41:18.302 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.49189.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49189.log.gz 2024-09-13T10:41:18.302 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53324.log 2024-09-13T10:41:18.306 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.40805.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.40805.log.gz 2024-09-13T10:41:18.306 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39724.log 2024-09-13T10:41:18.306 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.53324.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53324.log.gz 2024-09-13T10:41:18.306 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47597.log 2024-09-13T10:41:18.306 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39724.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39724.log.gz 2024-09-13T10:41:18.306 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39808.log 2024-09-13T10:41:18.307 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.47597.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47597.log.gz 2024-09-13T10:41:18.308 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.39808.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39808.log.gz 2024-09-13T10:41:18.376 INFO:teuthology.orchestra.run.smithi181.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-13T10:41:18.379 INFO:teuthology.orchestra.run.smithi195.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.h.log.gz 2024-09-13T10:41:18.387 INFO:teuthology.orchestra.run.smithi181.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.d.log.gz 2024-09-13T10:41:18.432 INFO:teuthology.orchestra.run.smithi181.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-13T10:41:18.434 INFO:teuthology.orchestra.run.smithi181.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-13T10:41:18.473 INFO:teuthology.orchestra.run.smithi195.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.f.log.gz 2024-09-13T10:41:18.579 INFO:teuthology.orchestra.run.smithi195.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.g.log.gz 2024-09-13T10:41:18.877 INFO:teuthology.orchestra.run.smithi195.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.i.log.gz 2024-09-13T10:41:20.059 INFO:teuthology.orchestra.run.smithi181.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-13T10:41:20.258 INFO:teuthology.orchestra.run.smithi195.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-13T10:41:20.366 INFO:teuthology.orchestra.run.smithi181.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-13T10:41:20.415 INFO:teuthology.orchestra.run.smithi181.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-13T10:41:20.416 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-09-13T10:41:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m2.763s 2024-09-13T10:41:20.416 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m10.612s 2024-09-13T10:41:20.417 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.605s 2024-09-13T10:41:20.612 INFO:teuthology.orchestra.run.smithi195.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-13T10:41:20.635 INFO:teuthology.orchestra.run.smithi195.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-13T10:41:20.637 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-09-13T10:41:20.637 INFO:teuthology.orchestra.run.smithi195.stderr:real 0m2.960s 2024-09-13T10:41:20.637 INFO:teuthology.orchestra.run.smithi195.stderr:user 0m11.554s 2024-09-13T10:41:20.637 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m0.549s 2024-09-13T10:41:20.637 INFO:tasks.ceph:Archiving logs... 2024-09-13T10:41:20.638 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/remote/smithi181/log 2024-09-13T10:41:20.638 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T10:41:22.448 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/remote/smithi195/log 2024-09-13T10:41:22.449 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T10:41:24.345 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T10:41:24.355 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T10:41:24.355 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T10:41:24.358 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T10:41:24.440 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T10:41:24.449 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T10:41:24.449 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T10:41:24.452 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T10:41:24.466 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-09-13T10:41:24.468 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-09-13T10:41:24.471 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T10:41:24.471 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-09-13T10:41:24.471 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 -228us[ -218us] +/- 54ms 2024-09-13T10:41:24.471 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 +336us[ +345us] +/- 56ms 2024-09-13T10:41:24.471 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -96us[ -86us] +/- 70ms 2024-09-13T10:41:24.471 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T10:41:24.474 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T10:41:24.474 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-09-13T10:41:24.474 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 -226us[ -216us] +/- 54ms 2024-09-13T10:41:24.474 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 +349us[ +349us] +/- 56ms 2024-09-13T10:41:24.474 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -92us[ -92us] +/- 70ms 2024-09-13T10:41:24.474 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T10:41:24.475 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T10:41:24.486 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T10:41:24.487 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T10:41:24.502 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T10:41:24.586 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T10:41:24.654 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T10:41:24.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T10:41:24.684 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T10:41:24.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T10:41:24.715 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T10:41:24.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T10:41:24.739 INFO:teuthology.task.internal:Duration was 1094.553075 seconds 2024-09-13T10:41:24.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T10:41:24.751 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T10:41:24.751 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T10:41:24.754 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T10:41:24.791 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T10:41:24.798 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T10:41:25.193 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T10:41:25.193 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-09-13T10:41:25.193 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T10:41:25.254 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-09-13T10:41:25.255 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T10:41:25.282 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T10:41:25.282 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T10:41:25.297 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T10:41:25.353 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T10:41:25.353 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T10:41:25.363 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T10:41:25.501 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T10:41:25.511 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T10:41:25.511 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T10:41:25.537 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T10:41:25.563 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T10:41:25.596 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T10:41:25.599 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T10:41:25.619 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-09-13T10:41:25.625 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-09-13T10:41:25.661 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T10:41:25.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T10:41:25.716 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T10:41:25.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T10:41:25.731 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T10:41:25.743 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T10:41:25.744 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/remote/smithi181 2024-09-13T10:41:25.744 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T10:41:25.790 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903356/remote/smithi195 2024-09-13T10:41:25.791 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T10:41:25.824 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T10:41:25.824 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T10:41:25.827 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T10:41:25.876 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T10:41:25.887 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T10:41:25.887 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T10:41:25.902 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T10:41:25.902 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T10:41:25.904 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T10:41:25.917 INFO:teuthology.orchestra.run.smithi181.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 10:41 /home/ubuntu/cephtest 2024-09-13T10:41:25.931 INFO:teuthology.orchestra.run.smithi195.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 10:41 /home/ubuntu/cephtest 2024-09-13T10:41:25.932 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T10:41:25.944 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T10:41:25.976 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-bitmap} rados supported-random-distro$/{centos_latest} thrashers/one workloads/pool-create-delete} duration: 1094.5530753135681 flavor: default owner: scheduled_akupczyk@teuthology success: true 2024-09-13T10:41:25.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T10:41:26.059 INFO:teuthology.run:pass